JP2023141349A - Video display system, video display method and program - Google Patents

Abstract

To reduce such a possibility that an image in a case where an event of a monitoring object occurs is overlooked.SOLUTION: A video display system 1 includes a first acquisition unit 11, a second acquisition unit 12, a selection unit 13 and a display control unit 14. The second acquisition unit 12 acquires notification information that notifies of the occurrence of an event of a monitoring object from a detection system for detecting the occurrence of the event of the monitoring object within an imaging range of each of a plurality of cameras 40. The selection unit 13 selects the one or more cameras 40 being the display object as the object cameras from the plurality of cameras 40 on the basis of the one or more pieces of notification information acquired by the second acquisition unit 12. The display control unit 14 causes a first display unit 31 to display images of the plurality of cameras 40 acquired by the first acquisition unit 11 and causes a second display unit 32 to display images of the object cameras selected by the selection unit 13. The display control unit 14 can cause the second display unit 32 to display the images of the two or more cameras 40 selected as the object cameras by the selection unit 13.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a video display system, a video display method, and a program. More specifically, the present disclosure relates to a video display system, a video display method, and a program that display videos from a plurality of cameras.

Patent Document 1 discloses a monitoring system for monitoring images of a plurality of network cameras. In this monitoring system, multiple network cameras are divided into groups, images from the multiple network cameras are displayed on a display screen for each group, and the groups displayed on the display screen are switched at regular intervals.

Japanese Patent Application Publication No. 2005-129999

In the above-mentioned monitoring system, images from a plurality of network cameras are simply displayed on the display screen in groups, so there is a possibility that images when a monitored event occurs may be overlooked.

An object of the present disclosure is to provide a video display system, a video display method, and a program that reduce the possibility of missing an image when a monitored event occurs.

A video display system according to one aspect of the present disclosure includes a first acquisition section, a second acquisition section, a selection section, and a display control section. The first acquisition unit acquires image data from each of the plurality of cameras. The second acquisition unit acquires notification information that notifies the occurrence of the event to be monitored from a detection system that detects the occurrence of the event to be monitored within the shooting range of each of the plurality of cameras. The selection unit selects one or more cameras to be displayed as target cameras from the plurality of cameras, based on the one or more notification information acquired by the second acquisition unit. The display control unit displays images of the plurality of cameras on a first display unit based on image data of the plurality of cameras acquired by the first acquisition unit, and displays images of the target camera selected by the selection unit. The image of the target camera is displayed on the second display section based on the image data. The display control section can display images of two or more cameras selected by the selection section as the target cameras on the second display section.

A video display method according to one aspect of the present disclosure includes a first acquisition process, a second acquisition process, a selection process, and a display control process. In the first acquisition process, image data is acquired from each of the plurality of cameras. In the second acquisition process, notification information that notifies the occurrence of the event to be monitored is acquired from a detection system that detects the occurrence of the event to be monitored within the photographing range of each of the plurality of cameras. In the selection process, one or more cameras to be displayed are selected as target cameras from the plurality of cameras, based on the one or more notification information acquired in the second acquisition process. In the display control process, the images of the plurality of cameras acquired in the first acquisition process are displayed on a first display unit, and the images of the target camera selected in the selection process are displayed on a second display unit. . In the display control process, images of two or more cameras selected as the target cameras in the selection process can be displayed on the second display section.

A program according to one aspect of the present disclosure is a program for causing a computer system to execute the video display method.

According to the present disclosure, it is possible to reduce the possibility of missing an image when a monitored event occurs.

FIG. 1 is a block diagram of a video display system according to an embodiment of the present disclosure. FIG. 2 is an explanatory diagram of a display screen displayed on the first display unit by the above video display system. FIG. 3 is an explanatory diagram of a display screen displayed on the second display section by the above video display system. FIG. 4 is an explanatory diagram of a display screen displayed on the second display unit by the above video display system. FIG. 5 is an explanatory diagram of a display screen displayed on the second display section by the video display system same as above. FIG. 6 is an explanatory diagram of a display screen displayed on the second display section by the video display system as described above. FIG. 7 is a flowchart illustrating the operation of the above video display system.

(Embodiment)
(1) Overview Each figure described in the following embodiments is a schematic diagram, and the ratio of the size and thickness of each component in each figure does not necessarily reflect the actual size ratio. Not necessarily.

The video display system 1 of this embodiment includes a first acquisition section 11, a second acquisition section 12, a selection section 13, and a display control section 14.

The first acquisition unit 11 acquires image data from each of the plurality of cameras 40.

The second acquisition unit 12 acquires from the detection system 50 notification information that notifies the occurrence of an event to be monitored. The detection system 50 detects the occurrence of an event to be monitored in the shooting range of each of the plurality of cameras 40.

The selection unit 13 selects one or more cameras 40 to be displayed as target cameras from the plurality of cameras 40, based on the one or more notification information acquired by the second acquisition unit 12.

The display control unit 14 causes the first display unit 31 to display images of the plurality of cameras 40 based on the image data of the plurality of cameras 40 acquired by the first acquisition unit 11.

The display control unit 14 causes the second display unit 32 to display the image of the target camera based on the image data of the target camera selected by the selection unit 13. The display control unit 14 can display images of two or more cameras 40 selected as target cameras by the selection unit 13 on the second display unit 32.

In the video display system 1 of this embodiment, the display control unit 14 causes the first display unit 31 to display images of the plurality of cameras 40, so the user can view the images of the plurality of cameras displayed on the first display unit 31. 40 images can be visually recognized.

Further, the display control unit 14 causes the second display unit 32 to display images of the target camera, and can display images of two or more cameras 40 selected as target cameras on the second display unit 32. Therefore, by visually checking the images of one or more target cameras displayed on the second display section 32, the surveillance officer can confirm the situation of the place where the monitored event has occurred, and It is possible to prevent overlooking of images when this occurs. In addition, by checking the image on the second display section 32, the surveillance officer can check the image when the event to be monitored occurs, so the surveillance officer can check the images of all the cameras 40 displayed on the first display section 31. There is also the advantage that there is no need for visual confirmation, which reduces the burden on the observer.

(2) Details The video display system according to this embodiment will be described in detail below with reference to FIGS. 1 to 7.

(2.1) Configuration FIG. 1 is a block diagram of a video display system 1 according to this embodiment.

For example, the video display system 1 displays images from a plurality of cameras 40 installed at a plurality of locations in the facility on a monitor device (a first display section 31 and a second display section 32) in a monitoring room provided in the facility. Used for displaying on screen. A supervisor stationed in the monitoring room monitors whether or not an abnormality is occurring within the facility by visually observing the camera image displayed on the screen of the monitor device.

Here, the facilities are, for example, buildings such as office buildings, commercial facilities, accommodation facilities, factories, distribution warehouses, public facilities, and educational facilities. One or more cameras 40 are installed at each of a plurality of locations to be monitored within the facility (for example, entrances and exits, hallways, rooms, equipment rooms, warehouses, parking lots, etc.). That is, there are multiple locations to be monitored within the facility, and one or more cameras 40 are installed at each of the multiple locations.

A first display section 31 and a second display section 32 are provided in a monitoring room provided within the facility. The first display section 31 and the second display section 32 are, for example, display devices such as liquid crystal displays. , it is confirmed whether an event to be monitored is occurring within the photographing range of the camera 40.

Here, in this embodiment, a plurality of cameras 40 are installed in the facility. The plurality of cameras 40 include first to fifth cameras 40A to 40E installed at different locations within the facility.

The first to fifth cameras 40A to 40E are installed at multiple locations within the facility that require monitoring, such as entrances and exits of the facility, rooms (rooms used for shops or living rooms), hallways, stairs, and elevators. It may include halls, restrooms, equipment rooms, warehouses, parking lots, etc. The first camera 40A is arranged, for example, in a facility at a position where it can photograph a place where a sensor of a sensor system 51 that detects an event to be monitored is installed. The second camera 40B is placed, for example, at a position where it can photograph the area around an entrance/exit (entrance/exit of a room or facility) whose entrance/exit of people is controlled by the entrance/exit management system 52. The third camera 40C is arranged at a position where it can photograph, for example, the area around a fence installed at the boundary of the facility or a space such as a lobby within the facility. The fourth camera 40D is placed, for example, at a position where it can photograph the surrounding area of a facility where sensors for disaster prevention and crime prevention, such as fire detectors and window opening/closing detection sensors, are installed. The fifth camera 40E is arranged, for example, near the gate of the parking lot at a position where it can photograph a vehicle passing through the gate of the parking lot. Note that the number of each of the first to fifth cameras 40A to 40E may be one, but in this embodiment, the case where each number is plural will be described as an example. The number of the first to fifth cameras 40A to 40E can be changed as appropriate depending on the number of locations that need to be monitored.

Furthermore, the facility is provided with a detection system 50 for detecting the occurrence of an event to be monitored within the photographing range of each of the plurality of cameras 40. When detecting the occurrence of a monitored event, the detection system 50 outputs notification information including information such as the type of the monitored event that has occurred and the location where the monitored event has occurred, to the processing device 10. Detection system 50 includes a plurality of subsystems, each of which detects a monitored event. In this embodiment, the detection system 50 includes a sensor system 51, an entrance/exit management system 52, an image analysis system 53, a management system 54, and a vehicle number recognition system 55 as subsystems. Note that it is not essential that the sensor system 51, the entrance/exit management system 52, the image analysis system 53, the management system 54, and the vehicle number recognition system 55 are all installed in the facility, and they can be omitted as appropriate. Furthermore, the detection system 50 may further include one or more systems that detect other events as subsystems.

The sensor system 51 is a system that detects an event to be monitored in the photographing range of each of the plurality of first cameras 40A. The sensor system 51 includes a sensor arranged in the photographing range of each of the plurality of first cameras 40A, and detects an event to be monitored based on the detection result of the sensor.

Here, the "monitored event" detected by the sensor system 51 includes, for example, at least one of an event related to the indoor environment and an event that a person is present or absent in the facility. If the event to be monitored is related to the indoor environment, the sensor system 51 performs monitoring based on the detection results of an environmental sensor that detects at least one of temperature, humidity, illuminance, atmospheric pressure, CO ₂ concentration, and noise. , detect the event to be monitored. In addition, if the event to be monitored is related to the presence or absence of a person, it may be an event in which a person is switched from a state in which a person is present to a state in which a person is absent based on the detection result of a human sensor that detects the presence or absence of a person, or , detects an event where a person switches from a state where a person is absent to a state where a person is present.

The environmental sensor and the human sensor are IoT (Internet of Things) sensors that can communicate with the processing device 10 via a communication network such as the Internet, and the sensor system 51 receives information from the environmental sensor and the human sensor via the communication network. Collect detection results. Note that the environmental sensor and the human sensor may be sensors that do not have a communication function. If the environmental sensor and the human sensor do not have a communication function, a communication adapter that can communicate with the processing device 10 may be connected to the environmental sensor and the human sensor via a communication network. The sensor system 51 collects detection results from environmental sensors and human sensors via a communication adapter and a communication network.

The entrance/exit management system 52 detects whether or not a person enters or exits, for example, at the entrance/exit of a facility or a room. In other words, the monitored event detected by the entrance/exit management system 52 is the entry or exit of a person. The entrance/exit management system 52 reads identification information from an ID card presented by a person when entering or exiting, and when authentication is successful, unlocks the entrance/exit and permits entry or exit. The entrance/exit management system 52 performs authentication by acquiring biometric information such as fingerprints and iris from a person attempting to enter or exit, and when authentication is successful, unlocks the entrance/exit and permits entry or exit. It's okay.

The image analysis system 53 detects whether an event to be detected is occurring in the photographing range of the plurality of third cameras 40C by image analyzing the image data photographed by the plurality of third cameras 40C. Events to be detected include, for example, a person climbing over a fence installed at the boundary of a facility, a person entering an area that is prohibited to the general public, the occurrence of an accident such as a person falling, or an abnormality caused by a person. This may include actions such as damaging property, removing items, or leaving suspicious items behind. Note that image data of cameras 40 other than the third camera 40C may be input to the image analysis system 53. The image analysis system 53 may detect whether an event to be monitored is occurring in the shooting range of the camera 40 based on the image data of the cameras 40 other than the third camera 40C.

The management system 54 detects a plurality of locations including the shooting range of the plurality of fourth cameras 40C based on the detection results of disaster prevention/crime prevention related sensors installed at a plurality of locations including the shooting range of the plurality of fourth cameras 40C. Detects whether disaster prevention/crime prevention related events are occurring at a location. Here, the disaster prevention/crime prevention related event includes at least one of fire, gas leak, intrusion into the facility from the outside, and activation of an emergency call button. In addition, disaster prevention and crime prevention-related sensors include fire detectors, gas leak detectors, emergency call buttons that detect button presses and issue alarms, open/close detection sensors that detect the opening and closing of doors and windows, and glass windows. at least one of a glass breakage sensor and the like that detects breakage of the glass.

The vehicle number recognition system 55 reads the vehicle number of the vehicle (automobile or two-wheeled vehicle) photographed by the fifth camera 40E by analyzing the image data input from the fifth camera 40E. The vehicle number recognition system 55 detects whether the vehicle to be searched has entered or exited the parking lot of the facility by comparing the read vehicle number with the vehicle number of the vehicle to be searched that has been set in advance.

Here, in at least some of the plurality of cameras 40, the plurality of detection systems 50 detect the occurrence of an event to be monitored within the photographing range of the camera 40. For example, in a part of the shooting range of the first camera 40A, the occurrence of an event to be monitored is detected by the sensor system 51 and the image analysis system 53 that detects the presence or absence of an event by processing the image data of the camera 40. be done. Further, in the photographing range of the second camera 40B, an event to be monitored (entrance or exit of a person) is detected by the entrance/exit management system 52 and the image analysis system 53 that analyzes the image data of the second camera 40B. Further, in the photographing range of the fourth camera 40D, an event to be monitored is detected by the management system 54 and the image analysis system 53 that analyzes the image data of the fourth camera 40D.

The video display system 1 includes a processing device 10 and an image storage section 20.

The processing device 10 includes, for example, a computer system having a processor and a memory. The computer system functions as the processing device 10 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the computer system here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

The processing device 10 has, for example, the functions of a first acquisition section 11, a second acquisition section 12, a selection section 13, a display control section 14, and an operation input section 15. Note that the first acquisition section 11, the second acquisition section 12, the selection section 13, the display control section 14, and the operation input section 15 merely indicate the functions realized by the processing device 10, and are not necessarily actual functions. It does not indicate the configuration.

The first acquisition unit 11 acquires image data from a plurality of cameras 40 installed in a facility. The image data of the plurality of cameras 40 acquired by the first acquisition unit 11 is stored in the image storage unit 20. Note that the image storage unit 20 only needs to store the image data of the plurality of cameras 40 for a predetermined storage period. The storage period of image data is, for example, a period of several days to several months, and can be changed as appropriate by the user of the video display system 1.

The second acquisition unit 12 acquires notification information that notifies the occurrence of an event to be monitored from the detection system 50. Specifically, the second acquisition unit 12 acquires information from a plurality of subsystems (sensor system 51, entrance/exit management system 52, image analysis system 53, management system 54, and vehicle number recognition system 55) included in the detection system 50. , obtain notification information that notifies the occurrence of a monitored event. The notification information includes at least information indicating the type of event to be monitored, information on the location where the event to be monitored has occurred, and the like.

The selection unit 13 selects one or more cameras 40 to be displayed on the second display unit 32 from the plurality of cameras 40 based on the one or more notification information that the second acquisition unit 12 acquired from the detection system 50. Select as camera. Information regarding the installation locations of the plurality of cameras 40 is registered in the processing device 10 in advance, and the selection unit 13 selects the information regarding the location where the event to be monitored included in the notification information and the location of the multiple cameras 40 are registered. Select the target camera based on information such as the installation location. For example, when the second acquisition unit 12 acquires notification information indicating that an event to be monitored has occurred, the selection unit 13 identifies the location where the event to be monitored has occurred from the notification information, and performs monitoring. One or more cameras 40 that photograph the place where the target event has occurred are selected as target cameras.

The operation input unit 15 receives operation information input by the observer using an input device such as a keyboard, a mouse, or a touch panel integrated with a display screen.

The display control unit 14 controls the display of a first display unit 31 and a second display unit 32 installed in a monitoring room of the facility, for example. The first display section 31 and the second display section 32 are display devices such as liquid crystal displays, for example. The first display section 31 and the second display section 32 may each be configured to display images on one screen, or may be configured to display images on multiple screens.

The display control unit 14 causes the first display unit 31 to display the image data of the plurality of cameras 40 acquired by the first acquisition unit 11. FIG. 2 shows a state where the images of cameras 40 No. 1 to No. 9 are displayed on nine child screens obtained by dividing the screen P1 of the first display unit 31 into nine 3×3 screens. In FIG. 2, the images displayed on the nine sub-screens obtained by dividing the screen P1 into nine parts are not shown, but in reality, the image of the camera 40 is displayed on each sub-screen. In FIG. 2, the numbers in parentheses written on each small screen indicate the identification number of the camera 40 being displayed on each small screen. Note that when the number of cameras 40 is more than nine, the cameras 40 to be displayed on the screen P1 may be switched and displayed in a predetermined order every time a predetermined display time (for example, 10 seconds) elapses. Further, the number of divisions of the screen P1 is not limited to nine divisions, but may be divided into four (2×2) or sixteen (4×4), and can be changed as appropriate.

Further, the display control unit 14 causes the second display unit 32 to display the image of the target camera selected by the selection unit 13. When the selection unit 13 selects two or more cameras 40 as target cameras, the display control unit 14 causes the second display unit 32 to display images of the two or more cameras 40 selected as target cameras.

Furthermore, the display control unit 14 causes the second display unit 32 to display images of the target camera from the first time point to the second time point. The first point in time is a first time before the event occurs, and the second point in time is a second time after the event occurs. The event occurrence point is the point in time when the event to be monitored is detected within the shooting range of the target camera. The first time is, for example, 10 seconds. In other words, since the image of the target camera is displayed on the second display unit 32 from the first time point (for example, 10 seconds) before the event occurrence point, the monitoring staff can see that the event to be monitored has occurred. It becomes easier to visually check the image when The second time is, for example, about several minutes. In other words, since the image of the target camera is displayed on the second display unit 32 from the time when the event occurs to the second time point that is a second time later, the surveillance officer can visually check the situation after the event to be monitored occurs. It becomes easier to do. Since the display control unit 14 stops displaying the image of the target camera when the second time period elapses from the time of occurrence of the event, it becomes possible to display an image of a new target camera on the second display unit 32. Note that when the observer performs an operation to stop the display of a desired target camera using an input device, the display control unit 14 controls the display before the second time point arrives based on the operation information received by the operation input unit 15. The display of the image of the target camera may be stopped.

3 to 6 show an example of the screen P2 displayed on the second display section 32. The screen P2 is divided into nine parts, for example, 3×3, and the image of the target camera is displayed on each child screen obtained by dividing the screen P2 into nine parts. That is, in the present embodiment, images of up to nine target cameras can be displayed on the screen P2 of the second display section 32. The screen P2 of the second display unit 32 is divided into nine sub-screens, and the images of the plurality of target cameras are displayed side by side, for example, from the upper left to the lower right in the order in which the events to be monitored occur.

The image storage unit 20 may include, for example, an external storage device such as a hard disk drive. The image storage unit 20 stores image data acquired by the first acquisition unit 11 from the plurality of cameras 40. The image storage unit 20 retains image data from a plurality of cameras 40 for a predetermined retention period (for example, a period of several days to several months), and overwrites the image data with new image data after the retention period has passed. Note that it is not essential to provide the image storage unit 20 in conjunction with the processing device 10, and the image data of the plurality of cameras 40 may be stored in an image server on the cloud.

(2.2) Operation Description The operation of the video display system 1 of this embodiment will be explained based on FIG. 7 and the like. Note that the flowchart shown in FIG. 7 is only an example of the video display method according to the present embodiment, and the order of processing may be changed as appropriate, and processing may be added or omitted as appropriate.

The first acquisition unit 11 of the video display system 1 sequentially performs a first acquisition process of acquiring image data from a plurality of cameras 40 installed within the facility (step ST1). The first acquisition unit 11 stores image data acquired from the plurality of cameras 40 in the image storage unit 20.

The second acquisition unit 12 performs a second acquisition process of acquiring notification information from a plurality of subsystems included in the detection system 50 (step ST2).

When the notification information is not input from the detection system 50 to the second acquisition unit 12, that is, when the event to be monitored has not occurred (step ST3: No), the display control unit 14 receives the notification information from the first acquisition unit 11. Display processing is performed to display the images of the plurality of cameras 40 on the first display section 31 (step ST6).

On the other hand, when notification information is input from the detection system 50 to the second acquisition unit 12, that is, when an event to be monitored occurs (step ST3: Yes), the selection unit 13 selects the notification information acquired by the second acquisition unit 12. Based on the information, a selection process is performed to select a target camera from the plurality of cameras 40 (step ST4). The selection unit 13 selects the camera 40 that photographs the place where the event occurs as the target camera, based on the information about the place where the event to be monitored occurs, which is included in the notification information. Then, the display control unit 14 causes the first display unit 31 to display the images of the plurality of cameras 40 acquired by the first acquisition unit 11, and the images of the one or more cameras 40 selected as target cameras by the selection unit 13. Display processing is performed to display on the second display unit 32 (step ST5). Here, if two or more cameras 40 are selected as target cameras by the selection unit 13, the display control unit 14 displays images of the two or more cameras 40 selected as target cameras side by side on the second display unit 32. do.

The video display system 1 repeatedly executes the processes from steps ST1 to ST5 at a predetermined period. As a result, images from the plurality of cameras 40 are displayed on the first display section 31 in real time. Furthermore, the second display unit 32 displays images of one or more target cameras when the event to be monitored occurs (from the first time point to the second time point).

Here, the operation of the display control unit 14 to display images of the two cameras 40 selected as target cameras on the second display unit 32 will be described with reference to FIGS. 3 to 6.

At a certain point, when the entrance/exit management system 52 detects the entrance of a person and outputs notification information to the processing device 10, the selection unit 13 performs entrance/exit management based on the notification information input from the entrance/exit management system 52. The system 52 selects the second camera 40B, which photographs the entrance and exit where entry and exit are managed, as the target camera. The display control unit 14 changes the image G40B of the second camera 40B from a first time point before the event occurrence time point at which the event to be monitored (here, the entrance of a person) has occurred to a second time point after the event occurrence time point. It is displayed on the screen P2 of the second display section 32 up to this point. FIG. 3 shows a state where the image G40B of the second camera 40B at the first time point is displayed on the screen P2 of the second display unit 32, and the image G40B of the second camera 40B is displayed on the child screen at the upper left of the screen P2. has been done. Further, FIG. 4 shows a state in which an image G40B of the second camera 40B at the time of occurrence of the event is displayed on the screen P2 of the second display section 32, and FIG. A state in which an image G40B of the second camera 40B at two points in time is displayed is shown. In this way, from the first time point that is the first time before the event occurrence time point at which the event to be monitored (person's entry) occurred, to the second time point that is the second time time after the event occurrence time point, the second time point is Since the image G40B of the camera 40B is displayed, it becomes easier for the guard to see how people enter through the entrance/exit. Therefore, it is possible to reduce the possibility that the monitor will overlook the image G40B of the second camera 40B when a person enters the room.

Note that if a new monitoring target event occurs while the image G40B of the second camera 40B is being displayed on the second display unit 32, the display control unit 14 displays the occurrence location of the new monitoring target event. The images taken by the camera 40 are displayed side by side on the screen P2 of the second display section 32. For example, when the image analysis system 53 detects the presence or absence of a person passing by by analyzing the image of the third camera 40C that photographs the passage, the image analysis system 53 detects the presence or absence of a person passing and sends notification information to the processing device 10. Upon output, the selection unit 13 selects the third camera 40C that photographs this passage as the target camera based on the notification information input from the image analysis system 53. At this time, the display control unit 14 changes the image G40C of the third camera 40C from a first time point before the event occurrence time point at which the event to be monitored (in this case, the passage of a person) occurred to a time point after the event occurrence time point. is displayed on the screen P2 of the second display section 32 until the second point in time. FIG. 5 shows a state in which an image G40C of the third camera 40C at the first time point is displayed on the screen P2 of the second display unit 32. In FIG. 5, the previously displayed image G40B of the second camera 40B is displayed on the upper left of the screen P2 of the second display section 32, and the image G40C of the third camera 40C is displayed on the right side of the image G40B.

Further, FIG. 6 shows a state in which an image G40C of the third camera 40C at the time of occurrence of an event in which a person passes is displayed on the screen P2 of the second display unit 32. In the screen example of FIG. 6, since the display of the image G40B of the second camera 40B that was previously displayed has ended, only the image G40C of the third camera 40C is displayed on the screen P2 of the second display section 32. There is. Although the image G40C of the third camera 40C is displayed at the same position on the screen P2 of the second display unit 32, it may be displayed close to the upper left of the screen P2. Thereafter, at a second time point after the event occurrence time point at which the monitored event (here, the passage of a person) occurs, the display control unit 14 stops displaying the image G40C of the third camera 40C.

In this embodiment, the occurrence of multiple types of events is detected by multiple subsystems included in the detection system 50, and images of multiple target cameras caused by the occurrence of multiple types of events are displayed on the second display unit 32. They are displayed all together on screen P2. Therefore, the monitor who monitors the screen P2 of the second display unit 32 can check the images of the target camera on the screen P2 of the second display unit 32 when multiple types of events are detected by the multiple subsystems. This allows for efficient monitoring work and reduces the burden on the monitoring staff.

(3) Modifications The above embodiment is just one of various embodiments of the present disclosure. The embodiments described above can be modified in various ways depending on the design, etc., as long as the objective of the present disclosure can be achieved. Furthermore, the same functions as the video display system 1 may be realized by a video display method, a computer program, a non-temporary recording medium on which the program is recorded, or the like. A video display method according to one embodiment includes a first acquisition process, a second acquisition process, a selection process, and a display control process. In the first acquisition process, image data is acquired from each of the plurality of cameras 40. In the second acquisition process, notification information that notifies the occurrence of the event to be monitored is acquired from the detection system 50 that detects the occurrence of the event to be monitored in the shooting range of each of the plurality of cameras 40 . In the selection process, one or more cameras 40 to be displayed are selected from the plurality of cameras 40 as target cameras, based on the one or more pieces of notification information acquired in the second acquisition process. In the display control process, images of the plurality of cameras 40 are displayed on the first display unit 31 based on the images of the plurality of cameras 40 acquired in the first acquisition process, and based on image data of the target camera selected in the selection process. The image of the target camera is displayed on the second display section 32. In the display control process, images of two or more cameras 40 selected as target cameras in the selection process can be displayed on the second display section 32. Further, a (computer) program according to one embodiment is a program for causing a computer system to execute the above video display method.

Modifications of the above embodiment will be listed below. The modified examples described below can be applied in combination as appropriate.

The main body that executes the video display system 1 or the video display method in the present disclosure includes a computer system. A computer system mainly consists of a processor and a memory as hardware. When the processor executes the program recorded in the memory of the computer system, the function as an execution entity of the video display system 1 or the video display method according to the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, may be provided through a telecommunications line, or may be recorded on a non-transitory storage medium readable by the computer system, such as a memory card, optical disc, hard disk drive, etc. may be provided. A processor in a computer system is comprised of one or more electronic circuits including semiconductor integrated circuits (ICs) or large scale integrated circuits (LSIs). The integrated circuits such as IC or LSI referred to herein have different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, an FPGA (Field-Programmable Gate Array), which is programmed after the LSI is manufactured, or a logic device that can reconfigure the connections inside the LSI or reconfigure the circuit sections inside the LSI, may also be used as a processor. I can do it. The plurality of electronic circuits may be integrated into one chip, or may be provided in a distributed manner over a plurality of chips. A plurality of chips may be integrated into one device, or may be distributed and provided in a plurality of devices. The computer system herein includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits including semiconductor integrated circuits or large-scale integrated circuits.

Furthermore, it is not an essential configuration for the video display system 1 that multiple functions of the video display system 1 are integrated into one housing, and the components of the video display system 1 are distributed among multiple housings. may be provided. Furthermore, at least some of the functions of the video display system 1 may be realized by a cloud (cloud computing) or the like.

On the contrary, in the embodiments described above, at least some of the functions of the video display system 1 that are distributed among a plurality of devices may be integrated into one housing. Furthermore, some functions of the video display system 1 and the detection system 50 may be integrated into one housing.

In the above embodiment, the detection system 50 may include two or more subsystems that each detect the occurrence of an event to be monitored in the shooting range of the display candidate camera that is one of the plurality of cameras 40. good. In this case, the selection unit 13 may select whether or not to use the display candidate camera as the target camera based on the detection results of two or more subsystems.

For example, when the entrance/exit management system 52 detects the entry of a person and outputs a notification signal to the processing device 10, the second camera 40B captures an image of the entrance/exit where the entrance/exit management system 52 manages the entry and exit of the person. When the image analysis system 53 analyzes this and determines that multiple people have entered (so-called tailgating entry), the selection unit 13 selects the second camera 40B as the target camera, and displays the image of the second camera 40B on the second display unit. 32 may be displayed. On the other hand, if the image analysis system 53 analyzes the image taken by the second camera 40B that captures the entrance/exit, and it is found that only one person has entered, the selection unit 53 is not determined to be an abnormal event, and the image from the second camera 40B is not displayed on the second display unit 32. Thereby, if the event is not an abnormal event, no image is displayed on the second display section 32, thereby reducing the burden on the observer who monitors the second display section 32.

In addition, when the management system 54 detects a person's intrusion into a storage place where important items are stored using an intrusion sensor and outputs notification information notifying the person's intrusion to the processing device 10, the storage place is When the image analysis system 53 analyzes the image of the camera to be photographed (for example, the fourth camera 40D) and detects the presence of a person, the selection unit 13 selects the fourth camera 40D as the target camera, and selects the fourth camera 40D. The image may be displayed on the second display section 32. On the other hand, if no person is detected as a result of the image analysis system 53 analyzing the image taken by the fourth camera 40D photographing the storage location, the selection unit 13 does not determine that it is an abnormal event, and the fourth camera 40D The image of 40D is not displayed on the second display section 32. Thereby, the burden on the monitor who monitors the second display section 32 can be reduced.

Note that when the notification information notifying the intrusion of a person is output to the processing device 10, the selection unit 13 selects the fourth camera 40D as the target camera, and displays the image of the fourth camera 40D on the screen of the second display unit 32. The display mode may be changed based on the result of image analysis performed by the image analysis system 53 on the image taken by the fourth camera 40D. For example, if the intrusion sensor detects an intrusion of a person and the image analysis system 53 analyzes the image of the fourth camera 40D and detects the person, it is determined that there is a high probability that this is an abnormal event, and the second display is displayed. The image of the fourth camera 40D is displayed on the screen P2 of the unit 32 to perform the first stage alert display. On the other hand, if the image analysis system 53 analyzes the image of the fourth camera 40D when the intrusion sensor detects the intrusion of a person and cannot detect the person, it is determined that the probability of an abnormal event is low, and the The image of the fourth camera 40D is displayed on the screen P2 of the second display section 32, and a second stage alert display in which the abnormality level is lower than the first stage is performed. Note that the display control unit 14 displays the image of the target camera on the screen P2 of the second display unit 32 in a display mode that is more conspicuous as the abnormality level is higher. Therefore, if there is a high probability that it is an abnormal event, the image of the target camera is displayed in a more conspicuous manner on the screen P2 of the second display unit 32, reducing the possibility that the observer will overlook it. .

Note that when the second acquisition unit 12 receives notification information from two or more subsystems regarding an event that occurred at a shooting location of a certain camera 40, the selection unit 13 determines whether or not this camera 40 should be the target camera. may be determined using the following determination method. When two or more pieces of notification information received from two or more subsystems each include a judgment value indicating the probability of occurrence of an event, the selection unit 13 selects a subsystem from the judgment value included in each of the two or more pieces of notification information. The total value is calculated by multiplying each by the set weighting coefficient and calculating the sum. Then, the selection unit 13 compares the total value with the threshold value, and if the total value is higher than the threshold value, determines that the camera 40 is to be the target camera. Note that the judgment value included in the notification information is 0 or 1 in the case of notification information based on the detection result of a sensor such as a human sensor, but in the case of notification information input from the image analysis system 53 etc., it is a judgment value of the event. This is the probability of occurrence (eg, percentage).

Further, the selection unit 13 may determine whether or not to set the display candidate camera as the target camera by inputting the notification information acquired by the second acquisition unit 12 into the learned model generated by machine learning. . Note that the processing device 10 may include a learning unit that generates a trained model that determines whether or not a display candidate camera is to be a target camera when notification information is input. For example, if the observer performs an operation to enlarge and display the image of the target camera displayed on the second display section 32, the learning section determines that the process of selecting the target camera is correct and re-creates the trained model. learn. Further, if the monitor performs an operation to stop displaying the image of the target camera without checking the image, the learning unit re-learns the learned model because the process of selecting the camera as the target camera is incorrect. In this way, the learning section re-learns the learned model based on the operations performed by the observer on the image of the target camera displayed on the second display section 32, thereby improving the learned model. be able to.

The display control unit 14 also displays the images of the two or more cameras selected by the selection unit 13 as target cameras, the installation location of the two or more cameras, the type of event to be monitored notified by the notification information, and the target camera to be monitored. The events may be arranged and displayed in an order according to a priority based on at least one of the event durations. For example, a first priority is set for a plurality of installation locations where a plurality of cameras 40 are each installed, depending on the importance of the location. Specifically, a first priority is set for each of the plurality of installation locations such that the more important the location is for the safety of the facility, the higher the first priority is set. Furthermore, there are a plurality of types of events to be monitored, and a second priority level is set for each type of event to be monitored. For example, a second priority is set for each of a plurality of events such that the higher the risk of an event from the perspective of disaster prevention or crime prevention, the higher the second priority is set. In addition, for images from two or more cameras, priority is given to cases where the duration of the event to be monitored is longer than the reference time than cases where the duration of the event to be monitored is shorter than the predetermined reference time. A higher third priority is set. The display control unit 14 displays images from two or more cameras 40 on the second display unit 32 in an order according to the priority order based on the first to third priorities, and The taller the image, the closer it is to the beginning. This has the advantage that the observer who monitors the screen of the second display section 32 can easily distinguish between the more important images among the images of the two or more cameras 40 displayed on the second display section 32. .

Further, the display control unit 14 may display the image of the target camera on the second display unit 32 in a display mode according to the type of event to be monitored that is notified by the notification information. For example, the screen P2 of the second display unit 32 is divided into nine parts, and the image of the target camera is displayed on a child screen obtained by dividing the screen P2 into nine parts. The display color of the sub-screen border is changed according to the Thereby, the monitoring staff can understand the type of event to be monitored based on the color of the frame line surrounding the image of the target camera. Note that the display mode according to the type of event to be monitored is not limited to changing the color of the frame line surrounding the image of the target camera to a color corresponding to the type of event to be monitored; Depending on the type, the shape of the frame surrounding the image of the target camera may be changed or the frame may be displayed blinking. Furthermore, when displaying the image of the target camera on the screen of the second display unit 32, the display control unit 14 generates a notification sound according to the type of event to be monitored. It may also be output from a speaker or the like. Further, the display control unit 14 may display the image of the target camera on the second display unit 32 in a display mode according to the above priority order. For example, the display control unit 14 may change the color, brightness, shape, thickness, etc. of the frame line surrounding the image depending on the priority of the target camera, so that the target camera with a higher priority is more conspicuous. It can be displayed in an easy-to-use display mode.

Further, the display control unit 14 may display images of one or more related cameras related to the target camera among the plurality of cameras 40 on the second display unit 32. One or more related cameras are one or more cameras 40 that are related to the camera 40 selected as the target camera. The one or more related cameras are, for example, one or more cameras 40 installed at a location where an event to be monitored that occurs at the installation location of the camera 40 selected as the target camera is expected to spread. When the event to be monitored is a fire, the relevant cameras are one or more cameras installed at one or more locations where the fire is expected to spread. When the event to be monitored is the detection of a suspicious person, the related cameras are one or more cameras installed at locations where the suspicious person is expected to move. By viewing the images of the target camera and related cameras displayed on the second display section 32, the surveillance officer can grasp in more detail the situation in which the event to be monitored is occurring.

In the video display system 1 of the embodiment described above, the screen P1 of the first display unit 31 is composed of the screen of one display device, but may be composed of the screens of a plurality of display devices. Further, although the screen P2 of the second display unit 32 is composed of the screen of one display device, it may be composed of the screens of a plurality of display devices.

In the video display system 1 of the above embodiment, the facility to be monitored is one building, but the facility to be monitored is not limited to one building, and may include a plurality of buildings. That is, the video display system 1 may display images from a plurality of cameras 40 installed in a plurality of buildings.

(summary)
As explained above, the video display system (1) of the first aspect includes a first acquisition section (11), a second acquisition section (12), a selection section (13), and a display control section (14). and. The first acquisition unit (11) acquires image data from each of the plurality of cameras (40). The second acquisition unit (12) acquires notification information that notifies the occurrence of a monitored event from a detection system (50) that detects the occurrence of a monitored event in the shooting range of each of the plurality of cameras (40). do. The selection unit (13) selects one or more cameras (40) to be displayed as target cameras from the plurality of cameras (40) based on the one or more notification information acquired by the second acquisition unit (12). . The display control unit (14) causes the first display unit (31) to display images of the plurality of cameras (40) based on the image data of the plurality of cameras (40) acquired by the first acquisition unit (11), The image of the target camera is displayed on the second display unit (32) based on the image data of the target camera selected by the selection unit (13). The display control section (14) can display images of two or more cameras (40) selected as target cameras by the selection section (13) on the second display section (32).

According to this aspect, images of two or more cameras (40) selected as target cameras by the selection unit (13) can be displayed on the second display unit (32), so that when an event to be monitored occurs, The possibility of missing an image can be reduced.

In the video display system (1) of the second aspect, in the first aspect, the detection system (50) detects a target to be monitored in the photographing range of the display candidate camera, which is one of the plurality of cameras (40). It includes two or more subsystems (51 to 55) that each detect the occurrence of an event. A selection unit (13) selects whether or not a display candidate camera is to be a target camera based on the detection results of two or more subsystems (51 to 55).

According to this aspect, the selection unit (13) reliably selects a display candidate camera in which an event to be monitored has occurred at a shooting location as a target camera based on the detection results of two or more subsystems (51 to 55). can do.

In the video display system (1) of the third aspect, in the first or second aspect, the display control section (14) displays the images of the target camera from the first time point to the second time point on the second display section (32). ) is displayed. The first point in time is the first time before the event occurrence point when the occurrence of the monitored event is detected in the shooting range of the target camera, and the second point in time is the second time point after the event occurrence point. This is the point in time.

According to this aspect, the observer who monitors the screen of the second display section (32) can visually recognize images before and after the event occurs.

In the video display system (1) of the fourth aspect, in any one of the first to third aspects, the display control unit (14) controls two or more cameras (40 ) are displayed side by side in an order according to the priority order set for each of the images of two or more cameras (40). The priority is based on at least one of the installation location of each of the two or more cameras (40), the type of event to be monitored notified by the notification information, and the duration of the event to be monitored.

According to this aspect, it is possible to reduce the possibility that an image of a target camera having a high priority will be overlooked.

In the video display system (1) of the fifth aspect, in any one of the first to fourth aspects, the display control unit (14) displays the image of the target camera according to the monitoring target event notified by the notification information. It is displayed on the second display section (32) in a display mode according to the type.

According to this aspect, images of the target camera can be displayed in an easy-to-see manner according to type.

In the video display system (1) of the sixth aspect, in any one of the first to fifth aspects, the display control unit (14) controls one or more of the plurality of cameras (40) related to the target camera. The image of the related camera is displayed on the second display section (32).

According to this aspect, the occurrence status of the event to be monitored can be grasped in more detail based on the images of one or more related cameras displayed on the second display section (32).

The video display method of the seventh aspect includes a first acquisition process, a second acquisition process, a selection process, and a display control process. In the first acquisition process, image data is acquired from each of the plurality of cameras (40). In the second acquisition process, notification information that notifies the occurrence of an event to be monitored is acquired from a detection system (50) that detects the occurrence of an event to be monitored in the shooting range of each of the plurality of cameras (40). In the selection process, one or more cameras (40) to be displayed are selected from the plurality of cameras (40) as target cameras, based on the one or more notification information acquired in the second acquisition process. In the display control process, the images of the plurality of cameras (40) acquired in the first acquisition process are displayed on the first display unit (31), and the images of the target camera selected in the selection process are displayed on the second display unit (32). Display. In the display control process, images of two or more cameras (40) selected as target cameras in the selection process can be displayed on the second display section (32).

According to this aspect, images of two or more cameras (40) selected as target cameras in the selection process can be displayed on the second display section (32), so that images when an event to be monitored occurs may be overlooked. The possibility can be reduced.

The program of the eighth aspect is a program for causing a computer system to execute the video display method of the seventh aspect.

According to this aspect, it is possible to reduce the possibility of missing an image when an event to be monitored occurs.

Not limited to the above aspects, various configurations (including modifications) of the video display system (1) according to the embodiment can be applied to a video display method of the video display system (1), a (computer) program, or a non-computer recording program. It can be realized by a temporary recording medium or the like.

The configurations according to the second to sixth aspects are not essential to the video display system (1) and can be omitted as appropriate.

1 Video display system 11 First acquisition section 12 Second acquisition section 13 Selection section 14 Display control section 31 First display section 32 Second display section 40 Camera 50 Detection system 51 Sensor system (subsystem)
52 Entrance/exit control system (subsystem)
53 Image analysis system (subsystem)
54 Management system (subsystem)
55 Vehicle number confirmation system (subsystem)

Claims (8)

a first acquisition unit that acquires image data from each of the plurality of cameras;
a second acquisition unit that acquires notification information that notifies the occurrence of the monitored event from a detection system that detects the occurrence of the monitored event in the shooting range of each of the plurality of cameras;
a selection unit that selects one or more cameras to be displayed as target cameras from the plurality of cameras, based on the one or more notification information acquired by the second acquisition unit;
A display control unit;
The display control section includes:
displaying the images of the plurality of cameras on a first display unit based on the image data of the plurality of cameras acquired by the first acquisition unit;
The image of the target camera is displayed on a second display unit based on the image data of the target camera selected by the selection unit,
The display control unit is capable of displaying images of two or more cameras selected as the target cameras by the selection unit on the second display unit.
Video display system. The detection system includes two or more subsystems that each detect the occurrence of the event to be monitored in a shooting range of a display candidate camera that is one of the plurality of cameras,
The selection unit selects whether or not the display candidate camera is to be the target camera based on the detection results of the two or more subsystems.
The video display system according to claim 1. The display control unit displays images of the target camera from a first time point to a second time point on the second display unit,
The first time point is a time point that is a first time before the event occurrence time point at which the occurrence of the monitoring target event is detected in the shooting range of the target camera,
The second time point is a second time point after the event occurrence time point,
The video display system according to claim 1 or 2. The display control unit displays images of the two or more cameras selected as the target cameras by the selection unit in an order according to priorities set for the images of the two or more cameras, respectively,
The priority order is based on at least one of the installation location of each of the two or more cameras, the type of the monitored event notified by the notification information, and the duration of the monitored event.
The video display system according to any one of claims 1 to 3. The display control unit displays the image of the target camera on the second display unit in a display mode according to the type of the monitoring target event notified by the notification information.
The video display system according to any one of claims 1 to 4. The display control unit displays images of one or more related cameras related to the target camera among the plurality of cameras on the second display unit.
The video display system according to any one of claims 1 to 5. a first acquisition process of acquiring image data from each of the plurality of cameras;
a second acquisition process of acquiring notification information notifying the occurrence of the event to be monitored from a detection system that detects the occurrence of the event to be monitored in the shooting range of each of the plurality of cameras;
a selection process of selecting one or more cameras to be displayed as target cameras from the plurality of cameras, based on the one or more notification information acquired in the second acquisition process;
Display control processing;
In the display control process,
displaying the images of the plurality of cameras acquired in the first acquisition process on a first display unit;
displaying the image of the target camera selected in the selection process on a second display section;
In the display control process, images of two or more cameras selected as the target cameras in the selection process can be displayed on the second display unit.
Image display method. to the computer system,
A program for executing the video display method according to claim 7.

Images