JP6559759B2 - Monitoring device and monitoring system - Google Patents

Description

  The present invention relates to a monitoring apparatus using a monitoring camera installed indoors and outdoors, and more particularly to a monitoring apparatus that can arrange images of a plurality of monitoring cameras on a display by a free and simple operation.

  In a monitoring device, particularly a medium-sized or larger monitoring device, videos from a plurality of monitoring cameras are collected on a monitoring display that is monitored by a monitor. As the number of surveillance cameras increases, it becomes important how efficiently and reliably images from a plurality of surveillance cameras are presented on the surveillance display. For this reason, a method is adopted in which one screen of a relatively large monitoring display is divided into a plurality of areas, and video from each monitoring camera is assigned to each area.

JP 2005-269342 A

  Japanese Patent Application Laid-Open No. 2004-228561 discloses a method for assigning video to a screen divided into a plurality of areas. According to this method, the supervisor first determines the number of divisions of the display screen of the display device by the setting means. A plurality of areas divided by the decision appear, and video is assigned to these areas. The monitor first selects an area to be allocated with a pointing device such as a mouse, and then displays a menu by an operation such as clicking on the selected area. The menu includes selectable video identifiers, and the monitor selects the video to be displayed in the area by selecting the identifier. Then, the selected video is displayed in the area. In this way, the video to be displayed is assigned to each area.

  However, an operation such as expanding a menu on an area to be allocated becomes very difficult when the number of images to be selected increases. If you try to expand a menu that has a large number of images to select at the edge of the screen, a part of the menu may protrude outside the screen, making it impossible to select the images. It also falls into such a situation.

  Based on the above problems, there arises a problem of providing a user interface that can realize a task with high operability such as selecting one video from a large number of videos and assigning it to one area of the divided screen.

  In order to solve such a problem, the present invention arranges a camera icon indicating an image from a camera to be selected and a position icon indicating a position of an area obtained by dividing an allocation destination screen. A monitoring device capable of displaying an image from a selected camera in an area indicated by a position icon by clicking the icon with a pointing device such as a mouse and then clicking a position icon indicating a frame to be allocated. I will provide a.

  Specifically, a video acquisition unit that acquires different images from multiple cameras, and a camera selection that arranges multiple camera icons on the display so that the images from the cameras are arranged in frames that are displayed on the display Section, a position selection section in the frame in which a plurality of position icons indicating positions in the frame where the image from the camera is displayed on the display can be selected on the display, selection of the camera icon in the camera selection section and other cameras A video placement unit that places the video from the camera indicated by the selected camera icon at the position within the frame indicated by the position icon selected by the position selection unit within the frame during the selection of the icon, and plays the placed video And a playback unit.

  Further, in addition to the above features, the in-frame position selection unit provides a monitoring apparatus having a sequence setting unit that allows a position icon to be selected for each different frame according to time.

  In addition to the above features, the camera selection unit provides a monitoring apparatus having a hierarchical structure selection unit that can select camera icons by dividing them into groups having a hierarchical structure.

  In addition to the above features, an intra-frame position acquisition unit that acquires the intra-frame position of one frame by a combination of the area and position that occupies the frame, and an intra-frame position selection unit to select the acquired intra-frame position An in-frame position output unit for outputting is provided.

  Further, in addition to the above-described features, a recording unit that records different videos from a plurality of cameras in association with the cameras, and the video acquisition unit includes a recorded video acquisition unit that acquires recorded videos from the plurality of cameras. A monitoring device is provided.

  In addition to the above features, the recording unit further includes a disk recording unit that records video in a series on a plurality of portable discs, and a replacement time notification unit that notifies a disk replacement time of the disk recording unit. I will provide a.

  In addition to the above features, the monitoring device further provides a monitoring device further including a comment recording / reproducing unit capable of recording / reproducing a comment in association with the video reproduced by the reproducing unit.

In addition to the above features, any one of the monitoring devices and the cameras installed in a plurality of different locations,
Provided is a monitoring system having an abnormality detection device installed at a plurality of different locations, and a camera control unit that controls the shooting direction of the camera in the vicinity when the abnormality detection device detects an abnormality.

  Further, in addition to the above features, there is further provided a monitoring system that further includes a sensor that detects a movement of a person or the like, and wherein the camera control unit further includes a sensor camera control unit that controls a shooting direction in response to detection by the sensor.

  In addition to the above characteristics, the playback unit of the monitoring device adds identification information for each video so that at least one of a real-time monitoring video, a recorded video, and a video when an abnormality is detected can be identified. There is provided a monitoring system further comprising information adding means.

  With the monitoring device and the monitoring system as described above, it is possible to provide a user interface with high operability. Thereby, the supervisor can acquire necessary information efficiently and reliably from a large amount of video information acquired by a plurality of cameras.

The figure which shows the outline | summary of a process of the monitoring apparatus of Example 1. FIG. The figure which shows the functional structure of the monitoring apparatus concerning Example 1. FIG. The figure which showed the window displayed on the display of the monitoring apparatus which has a hierarchical structure selection means in Example 1. FIG. The figure which shows an example of the video arrangement | positioning of the display screen in the monitoring apparatus concerning Example 1. FIG. The figure which shows the outline | summary of the process of the comment recording / reproducing part in the monitoring apparatus concerning Example 1. FIG. The flowchart which shows an example of the flow of a process of the monitoring apparatus in Example 1. The figure which shows an example of the hardware constitutions of the monitoring apparatus concerning Example 1. FIG. The figure which shows the outline | summary of the process of the monitoring apparatus concerning Example 2. FIG. The figure which shows the outline of the screen for setting the sequence display of the monitoring apparatus concerning Example 2 The figure which shows the functional structure of the monitoring apparatus concerning Example 2. FIG. The flowchart which shows an example of the flow of a process of the monitoring apparatus in Example 2. The figure which shows an example of the hardware constitutions of the monitoring apparatus concerning Example 2. FIG. The figure which shows an example of the video display in the monitoring apparatus concerning Example 3. The figure which shows the functional structure of the monitoring apparatus concerning Example 3. FIG. The flowchart which shows an example of the flow of a process of the monitoring apparatus in Example 3. The figure which shows an example of the hardware constitutions of the monitoring apparatus concerning Example 3. FIG. The figure which shows the functional structure of the monitoring apparatus concerning Example 4. FIG. The flowchart which shows an example of the flow of a process of the monitoring apparatus in Example 4. The figure which shows an example of the hardware constitutions of the monitoring apparatus concerning Example 4. FIG. The figure which shows the functional structure of the monitoring apparatus concerning Example 5. FIG. Flowchart illustrating an example of a processing flow of the monitoring apparatus according to the fifth embodiment. The figure which shows an example of the hardware constitutions of the monitoring apparatus concerning Example 5. FIG.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The relationship between the embodiment and the claims is as follows. Example 1 is mainly related to claims 2 and 6 , Example 2 is mainly related to claim 1 , Example 3 is mainly related to claim 3 , Example 4 is mainly related to claims 4 and 5 , Example 5 mainly relates to claims 7, 8, and 9 . The present invention should not be limited to these examples, and can be implemented in various modes without departing from the scope of the present invention.

<Overview>

  FIG. 1 is a diagram showing an outline of processing of the monitoring apparatus of this embodiment. As shown in this figure, a management screen window (0101) is displayed on the display of the monitoring apparatus. It is desirable to design the monitor screen and the management screen as separate screens so that monitoring is not interrupted during execution of settings. A plurality of camera icons (0102) are arranged on the window, and a frame (0103) for outputting video is arranged next to the icons. The frame is divided, and a position icon is arranged for each frame so that images from a plurality of cameras can be selectively output. Here, the letters A to D have the role of position icons. The monitoring apparatus according to the present embodiment is characterized in a video selection method when video from a plurality of cameras is assigned to a frame. First, the user clicks and selects the camera icon of the camera 2 to be assigned (1). Next, an in-frame position icon “A” for outputting video from the camera is clicked to select it. Then, the video of the camera 2 selected in (1) is arranged and displayed at the position in the frame selected in (2).

  Below, the function of the monitoring apparatus of this embodiment, the flow of processing, and the contents of hardware will be described in detail. Note that the functional blocks of the apparatus described below can be realized as a combination of hardware and software. Specifically, if a computer is used, a CPU (Central Processing Unit), a main memory, a bus, or a secondary storage device (a storage medium such as a hard disk drive, a non-volatile memory, a CD, a DVD, and the like) Read drive, etc.), input devices such as surveillance cameras used for information input, human sensors, door opening / closing sensors, display devices such as printing devices and displays, alarm devices, and other hardware components such as external peripheral devices In addition, an interface for the external peripheral device, a communication interface, a driver program for controlling the hardware, other application programs, a user interface application, and the like. Then, by CPU processing according to the program developed on the main memory, the data input from the input device or other interface and held in the memory or hard disk is processed and stored, An instruction for controlling the software is generated. Alternatively, the functional blocks of this apparatus may be realized by dedicated hardware.

  The present invention can be realized not only as an apparatus but also as a method. A part of the invention can be configured as software. Furthermore, a program used for causing a computer to execute such software and a recording medium on which the program is fixed are naturally included in the technical scope of the present invention (the same applies throughout this specification).

<Functional configuration>
FIG. 2 is a diagram illustrating a functional configuration of the monitoring apparatus according to the present embodiment. The “monitoring device” (0200) according to the present embodiment includes a “video acquisition unit” (0201), a “camera selection unit” (0202), an “in-frame position selection unit” (0203), and a “video placement unit”. ”(0204) and“ Playback unit ”(0205).

  The “video acquisition unit” (0201) has a function of acquiring different videos from a plurality of cameras. “Video” includes both moving images and still images. In addition to live video, video includes video recorded and accumulated. “Camera” includes a surveillance camera installed outdoors or indoors, a wearable camera worn by a security guard or the like on the body. A thermography, an X-ray camera, and the like are also included in the “camera” of this embodiment. “Acquisition” means receiving a video signal from a camera as an input, and includes a wired input through a cable connection, a wireless input such as a wireless LAN, and short-range wireless communication. The acquired video is output to a video layout unit (0204) described later. The functions of this unit are realized by the CPU and RAM of the computer and a video acquisition program executed by the CPU.

  The “camera selection unit” (0202) has a function of arranging a plurality of camera icons to be selectable on the display in order to arrange the images from the cameras in frames displayed on the display. The “camera icon” is not limited as long as it can identify at least a plurality of cameras, and a button with a caption arranged on the window as shown in FIG. 1, a thumbnail of a video (still image, video, intermittent video), etc. Included in the concept. In addition, since it is “selectively arranged”, it is desirable that the selection can be made at a glance. For example, if the button is in the selected state, its color may change, or a check box, a toggle button or the like may be employed. The functions of this unit are realized by a CPU and RAM of a computer, a camera selection program executed by the CPU, and a U / I such as a mouse.

  The “camera selection unit” (0202) may include a hierarchical structure selection unit (not shown) that can select camera icons by dividing them into groups having a hierarchical structure. FIG. 3 is a diagram showing a window displayed on the display of the monitoring apparatus having the hierarchical structure selection means. As shown in this figure, there are four groups, and icons for each group are displayed. When a selection is made by clicking “Group 1”, four camera icons belonging to Group 1 are displayed at the bottom of the screen. Although the example shown in the figure has two layers, it can be configured with an arbitrary depth. As shown in the figure, a hierarchy can be displayed by enclosing camera icons in the same hierarchy with lines, or by using a pull-down menu to display only each hierarchy sequentially. The function of this means is realized by a CPU and RAM of a computer, a hierarchical structure selection program executed by the CPU, and a U / I such as a mouse.

  The “in-frame position selection unit” (0203) has a function of arranging a plurality of position icons on the display so as to select a plurality of position icons indicating positions in the frame where the video from the camera is displayed on the display. A “frame” refers to an area for displaying an image in the display. According to FIG. 1, the image display area is divided into four parts A to D, and images from four cameras can be displayed. The “position icon” is an object that is arranged in a frame and for selecting a position for displaying an image. Selection is performed by clicking the object with a pointing device such as a mouse. In FIG. 1, characters A to D are position icons. The functions of this unit are realized by a CPU and RAM of a computer, an intra-frame position selection program executed by the CPU, and a U / I such as a mouse.

  The “video arrangement unit” (0204) is selected at the position in the frame indicated by the position icon selected by the position selection unit in the frame between the selection of the camera icon in the camera selection unit and the selection of another camera icon. It has a function of arranging video from a camera indicated by a camera icon. “Placing video” executes a process of storing a plurality of streams of a plurality of videos acquired from the video acquisition unit (0201) at selected intra-frame positions of consecutive frames of one stream by calculation processing of a computer. It is to be. By selecting the position in the frame between the selection of the camera icon and the selection of another camera icon, an operation such as “select camera icon” → “select position icon” is executed. Video placement is executed by two operations of “select icon” → “select position icon”. In principle, the arrangement is fixed when the “camera icon selection” operation is performed next. In addition, when there is no selection of the camera icon, the arrangement determining process may be performed on the condition that a predetermined time has passed. When the video is placed at the last position in the frame, there is no need for “select camera icon” next. Accordingly, the arrangement is determined so as to be performed by an operation different from the selection of the camera icon. For example, when the next camera icon is not selected for a predetermined time from the selection of the last position icon, or when an image from another camera is placed in a frame of another stream, the process is processed to a predetermined next operation. This is the case when As a result, it is possible to specify which camera image is to be displayed at which position in the frame. By the way, when “select camera icon 1” → “select camera icon 2” and continue to select the camera icon, the previously selected camera icon, in this case, the selection of camera icon 1 is canceled. It may be configured. Further, when “selection of camera icon” → “selection of position icon 1” → “selection of position icon 2” and selection of the position icon continue, both “position icon 1” and “position icon 2” are displayed. A configuration in which an image related to the camera icon 1 is displayed at such a position may be used. Or it is good also as a structure which cancels selection of the position icon selected before among the position icons selected continuously. In addition, a cancel button for stopping the selection may be provided. The functions of this unit are realized by a CPU and RAM of a computer and a video arrangement program executed by the CPU.

  FIG. 4 is a diagram showing an example of the video layout of the display screen in the monitoring apparatus of the present embodiment. The left side of the figure shows the arrangement of cameras on the monitoring target on a schematic map (including a floor plan). On the right side is a screen having an icon for selecting a position in the frame, and here, one frame is divided into seven. On such a screen, the camera arrangement on the left approximate map is mapped to the position in the frame of the right frame, and the video from the camera is arranged. Specifically, camera 1 → frame position A, camera 2 → frame position B, camera 3 → frame position C, camera 4 → frame position D, camera 5 → frame position E, camera 6 → frame. The camera and the in-frame position are associated with each other such as position F, camera 7 → in-frame position G. This makes it possible to monitor while intuitively grasping the position of the camera image within the monitoring target.

  The “playback unit” (0205) has a function of playing back the arranged video. Specifically, the video of the selected camera is placed in the selected frame and displayed by an output device such as a display. As an output mode, as shown in FIG. 1, the image is displayed on the same window as the camera icon and output, displayed on a different window from the camera icon, and output or the camera icon is displayed on the same display. A plurality of modes such as outputting to a display different from the display can be considered. The functions of this unit are realized by a CPU and RAM, a reproduction program executed by the CPU, and an output device such as a video card and a display.

  In addition to the above configuration, a “comment recording / playback unit” (not shown) that can record and play back comments in association with the video played back by the playback unit may be included. FIG. 5 is a diagram showing an outline of processing of the comment recording / playback unit. Select one of the images being played by tapping, etc., and insert a comment into that image. If the scene where a comment is to be entered is a short time, it can be configured to insert a comment at an appropriate timing by performing slow playback or still image playback. As shown in this figure, when a comment is entered in a text box (0501) and a registration button (0502) is pressed, the entered characters are displayed on the status bar (0503). The standard sentence is registered in advance as a stamp, and the registration is completed by pressing a stamp button (0504). As shown in FIG. 5, a fixed sentence may be displayed in advance as the caption of the stamp button (0504). The comment may be able to refer to the registration history. In the monitoring apparatus of the present embodiment, the comment is displayed on the status bar, but a mode (0505) in which the comment is overlaid on the video of the designated frame is also conceivable. Furthermore, information displayed on the screen such as comments and camera names may have a function of switching between display and non-display in a batch with a toggle button or the like provided in the screen.

<Process flow>
FIG. 6 is a flowchart for illustrating an example of a flow of processing when an image is arranged using the monitoring apparatus according to the present embodiment. First, different videos from a plurality of cameras are acquired (step S0601). Next, a plurality of camera icons are selected on the display in order to arrange the images from the cameras in frames that are displayed on the display (step S0602). Next, a plurality of position icons indicating the position in the frame where the image from the camera is displayed on the display are selected on the display (step S0603). Subsequently, an image from the camera indicated by the selected camera icon is arranged at the position in the frame indicated by the selected position icon between the selection of the camera icon and the selection of another camera icon (step S0604). Next, it is determined whether or not the arrangement is finished (step S0605). If it is not finished, the process returns to the selection of the camera icon (step S0602), and if it is finished, the arranged video is reproduced (step S0606).

<Hardware configuration>
FIG. 7 is a diagram illustrating an example of a hardware configuration of the monitoring apparatus according to the present embodiment. Hereinafter, description will be made with reference to this figure.

  As shown in this figure, the monitoring apparatus according to the present embodiment includes a “CPU (central processing unit)” (0701) that performs various arithmetic processes, a “nonvolatile memory” (0702) such as an HDD, and a volatile type. “RAM” (0703) which is a storage medium is provided. A “display” (0705) is connected to the “video card” (0704). Also, a “U / I” (0706) including a pointing device such as a keyboard and a mouse, and a “network I / F” (0707) for connecting to a network such as a LAN are provided. A plurality of network cameras, video recording devices, alarm devices, human sensors, and the like are connected to the network I / F (0707). Then, they are connected to each other by a data communication path such as “system bus” (0708) to transmit / receive information and process information.

  The “RAM” (0703) provides a work area that is also a work area of the program at the same time as reading a program for performing various processes to be executed by the “CPU” (0701). A plurality of addresses are assigned to the RAM (0703), and a program executed by the CPU (0701) specifies and accesses the addresses to exchange data and perform processing. (Similar throughout this specification).

  First, stored in the nonvolatile memory (0702) 1. The video acquisition program is expanded on the RAM (0703) and executed by the CPU (0701). The program acquires video from the camera via the network I / F (0707) and temporarily holds it on the RAM (0703). At this time, a camera ID is assigned to the acquired video.

  Next, 2. The camera selection program is expanded on the RAM (0703) and executed by the CPU (0701). The program displays the camera selection screen on the display (0705) via the video card (0704). When the camera selection is received by the U / I, the camera ID of the received camera is stored in the RAM (0703) as x: selected camera ID.

  Next, 3. The in-frame position selection program is called on the RAM (0703) and executed by the CPU (0701). The program displays the in-frame position selection screen on the display (0705) via the video card (0704). When the intra-frame position selection is accepted by the U / I, the received intra-frame position ID is held on the RAM (0703) as y: selected intra-frame position ID.

  Then, 4. The video arrangement program is called on the RAM (0703) and executed by the CPU (0701). The program reads x: selected camera ID and y: selected in-frame position ID. When the reading is completed, a process for outputting the video with ID x, temporarily held in the RAM (0703), to the position in the frame with ID y is executed. Specifically, x and y are associated with each other, and an instruction for video reproduction is given in 5. Execute processing to send to the playback program. 5. Based on the received command, the playback program outputs the video of the camera selected by the display (0705) to the selected in-frame position via the video card (0704). The arrangement of the video is completed by repeating the above process the same number of times as the number of available positions in the frame. In addition to this, there are programs for displaying alarms on the monitoring screen according to the alarm device, and sensors (human sensor, sound sensor, vibration sensor, gas leak sensor, fire sensor, water supply sensor, etc.) A program for displaying the detection contents on the monitoring screen based on the detection result may be provided. These characters may be output on the monitoring screen, or may be output in a form that changes the display mode of the screen, such as making the screen red. Of course, it may be configured to output sound.

<Overview>

  FIG. 8 is a diagram showing an outline of processing of the monitoring apparatus of this embodiment. As shown in this figure, the video displayed in the frame changes with the passage of time. Further, the number and position of a plurality of videos displayed in the frame are changed. In the figure, the G1: C1 video (showing the camera 1 of group 1; the same applies hereinafter) is displayed on a single screen, and then the G1: C2-G1: C5 video is displayed at four positions in the frame. ing. After that, G2: C1-G2: C7 video at 7 positions, G3: C1-G3: C3 at 3 positions, G4: C1-G4: C4 at 4 positions, etc. as time passes Displayed while changing. In this way, it is possible to perform monitoring without omission by executing “sequence display” in which a combination of images is displayed in accordance with the passage of time.

  FIG. 9 is a diagram showing an outline of processing of the monitoring apparatus of the present embodiment, and is a diagram showing an outline of a screen for setting a sequence display. As shown in this figure, the sequence display setting is performed by designating a sequence to be set from among a plurality of sequences that can be set, as indicated by (1) in the figure. In each sequence, a frame group that is sequentially repeated at a predetermined time is defined in advance. For example, when “Sequence 1” is selected as shown in (1) in the figure, frame groups with frame group IDs: 1 to 5 are defined in advance. 1 to frame group 5 are repeatedly executed. In FIG. 9, a video from the camera 1 of the group 1 of camera icons having a hierarchical structure is already assigned to the frame group ID1. Next, “frame group 2” is set. This procedure is performed by determining a frame division number and then selecting a frame group. That is, as shown in (2) in FIG. 9, first, the number of videos to be displayed in the frame of the frame group scheduled to be selected is designated. For example, when “4 divisions” is designated, a maximum of 4 videos can be allocated. Next, “frame group ID: 2” is selected as shown in FIG. Then, the arrangement of four position icons is determined in advance for the “frame group ID: 2” or not depending on the frame group, and a position icon in which the frame area of the frame group is divided into, for example, equally divided into two vertically and horizontally. Indicated. Next, the camera icon to be assigned is selected. In this case, as shown in (4) of FIG. 9, “Group 1” is first selected, and “Camera 4” is selected as shown in (5) of FIG. This completes the selection of the camera image to be assigned. Finally, as indicated by (6) in FIG. 9, the arrangement of the video is completed by designating the position icon at the position in the frame where the selected video is to be assigned. In the figure, an image of G1: C4 is allocated to the area C of the frame group ID: 2.

<Functional configuration>
FIG. 10 is a diagram illustrating a functional configuration of the monitoring apparatus according to the present embodiment. The monitoring apparatus (1000) according to the present embodiment includes a “video acquisition unit” (1001), a “camera selection unit” (1002), an “in-frame position selection unit” (1003), and a “video placement unit” ( 1004) and a “reproducing unit” (1005). Since these configurations have already been described in the above embodiment, description thereof is omitted. In addition to the above-described configuration, the monitoring apparatus of the present embodiment is characterized in that the “in-frame position selection unit” (1003) newly includes a “sequence setting unit” (1006).

  The “sequence setting means” (1006) has a function that enables the position icon to be selected for each different frame according to time in the in-frame position selection unit (1003). As shown in FIG. 9, by sequentially setting different frames in which different videos can be displayed, the frames are switched in that order, and the displayed video changes. “According to time” means that each frame is switched every time a certain time elapses, and the certain time may be set in advance. In addition, by scheduling a plurality of sequences, there may be a function of displaying different sequences in different time zones. For example, when a place that needs to be monitored with priority changes depending on the time, it may be possible to execute different sequence display depending on the time. The function of this means is realized by a CPU, a RAM, a sequence setting program executed by the CPU, and a U / I such as a mouse.

  As shown in FIG. 9, the monitoring apparatus according to the present embodiment can perform division designation in order to display a plurality of videos in a frame, but the number of screen divisions, that is, the number of position icons. Is different depending on the design, and various patterns may exist.

<Process flow>
FIG. 11 is a flowchart for illustrating an example of a processing flow when the monitoring apparatus according to the present embodiment is used. First, different videos from a plurality of cameras are acquired (step S1101). Next, a plurality of camera icons are selected on the display in order to arrange the images from the cameras in frames displayed on the display (step S1102). Next, a position icon is selected for each different frame according to time (step S1103). Subsequently, an image from the camera indicated by the selected camera icon is arranged at the position in the frame indicated by the selected position icon between the selection of the camera icon and the selection of another camera icon (step S1104). Next, it is determined whether or not the arrangement is completed (step S1105). If the arrangement is not completed, the process returns to the selection of the camera icon (step S1102). If the arrangement is completed, the arranged video is reproduced (step S1106).

<Hardware configuration>
FIG. 12 is a diagram illustrating an example of a hardware configuration of the monitoring apparatus according to the present embodiment. Hereinafter, description will be made with reference to this figure.

  As shown in this figure, the monitoring apparatus according to the present embodiment includes a “CPU (central processing unit)” (1201) that performs various arithmetic processes, a “nonvolatile memory” (1202) such as an HDD, and a volatile type. A “RAM” (1203) as a storage medium is provided. A “display” (1205) is connected to the “video card” (1204). Also, a “U / I” (1206) including a pointing device such as a keyboard and a mouse, and a “network I / F” (1207) for connecting to a network such as a LAN are provided. Then, they are connected to each other through a data communication path such as a “system bus” (1208) to transmit / receive information and process information.

  First, stored in the nonvolatile memory (1202). The video acquisition program is expanded on the RAM (1203) and executed by the CPU (1201). The program acquires video from the camera via the network I / F (1207) and temporarily holds it on the RAM (1203). At this time, a camera ID is assigned to the acquired video.

  Next, 6. The sequence setting program is expanded on the RAM (1203) and executed by the CPU (1201). The program displays the sequence setting screen on the display (1205) via the video card (1204). In the same screen, first, a different number of frames according to time and the number of videos (number of screen divisions) acquired in each frame are received by “U / I” (1206), and the memory area of the sequence array S is secured. More specifically, FIG. 8 has five frames in one sequence, and images from 1, 4, 7, 3, and 4 cameras are acquired from the top, respectively. ] To S [4], areas for storing camera IDs and in-frame position IDs are secured on the memory for 1, 4, 7, 3, 4 × 2 = 38.

  Next, 2. A camera selection program is expanded on the RAM (1203) and executed by the CPU (1201). The program displays the camera selection screen on the display (1205) via the video card (1204). When the camera selection is accepted by “U / I” (1206), the camera ID of the accepted camera is temporarily stored in the RAM (0703) as the selected camera ID.

  Next, 3. The in-frame position selection program is called on the RAM (1203) and executed by the CPU (1201). The program displays the in-frame position selection screen on the display (1205) via the video card (1204). On this screen, each frame of the previously set sequence is displayed. When the intra-frame position selection is received by the U / I, the received frame group ID and the intra-frame position ID are temporarily held on the RAM (0703) as the selected frame position ID. For example, in (6) of FIG. 9, the frame group ID: 2 and the in-frame position ID: C are acquired and temporarily stored in the RAM (0703).

  Next, the selected intra-frame position ID and the selected camera ID are stored in the array variable S corresponding to the frame group ID. In (6) of FIG. 9, the in-frame position ID: C and the camera ID (G1: C4) are stored in the array variable S [1] corresponding to the frame group ID: 2. The above processing is executed for all the set frame groups, and values are stored in the array S.

  Then, 4. The video arrangement program is called on the RAM (1203) and executed by the CPU (1201). The program reads the array S. When the reading is completed, a command for video playback is issued in order to output the video of the camera ID selected for each frame group to the selected intra-frame position ID. Execute processing to send to the playback program. At this time, the program increments the index of the array every predetermined time, while giving a command for video reproduction to 5. Processing to send to the playback program. By doing so, it is possible to execute a sequence display in which frames are switched and a video to be displayed can be changed according to time. 5. The reproduction program executes the sent command. Specifically, a plurality of videos related to a plurality of camera IDs in the command are integrated, arranged at a selected position in one frame group, and the integrated video is transmitted to the video card (1204). The display is executed on the display (1205).

<Overview>

  In the third embodiment, a monitoring device capable of freely arranging a plurality of videos in a frame will be described. FIG. 13 is a diagram showing an example of video display in the monitoring apparatus of the present embodiment, and shows a mode in which video frames are arranged at a plurality of positions in one frame. In FIG. 13A, there are six video frames (A to F) in one frame. This can be brought to such a state by, for example, pressing a “6 division” button or the like. Here, when the video frame at the position A in the frame (referred to as video frame A. The same applies hereinafter) is dragged to the right (in the direction of the arrow) with a pointing device such as a mouse, as shown in FIG. Moves to the right, and the positions of the video frame B and the video frame C are switched. As shown in FIG. 13 (3), the video frame B is enlarged by dragging the lower left vertex of the frame of the video frame B in the direction of the arrow. As described above, the monitoring apparatus according to the present embodiment can acquire the position and size (area) of the video frame in the frame and reflect them in the display.

  Hereinafter, the functional configuration, the flow of processing, and the hardware configuration will be described in order.

<Functional configuration>
FIG. 14 is a diagram illustrating a functional configuration of the monitoring apparatus according to the present embodiment. The monitoring apparatus (1400) according to the present embodiment includes a “video acquisition unit” (1401), a “camera selection unit” (1402), an “in-frame position selection unit” (1403), and a “video arrangement unit” ( 1404) and a “reproducing unit” (1405). Since these configurations have already been described in the above embodiment, description thereof is omitted. In addition to the above-described configuration, the monitoring apparatus of the present embodiment has a feature that an “in-frame position acquisition unit” (1407) and an “in-frame position output unit” (1408) are newly provided.

  The “intra-frame position acquisition unit” (1407) has a function of acquiring the intra-frame position of one frame by a combination of the area and position occupied in the frame. Specifically, it is acquired by receiving in-frame position information consisting of area and position from a device such as U / I. In FIG. 13A, by dragging, the process of acquiring the position in the frame in the right direction is performed without changing the area of the video frame A. When the position in the frame reaches a predetermined value by dragging, the video frame A is switched to the video frame B and the video frame C. In FIG. 13 (3), the process of acquiring the enlarged area information is performed without changing the position of the video frame B by dragging the vertex of the video frame. When a drag operation is performed to enlarge the area of the video frame B to a predetermined value, the position of the video frame C is changed to the left end, and the video frame A is reduced by the enlargement of the video frame B. The functions of the headquarters are realized by a CPU and a RAM, an in-frame position acquisition program executed by the CPU, a video card, a display for displaying video, a U / I such as a mouse, and the like.

  The “intra-frame position output unit” (1408) has a function of outputting to the intra-frame position selection unit in order to select the acquired intra-frame position. Specifically, when the position in the frame is changed due to movement of the video frame or the like, new position information in the frame is output to the position selection unit in the frame. The function of this section is realized by a CPU, a RAM, and an in-frame position output program executed by the CPU.

<Process flow>
FIG. 15 is a flowchart for illustrating an example of the flow of processing when the monitoring apparatus according to the present embodiment is used. First, different videos from a plurality of cameras are acquired (step S1501). Next, an in-frame position is acquired by a combination of the area and position occupied in the frame (step S1502). Next, the acquired in-frame position is output (step S1503). Next, a plurality of camera icons are selected on the display in order to arrange the images from the cameras in frames displayed on the display (step S1504). Next, a plurality of position icons indicating the position in the frame where the video from the camera is displayed on the display are selected on the display (step S1505). Subsequently, an image from the camera indicated by the selected camera icon is arranged at the position in the frame indicated by the selected position icon between the selection of the camera icon and the selection of another camera icon (step S1506). Next, it is determined whether or not the arrangement is complete (step S1507). If not, the process returns to the acquisition of the position in the frame (step S1502). If the arrangement is complete, the arranged video is reproduced (step S1508). .

<Hardware configuration>
FIG. 16 is a diagram illustrating an example of a hardware configuration of the monitoring apparatus according to the present embodiment. Hereinafter, description will be made with reference to this figure.

  As shown in this figure, the monitoring apparatus according to the present embodiment includes a “CPU (central processing unit)” (1601) that performs various arithmetic processes, a “nonvolatile memory” (1602) such as an HDD, and a volatile type. A “RAM” (1603) as a storage medium is provided. A “display” (1605) is connected to the “video card” (1604). Further, a “U / I” (1606) including a pointing device such as a keyboard and a mouse, and a “network I / F” (1607) for connecting to a network such as a LAN are provided. Then, they are connected to each other via a data communication path such as a “system bus” (1608) to perform transmission / reception and processing of information.

  First, stored in the nonvolatile memory (1602) 1. The video acquisition program is expanded on the RAM (1603) and executed by the CPU (1601). The program acquires video from the camera via the network I / F (1607) and temporarily holds it on the RAM (1603). At this time, a camera ID is assigned to the acquired video.

  Next, 7. The in-frame position acquisition program is expanded on the RAM (1603) and executed by the CPU (1601). The program accepts input from the U / I (1606), acquires in-frame position information consisting of area and position coordinates, and stores it in a variable F. When displaying n videos in a frame, variables F [0] to F [n−1] are secured and stored in this. Next, 8. The in-frame position output program is expanded on the RAM (1603) and executed by the CPU (1601). The program outputs the acquired in-frame position information in a state where the in-frame position selection program can be used.

  Next, 2. A camera selection program is expanded on the RAM (1603) and executed by the CPU (1601). The program displays a camera selection screen on the display (1605) via the video card (1604). When the camera selection is received by the U / I, the camera ID of the received camera is stored in the RAM (1603) as x: selected camera ID.

  Next, 3. The in-frame position selection program is called on the RAM (1603) and executed by the CPU (1601). The program is The intra-frame position information F output by the intra-frame position output program is read, and the intra-frame position selection screen is displayed on the display (1605) via the video card (1604). When the intra-frame position selection is accepted by the U / I, the received intra-frame position ID is held on the RAM (1603) as y: selected intra-frame position ID.

  Then, 4. The video arrangement program is called on the RAM (1603) and executed by the CPU (1601). The program reads x: selected camera ID and y: selected in-frame position ID. When the reading is completed, a process for outputting a video having an ID of x temporarily stored in the RAM (1603) to a frame having an ID of y is executed. Specifically, x and y are associated with each other, and an instruction for video reproduction is given in 5. Execute processing to send to the playback program. 5. Based on the received command, the playback program outputs the video of the camera selected by the display (1605) to the selected frame via the video card (1604). By repeating the above process the same number of times as the number of usable frames, the video arrangement is completed.

<Overview>

  The monitoring apparatus according to the fourth embodiment can further record different videos from a plurality of cameras in association with the cameras on the basis of the monitoring apparatus, and the recorded videos can be reproduced by designating the cameras and the date and time. is there. It is also possible to reproduce a plurality of recorded videos simultaneously by selecting a plurality of cameras.

  Hereinafter, the functional configuration, the flow of processing, and the hardware configuration will be described in order.

<Functional configuration>
FIG. 17 is a diagram illustrating a functional configuration of the monitoring apparatus according to the present embodiment. The monitoring apparatus (1700) according to the present embodiment includes a “video acquisition unit” (1701), a “camera selection unit” (1702), an “in-frame position selection unit” (1703), and a “video placement unit” ( 1704) and a “reproducing unit” (1705). Since these configurations have already been described in the above embodiment, description thereof is omitted. The feature of the monitoring apparatus of this embodiment is that the “recording unit” (1709) and the “video acquisition unit” (1701) newly have “recorded video acquisition means” (1710).

  The “recording unit” (1709) has a function of recording different videos from a plurality of cameras in association with the cameras. By recording “in association with the camera”, the video can be selected by designating the camera at the time of reproducing the video. In this way, when recording a video, it is not necessary to input names associated with the video one by one. The functions of this unit are realized by a CPU, a RAM, a recording program executed by the CPU, and a nonvolatile storage medium such as an HDD, a DVD, or a Blu-ray disc for recording video.

  The “recorded video acquisition means” (1710) has a function of acquiring recorded videos from a plurality of cameras in the video acquisition unit (1701). Specifically, the recording date and time are received, the recording unit (1709) is searched based on the received information, and the corresponding video is acquired. The functions of this department are realized by a CPU, RAM, a recorded video acquisition program executed by the CPU, a U / I such as a mouse and keyboard for receiving input, a video card for displaying a reception screen, a display, and the like. .

  "Recording unit" (1709) includes "disk recording means" (not shown) for recording video in a series on a plurality of portable disks, and "exchange time notification means" for notifying the disk replacement time of the disk recording means. (Not shown). “Series” means that recording is sequentially performed on a plurality of disks. It is possible to notify that it is the replacement time by the “exchange time notification means” at a predetermined timing before the video is recorded on all the disks. “Portable discs” include Blu-ray discs and the like.

<Process flow>
FIG. 18 is a flowchart for illustrating an example of the flow of processing when the monitoring apparatus according to the present embodiment is used. First, recorded videos from a plurality of cameras are acquired (step S1801). Next, a plurality of camera icons are selected on the display in order to arrange the recorded video of the selected camera into frames displayed on the display (step S1802). Next, a plurality of position icons indicating the position in the frame where the image from the camera is displayed on the display are selected on the display (step S1803). Subsequently, an image from the camera indicated by the selected camera icon is arranged at the position in the frame indicated by the selected position icon between the selection of the camera icon and the selection of another camera icon (step S1804). Next, it is determined whether or not the arrangement is completed (step S1805). If the arrangement is not completed, the process returns to the selection of the camera icon (step S1802). If the arrangement is completed, the arranged video is reproduced (step S1806). The camera selection process (step S1802) may be executed prior to the process of acquiring the recorded video (step S1801).

<Hardware configuration>
FIG. 19 is a diagram illustrating an example of a hardware configuration of the monitoring apparatus according to the present embodiment. Hereinafter, description will be made with reference to this figure. As shown in this figure, the monitoring apparatus according to the present embodiment includes a “CPU (central processing unit)” (1901) that performs various arithmetic processes, and a “nonvolatile memory” (1902) such as an HDD or a portable optical drive. And “RAM” (1903) which is a volatile storage medium. A “display” (1905) is connected to the “video card” (1904). Further, a “U / I” (1906) including a pointing device such as a keyboard and a mouse, and a “network I / F” (1907) for connecting to a network such as a LAN are provided. These are connected to each other through a data communication path such as a “system bus” (1908), and perform transmission / reception and processing of information.

  Beforehand. A recording program is executed by the CPU (1901), and a video is stored in the nonvolatile memory (1902) in association with an identifier for specifying the camera. Next, 10. A recorded video acquisition program is executed in the CPU (1901) to acquire a recorded video stored in the nonvolatile memory (1902). At this time, the program executes processing such as accepting a condition such as date and time by the U / I (1906), searching the nonvolatile memory (1902) according to the accepted condition, and acquiring the corresponding recorded video. Also good. Next, 2. A camera selection program is executed by the CPU (1901), and a camera is selected by the U / I (1906) in order to reproduce the recorded video of the selected camera among the acquired videos. This process is described in 10. It may be performed before execution of the recorded video acquisition program. 3. 3. In-frame position selection program; 4. video layout program; Although the reproduction program is executed by the CPU (1901), the processing of these programs has been already described above, and thus description thereof is omitted.

<Overview>

  In the fifth embodiment, a monitoring system including cameras installed in a plurality of different locations and abnormality detection devices installed in a plurality of different locations in addition to the monitoring device will be described. According to this system, when an abnormality such as a door breakage or intrusion is detected by the abnormality detection device, it is possible to perform control such as turning the shooting direction of the camera in the direction in which the abnormality is detected.

  Hereinafter, the functional configuration, the flow of processing, and the hardware configuration will be described in order.

<Functional configuration>
FIG. 20 is a diagram illustrating a functional configuration of the monitoring system according to the present embodiment. The monitoring system according to the present embodiment includes a monitoring device (2000), cameras (2011) installed at a plurality of different locations, and an anomaly detection device (2012) installed at a plurality of different locations. The monitoring device (2000) includes a "video acquisition unit" (2001), a "camera selection unit" (2002), an "in-frame position selection unit" (2003), a "video placement unit" (2004), Playback unit "(2005). Since the configuration of the monitoring device (2000) has already been described in the above embodiment, a description thereof will be omitted. The monitoring system of the present embodiment is characterized in that the system includes a camera (2011), an abnormality detection device (2012), and the abnormality detection device (2012) includes a camera control unit (2013).

  There are various types of “camera” (2012). The camera (2012) of the present embodiment refers to all cameras that can be used as a surveillance camera. The camera (2012) is installed in a plurality of different places, and may have functions such as changing the angle of view, changing the shooting direction, and acquiring sound by a monitoring device.

  The “abnormality detection device” (2013) is installed in a plurality of different locations and has a function of detecting an abnormality such as destruction or intrusion. In “abnormality detection”, sensors such as infrared sensors, microwave sensors, tension sensors, and optical vibration sensors are connected to detect abnormalities at each location, and patrol guards use alarm devices. A mode for notifying the detection of an abnormality is conceivable. When an abnormality is detected, this is output to the monitoring device (2011), and a warning is presented on the monitoring device (2011).

  The “camera control unit” (2014) has a function of controlling the shooting direction of the camera in the vicinity when the apparatus detects an abnormality in the “abnormality detection apparatus” (2013). For the control of the shooting direction, the direction of each anomaly detection device is preset, and in the case of anomaly detection, the camera is pointed in a predetermined direction of the detected device, or the movement of a predicted intruder, etc. It is conceivable that the camera is directed in the direction of the line, or that the reporting device outputs position information and changes the direction of the camera based on the position information. The functions of this unit are realized by a CPU, a RAM, a camera control program executed by the CPU, a network I / F, and the like.

  Furthermore, the monitoring system of the present embodiment has a sensor for detecting the movement of a person or the like, and the “camera control unit” (2014) controls a “sensor camera control unit” (FIG. (Not shown).

  The “playback unit” (2005) is an identification information adding unit (not shown) that adds identification information for each video so that at least one of a real-time monitoring video, a recorded video, and a video when an abnormality is detected can be identified. May be included). For example, when the video of multiple cameras is displayed on the display, the frame color of the real-time monitoring video is blue, the frame color of the recorded video is red, and the color of the video frame when an abnormality is detected is yellow It can be configured so that the state indicated by each video image can be identified at a glance, such as blinking of.

<Process flow>
FIG. 21 is a flowchart for illustrating an example of a process flow when the abnormality detection device is used in the monitoring system according to the present embodiment. First, photographing is performed using cameras installed at a plurality of different locations (step S2101). Next, an abnormality is monitored by an abnormality detection device installed at a plurality of different locations, and it is determined whether or not an abnormality has been detected (step S2102). If no abnormality is detected, shooting is continued (step S2101). If an abnormality is detected, the shooting direction of the camera in the vicinity is controlled (step S2103).

<Hardware configuration>
FIG. 22 is a diagram illustrating an example of a hardware configuration of the abnormality detection device included in the monitoring system according to the present embodiment. Hereinafter, the abnormality detection processing of the monitoring system will be described with reference to this figure. As shown in this figure, the abnormality detection device according to the present embodiment includes a “CPU (central processing unit)” (2201) that performs various arithmetic processes, a “nonvolatile memory” (2202) such as a ROM and an HDD, “RAM” (2203) which is a volatile storage medium. Various sensors (2210) are connected via an I / O interface (2209). Further, a “network I / F” (2204) for connecting to a network such as a LAN is provided. Then, they are connected to each other via a data communication path such as a “system bus” (2205) to perform transmission / reception and processing of information.

  Here, in the CPU, 11. An abnormality detection program is executed in the CPU (2201). The program resides and waits for input from the sensor (2210). When there is an input from the sensor (2210), the program determines whether an abnormality has occurred. If it is determined that no abnormality has occurred even if there is an input from the sensor (2210), the input is continuously waited. If it is determined that an abnormality has occurred, 12. The camera control program is executed by the CPU (2201). The program accesses the camera via the network I / F (2204) and executes control for directing the camera in a predetermined direction.

0200: Monitoring device 0201: Video acquisition unit 0202: Camera selection unit 0203: In-frame position selection unit 0204: Word output unit with attribute position 0205: Reproduction unit

Claims (9)

An image acquisition unit for acquiring different images from a plurality of cameras;
A camera selection unit arranged so that a plurality of camera icons can be selected on the display in order to arrange the images from the camera into frames displayed on the display;
An in-frame position selection unit in which a plurality of position icons indicating positions in the frame in which video from the camera is displayed on the display are selectable on the display;
The video from the camera indicated by the selected camera icon at the position in the frame indicated by the position icon selected by the position selection part in the frame between the selection of the camera icon in the camera selection part and the selection of another camera icon. A video placement section to be placed;
A playback unit for playing back the arranged video;
A monitoring apparatus having sequence setting means in which an in-frame position selection unit can select a position icon for each different frame according to time so that a combination of images from a camera can be changed and displayed according to time.   The monitoring apparatus according to claim 1, wherein the camera selection unit includes a hierarchical structure selection unit that enables selection by dividing the camera icon into a group having a hierarchical structure. An in-frame position acquisition unit for acquiring an in-frame position of one frame by a combination of an area and a position in the frame;
An in-frame position output unit that outputs to the in-frame position selection unit to select the acquired in-frame position;
The monitoring device according to claim 1, further comprising: It has a recording unit that records different videos from multiple cameras in association with the cameras,
The monitoring apparatus according to any one of claims 1 to 3, wherein the video acquisition unit includes recorded video acquisition means for acquiring recorded videos from a plurality of cameras. The recording unit is a disk recording means for recording video in a series on a plurality of portable disks,
A replacement time notification means for notifying the disk replacement time of the disk recording means;
The monitoring device according to claim 4, further comprising:   The monitoring apparatus according to claim 1, further comprising a comment recording / reproducing unit capable of recording / reproducing a comment in association with the video reproduced by the reproducing unit. A monitoring device according to any one of claims 1 to 6,
The cameras installed in a plurality of different locations;
An anomaly detector installed in different locations;
A camera control unit for controlling the shooting direction of the camera in the vicinity when the abnormality detection device detects an abnormality;
Having a surveillance system. Furthermore, it has a sensor that detects the movement of people ,
The monitoring system according to claim 7, wherein the camera control unit further includes a sensor camera control unit that controls a shooting direction in accordance with detection by a sensor.   The reproduction unit of the monitoring device further includes identification information adding means for adding identification information for each video so that at least one of a real-time monitoring video, a recorded video, and a video when an abnormality is detected can be identified. The monitoring system according to claim 7 or 8.

Images