JP2018182712A - Monitor system and imaging direction control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a monitor system capable of controlling an imaging device so as to image a monitoring target which does not exist in the present imaging range of the imaging device.SOLUTION: The system comprises: the imaging device for imaging a monitoring target area; a detection device which detects a signal originated from a specific position in the monitoring target area and indicating a direction of the existence of a monitoring target; and an imaging direction control device which controls the imaging direction of the imaging device on the basis of the signal detected by the detection device and indicating the direction of the existence of a monitoring target.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a monitoring system and an imaging direction control device that control an imaging device that captures an object present in a monitoring target area.

  Conventionally, there is a technology for automatically controlling the imaging direction of the imaging device. For example, Patent Document 1 recognizes a subject to be photographed from within a wide-angle image photographed by a sensor camera and sequentially measures the current position of the subject, and uses a predetermined viewpoint of a camera for photographing as an origin. There is disclosed a technology for automatically driving and controlling a photographing camera according to the movement of a subject based on information indicating the current position or the like of the subject in a space.

JP 10-294890 A

In the technique described in Patent Document 1, if the sensor camera can recognize the subject, the subject is photographed so as to photograph the subject even if the current position of the subject is out of the photographing range as viewed from the current orientation of the camera for photographing Drive control can be performed.
However, when the subject is out of the recognition range of the sensor camera, the subject can not be recognized by the sensor camera, and as a result, when the subject is within the range which can be photographed by changing the direction of the photographing camera. Even if there is a problem, there is a problem that the photographing camera can not photograph the subject.

  The present invention has been made to solve the above-described problems, and provides a monitoring system capable of controlling a photographing apparatus to photograph a monitoring target that does not exist in the photographing range of the present photographing apparatus. The purpose is

  A monitoring system according to the present invention includes an imaging device for imaging a monitoring target area, a detection device for detecting a signal indicating a direction in which the monitoring target is transmitted from a specific position in the monitoring target area, and a detection device And an imaging direction control device for controlling the imaging direction of the imaging device based on a signal indicating the direction in which the monitoring target exists.

  According to the present invention, it is possible to control the imaging device to capture a monitoring target that does not exist in the current imaging range of the imaging device.

FIG. 1 is a diagram showing an example of the entire configuration of a monitoring system according to a first embodiment. FIG. 7 is a flowchart for describing an example of an operation of controlling a shooting direction of the shooting device in the first embodiment. FIG. 1 is a diagram for describing an example of the entire configuration of a detection device according to a first embodiment. In Embodiment 1, it is a figure which shows an example of arrangement | positioning of the detection area | region in a detection apparatus. It is a flowchart explaining an example of operation | movement of the detection apparatus in this Embodiment 1. FIG. FIG. 2 is a diagram for describing an example of the entire configuration of a photographing apparatus equipped with a photographing direction control device in the first embodiment. FIG. 6 is a flowchart illustrating an example of an operation of controlling the photographing apparatus by the photographing direction control device of the first embodiment. FIG. FIG. 7 is a diagram showing an example of a conversion table used when the conversion unit converts detection area information in the first embodiment. FIG. 7 is a schematic view showing an example of a shooting range of the monitoring camera and a shooting available range in the first embodiment. It is a figure which shows an example of the installation environment of a surveillance camera in the example which applied the surveillance system of Embodiment 1 to the surveillance system which monitors the platform of a station, and a track. FIG. 11 is a diagram for describing an example of an operation in which a shooting direction of a monitoring camera is controlled when a station worker finds a monitoring target in a monitoring system as shown in FIG. 10. 12A and 12B are diagrams showing an example of the hardware configuration of the photographing direction control device according to Embodiment 1 of the present invention. FIG. 8 is a diagram showing an example of the entire configuration of a monitoring system according to a second embodiment. 7 is a flowchart illustrating an example of the operation of the monitoring system of the second embodiment. In Embodiment 2, it is a figure explaining an example of the screen displayed on a display device when the reception part of a display control apparatus receives proposal preset information, Comprising: FIG. 15A is an example of a confirmation instruction screen, 15B is an example of a presetting necessity indication screen, and FIG. 15C is an example of a registration completion screen.

Hereinafter, in order to explain the present invention in more detail, a mode for carrying out the present invention will be described according to the attached drawings.
Embodiment 1
FIG. 1 is a diagram showing an example of the entire configuration of a monitoring system according to a first embodiment.
In the monitoring system according to the first embodiment, a field supervisor who is present in the monitoring target area and directly monitors the monitoring target area by visual observation, and a video of the monitoring target area captured from a place apart from the monitoring target area The monitoring operation is performed by the remote monitor who monitors the monitoring target area by confirming the above.

The monitoring system includes an imaging device 101, a detection device 102, an instruction device 103, a display device 104, a recording device 105, and a control device 106. The imaging device 101 mounts the imaging direction control device 107.
The imaging device 101 captures an area to be monitored as an image or a video. The imaging device 101 is, for example, a surveillance camera, a smartphone, or a digital camera.
The imaging device 101 outputs the captured image or video to the display device 104 and the recording device 105. The control device 106 controls the imaging device 101. For example, the orientation of the imaging device 101 is controlled. The controller 106 may be connected to the display device 104. Specific examples of the control device 106 include a controller, a remote controller, and a mouse.
Further, the imaging apparatus 101 changes the shooting direction based on the control of the shooting direction control device 107, and shoots the monitoring target area.

The photographing direction control device 107 controls the photographing direction of the photographing device 101 based on the information transmitted from the detection device 102. The details of the information transmitted from the detection device 102 and the specific operation of controlling the imaging direction of the imaging device 101 will be described later.
In the first embodiment, as shown in FIG. 1, the photographing apparatus 101 incorporates the photographing direction control apparatus 107. However, the present invention is not limited to this. The photographing direction control apparatus 107 is an external unit of the photographing apparatus 101. The imaging direction of the imaging device 101 may be controlled from the outside of the imaging device 101 via a network or the like.

The pointing device 103 is for transmitting a signal indicating the direction in which the monitoring target exists from the specific position in the monitoring target area. The pointing device 103 is, for example, a laser pointer, and the on-site supervisor carries the pointing device 103. The specific position in the monitoring target area is an actual place in the monitoring target area, and a position on a half straight line passing the position of the monitoring target with the detection device 102 at one end, or a position near the half straight line It is. The specific position is selected by the field supervisor according to the position where the monitoring target exists, and is not fixed.
Specifically, when the pointing device 103 is a laser pointer, for example, the on-site supervisor reflects the light from the laser pointer by projecting the light from the laser pointer onto the monitoring target present in the monitoring target area. The transmitted light beam is transmitted as a signal indicating the direction in which the monitoring target exists. The specific position in this case is the position where the monitoring target is present.
Similarly, when the pointing device 103 is a laser pointer, for example, the on-site supervisor within the monitoring target area directly projects the light beam from the laser pointer to the detecting device 102 to monitor the light beam. It sends as a signal indicating the direction in which exists. The specific position in this case is the position where the pointing device 103 exists.

The detection device 102 detects the direction in which the monitoring target exists based on the signal transmitted by the pointing device 103. The detection device 102 is, for example, an optical sensor or the like.
Specifically, the sensing device 102 has, for example, one or more sensing regions, each of which is a sensor element.
For example, when the pointing device 103 is a laser pointer and the light beam from the laser pointer is projected to the monitoring target, the detecting device 102 detects the reflected light reflected from the monitoring target. By detecting in the area, the direction in which the monitoring target exists is detected. Also, for example, when the light beam from the laser pointer is directly projected to the detection device 102, the detection device 102 detects the light beam projected from the laser pointer in the detection area, whereby the laser pointer The existing direction is detected as the direction in which the monitoring target exists.
The detection apparatus 102 transmits information on a detection area in which the direction in which the monitoring target is present is detected to the imaging direction control apparatus 107 as detection area information.

  The display device 104 displays the image or video output by the imaging device 101. The display device 104 is, for example, a display, a smartphone, a television, or a video monitor. For example, it is assumed that the display device 104 is used at a place apart from the monitoring target area, such as a monitoring room. The remote monitor monitors the monitoring target area by confirming the image or video displayed on the display device 104.

  The recording device 105 records the image or video output from the imaging device 101. The recording device 105 is, for example, a recorder or a smartphone.

  The control device 106 controls the imaging device 101. Specifically, for example, the control device 106 controls an operation such as zoom, focus, pan, or tilt of the imaging device 101. The control device 106 is, for example, a PC (Personal Computer) in which control software is installed, a controller, or the like.

The imaging device 101, the display device 104, the recording device 105, and the control device 106 are communicably connected to one another.
Further, the imaging device 101 and the detection device 102 are communicably connected.
Further, the detection device 102 and the pointing device 103 are communicably connected.

An operation of controlling the imaging direction of the imaging device 101 in the monitoring system as shown in FIG. 1 will be described.
FIG. 2 is a flowchart for explaining an example of an operation of controlling the shooting direction of the shooting apparatus 101 in the first embodiment.
In FIG. 2, when the on-site supervisor finds a person to be monitored in the monitoring target area, the imaging direction of the imaging device 101 is set so that the range including the monitoring target is the imaging range of the imaging device 101. The operation of controlling the
In the following description, as an example, the detection device 102 is a spherical sensor, and the pointing device 103 is a laser pointer.

  The instructing device 103 instructs the direction in which the person to be monitored is present (step ST201). Specifically, the on-site supervisor projects a light beam to the person to be monitored using the carried pointing device 103.

  In step ST201, the detection device 102 detects a light beam emitted from the pointing device 103 to a person to be monitored and reflected by the person as a signal indicating the direction in which the object to be monitored is present. The detection apparatus 102 transmits, as detection area information, information on the detection area in which the signal is detected to the imaging direction control apparatus 107 mounted on the imaging apparatus 101 (step ST202).

  The photographing direction control device 107 controls the photographing direction of the photographing device 101 based on the information transmitted from the detection device 102 in step ST202 (step ST203). Then, the imaging apparatus 101 captures an image of the monitoring target area in the shooting direction according to the control of the shooting direction control device 107.

  By operating as described above, even if the monitoring target is present outside the current shooting range of the imaging apparatus 101, a signal indicating the direction in which the monitoring target is transmitted, which is transmitted from the pointing device 103, is detected. Thus, the imaging direction of the imaging device 101 can be controlled so that the monitoring target is included in the imaging range of the imaging device 101.

  The details of the configuration and operation of the detection device 102 constituting the monitoring system and the imaging device 101 on which the imaging direction control device 107 is mounted will be described below.

First, the detection device 102 will be described.
FIG. 3 is a diagram for explaining an example of the entire configuration of the detection device 102 according to the first embodiment.
In FIG. 3A, the detecting device 102 directly detects the light beam emitted from the pointing device 103 in the detection area 302, thereby detecting the direction in which the pointing device 103 is present as the direction in which the monitoring target 305 is present. In FIG. 3B, the direction in which the monitoring target 305 exists is that the detecting device 102 detects the light beam projected from the pointing device 103 onto the monitoring target 305 and reflected by the monitoring target 305. Shows the case of detecting.

In FIG. 3, the coordinate axis 301 is an xyz coordinate axis, and the origin is, for example, the center of the detection device 102. Also, the z-axis direction is the vertical direction.
The sensing device 102 has a plurality of sensing areas 302. In FIG. 3, only one detection area 302 of the plurality of detection areas 302 is shown. Further, in FIG. 3, as an example, each detection region is provided on the surface of the spherical detection device 102.
Each of the detection areas 302 is constituted by, for example, a single sensor element for detecting a signal transmitted from the pointing device 103.
The detection device 102 may be provided with a plurality of detection areas so that light beams projected in the monitoring target area can be detected from any direction. The arrangement of the plurality of detection areas and the specific number of the plurality of detection areas will be described later.

The monitoring target 305 is such that the direction in which it is present is the detection target of the detection apparatus 102.
As shown in FIG. 3A, the detection device 102 can detect the direction in which the monitoring target 305 exists by the detection device 102 detecting the light beam directly projected from the pointing device 103 to the detection device 102. Although the monitoring target 305 is not illustrated in FIG. 3A, the monitoring target 305 in this case exists on a half straight line passing the position of the pointing device 103 with the detection device 102 at one end, or in the vicinity of the half straight line.
Further, as shown in FIG. 3B, the detection device 102 detects the light beam projected from the pointing device 103 to the monitoring target 305 and reflected from the monitoring target 305, whereby the detection device 102 detects the presence of the monitoring target 305. Direction can be detected.
The detection device 102 emits a light beam directly projected from the pointing device 103 to the detection device 102 as a signal indicating the direction in which the monitoring target 305 is present, or the light is projected from the pointing device 103 to the monitoring target 305 to be monitored. The light beam reflected from the object 305 is detected, and the photographing direction control device 107 is controlled so as to photograph the direction in which the monitoring object 305 exists.

Here, the imaging device 101 can capture a wide field of view using, for example, a 120-degree wide-angle lens. Therefore, as long as the monitoring target 305 can be reflected in the field of view of the photographing apparatus 101, thereafter, the existing photographing function of the photographing apparatus 101 originally provided, for example, the recognition function using the face detection of the object, etc. It is possible to perform the desired monitoring task.
Therefore, the detection area 302 of the detection apparatus 102 can be arranged, for example, so as to be able to distinguish three directions obtained by equally dividing 360 degrees in the horizontal direction into three as viewed from the center of the imaging apparatus 101. Further, for example, in consideration of the vertical direction, it is possible to distinguish two directions obtained by equally dividing 180 degrees in the vertical direction into two as viewed from the center of the imaging device 101. Specifically, as shown in FIG. 4, the detection area 302 is, for example, an area divided equally into three in the horizontal direction 360 degrees and divided equally in two in the vertical direction 180 degrees as viewed from the center of the imaging device 101. And two triangular pyramids are combined. The number of detection areas 302 in this case is six.
The arrangement of the detection areas 302 of the detection apparatus 102 and the number of detection areas 302 are not limited to the combination of two triangular pyramids as described above, but taking into consideration the field of view of the imaging apparatus 101, that is, the degree of wide angle. The direction of the light ray indicating the direction in which the monitoring target 305 exists may be appropriately arranged so as to be distinguishable. For example, four shapes in the horizontal direction and three directions in the vertical direction can be distinguished, and the shape may be any shape as long as the detection region 302 faces the direction in which the photographing apparatus 101 is desired to be directed.

When the detection device 102 is configured of a spherical sensor as shown in FIG. 3, the center of the sphere, which is an intersection of each axis of the xyz coordinate axes 301, is taken as a viewpoint and the sphere surface of the detection device 102 passes. Assuming that the real space is viewed, the real space and the spherical surface of the detection device 102 can be mapped and mapped.
As described above, the sphere surface of the detection device 102 capable of mapping in association with the real space is divided such that no blind spot of the imaging range by the imaging device 101 occurs and that the resolution of the control coordinates is sufficient. Composed of multiple sensor elements. For example, each detection area 302 is formed by dividing the surface of the sphere into 60 by using the universal horizontal Mercator projection method, and a single light sensor element is assigned to each detection area 302 to configure the detection device 102. .

The x-y-z coordinate axis 301 assists in drawing the space figure.
The detection area 302 illustrated in FIG. 3A indicates a detection area 302 in which a light beam directly projected from the pointing device 103 to the detection device 102 is detected among the plurality of detection areas 302 included in the detection device 102. There is.
The detection area 302 illustrated in FIG. 3B particularly detects a light beam projected from the pointing device 103 to the monitoring target 305 and reflected from the monitoring target 305 among the plurality of detection areas 302 included in the detection device 102. The detection area is shown.
The detection device 102 uses, as detection area information, information on the detection area 302 that has detected a light beam indicating a direction in which the monitoring target 305 exists, such as the detection area 302 illustrated in FIG. 3A or 3B. It is transmitted to the control device 107.

  The imaging direction control device 107 receives the detection area information transmitted from the detection device 102 and determines the imaging direction of the imaging device 101. For example, when the lens of the imaging device 101 is a wide angle lens of 120 degrees, the imaging direction control device 107 can divide the field of view of the imaging device 101 of 360 degrees into three, and therefore does not specify accurate position information of the monitoring target 305 Even in this case, the imaging direction in which the subject can be captured in the field of view of the imaging device 101 can be determined.

Note that since the light beam detected by the detection device 102 may include disturbance light and the like, detection region information transmitted from the detection device 102 may include erroneous detection region information due to detection of disturbance light and the like. . Therefore, for example, by setting the light beam indicating the direction in which the monitoring target 305 exists to a specific pattern (flashing), the detection apparatus 102 identifies the light beam indicating the direction in which the monitoring target 305 exists and the disturbance light. Accuracy is greatly improved and detection accuracy is improved.
The detection device 102 notifies detection direction information to the photographing direction control device 107 when receiving a light beam of a predetermined pattern, and discards the information when receiving other light rays. In this manner, the detection device 102 can determine the validity of the received light and reduce false detection. The detailed configuration and operation of the photographing direction control device 107 will be described later.

  The mapping between the above-described real space and the surface of the detection device 102 can be performed by defining a predetermined viewpoint even when the detection device 102 is configured of a sensor other than a sphere.

FIG. 5 is a flow chart for explaining an example of the operation of the detection apparatus 102 in the first embodiment.
That is, FIG. 5 is a flowchart for explaining an example of the detailed operation of step ST202 of FIG.
The detection device 102 detects a light beam emitted from the pointing device 103 as a signal indicating the direction in which the monitoring target 305 exists in the detection area 302 (step ST501).

  The detection apparatus 102 transmits, as detection area information, information on the detection area 302 in which the light beam is detected in step ST501 to the photographing direction control apparatus 107 (step ST502).

Next, the imaging device 101 equipped with the imaging direction control device 107 will be described.
FIG. 6 is a diagram for explaining an example of the entire configuration of the imaging apparatus 101 in which the imaging direction control device 107 is mounted in the first embodiment.
As shown in FIG. 6, the imaging device 101 is equipped with the imaging direction control device 107. Further, as shown in FIG. 6, the imaging device 101 includes an imaging unit 1011, a focus alignment processing unit 1012, and a turning processing unit 1013.

The imaging unit 1011 captures an image or video of the monitoring target area. The imaging unit 1011 transmits the captured image or video of the monitoring target area to the display device 104, the recording device 105, and the control device 106 (see FIG. 1).
The focus alignment processing unit 1012 performs focus alignment on the imaging unit 1011 based on control from the imaging direction control device 107.
The turning processing unit 1013 turns the photographing unit 1011 based on the control from the photographing direction control device 107.

The imaging direction control device 107 is communicably connected to the detection device 102, and receives detection area information from the detection device 102 by a receiving unit (not shown) of the imaging direction control device 107.
The photographing direction control device 107 controls the direction of the photographing device 101 in the direction in which the monitoring target 305 exists based on the detection device 102 based on the detection area information received by the reception unit from the detection device 102.
The shooting direction control device 107 includes a shooting control unit 1071 and a conversion unit 1072.
The imaging control unit 1071 controls the operations of the focus alignment processing unit 1012 and the turning processing unit 1013 based on the parameters acquired from the control device 106 or the conversion unit 1072. The control device 106 converts, for example, information indicating upper, lower, left, right, etc., so as to conform to the I / F (interface) required by the imaging control unit 1071 and captures the converted parameter as control information. It is output to the control unit 1071. In addition, the control based on the information from the said control apparatus 106 assumes the manual control which a remote monitoring person operates by operating a controller, for example.
The conversion unit 1072 acquires detection area information from the detection device 102 by the reception unit from the reception unit, converts the detection area information into an I / F determined by the imaging control unit 1071, and converts the converted parameter. Are output to the imaging control unit 1071 as control information.
The shooting control unit 1071 controls the operation of the focus alignment processing unit 1012 or the turning processing unit 1013 based on the parameters acquired from the control device 106 or the converting unit 1072 to perform the turning processing of the shooting unit 1011 or the like. The operation is controlled.

FIG. 7 is a flow chart for explaining an example of the operation of controlling the photographing apparatus 101 by the photographing direction control device 107 of the first embodiment.
The receiving unit of the photographing direction control device 107 receives the detection area information transmitted from the detection device 102 (step ST701). The reception unit outputs the received detection area information to the conversion unit 1072.

  The conversion unit 1072 converts the detection area information output from the reception unit in step ST 701 so as to match the I / F determined by the imaging control unit 1071 and outputs the converted parameter to the imaging control unit as control information ( Step ST702). Specifically, the conversion unit 1072 converts the detection area information based on the conversion table as shown in FIG. For example, when the conversion unit 1072 acquires detection area information indicating the detection area A received from the detection apparatus 102 via the reception unit, the pan angle is 0 degrees from the reference and the tilt angle is reference Further, the control information is converted to 45-degree control information and output to the imaging control unit 1071. In the detection area A or the like, coordinate axes may be provided in the detection device 102 or the real space and designated by coordinates. A conversion table as shown in FIG. 8 is created in advance and stored in a place where the imaging direction control device 107 can refer.

The imaging control unit 1071 controls the operation of the focus alignment processing unit 1012 or the turning processing unit 1013 based on the control information output from the conversion unit 1072 in step ST702. Thereby, the operation such as the turning process of the imaging unit 1011 is controlled (step ST703).
The photographing unit 1011 transmits the photographed image or video to the display device 104 and the recording device 105.

Hereinafter, the application example of the monitoring system of Embodiment 1 of this invention is demonstrated using FIGS. 9-11.
In the following, for example, an example is shown in which the monitoring system according to the first embodiment of the present invention is applied to a monitoring system that monitors a station home and a track. In this case, the station's home and track become the monitoring target area. In addition, the site supervisor is station staff 1001 who is at the station's home, and the remote surveillance staff is in the control room etc., and by confirming the image or video displayed on the display device installed in the management room etc. , Is a station worker to monitor the station home.
In the monitoring system, a monitoring camera 801 which is a photographing apparatus 101 is installed so as to be able to turn at a position where it is possible to photograph the platform 902 and track 901 of a station, and a laser pointer 1002 whose station supervisor 1001 who is a field supervisor is a pointing device 103 Shall be carried.
Further, in the vicinity of the monitoring camera 801, a spherical sensor which is the detection device 102 is installed. In addition, description of the detection apparatus 102 is abbreviate | omitted in FIGS. 9-11 used by the following description.

FIG. 9 is a schematic diagram showing an example of the imaging range 802 and the imaging available range 803 of the monitoring camera 801 in the first embodiment. The drawing shown at the top in FIG. 9 is a drawing showing the photographing range 802, and the drawing shown at the bottom in FIG. 9 is a drawing showing the photographing possible range 803.
Here, the imaging range 802 refers to the imaging range of the monitoring camera 801 at the current installation position. Moreover, although the imaging possible range 803 is outside the imaging range of the monitoring camera 801 at the current installation position, it refers to the imaging range which can be imaged by performing control such as turning the monitoring camera 801.
The monitoring camera 801 is an imaging device 101 capable of camera control of zoom, focus, pan, and tilt.

FIG. 10 is a diagram showing an example of an installation environment of the monitoring camera 801 in an example in which the monitoring system of the first embodiment is applied to a monitoring system that monitors the platform 902 and the track 901 of a station.
As shown in FIG. 10, a monitoring camera 801 is installed at a position where the status of the train track 901 and the station platform 902 can be monitored.

FIG. 11 is a diagram for explaining an example of the operation in which the shooting direction of the monitoring camera 801 is controlled when the station worker 1001 finds the monitoring target person 1003 in the monitoring system as shown in FIG.
The surveillance camera 801 captures a certain direction (indicated by a in FIG. 11) at time t1, and captures a direction (indicated by b in FIG. 11) different from the time t1 at time t2.
At time t1, it is assumed that the monitoring camera 801 is facing the direction of a, and a station worker 1001 at the home 902 has found a suspicious person to be monitored. The suspicious person is set as a monitoring target person 1003.
The station worker 1001 emits a light to the person to be monitored 1003 with the carrying laser pointer 1002 (a light beam projected is indicated by c in FIG. 11).

Then, the monitoring camera 801 shooting the direction of a in FIG. 11 turns from the shooting range for shooting the direction of a in FIG. 11 to a position that becomes the shooting range for shooting the direction of b in FIG.
Specifically, the detection area of the detection apparatus 102 detects a light beam from the laser pointer 1002 reflected by the monitoring target person 1003, and the detection apparatus 102 transmits detection area information to the photographing direction control apparatus 107.
The photographing direction control device 107 controls the focus matching processing unit 1012 or the turning processing unit 1013 of the monitoring camera 801 based on the detection area information so that the direction in which the monitoring target person 1003 is present is the photographing direction. As a result, the shooting direction of the monitoring camera 801 is controlled, and the monitoring target person 1003 is included in the shooting range of the monitoring camera 801.

  The light beam emitted by the laser pointer 1002 may be visible light or invisible light, and may be always on or blink. That is, regardless of the apparent color of the light beam, the light projection pattern may be arbitrary. In addition, the laser pointer 1002 may emit light simultaneously to one or more light beams, or may emit light not simultaneously.

  As described above, in the monitoring system of the first embodiment, for example, the user of the monitoring system such as a field supervisor directly projects light to the detection device 102 using the pointing device 103 or projects the light to the monitoring target. The photographing device 101 can be directed to the direction in which the monitoring target exists by a simple means of lighting. Thus, for example, at the timing when the on-site supervisor grasps the direction in which the monitoring target exists, it is possible to quickly direct the imaging range of the imaging device 101 to the monitoring target, and from the imaging device 101 to a remote location. It is possible to quickly transmit an image or video of a monitored object to a certain display device.

In the above-described prior art, when a monitoring target is present outside the imaging range of a sensor camera that captures a wide-angle image, in order to capture the monitoring target with the imaging camera, for example, a site supervisor who is in the vicinity of the sensor camera It is necessary to recognize the target to be monitored and to notify the remote monitor who is away from the monitoring target area that the target to be monitored has been recognized. However, in this case, when the on-site supervisor conveys information on the subject of monitoring, there is a possibility that a misunderstanding or human error may occur.
In addition, the on-site supervisor can not confirm whether the monitoring target is included in the imaging range of the sensor camera if the display device is not installed near the installation place of the sensor camera.
As described above, in the related art, when the monitoring target that is within the range where the imaging device can capture is recognized but not included in the current imaging range of the imaging device is recognized, the range including the monitoring target is captured In some cases, it may not be possible to control the imaging device to set the imaging range of the device, in which case labor is required to control the imaging device, and the monitoring target is included in the imaging range of the imaging device. It becomes difficult to adjust the direction accurately.
Further, in the prior art, even if the monitoring target exists within the shooting range of the sensor camera, the monitoring target can not be recognized if the monitoring target does not match the predetermined condition, and the shooting The camera can not be directed to the monitoring target.

On the other hand, in the monitoring system according to the first embodiment of the present invention, as described above, the pointing device 103 carried by the on-site supervisor directly emits light to the detecting device 102 or emits light to the monitoring target. By doing this, it is possible to indicate the direction in which the monitoring target is present, and to control the shooting direction of the shooting apparatus 101.
At that time, since the field supervisor does not need to perform an operation such as explaining the direction in which the surveillance target exists to the remote surveillance, there is a need for a recognition trap between the field surveillance and the remote surveillance, or It is also possible to suppress the possibility of human error or the like.
In addition, since the on-site supervisor instructs the direction in which the monitoring target is present using the pointing device 103, judgment and instructions on the monitoring target can be made by human judgment, making it more flexible or more accurate. In addition, it is possible to capture a monitoring target to be monitored by the imaging device 101.

12A and 12B are diagrams showing an example of a hardware configuration of the photographing direction control device 107 according to Embodiment 1 of the present invention.
In the first embodiment of the present invention, the imaging control unit 1071 is realized by the processing circuit 111. That is, the imaging direction control device 107 includes a processing circuit 111 for controlling the imaging direction of the imaging device 101 based on the detection area information received from the detection device 102.
The processing circuit 111 may be dedicated hardware as shown in FIG. 12A or a CPU (Central Processing Unit) 116 that executes a program stored in the memory 115 as shown in FIG. 12B.

  When the processing circuit 111 is dedicated hardware, the processing circuit 111 may be, for example, a single circuit, a complex circuit, a programmed processor, a parallel programmed processor, an application specific integrated circuit (ASIC), an FPGA (field-programmable) Gate Array) or a combination thereof is applicable.

  When the processing circuit 111 is the CPU 116, the function of the imaging control unit 1071 is realized by software, firmware, or a combination of software and firmware. In other words, the imaging control unit 1071 is realized by a processing circuit such as a system integrated circuit (LSI) such as a CPU 116 that executes a program stored in a hard disk drive (HDD) 112 or the memory 115. Alternatively, the program may be stored in the processing circuit 111. Further, it can be said that the program stored in the HDD 112, the memory 115 or the like causes the computer to execute the procedure and method of the photographing control unit 1071. Here, the memory 115 is, for example, a random access memory (RAM), a read only memory (ROM), a flash memory, an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), an HDD 112 or the like. Non-volatile or volatile semiconductor memory, magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), etc. correspond.

  The imaging direction control device 107 also has an input interface device 113 and an output interface device 114 that communicate with the imaging device 101 or a device such as the detection device 102. The receiving unit is configured of, for example, the input interface device 113.

  As described above, according to the first embodiment, the monitoring system transmits a signal indicating the direction in which the monitoring target is present, which is transmitted from a specific position within the monitoring target area, and the imaging device 101 that captures the monitoring target area. The system is configured to include the detection device 102 that detects the image and the imaging direction control device 107 that controls the imaging direction of the imaging device 101 based on the signal indicating the direction in which the monitoring target detected by the detection device 102 exists. The imaging device can be controlled to capture a monitoring target that does not exist in the imaging range of the current imaging device.

Second Embodiment
In the first embodiment, the detection device 102 detects an instruction from the instruction device 103, and the imaging direction control device 107 controls the imaging direction of the imaging device 101 based on the detection area information detected by the detection device 102. I was on my mind.
In the second embodiment, an embodiment will be described in which the shooting direction with high frequency is learned from the history of the shooting direction of the shooting device 101 controlled by the shooting direction control device 107.

FIG. 13 is a diagram showing an example of the entire configuration of a monitoring system according to a second embodiment.
In FIG. 13, the same components as those described with reference to FIG. 1 in the first embodiment are denoted by the same reference numerals, and redundant description will be omitted. In the second embodiment, as an example, as shown in FIG. 13, the photographing apparatus 101a incorporates the photographing direction control device 107. However, the present invention is not limited to this. The photographing direction control device 107 may be a photographing apparatus It may be provided outside of 101a.
The configuration of the photographing direction control device 107 is the same as the configuration described with reference to FIG. 6 in the first embodiment, so the same reference numerals are given and duplicate descriptions are omitted.

  The monitoring system illustrated in FIG. 13 is different from the monitoring system illustrated in FIG. 1 in detailed configurations of the imaging device 101a, the display device 104a, and the recording device 105a. While the imaging device 101 in the monitoring system of the first embodiment does not have a metadata (eg, pan angle, tilt angle, zoom value, etc.) distribution function, the imaging device 101 a in the monitoring system of the second embodiment Differs in that it has a metadata delivery function. In addition, the display device 104 in the monitoring system according to the first embodiment has a preset function of controlling the photographing device at the preset position with the photographing direction (pan angle, tilt angle, zoom value, etc.) of the photographing device specified in advance as the preset position. While the display control device 108 is not provided, the display device 104a in the monitoring system of the second embodiment is different in that the display control device 108 having a preset function is provided. Further, while the recording device 105 in the monitoring system of the first embodiment does not have a learning function for learning the shooting direction with high frequency, the recording device 105 a in the monitoring system of the second embodiment has a learning function. The point to prepare is different.

  The imaging device 101a has a metadata delivery function. The metadata may be distributed as a stream in the same manner as the video data, or may be embedded in the video stream. Specifically, a metastream is distributed, metadata values are superimposed on video data as image data, and stored in APPn, which is a JPEG header area. H.264 | MPEG-4 AVC is stored in SEI, which is a header area, and the like.

The display device 104 a mounts the display control device 108.
In the second embodiment, as an example, as shown in FIG. 13, the display device 104a is equipped with the display control device 108. However, the present invention is not limited to this. The display control device 108 is outside the display device 104a. It may be provided.
The display control device 108 publishes an external I / F (interface) so that a preset candidate can be proposed from an external device (for example, the recording device 105 a). The preset position may be stored by the display control device 108 or may be recorded by the recording device 105a.
The display control device 108 includes a control unit 1081 and a reception unit 1082 as shown in FIG.
The control unit 1081 executes various instructions from the reception unit 1082.
The receiving unit 1082 receives various instructions from an external I / F (recording device 105 a, remote monitor, etc.), and transmits the received instructions to the control unit 1081 as necessary.
The accepting unit 1082 accepts information on preset candidates transmitted from the recording device 105a (hereinafter referred to as proposal preset information), and causes the display device 104a to display a screen or the like that proposes the preset candidates. When the reception unit 1082 receives instruction information (first instruction information) indicating that the content of the preset candidate is to be confirmed by the remote monitoring person selecting the confirmation instruction screen, the control unit 1081 instructs the photographing direction. The proposal preset information received from the recording device 105a (details will be described later) is transmitted to the photographing control unit 1071 of the control device 107, and the display device 104a displays a screen or the like for selecting whether to perform the presetting. Further, the reception unit 1082 transmits, to the recording device 105 a, instruction information (second instruction information) indicating that preset is received from the display device 104 a or not performed.

The recording device 105 a includes a proposal preset transmission / reception control unit 1051, a recording control unit 1052, a recording unit 1053, and a proposal preset calculation unit 1054.
The proposal preset transmission / reception control unit 1051 transmits the proposal preset information output from the proposal preset calculation unit 1054 to the display control device 108. In addition, the proposed preset transmission / reception control unit 1051 receives the second instruction information transmitted from the display control device 108, and outputs the second instruction information to the proposed preset calculation unit 1054.

The recording control unit 1052 receives the control information of the photographing direction of the photographing apparatus 101a transmitted from the photographing direction control device 107, and records the control information as learning data in the recording unit 1053.
The recording unit 1053 records control information of the photographing direction of the photographing apparatus 101a as learning data based on the control of the recording control unit 1052.
In the second embodiment, when the imaging control unit 1071 of the imaging direction control device 107 performs control to change the imaging direction of the imaging device 101a, image data or video data of the imaging direction after the change, and the image data The parameters at the time of control are transmitted to the recording device 105a. For example, image data or video data and control parameters are distributed as streams from the imaging device 101a.

The proposal preset calculation unit 1054 learns the photographing direction of the photographing apparatus 101 a based on the learning data recorded in the recording unit 1053, and determines the photographing direction with high frequency as the photographing direction to be proposed as a preset candidate. The learning data recorded in the recording unit 1053 is data including control information of the photographing direction as described above, and more specifically, data including pan angle, tilt angle, zoom value, etc., which are parameters at the time of control. is there.
The proposal preset operation unit 1054 outputs control information of the photographing direction proposed as a preset candidate to the proposal preset transmission / reception control unit 1051 as proposal preset information.

The operation of the monitoring system of the second embodiment will be described.
FIG. 14 is a flowchart for explaining an example of the operation of the monitoring system of the second embodiment.
In the second embodiment, as described above, when the photographing control unit 1071 of the photographing direction control device 107 controls the photographing direction with respect to the photographing device 101a, the control information of the photographing direction is transmitted to the recording control unit of the recording device 105a. Send to 1052.
The operation described below with reference to FIG. 14 is assumed to be performed, for example, at the timing when an instruction from the on-site supervisor is received. Note that this is merely an example, and the operations described below may be performed at other timings.

  The recording control unit 1052 of the recording device 105a receives the control information of the photographing direction transmitted from the photographing direction control device 107 (step ST1401), and causes the recording unit 1053 to record it as learning data (step ST1402).

The proposal preset operation unit 1054 learns the frequency of the photographing direction based on the learning data recorded in the recording unit 1053 (step ST1403).
The proposal preset operation unit 1054 learns the frequency of the photographing direction of the photographing apparatus 101 a by machine learning such as clustering, for example.
Specifically, the proposal preset operation unit 1054 learns the frequency of the photographing direction based on the learning data recorded in the recording unit 1053. The frequency of the shooting direction is, for example, the number of times of specification for the last week when the corresponding shooting direction is specified, the total number of times of specification when the corresponding shooting direction is specified, or the continuous specified time for which the corresponding shooting direction is specified. . The proposal preset operation unit 1054 classifies the shooting direction that appears with relatively high frequency as the “high frequency” shooting direction as a result of learning.

  As a result of learning in step ST1403, the proposal preset operation unit 1054 determines whether there is a shooting direction classified into high frequency (step ST1404).

  When it is determined in step ST1404 that there is no shooting direction classified into high frequency (in the case of “NO” in step ST1404), the process returns to step ST1401.

If it is determined in step ST 1404 that there is a shooting direction classified into high frequency (in the case of “YES” in step ST 1404), the control information of the shooting direction determined to be classified into high frequency Are output to the proposed preset transmission / reception control unit 1051 as proposed preset information. For example, when there are a plurality of shooting directions determined to be classified as high frequency, the proposal preset operation unit 1054 sets control information of the shooting direction determined as the highest frequency as proposal preset information.
When the proposal preset transmission / reception control unit 1051 obtains the proposal preset information from the proposal preset calculation unit 1054, the proposal preset transmission / reception control unit 1051 transmits the proposal preset information to the display control apparatus 108 (step ST1405).

When the proposal preset information is received from the recording device 105a, the reception unit 1082 of the display control device 108 checks the content of the display device 104a for the shooting direction with high frequency based on the received proposal preset information. Display the confirmation instruction screen for accepting the specification of the from the remote monitoring person. The display of the confirmation instruction screen is performed using, for example, a GUI (Graphical User Interface).
Here, FIG. 15 is a diagram for explaining an example of a screen displayed on the display device 104 a when the reception unit 1082 of the display control device 108 receives the proposed preset information in the second embodiment, and FIG. They are an example of a confirmation instruction screen. The screen examples shown in FIG. 15B and FIG. 15C will be described later.

When the confirmation instruction screen as shown in FIG. 15A is displayed on the display device 104a, the remote monitoring person confirms the confirmation instruction screen, and determines whether or not the content confirmation of the shooting direction is performed frequently.
Then, the remote monitoring person confirms the content or inputs an instruction not to confirm the content from the confirmation instruction screen using an input device (not shown) such as a touch panel, a mouse, and a keyboard.
For example, in the confirmation instruction screen of FIG. 15A, the remote monitoring person inputs “Yes” to confirm the content, “No” on the touch panel when the content confirmation is not performed, or the like.
The reception unit 1082 of the display control device 108 receives the first instruction information indicating that the content confirmation or the content confirmation is not performed, which is input from the input device, and receives the proposed preset information received from the recording device 105 a. , To the control unit 1081.

The receiving unit 1082 determines whether or not the first instruction information to perform content confirmation has been received (step ST1406).
In step ST1406, if the first instruction information to perform content confirmation has not been received (in the case of “NO” in step ST1406), that is, if the first instruction information to not perform content confirmation is received, It returns to step ST1401. When the first instruction information to the effect that content confirmation is not performed is received from the remote monitoring person, the reception unit 1082 discards the proposal preset information received from the proposal preset transmission / reception control unit 1051 of the recording device 105a in step ST1405. .

In step ST1406, when the first instruction information to confirm the content is received (in the case of “YES” in step ST1406), the accepting unit 1082 sends a message to the control unit 1081 in step ST1405 from the recording device 105a. The received proposal preset information is transmitted, and the control unit 1081 transmits the same information to the imaging control unit 1071 of the imaging direction control device 107.
When the shooting control unit 1071 receives the proposal preset information from the control unit 1081, the shooting control unit 1071 controls the shooting direction of the shooting apparatus 101a so as to be the shooting direction based on the received proposal preset information. The specific operation is the same as the control operation of the photographing direction described in the first embodiment, and therefore the duplicated description is omitted (see step ST703 in FIG. 7).
When the shooting direction of the shooting apparatus 101a is controlled by the shooting control unit 1071, the shooting unit 1011 of the shooting apparatus 101a shoots an image or video of the monitoring target area in the shooting direction based on the control of the shooting direction control unit 107. The image or video and the control parameter are transmitted to the display device 104a and the recording device 105a.
In the second embodiment, at this time, the photographing unit 1011 of the photographing apparatus 101a records that, together with the image or video, for example, to prevent the control parameter at the time of the control instruction according to the confirmation content from becoming learning data. Send to device 105a. Note that this is merely an example, and it may be determined that it is a control parameter at the time of control based on the proposed preset.

The display device 104 a displays the image or video transmitted from the imaging unit 1011.
The reception unit 1082 of the display control device 108 causes the display device 104 a to display a preset necessity indication screen for confirming whether or not to preset the shooting direction in which the displayed image or video is shot.

FIG. 15B is a diagram showing an example of a presetting necessity indication screen that the receiving unit 1082 of the display control device 108 causes the display device 104a to display in the second embodiment. The reception unit 1082 causes the display device 104a to display a preset necessity / non-necessity instruction screen as shown in FIG. 15B, for example, in a pop-up screen or the like.
The remote monitor checks the image or video currently displayed on the display device 104a, and presets the shooting direction in which the image or video was shot, or an instruction not to preset is required to be preset Input from the no indication screen using the input device.
For example, in the preset necessity indication screen of FIG. 15B, the remote monitoring person inputs “Yes” when performing preset, “No” when not performing with the touch panel, or the like.
The receiving unit 1082 of the display control device 108 receives the second instruction information input from the input device, indicating that presetting or non-presetting is to be performed.
The reception unit 1082 transmits, to the recording device 105 a, second instruction information indicating that preset is performed or not performed, which is input from the input device. At this time, for example, the accepting unit 1082 adds second instruction information to the proposed preset information received from the proposed preset transmission / reception control unit 1051 of the recording device 105a in step ST1405, and transmits the information to the recording device 105a.
The reception unit 1082 displays, on the display device 104a, a registration completion screen after transmitting, to the recording device 105a, the second instruction information indicating that presetting or non-presetting is input from the input device. Let
FIG. 15C is a diagram showing an example of a registration completion screen displayed by the reception unit 1082 on the display device 104a in the second embodiment. The preset name may be set as a default setting, and may be set by the reception unit 1082 when the second instruction information indicating that the preset is to be performed is received, or the remote monitor may be preset for the remote monitor. When inputting the second instruction information to the effect of performing the command, it may be input each time.

The proposed preset transmission / reception control unit 1051 of the recording device 105 a determines whether or not the second instruction information to perform the presetting is received from the display control device 108 (step ST 1407).
In step ST1407, when the second instruction information indicating that preset is to be performed has not been received (“NO” in step ST1407), that is, the second instruction information indicating that preset is not performed is received. The proposed preset transmission / reception control unit 1051 feeds back to the proposed preset operation unit 1054 that the presetting is not performed (step ST1411), and the process proceeds to step ST1409.

  In step ST1407, when the second instruction information indicating that preset is to be performed is received (in the case of “YES” in step ST1407), the proposed preset transmission / reception control unit 1051 performs preset on the proposed preset operation unit 1054. The effect is fed back (step ST1408).

  When feedback to the effect that presetting is to be performed or nonpresetting is to be fed back, for example, in the case where feedback to the effect that presetting is to be performed, the proposed preset operation unit 1054 takes the photographing as the proposed preset information in step ST1404 The control information of the device 101a is excluded from learning. This is merely an example, and information on the correct answer selected by the remote monitor may be fed back to the learning system to improve efficiency.

  In the above description, when there are a plurality of shooting directions determined to be classified as high frequency, the proposed preset operation unit 1054 determines the control information of the shooting direction of the shooting apparatus 101 a determined as the highest frequency, The proposal preset information is not limited to this. For example, the proposal preset operation unit 1054 may create proposal preset information for all shooting directions determined to be classified frequently. In this case, in the display control device 108, for example, on the confirmation instruction screen, it is possible to accept specification of confirmation of the proposed preset information related to which imaging direction, and the remote monitor arbitrarily selects and controls Alternatively, desired suggestion preset information is arbitrarily selected from a plurality of images or videos.

As described above, according to the second embodiment, the monitoring system includes the display control device 108 or the recording device 105a having the preset function of designating and holding control information of the photographing direction in advance, and controls the photographing direction. A recording control unit 1052 that receives control information of the photographing direction of the photographing apparatus 101a and a recording unit that records the control information of the photographing direction of the photographing apparatus 101a received by the recording control unit 1052 as learning data. The recording apparatus 105a includes the proposed preset calculation unit 1054, which learns the photographing direction of the photographing apparatus 101a based on the learning data recorded by the recording unit 1053 and the high frequency photographing direction as the preset candidate 1053. Since we configured, based on the past control situation, we will automatically extract the shooting direction specified frequently. It is possible to reset of.
Thus, for example, the shooting range overlooked by the remote monitor can be specified from the designation information of the shooting direction of the on-site supervisor. In the surveillance system, the importance of the shooting direction is learned from the specified information of the shooting direction of the on-site supervisor, and the monitoring target is proposed by suggesting the shooting direction in the oversight range that is not preset by the remote monitoring person. Can be reduced.

  In the scope of the invention, the present invention allows free combination of each embodiment, or modification of any component of each embodiment, or omission of any component in each embodiment. .

  101, 101a imaging apparatus, 102 detection apparatus, 103 instruction apparatus, 104, 104a display apparatus, 105, 105a recording apparatus, 106 control apparatus, 107 imaging direction control apparatus, 108 display control apparatus, 111 processing circuit, 112 HDD, 113 inputs Interface device, 114 output interface device, 115 memory, 116 CPU, 302 detection area, 305 monitoring target, 801, 801 a surveillance camera, 802 imaging range, 803 imaging available range, 901 line, 902 home, 1001 field supervisor, 1002 laser Pointer, 1003 monitoring target, 1011 imaging unit, 1012 focus alignment processing unit, 1013 rotation processing unit, 1051 transmission / reception control unit, 1052 recording control unit, 1053 recording unit, 1054 preset operation unit, 107 Imaging control unit, 1072 conversion unit, 1081 control unit, 1082 receiving unit.

Claims (10)

An imaging device for imaging the monitoring target area;
A detection device for detecting a signal indicating a direction in which the monitoring target is present, which is transmitted from a specific position in the monitoring target area;
A monitoring direction control device configured to control a shooting direction of the shooting device based on a signal indicating a direction in which a monitoring target detected by the detection device is present. It further comprises an indication device for emitting a signal indicating the direction in which the monitoring target exists from a specific position in the monitoring target area,
The monitoring system according to claim 1, wherein the detection device detects a signal indicating the direction in which the monitoring target transmitted by the pointing device is present. The pointing device transmits a signal indicating a direction in which the monitoring target is present from the specific position, with the position where the monitoring target is present in the monitoring target area as a specific position. Monitoring system. The pointing device emits a light beam, projects the light beam to the monitoring target, and transmits the light beam reflected by the monitoring target as a signal indicating a direction in which the monitoring target is present. The monitoring system according to claim 3, wherein The monitoring system according to claim 2, wherein the pointing device emits a light beam and transmits the light beam directly projected to the detection device as a signal indicating a direction in which a monitoring target exists. A recording control unit that receives control information of the imaging direction of the imaging device under control of the imaging direction control device;
A recording unit that records, as learning data, control information of the imaging direction of the imaging device received by the recording control unit;
A recording apparatus comprising: a proposed preset calculation unit which learns the photographing direction of the photographing device based on the learning data recorded by the recording unit, and takes a high frequency photographing direction as a preset candidate. 5. A monitoring system according to any one of 5. The display control apparatus further includes a display control device that receives an instruction as to whether or not to preset a shooting direction designated in advance based on the preset candidate.
When the display control device receives the second instruction information for presetting the imaging direction specified based on the preset candidate, the display control device or the recording device is previously based on the preset candidate. 7. The monitoring system according to claim 6, wherein control information of a designated imaging direction is held as information of a preset position. The proposed preset operation unit learns the photographing direction of the photographing device based on the second instruction information for instructing the photographing direction of the photographing device as the preset candidate to be the preset position and the preset position. The monitoring system according to claim 6, wherein When the information regarding the preset candidate determined by the proposed preset calculation unit is received, and the first instruction information for confirming the content of the preset candidate is received, the photographing direction control device relates to the preset candidate. The display control apparatus further includes a reception unit that transmits information.
When the information regarding the preset candidate is received from the reception unit, the shooting direction control device controls the shooting direction of the shooting device to be the shooting direction based on the preset candidate.
The reception unit transmits the second instruction information to the proposal preset operation unit when the second instruction information for presetting the imaging direction controlled by the imaging direction control device is received,
The surveillance system according to claim 6, wherein the proposal preset operation unit presets the photographing direction of the photographing device as the preset candidate. A receiving unit that receives a signal indicating a direction in which the monitoring target is present, which is transmitted from a specific position in the monitoring target area by the pointing device;
And a photographing control unit configured to control a photographing direction of a photographing apparatus for photographing the monitoring target area based on a signal received by the receiving unit.

Images