JP2005244562A - Remote control method and apparatus for camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve problems that it is impossible to point out a noted part at once because only a magnified video image is displayed on a monitor in the case of the operation by an operator with a conventional technology where a photographing object exists cannot be discriminated in a photographing range and only a relative movement can be recognized, that smooth photographing cannot be attained because of a delay caused between a camera and the operator through the presence of a communication line, and that instruction by the operator is often required because whether or not what is really desirably to be viewed is photographed cannot be understood although smooth photographing can be attained in matching with a mobile body in the case of automatic tracking photographing by means of motion detection or the like on the other hand. <P>SOLUTION: The operator points out the noted part in an entire video image by a pointing device to display a cursor thereby clarifying a positional relation and directly displaying the magnified video image of the noted part. In the case of viewing the entire video image and the magnified video image by two cameras, the video image of the rotary camera and the entire video image are composed and the composite image can be displayed on the screen viewed by the operator. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a remote camera remote control method and apparatus.

In order to control the rotating camera, an operator operates with a remote controller or the like, or is operated according to a preset pan / tilt / zoom condition by a preset function.
There is also an imaging device that automatically detects an imaging object by motion detection or an external sensor and continuously tracks the object.
JP 2004-015516 A

When an operator operates using a method according to the prior art, only an enlarged image is output to the monitor, so it is not possible to know where the shooting target is in the shooting range, and only relative movement can be determined.
Therefore, it is impossible to point at a time, and when a communication line is connected between the apparatus and the operator, a delay occurs and smooth photographing cannot be performed.
On the other hand, automatic tracking shooting using motion detection can perform smooth shooting according to the moving object, but it is not known whether the subject is really shooting, and human instructions may be required.
If something different from what you want to see is detected, we want to have a means that can be instructed by humans. In this case, the relative instruction from the conventional remote controller is not in time, and some direct means is required.

A point of interest in the entire image is designated by a pointing device and displayed as a cursor to clarify the positional relationship, and an enlarged image of the point of interest is directly displayed.
Viewing the entire image and the enlarged image on two monitors may cause an oversight or an operation error, so that the screen viewed by the operator can be displayed by combining the image of the rotating camera and the entire image.
Only images from a rotating camera can be output for relay and recording. However, in security applications, it is advantageous to record the video including the whole because the positional relationship with the whole becomes clear.

When the operator operates the rotating camera while looking at the monitor, the enlarged image and the entire image can be displayed on one screen, so the camera is focused on the target portion while checking the absolute position in the shooting range by viewing the entire image. Be directed.
Therefore, the part of interest can be pointed more accurately.

  Even through a communication line between the apparatus and the operator, the pointing device can directly specify on the screen, so that the delay can be minimized and an enlarged image of the target portion can be taken without missing the opportunity.

  When a point different from the desired location is detected by automatic tracking shooting based on motion detection, an accurate target portion can be immediately shot by a button operation by an operator or direct designation of a pointing device.

  By panning the rotating camera in advance and connecting the images and using it as a whole image map, the rotating camera can be operated while checking the position of the monitoring range only with the rotating camera.

  By clicking on the magnified image and controlling the rotating camera, you can perform detailed pan / tilt operations. Also, it is limited to the range displayed on the device using only the rotating camera. Can be specified.

The best mode for carrying out the present invention will be described with reference to the drawings.
FIG. 1 shows an apparatus combining a fixed camera and a rotating camera.

  FIG. 1 shows an image of a wide-angle fixed camera 2 as a whole image at the bottom of the screen, and an enlarged image of the rotating camera 1 at the top of the screen (control and monitoring monitor 30). It is a device that can control the rotary camera 1.

First, the video obtained from the fixed camera 2 is input to the cutout block 7, and the video above and below the shooting area is cut out to cut out only the middle in a panoramic shape. The cursor is overlaid on this video, and a video displaying a cursor indicating the center position of the enlarged video is output.

Means for controlling the pan / tilt of the rotating camera 1 include:
(1) When operating buttons on the device or remote control;
(2) When an operator designates a cursor on the entire video in a remote PC via a transmission device or a network,
(3) When specifying the cursor on the enlarged image,
(4) With a sensor installed within the shooting range,
(5) When detecting motion from the video of the fixed camera 2,
There is
Means for controlling the zoom of the rotating camera 1 include:
(6) Button operation with the device or remote control,
(7) In the remote PC via the transmission device or the network, when the operator indicates a range to be displayed on the enlarged image on the video with a square cursor,
There is.

When the pan / tilt operation is performed with the buttons of the remote controller or the device, the signal is converted into the coordinates for one point in the constant table 12 per one push of the button operation 36 and enters the adder 16. By being added to the coordinates, position information (coordinates) of the designated point is obtained. The coordinates are input to the cursor overlay block 9 and the angle calculation block 6. The former is displayed by moving the cursor on the entire image, the latter is converted into an angle, and the command conversion block 5 controls the rotating camera 1. The command is passed to the rotating camera 1 to pan / tilt the camera.
The operator confirms the video obtained in this manner, and repeats the button operation 36 until pan / tilt is performed at the point to be moved.
FIG. 3 is an explanatory diagram showing the exchange between the PC and the apparatus. When the PC 56 is operated, the operation and parameters are command-converted and transmitted to the device 60 (57), the command is analyzed and the control register is updated (59), and the updated video 58 is transmitted to the PC 56.
The details are as described in [0015] to [0016] and [0020].

When pan / tilt operation is performed on the image of the control (monitoring) PC 22 via the transmission apparatus or the network, first, a point to be viewed on the entire image on the display is directly designated (clicked) by the pointing device.
Then, the fact that the entire image is clicked on the PC side (operation) and the coordinates (parameters) on the clicked entire image are command-converted and transmitted to the apparatus (via the network).
On the device side, if the previous command is analyzed and it is determined that the entire video has been clicked, the coordinates are input to the cursor register 19.
Thereafter, the coordinates are input to the cursor overlay block 9 and the angle calculation block 6, and after following the same route as [0014] described above, the operator confirms the video displayed via the network.
The details are as shown in FIG.

When pan / tilt operation is performed on the enlarged image of the control (monitoring) PC 22 via the transmission apparatus or the network, first, the center point of the place to be seen in the enlarged image on the display is directly designated (clicked) by the pointing device. .
Then, the fact that the enlarged image is clicked on the PC side (operation) and the coordinates (parameters) on the enlarged image are command-converted and transmitted to the apparatus.
On the apparatus side, if the previous command is analyzed and it is determined that the enlarged image has been clicked, the coordinates are input to the enlargement ratio division block 13 and divided by the enlargement ratio input from the enlargement ratio register 29.
As a result, the coordinates of the movement at the same scale as the entire video are calculated.
Next, it is added to the current coordinates fed back from the cursor register 19 by the adder 16, and the coordinates to which the rotary camera 1 should be directed are input to the cursor register 19.
Thereafter, the coordinates are input to the cursor overlay block 9 and the angle calculation block 6, and after following the same route as [0014], the operator confirms the video displayed via the network.
This detailed description is as shown in FIG.

When pan / tilt operation is performed with the sensor input 39, coordinates corresponding to the sensor are written in advance in the sensor correspondence table 14, and when the sensor input signal is input to the table 14, position information (coordinates) of the point that has reacted. The coordinates are input to the cursor register 19.
Thereafter, the coordinates are input to the cursor overlay block 9 and the angle calculation block 6, followed by the same path as [0014], and then output to the monitor for confirmation.

When pan / tilt operation is performed using the moving object detection technique, the moving object is detected from the image of the fixed camera 2 (motion detection block 8), and position information (coordinates) where the moving object exists is obtained.
The coordinates are input to the cursor overlay block 9 and the angle calculation block 6, followed by the same path as [0014], and then output to the monitor for confirmation. If the mobile object is lost, the mobile phone returns to the preset home position (a home position register is installed in the motion detection block 8).

Regarding the zoom operation, the present invention considers a case where the operation is performed with the buttons of the remote controller or the apparatus and a case where the operation is performed on the display of the PC.
When the operation 41 is performed using the buttons on the remote controller or the device, the signal for each push of the button is converted into an enlargement rate for one point in the enlargement factor increase / decrease register 24 and enters the adder 27 and immediately before being fed back from the enlargement factor register 29. In addition to the enlargement ratio, it is input to the enlargement ratio register 29.
Thereafter, the enlargement ratio output from the enlargement ratio register 29 is transferred to the command conversion block 5 of the rotary camera 1 and converted into a zoom command of the rotary camera 1 to operate the rotary camera 1.
The operator confirms the result on the monitor, and presses the button repeatedly until it feels good.

When the zoom operation is performed on the PC, the range to be displayed as an enlarged image on the entire image is directly specified by clicking and dragging on the entire image on the PC 22 for control (monitoring) via the transmission device or the network as shown in FIG. To display a square cursor.
On the PC side, the X coordinate Xs of the start point of the specified range, the X coordinate Xe of the end point, and the operation are converted into commands and transmitted to the apparatus (operation and parameters).
When the apparatus analyzes the previous command and determines that the zoom operation has been performed, the two X coordinates are input to the enlargement ratio calculation block 25, and the current enlargement ratio fed back from the enlargement ratio register 29 and the monitor width An enlargement ratio (enlargement ratio for displaying the specified range) according to the following calculation formula is obtained from (for example, 640 dots).
Enlargement ratio = (Previous enlargement ratio) × (640 ÷ (Xe−Xs))
Here, Xs is the X coordinate of the designated range start point, and Xe is the X coordinate of the designated range end point.
The result is input to the enlargement ratio register 29.
Thereafter, the enlargement ratio output from the enlargement ratio register 29 is converted into a zoom command of the rotating camera 1 over the command conversion block 5 of the rotating camera 1, and the rotating camera 1 is operated.
The operator confirms by viewing the video displayed via the network.
However, the method described is a case where the horizontal component is used for the calculation, and the Y coordinate is used when considering the vertical component, and the calculation formula is: enlargement ratio = (previous enlargement ratio) × (480 ÷ (Ye−Ys))
Here, 480 is the vertical width of the monitor, Ys is the Y coordinate of the designated range start point, and Ye is the Y coordinate of the designated range end point.

  The registers [0014] to [0020] are provided with corresponding flags. When a button operation, a pointing device input by a PC or the like, a sensor input or a motion detection is performed, the corresponding flags are provided. The flag is activated (standing).

Information on the state of each flag is input to the priority encoder 26, and one of the flags activated is selected, and information on the selected flag is input to the selector, and the register corresponding to the flag is selected. The stored position information is acquired as a control signal for the rotating camera 1.
The priority of this embodiment is
(1) Button operation with the device or remote control,
(2) PC pointing device operation (whole picture designation),
(3) Operation by PC pointing device (enlarged video designation),
(4) Sensor input,
(5) motion detection,
In the zoom operation, (1) button operation by the device or remote control (2) range designation on the image by the pointing device.

The control signal of the rotating camera 1 is input to the rotating camera 1 and the enlarged video data of the target portion is output.
This video is used for the relay monitor 4.

The video data [0012] and [0023] are respectively input to the video synthesis block 10 and output to the control (monitoring) monitor 30 and the control (monitoring) PC 22 through the D / A conversion 11.
The video composition block 10 is controlled by a composition control signal obtained by converting the address data from the display address counter 21 by the composition control block 20.

  FIG. 2 memorizes the images shot by panning the rotary camera 1 90 degrees at a time four times in advance, and obtains a whole image that covers the entire shooting range by attaching the four images, and controls the image as a map It is a device that is configured below the image of the (monitoring) monitor 30 or the control (monitoring) PC 22 and can move the cursor on the map by the operator to control the rotary camera 1 and obtain an enlarged image.

First, the entire surveillance video is acquired by pressing the update button 34. When the update button 34 is pressed, a signal is passed from the connection control block 35 to the selector, and the video of the rotary camera 1 is input to the reduction block 31 and becomes a 1/4 size video.
At the same time, a signal is passed to the sensor correspondence table 14 of the connection control block 35 and a rotating camera control signal is output so that the rotating camera 1 pans at a preset angle (for example, if the angle of view is 90 degrees, it is 360 degrees in 4 times). To do.
Next, when the panning of the rotating camera 1 stops, the connection control block 35 issues a write address so that the reduced image is written in the memory, and issues a read address so that the four reduced images become panoramic.
The image (map) read at the above-described timing is input to the cursor overlay block 9 and a synthesized video is synthesized and displayed.
At the same time, it is stored in the non-volatile memory 33 so that it remains even if the apparatus is turned off.

Means for pan / tilt control of the rotating camera 1 include:
(1) Button operation 36 by the device or remote control;
(2) When an operator designates a cursor on the entire video in a remote PC via a transmission device or a network,
(3) When specifying the cursor on the enlarged image,
(4) by the sensor 39 installed in the imaging area;
(5) When the motion detection block 8 detects from the image of the rotating camera 1,
There is.
The zoom control means includes
(6) Button operation 41 by the device or remote control;
(7) When the operator designates a range to be displayed on the enlarged image on the video in the remote PC via the transmission device or the network;
There is.

When the pan / tilt operation is performed by the remote controller or the device, the operation is performed by the same means as the method shown in [0014].

When panning / tilting is performed on the entire video of the control (monitoring) PC 22 via the transmission apparatus or the network, it is operated by means similar to the method shown in [0015].

When performing pan / tilt operation on the enlarged image of the control (monitoring) PC 22 via the transmission apparatus or the network, the operation is performed by means similar to the method shown in [0016].

When pan / tilt operation is performed by sensor input, it is operated by means similar to the method shown in [0017].

When performing pan / tilt operation using the moving object detection technology, the moving object is detected from the image of the rotating camera 1 (motion detection block 8), and the relative position information of the moving object (coordinates in the enlarged image) Get.
The relative coordinates are input to the cursor register 19 as coordinates on the whole image added by the adder 16 and the previous coordinates from the cursor register 19.
Thereafter, the coordinates are input to the cursor overlay block 9 and the angle calculation block 6, followed by a route similar to [0014], and then output to the monitor for confirmation.
When the moving object is lost, the home position set in advance in the motion detection block 8 (home position register) is returned.

When the zoom operation is performed with the buttons of the remote controller or the device, the operation is performed by means similar to the method shown in [0019].

When the zoom operation is performed on the PC, it is operated by means similar to the method shown in [0020].

The registers [0028] to [0034] are provided with corresponding flags. When a button operation, a pointing device input by a PC or the like, a sensor input, or a motion is detected, they correspond respectively. The flag to be activated is activated.

Information on the state of each flag is input to the priority encoder 26 and operates in the same manner as in [0022] to obtain a rotating camera control signal.

The control signal of the rotating camera 1 is input to the rotating camera 1, and the enlarged video data of the target portion is output.
This video is used for the relay monitor 4.

The video data [0026] and [0037] are respectively input to the video synthesis block 10 and output to the control (monitoring) monitor 30 and the control (monitoring) PC 22 via the D / A conversion 11.
The video composition block 10 is controlled by a composition control signal obtained by converting the address data from the display address counter 21 by the composition control block 20.

A device that combines a fixed camera and a rotating camera. A device that uses only a rotating camera. Explanatory drawing which shows exchange between PC and an apparatus. Explanatory drawing of [0015] of Example 1. FIG. Explanatory drawing of [0016] of Example 1. FIG. Explanatory drawing of [0020] of Example 1. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Rotating camera 2 Fixed camera 3,11 D / A conversion 4 Relay monitor 5 Rotating camera control command conversion block 6 Angle calculation block 7 Extraction block 8 Motion detection block 9 Cursor overlay block 10 Video composition block 12 Constant table 13 Magnification ratio Division block 14 Sensor correspondence table 15, 18, 28 Selector 16, 27 Adder 19 Cursor register 20 Composition control block 21 Display address counter 22 PC for control (monitoring)
23 mouse 24 enlargement rate increase / decrease register 25 enlargement rate calculation block 26 priority encoder 29 enlargement rate register 30 control (monitor) monitor 31 reduction block 32 memory 33 nonvolatile memory 34 update button 35 connection control block 36 button operation 37 PC pan / tilt・ Command (serial)
38 PC pan / tilt command (serial)
40 Video Output Switching Block 41 Button Operation / Zoom Indirect Operation 42 PC Zoom Command (Serial) Direct Operation 43 Various Input Signals to Priority Encoder 26 51 ₁ , 51 ₂ , 5 _{3 3} Magnified Video 52 ₁ , 52 ₂ , 52 ₃ whole by the fixed camera image 53 _{1, 53} 2, 53 ₃ altered enlarged image 54 _{1, 54} 2, 54 ₃ altered the overall image 55 operation → command conversion 56 PC
57 _{1, 57} 2, 57 ₃ command transfer 58 updated image 59 _{1, 59} 2, 59 ₃ updates 60 61 ₂ command analysis → control register, 62 ₃ formula

Claims (6)

A whole image shooting means of the range to be shot;
A means of designating the part of interest on the entire video;
Means for displaying the position of the target portion on the whole image;
Means for obtaining an enlarged image of the portion of interest;
Means for synthesizing and displaying the whole image and the enlarged image;
Composed by
Specify the focused position on the entire real-time video,
A remote control method and apparatus for a camera, wherein the enlarged image is displayed on a monitor. A whole image shooting means of the range to be shot;
Means for acquiring an enlarged image of the target portion;
Means for designating a portion of interest on the enlarged image;
Means for corresponding the position on the whole image;
Means for synthesizing and displaying the whole image and the enlarged image;
Composed by
Specify the focused position on the real-time enlarged image,
A remote control method and apparatus for a camera, characterized in that its position is displayed on the entire image. A whole image shooting means of the range to be shot;
Means for acquiring an enlarged image of the target portion;
Means for designating a range to be displayed on the enlarged image on the entire image or the enlarged image;
A means for changing the magnification according to the specified display range;
Means for synthesizing and displaying the whole image and the enlarged image;
Composed by
3. The camera remote control method and apparatus according to claim 1, wherein an enlargement ratio of a point of interest can be designated on a screen. A whole image shooting means of the range to be shot;
Means for storing the entire video;
Means for designating a portion of interest on the stored whole image;
Means for obtaining an enlarged image of the portion of interest;
Means for synthesizing and displaying the whole image and the enlarged image;
Composed by
The remote control method and apparatus for a camera according to claim 1 or 2, wherein a target position can be designated or confirmed using an entire video imaged in advance. A whole image shooting means of the range to be shot;
A means of specifying a portion of interest and obtaining an enlarged image;
Means for designating relative movement with respect to the current position of interest;
2. The camera remote control method and apparatus according to claim 1, wherein the position can be finely adjusted. A whole image shooting means of the range to be shot;
A means for acquiring information on a position where there was a change to be noticed;
Means for displaying the position on the entire image;
Means for obtaining an enlarged image of the position;
Means for synthesizing and displaying the whole image and the enlarged image;
Composed by
A remote control method and apparatus for a camera, characterized in that position information is displayed on the whole video for enlarged changes, an enlarged video is obtained, and continuously displayed on a monitor for tracking. .

Images