JP2003158664A - Camera controller - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system where a video receiver receives and reproduces video data from a camera and the video receiver can quickly and simply operate a plurality of cameras when the video receiver controls a plurality of the cameras. SOLUTION: When the video receiver issues a camera control command to one camera, the camera receiving the control command issues a camera control command to a plurality of the other cameras to control the cameras not operated by a user. Since it is not required for the user to operate a plurality of the cameras, the operation is simplified and the operation time can be reduced. Further, since it is not required to issue the control command to all the cameras, the camera operation time can be reduced and a position or an object can quickly and simply be photographed in a plurality of directions.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention comprises a video transmission side that transmits video images captured by a plurality of cameras whose shooting directions are controllable, and a video reception side that receives video images via a network and displays the video images from a plurality of cameras. , A system capable of controlling the shooting direction of a camera connected from a video receiving side to a video transmitting side.

[0002]

2. Description of the Related Art With the progress of network technology in recent years,
Send the video taken by the camera via the network,
Many systems that reproduce the image on the receiving side have appeared. Among these systems, there is a drive device that can change the shooting direction of the camera, and some can control the shooting direction of the camera connected from the side that receives and plays back the video to the side that sends the video. Many. By being able to control the shooting direction of the camera, the user who is far away from the camera can more appropriately understand the surrounding situation where the camera is installed.

This camera control device is used in a wide variety of applications such as surveillance, monitoring, and video conferencing. For example, when the camera control device is used for monitoring, by controlling the camera remotely, it is possible to capture an image of a moving suspicious person without losing sight.

FIG. 16 shows an example of the configuration of a conventional camera control device that controls the shooting direction of a camera that is transmitting a video from a terminal that is generally receiving the video. A method of controlling the shooting direction of the camera from the terminal receiving and displaying the image will be described with reference to FIG.

This camera control device is a video receiving device 1620 which receives video through a plurality of cameras 1610 and a network.
And a screen 1630 for displaying the received video and an input device 1640 for inputting control commands for operating the camera.

The plurality of cameras 1610 include a video transmission unit 1611 that transmits captured images to a network, a camera drive unit 1612 that changes the camera shooting direction, and a control command reception unit that receives a camera control command from a video reception device. 1614
And a camera control unit 1613 for instructing to change the shooting direction of the camera by referring to the control command. Some cameras have a shooting position recording unit 1615 that records the shooting direction of the camera, the focus position of the camera, and the like.

The image receiving device 1620 includes an image receiving unit 1621 for receiving an image transmitted by the camera and a plurality of received cameras.
A video reproduction unit 1622 for displaying the video of 1610 on the screen 1630 and a control command transmission unit 1623 for transmitting a camera control command input by the user using the input device 1640 to the camera.

The flow of processing in which the user controls the shooting directions of the plurality of cameras 1610 using the input device 1640 connected to the video receiving device 1620 will be described.

The user uses the input device 1640 to select one camera to be operated from among the plurality of cameras 1610, and inputs commands such as up, down, left and right. The control command transmission unit 1623 of the video reception device 1620 transmits the command input by the user to the camera designated by the user. The camera 1610 that receives the camera control command transmitted by the user receives the camera control command at the control command receiving unit 1614. The control command receiving unit 1614 transmits the received camera control command to the camera control unit 1613, the camera control unit 1613 instructs the camera driving unit 1612 to change the shooting direction of the camera according to the camera control command, and the camera driving unit 1612 Change the shooting direction of.

[0010]

However, in the prior art, firstly, when the user wants to acquire more information by shooting a certain shooting position or the state of an object from a plurality of directions, the user needs to use each camera. Since it is necessary to issue a camera control command instantaneously, it takes a long time to operate, and a complicated operation is required. In particular, when a moving object is tracked by a plurality of cameras, the conventional technique requires agile and accurate camera operation.

Secondly, even if the user operates a plurality of cameras to face in a direction in which an object can be photographed, the zoom magnification is not suitable for photographing an object, and a zoom control command is transmitted to each of the cameras. Therefore, there is a problem that the operation becomes complicated.

Thirdly, when the object moves after the user operates the plurality of cameras to instruct the camera to face the direction in which the object can be photographed, the user again issues a camera control command to each camera. There is a need to do it.

Fourth, when the user operates the camera, the user cannot grasp the blind spot of the operating camera,
When the object to be photographed moves into the blind spot of one camera, the user has to search for the object by operating the other cameras, and if the user loses sight of the moving object, he will capture it again in the image. However, there is a problem that many camera operations and time are required.

[0014]

In order to solve this problem, the present invention firstly proposes, among other cameras, the position at which the camera operated by the user from a remote location is currently taken by another camera. By giving the notification, the camera not operated by the user is controlled.

Thus, the user can operate a plurality of cameras without issuing a camera control command for photographing a position or an object to all the existing cameras, and issue a control command to all the cameras. Therefore, the operation time of the camera can be shortened, and a certain point or an object can be quickly and easily photographed from a plurality of directions.

Secondly, the zoom magnification of the camera operated by the user is recorded, and the distance between the camera and the photographing point and the zoom magnification are transmitted to another camera.

As a result, the user can
The zoom magnification of multiple cameras can be controlled simply by operating the zoom magnification of one camera, and it is possible to obtain the effect that the positions or objects desired to be photographed can be captured in the same size from multiple directions on the screen. .

Thirdly, when the object being photographed moves, the movement of the object is recognized from the image and the movement direction information is transmitted to the other plurality of cameras.

As a result, when the user operates the camera to take a picture of a moving object and shoots the moving object, another camera automatically moves the moving object even if it is likely to be lost due to an operation error or unpredictable movement of the object. The effect of being able to shoot is obtained.

Fourthly, the area in which the camera operated by the user cannot photograph is calculated, and based on the result, a camera control command is issued to the camera not operated by the user. .

Thus, even if the object to be photographed moves into the blind spot of one camera, the other cameras operate without user's operation, and the moving object can be caught quickly and easily. That is the effect that can be obtained.

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to FIGS. 1 to 15.

(Embodiment 1) In the present embodiment, an image transmitting apparatus for transmitting images photographed by a plurality of cameras and an image photographed by a plurality of cameras via a network are received, and images of a plurality of cameras are received. In a system that is configured by a video receiving device to be displayed and in which the shooting direction of the camera connected from the video receiving device side to the video transmitting device side can be controlled, there are multiple users with the input device connected to the video receiving device. When one of the cameras is operated, all of the existing cameras rotate in the direction in which the camera operated by the user is shooting, thereby capturing a single point or object from multiple directions. Will be described. The block diagram of this method is shown in FIG. Further, FIG. 2 shows an arrangement example of a camera, a shooting direction, and a configuration example of a screen of a display connected to a video receiving device when controlling the camera by this method.

In FIG. 1, 110 is a camera, 120 is an image receiving device, 130 is a screen for displaying images taken by a plurality of cameras such as a display, and 140 is an input device such as a joystick for operating one of the plurality of cameras. Further, in FIG. 2, 210 is a shooting area in which a plurality of cameras are installed, 211 and 212 are cameras installed in a monitoring area, 213 is a person in the shooting area 210, 220 is a screen displayed by the video receiving device, 221, Reference numeral 222 represents images captured by the cameras 211 and 212, respectively, and 223 represents a control panel for controlling the cameras.

The camera 110 shown in FIG. 1 transmits a captured image to a network, an image transmitting unit 111, a camera driving unit 112 that changes the photographing direction of the camera, and an instruction to the camera driving unit 112 to control the photographing direction of the camera. A camera control unit 113 for
A control command receiving unit 114 that receives a camera control instruction from a remote location, a shooting position recording unit 115 that records the current shooting position, and a control that sends the shooting position recorded by the shooting position recording unit 115 to the network. It is composed of the command transmission unit 116. The video receiving device 120 also includes a video receiving unit 121 that receives video from a network, a video playback unit 122 that displays the received video on the screen, and a camera control command input by the user to a camera connected on the network. It is composed of a control command transmitting unit 123 for transmitting.

In FIG. 3, one camera receives a control command from a user, rotates, and then transmits a shooting position to a camera installed separately, so that the same position as the camera controlled by the user is taken. It is a flowchart explaining the flow of the process which controls the installed camera. A method in which all the cameras installed in the photographing area 210 in FIG. 2 photograph one point 213 will be described with reference to FIG.

In the following description, a camera remotely operated by the user is referred to as an operation camera. A camera that rotates by receiving shooting position information from the operation camera is called a cooperative camera.

In FIG. 2, the operating camera is 212 and the cooperative camera is 211. The command receiving unit 114 of the operation camera 212 passes the received camera control command to the camera control unit 113, and the camera control unit 113 changes the shooting direction of the camera from the received camera control command (301). Shooting position recording unit 1
15 calculates the point where the camera is shooting from the shooting direction of the camera changed by the camera control unit 113, and passes the result to the control command transmission unit 116 (302).

FIG. 4 is a view showing that the operation camera 212 and the cooperative camera 211 installed in the photographing area 210 in FIG. 2 are photographing the same position 213, and 411 is the cooperative camera 211.
And a rotation angle 412 of the operation camera 212. A method of calculating the shooting position from the camera will be described with reference to FIG.

The operation camera 212 calculates a shooting position. The coordinates of the operation camera 212 are (0, 0), the x and y axes are appropriately determined, the photographing position is (x, y), the distance from the operation camera to the photographing position is r, and the rotation angle 412 of the operation camera is 412. Assuming the size of θ is θ, an example of calculating the imaging position (x, y) is x = r · cos θ (1) y = r · sin θ (2). Method is also acceptable.

In the above equation, the operation camera is set at the photographing position.
It can be obtained by adjusting the focus of 212 and acquiring the focus position of the camera, or by using the distance sensor to acquire the distance between the operation camera 212 and the shooting position. What is the acquisition method of r? The method does not matter.
In addition, θ also acquires the rotation angle from the camera, or the operation camera
It can be obtained by storing how much the home position 212 has rotated, but any method may be used to obtain θ.

The control command transmitting unit 116 is the photographing position recording unit 1
The shooting position information received from 15 is transmitted to the control command receiving unit of the cooperative camera 211 (303). Upon receiving the shooting position information, the control command receiving unit 114 of the cooperative camera 211 passes the shooting position information to the camera control unit 113, and the camera control unit 113 calculates an angle to rotate from the shooting position information and the installation position of the camera (304 ), And instructs the camera drive unit 112 to rotate the camera by the calculated angle (305).

A method for the camera control unit 113 to calculate the installation position of the cooperative camera from the photographing position information and the angle to rotate from the coordinates will be described with reference to FIG. Assuming that the coordinate of the cooperative camera 211 is (x ₁ , y ₁ ), as an example of calculating the angle 411 to rotate,

[Equation 1] ... (3) is given, but other methods may be used.

The camera control unit 113 controls the shooting direction of the cooperative camera to the angle calculated as described above. In addition,
(X ₁ , y ₁ ) can be measured based on the x-axis and y-axis defined above. As an example of the measurement method, a method of actually measuring the distance between the operation camera and the cooperation camera using a measure, or the user operating the operation camera from a remote location to shoot the cooperation camera and shooting the distance and angle You can use the method of calculating and getting from, but you can use any method. With the above flow, one shooting point can be shot by a plurality of cameras.

In this embodiment, the method of calculating the two-dimensional coordinates of the photographing position from the pan (horizontal) angle has been described in the example in which the area where a plurality of cameras are installed is viewed perpendicular to the ground. It is also possible to calculate and notify the 3D coordinates of the shooting position in consideration of the tilt (vertical) angle of the camera, and to shoot the 3D shooting position with multiple cameras in the same way. You can

Furthermore, although an example in which only one cooperative camera exists is shown in the present embodiment, a plurality of cooperative cameras may exist for one cooperative camera. The greater the number of linked cameras, the more the image receiving device can simultaneously view the images captured at the shooting position or in the more shooting directions of the object.

As described above, in the present embodiment, when the user issues a camera control command from the terminal to photograph a target operating a remote camera, another camera not operated by the user interlocks. This allows the user to operate multiple cameras without issuing multiple camera control commands for shooting a certain position or object, and issue control commands to all cameras. This saves time for camera operation and allows you to quickly and easily capture a point or object from multiple directions.

(Embodiment 2) In Embodiment 1, the method of notifying another camera of the photographing position of the camera operated by the user and photographing the point from a plurality of directions has been described. Here, in addition to the shooting position of the camera operated by the user, the zoom magnification of the camera is notified to another camera, so that the position where the user is shooting can be shot from a plurality of directions at the same magnification. explain. The block diagram of this method is shown in FIG. Further, FIG. 6 shows a screen of the image receiving device when the camera not operated by the user receives the shooting position and the zoom magnification from the camera operated by the user, faces the shooting position and adjusts the zoom magnification. is there.

In FIG. 5, 110 is a camera, 120 is an image receiving device, 130 is a screen for displaying images taken by a plurality of cameras such as a display, and 140 is an input device such as a joystick for operating one of the plurality of cameras.

The camera 110 shown in FIG. 5 has the same structure as that of the first embodiment except that the zoom magnification controller 511 for controlling the zoom magnification according to the control command received from the user and the camera and the zoom magnification recorder 512 for recording the zoom magnification of the camera. Is added. In addition to the shooting position information, the camera 110 transmits the zoom ratio of the camera 110 recorded in the zoom ratio recording unit 512 to another camera, and the camera receiving the shooting position information and the zoom ratio determines the zoom ratio along with the shooting position direction. By adjusting, multiple cameras shoot the same spot with the same screen size. Other configurations are the same as those of the first embodiment shown in FIG.

In the first embodiment, the plurality of cameras photograph the same point from a plurality of directions by transmitting the position information photographed by the camera operated by the user to another camera.

However, when only a position information is transmitted to a plurality of cameras when a certain point or object is photographed, the condition of the photographing position is displayed on the image because the distance between the installation position and the photographing position is too large depending on the cameras. However, since the distance between the installation position and the shooting position is too small, the situation at the shooting position is enlarged more than necessary. Therefore, in the present embodiment, the camera operated by the user transmits the zoom magnification of the camera to the other camera in addition to the photographing position information, so that the camera receiving the photographing position and the zoom magnification operates the user. A method of taking a picture with the same size as the video taken by the camera will be described. FIG. 7 is a flowchart illustrating the flow of processing from the operation camera 212 in FIG. 6 transmitting the zoom magnification to the reception by the cooperative camera 211 and controlling the zoom magnification. A method of controlling the zoom magnification of the cooperative camera 211 will be described below with reference to FIG. 7.

The operation camera 212 acquires the zoom magnification of the operation camera 212 from the zoom magnification storage unit 512 and transmits the photographing position and the zoom magnification to the cooperative camera 211 (701). The method of acquiring the shooting position is the same as the method described in the first embodiment. The cooperative camera 211 calculates the zoom magnification of the cooperative camera 211 based on the received shooting position and zoom magnification (702). The zoom magnification of the cooperation camera can be obtained from the installation position of the operation camera, the shooting position of the operation camera, the zoom magnification of the operation camera, and the installation position of the cooperation camera. The relationship between the distance between the camera and the shooting position and the zoom magnification differs depending on the camera, but in the present embodiment, as an example, the distance between the camera and the shooting position is linearly proportional to the zoom magnification, and the coordinates of the operating camera are (x ₂ , Y ₂ ), the shooting position is (x, y),
The zoom magnification of the operating camera is A, and the coordinate of the cooperative camera is (x
₃ , y ₃ ). The zoom magnification B of the linked camera is obtained as follows.

[Equation 2] ...(Four)

The control command receiving unit 114 transmits the zoom magnification obtained by the above equation (4) to the zoom magnification control unit 511. The method of controlling the camera based on the shooting position information received separately from the zoom magnification is the same as in the first embodiment. As described above, the cooperative camera that receives the shooting position and the zoom magnification,
It is possible to take a picture with the same size as the video taken by the operation camera operated by the user.

In this embodiment, the method of calculating the two-dimensional coordinates of the photographing position from the pan angle has been described in the example in which the area where a plurality of cameras are installed is viewed perpendicular to the ground.
It is also possible to calculate and notify the three-dimensional coordinates of the photographing position in consideration of the tilt angle of the camera, and the three-dimensional photographing position can be photographed by a plurality of cameras by the same method.

Furthermore, although an example in which only one cooperative camera exists is shown in the present embodiment, a plurality of cooperative cameras may exist for one cooperative camera. The greater the number of linked cameras, the more the image receiving device can simultaneously view the images captured at the shooting position or in the more shooting directions of the object.

Further, in the present embodiment, the zoom magnification of the cooperation camera is controlled so that the operation camera and the cooperation camera shoot the same area. However, for example, when the user uses the operation camera to track a suspicious person, By making the magnification of the cooperative camera smaller than that of the operation camera, it is possible to recognize the surrounding situation of the suspicious person in the image. Such control of the zoom magnification can be realized by the user issuing a command for controlling the magnification of the cooperative camera from the video receiving device, in addition to the camera operation command of the operation camera.
It can be easily analogized.

As described above, in this embodiment, a camera operated remotely by the user transmits the position taken by the camera to another camera so that one shooting point can be viewed from a plurality of directions. An area having the same size as the image captured by the camera operated by the user can be captured by the cooperative camera.

(Third Embodiment) In the first embodiment, the method of notifying another camera of the photographing position of the camera operated by the user and photographing the point from a plurality of directions has been described. In this embodiment, when a moving object such as a person is photographed by the operation camera operated by the user, the movement information of the object is sensed on the image to recognize the moving direction of the object,
A method for controlling the shooting direction of the linked camera by transmitting the moving direction to the linked camera will be described. The block diagram of this method is shown in FIG. Further, FIG. 9 is a screen of the video reception device when the linked camera which is not operated by the user receives the moving direction of the object from the operation camera which is operated by the user and controls the shooting direction.

In FIG. 8, 110 is a camera, 120 is an image receiving device, 130 is a screen for displaying images taken by a plurality of cameras such as a display, and 140 is an input device such as a joystick for operating one of the plurality of cameras.

The camera 110 of FIG. 8 has the same structure as that of the first embodiment except that the object moving direction detecting unit 811 for detecting the moving direction of the object.
Is added. The object movement direction detection unit 811 extracts an object such as a person from the image captured by the camera 110, determines in which direction on the screen it moves, and transmits the result to the control command transmission unit 116. Other configurations are the same as those of the first embodiment shown in FIG.

When the user operates the operation camera to track a moving object such as a person, the movement of the object does not follow the operation of the user, or a moving object such as a person appears on the image of the operation camera due to an operation error of the user. May not be captured. At this time, even if the user does not operate the operation camera, the operation camera recognizes the moving direction of the object and transmits it to the cooperation camera, so that the cooperation camera can capture a moving object such as a person in an image.

FIG. 10 is a flowchart for explaining the flow of processing when the operation camera recognizes the movement of an object, transmits the moving direction to the cooperation camera, and causes the cooperation camera to follow the movement of the object. Further, FIG. 11 is a diagram showing a movement vector recognized by the operation camera and a direction in which the cooperative camera should move when the object moves. A method for causing the cooperative camera to follow the movement of the object will be described with reference to FIGS.

When the operation camera recognizes the movement of the object when the operation camera and the cooperative camera are looking at the same object by the method as shown in the first embodiment, the object movement direction detection unit 811 moves the object. The direction is extracted and transmitted to the linked camera (1001). It is assumed that the moving direction of the object is extracted as a vector 1111 as shown in FIG. At this time, the operation camera 212
The control command transmitting unit 116 transmits the vector 1111 that is the motion information of the object to the cooperative camera 211. The control command receiving unit 114 of the cooperative camera 211, the vector 1111 and the cooperative camera 2
A camera control command that rotates so that the cooperative camera can capture a moving object from the position where 11 is shooting is generated (1002).

Object movement vector 1111 and cooperative camera 211
As an example of generating the camera control command in which the linked camera rotates from the shooting position of (1), (x _a , y _a ) is the position where the linked camera is shooting, and (x _v , y _v ) is the vector received from the operating camera. point coordinates object when is in after moving only vector that has moved (x, y) and _{x = (x a + x v} ) ... (5) y = (y a + y v) ... (6) Then, a method of converting the rotation angle of the cooperative camera into a control command by the method as described in the first embodiment is given, but another method may be used as long as a camera control command capable of capturing a moving object can be generated. Absent.

The control command receiving unit 114 transmits the camera control command obtained as described above to the camera control unit 113 so that the camera can capture a moving object. In the present embodiment, the method of calculating the two-dimensional coordinates of the shooting position from the pan angle has been described in the example in which the area where a plurality of cameras are installed is viewed perpendicular to the ground, but the tilt angle of the camera is also taken into consideration. Then, the three-dimensional coordinates of the photographing position can be calculated and notified, and the three-dimensional photographing position can be photographed by a plurality of cameras by the same method.

Further, although an example in which only one cooperative camera exists is shown in the present embodiment, a plurality of cooperative cameras may exist for one cooperative camera. The greater the number of linked cameras, the more the image receiving device can simultaneously view the images captured at the shooting position or in the more shooting directions of the object.

As described above, in the present embodiment, the operation camera operated by the user remotely extracts the moving direction of the object photographed by the operation camera and transmits it to the cooperation camera, whereby the operation is performed. Once the camera captures the object, the linked camera can capture the moving object even if the user cannot operate following the movement of the object.

(Fourth Embodiment) In the first embodiment, the method of notifying another camera of the photographing position of the camera operated by the user and photographing the point from a plurality of directions has been described. In the present embodiment, a method of supplementing a blind spot of a camera operated by a user by another camera in cooperation with a camera operated by the user will be described. FIG. 12 shows a configuration diagram of this embodiment. Further, FIG. 13 shows the shooting direction of the camera and the screen of the video receiving device when the linked camera which is not operated by the user operates so as to compensate for the blind spot of the operation camera which is operated by the user.

In FIG. 12, 110 is a camera, 120 is an image receiving device, 130 is a screen for displaying images taken by a plurality of cameras such as a display, and 140 is an input device such as a joystick for operating one of the plurality of cameras.

The camera 110 shown in FIG. 12 has the same structure as that of the first embodiment except that the non-photographable area detection unit 1211 for detecting the non-photographable area by the user's camera and the non-photographable area by the user's operating camera. A control command generation unit 1212 for generating a command for controlling the shooting direction of another camera in order to shoot the image with another camera is added. Other configurations are the same as those of the first embodiment shown in FIG.

In FIG. 13, reference numerals 1311, 1312 denote cameras.
212 is a non-photographable area, 1313 is a camera, 1314 is a valuable such as a safe, 1315 is a room entrance, 1323, 1324, 1325 are images of the camera 1313 received by the image receiving device 120, respectively.
Video of the safe taken by linked camera 211, linked camera 1313
Shows the video of the door taken by.

FIG. 14 is a non-photographable area detection unit 1211 of FIG.
Is a flow diagram for explaining the flow of processing from when the control command generation unit 1212 generates a control command for controlling the cooperative camera until it detects an area in which the operation camera 212 cannot capture, and controls the cooperative cameras 211 and 1313. is there. In addition, FIG.
In the shooting area 210 is the operation camera 212 and the cooperation cameras 211 and 1313.
FIG. 15 is a diagram in which blind spots 1514 and 1515 of the operation camera 212 are photographed by using the linked cameras 211 and 1313 when there is. 14
15 and FIG. 15, a flow in which the cooperation camera 211 or 1313 shoots an area in which the operation camera 212 cannot shoot will be described.

First, the non-photographable region detection section 1211 detects the photographing direction 1516 of the operation camera 212 and the angle 1518 from the photographing direction 1516 of the operation camera 212 obtained from the zoom magnification of the operation camera 212 to the photographable region. An area of the shooting area 210 that cannot be shot by the operation camera is calculated (1401).

The shooting direction 1516 is θ, the angle 1518 from the shooting direction 1516 of the operation camera 212 to the area where shooting is possible is ω, the coordinates of the operation camera 212 are (x _cnt , 0), and the cooperative camera 1313.
Is set as (0, 0), and the boundary point 1 between the area that can be captured by the operation camera 210 and the area that cannot be captured in the capturing area 210 is 1
The coordinates of 513 can be represented as (0, x _cnt tan (π−θ−ω)).

Next, the control command generation unit 1212 determines which cooperative camera will photograph the region 1514 that cannot be photographed by the operation camera 212 (1402). It does not matter which camera is used for shooting, but a blind spot remains, so avoid shooting an area that cannot be shot by the operating camera with a camera installed in that area. In the case of FIG. 15, 1514
Even if an attempt is made to shoot an area 1514 with the cooperative camera 1313 installed therein, a blind spot remains around the cooperative camera 1313, and therefore the area 1514 is taken with the cooperative camera 211.

Next, the control command generator 1212 calculates the shooting direction and zoom magnification of the cooperative camera and generates a camera control command (1403). To capture area 1514,
1513, which is the boundary point between the areas that can and cannot be photographed
The rotation angle and zoom magnification of the cooperative camera 211 may be adjusted so as to capture images 212 and 212. Rotation angle 1519 is a linked camera
It is obtained by drawing a bisector 1522 of an angle formed by straight lines 1520 and 1521 connecting 212 and the boundary points 1513 and 212. The zoom factor is
Calculated from the angle formed by 1520 and 1522.

The installation coordinates of the cooperative camera 212 are (0,
y _cnb ), the straight lines 1520 and 1521 are respectively x = 0 (7)

[Equation 3] It can be expressed as (8).

Further, from FIG. 15, when the angle 1519 at which the linked camera 211 rotates is λ, λ is

[Equation 4] It can be expressed as (9).

The zoom magnification when the linked camera 211 shoots from the angle 1519 can also be obtained from the angle formed by the straight line 1520 and the angle bisector 1522. Here, the angle μ formed by the straight line 1520 and the angle bisector 1522 can be expressed as μ = 2π−λ (10) by using λ.

The zoom magnification of the cooperative camera 211 is obtained from this angle μ and a camera control command is generated. The control command receiving unit of the cooperative camera 211 receives the camera control command created in the above process flow (1404) and transfers it to the camera control unit 113 to control the shooting direction of the camera.

The area 1515 which is the blind spot of the operation camera 212 in FIG.
Control the camera to capture the blind spot at 13. With the above processing, it is possible to capture an area with a plurality of cameras without blind spots.

As described above, in the present embodiment, the area in which the camera operated by the user cannot photograph is calculated, and based on the result, the camera control command is issued to the camera not operated by the user. By doing so, even if the object to be photographed moves into the blind spot of one camera, the other cameras operate without user's operation, and the moving object can be caught quickly and easily. In the present embodiment, the method of calculating the two-dimensional coordinates of the shooting position from the pan angle has been described in the example in which the area where a plurality of cameras are installed is viewed perpendicular to the ground, but the tilt angle of the camera is also taken into consideration. Then, the three-dimensional coordinates of the photographing position can be calculated and notified, and the three-dimensional photographing position can be photographed by a plurality of cameras by the same method.

[0074]

As described above, according to the present invention, the following effects can be obtained.

First, when a user issues a camera control command from a terminal to operate a remote camera and shoots an object, another camera not operated by the user operates in conjunction, The camera allows the user to operate multiple cameras without issuing multiple camera control commands to capture an image of a position or object, and to avoid issuing control commands to all cameras. The operation time can be shortened, and a certain point or object can be quickly and easily photographed from multiple directions.

Secondly, the camera operated remotely by the user transmits the position taken by the camera to another camera, so that one shooting point is taken from a plurality of directions and the user operates it. The effect that the linked camera can shoot an area of the same size as the image taken by the running camera is obtained.

Thirdly, the operation camera operated remotely by the user extracts the moving direction of the object photographed by the operation camera and transmits it to the cooperative camera, so that the operation camera can photograph the object once. For example, even if the user cannot operate the object following the movement of the object, the linked camera can capture the moving object.

Fourth, even if an object to be photographed moves and enters a blind spot of one camera, a plurality of other cameras operate without user's operation, and a moving object can be quickly and easily caught. The effect that it can be obtained.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a camera control device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an example of camera arrangement and screen display according to the first embodiment of the present invention.

FIG. 3 is a flow diagram illustrating a flow of a camera photographing position notification process according to the first embodiment of the present invention.

FIG. 4 is a diagram showing an example of camera arrangement, photographing position, and camera rotation angle in the first embodiment of the present invention.

FIG. 5 is a configuration diagram of a camera control device according to a second embodiment of the present invention.

FIG. 6 is a diagram showing a camera arrangement example and a screen display example of the camera control device according to the second embodiment of the present invention.

FIG. 7 is a flowchart illustrating a flow of zoom magnification notification processing according to the second embodiment of the present invention.

FIG. 8 is a configuration diagram of a camera control device according to a third embodiment of the present invention.

FIG. 9 is a diagram showing an example of camera arrangement, object movement, and screen display according to the third embodiment of the present invention.

FIG. 10 is a flowchart illustrating the flow of a moving direction notification process according to the third embodiment of the present invention.

FIG. 11 is a diagram showing an example of camera arrangement and object movement vector according to the third embodiment of the present invention.

FIG. 12 is a configuration diagram of a camera control device according to a fourth embodiment of the present invention.

FIG. 13 is a diagram showing a camera arrangement, camera shooting directions, and a screen display example according to the fourth embodiment of the present invention.

FIG. 14 is a flowchart illustrating the flow of camera blind spot area notification processing according to the fourth embodiment of the present invention.

FIG. 15 is a diagram showing an example of shooting with another camera in a camera blind spot area according to the fourth embodiment of the present invention.

FIG. 16 is a block diagram showing a configuration of a conventional camera control device.

[Explanation of symbols]

110 cameras 111 Video transmitter 112 camera drive 113 camera control unit 114 Control command receiver 115 Shooting position recording unit 116 Control command transmitter 120 Video receiver 121 Video receiver 122 Video playback unit 123 Control command transmitter 130 screens 140 input device 210 shooting area 211 Cooperation camera 212 Operation camera 213 Shooting object 220 screen 221 Cooperation camera image 222 Operation camera image 223 Camera control button 231 Object photographed by the cooperative camera 232 Object shot by operation camera 511 Zoom magnification control unit 512 Zoom magnification recording section 811 Object moving direction detection unit 1211 non-photographable area detection unit 1212 control command generator 1311 Non-photographable area 1312 Non-photographable area 1313 Cooperation camera 1314 Valuables 1315 doorway 1323 Linked camera image 1324 Valuables taken by the cooperative camera 1325 Video of the entrance and exit of the cooperative camera 1610 camera 1611 Video transmitter 1612 camera driver 1613 camera control unit 1614 control command receiver 1615 Shooting position recording unit 1620 video receiver 1621 Video receiver 1622 Video playback unit 1623 Control command transmitter 1630 screen 1640 input device

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 7/18 H04N 7/18 EF F term (reference) 5C022 AA01 AB61 AB62 AB63 AB65 AB66 AC27 AC31 5C054 AA01 CA04 CE15 CE16 CF06 DA06 EA01 EA03 EA05 EA07 FA09 FC11 GB11 HA19 HA31 5C084 AA02 AA07 AA14 BB01 CC17 DD12 EE02 EE05 FF03 GG17 GG78 5C087 AA03 AA08 AA24 BB03 BB65 BB74 DD05 DD27 FF02 FF06 FF06 FF02

Claims (9)

[Claims] 1. A video transmission unit for transmitting a captured video to a network, a camera drive unit for changing the shooting direction of the camera, a camera control unit for instructing the camera drive unit to change the shooting of the camera, and a camera from a remote location. A control command receiving unit that receives a control instruction, a shooting position recording unit that records the current shooting location, and a control command transmitting unit that sends the shooting position or the camera control command recorded by the shooting position recording unit to the network. And a camera control device. 2. When a remote camera is operated by issuing a camera control command from the terminal, the control command transmission unit notifies another camera of the control command or the photographing position of the camera, thereby operating from the terminal. The camera control device according to claim 1, which controls a shooting direction of a camera that is not installed. 3. The control command receiving unit receives the photographing position of the camera transmitted by the control command transmitting unit,
The camera control device according to claim 1, wherein the camera control unit controls a shooting direction of the camera based on a shooting position. 4. The camera control device according to claim 1, further comprising a zoom magnification control unit that changes the zoom magnification of the camera, and a zoom magnification storage unit that stores the zoom magnification of the camera. 5. The control command receiving unit receives the zoom magnification of the camera transmitted from the control command transmitting unit, passes the zoom magnification to the zoom magnification control unit, and controls the zoom magnification. 2. The camera control device described in 2 or 4. 6. The camera control device according to claim 1, further comprising an object moving direction detection unit that cuts out an object from an image, extracts a moving direction, and calculates a position of the moved object. 7. When the object being photographed moves by operating the camera, another camera can track the object by transmitting the movement information acquired from the object movement direction detection unit to the other camera. 7. The camera control device according to claim 2 or 6, wherein: 8. A non-photographable area detection unit that detects a non-photographable area of a camera that is operated remotely, and an installation state of the camera and a non-photographable area detected by the non-photographable area detection unit, The camera control device according to claim 1, further comprising a control command generation unit that generates a camera control command that controls a shooting direction of the camera. 9. The entire control area is imaged by transmitting a camera control command to the another camera, in which the control command generation unit can image the blind spot of the camera operating the camera. Item 9. The camera control device according to item 2 or 8.