JP3604766B2 - Camera control device and camera control method - Google Patents

Description

[0001]
[Industrial applications]
The present invention relates to a control method for a camera control apparatus and a camera control apparatus for remotely controlling one or more optional camera the camera.
[0002]
[Prior art]
A conventional camera in which a plurality of cameras having a pan / tilt function and / or a zoom function are arranged in various places, and these cameras are connected to an operation device at a center or an arbitrary place by a communication line so that an arbitrary camera can be remotely controlled. In the camera control system, a control signal line for transmitting a camera control / status signal is required in addition to a cable for transmitting a video / audio signal.
[0003]
A method of modulating a camera control / status signal and superimposing it on a video / audio signal is also known, but it is logically the same as providing a separate communication channel.
[0004]
Further, a camera control system for remotely controlling an arbitrary camera by establishing a communication path for video / audio and a control signal when necessary is implemented on a computer network such as a LAN (local area network). Used in video conferencing systems. In a video conference system, video / audio input from each terminal and various control information can be mutually transmitted via the same network, and a camera of an arbitrary partner can be remotely controlled.
[0005]
[Problems to be solved by the invention]
A camera control system in which a dedicated cable for video / audio is provided has a case where the number of cameras to be remotely controlled is small, an installation location is rarely changed, and a remote control is performed from a fixed location. In this case, it is effective, but when any of these conditions is not satisfied, the usability becomes very poor. This is because arranging the video / audio cable is very costly, and changing the installation location is very troublesome.
[0006]
For example, it is very troublesome and sometimes impossible to reroute a video / audio cable in accordance with a change in the installation location of a camera. If there are N cameras and M operation devices for remotely controlling these cameras, N × M video / audio cables must be installed.
[0007]
Further, in the video conference system, the cameras that can be remotely controlled are a small number of cameras connected to the terminals of the conference participants, and do not satisfy the desire to freely view the video (and audio) of the camera at an arbitrary location. .
[0008]
An object of the present invention is to provide a camera control device and a control method of the camera control device that can easily remotely control any one or more cameras .
[0010]
[Means for Solving the Problems]
A camera control device according to the present invention is a camera control device connected via a communication medium to one or more cameras capable of externally controlling any one of a shooting direction and a magnification, and for issuing a camera control command. In response to the disconnection, the storage means for storing any camera state of the shooting orientation and magnification of the camera at the time of the disconnection, and, when the connection to the camera is made again, the storage means Issuing means for issuing a camera control command so as to enter the stored camera state.
A control method of a camera control device according to the present invention is a control method of a camera control device connected via a communication medium to one or more cameras capable of externally controlling any one of a shooting direction and a magnification, and includes a camera control method. In response to disconnection of the connection for issuing the command, a storage step of storing in the storage means any one of the camera states of the shooting direction and magnification of the camera at the time of the disconnection, and the connection to the camera is re-established. Issuing a camera control command so that the camera state stored in the storage means is set when the operation is performed.
[0012]
【Example】
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0013]
FIG. 1 shows a schematic block diagram of an embodiment of the present invention.
[0014]
It is. Reference numeral 10 denotes a LAN composed of Ethernet (trademark), to which a plurality of camera management devices 12 and 14 are connected. Video cameras 16 and 18 are connected to the camera management devices 12 and 14, respectively. The video cameras 16 and 18 may be equipped with a microphone for audio input. The LAN 10 is also connected with a plurality of camera operation devices 20 and 22 for remotely controlling the cameras 16 and 18.
[0015]
Although details will be described later, the camera management devices 12 and 14 control the azimuth (pan / tilt) and zoom of the video cameras 16 and 18 under their control according to the camera control signals from the camera operation devices 20 and 22. Then, the video (and audio) is transferred to the control signal supply source.
[0016]
The camera management device 12 includes a communication control device 30 that controls connection and data communication with arbitrary camera operation devices 20 and 22 via the LAN 10, and a storage device 32 that stores various data including video / audio data to be transferred. A camera controller 34 for controlling the shooting direction and magnification of the video camera 16 and supplying the video / audio data from the camera 16 to the communication controller 30 via the storage device 32; It comprises an interface 36 connected to the device 34. The camera management device 14 also has the same configuration as the camera management device 12.
[0017]
The camera operation device 20 includes a communication control device 40 that controls connection with any camera management devices 12 and 14 via the LAN 10 and data communication, and a storage device that stores various data including transferred video / audio data. 42, a camera selection unit 44 for selecting a camera to be operated, an operation unit 46 for operating pan, tilt, and zoom of one camera selected by the camera selection unit 44, and a selection and operation unit 46 for the camera selection unit 44 , An operation management means 48 for exchanging information for control with a camera management device for managing a camera to be controlled, a display monitor 50 for displaying a received video, and A speaker 52 for outputting sound is provided. The camera operation device 22 also has the same configuration as the camera operation device 20.
[0018]
Note that the camera operation devices 20 and 22 are substantially composed of a personal computer or a workstation, and the part composed of the camera selection means 44, the operation means 46 and the operation management means 48 is a computer or the like which is a graphical user. Displaying image elements or selection menus set on the interface, a pointing device such as a mouse for operating or selecting them, and a graphical user interface, and processing operation or selection of the pointing device Implemented by program software.
[0019]
FIG. 1 illustrates two camera management devices 12 and 14 and two camera operation devices 20 and 22. However, three or more camera management devices can be connected to the LAN 10, and similarly, three or more camera management devices can be connected to the LAN 10. Obviously, the camera operating device can be connected to the LAN 10.
[0020]
FIG. 2 is a camera operation screen indicated as operation means 46 in FIG. On the camera operation screen 60, pan buttons 62 and 64 for instructing horizontal rotation, tilt buttons 66 and 68 for instructing vertical rotation, a home button 70 for returning to the front position, and zooming in the telephoto direction are displayed. And a wide-angle button 74 for instructing zooming in a wide-angle direction. A rectangular frame 76 indicates a photographable range that can be photographed by maximizing the angle of view of the operation target camera and panning and tilting, and a rectangular frame 78 indicates the current pan angle, tilt angle, and zoom value. Is indicated by a relative position within the photographable range 76.
[0021]
FIG. 3 is a camera selection screen for selecting a camera to be operated, which is described as a camera selection unit 44 in FIG. 1, and is also displayed on the monitor 50. The “connection” pull-down menu 80 includes connection and disconnection items. A camera table 82 showing a list of all selectable cameras is displayed together with the display of the pull-down menu 80 by the selection of the “connection” menu or in response to the selection of the display menu (not shown) of the camera list. You.
[0022]
The camera table 82 holds a set of names for easily displaying individual cameras and identification information for uniquely identifying the camera management devices 12 and 14 to be connected. In this embodiment, since the camera management devices 12 and 14 and the camera operation devices 20 and 22 are connected via the LAN 10, the IP address is used as the identification information. The camera name and the IP address of the camera management device are stored in the storage device 42 in advance.
[0023]
When any one of the cameras displayed in the camera table 82 is selected and “Connect” is selected from the “Connect” pull-down menu 80, the camera becomes operable via the LAN 10 and the The video is displayed on a video window (not shown) of the monitor 50.
[0024]
When one of the cameras already connected is selected from the cameras displayed in the camera table 82 and "Disconnect" is selected in the "Connect" pull-down menu 80, the operation right of that camera is changed to another camera. The camera is released to the operation device, and the image of the camera is not displayed on the monitor 50.
[0025]
The operation of this embodiment will be described with reference to the flowcharts shown in FIGS. 4 to 6 show operation flowcharts of the camera operation devices 20 and 22, and FIGS. 7 to 10 show operation flowcharts of the camera management devices 12 and 14.
[0026]
FIG. 4 is an operation flowchart when a camera is selected. Here, it is assumed that the operator uses the camera operation device 20. When the operator selects a connectable camera using the camera selection unit 44, the operation management unit 48 checks whether the camera operation device 20 is currently connected to another camera (S1). Then, the operator confirms whether the connection can be cut off (S2). When the operator inputs an instruction not to disconnect (S3), the process is terminated, and when the disconnection instruction is input, the operation management unit 48 instructs the communication control device 40 to disconnect the communication path with the connected camera (step S3). S4). Specifically, the communication control device 40 releases or closes the logical communication channel after notifying the communication control device of the communication partner of the disconnection as the disconnection process.
[0027]
If the camera is not connected to any other camera (S1), or if it is connected to another camera but is disconnected (S4), the connection request to the selected camera is managed by the selected camera. And waits for a response (S5). Here, it is assumed that a connection request is made to the camera 16 managed by the camera management device 12. Upon receiving the connection request, the communication control device 30 of the camera management device 12 determines whether the designated camera has already been operated by another camera operation device, and when the camera has been operated by another camera operation device, It returns a busy signal, and if not operated, returns a connection permission signal.
[0028]
If the response from the camera management device 12 that sent the connection request is a busy signal, or if there is no response within a predetermined period, the camera operation device 20 displays that the connection has failed (S7). ,finish. On the other hand, when there is a connection permission response (S6), the communication control device 40 sets a logical communication channel (S8), requests the camera management device 12 for the status parameter of the camera to be operated, and acquires it. (S9). Using the acquired state parameters, the operation management unit 48 displays the camera operation screen 60 (S10). This is to correctly position the shooting range frame 78 indicating the direction (pan / tilt) of the camera to be operated and the current state of zooming within the shooting range frame 76. It is assumed that information indicating the photographable range of the camera to be operated has been collected from each camera in advance.
[0029]
FIG. 5 is an operation flowchart of the camera operation. When the operator presses any one of the operation buttons 62 to 74 on the camera operation screen 60, the operation management unit 48 in FIG. 1 first determines whether or not the camera is already connected to any of the cameras (S11). If the connection is not established, a message to that effect is displayed and the process ends (S12). If connected, the camera control command corresponding to the operated button is transmitted to the connected camera management device via the set communication channel (S13). The state parameter after the operation of the operation target camera is acquired (S14), and the shooting range frame 78 of the camera operation screen 60 is updated (S15).
[0030]
FIG. 6 is an operation flowchart at the time of disconnection. When the operator selects disconnection on the camera selection / disconnection screen shown in FIG. 3, the camera operation management unit 48 determines whether or not the camera is connected to any camera or camera management device (S21). If the connection is being established, a disconnection request is issued to the communication control device of the other camera management device (S22), and the set logical communication channel is released or closed (S23). If the connection is not established (S21), a message to that effect is displayed and the processing is terminated.
[0031]
FIG. 7 is an operation flowchart of the camera management device (for example, the device 12) when there is a connection request from the camera operation device (for example, the device 20). When there is a connection request from the camera operation device on the LAN 10, the camera management device 20 determines whether the connection is already established (S31). If the connection is in progress (S31), a busy signal is returned and the process is terminated (S32). If the connection is possible (S31), a connection permission is returned (S33), and a logical communication channel is sent to the communication control device 30. It is set (S34).
[0032]
FIG. 8 is an operation flowchart of the camera management apparatus in response to a camera state parameter request. When a camera status parameter is requested from the camera operation device, the camera control device 34 sends a status parameter request command to the camera 16 via the camera interface 36 to acquire a current value (S41). The value is returned to the camera operation device that has requested the state parameter (S42).
[0033]
When connecting for the first time, it is necessary to acquire and transmit all parameters, but after performing a pan / tilt or zoom operation, it is effective to acquire and transmit only changed parameters. Further, if the camera operation device of the connection partner is replaced after the camera status is acquired, the previously acquired parameters are valid, and are stored in the storage device 32, Instead of obtaining the parameters, the values stored in the storage device 32 may be substituted.
[0034]
FIG. 9 is an operation flowchart of the camera management device in response to a camera control command. When a camera control command is sent from the camera operation device, the camera control device 34 transfers the command to the camera 16 via the camera interface 36 (S51). Thereby, the camera 16 is driven to the designated state. If the response from the camera 16 includes the status parameter after the operation, the status parameter is stored in the storage device 32. If not, the status parameter request command is sent to the camera 16 to be acquired and stored in the storage device 32. (S52). After the execution of the camera control command, the end of the command is returned to the camera operation device together with the status parameter stored in the storage device 32 (S53).
[0035]
Here, the camera operation device transmits a camera control command suitable for the control command system of the camera to be operated to the camera management device.However, the control command system is usually different depending on the camera product. It is common for different camera products to be connected. In such a case, an abstracted or normalized control command is transmitted from the camera operation device to the camera management device, and the camera control device of each camera management device translates the control command into a control command suitable for the camera connected to the camera management device. Or it may be converted.
[0036]
FIG. 10 is an operation flowchart of the camera management apparatus in response to a disconnection request. When there is a disconnection request, the communication control device 30 of the camera management device executes disconnection processing such as closing a communication channel (S61).
[0037]
Although the description is omitted, the video / audio signal is compressed and encoded on the LAN 10 and transmitted. That is, the camera management devices 12 and 14 compress and encode the video / audio signal to be transmitted and output the encoded video / audio signal to the LAN 10, and the camera operation devices 20 and 22 decompress the compressed video / audio signal from the LAN 10, It is applied to the monitor 50 and the speaker 52.
[0038]
In the present embodiment, the camera management devices 12 and 14 and the camera operation devices 20 and 22 are connected by an Ethernet (trademark) LAN, but may be connected by an ISDN or a public telephone line instead. Is clear. In this case, a telephone number can be used as information for uniquely identifying the camera management devices 12 and 14.
[0039]
In this embodiment, the camera management device and the camera operation device are described as separate devices. However, it is apparent that the camera management device and the camera operation device can be incorporated in one personal computer or workstation, for example. In this case, if a video camera is connected to an input / output interface of a personal computer or a workstation, for example, a serial port without going through a LAN, the input / output interface is opened and assigned as a logical communication channel. Thereby, the operation can be performed in the same manner as in the case where the communication is performed via the LAN.
[0040]
In recent years, many personal computers have a video camera (and a microphone) in preparation for a video conference. When such a computer is connected to a LAN, it is apparent that the own computer can be used as a camera operation device and another computer can be used as a camera management device.
[0041]
In the present embodiment, when the camera management device and the camera operation device are logically connected, the display of the shooting range frame 78 on the camera operation screen is adjusted to the current state of the camera (pan, tilt, and zoom). May be matched by a specific initialization process.
[0042]
When the camera management device and the camera operation device are once connected and then disconnected, the camera state (pan, tilt, and zoom) at the time of disconnection is stored in the storage device 32 and / or the storage device 42, and the next connection is performed. Sometimes, the camera may be controlled so as to be in the camera state at the time of the previous disconnection, and the shooting range frame 78 of the camera operation screen 60 may be displayed. When there are a plurality of camera operating devices, another camera operating device may be connected and operating the camera while reconnecting to the same camera. In this way, by storing the camera state at the time of the previous disconnection and controlling the same camera state when reconnecting, the camera operation can be continued without a sense of discomfort.
[0043]
In the above embodiment, only one camera is connected to one camera management device, but it is apparent that a plurality of cameras may be connected. It is simply a matter of the processing capability of the video signal having the heaviest processing load.
[0044]
FIG. 11 shows a schematic block diagram of a modified example thereof. A camera management device 112 is connected to the LAN 10 and manages two video cameras 114 and 116. The camera management device 112 includes a communication control device 120 and a storage device 122 similar to the communication control device 30 and the storage device 32, respectively, and further includes a camera control device 124 capable of controlling two or more cameras, Camera interfaces 126 and 128 are provided for connecting the cameras 114 and 116 to the camera controller 124, respectively. In other components, the same components as those in FIG. 1 are denoted by the same reference numerals.
[0045]
When one camera management device 112 manages a plurality of cameras 114 and 116 in this way, in order to specify a camera to be operated, in addition to the camera management device, a plurality of cameras managed by the camera management device are used. What is necessary is just to add the information which specifies which of the cameras.
[0046]
Of course, when the communication control device 120 of the camera management device 112 can set logical communication channels for the number of cameras 114 and 116 to be managed, it is possible to simultaneously respond to connection requests from a plurality of camera operation devices to different cameras. become.
[0047]
Similarly, it is apparent that it is easy to extend the functions of the camera operation devices 20 and 22 so that a plurality of cameras can be operated simultaneously.
[0048]
In each of the above embodiments, other camera operating devices cannot remotely control the camera unless the camera operating device that can operate the camera once explicitly releases the camera. As shown in FIG. 12, such an adverse effect may be caused by providing the camera management device and / or the camera operation device with the timeout monitoring devices 130 and 132 to limit the monopoly of the operation by any one of the camera operation devices to a certain period. Just fine. The time-out monitoring devices 130 and 132 measure the elapsed time since the setting change and the new operation such as rotation and zoom are performed for the connected camera, and when the time exceeds a predetermined time, Then, the camera control device of the camera management device or the operation management unit of the camera operation device is forcibly disconnected from the camera.
[0049]
If the time-out period is set relatively short, automatic disconnection frequently occurs, and it is troublesome to perform the connection operation again each time. In order to avoid this, the information for identifying the previously connected camera is recorded in the storage device 42 of the camera operation device, and the camera to be reconnected is displayed on the camera operation screen as shown in FIG. And a button 142 for instructing reconnection. Thus, a camera that has been automatically disconnected due to a timeout can be reconnected with a single touch if the camera is not currently occupied by another camera operation device.
[0050]
【The invention's effect】
As can be easily understood from the above description, according to the present invention, a system in which a plurality of remotely controllable video cameras and at least one camera operation device are connected via a communication line, and which can be easily operated. You can select any camera and operate the camera.
[Brief description of the drawings]
FIG. 1 is a schematic block diagram of an embodiment of the present invention.
FIG. 2 is an example of a camera operation screen.
FIG. 3 is an example of a camera table and a connection / disconnection menu.
FIG. 4 is an operation flowchart of the camera operation device when a camera is selected.
FIG. 5 is an operation flowchart of a camera operation of the camera operation device.
FIG. 6 is an operation flowchart when the camera operation device is disconnected.
FIG. 7 is an operation flowchart of the camera management device in response to a connection request from the camera operation device.
FIG. 8 is an operation flowchart of the camera management apparatus in response to a camera state parameter request.
FIG. 9 is an operation flowchart of the camera management apparatus in response to a camera control command.
FIG. 10 is an operation flowchart of the camera management apparatus in response to a disconnection request.
FIG. 11 is a schematic block diagram of a modified embodiment of the present invention.
FIG. 12 is a schematic block diagram of another modified embodiment of the present invention.
FIG. 13 is an example of a camera operation screen of the embodiment shown in FIG.
[Explanation of symbols]
10: LAN
12, 14: Camera management devices 16, 18: Video cameras 20, 22: Camera operation device 30: Communication control device 32: Storage device 34: Camera control device 36: Camera interface 40: Communication control device 42: Storage device 44 : Camera selection means 46: Operation means 48: Operation management means 50: Monitor 52: Speaker 60: Camera operation screens 62, 64: Pan buttons 66, 68: Tilt button 70: Home button 72: Tele button 74: Wide angle Button 76: Shootable frame 78: Shooting range frame 80: "Connect" pull-down menu 82: Camera table 112: Camera management device 114, 116: Video camera 120: Communication control device 122: Storage device 124: Camera control device 126, 128: camera interface 130, 132: timeout monitoring device 40: Reconnect the camera display field 142: re-connect button

Claims (6)

A camera control device connected via a communication medium to one or more cameras capable of externally controlling one of a shooting direction and a magnification ,
Storage means for storing any camera state of the shooting orientation and magnification of the camera at the time of the disconnection, in response to disconnection of the connection for issuing the camera control command,
Issuing means for issuing a camera control command so as to be in the camera state stored in the storage means when the connection to the camera is made again,
A camera control device comprising: Further comprising operating means for generating the camera control command,
2. The camera control device according to claim 1, wherein the storage unit stores a camera state as a result of execution of a camera control command by the operation unit. The camera control device according to claim 1, further comprising a display unit configured to display the camera status when the connection to the camera is made again. The camera is connected to a plurality of camera controllers,
The issuance unit issues a camera control command such that the camera state is stored in the storage unit even when another camera control device is operating the camera before the connection is made again. The camera control device according to claim 2. The camera control device according to claim 1, wherein the camera control device is connected to the camera via a camera management device that manages connection and disconnection between the camera control device and the camera. A control method of a camera control device connected via a communication medium to one or more cameras capable of externally controlling one of a shooting direction and a magnification,
A storage step of storing, in a storage unit, any one of a camera state of an imaging azimuth and a magnification of the camera at the time of the disconnection in response to disconnection of a connection for issuing a camera control command;
When the connection to the camera is made again, an issuing step of issuing a camera control command so as to be in the camera state stored in the storage means,
A method for controlling a camera control device, comprising:

Images