JP2012244311A - Camera remote controller and camera remote control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide technique capable of allowing one or multiple cameras to be easily directed to a desired point.SOLUTION: A camera remote controller 200 acquires first, the coordinate of a desired point which indicates a position to be imaged, and selects a camera 100 to image the desired point on the basis of a predetermined selection mode. Then, the camera remote controller 200 acquires the coordinate of the position of the selected camera 100 and its present direction, and calculates a turning angle to allow the camera 100 to be turned to the desired point. The camera remote controller 200 generates control information including the calculation result of the turning angle, transmits the control information to the camera 100, and remotely controls the direction of the camera 100.

Description

  The present invention relates to a technique for remotely controlling a camera connected to a network.

  In recent years, in order to monitor a predetermined place in a remote place, a technique has been used in which the direction of a camera connected to a network is controlled via the network to acquire an image captured by the camera.

  For example, in Patent Document 1, a panoramic image is generated in advance using captured images and displayed on a display unit, and a desired position of the displayed panoramic image is designated (clicked) using an external input device (such as a mouse). Thus, a technique for controlling the orientation of the camera is disclosed.

  Moreover, in patent document 2, the map of the designated area and the camera icon showing the installation position of a camera on the map are displayed on a display part. When a camera icon is designated (clicked) with an external input device (such as a mouse), a direction indication icon indicating a preset shooting direction is displayed around the camera icon, and when the direction indication icon is designated (clicked). A technique for controlling the direction of the camera in the shooting direction indicated by the direction instruction icon is disclosed.

JP 2000-358234 A JP 2010-206487 A

In order to photograph a desired location from various angles, there is a demand to be able to control the orientation of one to a plurality of cameras with a simple operation.
In the technique of Patent Document 1, when controlling one camera, the direction of the camera is easily controlled by instructing (clicking) a desired position of the panoramic image with an external input device (such as a mouse). Can do. However, when trying to control a plurality of cameras to be directed to the same place all at once, one panorama image is generated for one camera, so that the panoramic image is not familiar to everyday use. If the local geography is not well understood, it is difficult to grasp the space, and it is difficult to set the orientations of a plurality of cameras at the same location.

  Moreover, in the technique of Patent Document 2, since the directions indicated by the direction indication icons are set discretely, it is difficult to set the orientations of a plurality of cameras at the same location. Furthermore, since the camera control operation is performed for each camera, there is a problem in that it takes time and effort to set the orientations of a plurality of cameras at the same location.

  Accordingly, an object of the present invention is to provide a technique for easily pointing one or a plurality of cameras to a desired point.

  In order to solve the above-described problem, the camera remote control device according to the present invention first acquires the coordinates of a desired point indicating the position to be photographed, and sets the camera that photographs the desired point based on a predetermined rule (selection mode). To select. Next, the camera remote control device acquires the coordinates of the position of the selected camera and the current orientation, and calculates a turning angle for directing the camera to a desired point. The camera remote control device generates control information including a calculation result of the turning angle, transmits the control information to the camera, and remotely controls the direction of the camera.

  According to the present invention, one or a plurality of cameras can be easily directed to a desired point.

It is a figure which shows the structural example of the camera control system in this embodiment. It is a figure which shows the example of a display of a display part. It is a figure which shows the example of a display of a video display area. It is a figure which shows the example of a display of a layout map display area. It is a figure which shows an example of the control which matches the direction of a camera with the height position of a desired point. It is a figure which shows an example of the information memorize | stored in camera position DB. It is a figure which shows an example of the information memorize | stored in camera posture information DB. It is a figure which shows an example of the processing flow of a camera remote control apparatus.

  Next, a mode for carrying out the present invention (hereinafter referred to as “the present embodiment”) will be described in detail with reference to the drawings as appropriate.

(Overview of camera control system)
FIG. 1 shows a configuration example of a camera control system 1 in the present embodiment. In the camera control system 1, a camera 100 (100 </ b> A, 100 </ b> B, 100 </ b> C) and a camera remote control device 200 are connected via a network 300 so as to communicate with each other.

  When the camera 100 receives the control information for controlling the direction of the camera 100 from the camera remote control device 200 while shooting the video image that is arranged in advance in the shooting area, the camera 100 controls the direction of the camera 100 based on the control information. To do. In FIG. 1, only three cameras 100 are illustrated, but it is assumed that one to a plurality of cameras 100 are arranged for one photographing area. However, in the present embodiment, description will be made assuming that three cameras 100 are arranged in the shooting area.

  The camera remote control device 200 is, for example, a device configured with dedicated hardware or a personal computer installed with camera control software, and generates control information for determining the orientation of the camera 100 on a target to be photographed. The control information is transmitted to the camera 100.

The network 300 is configured by a wired network, a wireless network, or a combination of a wired network and a wireless network.
Hereinafter, details of the functions of the camera 100 and the camera remote control device 200 will be described with reference to FIG.

(Camera function)
The camera 100 includes a processing unit 110 that executes various processes using a CPU (Central Processing Unit) and a main memory (not shown), an imaging unit 120, a communication unit 130, and a storage unit (not shown) that stores application programs and the like.

The processing unit 110 implements the attitude control unit 111 by developing an application program stored in the storage unit in the main memory. The processing unit 110 controls transmission / reception of information between the imaging unit 120 and the communication unit 130. Further, the processing unit 110 encodes the digital signal of the video received from the imaging unit 120 to generate video information, and transmits the video information to the camera remote control device 200 via the communication unit 130. Further, the processing unit 110 may transmit posture information related to the current orientation of the camera 100 to the camera remote control device 200 via the communication unit 130.
The attitude control unit 111 controls the orientation of the camera 100 based on the control information received via the communication unit 130.

The imaging unit 120 is configured with a lens, a light receiving element, and the like, converts a captured image into a digital signal, and outputs the digital signal to the processing unit 110.
The communication unit 130 is a communication interface and sends, for example, video information and posture information to the network 300 and receives control information from the network 300.

(Function of camera remote control device)
The camera remote control device 200 includes a processing unit 210 that executes various processes by a CPU and a main memory (not shown), a storage unit 220 that stores application programs, an input unit 230, a display unit 240, and a communication unit 250. .

The input unit 230 is an interface that receives input of various operations from an external input device (such as a mouse or a keyboard) (not shown).
The display unit 240 is a display device such as a display, and displays messages generated by the processing unit 210, processing results, and the like.
The communication unit 250 is a communication interface, and sends control information to the network 300 and receives various types of information from the network 300.

  The processing unit 210 expands the application program stored in the storage unit 220 in the main memory, and performs a desired point coordinate acquisition unit 211, a camera selection mode acquisition unit 212, a target camera selection unit 213, a turning angle calculation unit 214, and The control information generation unit 215 has a function to embody. The processing unit 210 controls transmission / reception of information among the storage unit 220, the input unit 230, the display unit 240, and the communication unit 250.

  As shown in FIG. 2, the processing unit 210 sets a video display area 241 and a layout drawing display area 242 as displays on the display unit 240. Note that the display position and size of the video display area 241 and the layout drawing display area 242 can be arbitrarily changed by an external input device (not shown).

The video display area 241 shown in FIG. 2 further includes a video area 243 and a camera operation function area 244 as shown in FIG.
The video area 243 is an area for displaying video shot by the camera 100.
The camera operation function area 244 is an area for displaying a function for operating the video displayed in the video area 243. For example, playback, stop, fast forward, pan / tilt, zoom for changing the orientation of the camera 100 Etc. Function buttons are displayed.

Further, the layout map display area 242 shown in FIG. 2 further includes a layout map area 245 and a selection function area 246, as shown in FIG.
The layout map area 245 is an area for displaying map data stored in the map information DB 221. The scale of the map displayed in the layout map area 245 can be changed by a scale scale (not shown) displayed in the layout map area 245. On the map, camera icons 101 (101A, 101B, 101C) indicating the installation positions of the cameras 100 (100A, 100B, 100C) are displayed. In other words, the layout map area 245 displays a layout map 248 that displays the map and the camera icon 101.
The selection function area 246 is an area for displaying an operation function necessary for setting a selection mode when selecting the camera 100 that captures the desired point 400 or selecting a specific camera 100.

  Returning to FIG. 1, the desired point coordinate acquisition unit 211 is configured such that a desired point 400 indicating a desired shooting position on the layout drawing 248 is displayed on an external input device (not shown) in the layout map area 245 displayed on the display unit 240. ) From the input unit 230, first, the coordinates of the desired point 400 on the display unit 240 are obtained. In addition, the desired point coordinate acquisition unit 211 represents a display for accepting an input of height in the selection function area 246 for the height, and acquires the height of the desired point 400 based on an input from an external input device (not shown). To do.

  The camera selection mode acquisition unit 212 has a function of receiving a selection mode when selecting the camera 100 that captures the desired point 400 from an external input device (not shown) via the input unit 230. The selection mode includes, for example, a mode in which (a) a distance from the desired point 400 is received via an external input device (not shown) and a camera 100 existing within the distance is selected, and (b) a camera closest to the desired point 400 100 is selected, (c) a camera icon 101 designated by an external input device (not shown) is acquired, and the camera 100 corresponding to the position of the camera icon 101 is selected. . In the case of the selection mode (a), the camera selection mode acquisition unit 212 receives an input of a distance and displays a circle whose center is the desired point 400 and whose radius is the radius (a broken line circle 247 in FIG. 4). To do. In the selection mode (c), the camera selection mode acquisition unit 212 receives an input for selecting the specific camera 100. The selection mode is not limited to the above (a) to (c) and may include other modes.

  The target camera selection unit 213 has a function of acquiring coordinates on the display unit 240 of the camera icon 101 displayed in the layout diagram 248 (see FIG. 4) of the display unit 240. Specifically, the target camera selection unit 213 stores map information stored in the map information DB 221 of the storage unit 220 corresponding to the area of the layout map 248 displayed in the layout map area 245 based on the scale of the map. The upper coordinate value is acquired, and the coordinates of the camera 100 existing in the area are acquired from the camera position DB 222. Then, the target camera selection unit 213 acquires the coordinates on the display unit 240 of the camera 100 based on the scale of the map.

  Next, in the selection mode (a), when the distance input is L1, the target camera selection unit 213 sets the circle 247 having the radius L1 as the control target camera 100 as illustrated in FIG. The cameras 100A and 100B corresponding to the camera icons 101A and 101B that enter inside are selected. In the selection mode (b), the target camera selection unit 213 selects the camera 100A corresponding to the camera icon 101A as the camera 100 closest to the desired point 400. In the selection mode (c), the target camera selection unit 213 selects the camera 100 corresponding to the camera icon 101 designated by the external input device (not shown) as the camera 100 to be controlled.

  The target camera selection unit 213 may display the camera icon 101 selected based on the selection mode so as to be conspicuous, and may display the camera icon 101 not corresponding to be conspicuous.

  The turning angle calculation unit 214 has a function of acquiring information about the current camera orientation (current posture information) from the camera posture information DB 223. Then, the turning angle calculation unit 214 uses the current posture information of the camera 100, the coordinates of the desired point 400, and the coordinates of the installation position of the camera 100 to turn necessary to turn the camera 100 toward the desired point 400. Calculate the angle. Further, the turning angle calculation unit 214 stores the calculation result in the camera posture information DB 223 so that the current direction of the camera 100 can always be acquired.

  The control information generation unit 215 has a function of generating control information including the turning angle calculated by the turning angle calculation unit 214 and transmitting the control information to the corresponding camera 100 via the communication unit 250.

Here, as a specific example, calculation of the turning angle in the selection mode (a), that is, when the camera 100 within a predetermined distance from the desired point 400 is selected will be described with reference to FIGS. (See FIG. 1).
In the layout diagram 248 displayed in the layout map area 245 of FIG. 4, the map, the camera icon 101 (101A, 101B, 101C), and the desired point 400 are displayed. The camera selection mode acquisition unit 212 accepts “L1” as an input of the predetermined distance.

In FIG. 4, the cameras 100A and 100B corresponding to the camera icons 101A and 101B are selected by the target camera selection unit 213, and rotated by Δθa counterclockwise and Δθb clockwise by the turning angle calculation unit 214, respectively. Is calculated as follows. As for the height direction of the desired point 400, as shown in FIG. 5, the turning angle calculation unit 214 uses the map information stored in the map information DB 221 of the storage unit 220 to set the camera 100 n and the desired point 400. The horizontal distance L2 is obtained, and by using the horizontal distance L2, the height position Hn of the camera 100n, and the height position h of the desired point 400, Δθn is rotated upward from the current direction of the camera 100n. Calculate as follows.
In this way, the camera remote control device 200 can execute horizontal and vertical control of the camera 100.

The storage unit 220 stores a map information DB 221, a camera position DB 222, and a camera posture information DB 223.
The map information DB 221 stores map information.
The camera position DB 222 stores the horizontal coordinate and height coordinate of the installation position of the camera 100 on the map information stored in the map information DB 221. That is, as shown in FIG. 6, the camera position DB 222 includes a camera ID for identifying a camera, a coordinate position (X, Y) (for example, latitude and longitude), and a height coordinate (for example, altitude) on map information. It is associated and remembered.
The camera posture information DB 223 stores posture information indicating the current orientation of the camera 100. For example, as shown in FIG. 7, the camera posture information DB 223 stores a camera ID and a coordinate position (horizontal angle, vertical angle) in association with each other.

Next, an example of the processing flow of the camera remote control device 200 will be described with reference to FIG. 8 (see FIGS. 1 and 4 as appropriate).
In step S <b> 801, the desired point coordinate acquisition unit 211 acquires the coordinates of the desired point 400 set in the layout diagram 248 displayed on the display unit 240.
In step S802, the camera selection mode acquisition unit 212 acquires the selection mode and also acquires a value related to the selection mode.

In step S803, the target camera selection unit 213 selects the selected camera for the camera 100 corresponding to the position of the camera icon 101 displayed in the layout drawing 248 based on the selection mode acquired by the camera selection mode acquisition unit 212. It is determined whether or not.
If the selected camera is selected (Yes in step S803), the process proceeds to step S804. If the selected camera is not selected (No in step S803), the process proceeds to step S809.

  In step S804, the target camera selection unit 213 uses the position and scale of the area of the layout drawing 248 displayed on the display unit 240, and the area on the map information stored in the map information DB 221 of the storage unit 220. And the coordinates (for example, X, Y, height) of the position of the camera 100 existing in the area are acquired from the camera position DB 222. Then, the target camera selection unit 213 acquires the coordinates of the position of the camera 100 on the layout drawing 248 displayed on the display unit 240 using the scale.

In step S <b> 805, the turning angle calculation unit 214 acquires information (current posture information) regarding the current orientation of the camera 100 from the camera posture information DB 223.
In step S806, the turning angle calculation unit 214 is necessary to turn the camera 100 toward the desired point 400 using the current posture information of the camera 100, the coordinates of the desired point 400, and the coordinates of the position of the camera 100. Calculate the turning angle.

In step S807, the control information generation unit 215 generates control information including the turning angle calculated by the turning angle calculation unit 214.
In step S808, the control information generation unit 215 transmits the generated control information to the corresponding camera 100 via the communication unit 250.

  In step S809, the target camera selection unit 213 determines whether there is an unprocessed camera. If there is an unprocessed camera (Yes in step S809), the process returns to step S803. If there is no unprocessed camera (No in step S809), the process ends.

  As described above, the camera remote control device 200 according to the present embodiment first acquires the coordinates of the desired point 400 indicating the position to be photographed, and selects the camera 100 that photographs the desired point 400 based on the predetermined selection mode. Next, the camera remote control device 200 acquires the coordinates of the position of the selected camera 100 and the current orientation, and calculates a turning angle for making the camera 100 point to the desired point 400. Then, the camera remote control device 200 generates control information including a calculation result of the turning angle, transmits the control information to the camera 100, and remotely controls the direction of the camera 100. Therefore, the camera remote control device 200 can easily point one or a plurality of cameras 100 to a desired point.

  In the present embodiment, the coordinates of the position of the desired point 400 and the coordinates of the position of the camera 100 are acquired using the coordinate axes of the layout diagram 248 displayed on the display unit 240, but the map information in the storage unit 220 is used. You may acquire the coordinate of those positions with the coordinate axis on the map information memorize | stored in DB221.

  In the present embodiment, the current orientation of the camera 100 has been described as being stored in the camera posture information DB 223. However, the turning angle calculation unit 214 inquires of the camera 100 about the current orientation, and the camera 100 determines the current orientation. You may make it acquire a response as attitude information. Moreover, although it demonstrated as using the difference of the current direction of the camera 100, and the direction of the desired point 400 as control information which controls the turning angle of the camera 100, the direction of the camera 100 itself respond | corresponds to an absolute direction. An angle may be used.

DESCRIPTION OF SYMBOLS 1 Camera control system 100 (100A, 100B, 100C) Camera 200 Camera remote control apparatus 210 Processing part 211 Desired point coordinate acquisition part 212 Camera selection mode acquisition part 213 Target camera selection part 214 Turning angle calculation part 215 Control information generation part 220 Storage Department 221 Map information DB
222 Camera position DB
223 Camera posture information DB
230 Input unit 240 Display unit 250 Communication unit

Claims (6)

A camera remote control device that remotely controls the orientation of a camera via a network,
A storage unit storing posture information indicating the orientation of the camera;
A display unit for displaying a map of an area including a desired point indicating a shooting point, and a camera icon indicating the installation position of the camera;
On the map displayed on the display unit, a desired point coordinate acquisition unit that acquires the coordinates of the desired point instructed via an external input device;
A camera selection mode acquisition unit for acquiring a selection mode for selecting the camera used for photographing the desired point;
A target camera selection unit that selects the camera to be used for photographing the desired point based on the selection mode;
A turning angle calculation unit for obtaining the coordinates of the selected camera and the posture information of the camera, and calculating a turning angle for directing the camera to the desired point;
A camera remote control device comprising: a control information generating unit that generates control information including a calculation result of the turning angle and transmits the control information to the camera via a network. The camera remote control device according to claim 1, wherein a plurality of the cameras are remotely controlled. The selection mode includes: (a) a mode in which a distance from the desired point is received via the external input device and the camera existing within the distance is selected; and (b) the camera closest to the desired point is selected. And (c) a mode in which the camera icon designated by the external input device is acquired and the camera corresponding to the position of the camera icon is selected. The camera remote control device according to claim 1 or 2. A camera remote control method of a camera remote control device for remotely controlling a camera direction via a network,
The camera remote control device is:
A storage unit storing posture information indicating the orientation of the camera;
A display unit for displaying a map of an area including a desired point indicating a shooting point, and a camera icon indicating the installation position of the camera;
With
On the map displayed on the display unit, a desired point coordinate acquisition step of acquiring coordinates of the desired point instructed via an external input device;
A camera selection mode obtaining step for obtaining a selection mode for selecting the camera used for photographing the desired point;
A target camera selection step of selecting the camera used for photographing the desired point based on the selection mode;
A turning angle calculating step of obtaining coordinates of the selected camera and the posture information of the camera, and calculating a turning angle for directing the camera to the desired point;
A control information generation step of generating control information including a calculation result of the turning angle and transmitting the control information to the camera via the network. 5. The camera remote control method according to claim 4, wherein remote control is performed for a plurality of the cameras. The selection mode includes: (a) a mode in which a distance from the desired point is received via the external input device and the camera existing within the distance is selected; and (b) the camera closest to the desired point is selected. And (c) a mode in which the camera icon designated by the external input device is acquired and the camera corresponding to the position of the camera icon is selected. The camera remote control method according to claim 4 or claim 5.

Images