JP2011040984A5 - - Google Patents

Description

Shooting system

  The present invention relates to an imaging system that transmits an image captured by a camera by wireless communication or the like, and more particularly to an imaging system in which an operator operates a camera head in a remote place while viewing the transmitted image.

  When transmitting captured video data by wireless communication or the like, a certain amount of time is required for transmission processing such as video data compression processing or digital modulation. For this reason, in an imaging system such as that described above, pan (P) and tilt (T) direction operations of the camera platform and zoom (Z) and focus (F) operations of the imaging unit including the lens are performed by the operator. A delay occurs in the video transmitted to the operator.

  In an environment in which such video delay occurs, it is not easy to obtain a desired shooting composition (target composition) by performing an operation while viewing the transmitted video. This is because an extra operation is performed for the time that the video is delayed, and P, T, Z, and F of the camera platform are over-operated by the extra operation.

  Patent Document 1 discloses a shot memory function as a function used for avoiding an excessive operation of the camera head due to such a video delay. The shot memory function stores the P, T, Z, and F positions corresponding to a predetermined target composition in the memory as preset positions, and automatically moves the camera platform in response to a one-touch operation of one switch. It is a function that operates to the preset position.

  However, if the change in the angle of view (P, T, Z) until the target composition is reached by the shot memory function is not intended by the operator, the subject to be photographed until the target composition is reached. You may be temporarily out of the frame. For this reason, it is not always preferable to use the shot memory function in an environment where a video delay occurs.

  In Patent Document 1, when the camera head is over-operated in response to an operation during the video delay time, the camera head automatically performs a return operation corresponding to the over-operation amount. An imaging system that freezes the camera is disclosed.

  Patent Document 2 discloses a photographing system that obtains target coordinate information according to an operation of an operator and displays a character such as an arrow or a frame representing the operation of a camera platform on the video based on the target coordinate information. Has been. In this shooting system, the operator stops the operation when the character display reaches the position where the camera head operation is desired to be stopped, so that the camera head can be prevented from over-operating due to video delay. is there.

Japanese Patent No. 3104816 JP 2001-036883 A

  In the photographing system disclosed in Patent Document 1, it is necessary to accurately obtain the delay time of the video and the over-operation amount of the camera platform. However, when actually operating the imaging system, the video delay time depends on the video compression method, video transmission path, and the like, so the video delay time and the camera head over-operation amount are accurately obtained. It ’s difficult. In addition, an image memory for freezing the video is required, which increases the hardware scale and control load.

  Furthermore, even in the video system disclosed in Patent Document 2, it is difficult to always obtain target coordinate information accurately due to the influence of variations in video delay time. As a result, even if the operation is stopped according to the character display, the camera head may be overoperated.

  The present invention provides a photographing system that can easily suppress an excessive operation of a camera head due to a video delay.

  An imaging system according to one aspect of the present invention includes a camera platform including an imaging unit that generates an image by imaging and a movable platform unit that includes the imaging unit, and a command for operating the camera platform in response to an operation. An operation unit that outputs a signal, a control unit that operates the camera platform in response to the command signal, and a storage unit that stores a target operation position of the camera platform. The control unit calculates the difference between the actual operation position of the camera platform detected by the position detector or the command operation position of the camera platform corresponding to the command signal and the target operation position, and the difference becomes smaller than a predetermined value. In this case, regardless of the input of the command signal, any one of the stop of the operation of the camera head, deceleration, and automatic control of the operation of the camera head to the target operation position is performed.

  According to the present invention, it is possible to more easily and reliably suppress the excessive operation of the camera platform in an environment with a video delay as compared with the conventional case.

5 is a flowchart for explaining a control procedure of the camera head system that is Embodiment 1 of the present invention. FIG. 3 is a diagram illustrating a usage pattern of the camera head system according to the first embodiment. FIG. 3 is a diagram illustrating a schematic configuration of an operation device included in the camera pan head system according to the first embodiment. FIG. 3 is a diagram illustrating a video monitor provided with an operation device in the first embodiment. FIG. 2 is a block diagram illustrating a configuration of a camera pan head according to the first embodiment. The figure which shows schematic structure of the operating device contained in the camera pan head system which is Example 3 of this invention. FIG. 10 is a diagram illustrating a video monitor provided together with an operation device in the third embodiment. The figure which shows schematic structure of the operating device contained in the camera pan head system which is Example 5 of this invention.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 2 shows an example of the usage (operation) mode of the camera head system (imaging system) that is Embodiment 1 of the present invention.

  Reference numeral 1 denotes a camera head used in the photographing system. Reference numeral 2 denotes an initial video frame corresponding to the angle of view initially set by the camera platform 1. Reference numeral 3 denotes a target video frame, which performs a plurality of operations of pan (P), tilt (T), zoom (Z), and focus (F) from the state in which the initial video frame 2 is set on the camera head 1. This is a video frame that is finally obtained by the operator.

  The camera platform 1 includes a camera unit (imaging unit) that can perform a Z operation and an F operation and captures a subject to generate an image, and a movable platform unit that supports the camera unit and can perform a P operation and a T operation. It is comprised by. The camera platform 1 is connected to the operating device 4 shown in FIG. 3 via a communication line (hereinafter referred to as a control line) such as a public telephone line that has almost no communication delay. When the operator manually operates the operation unit 4, the camera platform 1 can be remotely controlled from a location far away from the camera platform 1.

  The video generated by the camera platform 1 is transmitted to and displayed on a video monitor (display unit) 5 shown in FIG. 4 via a video line such as a wireless line. When video is transmitted through a video line, the delay described above occurs. For this reason, the video from the camera platform 1 is delayed and displayed on the video monitor 5 with respect to the operation on the operation device 4.

  FIG. 5 shows a more detailed configuration of the camera head 1. The camera unit is provided with a photographing lens 16 that can perform a Z operation and an F operation, and an imaging element 18 such as a CCD sensor or a CMOS sensor that photoelectrically converts a subject image formed by the photographing lens 16. In the photographic lens 16, a Z / F position sensor 20 is provided as a position detector that detects actual operation positions (hereinafter referred to as Z operation position and F operation position) of a zoom lens and a focus lens (not shown). .

  An image signal processing circuit 19 provided in the camera unit performs various kinds of image processing on the image pickup signal output from the image pickup device 18 to generate a video as an image signal. The image signal processing circuit 19 outputs the generated video to a video line via a video output terminal (not shown).

  The movable head unit includes a P / T drive unit 17 in which an actuator for P operation and T operation is incorporated, and position detection for detecting the P operation position and the T operation position, which are actual operation positions in the pan and tilt directions, respectively. A P position sensor 13 and a T position sensor 14 are provided.

  Further, the camera head 1 is provided with a CPU 12 as a control unit, a memory 11 as a storage unit, and a communication terminal 15 to which the above-described control line is connected.

  FIG. 2 shows an example in which a tree is enlarged and displayed by capturing the upper right tree pointed to by a person (reporter) in the initial video frame 2 in the target video frame 3. An operator (not shown) operates the operating device 4 to operate the camera platform 1 in P, T, Z, and F, and changes the video frame from the initial video frame 2 to the target video frame 3.

  The operation device 4 shown in FIG. 3 is arranged near the operator together with the video monitor 5. The operation device 4 includes a P / T operation lever 41, a Z operation lever 42, and an F operation knob 43 as operation members that are manually operated by an operator. When the P / T operation lever 41 is operated, the controller 4 outputs a command signal for causing the camera pan head 1 to perform the P operation and the T operation. Similarly, when the Z operation lever 42 and the F operation knob 43 are manually operated, the controller 4 outputs a command signal for causing the camera pan head 1 to perform the Z operation and the F operation. In the following description, manual operation of the P / T operation lever 41, the Z operation lever 42, and the F operation knob 43 is also referred to as P / T / Z / F operation, and P operation, T operation, Z operation, and F operation are referred to. The command signal to be performed is also referred to as a P / T / Z / F command signal.

  Further, the operation device 4 is provided with threshold value indicators 49 and 51 and an approach indicator (difference display unit) 52 for P / T / Z / F. Further, the operating device 4 includes a first threshold setting knob 48, a second threshold setting knob 50, a memory switch 40, a first position memory switch 44, a second position memory switch 45, a stop switch 46, A suppression mode selection switch 47 is provided. These roles will be described later. Further, the operation device 4 is provided with a communication terminal 53 to which the above-described control line is connected.

  The flowchart of FIG. 1 shows the flow of processing performed in the camera head system (mainly the CPU 12 and the operating device 4) of the present embodiment. This process is executed according to the computer program stored in the CPU 12 and the operating device 4.

  First, in step S1, the operator operates P / T / Z / F on the operation device 4 so that the target video frame 3 shown in FIG. Next, the operator presses the memory switch 40 and the first position memory switch 44 or the second position memory switch 45 (here, referred to as the second position memory switch 45) of the operation device 4. The operation device 4 transmits a command indicating that the memory switch 40 and the second position memory switch 45 are pressed from the communication terminal 53 to the camera pan head 1 through the control line.

  The CPU 12 receives the above command through the communication terminal 15, detects the P operation position and the T operation position by the P position sensor 13 and the T position sensor 14, and sets the Z operation position and the F operation position by the Z / F position sensor 20. To detect. Then, the CPU 12 uses the detected P operation position, T operation position, Z operation position and F operation position (hereinafter referred to as P / T / Z / F detection position) as a target operation position (hereinafter referred to as P / T / Z). (Referred to as a target position of / F).

  Next, in step S2, the operator sets the initial video frame 2 shown in FIG. Thereafter, the operator operates the P / T / Z / F in the operation unit 4 in order to obtain an enlarged image of the tree shown in FIG. 2, and the P / T / Z / F command signal is sent to the camera head. 1 to send. As a result, the camera platform 1 operates to bring the video frame closer to the target video frame 3. The method of changing the video frame until reaching the vicinity of the target video frame 3 is not necessarily linear, and is arbitrarily determined by the operator.

  While the image frame approaches the target image frame 3, the CPU 12 detects the P / T / Z / F detection position obtained by the P position sensor 13, the T position sensor 14, and the Z / F position sensor 20 in step S 3. The difference from the target position of P / T / Z / F stored in the memory 11 is calculated periodically. And CPU12 determines whether the said difference became smaller than the difference threshold value (predetermined value) about each of P / T / Z / F.

  Here, the difference threshold is arbitrarily set by the operator by operating the first threshold setting knob 48 provided in the operation device 4. The threshold values may be the same value or different values for P / T / Z / F (see Example 3). The set difference threshold is displayed numerically on the threshold display 49 and transmitted to the camera platform 1. The CPU 12 presets the received difference threshold value.

  In step S <b> 4, the CPU 12 transmits an approach signal for P / T / Z / F in which the difference is smaller than the difference threshold to the controller 4 through the communication terminal 15. For example, the resolution of the P detection position is set to 4096 steps of 12 bits, and the center position of the target video frame 3 in the P operation is set to 2000. At this time, a P approach signal is output when the difference is smaller than the difference threshold value ± 8 (that is, when the P detection position is closer to 2000 than 2000 ± 8). The controller 4 that has received the P approach signal lights up the P approach indicator 52. Also for T / Z / F, when the difference between the detected position and the target position becomes smaller than the difference threshold value, the CPU 12 lights the proximity indicator 52 for T / Z / F.

  At this time, on the video monitor 5, as shown in FIG. 4, the tree does not reach the center of the screen due to the video delay, but the camera head 1 sets the target video frame 3 shown in FIG. An image is generated at the center of the screen. Even if the video on the video monitor 5 is delayed by turning on the P / T / Z / F proximity indicator 52 of the operating device 4, the operator can use the camera head 1 almost in the target video frame 3. You can know that shooting is taking place.

  Next, in step S5, the CPU 12 determines whether or not an approach signal for at least the stop threshold number (predetermined number) of the four operations P / T / Z / F has been input, that is, the video frame is the target video frame. It is determined whether or not the video frame near (immediately before) 3 has been reached. If an approach signal for at least the stop threshold number of operations is input, the process proceeds to step S6, and if not, the process returns to step S2.

  In step S <b> 6, the CPU 12 determines which one of a mode in which a command ignoring operation described later is performed and a mode in which it is not performed is selected by a stop switch 46 provided in the operation device 4. Since the information on the mode selected by the stop switch 46 is transmitted to the CPU 12, the CPU 12 makes the above determination based on the information. When the mode for performing the command ignoring operation is set, the process proceeds to step S7, and when the mode for not performing the command ignoring operation is set, the process returns to step S2.

  In addition, when the mode which performs command ignoring operation is selected by the stop switch 46, the indicator provided in the stop switch 46 lights up.

  In step S7, the CPU 12 performs a command ignoring operation. The command ignoring operation is an operation of ignoring the P / T / Z / F command signal from the controller 4 for a predetermined time. This command ignoring operation is performed for the following reason.

  The operator who has operated the P / T / Z / F stops the operation after reaching the video monitor 5 with a delay time and confirming the displayed video. For this reason, at least during the delay time, the command signal of P / T / Z / F is continuously sent from the controller 4 to the CPU 12. However, if the CPU 12 causes the P / T / Z / F operation to be performed in response to an extra command signal during this period, the operation becomes an overoperation, and the video frame goes too far from the target video frame 3. Therefore, the command ignoring operation is performed so as to ignore the extra command signal.

  The number of stop thresholds in step S5 is arbitrarily set by the operator by operating the second threshold setting knob 50 of the operating device 4, and the set stop threshold number is displayed numerically on the threshold display 51 and the camera platform 1 Sent to. The CPU 12 presets the received stop threshold number. For example, when the stop threshold number is 3, the CPU 12 performs the command ignoring operation when an approach signal for at least three of the four operations of P / T / Z / F is input.

  Further, the predetermined time during which the command ignoring operation is performed is set longer than the delay time from the operation of P / T / Z / F until the change of the image can be confirmed. For example, if the delay time is 1 second, it is set to about 3 seconds.

  The CPU 12 that has started the command ignoring operation turns on the indicator provided in the second position memory switch 45.

  The CPU 12 that has returned from step S6 to step S2 performs a P / T / Z / F operation in response to a P / T / Z / F command signal from the operation device 4.

  After performing the command ignoring operation for a predetermined time in step S7, the CPU 12 determines in step S8 which one of the stop mode and the automatic movement mode is selected by the mode selection switch 47 provided in the operation device 4. . Since the information on the mode selected by the mode selection switch 47 is transmitted to the CPU 12, the CPU 12 makes the above determination based on the information. If the stop mode is set, the process proceeds to step S9. If the automatic movement mode is set, the process proceeds to step S10.

  When the automatic movement mode is selected by the mode selection switch 47, the indicator provided on the mode selection switch 47 is turned on.

  In the stop mode of step S9, the CPU 12 stops the P / T / Z / F operation regardless of the input of the P / T / Z / F command signal from the operation device 4. As a result, even if the operator continues to perform the P / T / Z / F operation after the image frame actually set on the camera platform 1 reaches the vicinity of the target image frame 3, the operation is irrelevant. At this time, the P / T / Z / F operation of the camera pan head 1 stops. Then, the change of the video frame is also stopped near the target video frame 3. Therefore, it is possible to avoid an excessive operation of the camera platform 1 (an excessive change in the video frame) due to the video delay.

  Further, in the automatic movement mode in step S10, the CPU 12 causes the detected position of P / T / Z / F to approach the target position regardless of the input of the P / T / Z / F command signal from the operation device 4. (Preferably so as to match) P / T / Z / F operation is automatically controlled. As a result, even if the operator continues to perform the P / T / Z / F operation after the image frame actually set on the camera platform 1 reaches the vicinity of the target image frame 3, the operation is irrelevant. The video frame is automatically changed so as to substantially match the target video frame 3. Therefore, it is possible to avoid an excessive operation of the camera platform 1 due to the video delay, and to set the video frame to the target video frame 3 almost accurately.

  As described above, according to the present embodiment, when the operator manually operates the operating device 4 in an environment where there is a video delay, the video frame is set to the target video frame or to it while avoiding the excessive operation of the camera platform 1. A system that can be changed to a near video frame can be easily constructed. Further, the operator can select whether the change of the video frame is stopped near the target video frame or whether the video frame is automatically changed to the target video frame. In addition, since the operator can freely select how to change the video frame up to the vicinity of the target video frame through manual operation, the degree of freedom of video expression can be expanded.

  In the first embodiment, the operation of the P / T / Z / F of the camera platform 1 is stopped or the target is automatically set when the video frame reaches the vicinity of the target video frame by the manual operation of the operator 4 of the operator. The case where it is possible to select whether to change the video frame has been described. On the other hand, in this embodiment, after the video frame reaches the vicinity of the target video frame, the P / T / Z / F operation speed of the camera platform 1 is reduced. That is, a deceleration mode is provided.

  Specifically, in step S9 in FIG. 1, the CPU 12 uses the operation direction indicated by the command signal sent from the operation device 4 as it is, while dividing the operation speed by a predetermined value to obtain a new operation speed (low speed). ) Is set. As a result, after the video frame reaches the vicinity of the target video frame, the operation speed of the camera pan head 1 at P / T / Z / F even if the amount of operation of P / T / Z / F by the operator does not change. Is decelerated, and the change of the image frame is also slowed.

  According to the present embodiment, even if the camera pan head 1 is over-operated by the operation of the operator, the over-operation amount can be suppressed to a very small level, and an operator who desires manual operation until the end can provide a satisfactory operation feeling. .

  Note that whether or not to set such a deceleration mode may be selected by operating a switch. Further, the operator may freely select a mode from the stop mode and automatic movement mode described in the first embodiment and the deceleration mode of the present embodiment.

  In the first embodiment, a case has been described in which the proximity indicator 52 for P, T, Z, and F is provided in the operation device 4 shown in FIG. 3, but as shown in FIG. The approach display 52 'for P, T, Z, and F may be performed by superimposing it on the video. Since the operator often operates while gazing at the video monitor 5 'without looking at the operation device, the operability can be further improved by performing the approach display 52' on the video monitor 5 '.

  In order to realize such a function, as shown in FIG. 6, an external output terminal 56 for outputting a superimposed signal for displaying the approach display 52 ′ to the video monitor 5 ′ is provided on the operation unit 4 ′. .

  In the first embodiment, the proximity indicator 52 indicates that the difference between the detection position of P / T / Z / F and the target position is smaller than the difference threshold value. If the difference itself is displayed, it becomes easier for the operator to perform the operation. For this reason, in the operating device 4 ′ shown in FIG. 6, a difference display (difference display unit) 55 for displaying a difference (hereinafter referred to as difference information) between each detection position of P / T / Z / F and the target position. Is provided. The CPU 12 of the camera platform 1 transmits the difference information of P / T / Z / F to the operation device 4 ′. The operation device 4 ′ displays the received difference information on the difference display 55.

  Since the difference display 55 displays the difference values of P / T / Z / F and the direction (+, −), the operator can easily recognize the direction in which the operation device 4 ′ should be operated. Further, the difference information may be displayed superimposed on the video on the video monitor.

  Further, in the operation device 4 'of the present embodiment, the difference threshold value by the operation of the first threshold value setting knob 48 is set so that the difference threshold value can be set independently for each of P / T / Z / F. A changeover switch 57 is provided for selecting the setting target in P / T / Z / F. For example, in order to set the difference threshold for P, “P” is selected by the changeover switch 57 and the first threshold setting knob 48 is operated while looking at the threshold indicator 49 to set the difference threshold. By allowing the difference threshold values of P / T / Z / F to be set independently of each other, it is possible to reflect the habits and preferences of the operator's operation.

  In the second embodiment, when the video frame reaches the vicinity of the target video frame 3 (that is, when the operating position of the camera pan 1 reaches the deceleration area), the P / T / Z / F of the camera pan 1 is It has been described that the excessive operation amount of the camera pan head 1 is suppressed to be small by reducing the operation speed. However, when the operation speed up to the deceleration area is high, the amount of excessive operation of the camera platform 1 may increase even if the operation speed is reduced in the deceleration area.

  Therefore, in the fourth embodiment of the present invention, the P / T / Z / F operating speed (hereinafter referred to as the command speed) of the camera pan head 1 corresponding to the P / T / Z / F command signal is changed in the deceleration area. It is determined whether or not the speed is higher than a threshold value (predetermined speed). When the command speed is higher than the deceleration area change threshold, the deceleration area is expanded as compared with the case where the command speed is lower than that.

  For example, the command speed of P can be set in the range of 0 to 127, and the deceleration area change threshold is set to 64. A deceleration area when the command speed of P is less than 64 (normal speed to low speed) is set as an area corresponding to ± 8 which is a difference threshold. In this case, when the command speed of P is larger than 64 (high speed), ± 8 is multiplied by, for example, a factor of 1.5, so that the deceleration area corresponds to ± 12 as the increased difference threshold value. Expand to the area.

  As described above, in this embodiment, the difference threshold is set to be larger as the operating speed of the camera platform 1 up to the deceleration area is higher. Thereby, even when the operation speed to the deceleration area is high, the excessive operation amount of the camera platform 1 can be suppressed to a small value.

  In the first to fourth embodiments, the case where the camera head 1 is equipped with the CPU 12 as the control unit and the memory 11 as the storage unit that stores the target position of P / T / Z / F has been described. However, the control unit and the storage unit may be mounted on the operation device.

  FIG. 8 shows a schematic configuration of an operating device in a camera head system that is Embodiment 5 of the present invention. In the operation device 4 ″, the same components as those of the operation device 4 shown in the first embodiment (FIG. 3) are denoted by the same reference numerals as those in the first embodiment, and are not described.

  The operation unit 4 ″ is provided with a CPU 62 as a control unit and a memory 61 as a storage unit. The operation unit 4 ″ receives a command signal from the CPU 62 in the camera pan head 1 (not shown). A communication terminal 63 to which a control line for transmitting to the CPU is connected is provided.

  In this embodiment, the operator operates P / T / Z / F on the operating device 4 ″ to set the video frame to the target video frame 3 shown in FIG. When the memory switch 40 and the position memory switch (44 or 45) are pressed as an operation for storing the Z / F target position, the CPU 62 transmits a memory command command to the camera platform 1.

  The camera pan head 1 (CPU not shown) transmits the detection position of P / T / Z / F at the time of receiving the memory command command to the operating device 4 ″. Detection position of P / T / Z / F The CPU 62 that has received these data stores them in the memory 61.

  Next, the operator starts shooting from the state in which the initial video frame 2 shown in FIG. 2 is set, and then the P / T / Z / F for changing the video frame toward the target video frame 3 is set. Perform the operation. The CPU 62 transmits a command signal corresponding to the operation of P / T / Z / F to the camera pan head 1. In the camera platform 1, a P / T / Z / F operation is performed in accordance with the command signal, and the detection position of P / T / Z / F is transmitted to the CPU 62.

  The CPU 62 periodically detects the P / T / Z / F detection position received from the camera head 1 and the P / T / Z / F target position stored in the memory 61 for each P / T / Z / F. It is determined whether or not these differences are smaller than the difference threshold. And the approach indicator 52 with respect to the operation | movement in which the said difference became smaller than the difference threshold value is lighted.

  Further, when the CPU 62 determines that the difference is smaller than the difference threshold value with respect to the operation of at least the stopper threshold value among P / T / Z / F, the CPU 62 performs the command ignoring operation for a predetermined time. Thereafter, the process proceeds to one of the stop mode, the target movement mode, and the deceleration mode described in the first and second embodiments.

  In the fifth embodiment, the information on the detection position of P / T / Z / F is transmitted from the camera pan head 1 to the operating device 4 ″, and the detected position and the memory 61 are stored in the CPU 62 in the operating device 4 ″. The comparison with the target position made was explained for the case. However, a position (command operation position) corresponding to the command signal generated in the CPU 62 may be used instead of the detection position.

  Each embodiment described above is only a representative example, and various modifications and changes can be made to each embodiment in carrying out the present invention.

  It is possible to provide an imaging system capable of suppressing the excessive operation of the camera platform in an environment with a video delay.

DESCRIPTION OF SYMBOLS 1 Camera pan head 2 Initial image frame 3 Target image frame 4, 4 ', 4 "Operation device 5, 5' Image monitor 11, 61 Memory 12, 62 CPU
13 P position sensor 14 T position sensor 17 P / T drive unit 20 Z / F position sensor