JP4423484B2 - IMAGING DEVICE, ITS CONTROL DEVICE, AND IMAGING SYSTEM - Google Patents

Description

The present invention relates to an imaging device, a control device thereof, and an imaging system. Specifically, an image signal generation unit that generates a first image signal of a variable-speed frame rate captured image, a synchronization signal generation unit that generates a synchronization signal used to generate the first image signal, and a frame rate of the image signal generation unit In response to the fact that the frame rate of the second image signal input from the outside is different from the frame rate of the first image signal in the imaging apparatus having the control means for controlling the operation of the synchronization signal generation means, the synchronization signal generation means A self-running synchronization signal is generated to generate a variable frame rate captured image and display a variable frame rate captured image while an externally supplied image is displayed.

  In conventional movie production and the like, shooting is performed by varying the shooting speed of a film camera, that is, the number of frames per second, so that a special video effect can be obtained. For example, if shooting is performed at a speed higher than the normal speed and playback is performed at the normal speed, the playback image becomes a slow playback image. For this reason, it is possible to observe easily and in detail a high-speed operation like when a water droplet falls on the water surface. If shooting is performed at a lower speed than normal speed and playback is performed at a normal speed, a high-speed playback image is obtained. For this reason, it is possible to enhance the sense of speed in a fighting scene, a car chase scene, etc., and to present an image with a high sense of reality.

  Also, in television program production, etc., digitization such as program shooting, editing, and transmission has been attempted, but in the production of movies, etc. due to the increase in image quality and the reduction in equipment prices accompanying the advancement of digital technology. It has been planned.

  Here, when imaging is performed using an imaging device (video camera) by digitization such as television program production or movie production, special video effects such as high-speed playback and slow playback can be easily obtained. As described above, the imaging apparatus disclosed in Patent Document 1 that can change the frame rate is used. By using this imaging device to capture an image with a frame rate lower than the predetermined frame rate and reproducing the captured image at a predetermined frame rate, a high-speed playback image can be easily obtained. Further, if the image is taken at a high frame rate and the captured image is reproduced at a predetermined frame rate, a slow reproduction image can be easily obtained.

JP 2000-125210 A

  By the way, when an image signal obtained by imaging at a variable frame rate is recorded on a recording medium such as a video tape or an optical disk, it is confirmed on the imaging device side whether or not a captured image desired by the photographer has been recorded. Things have been done. In this case, an image signal DVr obtained by reproducing the recording medium is supplied to the imaging device, and the imaging device is operated in synchronization with the image signal DVr, whereby an electronic viewfinder or monitor connected to the imaging device is used. An image display based on the image signal DVr is performed by an apparatus or the like.

  Here, when the frame rate is different from the image signal DVr obtained by reproducing the recording medium and the image signal of the variable frame rate captured image obtained when imaging is performed with the variable frame rate, the recorded imaging is performed. While the image is being confirmed, the imaging device is operated in synchronization with the image signal DVr, so that it becomes impossible to generate the image signal of the variable speed frame rate captured image and display the variable speed frame rate captured image. For this reason, during confirmation of the recorded captured image, for example, it is not possible to display a variable-speed frame rate captured image and perform image frame alignment, focus adjustment, or the like in advance.

Therefore, in the present invention, a variable speed frame rate captured image is generated and a variable speed frame rate captured image is displayed while an image supplied from the outside of the imaging device such as an image signal obtained by reproducing a recording medium is displayed. The present invention provides an imaging device, a control device for the imaging device, and an imaging system .

An imaging apparatus according to the present invention includes an image signal generation unit that generates a first image signal of a variable-speed frame rate captured image, a synchronization signal generation unit that generates a synchronization signal used to generate the first image signal, and an image signal generation Controlling the frame rate of the means and the operation of the synchronization signal generating means, and causing the synchronization signal generating means to self-run according to the fact that the frame rate of the second image signal input from the outside is different from the frame rate of the first image signal. Control means for generating a synchronization signal and monitor output means for outputting the second image signal as a monitor image signal .

An imaging apparatus according to the present invention includes an imaging apparatus and a controlled apparatus controlled by the imaging apparatus , and the imaging apparatus generates an image signal generation unit that generates a first image signal of a variable-speed frame rate captured image. A synchronization signal generating unit that generates a synchronization signal for generating the first image signal and supplies it to the image signal generating unit, and controls the frame rate of the image signal generating unit, the operation of the synchronization signal generating unit, and the controlled device. And a control unit that causes the synchronization signal generation unit to self-run to generate a synchronization signal in response to the frame rate of the second image signal input from the controlled device to the imaging device being different from the frame rate of the first image signal. And a monitor output means for outputting the second image signal as a monitor image signal .

The control device according to the present invention includes an image signal generation unit that generates a first image signal of a variable-speed frame rate captured image, and a synchronization signal generation unit that generates a synchronization signal for operating the image signal generation unit. An imaging apparatus and a control apparatus that controls the imaging apparatus are configured . The control apparatus includes a control unit that controls the frame rate of the image signal generation unit of the imaging apparatus and the operation of the synchronization signal generation unit. In response to the fact that the frame rate of the second image signal input to the imaging device is different from the frame rate of the first image signal, the synchronization signal generating means of the imaging device is caused to self-run to generate a synchronization signal. And a monitor output means for outputting the second image signal as a monitor image signal .
In addition, an imaging system according to the present invention generates an image signal generation unit that generates a first image signal of a variable-speed frame rate captured image, and generates a synchronization signal for generating the first image signal. The synchronization signal generating means to be supplied, the recording / reproducing means for recording / reproducing the first image signal, the frame rate of the image signal generating means, the operation of the synchronizing signal generating means, and the recording / reproducing means are controlled and reproduced from the recording / reproducing means When the frame rate of the reproduced image signal is different from the frame rate of the first image signal, a control unit that causes the synchronization signal generating unit to self-run to generate a synchronization signal and outputs the reproduced image signal as a monitor image signal And a monitor output means .

In the present invention, the first image signal of the variable-speed frame rate captured image is generated by the image signal generation unit of the imaging apparatus, and the synchronization signal used for generating the first image signal is generated by the synchronization signal generation unit. The Here, when the second image signal is supplied to the imaging device, for example, when the second image signal is supplied to the imaging device from the external device, the control device, or the controlled device, the synchronization signal generating unit of the imaging device Even when the frame rate of the second image signal is different from the frame rate of the first image signal, the image signal obtained by reproducing the recording medium is supplied from the outside of the imaging device. While the displayed image is displayed, a variable frame rate captured image is generated. Further, when the reference synchronization signal is supplied instead of the second image signal, the synchronization signal generating means of the imaging apparatus is operated in synchronization with the reference synchronization signal, so that the first image signal synchronized with the reference synchronization signal is output. It becomes possible to do.

  Furthermore, when a delay compensation unit that compensates for a delay caused by communication with the imaging device and a delay compensation driving unit that generates a drive signal for driving the delay compensation unit are provided, the second image signal is captured by the imaging device. Is supplied, the delay compensation driving means is self-run to generate a driving signal corresponding to the frame rate of the second image signal. When the reference synchronization signal is supplied to the imaging apparatus instead of the second image signal, a drive signal synchronized with the reference synchronization signal is generated by the delay compensation driving means.

According to the present invention, the first image signal of the variable-speed frame rate captured image is generated by the image signal generation unit of the imaging apparatus, and the synchronization signal used to generate the first image signal is the early synchronization signal generation unit. Generated. Here, in response to the second image signal being supplied from the external device, the control device, or the controlled device to the imaging device, the synchronization signal generating means of the imaging device is set in a free-running state. Therefore, even when the frame rate of the second image signal is different from the frame rate of the first image signal, an image supplied from the outside of the imaging device, such as an image signal obtained by reproducing the recording medium, is being displayed. In addition, the variable speed frame rate captured image can be generated and the variable speed frame rate captured image can be displayed . Further, when the reference synchronization signal is supplied instead of the second image signal, the synchronization signal generating means of the imaging apparatus is operated in synchronization with the reference synchronization signal, so that the first image signal synchronized with the reference synchronization signal is output. can do.

  Furthermore, when the delay compensation means for compensating for the delay caused by the communication with the imaging apparatus and the delay compensation driving means for generating the drive signal for driving the delay compensation means are provided, the second image signal is captured by the imaging apparatus. When this is supplied, the delay compensation driving means is self-run to generate a driving signal corresponding to the frame rate of the second image signal. For this reason, the delay of the second image signal can be correctly compensated and supplied to the imaging apparatus. When the reference synchronization signal is supplied to the imaging apparatus instead of the second image signal, a drive signal synchronized with the reference synchronization signal is generated by the delay compensation driving means. For this reason, the delay of the reference synchronization signal can be correctly compensated and supplied to the imaging apparatus. In addition, the first image signal synchronized with the reference synchronization signal from the imaging device can be received with correct delay compensation.

  Hereinafter, an embodiment for carrying out the present invention will be described with reference to the drawings. FIG. 1 shows the configuration of the imaging system. The imaging system includes an imaging device 10, a camera control device 40, and a recording / reproducing device 50. In this imaging system, the camera control device 40 and the recording / reproducing device 50 are used as control devices that control the imaging device 10. .

  In the imaging apparatus 10, a subject image based on light incident through an imaging lens (not shown) is formed on the imaging surface of an imaging element (not shown) that constitutes the imaging unit 111 of the image signal generation unit 11. Imaged. The imaging device generates imaging charges of the subject image by photoelectric conversion, reads the imaging charges based on the drive control signal RC supplied from the driving unit 112, and converts the imaging charges into a voltage signal. Further, this voltage signal is supplied to the imaging signal processing unit 113 as the imaging signal Spa.

  The drive unit 112 generates a drive control signal RC based on a control signal CT supplied from the control unit 20 described later and a synchronization signal SY supplied from the synchronization signal generation unit 18 and supplies the drive control signal RC to the imaging unit 111.

  The imaging signal processing unit 113 amplifies the imaging signal Spa and then removes noise components. Further, after the image signal from which noise has been removed is converted into a digital signal, feedback clamp processing, flare correction, correction processing for defects in the image sensor, process processing, and the like are performed to generate an image signal DVa. This image signal DVa is supplied to the frame addition processing unit 114. The signal processing operation performed by the imaging signal processing unit 113 is set based on the control signal CT supplied from the control unit 20.

  The frame addition processing unit 114 performs frame addition processing on the image signal DVa to vary the frame rate of the image signal DVa. This frame addition process can be performed using a RAM (Random Access Memory). For example, when performing addition of three frames, the image signal DVa of the first frame is stored in the RAM-1, and the signal stored in the RAM-1 is read out and added to the image signal DVa of the second frame to obtain the RAM-2. Remember me. The addition signal stored in the RAM-2 is read out, added to the image signal DVa of the third frame, and stored in the RAM-3. The signal stored in the RAM-3 is a signal obtained by adding the image signals DVa for three frames. If this signal is read and the signal level is multiplied by (1/3), the signal level is the required level and the frame The signal is 1/3 times the rate. Further, the image signal DVa of the fourth frame is stored in the RAM-1, the signal stored in the RAM-1 is read out, added to the image signal DVa of the fifth frame, and stored in the RAM-2. The addition signal stored in the RAM-2 is read out, added to the image signal DVa of the sixth frame, and stored in the RAM-3. The signal stored in the RAM-3 is a signal obtained by adding the image signals DVa for three frames. If this signal is read and the signal level is multiplied by (1/3), the signal level is the required level and the frame The signal is 1/3 times the rate. Similarly, it is possible to sequentially generate image signals having a required signal level obtained by adding the image signals DVa for three frames.

  Further, if the signals sequentially generated in this way are read out at a predetermined output frame rate, the frame rate obtained by multiplying the frame rate of the image signal DVa by 1/3 in the image signal at the output frame rate. Thus, the image signal DVb including the captured image is obtained.

  The frame addition process can also be performed using a frame delay circuit. For example, the image signal DVa of the first frame is delayed by two frame periods by the frame delay circuit, and the image signal DVa of the second frame is delayed by one frame period by the frame delay circuit. The delayed first frame image signal and second frame image signal DVa are added to the third frame image signal DVa to obtain a signal obtained by adding the image signals DVa for three frames. As described above, after reading this signal in synchronization with a predetermined frame rate, for example, the synchronization signal SYb supplied from the control unit 20, the signal level can be obtained by multiplying the signal level by (1/3). At the same time, the image signal DVb can be obtained in which the captured image corresponding to the frame rate obtained by multiplying the frame rate of the image signal DVa by 1/3 is included in the image signal of the output frame rate.

  By performing the frame addition process in this way, for example, the frame rate of the image signal DVa is “60P (the number indicates the number of frames per second, P indicates a progressive signal, and in other cases, Is the same)), it is possible to obtain an image signal including a picked-up image at a frame rate of “30P” if the number of added frames is 2 frames and is read at an output frame rate of 60P, for example. . Further, if the number of added frames is four, an image signal including a captured image at a frame rate of “15P” can be obtained.

  Furthermore, not only switching the number of added frames but also controlling the signal readout from the image sensor to vary the frame rate of the imaged signal Spa makes it possible to continuously vary the frame rate of the captured image. An image signal DVb having an output frame rate including a variable-speed frame rate captured image that is an image captured at a frame rate can be generated.

  Here, when the frame rate of the imaging signal Spa is varied, the frame is obtained by controlling the charge accumulation period in the imaging element, the readout timing of the imaging charge, and the like by the drive control signal RC supplied from the driving unit 112 to the imaging unit 111. An imaging signal Spa with a variable rate can be obtained. Further, assuming that the CDR method (Common Data Rate: common sampling frequency method) is used, the length of the horizontal blanking period or the vertical blanking period is adjusted, and the imaging frame rate FRp is changed. Even if the imaging frame rate FRp is varied, it is possible to generate an imaging signal Spa in which the image size of the effective screen period does not change. Further, by using the CDR method, it is not necessary to vary the operating frequency of each part using the imaging frame rate FRp according to the imaging frame rate FRp, and the configuration is simplified.

  In this way, the image signal DVb generated by the frame addition processing unit 114 is supplied to the interface 12 and the signal selectors 151 and 152 of the monitor output unit 15.

  The interface 12 is connected to the interface 41 of the camera control device 40 via the transmission line 30, and supplies the image signal DVb and the communication information RMw supplied from the control unit 20 to the camera control device 40.

  The interface 13 is connected to the interface 45 of the camera control device 40 via the transmission line 30, and synchronizes the image signal DVr supplied from the camera control device 40 with the signal selectors 151 and 152 of the monitor output unit 15. This is supplied to the sync separator 181 of the signal generator 18.

  The signal selector 151 selects either the image signal DVb or the image signal DVr based on the selection signal CSa from the control unit 20, and outputs it as a monitor image signal VFout to be supplied to the electronic viewfinder. The signal selector 151 selects either the image signal DVb or the image signal DVr based on the selection signal CSb from the control unit 20 and supplies the selected signal to the signal output unit 153. The signal output unit 153 converts the supplied image signal into a signal having a format corresponding to the monitor device connected to the imaging device 10 and outputs the signal as a monitor image signal MTout.

  The synchronization separation unit 181 separates the synchronization signal from the signal supplied via the interface 13 and supplies it to the phase comparison unit 183 via the switch 182. The phase comparison unit 183 performs phase comparison between the synchronization signal SY generated by the signal generation unit 185 and the synchronization signal SYc supplied via the switch 182, and a voltage controlled oscillator (VCO) 184 so as to eliminate the phase error. Is used to control the frequency of the reference oscillation signal MCK generated in step (1). The reference oscillation signal MCK generated by the VCO 184 is supplied to the signal generator 185. The signal generation unit 185 generates a synchronization signal SY based on the reference oscillation signal MCK supplied from the VCO 184 and supplies it to the drive unit 112 and the phase comparison unit 183. At this time, the synchronization signal SY and the synchronization signal SYc are synchronized signals. Further, when the switch 182 is turned off based on the switch control signal CW from the control unit 20 and the synchronization signal SYc is not supplied to the phase comparison unit 183, or even if the switch 182 is turned on, the synchronization separation unit 181 When the synchronization signal is not supplied from the VCO 184, the VCO 184 is caused to self-run and the reference oscillation signal MCK having the free-running oscillation frequency is supplied to the signal generation unit 185. Here, the free-running oscillation frequency of the VCO 184 is such that when the synchronizing signal SY generated from the reference oscillation signal MCK having the free-running oscillation frequency is supplied to the driving unit 112, the image signal DVb is converted into an electronic viewfinder, a monitor device, or a camera control device 40. And a predetermined frame rate corresponding to the recording / reproducing apparatus 50 or the like.

  A user interface unit 21 is connected to the control unit 20. When an operation signal PSa corresponding to a user operation is supplied via the user interface unit 21, the control unit 20 generates a control signal CT or the like based on the operation signal PSa and controls the operation of each unit. Thus, the imaging apparatus is operated in accordance with the user operation. Further, when the frame rate setting signal RSF for setting the frame rate of the image signal DVb output from the frame addition processing unit 114 is supplied to the control unit 20 via the user interface unit 21, for example, the operation unit sets the imaging speed. When switching is performed and the frame rate setting signal RSF is supplied to the control unit 20 as the operation signal PSa, or when the frame rate setting signal RSF is supplied to the control unit 20 from a remote control device or an external device, the control unit 20 Supplies a control signal CTfp for setting the imaging frame rate to the drive unit 112 and a control signal CTac for setting the number of added frames to the frame addition processing unit 114. Further, selection signals CSa and CSb and a switch control signal CW are generated based on the operation signal PSa or communication information RMc from the recording / reproducing apparatus 50 described later, and the signal selection operation by the signal selectors 151 and 152 and the on / off operation of the switch 182 are performed. Control. The control unit 20 also generates communication information RMw for controlling the camera control device 40 and the recording / reproducing device 50 as necessary.

  The camera control device 40 supplies the image signal DVb received by the interface 41 to the line memory 421 of the delay compensation unit 42. The line memory 421 writes and reads the image signal DVb based on a write / read control signal RWC from the delay compensation driving unit 44 described later, and synchronizes the image signal DVb with a reference synchronization signal SYref described later to generate a signal. The data is supplied to the selector 43 and the recording processing unit 51 of the recording / reproducing apparatus 50. Further, the communication information RMw received by the interface 41 is supplied to the control unit 55 of the recording / reproducing apparatus 50.

  When the image signal DVr is supplied from the recording / reproducing apparatus 50, the image signal DVr is supplied to the line memory 422. The line memory 422 writes and reads the image signal DVr based on the write / read control signal RWC from the delay compensation drive unit 44, and predicts the delay generated in the transmission path 30 in advance from the interface 45 to the image pickup apparatus 10. The signal DVr is transmitted. When the communication information RMc is supplied from the control unit 55 of the recording / reproducing apparatus 50, the communication information RMc is transmitted to the imaging apparatus 10 via the interface 45.

  The camera control device 40 is provided with a signal selector 43 for selecting either the image signal DVb or the image signal DVr based on the communication information RMw from the imaging device 10 and the communication information RMc from the recording / reproducing device 50. And output as an image signal DVm for image confirmation.

  The switch 442 of the delay compensation driving unit 44 is turned on when the image signal DVr is not supplied to the imaging device 10 and supplies the reference synchronization signal SYref to the phase comparison unit 443. Further, when the image signal DVr is supplied, the signal is turned off, and the supply of the reference synchronization signal SYref to the phase comparison unit 443 is stopped. The switch 442 is controlled by communication information RMw from the imaging apparatus 10 and communication information RMc from the recording / reproducing apparatus 50.

  The phase comparison unit 443 performs phase comparison between the synchronization signal SYd generated by the signal generation unit 445 and the reference synchronization signal SYref supplied via the switch 442, and the reference oscillation generated by the VCO 444 so that the phase error is eliminated. Controls the frequency of the signal MCL. The reference oscillation signal MCL generated by the VCO 444 is supplied to the signal generator 445. The signal generator 445 generates a write / read control signal RWC based on the reference oscillation signal MCL supplied from the VCO 444. Here, when the image signal DVr is not supplied to the imaging apparatus 10 or when the reference synchronization signal SYref is supplied to the imaging apparatus 10, the reference oscillation signal MCL synchronized with the reference synchronization signal SYref is used. A write / read control signal RWC is generated and supplied to the line memories 421 and 422. Further, when the image signal DVr is supplied to the imaging device 10, the VCO 444 is caused to self-run. The free-running frequency of the VCO 444 is set so that a reference oscillation signal MCR having a frequency corresponding to the frame rate of the image signal DVr can be generated, and a write / read control signal RWC is generated based on the reference oscillation signal MCR to generate a line memory. 422.

  The recording processing unit 51 of the recording / reproducing apparatus 50 selects an image signal of an effective frame to be described later from the supplied image signal DVb. Further, modulation processing, error correction code addition processing, and the like are performed on the selected image signal, and a recording signal WS is generated and supplied to the recording head 52W. The captured image is recorded on the recording medium 60 by driving the recording head 52W with the recording signal WS. Further, the captured image recorded on the recording medium 60 is read by the reproduction head 52R, and the obtained read signal RS is supplied to the reproduction processing unit 53. The reproduction processing unit 53 performs error correction processing and demodulation processing, and supplies the obtained image signal DVr to the line memory 422.

  A user interface unit 56 is connected to the control unit 55. When the operation signal PSb corresponding to the user operation is supplied via the user interface unit 56, the control unit 55 generates a control signal or the like based on the operation signal PSb and generates a recording processing unit 51 or a reproduction processing unit. 53 and the drive of the drive part 57 which drives the recording medium 60 are controlled, and a recording / reproducing apparatus is operated according to a user's operation. When the communication information RMw is supplied from the imaging device 10, the operation of each unit is controlled based on the communication information RMw. Further, the communication information RMc is generated in accordance with the operation signal PSb to enable control of the imaging device 10 and the camera control device 40.

  The imaging apparatus 10 performs the frame addition process on the image signal DVa and varies the frame rate of the image signal DVa. However, the frame rate variable operation is not limited to the frame addition process. For example, the frame rate can be varied by writing the image signal DVa into the RAM and reading out the written image signal DVa at a different frame rate.

  Next, the operation will be described. First, an operation in the case of performing imaging at a variable frame rate by operating the user interface unit 21 on the imaging apparatus side will be described. Here, when the reference synchronization signal SYref and the image signal DVr are not supplied to the imaging device 10, the VCO 184 is in a free-running state and a frame based on the synchronization signal SY generated from the reference oscillation signal MCK having the free-running oscillation frequency. A rate image signal DVb is generated. In addition, when the reference synchronization signal SYref is supplied to the camera control device 40 and an image signal synchronized with the reference synchronization signal SYref is generated by the imaging device 10, the reference synchronization signal SYref is delayed after compensation by the line memory 422, and then imaged. Supply to device 10. The imaging apparatus 10 takes out the supplied reference synchronization signal SYref by the synchronization separation unit 181 and supplies it to the phase comparison unit 183 via the switch 182. By controlling the frequency of the reference oscillation signal MCK so that the phase difference between the reference synchronization signal SYref and the synchronization signal SY generated by the signal generator 185 is eliminated, the operation of the imaging device 10 is synchronized with the reference synchronization signal SYref. It can be carried out.

  Based on the frame rate setting signal RSF from the user interface unit 21, the control unit 20 uses the frame rate (imaging frame rate) of the imaging signal Spa generated by the imaging unit 111 and the frame addition processing unit 114 as described above. Switch the number of added frames. For example, as shown in FIG. 2, when the frame rate (variable speed frame rate) FRc of the variable speed frame rate captured image is set within the range of “60P ≧ FRc> 30P” by the frame rate setting signal RSF, The number FA is set to “1”, and the imaging frame rate FRp is made equal to the variable frame rate FRc. When the variable frame rate FRc is set within the range of “30P ≧ FRc> 20P”, the number of added frames FA is set to “2”, and the imaging frame rate FRp is set to twice the variable frame rate FRc. When the variable frame rate FRc is set within the range of “20P ≧ FRc> 15P”, the number of added frames FA is set to “3”, and the imaging frame rate FRp is set to three times the variable frame rate FRc. Similarly, the imaging frame rate FRp and the number of added frames FA are switched.

  FIG. 3 is a diagram for explaining the operation of generating the image signal DVb. For example, when the variable frame rate FRc is “18P”, the imaging frame rate is “54P” and the number of added frames is “3”. 3A is a frame of the image signal DVa, FIG. 3B is an operation of the RAM-1 constituting the frame addition processing unit 114, FIG. 3C is an operation of the RAM-2, FIG. 3D is an operation of the RAM-3, and FIG. A frame of the signal DVb is shown. The output frame rate, which is the frame rate of the image signal DVb, is set to, for example, “60P” in accordance with the device to which the image signal DVb is supplied.

  At the time point t1 when the frame “0f” of the image signal DVa starts, the frame addition processing unit 114 sets, for example, RAM-1 as the writing RAM, and stores the image signal DVa of the frame “0f” in the writing RAM.

  When the frame start timing of the image signal DVb is reached at time t2, since the addition of the image signals of 3 frames is not completed, the image signal DVb is a blank frame.

  At time t3, which is the timing at which the frame “0f” of the image signal DVa ends and the frame “1f” starts, the RAM-1 in which the image signal of the frame “0f” is stored is designated as the internal read RAM and written. The RAM is changed from RAM-1 to, for example, RAM-2. Further, the signal recorded in the internal read RAM, that is, the signal of the frame “0f” stored in the RAM-1 is read, and the image signal DVa of the frame “1f” is added to the signal by the adder and written. It memorize | stores in RAM-2 which is RAM.

  At time t4 when the frame “1f” of the image signal DVa ends and the frame “2f” starts, the frame “0f” and the frame “1f” are added to generate an addition signal of 3 frames. The RAM-2 in which the signal is written is designated as the internal read RAM. Further, the write RAM is changed from RAM-2 to, for example, RAM-3. Further, the signal recorded in the internal read RAM, that is, the signal stored in the RAM-2 is read, and the image signal DVa of the frame “2f” is added to this signal by the adder, and the RAM- Remember to 3

  At time t5 when the frame “2f” of the image signal DVa ends and the frame “3f” starts, the generation of the 3-frame addition signal obtained by adding the image signals DVa for 3 frames is completed. The RAM-3 in which the 3-frame addition signal is stored is designated as the external read RAM. Also, the RAM-1 is set as the writing RAM, and the image signal DVa of the frame “3f” is stored in the writing RAM.

  When the frame start timing of the image signal DVb is reached after the generation of the 3-frame addition signal, for example, when the frame start timing of the image signal DVb is reached at the time t6, the 3-frame addition signal is read from the external read RAM and this readout is performed. The signal level of the obtained signal is multiplied by “1/3” and output as an image signal DVb. Further, a frame obtained by reading the 3-frame addition signal from the external read RAM and generating the image signal DVb is set as a valid frame. The frame start timing of the image signal DVb is reached when the writing of the three-frame addition signal to the RAM is not completed or when the reading of the three-frame addition signal for which writing has been completed is completed. In this case, the image signal DVb of the previous frame is repeatedly used, and this frame is set as an invalid frame. In this case, in the image signal DVb, a blank frame is not provided between the image signals of the captured images of each frame. When a blank frame is provided, this blank frame is an invalid frame.

  Similarly, the RAM-1 to RAM-3 and an adder are used to add 3 frames of the image signal DVa to generate a 3-frame addition signal, and this 3-frame addition signal is generated at the frame start timing of the image signal DVb. By reading out, it is possible to obtain an image signal DVb having an output frame rate in which valid frames are included at a variable frame rate FRc. That is, as shown in FIG. 3E, an image signal DVb having an output frame rate “60P” corresponding to an external device and including a valid captured image at a desired variable speed frame rate “18P” can be generated. . FIG. 3F is a flag EF indicating whether the frame of the image signal DVb is a valid frame or an invalid frame.

  Next, a case will be described in which imaging is performed at a variable frame rate and the image signal DVb of the obtained variable frame rate captured image is recorded on the recording medium 60 by the recording / reproducing apparatus 50. In this case, a command for starting recording of a captured image is supplied as communication information RMw from the control unit 20 to the recording / reproducing device 50 constituting the controlled device. The control unit 55 of the recording / reproducing device 50 controls the recording processing unit 51 and the driving unit 57 based on the communication information RMw to select an image signal of an effective frame indicated by the flag EF from the image signal DVb. Based on the selected image signal, a recording signal WS is generated and supplied to the recording head 52W, and a variable-speed frame rate captured image is recorded on the recording medium 60. Further, the image signal DVb is selected by the signal selector 43 of the camera control device 40 constituting the controlled device and is output as the image signal DVm for image confirmation.

  For example, when an operation for displaying a captured image recorded in the recording medium 60 on a monitor device is performed, the control unit 20 causes the signal selector 152 to select the image signal DVr by the selection signal CSb. Further, when displaying the captured image with the electronic viewfinder, the signal selector 151 is made to select the image signal DVb by the selection signal CSa. In addition, the control unit 20 supplies a command for starting reproduction of the captured image as communication information RMw to the control unit 55 of the recording / reproducing apparatus 50. Further, the image signal DVr is selected by the signal selector 43 of the camera control device 40 based on the communication information RMw and is output as the image signal DVm for image confirmation. Further, the control unit 20 causes the VCO 184 to self-run in response to the supply of the image signal DVr from the recording / reproducing device 50. For example, when a command for starting reproduction of a captured image is supplied as communication information RMw to the recording / reproducing apparatus, or an image signal DVr used for displaying an image on the monitor apparatus is supplied, the image signal DVr and the electronic view are displayed. When the frame rate of the image signal DVb used for displaying an image on the finder is different, the switch 182 is turned off and the VCO 184 is caused to self-run. Note that the image signal DVr is supplied and the difference between the frame rates of the image signal DVr and the image signal DVb is detected by communication between the control unit 20 and the control unit 55 of the recording / reproducing apparatus 50 or by the synchronization separation unit 181. This can be done by determining whether or not the synchronization signal has been separated and the frame rate of the separated synchronization signal.

  The control unit 55 controls the reproduction processing unit 53 and the driving unit 57 based on the communication information RMw, reads out a signal recorded on the recording medium 60 by the reproduction head 52R, and supplies the signal to the reproduction processing unit 53. The image signal DVr obtained at 53 is supplied to the imaging device 10 via the camera control device 40. At this time, the switch 442 of the camera control device 40 is turned off because the image signal DVr is supplied to the imaging device 10, and the VCO 444 is in a free-running state. For this reason, the delay of the image signal DVr generated in the transmission path 30 is compensated by the line memory 422.

  The imaging apparatus 10 selects the supplied image signal DVr with the signal selector 152 and supplies it to the signal output unit 153. The signal output unit 153 supplies the supplied image signal DVr to the monitor device as a signal having a format corresponding to the monitor device. In this way, the captured image recorded on the recording medium 60 can be displayed on the screen of the monitor device.

  Even if the image signal DVr is supplied, since the switch 182 is turned off and the VCO 184 is in a self-running state, the imaging device 10 does not operate in synchronization with the image signal DVr. An image signal DVb of a variable-speed frame rate captured image having a different frame rate can be generated. Furthermore, if this image signal DVb is selected by the signal selector 151 and supplied to the electronic viewfinder, a variable frame rate captured image can be displayed along with the captured image recorded on the recording medium 60.

  Here, for example, when an effective frame image signal is selected from the image signal DVb having an output frame rate of “60P” and recorded, and the recorded image signal is reproduced at “24P”, a variable frame rate is obtained. When the image is captured with FRc of “24P”, the speed of movement of the subject in the reproduced image becomes equal to that of the actual subject. When the variable frame rate FRc is set to be higher than “24P” and the image is captured and reproduced at “24P”, the speed of movement of the subject in the reproduced image becomes low, and the variable frame rate FRc is set to “24P”. If the image is captured at a lower setting and reproduced at “24P”, the speed of movement of the subject in the reproduced image becomes high, and the subject is displayed on the screen of the monitor device in accordance with the frame rate setting signal RSF. An image with variable speed is displayed. In addition, an image being captured by the imaging apparatus 10 is displayed on the electronic viewfinder.

  Thus, even when the frame rates of the image signal DVb and the image signal DVr are different, the image signal DVb of the variable-speed frame rate captured image is generated while displaying the reproduced image based on the image signal DVr on the monitor device. Thus, a variable speed frame rate captured image based on the image signal DVb can be displayed on the electronic viewfinder. For this reason, when checking the recorded captured image on the monitor device, for example, image frame alignment or focus adjustment is performed using the variable-speed frame rate captured image displayed on the electronic viewfinder. be able to.

  Further, if the image signal DVr is selected by the signal selector 151 and the image signal DVb is selected by the signal selector 152, the captured image recorded on the recording medium can be displayed on the electronic viewfinder, and the captured image of the variable frame rate can be displayed. It can also be displayed on a monitor device.

  Next, the camera control device 40 or the recording / reproducing device 50 is used as a control device, and the user interface unit 56 provided in the recording / reproducing device 50 is operated to change the frame rate of the variable-speed frame rate captured image. A case where the captured image recorded in the recording medium 60 is confirmed will be described.

  The control unit 55 controls the operations of the recording processing unit 51, the reproduction processing unit 53, and the driving unit 57 based on the operation signal PSb from the user interface unit 56, and an image signal of an effective frame from the supplied image signal DVb. Is recorded on the recording medium 60. Further, the signal recorded on the recording medium 60 is read and the image signal DVr is supplied to the imaging device 10. Further, when an operation for changing the frame rate of the captured image is performed, communication information RMc indicating the frame rate set by this operation is supplied to the control unit 20 of the imaging device 10. Further, the setting information CP of the image displayed on the electronic viewfinder or the monitor device can be supplied to the control unit 20 as the communication information RMc.

  The control unit 20 controls the frame rate of the imaging signal Spa and the number of added frames FA in the frame addition processing unit 114 so that the frame rate of the captured image becomes the set frame rate indicated by the communication information RMc. When the setting information CP for the image to be displayed is supplied, the selection signals CSa and CSb are generated based on the setting information CP, and the signal selection operations of the signal selectors 151 and 152 are controlled. Further, when a reproducing operation is performed in the recording / reproducing apparatus 50, the VCO 184 of the synchronizing signal generation unit 18 is caused to self-run in response to supplying the image signal DVr to the imaging apparatus 10 to generate a synchronizing signal. For example, when the image signal DVr is supplied to the imaging device 10 and the frame rate of the image signal DVr is different from the image signal DVb supplied from the imaging device 10, the switch 182 is turned off from the control unit 20 by the communication information RMC. , VCO 184 is self-propelled.

  As described above, the operation of the imaging device 10 is controlled according to the operation on the recording / reproducing device 50 side, and the variable speed frame rate captured image is displayed when the captured image recorded on the recording medium 60 is displayed. Can be made.

  In the above-described imaging system, the camera control device 40 and the recording / reproducing device 50 are used as control devices for controlling the imaging device 10, but the imaging device 10 and the recording / reproducing device 50 are integrated to form an imaging system. It is good as a thing. The configuration in this case is shown in FIG. 4, parts corresponding to those in FIG. 1 are denoted by the same reference numerals, and detailed description thereof is omitted.

  The image signal DVb output from the frame addition processing unit 114 is supplied to the signal selectors 151 and 152 of the monitor output unit 15 and the recording processing unit 51. The image signal DVr output from the reproduction processing unit 53 is supplied to the signal selectors 151 and 152.

  The reference synchronization signal SYref from the external device is supplied to the phase comparison unit 183 via the switch 182.

  Here, the operation signal PSa or the operation signal PSb for displaying the captured image recorded in the recording medium 60 on one of the electronic viewfinder and the monitor device and displaying the image captured by the imaging device 10 on the other side is the user. When supplied from the interface unit 21 or the user interface unit 56, as described above, the operation signal PSa or the selection signals CSa and CSb corresponding to the operation signal PSb are generated by the control unit 20 and supplied to the signal selectors 151 and 152. The image signal to be supplied to the electronic viewfinder or monitor device is selected. Further, when the image signal DVb synchronized with the reference synchronization signal SYref is generated, the switch 182 is turned on by the switch control signal CW from the control unit 20 to synchronize the VCO 184 with the reference synchronization signal SYref. Furthermore, when displaying the captured image recorded on the recording medium 60, the switch 182 is turned off by the switch control signal CW from the control unit 20 and the VCO 184 is set in the free-running state, whereby the free-running frequency of the VCO 184 is obtained. It is possible to generate an image signal DVb having a frame rate according to the above. When the control unit 55 and the user interface unit 56 are not provided in the recording / reproducing apparatus 50, the operation of the recording / reproducing apparatus 50 is controlled by the communication information RMw from the control unit 20.

  As described above, even when the imaging system is configured by the imaging device 10 and the recording / reproducing device 50, the reproduced image of the recording medium 60 having a frame rate different from that of the variable-speed frame rate captured image is displayed. In addition, a variable frame rate captured image can be displayed.

  As described above, the present invention can display a variable-speed frame rate captured image, for example, when displaying a playback image having a frame rate different from that of the variable-speed frame rate captured image. Etc.

It is a figure which shows the structure of an imaging system. It is a figure which shows the relationship between the addition frame number with respect to a variable frame rate, and an imaging frame rate. It is a figure for demonstrating the production | generation operation | movement of the image signal DVb. It is a figure which shows the other structure of an imaging system.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Imaging device, 11 ... Image signal production | generation part, 12, 13, 41, 45 ... Interface, 15 ... Monitor output part, 18 ... Synchronization signal production | generation part, 20, 55 ... Control unit 21, 56 ... User interface unit, 40 ... Camera control device, 42 ... Delay compensation unit, 43 ... Signal selector, 44 ... Delay compensation drive unit, 50 ... Recording / reproducing apparatus, 51... Recording processing unit, 52R ... reproducing head, 52W ... recording head, 53 ... reproducing processing unit, 57 ... driving unit, 60 ... recording medium, 111. ··· Image pickup unit, 112 ··· Driving unit, 113 ··· Image pickup signal processing unit, 114 ··· Frame addition processing unit, 151 and 152 ··· signal selector, 153 ··· Signal output unit, 181 ··· .Synchronous separation unit, 182, 442. Switch, 183,443 ... phase comparator, 184,444 ... voltage-controlled oscillator (VCO), 185,445 ··· signal generator, 421, 422 ... line memory

Claims (14)

Image signal generation means for generating a first image signal of a variable-speed frame rate captured image;
Synchronization signal generating means for generating a synchronization signal used for generating the first image signal;
The frame rate of the image signal generation unit and the operation of the synchronization signal generation unit are controlled, and the synchronization is performed according to the fact that the frame rate of the second image signal input from the outside is different from the frame rate of the first image signal. Control means for causing the signal generating means to self-run to generate a synchronization signal;
That an imaging device having a monitor output means for outputting the second image signal as a monitor image signal. Wherein, when said reference synchronizing signal from the outside instead of the second image signal is supplied, the synchronizing signal generating means said reference synchronized imaging device of the signal Ru is operated in synchronization with 請 Motomeko 1 wherein. It said control means, the image pickup apparatus 請 Motomeko 1, wherein you detect that the second image signal is supplied by the communication information from the outside. An imaging device and a controlled device controlled by the imaging device ,
The imaging device
Image signal generation means for generating a first image signal of a variable-speed frame rate captured image;
Synchronization signal generating means for generating a synchronization signal for generating the first image signal and supplying the same to the image signal generating means;
The frame rate of the image signal generation means, the operation of the synchronization signal generation means and the controlled device are controlled, and the frame rate of the second image signal input from the controlled device to the imaging device is the first image signal. A control means for generating a synchronization signal by causing the synchronization signal generation means to self-run according to the difference in the frame rate;
That an imaging device having a monitor output means for outputting the second image signal as a monitor image signal. Wherein, reference synchronization when a signal from the controlled device is supplied to the imaging device, the synchronization signal generating means said reference synchronizing imaging device signal 請 Motomeko 4, wherein Ru is operated in synchronization. When the controlled device has a delay compensation unit that compensates for a delay caused by communication with the imaging device, and a delay compensation drive unit that generates a drive signal for driving the delay compensation unit,
When the control means supplies the second image signal from the controlled apparatus to the imaging apparatus, the control means drives the delay compensation driving means of the controlled apparatus to run in accordance with the frame rate of the second image signal. imaging device 請 Motomeko 4 wherein Ru to produce a signal. Wherein, when to supply the reference synchronizing signal to the imaging device from the controlled device, the controlled device delay compensation driving means and said reference synchronizing signal to synchronize the driving signal according 請 Motomeko 6 Ru to generate in the Imaging device. Wherein, said controlled second image signal capturing apparatus 請 Motomeko 4, wherein that control the frame rate of supplied from the device. It said control means, the image pickup apparatus 請 Motomeko 4 wherein you detect that the second image signal is supplied by the communication information from the outside. An image signal generation unit that generates a first image signal of a variable-speed frame rate captured image, an imaging device that includes a synchronization signal generation unit that generates a synchronization signal for operating the image signal generation unit, and the imaging device It consists of a control device to control ,
The control device includes a control unit that controls the frame rate of the image signal generation unit of the imaging device and the operation of the synchronization signal generation unit,
The control means causes the synchronization signal generation means of the imaging apparatus to self-run in response to the frame rate of the second image signal input to the imaging apparatus being different from the frame rate of the first image signal, and outputs the synchronization signal. Generated,
The imaging device, that control device having a monitor output means for outputting the second image signal as a monitor image signal. Wherein, when said reference synchronizing signal in place of the second image signal is supplied to the imaging device, the imaging apparatus of a synchronous signal generating means said reference synchronizing signal Ru is operated in synchronization with 請 Motomeko 10 wherein Control device. Delay compensation means for compensating for a delay in communication with the imaging device;
A delay compensation driving means for generating a drive signal for driving the delay compensation means;
Wherein, when supplying the second image signal to the image pickup device, 請 Motomeko 10 the delay compensation drive means Ru to produce a drive signal corresponding to the frame rate of the second image signal by self The control device described. Wherein, when said in place of the second image signal providing a reference synchronizing signal to the imaging device, wherein the delay compensation driving means and said reference synchronizing signal to the 請 Motomeko 12 wherein Ru to generate a drive signal synchronized with Control device. Image signal generation means for generating a first image signal of a variable-speed frame rate captured image;
Synchronization signal generating means for generating a synchronization signal for generating the first image signal and supplying the same to the image signal generating means;
Recording / reproducing means for recording / reproducing the first image signal;
The frame rate of the image signal generating means, the operation of the synchronizing signal generating means and the recording / reproducing means are controlled, and the frame rate of the reproduced image signal reproduced from the recording / reproducing means is different from the frame rate of the first image signal. In response, control means for causing the synchronization signal generation means to self-run to generate a synchronization signal;
That an imaging system having a monitor output means for outputting the reproduced image signal as a monitor image signal.

Images