JP2003061113A - Image pickup device and processing method for imaging result - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup device and a processing method for the imaging result, applied to e.g. a camcorder provided with a still picture recording function that can select the operating speed of white balance adjustment so as to temporarily stop recording a moving picture and prevent a sudden color change in a reproduced image when restarting recording of a moving picture after recording the imaging result by a still picture. SOLUTION: This invention records a state of white balance adjustment when temporarily stopping recording by a moving picture and reproduces the state at restarting.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus and an image pickup result processing method, and can be applied to, for example, a camera-integrated video tape recorder having a still image recording function. The present invention, when switching the operation speed of white balance adjustment, temporarily stopping recording by moving images, recording the imaging result by still images, and then restarting recording by moving images, when temporarily stopping recording by moving images By recording the state of white balance adjustment and reproducing this state at the time of resumption, it is possible to prevent a rapid change in hue in a reproduced image.

[0002]

2. Description of the Related Art Conventionally, as a video tape recorder integrated with a camera, one having a still image recording function has been proposed.

That is, a video tape recorder with a built-in camera is used at sports events, concerts, weddings, travels, etc., and at the shooting sites of these, it may be desired to record the same scene as a still image. For this reason, in this type of camera-integrated video tape recorder, recording of a moving image is temporarily stopped by the user's operation, and the captured result can be recorded as a still image.

According to this camera-integrated video tape recorder, for example, at the wedding reception hall, after recording the state of the bride and groom as a moving image, the state of the audience seats is recorded as a still image, and the state of the bride and groom is again displayed as a moving image. It can be recorded at. In addition, after recording the full view of the venue at the athletic meet venue as a movie, you can record various aspects of your child's appearance by recording a still image up and then recording the full view again as a movie. There is.

In such a camera-integrated video tape recorder, when the image pickup result is obtained as a still image, the operation speed of white balance adjustment is increased,
High color reproducibility is ensured in a still image which is a result of image pickup. On the other hand, when recording the captured image as a moving image, the operation speed of white balance adjustment is slowed down compared to the case of a still image, so that the white balance of the captured image does not change frequently. There is.

[0006]

In such a camera-integrated video tape recorder, however, after recording the imaging result as a still image, the imaging result as a moving image is recorded again. In this case, in the video tape recorder with a built-in camera, the operation speed of white balance adjustment is increased to capture a still image while the white balance adjustment is being performed at a slow operation speed to capture a moving image. After recording the result, the white balance adjustment is performed at the original slow operation speed, and the capturing of the moving image is restarted.

As a result, when a still image is picked up in this way, in the reproduced image obtained by reproducing the magnetic tape, the white balance may suddenly change before and after the still image is picked up. Had a problem that the color tone changed abruptly in the reproduced image.

The present invention has been made in consideration of the above points, and in the case of temporarily stopping recording of a moving image and capturing a still image, an image capturing apparatus capable of preventing a rapid change in color tone in a reproduced image. And a method of processing the imaging result.

[0009]

In order to solve such a problem, the invention of claim 1 is applied to an image pickup apparatus, and the white balance control means operates the still image recording means and the moving image recording means by the recording control means. Interlocking with the switching of
When the operating speed of the white balance adjusting means is switched and the recording of the moving image by the recording control means is temporarily stopped, the set value of the white balance adjusting means is recorded, and when the moving image recording is restarted, the recorded set value is changed. The white balance adjusting means is operated with the reference.

Further, according to the invention of claim 4, it is applied to a method of processing an image pickup result, and the operation speed of white balance adjustment is switched between recording the image pickup result of a still image and recording the image pickup result of a still image. When the recording of the captured result of the moving image is temporarily stopped, the set value of the white balance adjustment is recorded, and when the recording of the captured result of the moving image is restarted, the set value of the white balance adjustment is set to the recorded set value as a reference. And set it.

According to the first aspect of the invention, the white balance control means switches the operation speed of the white balance adjustment means in association with the switching of the operations of the still image recording means and the moving image recording means by the recording control means, and records. When the recording of the moving image by the control means is temporarily stopped, the set value of the white balance adjusting means is recorded, and when the recording of the moving image is restarted, the white balance adjusting means is operated based on the recorded set value. Thus, the white balance adjusting means controlled by the white balance controlling means corrects the signal level of the imaging result with the same set value at the time when the recording of the moving image is temporarily stopped and when the recording of the moving image is restarted. Therefore, the white balance can be adjusted, and the continuity of the white balance adjustment can be ensured. This makes it possible to effectively avoid a sudden change in hue at the time of restarting recording when the recording of a moving image that has been temporarily stopped and restarted in this way is reproduced.

Thus, according to the fourth aspect of the present invention, there is provided a method of processing an image pickup result capable of preventing a rapid change in color tone in a reproduced image when recording a moving image is temporarily stopped and a still image is picked up. Obtainable.

[0013]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below in detail with reference to the drawings as appropriate.

(1) Configuration of Embodiment FIG. 2 is a block diagram showing a camera-integrated video tape recorder according to an embodiment of the present invention.

This camera-integrated video tape recorder 1
In, the lens 2 is a CCD (Charge Coupled Devic
e) The incident light is focused on the imaging surface of the solid-state imaging device 3. CC
The D solid-state image pickup device 3 is a single-plate color image pickup device in which color filters of three primary colors or complementary colors are attached to the image pickup surface, and outputs the image pickup result of each pixel in raster scan order. The signal processing circuit 4 is composed of a sample hold circuit, an AGC circuit, etc., and sequentially samples and holds the image pickup result output from the CCD solid-state image pickup device 3 at the timing corresponding to the pixel, so that the red, green, and Separate the blue color signal. Further subsequently, the signal level of each color signal is corrected by the AGC circuit. When a complementary color system color filter is applied to the CCD solid-state image sensor 3, a complementary color system color signal is generated by sample hold, and then the signal level is corrected by the AGC to generate red, green, and blue color signals. It is adapted to generate or generate color signals of red, green and blue and correct the signal level by AGC.

Analog-to-digital conversion circuit (A / D) 5
Performs analog-to-digital conversion processing on the color signals of red, green and blue thus obtained to generate digital color signals R, G and B, respectively.

The white balance amplifier 6 corrects the signal levels of the digital color signals R, G, B by the gain instructed by the camera controller 7, thereby white-balance adjusting the digital color signals R, G, B. And output.

In the camera-integrated video tape recorder 1, the digital color signals R, G, B output from the white balance amplifier 6 are gamma-corrected, knee-corrected, etc., and then input to the matrix circuit 8 to be input to the matrix circuit 8.
Performs a matrix calculation process on these digital color signals R, G, B to generate and output a luminance signal Y and color difference signals RY, BY by digital signals.

The moving picture recording / still picture recording switching circuit 9 processes the luminance signal Y and the color difference signals RY and BY in a predetermined format, and the moving picture recording medium 1 which is a magnetic tape.
0, it records on the still image recording medium 11 which is a memory card. That is, the moving image recording / still image recording switching circuit 9, when recording an image pickup result by a moving image, sequentially obtains the luminance signal Y, the color difference signals RY, and BY by MPEG (Mo
ving Picture Experts Group) data is compressed and recorded on the moving image recording medium 10. In addition, when the user instructs to record a still image by operating an operator (not shown), the recording of such a moving image is temporarily stopped,
Luminance signal Y and color difference signal R-
After accumulating Y and BY for one frame in the memory, for example, JPEG (Joint Photographic Coding Experts Group)
Data is compressed according to the format (1) and recorded on the still image recording medium 11.

The camera controller 7 is a controller for controlling the operation of the video tape recorder 1 with a built-in camera, and calculates the correction amount of the color temperature by the white balance adjustment as the set value of the white balance by monitoring the image pickup result. Further, the camera controller 7 controls the gain of the white balance amplifier 6 in accordance with the set value, thereby correcting the color temperature of the image pickup result by the set value and adjusting the white balance of the image pickup result.

The camera controller 7 monitors the processing in the moving image recording / still image recording switching circuit 9 and executes this white balance adjustment processing. Is recorded, the image pickup result is monitored at shorter time intervals and the gain of the white balance amplifier 6 is switched, as compared with the case where the image pickup result is recorded as a moving image. As a result, the camera controller 7 records the result of capturing a still image,
The operation speed of the white balance adjustment is switched between recording the image pickup result by the moving image, and when recording the image pickup result by the still image, the white balance adjustment is performed at a high speed. As a result, the camera-integrated video tape recorder should not record unstable imaging results due to frequent changes in white balance during movie recording, and should record imaging results by optimal white balance adjustment during still image recording. Has been done.

Further, the camera controller 7 executes the processing procedure shown in FIG. 1 in a predetermined cycle to set the setting value of the white balance adjustment as white balance data for restarting the moving image recording when the recording of the moving image is temporarily stopped. When recording and restarting recording with a moving image, the white balance is adjusted with the white balance data for restarting the recording of the moving image. As a result, the camera controller 7 ensures the continuity of white balance adjustment before and after recording with a still image, and prevents abrupt color change in reproduced images of moving images before and after this.

Further, after temporarily stopping the recording by the moving image,
If the period until resuming the recording by the moving image becomes a certain time or more, the white balance data for resuming the moving image recording recorded in the memory is updated with the set value of the white balance adjustment during still image recording, When resuming recording using a moving image, white balance adjustment is performed using this updated white balance data. That is, when a still image is recorded for a long time, it is considered that the subject itself is different before and after the still image is recorded.In this case, the white balance adjustment when the recording of the moving image is temporarily stopped is performed. If the image pickup result is corrected, the color tone of the image pickup result is rather unnatural. As a result, in this case, the camera controller 7 updates the recording of the memory with the white balance setting value at the time of recording the still image, and restarts the recording of the moving image with the updated setting value.

That is, the camera controller 7 proceeds from step SP1 to step SP2, and determines whether or not the current operation mode is an operation mode (still image recording mode) for recording an image pickup result of a still image. Note that this determination processing is executed here based on the monitoring result of the moving image recording / still image recording switching circuit 9. If a negative result is obtained here, the camera controller 7 moves to step SP3 and determines whether the operation mode of the camera-integrated video tape recorder 1 was the still image recording mode at the time of executing the immediately preceding processing procedure. to decide.

If a negative result is obtained here, in this case,
Since the camera-integrated video tape recorder 1 continuously records the imaging result as a moving image, the process proceeds to step SP4, and the gain setting period of the white balance amplifier 6 is set to the period at the time of moving image recording. Further, in subsequent step SP5, it is determined whether or not the timing for setting the gain of the white balance amplifier 6 has come according to the gain setting cycle of the white balance amplifier 6 thus set. If it is the timing of gain setting here,
The camera controller 7 determines the setting value of the white balance adjustment from the monitoring result of the imaging result, further calculates the gain of the white balance amplifier 6 from this setting value, and the amplification of the imaging result by this gain is performed by the white balance amplifier 6
After instructing, the process moves to step SP6 and this processing procedure is ended. If the gain setting timing has not come yet in step SP5, the gain of the white balance amplifier 6 is not set, and the process proceeds to step SP6 to end this processing procedure.

On the other hand, when the user gives an instruction to record a still image while the moving image is being recorded in this manner, the camera controller 7 obtains a positive result in step SP2, and thus step SP2 To Step SP7. Here, the camera controller 7 determines whether or not the operation mode of the camera-integrated video tape recorder 1 was the still image recording mode at the time of executing this processing procedure immediately before.

Immediately after the user gives an instruction to record a still image, a negative result is obtained in step SP7, so that the camera controller 7 moves from step SP7 to step SP8 and has a built-in function that functions as a timer. After resetting the counter, step SP
Go to 9. Here, the camera controller 7 records the set value of the white balance adjustment in the memory as the white balance data for restarting the moving image recording.

Subsequently, the camera controller 7 moves to step SP10 and increments the counter reset in step SP8. Further continuing step SP11
In, the gain setting cycle of the white balance amplifier 6 is set to the cycle for recording a still image, and then the process proceeds to step SP5. As a result, in this case, the camera controller 7 determines in step SP5 whether or not the timing for setting the gain of the white balance amplifier 6 has come according to the gain setting cycle of the white balance amplifier 6 thus set, and here the gain setting is performed. If the timing is, the gain of the white balance amplifier 6 is determined from the monitoring result of the imaging result, and the white balance amplifier 6 is instructed to amplify the imaging result by this gain, and then the step SP6
Then, the processing procedure is finished. Also step SP5
If the timing for gain setting is not reached, the gain of the white balance amplifier 6 is not set, and the process proceeds to step SP6 to end this processing procedure.

On the other hand, after the recording of the still image is started in this way, a positive result is obtained in step SP7, so that the camera controller 7 determines in step S7.
The process moves from P6 to step SP12. Here, the camera controller 7 determines whether or not the count value of the counter is above a certain value. Based on this judgment, the camera controller 7
Judges whether or not a fixed time has elapsed after the start of recording the imaging result as a still image. If a negative result is obtained here, the process proceeds to step SP10 and the counter is counted up. Therefore, in this case, the camera controller 7
Is a cycle of white balance adjustment when recording a still image, and the gain of the white balance amplifier 6 is set by calculating the gain from the imaging result.

On the other hand, when the recording of the imaging result of the still image is finished and the recording of the imaging result of the moving image is started before the recording of the still image is started for a predetermined time or more, the camera controller In step 7, since a positive result is obtained in step SP3, the process proceeds from step SP3 to step SP13. Here, the camera controller 7 loads the restarting white balance data recorded in the memory in step SP9,
The set value based on this white balance data is used as the set value for white balance adjustment.

As a result, the camera controller 7 sets the gain setting cycle of the white balance amplifier 6 to the cycle for recording a moving image in the subsequent step SP4. In the subsequent step SP5, it is determined whether or not it is the timing for setting the gain of the white balance amplifier 6, and if it is the timing for setting the gain here, step SP1
The gain of the white balance amplifier 6 is calculated by the set value set in 3, and the white balance amplifier 6 is instructed to amplify the image pickup result by this gain, and then the process proceeds to step SP6 to end this processing procedure. If the timing for gain setting has not come at step SP5,
Without setting the gain of the white balance amplifier 6,
The processing moves to step SP6 and the processing procedure is ended. As a result, the camera controller 7 ensures the continuity of the white balance adjustment before and after the recording of the imaging result of the still image, and prevents the abrupt change of the hue in the reproduced image.

On the other hand, when the recording of the still image is started and a predetermined time or more has elapsed, the camera controller 7
When a positive result is obtained in step SP12, the process proceeds to step SP9. Here, in this case, the camera controller 7 updates the white balance data recorded in the memory with the set value at the time of still image recording, which is the setting of the current white balance adjustment, and then executes step SP.
Go to 10. As a result, when recording for a still image has started for a predetermined time or more, the white balance data is sequentially updated with the setting value of the white balance adjustment at the time of recording a still image. The white balance adjustment is instructed by the white balance data updated in this way. As a result, in this case, the camera controller 7 ensures the continuity of white balance adjustment and starts recording the imaging result as a moving image between the case where the imaging result is recorded by the immediately preceding still image. ing.

(2) Operation of the Embodiment With the above-described configuration, in the camera-integrated video tape recorder 1, the image pickup result obtained from the CCD solid-state image pickup device 3 is processed by the signal processing circuit 4 to generate a color signal. After this color signal is analog-digital converted by the analog-digital conversion circuit 5, the white balance amplifier 6 corrects the signal level to adjust the white balance. In the image pickup result, the color signal output from the white balance amplifier 6 is converted into a luminance signal and a color difference signal by the matrix circuit 8, and the data is compressed by the moving image recording / still image recording switching circuit 9 in a format suitable for recording a moving image. And is recorded on the moving image recording medium 10.

Further, in this state, when the user instructs the recording of the image pickup result by the still image by the operation of the operator,
Recording of a moving image by the moving image recording medium 10 is temporarily stopped, and the image pickup result is data-compressed by the moving image recording / still image recording switching circuit 9 in a format suitable for recording a still image, and is recorded in the still image recording medium 11.

In the camera-integrated video tape recorder 1, when the operation is switched between recording of the imaged result of a moving image and recording of the imaged result of a still image in this way,
In conjunction with these switching, the gain setting cycle of the white balance amplifier 6 is switched by the camera controller 7, whereby the white balance adjustment of the imaging result is performed at the operation speed suitable for recording the still image and the moving image, and the recording medium 10 is adjusted. And 11 are recorded.

That is, when the image pickup result is recorded as a still image, the gain setting period of the white balance amplifier 6 is switched to a short period, whereby the operation speed of white balance adjustment is increased, and the still image which is the image pickup result is changed. In order to ensure high color reproducibility. On the other hand, in the case of recording the image pickup result as a moving image, the gain setting period of the white balance amplifier 6 is switched to a longer period, thereby lowering the operation speed of white balance adjustment as compared with the case of a still image. , The white balance of the imaging result is prevented from frequently changing.

When the recording of the image pickup result by the moving image is temporarily stopped and the recording of the image pickup result by the still image is started,
The setting value of the white balance adjustment up to that time is recorded in the memory, and when the recording of the imaging result of the still image is finished and the recording of the imaging result of the moving image is started within the range of the fixed time or less, it is recorded in this memory. The white balance adjustment state at the time of the temporary suspension is reproduced depending on the white balance adjustment setting value. As a result, the camera-integrated video tape recorder 1 can ensure the continuity of the white balance adjustment before and after recording the image pickup result as a still image, thereby effectively avoiding a sharp change in the hue before and after this. be able to.

On the other hand, when the recording of the image pickup result of the still image has passed for a certain time or more, in this case, it is considered that the subject itself is often different before and after the recording of the image pickup result of the still image. Even when the subject itself is not different as described above, it is considered that the angle of view and the like change in most cases before and after the recording of the imaging result of the still image. As a result, in such a case, even if the state of white balance adjustment immediately before recording the image pickup result as a still image is reproduced, a sense of discomfort occurs in the reproduced image.

As a result, in this case, the video tape recorder 1 with a built-in camera, in such a case, by continuing to update the recording of the memory with the set value of the white balance adjustment at the time of recording the still image, the result of the image capturing of the still image can be obtained. When the recording is finished and the recording of the moving image capturing result is started, the recording of the moving image capturing result is performed according to the white balance adjustment state at the time of recording the still image capturing result, which is the immediately preceding white balance adjustment state. Is started.
As a result, in this case, the camera-integrated video tape recorder 1 ensures the continuity of white balance adjustment between the immediately preceding case of recording the imaging result with the still image and starts recording the imaging result with the moving image. However, the discomfort in the reproduced image is effectively avoided.

(3) Effects of the Embodiments According to the above configuration, the operation speed of the white balance adjustment is switched, the recording of the moving image is temporarily stopped, the captured result is recorded as the still image, and then the recording of the moving image is performed. When resuming recording, the state of white balance adjustment when recording with a moving image is temporarily stopped is recorded, and by resuming this state at the time of resuming, it is possible to prevent a sudden change in hue in a reproduced image.

In this process, the white balance adjusting means is operated based on the recorded correction amount in accordance with the period from the temporary stop of the moving image recording to the restart of the moving image recording, whereby the still image If the recording is performed for a long time, etc., adjust the white balance according to the settings for recording with a still image and start recording a movie.
It is possible to effectively avoid discomfort in the reproduced image.

(4) Other Embodiments In the above-described embodiment, the recording time of the image pickup result of the still image is judged based on the fixed judgment reference time, and the recording of the image pickup result of the still image is within the fixed time. In the case of, the case of reproducing the state of the white balance adjustment at the time of the stopped moving image recording was described, but the present invention is not limited to this, and for example, depending on the change in the color temperature of the imaging result up to that time,
You may make it switch this judgment reference time suitably.

In the above embodiment, the case where the present invention is applied when the recording of the image pickup result is simply switched between the moving image and the still image and the speed of white balance adjustment is switched at this time has been described. The invention is not limited to this. For example, when capturing a still image by synchronizing with the flash light emission and recording the still image, it is necessary to deal with the change in the color temperature of the subject that changes due to the flash light emission. In some cases, the setting value of white balance adjustment may be changed when recording a still image, and the present invention can be applied to such a case. In this case, the process of resuming the recording of the moving image by the white balance adjustment at the time of recording the still image when the recording of the image pickup result by the still image is performed for a certain time or longer as in the above-described embodiment is omitted. Is desirable.

In the above embodiment, the case where the image pickup result is recorded in different recording media depending on the still image and the moving image has been described, but the present invention is not limited to this, and the still image and the moving image are recorded on the same recording medium. The present invention can be widely applied when recording the imaging result, and further when recording on various recording media other than the magnetic tape and the memory card.

Further, in the above-mentioned embodiments, the case where the present invention is applied to the camera-integrated video tape recorder which is the image pickup apparatus has been described, but the present invention is not limited to this, and various image pickup apparatuses, and further the image pickup apparatus. The present invention can be widely applied to various image recording devices for recording the image pickup result by, and various processing programs.

[0046]

As described above, according to the present invention, the operation speed of white balance adjustment is switched, the recording of a moving image is temporarily stopped, and the image pickup result is recorded as a still image.
When resuming video recording, record the white balance adjustment status when video recording is temporarily stopped.
By recreating this state at the time of restart, it is possible to prevent a rapid change in the color tone in the reproduced image.

[Brief description of drawings]

FIG. 1 is a flowchart showing a processing procedure of a camera controller in the camera-integrated video tape recorder shown in FIG.

FIG. 2 is a block diagram showing a camera-integrated video tape recorder according to an embodiment of the present invention.

[Explanation of symbols]

1-camera integrated videotape recorder, 6-white balance amplifier, 7-camera controller, 9-
… Movie recording / still image recording switching circuit, 10 …… Movie recording medium, 11 …… Still image recording medium

Claims (4)

[Claims] 1. A white balance adjusting unit for correcting a signal level of an image pickup result obtained by an image pickup unit to adjust a white balance, and a still image recording unit for recording the image pickup result output from the white balance adjusting unit in a still image format. An image recording unit, a moving image recording unit that records the imaging result output from the white balance adjusting unit in a moving image format, and a control of the still image recording unit and the moving image recording unit to trigger the operation of a predetermined operator. And a recording control unit for temporarily stopping recording of a moving image by the moving image recording unit, recording a still image by the still image recording unit, and restarting recording of the moving image by the moving image recording unit, and the white balance adjusting unit. And a white balance control means for controlling the operation of the white balance control means, When the operation speed of the white balance adjusting means is switched in association with the switching of the operations of the still image recording means and the moving image recording means by the recording control means, and the recording of the moving image by the recording control means is temporarily stopped. An image pickup apparatus, which records the setting value of the white balance adjusting means, and operates the white balance adjusting means on the basis of the recorded setting value when restarting the recording by the moving image. 2. The white balance control means uses the recorded set value as a reference according to a period from when the recording of the moving image by the recording control means is temporarily stopped to when the recording of the moving image is restarted. The image pickup apparatus according to claim 1, wherein the white balance adjusting unit is operated. 3. The still image recording means records the imaging result on a first recording medium, and the moving image recording means records the imaging result on a second recording medium different from the first recording medium. The image pickup apparatus according to claim 1, wherein the image is recorded. 4. A method of processing an image pickup result, wherein recording of an image pickup result of a moving image is temporarily stopped, an image pickup result of a still image is recorded, and then recording of an image pickup result of a moving image is restarted. The operation speed of white balance adjustment is switched between recording and recording of the captured result of the moving image, and when the recording of the captured result of the moving image is temporarily stopped, the set value of the white balance adjustment is recorded, A method of processing an image pickup result, characterized in that, when the recording of the image pickup result is restarted, the setting of the white balance adjustment is set with reference to the recorded set value.