JP2010114857A - Imaging apparatus and imaging method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To excellently perform photographing even when a frame rate of an image to be photographed is low. <P>SOLUTION: In an imaging apparatus which displays moving image data captured and outputted by an imaging section 101 onto a display section 104, a control means 110 is provided for controlling the moving image data outputted from the imaging section 101 to individually set a value of a frame rate of a moving image to be displayed on the display section 104 and a value of a frame rate of a moving image to be recorded on a recording medium 108. By preventing trouble in which the frame rate of a captured image to be displayed on the display section 104 becomes low while a video image of a low frame rate is being captured, even while a video image of a low frame rate is being captured, an update cycle of a display screen of the display section 104 can be prevented from becoming long. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an imaging method, and more particularly to a technique suitable for use in an imaging apparatus capable of changing the number of screens captured per unit time.

  Conventionally, in movie production and the like, in order to obtain a special shooting effect, when shooting with a camera, shooting may be performed by changing the number of frames (screen, frames) to be shot per unit time, that is, the frame rate.

  For example, in general, a movie displays 24 images per second. Therefore, a slow shooting effect can be obtained by shooting an image of 25 frames or more per second during shooting and reproducing the image at 24 frames / second. On the other hand, if an image taken at a frame rate lower than 24 frames per second is played back at 24 frames / second, a quick shooting effect can be obtained.

  On the other hand, in recent years, digital video cameras capable of shooting high-definition images have become widespread due to digital signal processing technology, image sensor advancement, compression technology advancement, and the like. In such a digital video camera, the frame rate of the captured video data can be converted relatively easily. In view of this, an imaging apparatus capable of obtaining a slow or quick reproduction effect has been proposed (see, for example, Patent Document 1).

JP 2003-153054 A

  In the above-described imaging device such as a digital video camera, generally, a moving image being shot is appropriately displayed on a display unit such as an LCD panel or a viewfinder. The user can perform zoom operation and focus adjustment while viewing the captured image displayed on the display unit.

  However, as described above, when shooting a video with a low frame rate, the frame rate of the captured image displayed on the display unit is also low. When the frame rate of the image displayed on the display unit is lowered, the display screen update cycle is also increased, so that it becomes difficult for the user to adjust the angle of view and the focus while photographing, and the photographing is performed well. There was a problem that became difficult.

  In view of the above-described problems, an object of the present invention is to enable good shooting even when the frame rate of an image to be shot is low.

The imaging device of the present invention is an imaging device that displays moving image data captured and output by an imaging unit on a display unit, and displays moving image data output from the imaging unit on the display unit. It is characterized by having control means for controlling to set individually the frame rate value of the moving image and the frame rate value of the moving image to be recorded on the recording medium.
Another feature of the imaging apparatus according to the present invention is that the imaging unit, a setting unit for setting a recording frame rate of moving image data captured by the imaging unit to an arbitrary value, and a setting by the setting unit The frame rate of the moving image data output from the imaging unit is determined based on the recorded recording frame rate and the display frame rate of the moving image to be displayed on the display unit, and the moving image data is determined at the determined frame rate. Control means for controlling the imaging unit to output, first conversion means for converting the frame rate of moving image data output from the imaging unit into the display frame rate, and display by the first conversion means Display means for displaying the moving image data converted into the frame rate on the display unit, and a frame rate of the moving image data output from the first converting means. Second converting means for converting the image data into the recording frame rate, and recording means for recording the moving image data output from the second converting means on a recording medium together with management information for reproducing at a predetermined frame rate; It is characterized by providing.
Another feature of the imaging apparatus of the present invention is that an imaging unit, a setting unit that sets a recording frame rate of moving image data photographed by the imaging unit, and a frame addition number to an arbitrary value, , Based on the recording frame rate and the frame addition number set by the setting means, the sensitivity of the imaging unit, and the display frame of the moving image displayed on the display unit, the moving image data output by the imaging unit Control means for controlling the imaging unit to determine a frame rate and output moving image data at the determined frame rate, and convert the frame rate of the moving image data output from the imaging unit to the display frame rate Set by the conversion means, display means for displaying the moving image data output from the conversion means at the display frame rate, and the setting means. Frame addition means for adding a plurality of frames of moving image data output from the conversion means according to the number of frame additions to convert the frame rate of the moving image data into the recording frame rate; and the frame addition means Means for controlling the gain of the moving image data output from the recording medium, and recording means for recording the moving image data output from the gain control means on a recording medium together with management information for reproducing at a predetermined frame rate. It is characterized by that.
Another feature of the imaging apparatus of the present invention is that an imaging unit, a setting unit that sets a recording frame rate of moving image data photographed by the imaging unit, and a frame addition number to an arbitrary value, The frame rate of the moving image data output by the imaging unit is determined based on the recording frame rate and the frame addition number set by the setting unit and the sensitivity of the imaging unit, and the moving image having the determined frame rate is determined. Control means for controlling the imaging unit to output image data, conversion means for converting a frame rate of moving image data output from the imaging unit into a display frame rate, and moving image data output from the conversion means Displayed at the display frame rate, and output from the imaging unit according to the number of frame additions set by the setting unit Frame adding means for adding moving image data of several frames and converting the frame rate of the moving image data to the recording frame rate; and means for controlling the gain of moving image data output from the frame adding means; And recording means for recording the moving image data output from the gain control means on a recording medium together with management information for reproducing at a predetermined frame rate.

The imaging method of the present invention is an imaging method for displaying moving image data captured and output by an imaging unit on a display unit, wherein the moving image data output from the imaging unit is displayed on the display unit. It is characterized by having a control step of controlling to individually set the value of the frame rate of the moving image and the value of the frame rate of the moving image to be recorded on the recording medium.
Another feature of the present invention is that a setting step of setting a recording frame rate of moving image data captured by the imaging unit to an arbitrary value, a recording frame rate set in the setting step, and a display A frame rate of moving image data output from the imaging unit is determined based on a display frame rate of a moving image displayed on the unit, and the imaging unit is controlled to output moving image data at the determined frame rate A control step for converting, a first conversion step for converting a frame rate of moving image data output from the imaging unit into the display frame rate, and a moving image converted into a display frame rate in the first conversion step A display step of displaying data on the display unit; and a frame rate of moving image data output from the first conversion step. And a recording step of recording the moving image data output from the second conversion step on a recording medium together with management information for reproducing at a predetermined frame rate. It is characterized by.
Another feature of the imaging method of the present invention is that a setting step of setting a recording frame rate and a frame addition number of moving image data photographed by the imaging unit to arbitrary values, and the setting step Based on the set recording frame rate, the number of frame additions, the sensitivity of the imaging unit, and the display frame of the moving image displayed on the display unit, the frame rate of the moving image data output by the imaging unit is determined. A control step for controlling the imaging unit to output moving image data at the determined frame rate; a conversion step for converting a frame rate of moving image data output from the imaging unit into the display frame rate; A display step for displaying moving image data output from the conversion step at the display frame rate; and a frame set in the setting step. A frame addition step of adding a plurality of frames of moving image data output from the conversion step according to an arithmetic operation to convert a frame rate of the moving image data into the recording frame rate, and an output from the frame addition step And a recording step of recording the moving image data output from the gain control step on a recording medium together with management information for reproducing at a predetermined frame rate. Features.
Another feature of the imaging method of the present invention is that a setting step of setting a recording frame rate and a frame addition number of moving image data photographed by the imaging unit to arbitrary values, and the setting step Based on the set recording frame rate, the number of frames added, and the sensitivity of the imaging unit, the frame rate of the moving image data output by the imaging unit is determined, and the moving image data of the determined frame rate is output. A control step of controlling the imaging unit, a conversion step of converting a frame rate of moving image data output from the imaging unit into a display frame rate, and a moving image data output from the conversion step of the display frame rate And a plurality of frames output from the imaging unit according to the frame addition number set in the setting step. A frame adding step for adding the moving image data of the video and converting a frame rate of the moving image data to the recording frame rate, a step of controlling a gain of the moving image data output from the frame adding step, A recording step of recording the moving image data output from the gain control step on a recording medium together with management information for reproducing at a predetermined frame rate.

  According to the present invention, zoom and focus adjustment can be easily performed on a display image during shooting for obtaining a quick or slow shooting effect.

(First embodiment)
Next, embodiments of the present invention will be described with reference to the drawings.
First, the quick and slow effects according to the imaging apparatus of the present embodiment will be described with reference to FIG.
For example, in order to realize 3 × speed quick shooting, camera shooting is performed at a frame rate of 1/20 second as shown in FIG. 7A, and 1/60 second as shown in FIG. 7B. Recorded on a recording medium as video shot at a frame rate. Then, the recorded data is reproduced at a frame rate of 1/60 seconds.

  Also, in order to realize double speed slow shooting, as shown in FIG. 7C, camera shooting is performed at a frame rate of 1/120 seconds, and as shown in FIG. Recorded on a recording medium as video shot at a frame rate. The recorded data is reproduced at a frame rate of 1/60 seconds.

FIG. 1 is a block diagram showing a configuration example of a video camera 100 as an embodiment of the present invention.
The video camera 100 in FIG. 1 can capture a moving image by arbitrarily setting the number of frames (frame rate) per unit time of the moving image captured by the user. In addition, the video camera 100 sets the update period of the moving image screen displayed during shooting to a value close to the determined frame rate regardless of the frame rate of the shot moving image. Hereinafter, functions of each unit constituting the video camera 100 will be described.

  In FIG. 1, an imaging unit 101 captures a subject image and outputs moving image data. The shooting timing of the imaging unit 101 is changed by the timing control unit 109. Reference numeral 102 denotes a flag generation unit that has a function of adding a flag for identifying a specified frame in the moving image data output from the imaging unit 101. Reference numeral 103 denotes a first conversion unit, which has a function of converting the frame rate of a captured moving image into a display frame rate. A display unit 104 has a function of displaying a captured image output from the first conversion unit 103.

  A second conversion unit 105 has a function of converting the frame rate of the moving image data output from the first conversion unit 103 into a recording frame rate L. A compression unit 106 has a function of compressing the information amount of the moving image data output from the second conversion unit 105. A recording unit 107 has a function of recording the moving image data compressed by the compression unit 106 on the recording medium 108. Reference numeral 108 denotes a recording medium. In the present embodiment, a large-capacity hard disk drive, a memory card, an optical disk, or the like is used as the recording medium 108.

  A timing control unit 109 has a function of controlling the operation timing of the imaging unit 101. 110 is a CPU that controls the operation of each unit, and 111 is an operation unit having various switches and buttons.

  In the video camera 100 of this embodiment, the user can set the number L of frames per second of moving image data to be shot to an arbitrary value by operating the operation unit 111. In the present embodiment, an arbitrary value can be set between 1 frame / second and 120 frames / second as a settable frame rate.

  Further, in the video camera 100, the user can appropriately select and set a screen update period P (frame rate) of a captured image displayed on the display unit 104 from predetermined values. For example, as the display frame rate P, any one of 30 frames / second, 50 frames / second, and 60 frames / second can be arbitrarily selected.

  When the recording frame rate L and the display frame rate P of the photographed image are set, the CPU 110 controls the operation of each unit during photographing based on the values of the frame rate L and the display frame rate P. The imaging unit 101 includes an optical unit such as a lens and a mechanism such as a motor. The user can adjust the optical unit by operating the operation unit 111 to adjust the angle of view, the focus, and the like. .

  In this state, when the user instructs to start shooting by operating the operation unit 111, the CPU 110 instructs the timing control unit 109 to move the moving image data of “L × N (N is an integer of 1 or more) frames / second”. The value of N is determined and instructed to shoot.

  The timing control unit 109 controls the drive timing of the image sensor in the imaging unit 101 based on the designated shooting frame rate, and the moving image data captured at a timing of 1 / (L × N) seconds is a flag generation unit. To 102. In this embodiment, “L × N” is set to a maximum value that does not exceed the display frame rate P. For example, if P is 60 and L is 17, N is 3.

  Based on the value N instructed from the CPU 110, the flag generation unit 102 adds a flag to a frame selected every N frames in the moving image data of the frame rate L × N output from the imaging unit 101. That is, the flag generation unit 102 adds a flag at 1 / L second intervals in the moving image data from the imaging unit 101.

  The moving image data with the flag added is output to the first conversion unit 103. The first conversion unit 103 converts moving image data having a frame rate of L × N from the CPU 110 into moving image data having a display frame rate P.

  For example, as described above, when the display frame rate P is 60 and the frame rate L is 17, “L × N = 51”. Therefore, the moving image data of “51 frames / second” is converted into moving image data of “60 frames / second”. As the frame rate conversion processing, for example, a technique for converting a movie of 24 frames for movies into 30 frames for video is known, and a known technique can also be used in this embodiment. However, in the present embodiment, when the frame rate is converted, the frame to which the flag is added has a feature that it is not thinned out.

  The display unit 104 displays the moving image data at the frame rate P output from the first conversion unit 103 on the display unit 104 at the frame rate P. As described above, in the video camera 100 according to the present embodiment, even when the set recording frame rate L is low, moving image data captured at the frame rate L × N is displayed on the display unit 104. Thereby, the update period of the screen displayed on the display unit 104 becomes L × N. Therefore, it is possible to easily adjust the angle of view (zoom) and focus while viewing the image displayed on the display unit 104 during shooting.

  On the other hand, the moving image data to which the flag is added at the frame rate P and at the shooting interval 1 / L second is also output to the second conversion unit 105. The second conversion unit 105 outputs the moving image data at the frame rate L by leaving only the frame to which the flag is added and deleting other extra frames from the input moving image data. The moving image data at the frame rate L is output to the compression unit 106.

  The compression unit 106 encodes the moving image data output from the second conversion unit 105 in accordance with a known encoding processing method such as MPEG, and compresses the information amount. At this time, the compression unit 106 adds management information indicating that it is moving image data of the reference frame rate K to the compressed moving image data, and outputs it. In the present embodiment, the value of the reference frame rate K is 60. The value of K is a predetermined value (K is a natural number). The compressed moving image data is recorded on the recording medium 108 by the recording unit 107.

  The moving image data recorded on the recording medium 108 is decoded and reproduced as moving image data of K frames / second based on the information of the reference frame rate K at the time of reproduction. Therefore, a quick effect is obtained when the value of the recording frame rate L is set smaller than the reference frame rate K, and a slow shooting effect is obtained when the recording frame rate L is larger than the reference frame rate K.

FIG. 4 shows an example of setting values in the configuration of FIG.
FIG. 4 is a diagram showing the state of moving image data handled by each unit when the recording frame rate L is set to 17 as described above.

  4, when 17 is set as the recording frame rate L as shown in FIG. 4A, the CPU 110 sets the recording frame rate L to 17 and the image sensor operation frame rate to “L × N = 17 × 3 = 51”. ”. The imaging unit 101 is controlled by the timing control unit 109, captures moving image data at a timing of every 1/51 seconds, and outputs it to the flag generation unit 102 as shown in FIG. 4B.

  As shown in FIG. 4C, the flag generation unit 102 adds a flag every three frames in the moving image data of (51 frames / second). As shown in FIG. 4D, the first conversion unit 103 converts the moving image data of “51 frames / second” into moving image data of 60 frames / second. The display unit 104 displays the 60 frames / second moving image on the display unit 104.

  On the other hand, as shown in FIG. 4 (e), the second conversion unit 105 deletes the frames other than the frame to which the flag is added from the 51 frames / second moving image data, and the 17 frames / second moving image data. Output image data. The compression unit 106 compresses the 17 frames / second moving image data. At this time, as shown in FIG. 4 (f), management information is added with the reference frame rate value K being 60. By reproducing the moving image data recorded in this way, a quick shooting effect of “K / L = 60/17 times” can be obtained.

Next, a control procedure of the imaging apparatus according to the present embodiment will be described with reference to the flowchart of FIG.
As shown in FIG. 8, in step S81, the recording frame rate L of the moving image data captured by the imaging unit 101 is set to a predetermined value as described above.

  Next, in step S82, the frame rate of the moving image data output from the imaging unit 101 is determined based on the recording frame rate L set in step S81 and the display frame rate P displayed on the display unit 104. . For example, it is determined as 1/20 second or 1/60 second. Then, the imaging unit 101 is controlled to output moving image data at the determined frame rate.

  Next, it progresses to step S83 and waits until imaging operation is performed by the user. When the operation unit 111 is operated by the user and an instruction to start shooting is given, the process proceeds to step S84. In step S84, moving image data is output from the imaging unit 101 at the determined frame rate.

  Next, in step S85, the first conversion unit 103 converts the frame rate of the moving image data output from the imaging unit 101 into a display frame rate for display on the display unit 104.

  Next, in step S <b> 86, the moving image converted into the display frame rate by the first conversion unit 103 is displayed on the display unit 104. Thereafter, the process proceeds to step S87, where a process of converting the frame rate of the moving image data output from the first conversion unit 103 into the recording frame rate L is performed.

  Next, in step S88, the moving image data output from the second conversion unit 105 is recorded on the recording medium 108 together with management information for reproduction at a predetermined frame rate, for example, the reference frame rate K (value 60). .

  As described above, according to the present embodiment, the frame rate of moving image data for displaying the frame rate of moving image data output from the imaging unit 101 on the display unit 104 is the display frame rate P. A conversion unit 103 is provided. Further, a second conversion unit 105 that converts the moving image data to a recording frame rate L for recording on the recording medium 108 is provided. As a result, the frame rate value of the moving image displayed on the display unit 104 and the frame rate value of the moving image recorded on the recording medium 108 can be individually set. Therefore, even when the recording frame rate L is lowered, the display frame rate P can be prevented from being lowered.

(Second Embodiment)
Next, a second embodiment of the imaging device of the present invention will be described.
FIG. 2 is a block diagram illustrating a configuration example of a video camera 200 as an embodiment of the present invention.
The video camera 200 in FIG. 2 arbitrarily sets the number of frames (frame rate) per unit time of a moving image captured by the user and the number of frames added to control the smoothness of the moving image and noise suppression for the main image. Can be taken. Further, the video camera 200 sets the update cycle of the moving image screen displayed during shooting to a value close to the determined frame rate regardless of the frame rate of the shot moving image.

  In FIG. 2, reference numeral 201 denotes an imaging unit, and the shooting timing is changed by the timing control unit 210. Reference numeral 202 denotes a flag generation unit that has a function of adding a first flag for identifying a specified frame in the moving image data output from the imaging unit 201. A conversion unit 203 converts the frame rate of the moving image captured by the imaging unit 201 into a display frame rate, and simultaneously adds a second flag to all the frames that are the output of the flag generation unit 202. Have A display unit 204 has a function of displaying a captured image output from the conversion unit 203.

  A frame addition unit 205 has a function of adding the frame to the moving image data output from the conversion unit 203 and simultaneously converting it to a recording frame rate. A gain control unit 206 has a function of controlling a gain change of the video signal due to frame addition. A compression unit 207 has a function of compressing the information amount of the moving image data output from the gain control unit 206.

  A recording unit 208 has a function of recording the moving image data compressed by the compression unit 207 on the recording medium 209. Reference numeral 209 denotes a recording medium. In the present embodiment, a large-capacity hard disk drive, a memory card, an optical disk, or the like is used as the recording medium 209. 210 is a timing control unit that controls the operation timing of the imaging unit 201, 211 is a CPU that controls the operation of each unit, and 212 is an operation unit that includes various switches, buttons, and the like.

  In the video camera 200 of the present embodiment configured as described above, the user operates the operation unit 212 to shoot. Thereby, it is possible to set the number of frames L per second of the moving image data to be shot and the frame addition number M for controlling the smoothness of the moving image and the noise suppression for the main image to arbitrary values. In the present embodiment, an arbitrary value can be set between 1 frame / second and 120 frames / second as the L frame rate that can be set.

  Further, in the video camera 200, the user can appropriately select and set the screen update period P (frame rate) of the captured image displayed on the display unit 204 from predetermined values. For example, as the display frame rate P, any one of 30 frames / second, 50 frames / second, and 60 frames / second can be arbitrarily selected.

  When the recording frame rate L, the display frame rate P, and the frame addition number M of the photographed image are set, the CPU 211 determines whether the image is being captured based on the values of the recording frame rate L, the display frame rate P, and the frame addition number M. Control the operation of each part.

  The imaging unit 201 includes an optical unit such as a lens and a mechanism such as a motor. The user can adjust the optical unit by operating the operation unit 212 to adjust the angle of view, the focus, and the like. .

  In this state, when the user gives an instruction to start shooting by operating the operation unit 212, the CPU 211 instructs the timing control unit 210 to move the moving image data of “L × N (N is an integer of 1 or more) frames / second”. The value of N is determined and instructed to shoot. The timing control unit 210 controls the drive timing of the image sensor in the imaging unit 201 based on the designated shooting frame rate, and the moving image data captured at a timing of 1 / (L × N) seconds is a flag generation unit. To 202.

  In this embodiment, “L × N” is set to a maximum value that does not exceed the display frame rate P. For example, if P = 60 and L = 19, N = 3. The flag generation unit 202 adds a first flag to the frame selected every N frames in the moving image data of the frame rate L × N output from the imaging unit 201 based on the value N instructed from the CPU 211. To do. That is, the flag generation unit 202 adds the first flag at 1 / L second intervals in the moving image data from the imaging unit 201.

  The moving image data to which the first flag is added is output to the conversion unit 203. The conversion unit 203 converts the moving image data with the frame rate L × N into moving image data with the display frame rate P, and simultaneously adds a second flag to all the frames with L × N. For example, as described above, when the frame rate P is 60 and L is 19, L × N is 57. Therefore, the 57 frames / second moving image data is converted to 60 frames / second moving image data, and a second flag is added to the 57 frames. The frame rate conversion is realized by inserting the same frame a plurality of times, and prevents all frames from being thinned out for L × N moving image data.

  The display unit 204 displays the moving image data at the frame rate P output from the conversion unit 203 at the display frame rate P. As described above, in the video camera 200 according to the present embodiment, even when the set recording frame rate L is low, by displaying moving image data shot at the frame rate L × N, an update cycle of a displayed screen is displayed. Becomes L × N. Therefore, it is possible to easily adjust the angle of view (zoom) and focus while viewing the image displayed on the display unit 204 during shooting.

  On the other hand, the moving image data in which the first flag is added at the frame rate P and the shooting interval is 1 / L second and the second flag is added to all L × N frames is also output to the frame adding unit 205. Is done. The frame addition unit 205 uses the L × N frame specified by the second flag, starting with the frame with the first flag, and adds M frames instructed by the CPU 211 to obtain the frame rate L Are output to the gain control unit 206.

  If the frame rate L × N imaged by the imaging unit 201 increases, the amount of noise included in one frame increases. However, by adding frames in the frame adding unit 205, the random noise level for the video signal is lowered, so that noise can be suppressed and at the same time smooth video expression can be performed on a moving subject. The gain control unit 206 controls the moving image gained up by the frame addition in the frame addition unit 205 to an appropriate gain.

  The moving image data of the frame rate L that is the output of the gain control unit 206 is output to the compression unit 207. The compression unit 207 encodes the moving image data output from the gain control unit 206 in accordance with a known encoding process such as MPEG, and compresses the amount of information.

  At this time, the compression unit 207 adds management information indicating that the compressed moving image data is moving image data at the reference frame rate K to the compressed moving image data, and outputs the result. In the video camera 200 of the present embodiment, the value of the reference frame rate K is 60. The value of K is a predetermined value (K is a natural number). The compressed moving image data is recorded on the recording medium 209 by the recording unit 208.

  The moving image data recorded on the recording medium 209 is decoded and reproduced as moving image data of K frames / second based on the information of the reference frame rate K at the time of reproduction. Therefore, when the value of the recording frame rate L is set smaller than the reference frame rate K, a quick effect is obtained, and when the recording frame rate L is made larger than the reference frame rate K, a slow shooting effect is obtained.

FIG. 5 shows an example of setting values of the video camera 200 in the configuration of FIG.
FIG. 5 is a diagram showing the state of moving image data handled by each unit when the recording frame rate L is 19 and the frame addition number 5 is set as described above.

  As shown in FIG. 5A, when 19 is set as the recording frame rate L, the CPU 211 sets the recording frame rate to 19 and the imaging element operation frame rate to “L × N = 19 × 3 = 57”. The imaging unit 201 is controlled by the timing control unit 210, captures moving image data at a timing of (1/57) seconds, and outputs the captured image data to the flag generation unit 202, as shown in FIG.

  As shown in FIG. 5C, the flag generation unit 202 adds a first flag every 3 frames in the moving image data of 57 frames / second. As shown in FIG. 5D, the conversion unit 203 converts the moving image data of 57 frames / second into moving image data of 60 frames / second, and simultaneously adds a second flag to all 57 frames.

  The display unit 204 displays the 60 frames / second moving image. On the other hand, as shown in FIG. 5E, the frame addition unit 205 sets the frame addition number 5 instructed by the CPU 211 to 57 frames specified by the second flag with the frame having the first flag as the head. Is used for frame addition. Then, as shown in FIG. 5F, 19 frames / second of moving image data is output to the gain control unit 206.

  The compression unit 207 compresses the 19 frames / second moving image data. At this time, as shown in FIG. 5G, the management information is added with the reference frame rate value K being 50. By reproducing the moving image data recorded in this way, a quick shooting effect of K / L = 50/19 times can be obtained.

Next, the control procedure of this embodiment is demonstrated, referring the flowchart of FIG.
In step S91, the recording frame rate of moving image data photographed by the imaging unit 101 and the number of frames added for controlling the smoothness of the moving image and noise suppression for the main image are set to predetermined values. As described above, in the present embodiment, regardless of the frame rate of the moving image shot by the imaging unit 201, the update period of the moving image screen displayed on the display unit 204 during shooting is set to a predetermined frame rate. The value is close.

  Next, in step S92, the frame rate of the moving image data output from the imaging unit 201 is determined. This is determined based on the recording frame rate set in step S91, the sensitivity of the imaging unit 201, the frame addition number M, and the display frame rate P displayed on the display unit 204. Then, the CPU 211 controls the imaging unit 201 to output moving image data at the determined frame rate.

  Next, in step S93, the process waits until the user performs a shooting operation. When the operation unit 212 is operated by the user and an instruction to start shooting is given, the process proceeds to step S94. In step S94, moving image data is output from the imaging unit 201 at the determined frame rate.

  Next, in step S95, the conversion unit 203 converts the frame rate of the moving image data output from the imaging unit 201 into a display frame rate. Next, in step S <b> 96, the moving image converted into the display frame rate by the conversion unit 203 is displayed on the display unit 204. Thereafter, the process proceeds to step S97.

  In step S97, the frame rate of the moving image data converted into the display frame rate by the conversion unit 203 is added to the frame by the frame addition unit 205 to convert it into a recording frame rate.

  Next, in step S98, the gain controller 206 controls the gain of the moving image data output from the frame adder 205. Thereafter, the process proceeds to step S99, and the moving image data output from the gain control unit 206 is recorded on the recording medium 209 together with management information for reproduction at the reference frame rate K (value 60).

(Third embodiment)
Next, a third embodiment of the imaging device of the present invention will be described.
FIG. 3 is a block diagram illustrating a configuration example of the video camera 300 according to the present embodiment.
The video camera 300 of FIG. 3 arbitrarily sets the number of frames (frame rate) per unit time of a moving image taken by the user and the number of frames added to control the smoothness of the moving image and noise suppression for the main image. Can be taken. In addition, regardless of the frame rate of the captured moving image, the video camera 300 sets the update period of the moving image screen displayed during shooting to a value close to the determined frame rate.

  In FIG. 3, reference numeral 301 denotes an imaging unit, and the shooting timing is changed by the timing control unit 310. A flag generation unit 302 has a function of adding a flag for identifying a specified frame in the moving image data output from the imaging unit 301. 303 converts the frame rate of the captured moving image into a display frame rate. A display unit 304 has a function of displaying a captured image output from the conversion unit 303.

  Reference numeral 305 denotes a frame addition unit that has a function of adding the frame to the moving image data output from the flag generation unit 302 and simultaneously converting it to a recording frame rate. A gain control unit 306 has a function of controlling a gain change of the video signal due to the frame addition. A compression unit 307 has a function of compressing the information amount of the moving image data output from the gain control unit 306.

  Reference numeral 308 denotes a recording unit that records the moving image data compressed by the compression unit 307 on the recording medium 309, and 309 denotes a recording medium. In this embodiment, a large-capacity hard disk drive, a memory card, an optical disk, or the like is used as the recording medium 309. 310 is a timing control unit that controls the operation timing of the imaging unit 301, 311 is a CPU that controls the operation of each unit, and 312 is an operation unit that includes various switches, buttons, and the like.

  In the video camera 300, the user operates the operation unit 312 to arbitrarily set the number of frames L per second of moving image data to be shot, the smoothness of moving images, and the number of frames added M that controls noise suppression for the main video. Can be set to a value of. In the present embodiment, an arbitrary value can be set between 1 frame / second and 120 frames / second as the L frame rate that can be set.

  Further, in the video camera 300, the user can appropriately select and set a screen update period P (frame rate) of a captured image displayed on the display unit 304 from predetermined values. For example, as the display frame rate P, any one of 30 frames / second, 50 frames / second, and 60 frames / second can be arbitrarily selected.

  When the recording frame rate L, the display frame rate P, and the frame addition number M of the captured image are set, the CPU 311 captures images based on the set recording frame rate L, display frame rate P, and frame addition number M. Control the operation of each part inside.

  The imaging unit 301 includes an optical unit such as a lens and a mechanism such as a motor. The user can adjust the optical unit by operating the operation unit 312 to adjust the angle of view, the focus, and the like. .

  In this state, when the user instructs to start shooting by operating the operation unit 312, the CPU 311 captures moving image data of L × N (N is an integer of 1 or more) frames / second to the timing control unit 310. To determine and determine the value of N. The timing control unit 310 controls the drive timing of the image sensor in the imaging unit 301 based on the designated shooting frame rate, and sets the moving image data captured at a timing of 1 / (L × N) seconds as a flag generation unit. It outputs to 302.

  Here, in the present embodiment, L × N is set so that the imaging element in the imaging unit 301 has a sensitivity that can sufficiently reduce noise in consideration of the noise suppression effect due to the frame addition effect in the frame addition unit 305. . For example, L = 60, N = 2, M is 2, and P = 50.

  The flag generation unit 302 adds a flag to a frame selected every N frames in the moving image data of the frame rate L × N output from the imaging unit 301 based on the value N instructed from the CPU 311. That is, the flag generation unit 302 adds a flag at 1 / L second intervals in the moving image data from the imaging unit 301.

  The moving image data with the flag added is output to the conversion unit 303. The conversion unit 303 converts the moving image data having the frame rate L × N into moving image data having the display frame rate P. For example, as described above, when P is 50, L is 60, and N is 2, since L × N is 120, the 120 frames / second moving image data is converted to 50 frames / second moving image data. The conversion unit 303 is realized by deleting a frame a plurality of times. The display unit 304 displays the moving image data at the frame rate P from the conversion unit 303 at the frame rate P.

  On the other hand, the moving image data to which the flag is added at the frame rate P and the shooting interval is (1 / L) seconds is also output to the frame addition unit 305. The frame addition unit 305 performs addition of M frames instructed by the CPU 311 with the frame having the flag as the head, and outputs a moving image having a frame rate L to the gain control unit 306.

  If the frame rate L × N imaged by the imaging unit 301 increases, the amount of noise included in one frame increases. In the present embodiment, frame addition in the frame adder 305 reduces the random noise level for the video signal, so that noise can be suppressed, and at the same time, smooth video expression can be made for a moving subject. The gain control unit 306 controls the moving image gained up by the frame addition in the frame addition unit 305 to an appropriate gain.

  The moving image data of the frame rate L, which is the output of the gain control unit 306, is output to the compression unit 307. The compression unit 307 encodes the moving image data output from the gain control unit 306 according to a known encoding process such as MPEG, and compresses the amount of information.

  At this time, the compression unit 307 adds management information indicating that the compressed moving image data is moving image data at the reference frame rate K to the compressed moving image data. In the present embodiment, the value of the reference frame rate K is 24. The value of the reference frame rate K is a predetermined value (K is a natural number). The moving image data compressed by the compression unit 307 is recorded on the recording medium 309 by the recording unit 308.

  The moving image data recorded on the recording medium 309 is decoded and reproduced as moving image data of K frames / second based on the information of the reference frame rate K at the time of reproduction. Therefore, a quick effect is obtained when the value of the recording frame rate L is set smaller than the reference frame rate K, and a slow shooting effect is obtained when the recording frame rate L is larger than the reference frame rate K.

FIG. 6 shows an example of setting values in the configuration of FIG.
FIG. 6 is a diagram illustrating the state of moving image data handled by each unit when the recording frame rate L is set to 60 and the frame addition number 2 is set as described above.

  In FIG. 6, when 60 is set as the recording frame rate L, the CPU 311 sets the recording frame rate L to 60 and the imaging element operation frame rate to L × N = 60 × 2 = 120. The imaging unit 301 is controlled by the timing control unit 310, captures moving image data at a timing of (1/120) seconds as shown in FIG. 6A, and outputs the moving image data to the flag generation unit 302.

  As shown in FIG. 6B, the flag generation unit 302 adds a flag every two frames in the moving image data of 120 frames / second. As shown in FIG. 6D, the conversion unit 303 converts moving image data of 120 frames / second into moving image data of 50 frames / second. The display unit 304 displays the 50 frames / second moving image.

  On the other hand, the frame addition unit 305 performs frame addition with the frame addition number 2 instructed by the CPU 311 starting from the frame with the flag, and as shown in FIG. Output to the gain controller 306. The compression unit 307 compresses the moving image data of 60 frames / second. At this time, as shown in FIG. 6E, the management information is added with the reference frame rate value K being 24. By reproducing the moving image data recorded in this way, a slow shooting effect of K / L = 24/60 times can be obtained.

Next, the control procedure of this embodiment is demonstrated, referring the flowchart of FIG.
In step S101, the recording frame rate of moving image data photographed by the imaging unit 301 and the frame addition number for controlling the smoothness of moving images and noise suppression for the main image are set to predetermined values. As described above, in the present embodiment, regardless of the frame rate of the moving image captured by the imaging unit 301, the update period of the moving image screen displayed on the display unit 304 during shooting is set to a predetermined frame rate. The value is close.

  Next, in step S102, the frame rate of the moving image data output by the imaging unit 301 is determined based on the recording frame rate set in step S101, the sensitivity of the imaging unit 301, and the frame addition number. Then, the CPU 311 controls the imaging unit 301 so as to output moving image data at the determined frame rate.

  Next, in step S103, the process waits until the user performs a shooting operation. When the operation unit 312 is operated by the user and an instruction to start shooting is given, the process proceeds to step S104. In step S104, moving image data is output from the imaging unit 301 at the determined frame rate.

  Next, in step S <b> 105, the frame rate of the moving image data output from the imaging unit 301 is converted into a display frame rate by the conversion unit 303. Thereafter, the process proceeds to step S106, and the moving image data output from the conversion unit 303 is displayed on the display unit 304 at the display frame rate.

  In step S107, the frame rate of the moving image data output from the imaging unit 301 is frame-added by the frame addition unit 305 to be converted into a recording frame rate. Thereafter, the process proceeds to step S108, and the gain controller 306 controls the gain of the moving image data output from the frame adder 305.

  Next, in step S109, the moving image data output from the gain control unit 306 is recorded on the recording medium 309 together with management information for reproduction at the reference frame rate K (value 60).

(Other embodiments according to the present invention)
Each unit constituting the imaging apparatus according to the above-described embodiment of the present invention can be realized by operating a program stored in a RAM or a ROM of a computer. This program and a computer-readable recording medium recording the program are included in the present invention.

  In addition, the present invention can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. The present invention may be applied to an apparatus composed of a single device.

  In the present invention, a software program (in the embodiment, a program corresponding to the flowcharts shown in FIGS. 8 to 10) for executing each step in the above-described imaging method is directly or remotely supplied to the system or apparatus. In addition, this includes a case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Various recording media can be used as a recording medium for supplying the program. For example, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD- R).

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  In addition to the functions of the above-described embodiments being realized by the computer executing the read program, the OS running on the computer may perform part or all of the actual processing. The functions of the above-described embodiments can be realized.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

1 is a block diagram illustrating a schematic configuration of a video camera according to a first embodiment of the present invention. It is a block diagram which shows the 2nd Embodiment of this invention and demonstrates schematic structure of a video camera. It is a block diagram which shows the 3rd Embodiment of this invention and demonstrates schematic structure of a video camera. It is a figure which shows the 1st Embodiment of this invention and shows the mode of the moving image data handled by each part, when 17 is set as a recording frame rate. It is a figure which shows the 2nd Embodiment of this invention, and shows the mode of the moving image data handled by each part, when 19 is set as a recording frame rate and the frame addition number 5 is set. It is a figure which shows the 3rd Embodiment of this invention, and shows the mode of the moving image data handled by each part, when the recording frame rate is set to 60 and the frame addition number 2 is set. It is a figure explaining the mechanism which implement | achieves quick and slow imaging | photography. It is a flowchart which shows the 1st Embodiment of this invention and demonstrates an example of a control procedure. It is a flowchart which shows the 2nd Embodiment of this invention and demonstrates an example of a control procedure. It is a flowchart which shows the 3rd Embodiment of this invention and demonstrates an example of a control procedure.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Video camera 101 Image pick-up part 102 Flag production | generation part 103 1st conversion part 104 Display part 105 2nd conversion part 106 Compression part 107 Recording part 108 Recording medium 109 Timing control part 110 CPU
111 Operation unit

Claims (8)

An imaging device that displays moving image data captured and output by an imaging unit on a display unit,
The moving image data output from the imaging unit is controlled to individually set the frame rate value of the moving image displayed on the display unit and the frame rate value of the moving image to be recorded on the recording medium. An image pickup apparatus comprising a control unit. An imaging unit;
Setting means for setting a recording frame rate of moving image data captured by the imaging unit to an arbitrary value;
Based on the recording frame rate set by the setting means and the display frame rate of the moving image displayed on the display unit, the frame rate of the moving image data output from the imaging unit is determined, and the determined frame rate Control means for controlling the imaging unit to output moving image data at
First conversion means for converting a frame rate of moving image data output from the imaging unit into the display frame rate;
Display means for displaying the moving image data converted into a display frame rate by the first conversion means on the display unit;
Second conversion means for converting the frame rate of the moving image data output from the first conversion means to the recording frame rate;
An image pickup apparatus comprising: recording means for recording the moving image data output from the second conversion means on a recording medium together with management information for reproducing at a predetermined frame rate. An imaging unit;
Setting means for setting the recording frame rate of moving image data captured by the imaging unit and the frame addition number to arbitrary values;
A frame of moving image data output by the imaging unit based on the recording frame rate set by the setting unit, the number of frame additions, the sensitivity of the imaging unit, and the display frame of the moving image displayed on the display unit Control means for determining a rate and controlling the imaging unit to output moving image data of the determined frame rate;
Conversion means for converting a frame rate of moving image data output from the imaging unit into the display frame rate;
Display means for displaying the moving image data output from the conversion means at the display frame rate;
Frame addition for adding a plurality of frames of moving image data output from the conversion unit and converting the frame rate of the moving image data into the recording frame rate according to the number of frame additions set by the setting unit Means,
Means for controlling the gain of the moving image data output from the frame addition means;
An image pickup apparatus comprising: recording means for recording the moving image data output from the gain control means on a recording medium together with management information for reproducing at a predetermined frame rate. An imaging unit;
Setting means for setting the recording frame rate of moving image data captured by the imaging unit and the frame addition number to arbitrary values;
Based on the recording frame rate and the number of frame additions set by the setting means and the sensitivity of the imaging unit, the frame rate of the moving image data output by the imaging unit is determined, and the moving image having the determined frame rate Control means for controlling the imaging unit to output data;
Conversion means for converting a frame rate of moving image data output from the imaging unit into a display frame rate;
Display means for displaying the moving image data output from the conversion means at the display frame rate;
Frame addition means for adding the moving image data of a plurality of frames output from the imaging unit according to the number of frame additions set by the setting means, and converting the frame rate of the moving image data to the recording frame rate When,
Means for controlling the gain of the moving image data output from the frame addition means;
An image pickup apparatus comprising: recording means for recording the moving image data output from the gain control means on a recording medium together with management information for reproducing at a predetermined frame rate. An imaging method for displaying moving image data captured and output by an imaging unit on a display unit,
The moving image data output from the imaging unit is controlled to individually set the frame rate value of the moving image displayed on the display unit and the frame rate value of the moving image to be recorded on the recording medium. An imaging method comprising a control step. A setting step for setting the recording frame rate of moving image data captured by the imaging unit to an arbitrary value;
Based on the recording frame rate set in the setting step and the display frame rate of the moving image displayed on the display unit, the frame rate of moving image data output from the imaging unit is determined, and the determined frame rate A control step of controlling the imaging unit so as to output moving image data;
A first conversion step of converting a frame rate of moving image data output from the imaging unit into the display frame rate;
A display step of displaying the moving image data converted into the display frame rate in the first conversion step on the display unit;
A second conversion step of converting the frame rate of the moving image data output from the first conversion step into the recording frame rate;
An imaging method comprising: a recording step of recording the moving image data output from the second conversion step on a recording medium together with management information for reproducing at a predetermined frame rate. A setting step of setting the recording frame rate of moving image data captured by the imaging unit and the frame addition number to arbitrary values;
A frame of moving image data output by the imaging unit based on the recording frame rate set in the setting step, the frame addition number, the sensitivity of the imaging unit, and the display frame of the moving image displayed on the display unit A control step of determining a rate and controlling the imaging unit to output moving image data of the determined frame rate;
A conversion step of converting a frame rate of moving image data output from the imaging unit into the display frame rate;
A display step of displaying the moving image data output from the conversion step at the display frame rate;
Frame addition for adding a plurality of frames of moving image data output from the converting step and converting the frame rate of the moving image data to the recording frame rate according to the number of frame additions set in the setting step Process,
Controlling the gain of the moving image data output from the frame addition step;
An imaging method comprising: a recording step of recording the moving image data output from the gain control step on a recording medium together with management information for reproducing at a predetermined frame rate. A setting step of setting the recording frame rate of moving image data captured by the imaging unit and the frame addition number to arbitrary values;
Based on the recording frame rate and the frame addition number set in the setting step, and the sensitivity of the imaging unit, the frame rate of the moving image data output by the imaging unit is determined, and the moving image having the determined frame rate is determined. A control step of controlling the imaging unit to output data;
A conversion step of converting a frame rate of moving image data output from the imaging unit into a display frame rate;
A display step of displaying the moving image data output from the conversion step at the display frame rate;
A frame addition step of adding a plurality of frames of moving image data output from the imaging unit according to the number of frame additions set in the setting step, and converting a frame rate of the moving image data into the recording frame rate When,
Controlling the gain of the moving image data output from the frame addition step;
An imaging method comprising: a recording step of recording the moving image data output from the gain control step on a recording medium together with management information for reproducing at a predetermined frame rate.

Images