JP2017199985A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an apparatus capable of disabling reproduction of a screen that must not be reproduced.SOLUTION: An imaging apparatus includes means for detecting shooting conditions during video recording, discriminating whether or not each frame is a reproducible frame based on the detected shooting conditions, and generating management information indicating whether or not it is a reproducible frame, means for recording a video and management information as a video file, reproduction means of reproducing the video file, display means for displaying the reproduced video, and means for controlling the display means to discriminate whether or not each frame, in a reproduced video, is a reproducible frame, based on the header information in a reproduced video file, and to display a reproducible frame in place of a non-reproducible frame.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus.

  2. Description of the Related Art Conventionally, imaging devices that capture and record moving images and still images are known. In addition, when recording a still image while recording a movie, a technology has been proposed in which the recording of the movie is paused when the flash fires, and the screen when the flash is issued is not included in the movie ( Patent Document 1).

JP 2008-295098 A

  In Patent Document 1, it is only necessary not to record a screen by flash emission. For example, if an unsightly image is recorded, such as when the device is shaken during shooting, it is reproduced as it is.

  It is an object of the present invention to provide an imaging apparatus that can solve such a problem and prevent a screen that should not be reproduced from being reproduced.

In order to achieve the above object, an imaging apparatus according to the present invention includes:
An image pickup means and a means for recording a moving image output by the image pickup means, starts recording the moving image in response to a recording start instruction, and automatically records the moving image after recording the moving image for a predetermined time. A recording unit that stops recording, and a recording state of the imaging apparatus is detected during recording of the moving image by the recording unit, and whether each frame in the moving image being recorded is a reproducible frame based on the detected shooting state A means for generating management information indicating whether each frame of the recorded moving image is a reproducible frame, and a moving image file including the moving image and the management information is recorded. Control means for controlling the recording means, reproducing means for reproducing the moving image file, and display means for displaying the moving image reproduced by the reproducing means, the control means comprising: Based on the management information in the moving image file reproduced by the raw means, it is determined whether or not each frame in the moving image reproduced by the reproducing means is a reproducible frame. The display means is controlled to display a reproducible frame.

  With the imaging apparatus according to the present invention, it is possible to prevent a screen that should not be reproduced from being reproduced.

Block diagram of imaging device Layout of 3D acceleration sensor Flow chart of AF operation during moving image recording Flow chart of AE operation during video recording Schematic diagram of video data structure Flow chart of video playback operation Data table that determines the level of identification data

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

[Example 1]
FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 100 according to the present embodiment.

  In FIG. 1, 110 is a variable power lens, 111 is a shift lens for correcting camera shake, 112 is a focus lens for focus adjustment, 113 is a mechanical shutter that blocks the light beam to the subsequent stage, and 114 is to adjust the light beam to the subsequent stage. Aperture. Reference numeral 115 denotes an image sensor, and 116 denotes a timing generator that drives the image sensor 115 and generates timing pulses necessary for sampling.

  An image processing unit 117 processes an image signal from the image sensor 115. The image processing unit 117 includes an SSG circuit that generates a synchronization signal for driving the image sensor, a preprocessing circuit, an AF evaluation value calculation circuit, a luminance integration circuit, a signal processing circuit, a face detection circuit, a reduction circuit, and a raster block conversion. A circuit and a compression circuit.

  The SSG circuit receives an imaging drive clock from the timing generator, generates horizontal and vertical synchronization signals, and outputs them to the timing generator and the image sensor. The preprocessing circuit distributes the input image to the luminance integration circuit and the signal processing circuit in units of rows. Further, processing such as data correction between channels necessary for imaging data is performed. In the AF evaluation value calculation circuit, the luminance component of the image signal input in the set plurality of evaluation areas is subjected to horizontal filtering, and the maximum value is selected while extracting a predetermined frequency representing contrast, and the vertical direction Perform the integral operation. In the luminance integration circuit, luminance components are mixed and generated from RGB signals, the input image is divided into a plurality of regions, and a luminance component is generated for each region.

  The signal processing circuit generates a luminance signal by performing color carrier removal, aperture correction, gamma correction processing, and the like on the image sensor output data. At the same time, color interpolation, matrix conversion, gamma processing, gain adjustment, and the like are performed to generate a color difference signal, and image data in YUV format is formed in the memory unit 123. In the signal processing circuit, the luminance signals (Y) of the YUV format image data to be generated are tabulated for each level, and luminance distribution data for each image data is generated.

  The reduction circuit receives the output of the signal processing circuit, cuts out input pixel data, performs thinning, linear interpolation processing, and the like, and performs pixel data reduction processing in the horizontal and vertical directions. In response to this, the raster block conversion circuit converts the raster scan image data scaled by the reduction circuit into block scan image data. Such a series of image processing is realized by using the memory unit 123 as a buffer memory. The compression circuit compresses the YUV image data converted into the block scan data by the buffer memory according to the moving image compression method, and outputs a moving image bit stream.

  An exposure control unit 118 controls the mechanical shutter 113 and the diaphragm 114. A lens control unit 119 moves the zoom lens 110 and the focus adjustment lens 112 along the optical axis, and forms an object scene image on the image sensor 115. Further, the shift lens is driven in accordance with the outputs of the angular velocity sensor and the acceleration sensor, and the camera shake of the image recording / reproducing apparatus is optically corrected. Reference numeral 120 denotes a release switch for instructing photographing.

  Reference numeral 127 denotes a microphone that converts input sound into a sound signal, 128 denotes an A / D converter that converts the sound output of the microphone into a digital sound signal, and 129 performs predetermined sound processing on the digital sound data to generate an audio bitstream. Is a voice processing unit that outputs.

  The system control circuit 121 includes a CPU and a memory. In the system control circuit 121, a program executed by a CPU that controls each unit of the imaging apparatus 100 is stored in the flash memory 122. 142 is a battery serving as a power source, 130 and 141 are connection terminals for engaging the image recording apparatus 100 and the battery 142, and 140 is a battery BOX that holds the battery 142 in the image recording apparatus 100. Reference numeral 133 denotes a recording medium for recording an image; 125 and 132, connection terminals for engaging the image recording apparatus 100 and the recording medium 133; 134, a switch for detecting a write-protect switch of the recording medium; 126, attachment / detachment of the recording medium 133 This is a detection switch for detecting.

  Reference numeral 150 denotes a reproduction circuit that converts image data generated by the image processing unit 117 and stored in the memory unit 123 into a display image and transfers it to a monitor, and 151 denotes a display device. The reproduction circuit 150 separates the YUV format image data into a luminance component signal Y and a modulated chrominance component C, and applies LPF to the analog Y signal subjected to D / A conversion. Further, BPF is applied to the analog C signal that has been subjected to D / A conversion, and only the frequency component of the modulated color difference component is extracted. Based on the signal component thus generated and the subcarrier frequency, the signal is converted into a Y signal and an RGB signal and output to the monitor 151. Thus, EVF is realized by sequentially processing and displaying the image data from the image sensor.

  180 is a first acceleration sensor pair for detecting vertical shift blur and vertical angle blur of the image recording apparatus, and 190 is for detecting horizontal shift blur and horizontal angle blur of the image recording apparatus. The second acceleration sensor pair. The first acceleration sensor pair is composed of first and second two-dimensional acceleration sensors. The second acceleration sensor pair is composed of third and fourth two-dimensional acceleration sensors.

<Explanation of blur detection>
FIG. 2 shows the arrangement of a three-dimensional acceleration sensor composed of a pair of acceleration sensors.

  Each of the first to fourth acceleration sensors constituting the acceleration sensor pair has two sensitivity axes. One is fixed to match the optical axis direction, and the other is fixed to match the vertical direction or horizontal direction, so that the acceleration in the optical axis direction and the vertical direction, or the acceleration in the optical axis direction and the horizontal direction Is detected.

  The first acceleration sensor is arranged directly beside the optical axis, and the second acceleration sensor is on the same plane as the first acceleration sensor and perpendicular to the optical axis and in a direction perpendicular to the first acceleration sensor. Arranged at a position shifted by a predetermined amount. The third acceleration sensor is arranged directly below the optical axis, and the fourth acceleration sensor is on the same plane as the third acceleration sensor and parallel to the optical axis and is horizontal to the third acceleration sensor. It is arranged at a position shifted by a predetermined amount in the direction.

  The G1 signal that is the output of the first acceleration sensor and the G2 signal that is the output of the second acceleration sensor are input to the system control circuit 121. The system control circuit 121 integrates the difference between the input G1 signal and the G2 signal in the time axis direction, and obtains an angular blur amount in the direction perpendicular to the optical axis and an angular blur amount in the optical axis direction. Further, the G1 signal and the G2 signal are integrated in the time axis direction, and the shift blur amount in the direction perpendicular to the optical axis is detected. Similarly, the G3 signal, which is the output of the third acceleration sensor, and the G4 signal, which is the output of the fourth acceleration sensor, are input to the system control circuit 121, and the amount of horizontal angle shake and the angle shake in the optical axis direction are input. The amount and shift blur amount are detected.

<Description of AF operation>
FIG. 3 is a flowchart of AF (automatic focus adjustment) operation during recording standby (live view display) and during moving image recording.

  The AF operation according to this embodiment will be described with reference to the flowchart of FIG. This operation is also realized by the system control circuit 121 loading and executing a program stored in the flash memory 122.

  The CPU of the system control circuit 121 starts action shooting recording (S300), and performs focusing rate determination based on periodic evaluation values (S301). If it is determined that the focusing rate is low, the focus lens is moved at a constant speed in synchronization with the imaging (S302). When the exposure of the first head line is completed (S303), an image property (image information) of a corresponding frame ID described later is acquired (S304), and evaluation values are integrated (S305). It is determined whether scanning for the number of evaluation value samples corresponding to the focal length has been completed (S306). When the scanning is completed, the center-of-gravity time of each evaluation value frame in the upper, middle, and lower stages is obtained (S307).

  The position of the focus lens is associated with the barycentric time of each evaluation value frame (S308), and the focus lens is moved to the most focused position (focus position) by a predetermined algorithm (S309). These are continued until the moving image recording is completed (S310). During the AF operation period, the AF program outputs evaluation data to an image property described later.

<Description of luminance level change>
FIG. 4 is a flowchart of an AE (automatic exposure control) operation during recording standby and during moving image recording.

  The AE operation according to this embodiment will be described with reference to the flowchart of FIG. This operation is also realized by the system control circuit 121 loading and executing a program stored in the flash memory 122.

  The CPU of the system control circuit 121 starts moving image shooting and recording (S400 = S300), divides the input image into a plurality of areas for the luminance integration circuit of the image processing unit 117, and generates a luminance component for each area. Settings are made (S401). Initial exposure control is performed (S402), and the completion of luminance integration under this exposure control is awaited (S403). When the luminance integration is completed, evaluation calculation of the integration result for each divided area is performed, and the field luminance is obtained together with the amount of deviation from the appropriate exposure (S404).

  Based on the exposure control value that matches the determined field luminance, exposure control is performed at the next exposure timing (S405). These are continued until the moving image recording is completed (S406). In the AE operation, the AE program outputs a deviation amount from the appropriate exposure obtained from the integration result as a Bv value to an image property described later.

<Description of video recording>
In order to perform moving image recording, the system control circuit 121 sets a pre-programmed synchronization signal pattern for controlling shooting during moving image recording in the SSG circuit of the image processing unit 117. The SSG circuit outputs horizontal and vertical synchronization signals based on the clock of the timing generation circuit 116. The image sensor 115 is driven according to the output of the timing generator 116 generated based on these synchronization signals, and digital image data obtained by continuously capturing images is taken into the image processing unit.

  The captured image data is sequentially subjected to the image processing described above, and converted into YUV data for display and YUV data for moving image recording. The compression unit compresses the YUV data for moving image recording and outputs a moving image bit stream. The system control circuit 121 sequentially records the moving image data for recording from the moving image bit stream and the audio bit stream on the recording medium while sequentially accumulating them in the memory.

  In the present embodiment, when recording a moving image, the recording of the moving image is started in response to an instruction to start recording the moving image by the user, and after a predetermined time, for example, 4 seconds of moving image and sound are recorded, the recording is automatically performed. Stop. A series of moving images recorded by one recording instruction is called a chapter. One chapter is recorded as one moving image file, and a header is added to each moving image file.

  The moving picture bitstream is composed of a set of GOP (Group Of Picture) in units of a header part and 15 frames of images. FIG. 5 is a schematic diagram showing the data structure of the moving image bit stream of the present embodiment, and represents moving image data that forms one chapter every 4 seconds. A header is formed at the beginning of each chapter.

  The system control circuit 121 determines whether or not each frame of the moving image is a screen to be reproduced based on the moving image shooting information acquired at the time of recording the moving image. Then, management information indicating the determination result is stored in the header. This header has a data size corresponding to the number of frames of a 4-second moving image, that is, a data amount of 15 bytes (120 bits), and bits 0 to 119 hold data corresponding to frames 0 to 119. That is, one bit of the management information indicates whether or not each frame can be reproduced. If it is determined that the frame is not reproducible (non-reproducible) from the moving image shooting information acquired at the time of moving image recording, the bit corresponding to the frame is set to 1, for example.

  The moving image shooting information includes a luminance change level, a focus shift level, and a vertical vibration level obtained by integrating a vertical blur amount in the time axis direction. Further, it includes a horizontal vibration level obtained by integrating the horizontal shake amount in the time axis direction, and a vertical rotation level obtained by integrating vertical angle shake in the time axis direction. Further, a horizontal rotation level obtained by integrating the angular shake in the horizontal direction in the time axis direction and a rotation level in the optical axis direction obtained by integrating the angular shake in the optical axis direction in the time axis direction are included.

The system control circuit 121 converts the moving image shooting information into grades based on the data table shown in FIG. Then, the number in the grade table is multiplied by the number of items to which the grade is assigned, and the value is added at the end. For example, out of 7 items of video shooting information, 5 items are grade 1, 1 item is grade 2, 1 item is 3,
50 × 5 + 40 × 1 + 30 × 1 = 320
Can be obtained as follows.

  If the calculated value is larger than the set threshold, the frame is set as a non-reproducible frame and recorded as described above.

<Operation during video playback>
FIG. 6 is a flowchart showing an operation during reproduction of a moving image.

  With reference to the flowchart of FIG. 6, the moving image reproduction operation according to the present embodiment will be described. This operation is also realized by the system control circuit 121 loading and executing a program stored in the flash memory 122.

  In the reproduction main flow of FIG. 7, first, the system control circuit 121 reads out management information of the header portion of the moving image recorded on the recording medium 133, stores it in the memory unit 123, and reads the information (S601). Next, it is determined whether or not the frame to be reproduced is a non-reproducible frame (S602). As described above, in the case of a non-reproducible frame, the management information bit of the corresponding frame is 1. For example, if bit 0 of the management information corresponding to the top frame is 1, it means that the top frame is a non-reproducible frame.

  If it is not a non-reproducible frame, the regenerated frame is displayed as it is (S603). On the other hand, if it is a non-reproducible frame, it is determined whether it is the top frame (S605). If it is the first frame, the chapter number is confirmed, and it is confirmed whether there is a related chapter immediately before (S606). When the chapter number is 2 or more, the last frame of the chapter immediately before the chapter is displayed instead of the unreproducible frame (S607). If the last frame immediately before is a frame that cannot be reproduced, the frame that can be reproduced before that final frame is displayed instead.

  If the chapter number is 1, the reproducible frame nearest the non-reproducible frame is displayed (S608). Here, since the first frame of the chapter cannot be reproduced, the next frame is reproduced and displayed instead. If it is not the first frame of the chapter in S605, a reproducible frame preceding the nonreproducible frame is displayed instead (S609).

  In this way, display is performed for one frame, and it is determined whether there is a remaining frame or whether playback stop is instructed (S604). If there is no instruction to stop playback and there are remaining frames, the next frame is selected (S610), and the process returns to S602. When all the frames have been played, the video playback ends.

  The program for performing the grade determination predetermines the reproduction reference grade in advance. Although detailed description of setting the reproduction reference grade is omitted, it is also possible for the user to select a grade with an operation member by displaying the GUI on the display device. If not set by the user, the default grade stored by the program is selected.

  In the present embodiment, information that determines frames that can be played back or not at the time of recording is stored in the header portion, and frames that can be played back are displayed instead of frames that cannot be played back during playback. Information at the time of moving image shooting may be recorded as it is at the time of recording, and a grade may be selected and set for each feature element at the time of reproduction, and only a moving image frame that is severely vibrated or rotated may be determined as a non-reproducible moving image frame. Further, only a moving image frame with a poor focus may be determined as a non-reproducible moving image frame, and the frame selection at the time of reproduction may be widened. The same applies to moving image recording without troublesome editing.

  As described above, by extracting and recording data characterizing the quality of an image from the characteristics of each frame during recording, it is possible to display another frame instead of a frame that is considered unnecessary during reproduction. Similarly, it is possible to re-record a file composed only of comfortable moving images without troublesome editing work. Furthermore, the user can easily determine the level for determining a comfortable moving image, and can select a scene to be reproduced or left as a moving image.

  That is, in the present embodiment, the image pickup means and the means for recording the moving image output by the image pickup means, the recording of the moving image is started in response to the recording start instruction, and after the moving image for a predetermined time is recorded, Recording means for stopping the recording of the moving image. In the present embodiment, the shooting state during recording of a moving image is detected, and it is determined whether each frame in the moving image being recorded is a reproducible frame based on the detected shooting state. Also, management information indicating whether or not each frame of the recorded moving image is a reproducible frame is generated. The moving image and management information are recorded as a moving image file.

  In the present embodiment, a playback unit that plays back a moving image file and a display unit that displays the played back moving image are provided. Furthermore, based on the header information in the moving image file reproduced by the reproducing means, it is determined whether or not each frame in the moving image reproduced by the reproducing means is a reproducible frame. Then, a reproducible frame is displayed instead of the non-reproducible frame.

  In this embodiment, the reproducible frame closest to the non-reproducible frame is displayed instead of the non-reproducible frame.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

110 zoom lens, 111 shift lens, 112 focus adjustment focus lens,
113 mechanical shutter, 114 aperture, 115 image sensor,
116 Timing Generator

Claims (4)

An imaging device,
Imaging means;
Recording means for recording the moving image output by the imaging means, wherein recording of the moving image is started in response to a recording start instruction, and recording of the moving image is automatically stopped after recording the moving image for a predetermined time. Means,
While the moving image is being recorded by the recording means, the shooting state of the imaging device is detected, and based on the detected shooting state, it is determined whether or not each frame in the moving image being recorded is a reproducible frame. Means for generating management information indicating whether or not each frame of the recorded moving image is a reproducible frame;
Control means for controlling the recording means to record a moving image file including the moving image and the management information;
Playback means for playing back the video file;
Display means for displaying the video reproduced by the reproduction means,
The control means determines whether or not each frame in the video reproduced by the reproduction means is a reproducible frame based on the management information in the video file reproduced by the reproduction means, and can be reproduced An imaging apparatus characterized by controlling the display means so as to display a reproducible frame instead of a non-frame.   2. The control unit according to claim 1, wherein the control unit controls the display unit to display a reproducible frame closest to the non-reproducible frame in place of the non-reproducible frame. Imaging device.   The control means controls the display means to display instead the last frame of the moving picture of the predetermined time recorded before that when the first frame of the moving picture of the predetermined time is the non-reproducible frame. The imaging apparatus according to claim 1, wherein:   The imaging apparatus according to claim 1, wherein the management information includes 1-bit information indicating whether or not each frame of the moving image of the predetermined time is a reproducible frame.