JP2007116331A - Digital imaging device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a digital imaging device capable of acquiring both a motion picture data and a still image data at a desired timing during photographing at one photographing, and capable of acquiring an image data of high picture quality always as the still image data. <P>SOLUTION: The digital imaging device comprises an imaging means 10 for imaging; a signal processing means 11 that captures signals supplied from the imaging means 10 at specified cycle and generates digital image signals for each specified cycle; a data processing means 13 that captures digital image signals supplied sequentially from the signal processing means 11, and generates the motion picture data in a first format in which the image data at respective timings are arranged in time series with no reduction in size of images; and a storage means 14 for storing the motion picture data in the first format that is generated by the data processing means 13 in a recording medium. The data processing means 13 allows the image data at a specified timing to be captured as the image data of one still image out of the motion picture data in the first format that is stored in the recording medium, for storage in the recording medium. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an imaging apparatus such as a digital still camera or a digital video camera, and more particularly to a technique useful for use in an imaging apparatus capable of capturing both moving images and still images.

  In recent years, digital still cameras that shoot still images have been commercialized so that it is possible to shoot moving images for a short time, and digital video cameras that shoot moving images can shoot still images.

  Further, there are the following techniques as conventional techniques related to the present invention. For example, in Patent Document 1, in a video camera device that records a captured moving image on a recording tape, when a still image shooting operation is performed, image data for five frames is stored in a buffer memory, and a desired one is stored therein. A technique is disclosed in which image data can be selected and recorded on a data disc.

  Patent Document 2 includes a circuit that generates moving image data from a signal from an image sensor and a circuit that generates image data of a still image, and operates a moving image processing circuit by switching an operation mode. An image generating apparatus is disclosed that can generate general moving image data or high-quality still image data by operating a still image processing circuit.

In Patent Documents 3 and 4, when a still image shooting instruction is given during shooting of a moving image, processing for a still image is performed on a signal captured from the imaging unit, or a plurality of frames of moving images are recorded. A technique is disclosed that enables image data of a still image to be generated in parallel with shooting of a moving image by, for example, combining image data for a still image.
JP 2004-096784 A JP 2004-282598 A JP 2005-217493 A JP 2005-197910 A

  However, the conventional imaging apparatus has the following problems. First, with general video cameras and digital still cameras that can shoot both moving images and still images, you can switch between the shooting mode for shooting movies and the operating mode for shooting still images to shoot movies and shoot still images. There is a problem that it is impossible to record a moving image and a still image at the same time.

  Also, when taking a still image, the shutter operation is performed and one piece of still image data is recorded in the storage medium for each operation, and there is a time lag between the shutter operation and securing the still image data. There is also a problem that it is difficult to capture the moment when a desired pose is obtained when shooting a moving subject.

  Also, instead of shooting still images by real-time operation such as shutter operation, take a certain period of time like movie shooting, and then acquire the still image by specifying the timing to make a still image Although there was a request to be able to do so, the conventional general digital imaging device and the devices of Patent Documents 1 to 4 could not meet this request.

  We have examined whether such a request can be realized by capturing video with a video camera and then capturing the video data into a personal computer or the like, and cutting out one frame of image data from the video data. Then, the following problems were considered.

  In other words, in a conventional digital video camera, a moving image is recorded in a versatile moving image format such as SD (standard definition) image quality MotionJPEG or MPEG2. For example, in the case of moving image data of SD image quality, the number of pixels is small. If the image is an interlaced image and is made a still image, the image becomes extremely rough, and a practical image quality cannot be obtained as still image data. Also, in the case of MPEG2 moving image data with HD (high definition) image quality, the image quality is good as long as it is an I picture image obtained by encoding a still image of one frame, but a P picture encoded before or after an error from the previous frame or In a B picture or the like in which an error from this frame is encoded, the image quality is considerably deteriorated, and a practical image quality as still image data cannot be obtained. Furthermore, since the I picture contains only a few frames per second, the I picture is often not generated at the timing at which it is desired to cut out as a still image. As a result, a still image at a desired timing is used as high-quality image data. Often not available.

  An object of the present invention is that it is possible to obtain both moving image data and still image data at a desired timing during the shooting period, and always obtain high-quality image data as still image data. It is an object of the present invention to provide a digital imaging device that can be used.

  In order to achieve the above object, the present invention provides an image pickup means for picking up an image, a signal processing means for taking in a signal supplied from the image pickup means at a predetermined period and generating a digital image signal for each predetermined period, A data processing unit that takes in digital image signals sequentially supplied from the unit and generates moving image data of a first format in which image data at each timing is arranged in time series without reducing the image size; and generated by the data processing unit Storage means for storing the first format moving image data in the storage medium, and extracting and storing the image data at the specified timing as the image data of one still image from the first format moving image data stored in the storage medium. Still image data generating means for storing in a medium or outputting to the outside of the apparatus is provided.

  According to such a configuration, after taking a moving image of a subject for a certain period, a still image at a desired timing in the shooting period can be cut out and stored as high-quality image data.

  Specifically, the moving image data in the first format is preferably a format in which image data having an image size of 720 pixels × 1280 pixels or more are arranged in time series. Here, as this image data, bitmap format image data, JPEG-compressed image data, or image data of various formats equivalent to these can be applied.

  With such a configuration, high-quality still image data can be obtained even when any frame in the moving image data is cut out as a still image.

  Desirably, a moving image data converting means for compressing and converting the first format moving image data stored in the storage medium into a second format moving image data having versatility and outputting the compressed data to the storage medium or outside the apparatus may be provided. .

  According to such a configuration, it is possible to cut out high-quality image data, but the non-universal first format moving image data can be converted into the versatile second format moving image data. Data can be played back by other general external devices, and moving image data can be stored with a high compression rate suitable for moving images and necessary and sufficient image quality suitable for moving images.

  Specifically, the moving image data in the second format is a compressed format having frame data in which differences between a plurality of consecutive frames are encoded and expressed, for example, MPEG2 format or H.264 format. H.264 format is preferable. The second format moving image data may be a moving image format having an image size smaller than that of the first format moving image data. With this configuration, it is possible to obtain easy-to-handle data with an appropriate data size as a moving image.

  More specifically, an operation input unit that inputs a command by an external operation, and a control unit that performs operation control of each unit based on the input content from the operation input unit, from the operation input unit, An imaging command, a command for taking out a still image, and a command for converting moving image data can be input, and when the imaging command is input from the operation input unit, the control unit The data processing means and the storage means are operated to store the first format moving image data in the storage medium, and the still image data generating means is operated when an instruction for taking out a still image is input from the operation input unit. When the moving image data conversion command is input from the operation input unit, the moving image data converting means is operated to compress and convert the moving image data of the second format. It may be configured so as to.

  According to such a configuration, at the time of shooting by shooting command operation, shooting is performed without being conscious of moving image shooting or still image shooting, and then necessary still images are cut out or converted into general-purpose moving image data. Thus, high-quality still image data and easy-to-handle video data can be obtained.

  As described above, according to the present invention, it is possible to obtain both moving image data and still image data at a desired timing during the shooting period, and still image data is included in the moving image data. Since a desired frame can be selected and cut out, the video at the moment of taking a still image is not missed. In addition, since the moving image data of the first format is stored at the time of shooting, there is an effect that high-quality still image data can be obtained in all frames.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing an overall configuration of a digital imaging apparatus according to an embodiment of the present invention.
The digital imaging device 1 of this embodiment is a device that takes an image by an electric signal, converts it into digital data, and records it. The digital imaging device 1 includes an imaging device 10 such as a CCD (charge coupled device) that captures an image by an electrical signal, and noise removal and gain control for the electrical signal captured by the imaging device 10 at predetermined intervals. AFE (Analog Front-End) 11 that samples and generates a digital image signal for every predetermined period, a microphone & AD converter 12 that inputs sound and converts it into digital data, and various types such as encoding of moving image data and extraction of still image data A data processing circuit 13 that performs the data processing, a storage device 14 that stores moving image data and still image data in a storage medium such as a hard disk, and a video output and storage device 14 that are in the middle of shooting, including a liquid crystal panel and its drive circuit, for example. Display unit 15 for displaying and outputting moving images and still images stored in the The system includes a speaker 16 to be performed, an operation input unit 17 having a plurality of operation buttons and the like and receiving an operation input from a user, and a non-volatile memory storing a CPU (Central Processing Unit) and a control program. It comprises a system controller 18 or the like as control means for performing control. Of these configurations, the image sensor 10 and the AFE 11 constitute a signal processing means.

The data processing circuit 13 constitutes data processing means, still image data generation means, and moving image data conversion means, and performs the following data processing 1-6.
1. The digital image signal sent from the AFE 11 is encoded in the JPEG format, arranged in time series, and the audio data sent from the microphone & AD converter 12 is superimposed, so that the HD format motion JPEG format moving image data as the first format 1. Encoding process for generating 2. Processing for sending a digital image signal sent from the AFE 11 and audio data sent from the microphone & AD converter 12 to the display unit 15 and the speaker 16 to perform video output and audio output. Motion picture data in HD quality MotionJPEG format is converted into MPEG2 or H.264 as the second format. 3. Data conversion processing for converting to moving image data in H.264 format 4. A process of converting (cutting out) a still image of a designated frame from HD motion picture data in Motion JPEG format into image data such as JPEG. 5. Processing for sending the generated data to the storage device 14 to store it or reading these data from the storage device 14 Reproduction processing in which moving image data and still image data read from the storage device 14 are combined and sent to the display unit 15 for display output, or audio data superimposed on the moving image data is converted to analog and sent to the speaker 16 for audio output.

  Here, the HD format MotionJPEG format is shown as the first format, but the digital image signal supplied from the AFE 11 is arranged in time series with the image data of each frame without reducing the image size. Any other data format may be applied as long as it is a progressive image data format. For example, it is also possible to apply a format in which bitmap format image data is arranged in time series without JPEG compression, or an MPEG2 moving image format in which all frames are made up of I pictures. In order to obtain a sufficient high quality as still image data, the image size of the image data at each timing is preferably 720 pixels × 1280 pixels or more.

  In addition, there is a case where trimming processing is performed to delete the outside of the frame of a predetermined image size from the digital image signal supplied from the AFE 11 for camera shake correction. However, such trimming processing does not correspond to the scale of the image size. Absent.

  Further, as the second format moving image data, MPEG2 or H.264 is used. Although the H.264 format is shown, it may be a general-purpose moving image format, and various other formats such as MPEG1 and MPEG4 can be applied. The image data cut out from the moving image data is not limited to the JPEG format, and may be image data in a bitmap format or other various formats.

  The system controller 18 executes a control program while receiving a signal from the operation input unit 17 and outputs a control signal to the data processing circuit 13 to perform a predetermined operation, or sends an operation signal to the AFE 11 or the display unit 15. Operation is controlled by outputting.

Next, the operation of the digital imaging apparatus 1 having the above configuration will be described with reference to the flowcharts of FIGS.
FIG. 2 is a flowchart of the mode selection process executed by the system controller 18, and FIG. 3 is a flowchart of the still image extraction process in step S4 of FIG.

  This mode selection process is started when the power is turned on or when the user performs a mode selection operation. In this mode selection process, first, an operation screen for mode selection is displayed on the display unit 15 to monitor input of key operations from the user (step S1). If there is a mode selection operation, the process branches to the selected operation mode (step S2).

  The digital imaging device 1 has a shooting mode for shooting, an operation mode for cutting out a still image, and a moving image conversion mode for converting a moving image format and storing it again in the storage device 14 as operation modes. If the shooting mode is selected, the process proceeds to the shooting process in step S3, the process proceeds to the still image cutting process in step S4 in which the still image extraction mode is selected, and if the moving image conversion mode is selected, the moving image conversion process in step S5 is performed. Migrate to

  When the process proceeds to the photographing process (step S3), first, the AFE 11, the data processing circuit 13, and the display unit 15 are operated, and the video signal captured by the image sensor 10 and the AFE 11 is sent to the display unit 15 for display output. Further, the video signal captured by the data processing circuit 13 is converted into a Motion JPEG format (first format) by using the user's shooting start operation as a trigger, and is superimposed on the audio data and stored in the storage device 14. Then, the generation and recording of the moving image data is stopped by an operation of stopping the shooting, and the moving image data output to the storage device 14 is fixed as one data file. Then, the photographing process is terminated by the user's photographing end operation.

  When the process proceeds to the still image cutout process (step S4), as shown in FIG. 3, first, the data processing circuit 13 and the display unit 15 are operated, and MotionJPEG moving image data stored in the storage unit 14 in the display unit 15 A file selection screen in which files are displayed in, for example, a thumbnail format is displayed, and any data file is selected by a user operation (step S11).

  When the data file is selected, the data processing circuit 13 starts the motion JPEG moving image data reproduction process and outputs the video to the display unit 15 (step S12). Further, while continuing this reproduction process, the selection operation of the frame to be cut out as a still image by the user is monitored (step S13). It should be noted that during this playback process, fast-forwarding, rewinding, pausing, slow playback, etc. of video playback may be possible.

  When the user performs an operation for selecting a cut-out frame, video display is temporarily stopped at the position of the frame (step S14), and the user is confirmed whether or not this frame image is cut out as still image data (step S15). If the user performs a YES operation, the process proceeds to a still image cutout process (step S16). If a NO operation is performed, the process returns to step S12 to reproduce the moving image data again from the paused position.

  When the process shifts to a still image cut-out process (step S16) by the user's YES operation, in this step, the data processing circuit 13 converts the data of the frame image into JPEG format image data, and the image data is converted into one data. The file is stored in the storage device 14 as a file.

  Then, the user confirms whether or not the still image extraction process is to be terminated by this still image extraction process, and if the YES operation is performed, the still image extraction process is terminated. If NO is performed, the process returns to step S12 again to continue the process of reproducing the moving image data.

  With the still image cutout process described above, the user can cut out a still image of a desired frame as high-quality image data and store it in the storage device 14 while playing back the captured moving image.

  In the moving image conversion process (step S5 in FIG. 2), first, the data processing circuit 13 and the display unit 15 are operated to select a file that displays a MotionJPEG moving image data file stored in the storage device 14 in, for example, a thumbnail format. The screen is output to the display unit 15 and any data file is selected by a user operation.

  When the data file is selected, the motion JPEG moving image data is read out from the storage device in the data processing circuit 13 and MPEG2 or H.264 is read. The data is again stored in the storage device 14 while being converted into the H.264 format. Then, when all the selected moving image data is converted, the moving image conversion process is terminated.

  By this moving image conversion processing, the size of the moving image data can be compressed into an easy-to-handle data file, or the moving image data can be transferred to an external general reproduction device and can be reproduced.

  Then, when the process of the selected operation mode is completed, the user is asked whether the mode selection process is to be terminated (step S6), and the mode selection process is terminated according to the user's operation, or again, Returning to the process of step S1, the mode selection process is repeated.

  As described above, according to the digital imaging device 1 of this embodiment, after shooting a subject for a certain period with the operation mode set to the shooting mode, a still image is captured at a desired timing in the shooting period by the still image cutting process. It can be cut out and saved as high-quality image data. Therefore, when a moving subject is photographed, the moment when a desired pose is obtained can be easily acquired as high-quality still image data.

  In addition, the moving image data stored in the storage device 14 by the shooting process is not versatile and has a low data compression rate. However, the moving image conversion process converts the moving image data into a format with high versatility and a high data compression rate. Easy to handle moving image data.

  Further, only the shooting mode for generating and storing the first format moving image data is provided as the shooting mode, and the shutter button for still image shooting is not provided, so that the user can take a picture without wondering which shooting mode to use when shooting. The effect that it can be performed is produced. Even in such a case, there is an effect that it is possible to generate moving image data in a desired format or a high-quality still image afterwards.

  The present invention is not limited to the above-described embodiment, and various modifications can be made. For example, in the above embodiment, a hard disk is exemplified as the storage device, but various storage devices such as a DVD (digital versatile disk) device capable of recording data and a large-capacity flash memory may be applied. I can do it. Further, the data file stored in the storage device may be externally output, and the cut out still image data and the format-converted moving image data may be directly output to the outside without being temporarily stored in the storage device. Also good.

  In the above embodiment, the apparatus has only the shooting mode for generating and storing the first format moving image data at the time of shooting. However, in addition to the above, the shooting mode for directly generating the second format moving image data at the time of shooting is added. Or a device having a still image shooting mode for directly generating still image data by shutter operation.

  In addition, the details described in the embodiment, such as the types of data formats of moving images and still images, and the specific processing contents shown in the flowchart, can be changed as appropriate without departing from the spirit of the invention.

1 is a block diagram illustrating an overall configuration of a digital imaging device according to an embodiment of the present invention. It is a flowchart which shows the procedure of the mode selection process performed by a system controller. It is a flowchart which shows the process sequence of the still image extraction process of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Digital imaging device 10 Imaging element 11 AFE (signal processing means)
13 Data processing circuit (data processing means, still image data generation means, moving image data conversion means)
14 Storage Device 15 Display Unit 17 Operation Input Unit 18 System Controller (Control Unit)

Claims (8)

Imaging means for imaging;
Signal processing means for taking in a signal supplied from the imaging means at a predetermined period and generating a digital image signal for each predetermined period;
Data that takes in digital image signals sequentially supplied from the signal processing means and generates moving image data of the first format in which image data having an image size of 720 pixels × 1280 pixels or more are arranged in time series without reducing the image size Processing means;
Storage means for storing, in a storage medium, moving image data of the first format generated by the data processing means;
Still image data generating means for extracting image data at a specified timing from the moving image data of the first format stored in the storage medium as image data of one still image and storing it in the storage medium or outputting it outside the apparatus;
The first format moving image data stored in the storage medium is converted to MPEG2 or H.264. Video data conversion means for compressing and converting the video data into a second format video data having versatility such as H.264, and storing the data in a storage medium or outputting the data to the outside of the apparatus;
An operation input unit for inputting a command by an external operation;
Control means for controlling the operation of each unit based on the input content from the operation input unit,
From the operation input unit, it is possible to input an imaging command, a command for taking out a still image, and a command for converting moving image data,
The control means includes
When an imaging command is input from the operation input unit, the signal processing unit, the data processing unit, and the storage unit are operated to store the first format moving image data in a storage medium, and the operation input unit When a still image extraction command is input from the above, the still image data generation means is operated to extract still image data, and when a moving image data conversion command is input from the operation input unit, A digital imaging apparatus, wherein a moving image data converting means is operated to compress and convert moving image data of the second format. Imaging means for imaging;
Signal processing means for taking in a signal supplied from the imaging means at a predetermined period and generating a digital image signal for each predetermined period;
Data processing means for taking in digital image signals sequentially supplied from the signal processing means and generating moving image data of a first format in which image data at each timing is arranged in time series without reducing the image size;
Storage means for storing, in a storage medium, moving image data of the first format generated by the data processing means;
Still image data generating means for extracting image data at a specified timing from the moving image data of the first format stored in the storage medium as image data of one still image and storing it in the storage medium or outputting it outside the apparatus;
A digital imaging device comprising:   3. The digital imaging apparatus according to claim 2, wherein the moving image data in the first format is a format in which image data having an image size of 720 pixels × 1280 pixels or more are arranged in time series.   Video data conversion means for compressing and converting video data of the first format stored in the storage medium into video data of the second format having versatility and storing it in the storage medium or outputting it to the outside of the apparatus is provided. The digital imaging device according to claim 2 or 3.   5. The digital imaging apparatus according to claim 4, wherein the moving image data in the second format is a compressed format having frame data in which differences between a plurality of consecutive frames are encoded and expressed.   The moving image data in the second format is MPEG2 format or H.264 format. The digital imaging apparatus according to claim 4, wherein the digital imaging apparatus is in a H.264 format.   7. The digital imaging apparatus according to claim 4, wherein the second format moving image data is a moving image format having an image size smaller than that of the first format moving image data. An operation input unit for inputting a command by an external operation;
Control means for controlling the operation of each unit based on the input content from the operation input unit,
From the operation input unit, it is possible to input an imaging command, a command for taking out a still image, and a command for converting moving image data,
The control means includes
When an imaging command is input from the operation input unit, the signal processing unit, the data processing unit, and the storage unit are operated to store the first format moving image data in a storage medium,
When a command for taking out a still image is input from the operation input unit, the image data of the still image is taken out by operating the still image data generating unit,
When a moving image data conversion command is input from the operation input unit, the moving image data conversion unit is operated to compress and convert the moving image data in the second format.
The digital imaging device according to claim 4, wherein the digital imaging device is a digital imaging device.

Images