JP4300959B2 - Electronic camera and image editing apparatus and method - Google Patents

Description

  The present invention relates to an electronic camera and an image editing apparatus and method, and more particularly to an electronic camera such as a digital camera or a video camera capable of capturing a moving image, and image editing for editing image data generated by the electronic camera. The present invention relates to an apparatus and a method.

  When taking a video with a digital camera or a video camera and recording it on a recording medium, high compression MPEG is preferable in consideration of recording as many images as possible on the recording medium. Recently, a high compression format such as MPEG2 has been adopted. Models are starting to enter the market.

  However, when images recorded in MPEG2 are imported and edited on a personal computer or the like, the image quality deteriorates significantly if a process such as wiping is performed at the in and out points when connecting a series of moving images, or if a title is applied. There is a problem that there is a tendency to. This is because MPEG2 is highly compressed, and therefore, when a part of moving image data is edited, it must be decompressed and re-rendered.

A video camera that records and reproduces a video by selecting a video compression method from two or more video compression methods according to the application using a changeover switch is disclosed (see Patent Document 1 below). However, a technique for automatically generating data that can be easily edited on a personal computer after recording is not disclosed.
Japanese Patent Laid-Open No. 10-174032

  In consideration of the above-described facts, the present invention provides an electronic camera that automatically generates data that can be easily edited on a personal computer or the like after recording, while recording a moving image with high compression, and an image for editing the generated moving image data An object is to provide an editing apparatus and method.

The present invention is an electronic camera for obtaining a video data using the imaging means, of Jo Tokoro time video co begin to record the high-compression data of a moving image when you start capturing a moving image by the image pickup means low compression data is also recorded, an electronic camera having a recording means that records the low compression data also moving images such termination predetermined time before the imaging is completed the series of moving images, consisting of.

  According to the present invention, high-compressed data and low-compressed data of a moving image are recorded for a predetermined time from the start of moving image capturing, and only high-compressed data is recorded after a predetermined time has elapsed, and when a series of moving image capturing ends High compression data and low compression data of a moving image are recorded for a predetermined time before the end.

  By storing the low-compression data of the moving image for a predetermined time in the storage unit at all times after the start of imaging, the low-compression of the moving image is also performed for a predetermined time before the end when a series of moving images are captured. Data can be recorded.

Furthermore, the present invention provides an image editing apparatus for editing a plurality of series of moving images, recorded a series of high-compression data and said series of predetermined time and end before the predetermined time from the start of the moving image of the moving image If the set of low compression data recorded there are a plurality of the predetermined time from the start of the series of moving images and first selecting means for selecting the low compressed data, after a predetermined time has elapsed from the start Second selection means for selecting the high compression data of the series of moving images after the predetermined time has elapsed following the low compression data, and the predetermined time before the end recorded the predetermined time before the end following the high compression data. A third selection means for selecting low-compression data, and a fourth selection for selecting low-compression data recording a predetermined time from the start instead of selecting high-compression data for a predetermined time from the start of the next series of moving images. And means, an image editing device consisting, consisting.

  According to the present invention, low-compression data is selected at the beginning and end of a series of moving images when editing a plurality of series of moving images.

  According to the present invention, when connecting a series of moving images when a plurality of recorded moving images are edited, the beginning and end portions of the series of moving images are recorded even with low-compression data. A connection portion between a moving image and a series of moving images can be connected using low-compression data, and deterioration in image quality can be minimized even at the connection portion.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  First, an external configuration of the digital camera 10 according to the present embodiment will be described with reference to FIG.

  As shown in the figure, the front of the digital camera 10 is provided with a lens 12 for forming a subject image and a viewfinder 70 used for determining the composition of the subject to be photographed. Further, on the upper surface of the digital camera 10, a release button (so-called shutter) 60 that is pressed by a user when shooting is performed, and a power switch 66 are provided.

  Note that the release button 60 according to the present embodiment is in a state where the release button 60 is pressed down to an intermediate position (hereinafter referred to as “half-pressed state”) and a state where the release button 60 is pressed down to a final pressed position beyond the intermediate position (hereinafter, referred to as “lower pressed state”). It is configured to be able to detect a two-stage pressing operation of “fully pressed state”.

  In addition, the digital camera 10 according to the present embodiment is configured so as to be able to shoot still images as well as moving images. When shooting still images, the release button 60 is set. When half-pressed, the AE (Automatic Exposure) function works and the exposure state (shutter speed, aperture) is set, then the AF (Auto Focus) function works Then, exposure (photographing) is performed when the shutter button is fully pressed thereafter.

  On the other hand, when shooting a moving image, shooting of the moving image is started by setting the release button 60 to a fully-pressed state. When the fully pressed state is set, the moving image is stopped. As described above, in the digital camera 10 according to the present embodiment, the release button 60 is fully pressed when moving image shooting is started, and the release button 60 is again fully pressed when shooting is stopped. However, the present invention is not limited to this, and it is also possible to take a moving image while the release button 60 is fully pressed.

  On the other hand, on the back of the digital camera 10, a liquid crystal display (hereinafter referred to as “the eyepiece” of the finder 70 and a subject image, various menu screens, messages, etc. indicated by the digital image data obtained by photographing). 30), a shooting mode that is a mode for performing shooting, and a playback mode that is a mode for displaying (reproducing) a subject image indicated by digital image data obtained by shooting on the LCD 30. A total of five mode changeover switches 62 operated for setting, four arrow keys indicating the four directions of movement in the upper, lower, left, and right directions in the display area of the LCD 30, and a determination key positioned at the center of the four arrow keys A cross-cursor button 64 including one key and a display changeover switch 68 are provided. .

  On the other hand, on the bottom surface of the digital camera 10, a receptacle 72 used for electrical connection with an external device by a predetermined interface standard (USB (Universal Serial Bus) in this embodiment) is provided.

  Next, the configuration of the digital camera 10 according to the present embodiment will be described with reference to FIG.

  As shown in FIG. 2, the digital camera 10 includes an optical unit 13 including the lens 12 described above, a CCD 14 disposed behind the optical axis of the lens 12, and a correlated double sampling circuit (hereinafter, “ CDS ”) 16 and an analog / digital converter (hereinafter referred to as“ ADC ”) 18 for converting the input analog signal into digital data, and the output terminal of the CCD 14 is the CDS 16. The output terminal of the CDS 16 is connected to the input terminal of the ADC 18.

  Here, the correlated double sampling processing by the CDS 16 is a feed included in the output signal for each pixel of the solid-state image sensor for the purpose of reducing noise (particularly thermal noise) included in the output signal of the solid-state image sensor. This is processing for obtaining accurate pixel data by taking the difference between the through component level and the pixel signal component level.

  On the other hand, the digital camera 10 has a line buffer having a predetermined capacity and an image input controller 20 that performs control for directly storing input digital image data in a predetermined area of a second memory 40 described later, and the digital image data. An image signal processing circuit 22 that performs various image processing, and an MPEG compression / decompression processing circuit 23 that performs compression processing on the digital image data in the MPEG compression format and performs expansion processing on the compressed digital image data. The digital image data is compressed in JPEG or Motion JPEG compression format, while the compressed digital image data is decompressed (Motion) by the JPEG compression / decompression processing circuit 24 and the digital image data. Displayed images and menu screens on the LCD 30 A video / LCD encoder 28 that generates a video signal indicating an image to be displayed on the LCD 30 (in this embodiment, an NTSC signal) and outputs it to the video output terminal OUT. , Including. The input terminal of the image input controller 20 is connected to the output terminal of the ADC 18.

  In addition, the digital camera 10 includes a CPU (central processing unit) 32 that controls the operation of the entire digital camera 10 and physical quantities required to operate the AF function (in this embodiment, an image obtained by imaging with the CCD 14). The brightness of the image obtained by imaging by the CCD 14 in this embodiment, and the AF detection circuit 34 for detecting the contrast value), and the AE function and the AWB (Automatic White Balance) function. An AE / AWB detection circuit 36 for detecting the amount of the first memory 38, a first dynamic random access memory (SDRAM) used as a work area when the CPU 32 executes various processes, and a first memory 38. A second memory 40 configured by a VRAM (VideoRAM) for storing the obtained digital image data, and a ring dedicated to the AVI file for temporarily storing the digital moving image data obtained by shooting in the Motion JPEG format And a third memory 39 composed of a buffer.

  Further, the digital camera 10 includes a media controller 42 for enabling the digital camera 10 to access the recording medium 42A configured by smart media (Smart Media (registered trademark)) and the recording medium 42B in the microdrive, and the receptacle described above. And a USB interface 46 for controlling communication with the outside according to the USB standard.

  Image input controller 20, image signal processing circuit 22, MPEG compression / expansion processing circuit 23, (Motion) JPEG compression / expansion processing circuit 24, video / LCD encoder 28, CPU 32, AF detection circuit 34, AE / AWB detection circuit 36, the first memory 38, the second memory 40, the third memory 39, the media controller 42, and the USB interface 46 are connected to each other via a bus BUS.

  Accordingly, the CPU 32 controls the operations of the image input controller 20, the image signal processing circuit 22, the MPEG compression / decompression processing circuit 23, the (Motion) JPEG compression / decompression processing circuit 24, and the video / LCD encoder 28, and AF. Acquisition of physical quantities detected by the detection circuit 34 and the AE / AWB detection circuit 36, access to the first memory 38, the second memory 40, the third memory 39, the recording medium 42A, and the recording medium 42B, and the receptacle 72 Mutual communication with the connected external device can be performed.

  In the present embodiment, a case where a personal computer (hereinafter referred to as “PC”) 90 is applied as an external device will be described.

  In the present embodiment, digital image data of still images obtained by shooting is recorded as a JPEG-compressed image file on the recording medium 42A and the recording medium 42B in the shooting order when the remaining recording capacity of the recording medium 42A is exhausted. The

  In this embodiment, digital image data of a moving image obtained by shooting is recorded as an MPEG compressed image file on the recording medium 42B in the order of shooting when the remaining recording capacity of the recording medium 42A and the recording medium 42A is exhausted. .

  In addition, the digital image data of the moving image at the beginning and end of a series of moving images obtained by shooting is recorded on the recording medium 42A and the recording medium 42A as a motion JPEG compressed image file separately from the MPEG compressed image file. When the capacity runs out, it is recorded on the recording medium 42B in the shooting order.

  On the other hand, the digital camera 10 is provided with a timing generator 48 that mainly generates a timing signal for driving the CCD 14 and supplies the timing signal to the CCD 14. The input terminal of the timing generator 48 is connected to the CPU 32 and the output terminal is connected to the CCD 14. The driving of the CCD 14 is controlled by the CPU 32 via the timing generator 48.

  Further, the CPU 32 is connected to an input terminal of the motor drive unit 50, and an output terminal of the motor drive unit 50 is connected to a focus adjustment motor, a zoom motor, and an aperture drive motor provided in the optical unit 13.

  The lens 12 included in the optical unit 13 according to the present embodiment has a plurality of lenses, and is configured as a zoom lens that can change (magnify) the focal length, and includes a lens driving mechanism (not shown). Yes. The lens drive mechanism includes the focus adjustment motor, the zoom motor, and the aperture drive motor. The focus adjustment motor, the zoom motor, and the aperture drive motor are each supplied with a drive signal supplied from the motor drive unit 50 under the control of the CPU 32. Driven by.

  When changing the optical zoom magnification, the CPU 32 controls the zoom motor to change the focal length of the lens included in the optical unit 13.

  Further, the CPU 32 performs focusing control by driving and controlling the focus adjustment motor so that the contrast value of the image obtained by imaging by the CCD 14 is maximized. In other words, the digital camera 10 according to the present embodiment employs a so-called TTL (Through The Lens) method in which the lens position is set so that the contrast of the read image is maximized as the focus control. .

  Further, the various buttons and switches of the release button 60, the mode switch 62, the cross cursor button 64, the power switch 66, and the display switch 68 described above are connected to the CPU 32. You can always know the operating status of the switches.

  The operation of the digital camera 10 according to the present embodiment will be described.

  First, the operation of the digital camera 10 during shooting will be briefly described.

  Signals (still images and moving images) indicating the subject image output from the CCD 14 by imaging via the optical unit 13 are sequentially input to the CDS 16 and subjected to correlated double sampling processing, and then input to the ADC 18. The ADC 18 receives the CDS 16. The R (red), G (green), and B (blue) signals input from are converted into 12-bit R, G, and B signals (digital image data), respectively, and output to the image input controller 20.

  The image input controller 20 accumulates digital image data sequentially input from the ADC 18 in a built-in line buffer and temporarily stores it in a predetermined area of the second memory 40.

  Digital image data stored in a predetermined area of the second memory 40 is read out by the image signal processing circuit 22 under the control of the CPU 32, and a digital gain corresponding to the physical quantity detected by the AE / AWB detection circuit 36 is added to these. In addition to white balance adjustment, gamma processing and sharpness processing are performed to generate 8-bit digital image data, and further YC signal processing is performed to obtain luminance signal Y and chroma signals Cr and Cb (hereinafter referred to as “YC signal”). And the YC signal is stored in an area different from the predetermined area of the second memory 40.

  The LCD 30 is configured so that it can display a moving image (through image) obtained by continuous imaging by the CCD 14 and can be used as a finder. In this way, the LCD 30 is used as a finder. The generated YC signal is sequentially output to the LCD 30 via the video / LCD encoder 28. As a result, a through image is displayed on the LCD 30.

  Here, when still image shooting is set by the user, when the release button 60 is fully pressed by the user, the YC signal stored in the second memory 40 at this time is expressed as (Motion). After being compressed in the JPEG format by the JPEG compression / decompression processing circuit 24, it is recorded on the recording medium 42 </ b> A via the media controller 42.

  In addition, when moving image shooting is set by the user, a period from when the release button 60 is fully pressed to the next time when the release button 60 is fully pressed, that is, shooting of a moving image. In a period during which the YC signal is stored in the second memory 40 every predetermined period (in this embodiment, 1/30 second (0.033...)), MPEG compression / decompression processing is performed. After being compressed in the MPEG format by the circuit 23, it is recorded on the recording medium 42A via the media controller 42. Therefore, when a moving image is shot with the digital camera 10 according to the present embodiment, a moving image of 30 frames / second can be recorded on the recording medium 42A. That is, when shooting a moving image, a period from the time when the release button 60 is fully pressed to the next time when the release button 60 is fully pressed, that is, a period during which moving image shooting is performed. Data compressed in the MPEG format, which is a much higher compression format, is recorded on the recording medium 42A.

  In this embodiment, when moving images are captured, data compressed in the Motion JPEG format, which is a low-compression format, is also recorded via the media controller 42 for 5 seconds after the release button 60 is fully pressed. Recorded on the medium 42A. At this time, the data of the AVI file compressed in the Motion JPEG format for a fixed time from the time when the release button 60 is fully pressed is stored in the third memory 39 formed of a ring buffer. As a result, when the release button 60 is fully pressed during moving image shooting, the AVI format data for 5 seconds immediately before the release button 60 is fully pressed can be recorded on the recording medium 42A. Record data for seconds.

  That is, as shown in FIG. 4, MPEG data is recorded on the recording medium 42 </ b> A in moving image cut 1 from when the release button 60 is fully pressed to start moving image shooting until the next release button 60 is fully pressed. In addition, Motion JPEG AVI data is recorded on the recording medium 42A for 5 seconds after the start of moving image shooting and for 5 seconds before the end of moving image shooting. Next, the moving image data is recorded in the MPEG format and the Motion JPEG format in the same format and time even in the moving image cut 2 from when the release button 60 is fully pressed to start moving image shooting and until the release button 60 is fully pressed. 42A is recorded.

  As shown in FIG. 5, the moving image data compressed in the MPEG format includes a plurality of GOPs (Group Of Pictures) in a moving image cut that is a series of moving image data. For example, “DSCF001.MPG” Give the file a name like The AVI file that stores data compressed in the Motion JPEG format includes GOP address information indicating which GOP the AVI file should be placed in when editing moving image data in the header information of the AVI file. For example, a file name “IN0001.AVI” is given for 5 seconds after the start of moving image shooting, and a file name “OUT0001.AVI” is given for 5 seconds before the end of moving image shooting. Is attached. The next moving image cut MPEG file may have a file name such as “DSCF002.MPG”, for example.

  The time for creating the MotionJPEG AVI file is not limited to 5 seconds after the start and 5 seconds before the end, but may be any time, for example, 3 seconds or 7 seconds instead of 5 seconds.

  A case will be described in which editing is performed by connecting a plurality of moving image cuts of moving image data recorded in the above-described form. In the present embodiment, editing is performed on the personal computer 90.

  FIG. 3 is a block diagram showing a hardware configuration of the personal computer 90. As shown in FIG. 3, the personal computer 90 includes a central processing unit (CPU) 210 that mainly controls the operation of each component, a main memory 212 that stores a control program for the device, and that serves as a work area when the program is executed. , An operating system (OS) of the personal computer 90, various application software including device drivers of peripheral devices connected to the personal computer 90, a hard disk device 214 storing user images, a CD-ROM drive 216, and a display As a display memory 218 for temporarily storing data, a monitor device 220 such as a CRT monitor or a liquid crystal monitor for displaying an image or a character by image data, character data, etc. from the display memory 218, a keyboard 222, and a position input device Mouse 224 and monitor the state of mouse 224 A mouse controller 226 that outputs signals such as the position of the mouse pointer on the device 220 and the state of the mouse 224 to the CPU 210, a USB (Universal Serial Bus) cable 206 that can be connected to the digital camera 10 and can input image data, etc. An interface 227 for connection, a communication interface 208 for connection to the Internet network, and a bus 228 for connecting the above components are configured.

  In the personal computer 90 having the above-described configuration, each component is well-known, and a detailed description of each component will be omitted.

  A case where editing is performed by connecting a plurality of moving image cuts, for example, moving image cut 1 which is a series of moving image data and moving image cut 2 which is a series of moving image data, will be described with reference to FIGS.

  First, MPEG data and AVI data of moving image cut 1 and MPEG data of moving image cut 2 recorded on the recording medium 42A through the USB interface 46 of the digital camera 10, the receptacle 72, the USB cable 206 of the personal computer 90, and the interface 227. And the AVI data are stored in the hard disk device 214 of the personal computer 90.

  When the moving image cut 1 and the moving image cut 2 are a series of moving image cuts 3, first, the AVI file composed of Motion JPEG of the moving image cut 1 is positioned at the head of the moving image cut 3.

  Since the first AVI file is composed of Motion JPEG, it is easy to edit and there is little deterioration in image quality even when editing. It is also possible to insert the title of the video cut 3 or the like in this AVI file. Next to the first AVI file is MPEG data (“DSCF0001.MPG” in FIG. 5) excluding the GOP for moving image data corresponding to the AVI file.

  The moving image data for 5 seconds before the end of the moving image cut 1 is positioned next to the MPEG data “DSCF0001.MPG” file in which the AVI file (“OUT0001.AVI” in FIG. 5) is positioned in the moving image cut 3. However, DSCF0001. Since the GOP for the last 5 seconds of the “MPG” file is a moving image that overlaps with the AVI file, the “OUT0001.AVI” file indicates which GOP is the AVI file written in the header of “OUT0001.AVI”. It is positioned after the GOP to be continued from the GOP address information indicating whether it should be placed after the GOP. That is, the address of the portion immediately before the moving image data GOP for the last 5 seconds of “DSCF0001.MPG” is written. The moving image data GOP for the last 5 seconds of “DSCF0001.MPG” is not used for the moving image cut 3.

  In moving image cut 3, the “IN0002.AVI” file is positioned after the “OUT0001.AVI” file. The “IN0002.AVI” file stores the same moving image data as the first five seconds of moving image data of the moving image cut 2 MPEG data “DSCF0002.MPG” file. The “IN0002.AVI” file is positioned after the GOP to be followed from the GOP address information indicating which GOP the AVI file written in the header of “IN0002.AVI” should be placed after. That is, the address of the end portion of the moving image data GOP for the first 5 seconds of “DSCF0002.MPG” is written. The moving image data GOP for the first 5 seconds of “DSCF0002.MPG” is not used for the moving image cut 3.

  Next to the “IN0002.AVI” file positioned in the moving image cut 3, the “DSCF0002.MPG” file excluding the first 5 seconds is positioned. In the movie cut 3, the AVI file of the last 5 seconds of the movie cut 2 is positioned in the last 5 seconds of the movie cut 2 as in the case of the movie cut 1. An ending title or the like can be inserted into the AVI file positioned at the end of the video cut 3.

  The AVI files “OUT0001.AVI” and “IN0002.AVI” files positioned in the movie cut 3 take into account the movie cut content and continuously express the movie content without a sense of incongruity. Can be formed. Since both AVI files are made up of MotionJPEG and can be managed in units of frames, this is possible because of the advantage that image quality is easy to edit and there is little deterioration in image quality.

  Further, as shown in FIG. 6, the “OUT0001.AVI” file and the “IN0002.AVI” file can be connected by the moving image cut 3 even if the moving image contents are shifted in time.

  With this form, it is easy to insert a title at the beginning of the edited video cut 3, to form an effect part at the part that connects a series of moving image data, and to insert a title at the end part while maintaining high quality image quality Because it is done automatically, the resulting video can be very enjoyable and worth watching.

  By applying the present invention, even a moving image camera using MPEG compression with a small recording medium can edit a shot video with high quality.

The figure which showed the external appearance of the digital camera. The block diagram which showed the structure of the digital camera. The block diagram which showed the hardware constitutions of the personal computer. The whole conceptual diagram at the time of connecting animation cuts. The figure which showed the file structure of the MPEG format moving image data at the time of connecting moving image cuts, and the file structure of Motion JPEG format moving image data. The figure which showed the file structure of the MPEG format moving image data at the time of connecting moving image cuts, and the file structure of Motion JPEG format moving image data, and the figure which showed the example which the moving image data to connect has shifted | deviated temporally.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Digital camera, 23 ... MPEG compression / decompression processing circuit, 24 ... (Motion) JPEG compression / decompression processing circuit, 32 ... CPU, 39 ... Third memory, 42 ... Media controller, 42A ... Recording medium, 42B ... Recording medium , 60 ... Release button, 90 ... Personal computer

Claims (4)

An electronic camera that obtains moving image data using an imaging means,
The high-compression data of the moving image from the start of imaging to the end of imaging is recorded, and the low-compression data of the moving image for a predetermined time from the start of imaging and the end of imaging are instructed. An electronic camera having recording means for recording low-compression data of a moving image for a predetermined time before recording. An electronic camera that records moving image data captured using an imaging unit in a storage unit and then records the data in a recording unit,
Storing low compression data of a moving image at normal time predetermined time in the storage means when starting the imaging of a moving image of high compressed data of the moving image co begins to record in the recording means by said image pickup means, moving image a series of the image pickup of the moving image is completed the finished before the predetermined well as recorded before type recording means low compression data of a moving image of a predetermined time after the start of imaging utilizing storing a low compression data in the storage means An electronic camera characterized in that low-compression data of a moving image is recorded in the recording means over time. An image editing apparatus for editing a series of moving images,
High-compressed data of a series of recorded moving images and low-compressed data of moving images for a predetermined time from the start of a predetermined time and a predetermined time before the end of the series of moving images are always stored in the storage means. If there are multiple sets of low-compression data recorded by letting
A first selection means for selecting the low-compression data for the predetermined time from the start of the series of moving images;
A second selection means for selecting the high compression data of the series of moving images after the predetermined time has elapsed following the low compression data after the predetermined time has elapsed since the start;
A third selection means for selecting low-compressed data in which the predetermined time before the end records the predetermined time before the end following the high-compression data;
A fourth selection means for selecting low compression data recording a predetermined time from the start instead of selecting high compression data for a predetermined time from the start of the next series of moving images;
An image editing apparatus comprising: An image editing method for editing a series of moving images,
High-compressed data of a series of recorded moving images and low-compressed data of moving images for a predetermined time from the start of a predetermined time and a predetermined time before the end of the series of moving images are always stored in the storage means. If there are multiple sets of low-compression data recorded by letting
The predetermined time from the start of the series of moving images selects the low-compression data,
After elapse of a predetermined time from the start, select the high compression data of the series of moving images after the elapse of the predetermined time following the low compression data,
The predetermined time before the end selects the low compression data recorded the predetermined time before the end following the high compression data,
An image editing method for selecting low-compressed data recording a predetermined time from the start instead of selecting high-compressed data for a predetermined time from the start of the next series of moving images.

Images