JP2004120281A - Image editing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image editing apparatus for displaying a moving image so that the entire contents of the moving image can be grasped when displaying the moving image. <P>SOLUTION: This image editing apparatus forms a piece of index image from a moving image file a plurality of frame images are recorded so as to be joined. The apparatus is provided with a dividing number deciding means for deciding the dividing number of the index image, image size deciding means for deciding the image size of the index image, extracting means for extracting frame images from the image file by the number of pieces corresponding to the dividing number decided by the dividing number deciding means at predetermined intervals, re-sizing means for re-sizing the respective frame images on the basis of the decided image size and dividing number of the index images and the image size of the respective extracted images, and index image forming means for arranging the respective re-sized frame images in a predetermined order to form a piece of index image. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image editing apparatus, and more particularly to an image editing apparatus that allows easy selection of whether or not to reproduce a moving image.
[0002]
[Prior art]
In recent years, an electronic camera such as a digital camera has a moving image shooting function, and can record and reproduce still images and moving images. In this type of digital camera, it is possible to select an arbitrary file from a memory card or the like in which a file in which still images are recorded and a file in which moving images are recorded is stored, and to reproduce the still images or moving images. ing.
[0003]
For example, a system has been proposed in which a moving image recorded on a video recording medium can be easily searched, and only a still image for a moving image title can be automatically printed (see Patent Document 1).
[0004]
In addition, an electronic camera has been proposed in which video shot during continuous shooting is recorded so that it can be displayed on a single screen so that continuous shooting can be efficiently recorded on a recording medium without waste, and the video during continuous shooting can be played back on a single screen. (See Patent Document 2).
[0005]
[Patent Document 1]
JP-A-9-116854 [0006]
[Patent Document 2]
Japanese Patent Application Laid-Open No. 7-111627
[Problems to be solved by the invention]
However, among images taken by an electronic camera or the like, the content of a still image can be easily confirmed by thumbnail display, but the content of a moving image is often not easily confirmed only by thumbnail display.
[0008]
In addition, when displaying thumbnails as still images from moving image data, it is necessary to select and synthesize the necessary number of frames. Conventionally, this type of display has a low degree of freedom in selecting images. In many cases, it was not easy to grasp the contents.
[0009]
The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image editing apparatus capable of displaying so that the entire contents of the moving image can be grasped when the moving image is displayed during reproduction. To do.
[0010]
[Means for Solving the Problems]
In order to achieve the above object, the present invention provides an image editing apparatus for creating one index image from a moving image file in which a plurality of frame images are connected to each other. A number determining means, an image size determining means for determining an image size of the index image, an extracting means for extracting frame images from the moving image file at equal intervals by the number of divisions determined by the division number determining means, Resizing means for resizing each frame image based on the determined image size and the number of divisions of the index image and the image size of each extracted frame image, and arranging the resized frame images in a predetermined order Index image creating means for creating the one index image. To provide an image editing apparatus according to.
[0011]
According to the present invention, the image editing apparatus includes a division number determining unit, an extracting unit, a resizing unit, and an index image creating unit. With these configurations, the number of frames constituting the moving image and the arrangement of the frames are arranged. Since the display pixel number of the index image can be set, the entire contents of the moving image can be displayed so as to be easily grasped. That is, when the recording time is long, it is easy to grasp the entire content of the moving image by setting a larger number of frames constituting the moving image. On the other hand, when the recording time is short, there is no problem in grasping the content of the moving image even if the number of frames constituting the moving image is set to be small. In addition, since the number of display pixels of the index image can be set according to the number of frames constituting the moving image, it becomes easier to grasp the contents.
[0012]
Further, by making it possible to arbitrarily set the number of display pixels of the index image, it is possible to obtain an advantage that the image quality at the time of output to the printer can be selected to a desired level.
[0013]
In the present invention, it is preferable to have a recording unit that records the created index image on a recording medium as a still image file in association with the moving image file. That is, if the index image can be recorded as a still image file in association with the moving image file, the operation for reproducing the index image becomes easy.
[0014]
Further, in the present invention, there is provided means for determining an arrangement order of the extracted frame images, and the index image creating means arranges the resized frame images according to the determined arrangement order, and It is preferable to create one index image. That is, if the frames constituting the moving image are arranged according to the determined arrangement order, it becomes easier to grasp the content of the moving image.
[0015]
Further, in the present invention, there is provided range determination means for determining a range of a frame image for creating the index image from the moving image file, and the extraction means is the number of divisions determined by the division number determination means. It is preferable to extract frame images at regular intervals from the determined range of frame images. In other words, if a range determining means for determining the range of the frame image is provided, only a desired range of the moving image file can be reproduced. In addition, if the frame images can be extracted at regular intervals from this range, it becomes easier to grasp the contents of the moving image.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of an image editing apparatus according to the present invention will be described in detail with reference to the accompanying drawings. 1 and 2 are a front view and a rear view, respectively, showing the external appearance of an electronic camera (digital camera) to which the image editing apparatus according to the present invention is applied.
[0017]
As shown in these drawings, this electronic camera is a digital camera 1 capable of recording / reproducing moving images / still images. On the front surface of the camera, as shown in FIG. 1, a photographing lens 10, a finder window 12, and An auxiliary light emitting unit 14 is provided. As the auxiliary light emitting unit 14, a strobe device is used in the case of a camera dedicated to still images, and a white light emitting diode or lamp is used in the case of a camera also used as a moving image still image.
[0018]
On the other hand, on the back side of the camera, as shown in FIG. 2, a display panel 20 for displaying recording (time), date, remaining memory, viewfinder eyepiece 22, zoom button 24, menu key 26, execution key 28. A multifunction cross key 30, a cancel key 32, an image monitor 34, and a speaker 36 are provided.
[0019]
Further, as shown in FIGS. 1 and 2, a power switch / mode switch 40 and a shutter button / recording start / end button 42 are provided on the upper surface of the camera, and an earphone is further provided on the right side of the camera in FIG. A jack 44 and a recording medium insertion portion 46 are provided.
[0020]
The power switch / mode switch 40 has four positions: a neutral position in which the power is turned off, a position in which the power is turned on and in the still image shooting mode, a position in which the power is turned on and in the video shooting mode, and a power on and playback mode. Switch. Instead of the power switch / mode change switch 40, only the power ON / OFF switch may be used, and the still image shooting mode, the moving image shooting mode, and the playback mode may be switched with another mode dial or the like.
[0021]
FIG. 3 is a block diagram showing an internal configuration of the digital camera 1 shown in FIGS. The digital camera 1 includes a photographing lens 10, an auxiliary light emitting portion (strobe) 14, an image monitor 34, a multi-function cross key 30, an operation switch group 41 such as a power switch / mode switch 40, a shutter button / recording start / end. Button 42, shutter / aperture 50, imaging device 52 such as CCD, analog signal processing circuit 54, A / D converter 56, digital signal processing circuit 58, memory 60, compression / decompression circuit 62, built-in memory or memory card 64, drive The circuit 66, a CPU (central processing unit) 68, and the like are included.
[0022]
The CPU 68 comprehensively controls each circuit of the entire camera based on input signals from the operation switch group 41, the shutter button / recording start / end button 42, and the like. Now, when the power is turned on by the power switch / mode switch and the still image shooting mode or the moving image shooting mode is set, the still image or moving image is shot based on the operation of the shutter button / recording start / end button. When the playback mode is set, a still image or a moving image is played back.
[0023]
The light passing through the photographing lens 10 and the shutter / aperture 50 in the still image photographing mode or the moving image photographing mode is focused on the imaging device 52. Here, the shutter prevents light from entering the imaging device 52 and generating smear when reading a signal from the imaging device, but is not necessarily required depending on the configuration of the imaging device 52. In addition, the diaphragm can be a single diaphragm or a plurality of diaphragms that can be switched. The auxiliary light emitting unit 14 emits auxiliary light at low illuminance or forcibly to illuminate the subject. The auxiliary light emitting unit 14 may be auxiliary light other than the strobe light, or may be omitted if the sensitivity of the imaging device is high.
[0024]
The imaging device 52 is driven at a timing generated by a timing generation circuit (not shown) in the driving circuit 66 and outputs an image signal. The drive circuit 66 also includes drive circuits such as the photographing lens 10, the shutter / aperture 50, and the auxiliary light emitting unit 14.
[0025]
The image signal output from the imaging device 52 is subjected to analog signal processing by the analog signal processing circuit 54, then converted to a digital signal by the A / D converter 56, and added to the digital signal processing circuit 58, where digital processing is performed. Is given. The digitally processed image data is temporarily recorded in the memory 60. Here, by reading out the image data in the memory 60 and outputting it to the image monitor 34, a moving image or a still image can be displayed on the image monitor 34.
[0026]
The image data after photographing is compressed by the compression / decompression circuit 62 and recorded in the built-in memory or the memory card 64. Depending on the shooting mode, recording may be performed without the compression process. In the reproduction mode, the image data recorded in the built-in memory or the memory card 64 is decompressed by the compression / decompression circuit 62 and then output to the image monitor 34 via the memory 60, and the reproduced image is displayed on the image monitor 34. It has come to be.
[0027]
With the above configuration, the division number determining means for determining the number of divisions of the index image, the image size determining means for determining the image size of the index image, the frame image from the moving image file by the number of divisions determined by the division number determination means, etc. Extraction means for extracting at intervals, image size and number of divisions of the determined index image, resizing means for resizing each frame image based on the image size of each extracted frame image, and each frame image after resizing in a predetermined order Index image creating means for arranging and creating one index image is formed.
[0028]
In the digital camera 1 configured as described above, when the still image shooting mode is selected and the shutter button / recording start / end button 42 is pressed, an image for one frame is shot, and a file name is assigned to the image (still image). And recorded in the built-in memory or memory card 64. On the other hand, when the moving image shooting mode is selected and the shutter button / recording start / end button 42 is pressed, images are continuously shot at a predetermined frame rate until the shutter button / recording start / end button 42 is pressed again. The file name is attached to the continuous image (moving image) and recorded in the built-in memory or the memory card 64.
[0029]
When the moving image shooting mode is selected, this moving image is composed of, for example, 10 still images per second. Further, the shortest shooting time of a moving image may be set (for example, 3 seconds). In this case, the moving image is composed of 30 frames of still images. The pixels of each still image can be set to 2400 × 1800 pixels, for example.
[0030]
Note that the file in which the still image is recorded and the file in which the moving image is recorded are stored in the holder in the shooting order regardless of whether the file is a still image or a moving image. In the moving image shooting mode, sound can be recorded simultaneously by a sound recording means (not shown), and in a playback mode described later, it can be reproduced as a moving image with sound.
[0031]
Next, a case where a still image or a moving image recorded in the built-in memory or the memory card 64 is reproduced will be described.
[0032]
Image playback in the playback mode is performed with one frame playback, index playback for playing back an index image consisting of a plurality of frames (for example, 4 frames), and one frame of a moving image displayed during single frame playback or index playback. There is a moving image reproduction performed when an instruction to reproduce a moving image is given. As one frame of a moving image displayed at the time of frame advance or index reproduction in single frame playback, for example, the first frame of the moving image or one frame positioned about ½ of the entire length of the moving image can be considered. .
[0033]
When the playback mode is selected, one-frame playback is automatically performed, and one frame of the first file is selected and played back on the image monitor 34. Note that one frame of the last file may be reproduced on the image monitor 34. Here, when performing one-frame playback of another frame, the frame is advanced by the left / right key of the multifunction cross key 30. As a result, the playback images are sequentially advanced.
[0034]
When index reproduction is instructed, an index image consisting of a plurality of frames is displayed. On the index image, the frame to be reproduced can be selected with the up / down key and the left / right key of the cross key 30. The selected frame is trimmed and distinguished from other frames. When the up / down key and the left / right key of the cross key 30 are operated beyond the range of the index image, the index screen is switched.
[0035]
In the index reproduction, the number of frames constituting the moving image, the arrangement of the frames, and the number of display pixels can be arbitrarily set by each of the above-described units (division number determining unit, image size determining unit, etc.). As for the number of frames, 4 frames of 2 frames vertically and 2 frames horizontally (illustrated in FIG. 4), 9 frames of 3 frames vertically and 3 frames horizontally (illustrated in FIG. 5), 5 frames vertically and 5 frames horizontally 25 frame display can be selected. As the frame arrangement, a grid-like vertical and horizontal uniform arrangement (illustrated in FIGS. 4 and 5), an arrangement in which the size of the frame is reduced from the periphery of the screen toward the center in a spiral arrangement (not shown), etc. You can choose.
[0036]
Further, in index reproduction, the frames constituting the moving image can be set so as to be arranged at regular time-series intervals (illustrated in FIG. 4). In this case, an appropriate time series interval (every 5 frames in FIG. 4) is input and set according to the recording time of the moving image.
[0037]
In index reproduction, it is preferable to display time-sequentially frames constituting a moving image in a still image. That is, the frames that make up a movie are generally displayed in the same order as a horizontally written character string, usually from the upper left to the upper right, and then from the upper left second row to the upper right second row (see FIG. 4, illustrated in FIG. 5A), even in this case, if the time-series display of frames is performed, it becomes easier to grasp the contents of the moving image. Further, for example, when the frames constituting the moving image are arranged in a spiral (illustrated in FIG. 5B), the contents can be easily grasped if the frames are displayed in time series. become.
[0038]
Further, by making it possible to arbitrarily set the number of display pixels of a still image, there is also an advantage that the quality of an image when outputting to a printer can be selected to a desired level.
[0039]
As described above, the file in which the still image is recorded and the file in which the moving image is recorded are mixed and stored in the built-in memory or the memory card 64 according to the shooting order. A still image and a single frame of a moving image are displayed together. Similarly, in index reproduction, there are cases where a still image and a single frame of a moving image are mixedly displayed in the index image.
[0040]
In view of this, at the time of single frame playback or index playback, the still images and the single frame of the moving image are displayed in different display forms so that they can be intuitively distinguished.
[0041]
FIGS. 6 to 8 are diagrams showing index images displayed by changing the display form of still images and moving images during index reproduction.
[0042]
In the embodiment shown in FIG. 6, the still image 70 in the index image is displayed as an image with a white frame reminiscent of a photo, while the single frame image 72 is a movie film. Is displayed as an image in which perforations 72A are synthesized on both left and right ends of one frame. This makes it possible to intuitively recognize whether each frame in the index image is a still image or one frame of a moving image.
[0043]
In the embodiment shown in FIG. 7, the still image 70 in the index image is displayed as an image with a white frame as in the case of FIG. 6, while the image 74 showing the moving image has a motion in the image. Several frames constituting the moving image are repeatedly reproduced so as to occur. Note that the number of frames constituting the moving image is not limited to a continuous frame of the moving image, and may be a relatively long frame in order to emphasize the motion.
[0044]
In the embodiment shown in FIG. 8, the still image 76 and the single frame image 78 in the index image are each displayed as an image without a white frame. It is displayed to vibrate vertically. This vibration may give the impression that it is broken if it is randomly vibrated, so it can be vibrated finely or sometimes vertically, as when playing an old film such as 8 mm. You may make it give atmosphere to movement. By vibrating the screen in this way, it can be recognized that it is one frame of a moving image.
[0045]
Note that the perforation 72A synthesized with the one-frame image 72 of the moving picture in FIG. 6 may be synthesized with the image 74 showing the moving picture in FIG. 7 or the one-frame image 78 of the moving picture in FIG. In some cases, the perforation may move vertically.
[0046]
6 to 8, the still image and the moving image display form on the index image are shown. However, as described above, the still image and the moving image can be recognized even when one frame is reproduced. And the video are displayed in different display forms.
[0047]
Further, at the time of one-frame playback, one frame may be displayed as a still image, and a moving image may be displayed as a four-screen multi-image as shown in FIG. According to this, when one frame is displayed during frame-by-frame playback, a still image can be recognized as a moving image (four frames in a moving image) when a four-screen multi-image is displayed. .
[0048]
Next, a case of a multi-image showing a moving image (in this case, a 4-screen multi-image) will be described. As shown in FIG. 9, the four-screen multi-image is composed of the first frame image 80A, the intermediate frame images 80B and 80C, and the last frame image 80D of all the frames constituting the moving image. It is configured.
[0049]
For example, when the moving image is composed of 400 frames, each frame is divided into 4 frames, each divided into 1 to 100 frames, 101 to 200 frames, 201 to 300 frames, and 301 to 400 frames. A 4-screen multi-image is constructed from the selected 4 frames.
[0050]
Thus, by displaying the 4-screen multi-image related to the moving image like a four-frame cartoon, the contents of the entire moving image can be grasped before the moving image is reproduced.
[0051]
In this embodiment, a four-screen multi-image has been described. However, as described above, the number of frames constituting the multi-screen is not limited to four, and may be a nine-screen multi-image, for example. In this case, the nine-screen multi-image is formed by dividing all the frames constituting the moving image into nine equal parts, and taking out one frame from each of the nine divided frame groups.
[0052]
In addition, when a frame is framed or wiped during movie shooting, the first frame has no meaning, and the last frame may also have no meaning. A multi-image may be composed of frames obtained by removing the first plurality of frames and the last plurality of frames from the frames. The multi-image may be created in advance and recorded in association with the moving image file.
[0053]
Furthermore, in this embodiment, a multi-image is configured based on a plurality of frames that are appropriately extracted from all the frames of the moving image, and the multi-image is displayed. However, the present invention is not limited to this, and one of all the frames of the moving image is displayed. A multi-image may be configured based on a plurality of frames extracted from a predetermined range of the part, and the multi-image may be displayed. A plurality of frames may be repeatedly displayed at predetermined intervals. In particular, since one frame at the time of index reproduction is small, it is preferable to sequentially display a plurality of frames within one frame rather than displaying them on a multi-screen.
[0054]
Next, the procedure for reproducing images of still images and moving images will be described with reference to the flowchart shown in FIG.
[0055]
As shown in FIG. 10, when the playback mode is selected and the playback mode is started (step S10), as described above, one-frame playback is automatically performed, and the first file in the built-in memory or the memory card 64 ( The first frame) is selected (step S12).
[0056]
Whether the selected file is a still image file or a moving image file is automatically determined (step S14). If the selected file is a still image file, the still image is displayed on the image monitor 34 based on the image data of the file (step S14). Step S16). Thereafter, the operation of the left / right key of the multifunction cross key 30 selects whether to display the next frame or the previous frame (step S18). When the right key of the cross key 30 is operated, the next file (next frame) is selected (step S20), and then the process returns to step S14. When the left key of the cross key 30 is operated, the previous file is selected. Is selected (step S22), the process returns to step S14.
[0057]
On the other hand, if the selected file is a moving image file, a part of the moving image is reproduced based on the image data of the file (step S24). By partial playback of this moving image, perforation is synthesized and displayed on one frame of the moving image (see image 72 in FIG. 6), or several frames constituting the moving image are repeatedly displayed (see image 74 in FIG. 7), or One frame of the moving image is displayed so as to vibrate vertically (see image 78 in FIG. 8), or four frames in the moving image are displayed as a 4-screen multi-image (see FIG. 9).
[0058]
Here, the user is required to determine whether or not the mode of partial playback of the video is appropriate (step S25). If appropriate (change is not required), the process proceeds to the next step, and is inappropriate (change is required). The display mode is reset (step S25A). This loop is then turned until it is appropriate.
[0059]
Based on the partial playback of the video in step S24 and the display mode of the video in step S25, the user performs video playback that plays back all the frames of the video that has been partially played, or frames without playing the video. Whether to send is selected (step S26). When an instruction to select moving image playback is given, the moving image is continuously reproduced from the beginning to the end based on the image data of the selected moving image file (step S28). Thereafter, in step S30, it is selected whether to perform moving image reproduction again or frame-by-frame.
[0060]
In step S26 or step S30, when the right key of the cross key 30 is operated, after the next frame is selected (step S20), the process returns to step S14, and when the left key of the cross key 30 is operated, Is selected (step S22), the process returns to step S14.
[0061]
Note that after the partial playback of the video in step S24, the video playback is performed only when a video playback instruction is input, so that only the video that is desired to be played back can be selectively played back. Because. In addition, once the video playback is started, the load on the CPU increases, and it becomes impossible to quickly reflect the switch instruction to stop the video playback and frame advancement cannot be performed until the video playback ends. Because.
[0062]
As described above, the procedure of image reproduction of still images and moving images described with reference to the flowchart of FIG. 10 is an example, and other different modes can be adopted. For example, the digital camera 1 shown in FIG. 1 or the like is recorded in a built-in memory or a memory card 64 as a moving image with sound at the time of moving image shooting. Therefore, in order to make use of this function, it may be possible to appropriately select between video playback with audio and video playback without sound when playing a video with audio recorded in the built-in memory or memory card 64.
[0063]
Furthermore, it is also possible to select a still image with sound and a still image without sound even when the sound can be recorded even in the still image shooting mode and the sound can be reproduced during single frame playback of the still image.
[0064]
In this embodiment, the digital camera to which the image editing apparatus according to the present invention is applied has been described. However, the present invention is not limited to a digital camera, but an image reproducing apparatus having an image editing function or an apparatus including the image reproducing apparatus. The present invention can be applied to any apparatus as long as it is present.
[0065]
【The invention's effect】
As described above, according to the present invention, the division number determining means, the extracting means, the resizing means, and the index image creating means are provided. Can be set, and the number of display pixels of the index image can be set, so that the entire contents of the moving image can be displayed easily. That is, when the recording time is long, it is easy to grasp the entire content of the moving image by setting a larger number of frames constituting the moving image. On the other hand, when the recording time is short, there is no problem in grasping the content of the moving image even if the number of frames constituting the moving image is set to be small. In addition, since the number of display pixels of the index image can be set according to the number of frames constituting the moving image, it becomes easier to grasp the contents.
[0066]
Further, by making it possible to arbitrarily set the number of display pixels of the index image, it is possible to obtain an advantage that the image quality at the time of output to the printer can be selected to a desired level.
[Brief description of the drawings]
FIG. 1 is a front view showing an external appearance of a digital camera to which an image editing apparatus according to the present invention is applied. FIG. 2 is a rear view of the digital camera shown in FIG. FIG. 4 is a diagram showing an example of an index image. FIG. 5 is a diagram showing an example of an index image. FIG. 6 is a diagram of an index image displayed by changing the display form of a still image and a moving image during index playback. FIG. 7 is a diagram showing another example of an index image displayed by changing the display mode of still images and moving images during index playback. FIG. 8 is a display mode of still images and moving images during index playback. Fig. 9 is a diagram showing still another example of an index image displayed with different images. Fig. 9 is a diagram showing a moving image displayed as a 4-screen multi-image during frame-by-frame playback. Fig. 10 is an example of a procedure for reproducing still images and moving images. Flowchart DESCRIPTION OF SYMBOLS
DESCRIPTION OF SYMBOLS 1 ... Digital camera, 10 ... Shooting lens, 30 ... Multi-function cross key, 34 ... Image monitor, 36 ... Speaker, 40 ... Power switch / mode switch, 42 ... Shutter button / recording start end button, 44 ... Earphone jack 46 ... Recording medium insertion section, 52 ... Imaging device, 54 ... Analog signal processing circuit, 58 ... Digital signal processing circuit, 64 ... Built-in memory or memory card, 68 ... CPU (central processing unit), 70,76 ... Still image 72, 78 ... one frame image of a movie, 72A ... perforation, 74 ... an image showing a movie, 80A-80D ... each frame image of a 4-screen multi-image showing a movie

Claims (4)

In an image editing apparatus for creating one index image from a moving image file in which a plurality of frame images are connected and recorded,
Division number determining means for determining the number of divisions of the index image;
Image size determining means for determining an image size of the index image;
Extraction means for extracting frame images from the moving image file at equal intervals by the number of divisions determined by the division number determination means;
Resizing means for resizing each frame image based on the image size and number of divisions of the determined index image and the image size of each extracted frame image;
Index image creating means for creating the one index image by arranging the resized frame images in a predetermined order;
An image editing apparatus comprising: The image editing apparatus according to claim 1, further comprising a recording unit that records the created index image on a recording medium as a still image file in association with the moving image file. The index image creating means creates the one index image by arranging the resized frame images in accordance with the determined order of arrangement. The image editing apparatus according to claim 1 or 2. A range determining unit that determines a range of a frame image for creating the index image from the moving image file; The image editing apparatus according to claim 1, wherein frame images are extracted from the range at equal intervals.

Images