JP4610239B2 - Still image extraction apparatus and moving image imaging apparatus - Google Patents

Description

  The present invention relates to a still image extraction device that extracts and records a desired still image from a reproduced moving image, and a moving image imaging device including the still image extraction device.

  2. Description of the Related Art A moving image pickup apparatus having a conventional still image extraction device, such as a digital video camera, a digital still camera having a moving image recording / reproducing function, reproduces a recording / reproducing unit that reproduces a moving image recorded on a recording medium, and a recording / reproducing unit. A display unit for displaying a moving image to be displayed. The moving image is composed of a plurality of still images that are separated in time by a certain time interval, and the plurality of still images are displayed on the display unit at, for example, 30 frames / second and reproduced as a moving image.

  The moving image capturing apparatus further includes a capture button for extracting a desired still image from the moving image that is reproduced and displayed on the display unit. When the capture button is pressed, one still image displayed on the display unit when the capture button is pressed is specified, and the specified one still image is recorded on the recording medium as a still image file.

According to the moving image pickup apparatus configured as described above, a desired still image is extracted from a moving image by pressing the capture button when the desired still image is displayed on the display unit, and the extracted still image is converted into a still image. It can be recorded on a recording medium as a file.
JP 2001-245208 A

  However, since the moving image displayed on the display unit displays time-series still images sequentially, for example, every 1/30 seconds = approximately 0.03 seconds, the user of the moving image capturing apparatus recognizes the desired image. Even when the capture button is pressed, there is a possibility that the timing for extracting a still image may be shifted, and there is a problem that a desired still image cannot be extracted and recorded. For example, when a desired still image is extracted from a moving image including a person, an image including a person who blinks and closes his eyes may be recorded as a still image. In this case, it is necessary to try to extract and record a still image by reproducing the moving image again.

  The present invention has been made in view of such circumstances, and displays a juxtaposed image obtained by reducing and juxtaposing a plurality of still images before and after the moment when a designation button for accepting designation of one still image is pressed. Means for selecting a still image desired to be recorded from the juxtaposed images, and configured so that the selected still image can be recorded in accordance with a specific standard related to recording of the still image, thereby pressing the designation button. It is an object of the present invention to provide a still image extraction device capable of recording a desired still image in accordance with a specific standard and a moving image imaging device including the still image extraction device even when the image is shifted.

  Further, by configuring the still image desired to be recorded on a recording medium in accordance with the DCF standard, the still image recorded on the recording medium can be played back on another device that conforms to the DCF standard. It is another object of the present invention to provide an extraction device and a moving image imaging device including the still image extraction device.

  Further, the image processing apparatus includes a synthesis unit that identifies a plurality of still images before and after the moment when a designation button for accepting designation of one still image is pressed, and generates a synthesized still image by combining any or all of the identified still images. Thus, it is possible to provide a still image extraction device capable of generating a composite still image that allows a change in the image of a specified still image to be visually recognized with one image, and a moving image imaging device including the still image extraction device. The purpose.

  Furthermore, the composing unit is configured to generate a composite still image having, for each pixel, an average value of pixel values obtained from pixel values of a plurality of still images before and after the moment when the designation button is pressed. It is another object of the present invention to provide a still image extraction device that can easily generate a composite still image only by addition and division and a moving image imaging device including the still image extraction device.

  Furthermore, the luminance of each of the corresponding pixels of the plurality of still images to be combined is compared, and a combined still image having an average value of the pixel values related to the maximum or minimum luminance for each pixel is generated. Another object of the present invention is to provide a still image extraction device that can easily generate a composite still image by only comparing, adding, and dividing luminance, and a moving image imaging device including the still image extraction device. To do.

  Furthermore, a still image at the moment when the designation button is pressed, and a juxtaposed image obtained by reducing and juxtaposing the still images separated by a predetermined time interval before and after the still image are displayed. By configuring so that still images desired to be recorded can be selected, even if there is little change between time-series still images, a plurality of still images separated by a longer time than a certain time can be selected. Another object of the present invention is to provide a still image extraction device capable of selecting and recording a desired still image from the above and a moving image imaging device including the still image extraction device.

  Furthermore, a still image at the moment when the designation button is pressed, and a juxtaposed image obtained by reducing and juxtaposing the still images separated by the predetermined time or more before and after the still image are displayed, and the displayed juxtaposed image is displayed. Before and after the selected still image, the time-series still images separated from each other by an interval shorter than the above-mentioned interval are reduced and the juxtaposed juxtaposed images are displayed again, and the still image desired to be recorded is displayed from the re-displayed juxtaposed images. A still image extraction device and a still image extraction device capable of efficiently specifying a still image desired to be extracted by shortening an interval between still images stepwise by being configured to be selectable Another object of the present invention is to provide a moving image pickup apparatus comprising:

A still image extraction apparatus according to the present invention includes a reproducing unit that reproduces a moving image including information for generating a still image separated by a fixed time interval in time series, and a medium mounting unit on which a recording medium is mounted, In the still image extraction apparatus for extracting one still picture from the moving picture reproduced by the reproducing means and recording it on a recording medium attached to the medium attaching means, designation of one still picture from the moving picture reproduced by the reproducing means A specification receiving unit that receives the specification, a specification unit that specifies the specified still image and still images before and after the still image, and a reduction of the still image specified by the specification unit when the specification reception unit receives the specification. A juxtaposed image creating unit that creates a juxtaposed image, a selection receiving unit that receives a selection of a still image to be recorded from the juxtaposed image created by the juxtaposed image creating unit, and the selection receiving unit receives the selection. A recording processing unit for performing processing for recording the selected still image on a recording medium mounted on the medium mounting unit in accordance with a specific standard for recording a still image; Combining means for generating a combined still image in which any or all of them are combined, and the combining means compares the luminances of the pixels corresponding to each other of the plurality of still images to be combined to determine the maximum luminance and the minimum luminance. Pixel specifying means for specifying each pixel value of a pixel having luminance for each pixel position, and a pixel value and minimum pixel value relating to the maximum luminance specified by the pixel specifying means for each pixel position from among the plurality of still images The image processing apparatus includes: means for calculating an addition average value of pixel values relating to luminance for each corresponding pixel; and means for generating a composite still image having the addition average value calculated for each pixel position as a pixel value.

  In the still image extraction apparatus according to the present invention, the recording processing unit records management information for hierarchically managing data to be recorded on the recording medium mounted on the medium mounting unit, and the selection A compression means for compressing the still image, an addition means for adding specific information to the still image compressed by the compression means, and a still image with the specific information added by the addition means And means for recording so as to be managed in a hierarchy.

  In the still image extraction device according to the present invention, the specific standard is a DCF standard.

  In the still image extraction apparatus according to the present invention, the specifying unit reduces and juxtaposes the specified still image and still images separated by an integer multiple of 2 or more of the predetermined time before and after the still image. A side-by-side image is created.

  The still image extracting apparatus according to the present invention includes a receiving unit that receives selection of a still image to be re-displayed as a juxtaposed image from the juxtaposed image created by the juxtaposed image creating unit, and the specifying unit receives the selection by the receiving unit. In this case, the image processing apparatus is characterized by further comprising means for specifying the selected still image and still images having an interval shorter than the interval that is an integer multiple of 2 or more of the predetermined time before and after the still image.

  A moving image capturing apparatus according to the present invention includes an image capturing unit that captures a still image at a fixed time interval in time series, and a moving image generating unit that generates a moving image including information for generating the still image captured by the image capturing unit. And a still image extracting device according to any one of claims 1 to 7, wherein the moving image generated by the moving image generating means is reproduced by the still image extracting device and extracted from the reproduced moving image. One still image is recorded on a recording medium mounted on the medium mounting means.

In the present invention, the designation accepting unit accepts designation of one still image from among the still images constituting the moving image being reproduced when the designation is accepted, and a plurality of images before and after the designated one still image are received. A side-by-side image is created by reducing the still images. Then, a selection of a still image desired to be recorded is received from the created juxtaposed image, and the received still image is recorded on a recording medium mounted on the mounting unit in accordance with a specific standard for still images. Accordingly, even when the timing for giving the designation to the designation receiving means is shifted, a desired still picture can be selected from a plurality of still pictures before and after the designated still picture and recorded on the recording medium. it can. In addition, a still image extracted from a moving image can be recorded on a recording medium according to a specific standard so that the still image can be played back by another device that conforms to the specific standard.
In the present invention, a combined still image is generated by combining any or all of the still images specified by the specifying unit. Therefore, it is possible to generate a composite still image in which a change between the identified still images can be visually recognized with one image.
Further, in the present invention, the synthesizing unit specifies the pixel value of the pixel having the maximum or minimum luminance among the corresponding pixels of the plurality of still images to be synthesized. By specifying the pixel value of the pixel having the maximum or minimum luminance value, it is possible to extract information relating to a change between still images. Then, a combined still image is generated that has an added average value of the pixel value related to the specified maximum luminance and the pixel value related to the minimum luminance for each corresponding pixel. Therefore, it is possible to generate a composite still image in which a change between still images can be visually recognized with one image.

  In the present invention, management information for hierarchically managing data to be recorded is recorded on a recording medium. Specifically, a folder or directory is created. The compression unit compresses the selected still image data, and the addition unit adds specific information to the compressed still image data. Next, the compressed still image data is recorded so as to be managed below the highest-level root directory. Therefore, the still image extracted from the moving image can be recorded on the recording medium so that the still image can be reproduced by another device that can reproduce the still image that is compressed and managed in the lower layer.

  In the present invention, a still image extracted from a moving image can be recorded on a recording medium in accordance with the DCF standard so that it can be played back by a device compliant with the DCF standard.

  In the present invention, the designation accepting unit accepts designation of one still image from among the still images constituting the moving image being reproduced when the designation is accepted, and is constant before and after the designated one still image. A side-by-side image is created by reducing time series still images separated by a time interval longer than the time. Then, a selection of a still image desired to be extracted is received from the created juxtaposed image, and the received still image is recorded on a recording medium mounted on the mounting unit according to a specific standard for still images. Therefore, even when the timing for giving the designation to the designation receiving means is shifted and there is little change between time-series still images, a plurality of still images separated by the interval before and after the designated still image A desired still image can be selected from the images and recorded.

  In the present invention, the designation accepting unit accepts designation of one still image from among the still images constituting the moving image being reproduced when the designation is accepted. Then, before and after the specified one still image, a time-series still image separated by an interval longer than a predetermined time is reduced to create a juxtaposed image, and a desired still image is created from the created juxtaposed image. Accept selection. Furthermore, before and after the selected still image, a time-series still image that is shorter than the above interval is reduced to create a juxtaposed image, and the desired still image to be extracted is selected from the created juxtaposed image. The received still image is recorded on a recording medium mounted on the mounting means in accordance with a specific standard for still images. Therefore, even when the timing for giving the designation to the designation receiving unit is shifted, the time interval for separating the still images displayed as the juxtaposed images is shortened step by step to efficiently select a desired still image. Can be recorded.

  In the still image extraction device and the moving image capturing device according to the present invention, even when the timing for designating one still image is shifted, an interval longer than a certain time before and after the designated one still image A desired still image can be selected and recorded from a plurality of still images separated from each other. In addition, a still image extracted from a moving image can be recorded so that the still image can be reproduced by another device that complies with a specific standard.

  In the still image extracting device and the moving image capturing device according to the present invention, the still image is extracted from the moving image so that it can be played back by another device capable of playing back the still image that is compressed and managed in the lower layer. Still images can be recorded.

  With the still image extraction device and the moving image imaging device according to the present invention, a still image extracted from a moving image can be recorded so that it can be played back by a device that conforms to the DCF standard.

  In the still image extraction device and the moving image capturing device according to the present invention, a synthesized still image in which a designated one still image and still images before and after the still image are combined can be generated.

  In the still image extraction device and the moving image imaging device according to the present invention, a synthesized still image can be easily generated only by addition and division.

  In the still image extraction device and the moving image imaging device according to the present invention, a synthesized still image can be easily generated only by comparing, adding, and dividing luminance.

  In the still image extraction device and the moving image capturing device according to the present invention, even when the timing for designating one still image is shifted and the change between the still images is poor, the designated one A desired still image can be selected and recorded from a plurality of still images separated by a longer interval than before and after a still image.

  In the still image extracting device and the moving image capturing device according to the present invention, even if the timing for designating one still image is shifted, step-by-step re-specification is performed before and after the designated one still image. It is possible to efficiently select and record a desired still image from among a plurality of still images separated by a shorter interval.

(Embodiment 1)
Hereinafter, a still image extraction device and a moving image imaging device including the still image extraction device according to the present invention will be described in detail with reference to the drawings illustrating embodiments thereof.

FIG. 1 is a schematic perspective view schematically showing a moving image capturing apparatus including a still image extracting apparatus according to the present invention. In the figure, reference numeral 10 denotes a lens that collects light from a subject, and the lens 10 is provided on one side surface of a substantially rectangular housing 11. The housing 11 pivotally supports the display unit 4 having an aspect ratio of 4/3 on the right side surface 11a toward the lens 10. On the upper side of the display section 4 on the right side surface 11a, there are a menu display button 5a, a playback button 5b for starting playback of a moving image, a stop button 5c for stopping playback, and a time interval in a time series constituting the moving image to be played back Of a plurality of still images n (n = 0, 1, 2,..., N _end ) separated by a designation button 5d for designating one still image i reproduced and displayed on the display unit 4, and a cross A key 5e, an enter button 5f, a cancel button 5g, a still image recording button 5h, and a power switch 5i are provided.

  The moving image pickup apparatus includes a recording medium A for recording a still image on the back surface, and a medium mounting unit 3 (see FIG. 2) for recording data relating to the still image n on the recording medium A that is mounted. The recording medium A is a semiconductor memory such as a PC card conforming to the DCF standard. The control unit 20 performs recording control on the recording medium A mounted on the medium mounting unit 3. The control unit 20 controls various hardware described later.

  FIG. 2 is a block diagram illustrating a configuration of the moving image capturing apparatus. The moving image pickup apparatus includes an image pickup element 21 having an aspect ratio of 4/3 for converting an image focused and formed by the lens 10 into an analog image pickup signal, and a timing generator 22 for synchronizing the conversion of the image pickup signal. The image sensor 21 outputs the converted image signal to the image signal processor 23. The imaging signal processing unit 23 has an AD converter that converts the imaging signal converted by the imaging element 21 into digital moving image data, and outputs and stores the AD converted moving image data in the work memory 24.

  The moving image capturing apparatus compresses the moving image data stored in the work memory 24 by image processing unit 25a for performing image processing such as gamma correction and color correction, and the moving image data processed by the image processing unit 25a using the Motion JPEG compression / decompression method. And a video codec unit 25b for decompression. According to Motion JPEG, each of a plurality of time-series still images n is sequentially compressed by the JPEG compression / decompression method, and the compressed moving image is expanded as a plurality of still images n separated by a certain time interval in time series. . In the embodiment of the present invention, a frame image compressed by the JPEG compression / decompression method is described as a still image. However, a television broadcast standard two-field image (one frame image) may be a single still image. One field image may be a single still image.

  The moving image capturing apparatus records the moving image data compressed by the video codec unit 25b on the recording medium A mounted on the medium mounting unit 3 and the moving image recorded and reproduced by the recording / reproducing unit 25d. A video controller 25 c that converts the signal to be displayed on the display unit 4 and the display device B and outputs the signal to the display unit 4 and the moving image output unit 6 is provided. The moving image output unit 6 is an interface including a DV terminal to which the external display device B is connected through a cable, for example.

  Further, the moving image pickup apparatus reduces the reduced still images N-2d, Nd, N, N + d, and N + 2d specified from the plurality of still images n constituting the moving image expanded by the video codec unit 25b. A juxtaposed image creation unit 25e that creates a juxtaposed image in which the images 41 to 45 are juxtaposed is provided. Here, d is a natural number indicating a time-series frame difference between the still image N and the still images N ± d before and after the still image N, and is set by operating the cross key 5e and the decision button 5f. The image created by the juxtaposed image creation unit 25e is displayed on the display unit 4 or the display device B.

  Note that the image processing unit 25a, the video codec unit 25b, the video controller 25c, the recording / playback unit 25d, and the juxtaposed image creation unit 25e are realized as one chip.

  The timing generator 22, the imaging signal processing unit 23, the image processing unit 25a, the video codec unit 25b, the video controller 25c, the recording / reproducing unit 25d, and the juxtaposed image creation unit 25e are controlled by the control unit 20 of the microcomputer included in the moving image imaging apparatus. To do. The operation states of the menu display button 5a, the play button 5b, the stop button 5c, the designation button 5d, the cross key 5e, the enter button 5f, the cancel button 5g, the still image recording button 5h, and the power switch 5i are the I / O of the input / output device. It is configured to be detected by the control unit 20 via the O unit 26.

  3 to 5 are flowcharts showing a processing procedure of the control unit 20 related to extraction and recording of a still image. When the power switch 5i is turned on, the control unit 20 sets 9 to d (step S1). The time interval ΔT on the time series between the still image N and the still image N + d is ΔT = d / 30 = 0.3 seconds, for example, when the frame rate of the moving image is 30 frames / second.

  Next, the control unit 20 detects the operation state of the menu display button 5a, and determines whether or not the menu display button 5a is pressed (step S2). When it is determined that the menu display button 5a is pressed (step S2: YES), the control unit 20 displays a reception menu for accepting the setting of the time interval ΔT = d / 30 (step S3). Then, the control unit 20 detects the operation state of the cross key 5e and the enter button 5f and receives an input of ΔT (step S4). Further, the control unit 20 multiplies the received ΔT by 30 frames / second of the frame rate of the moving image, and sets a value 30ΔT obtained by the multiplication to d (step S5).

  When the process of step S5 is completed, or when it is determined in step S2 that the menu display button 5a has not been pressed (step S2: NO), the control unit 20 detects the state of the power switch 5i, and the power switch 5i It is determined whether or not is in an on state (step S6). When it determines with the power switch 5i not being in the ON state (step S6: NO), the control part 20 complete | finishes a process.

  When it is determined that the power switch 5i is on (step S6: YES), the control unit 20 detects the operation state of the playback button 5b and determines whether or not the playback button 5b is being pressed (step S6). S7). If it is determined that the playback button 5b is pressed (step S7: YES), a still image i to be played back, for example, a still image 0, is set from the still images n recorded as moving images (step S8). When it determines with the reproduction | regeneration button 5b not being pressed (step S7: NO), the control part 20 returns a process to step S2.

  When the process of step S8 is completed, the control unit 20 reproduces the still image i and displays it on the display unit 4, and outputs the still image i to the moving image output unit 6 (step S9). Specifically, the control unit 20 reads moving image data including the still image i from the recording medium A, expands the read moving image data by the video codec unit 25b, and displays the expanded still image i on the display unit 4 or the display device B. To display. Next, the control unit 20 detects the operation state of the stop button 5c and determines whether or not the stop button 5c is pressed (step S10). When it determines with the stop button 5c being pressed (step S10: YES), the control part 20 returns a process to step S2.

  When it is determined that the stop button 5c is not pressed (step S10: NO), the control unit 20 detects the operation state of the designation button 5d and determines whether or not the designation button 5d is pressed (step S11). ). If it is determined that the designation button 5d has not been pressed (step S11: NO), the control unit 20 increments the number i of the still image i to be reproduced by 1 (step S12), and returns the process to step S9.

  When it determines with the designation | designated button 5d being pressed (step S11: YES), the control part 20 sets the value of the number i to the number N of the still image N displayed as the reduced image 43 (step S13). Next, the control unit 20 reads out the moving image data including the still images N, N ± d, and N ± 2d from the recording medium A, and creates reduced images 41 to 45 of the still images N, N ± d, and N ± 2d. It is generated by the unit 25e (step S14).

  When the generation of the reduced images 41 to 45 is finished, the control unit 20 increases the reduced images 41 to 45 of the still images N-2d, Nd, N, N + d, and N + 2d in ascending order from the left side to the right side as shown in FIG. The juxtaposed image juxtaposed is created, and the created juxtaposed image is displayed on the display unit 4 (step S15). Further, the control unit 20 outputs the created juxtaposed image to the moving image output unit 6. And the control part 20 displays the cursor 40 for receiving selection of the reduction images 41-45 (step S16). For example, a substantially rectangular cursor 40 surrounding the edge of the reduced image 43 is displayed.

  After finishing the process of step 16, the control part 20 detects the operation state of the cross key 5e, and determines whether the cross key 5e is pressed (step S17). When it is determined that the cross key 5e is pressed (step S17: YES), the control unit 20 moves the cursor 40 in accordance with the operation of the cross key 5e (step S18). For example, when the cursor 40 specifies the reduced image 43 and the right button of the cross key 5e is pressed, the cursor 40 specifying the reduced image 43 is moved and juxtaposed to the right of the reduced image 43. The cursor 40 is moved to the reduced image 44 being displayed. Similarly, when the cursor 40 specifies the reduced image 43 and the left button of the cross key 5e is pressed, the cursor 40 specifying the reduced image 43 is moved and juxtaposed to the left of the reduced image 43. The cursor 40 is placed on the reduced image 42 being displayed.

  When the process of step S18 is completed, or when it is determined in step S17 that the cross key 5e is not pressed (step S17: NO), the control unit 20 determines whether d is 1 (step S17). S19). When it determines with d not being 1 (step S19: NO), the control part 20 detects the operation state of the determination button 5f, and determines whether the determination button 5f is pushed (step S20). When it is determined that the determination button 5f is pressed (step S20: YES), the control unit 20 sets the number k of the still image k related to the reduced images 41 to 45 specified by the cursor 40 to the number N. (Step S21). For example, when the reduced image 41 is designated by the cursor 40, the number k = N-2d of the still image k = N-2d related to the reduced image 41 is set to the number N. Then, the control unit 20 divides d by 3, and sets a value Int (d / 3) obtained by converting the divided value d / 3 into an integer as a new value of d (step S22). Conversion to an integer is performed by rounding up the fraction of the value obtained by dividing d by 3. When Int (d / 3) is set in d, the control unit 20 returns the process to step S14.

  When it is determined in step S19 that d is 1 (step S19: YES), or when it is determined in step S20 that the enter button 5f is not pressed (step S20: NO), the control unit 20 records the still image. The operating state of the button 5h is detected, and it is determined whether or not the still image recording button 5h has been pressed (step S23). When it is determined that the still image recording button 5h has been pressed (step S23: YES), the control unit 20 converts the still image k of the reduced images 41 to 45 selected by the cursor 40 into a DCF (Design rule for Camera File system). ) Call a subroutine for recording in accordance with the standard (step S24).

  In the subroutine, the control unit 20 detects the state of the medium mounting unit 3 and determines whether or not the medium mounting unit 3 has mounted the recording medium A (step S101). When it is determined that the medium mounting unit 3 does not mount the recording medium A (step S101: NO), the control unit 20 causes the display unit 4 to display a message notifying that the recording medium A should be mounted (step S101). S102), the subroutine processing ends.

  When it is determined that the medium loading unit 3 is loaded with the recording medium A (step S101: YES), the control unit 20 reads management information for hierarchically managing data from the recording medium A and uses the management information as management information. Based on this, it is determined whether or not there is a DCF image directory 7b (see FIG. 6) in the root directory 7a (step S103). Specifically, it is determined whether there is a directory whose file name is “DCIM”. If it is determined that there is no DCF image directory 7b (step S103: NO), the control unit 20 creates a directory with the file name “DCIM” in the root directory 7a of the recording medium A (step S104).

  When the process of step S104 is completed, or when it is determined in step S103 that the DCF image directory 7b exists (S103: YES), the control unit 20 has the DCF directory 7c in the lower layer of the DCF image directory 7b based on the management information. It is determined whether or not there is (step S105). When it is determined that there is no DCF directory 7c (step S105: NO), the control unit 20 creates the DCF directory 7c below the DCF image directory 7b (step S106). The DCF directory 7c is a directory consisting of a directory number having a directory name of 100 to 999 and five free characters. For example, a directory whose directory name is “100 SHARP” is created.

  When the process of step S106 is completed, or when it is determined in step S105 that there is a DCF directory 7c (step S105: YES), the control unit 20 temporarily expands the still image k in the work memory 24 at the original resolution. Then, the developed still image k is reduced to an image having a pixel number of 160 × 120, and a thumbnail image compressed by the JPEG compression / decompression method is generated (step S107). Then, the control unit 20 does not expand and compress the still image k, which is a part of the moving image compressed by the Motion JPEG compression / decompression method, according to the JPEG compression / decompression method. The image k is converted into a JPEG compression / decompression file (step S108). Since the file format is converted by changing the header portion, there is no further deterioration in image quality. Next, the control unit 20 creates a DCF basic file in the Exif file format in which the thumbnail generated in step S107 and specific information regarding the still image k are added to the compressed data of the still image k (step S109).

  The file name of the DCF basic file is composed of 4 free characters and a file number of 0001 to 9999, and has an extension of “JPG”. For example, the file name is recorded as “PICT0001.JPG”. The specific information is information related to information on the moving image capturing apparatus, color space information, and the like required by the Exif essential tag and DCF standards. More specifically, the manufacturer name, model name, generation date and time of the original image of the still image k, creation date and time of the digital data of the still image k, and DCF determination information for determining whether the file is a DCF basic file , Information indicating the color space of sRGB is recorded. Further, the control unit 20 records the DCF basic file created in step S109 in the DCF directory 7c (step S110), and ends the subroutine processing.

  When the process of step S24 is completed, or when it is determined in step S23 that the still image recording button 5h has not been pressed (step S23: NO), the control unit 20 detects the operation state of the cancel button 5g and cancels it. It is determined whether or not the button 5g is pressed (step S25). When it is determined that the cancel button 5g is pressed (step S25: YES), the control unit 20 sets d initially set in step S1 or step S5 to d (step S26), and the process proceeds to step S9. return. If it is determined that the cancel button 5g has not been pressed (step S25: NO), the process returns to step S16.

  FIG. 6 is a conceptual diagram showing a still image file recorded on the recording medium A by the processing shown in FIG. 5 and a directory structure of the recording medium. FIG. 6A shows a still image file to be recorded on the recording medium A. The still image file includes still image k data compressed by the JPEG compression / decompression method, thumbnail image of the still image k, specific information regarding the information of the imaging device, color space, and the like. Still image files are configured by SOI (Start of Image) and EOI (End of Image).

  FIG. 6B shows a directory structure of the recording medium A for recording the still image file shown in FIG. A DCF image directory 7b having a file name “DCIM” is created in the root directory 7a of the recording medium A, and a DCF directory 7c is created in the DCF image directory 7b. The still image file is recorded with the file name “PICT0001.JPG” in the DCF directory 7c with the file name “100SHARP”.

  FIG. 7 is a schematic diagram of a juxtaposed image created by the juxtaposed image creation unit 25e according to the present invention. On the upper side of the juxtaposed image, the reduced images 41 to 45 of the still images N, N ± d, and N ± 2d are juxtaposed in ascending order from the left side to the right side. Below the reduced images 41 to 45, the still image k = N of the reduced image 43 selected by the cursor 40 is displayed in an enlarged manner.

  FIG. 8 is a schematic diagram of a reduced image when the juxtaposed image is redisplayed by shortening the time interval between a plurality of still images displayed as the juxtaposed image in a stepwise manner. FIG. 8A shows reduced images 41 to 45 that are displayed when the designation button 5d is pressed during reproduction of a moving image. The time interval between the reduced images 41 to 45 is d / 30 = 9/30 = 0.3 seconds, and the reduced image 42 is selected with the cursor 40. FIG. 8B shows reduced images 46 to 50 that are displayed again when the enter button 5f is pressed in the state of FIG. The time interval between the reduced images 46 to 50 is 0.3 / 3 = 0.1 seconds, and the reduced image 48 is selected. FIG. 8C shows reduced images 51 to 55 redisplayed when the determination button 5f is further pressed in the state of FIG. 8B. The time interval between the reduced images is 0.1 / 3 = about 0.03 seconds.

  In the moving image pickup apparatus according to the present invention, even when the timing for designating the still images i that are reproduced as moving images and sequentially displayed on the display unit 4 is shifted, as shown in FIG. As described above, a plurality of still images N, N ± d, N ± 2d reduced images 41 to 45 including the still image i = N reproduced when the designation button 5d is pressed are displayed on the display unit 4. The desired still image k can be selected and the selected still image k can be recorded on the recording medium A as a still image file.

  Further, as shown in FIG. 8A, the time interval between the reduced images 41 to 45 is 0.3 seconds longer than 0.03 seconds, so that the change in the time-series continuous still image n is poor. Even so, it is possible to select a desired still image k from among the reduced images 41 to 45 with relatively large image changes and record the selected still image file on the recording medium A as a still image file.

  Further, as shown in FIGS. 8B and 8C, by displaying the reduced images 46 to 55 in which the time interval between the reduced images 41 to 45 is made shorter, the change of the continuous time-series still image n is changed. Can be selected, a desired still image k can be selected and recorded on the recording medium A as a still image file.

Furthermore, since the extracted still image k is recorded on the recording medium A in accordance with the DCF standard, the still image k recorded on the recording medium A can be reproduced by another device that conforms to the DCF standard. For example, when an apparatus having a recording medium conforming to the DCF standard is connected, a printing apparatus capable of performing printing without intervention of software on the personal computer or the personal computer, and the moving image imaging apparatus according to the present invention When the is connected, it is possible to easily print a still image extracted from a moving image by means equivalent to normal still image printing.
When the recording medium A is mounted on a printer capable of direct printing, the still image k recorded on the recording medium A can be directly printed.

  Furthermore, the moving image to be reproduced and the juxtaposed image can be displayed on the display device B connected to the moving image output unit 6.

  Note that the still image extraction device described in the embodiment is applied to a moving image capturing device that captures moving images, but may be applied to a DVD recorder that records moving images on a DVD or a mobile phone or other moving image recording device. good.

  Moreover, although the setting of the frame difference between a plurality of still images displayed as a juxtaposed image is accepted by the time interval d / 30, it may be configured to directly accept d. Further, it may be configured such that either a short or long time interval can be selected without accepting a specific time interval designation.

  Furthermore, although the juxtaposed image in which five reduced images including the designated still image are juxtaposed is generated, three or more reduced images may be displayed on the display unit.

  Furthermore, d is reduced stepwise by the function Int (d / 3), but d is changed stepwise by different ratios such as Int (d / 5) or Int (d / 2). May be.

(Embodiment 2)
FIG. 9 is a flowchart illustrating a processing procedure of a control unit included in the moving image capturing apparatus according to the second embodiment. The control unit 20 performs the process shown in FIG. 9 in addition to the processes shown in FIGS. That is, after completing the process of step S16, before performing the process of step S17, the processes of step S201 to step S213 are performed.

  When the process of step S16 is completed, the control unit 20 is configured to receive an instruction to create the composite still image 141 according to the present invention in a state where the juxtaposed image is displayed, and whether or not an instruction to generate the composite still image 141 has been received. Is determined (step S201). Specifically, a button for accepting creation of the composite still image 141 is displayed on the juxtaposed image shown in FIG. 7, and the control unit 20 detects the operation state of the cross key 5e and the decision button 5f, thereby combining the images. It is determined whether an instruction for creating a still image 141 has been received. If it is determined that an instruction to create the composite still image 141 has not been received (step S201: NO), the control unit 20 executes the process of step S17 shown in FIG.

  If it is determined that an instruction to create the composite still image 141 has been received (step S201: YES), the control unit 20 reads the still images N, N ± d, and N ± 2d from the recording medium A (step S202). The still image N, N ± d, N ± 2d has a pixel value Iα (x, y) of 0 to 255 for each pixel (x, y) of the number of pixels X0 × Y0. 0 is set to x and y indicating the pixel positions of the still images N, N ± d, and N ± 2d (steps S203 and S204). Here, x indicates the horizontal pixel position of the still images N, N ± d, N ± 2d, and is an integer between 0 and the maximum value X0. y indicates the vertical pixel position of the still images N, N ± d, and N ± 2d, and is an integer between 0 and the maximum position Y0. The subscript α of I is an integer from −2 to 2, and indicates pixel values corresponding to still images N, N ± d, and N ± 2d, respectively. In the following description, the still image is described as a monochrome image. However, in the case of a color image, the same processing may be performed on each pixel value of RGB (R = Red, G = Green, B = Blue).

  Then, the control unit 20 calculates an average value of the pixel values Iα (x, y) of the still images N, N ± d, and N ± 2d, and substitutes the calculated average value for P (x, y) ( Step S205). That is, the pixel values Iα (x, y) of the still images N, N ± d, N ± 2d are added, and the added addition value ΣIα (x, y) is divided by 5. 5 is the total number of still images N, N ± d and N ± 2d to be synthesized.

  Next, the control unit 20 determines whether x is X0 (step S206). When it determines with x not being X0 (step S206: NO), the control part 20 increments x by 1 (step S207), and returns a process to step S205.

  When it is determined that x is X0 (step S206: YES), the control unit 20 then determines whether y is Y0 (step S208). When it determines with y not being Y0 (step S208: NO), the control part 20 increments y by 1 (step S209), and returns a process to step S204.

  When it determines with y being Y0 (step S208: YES), the control part 20 displays the synthetic | combination still image 141 which has P (x, y) for every pixel on the display part 4 (step S210). Next, the control unit 20 receives an instruction as to whether or not to display the displayed composite still image 141 on the recording medium A (step S211). Specifically, the control unit 20 receives a recording instruction by displaying a menu for selecting whether recording is necessary or not, and detecting the operation state of the cross key 5e and the determination button 5f.

  When a recording instruction is received, the control unit 20 determines whether or not a recording instruction for the composite still image 141 is received in step S211 (step S212). If it is determined that an instruction to record the composite still image 141 has been received (step S212: YES), the control unit 20 calls a subroutine for recording a still image in order to record the composite still image 141 on the recording medium A (step S212). S213). The subroutine for recording a still image is the same as the subroutine shown in FIG.

  When it is determined that the recording instruction of the composite still image 141 is not received (step S212: NO) or when the process of step S213 is completed, the control unit 20 executes the process of step S17 shown in FIG.

  Since the configuration, operation, and effects other than the processing content of the control unit 20 included in the moving image capturing apparatus according to Embodiment 2 are the same as those of the moving image capturing apparatus described in Embodiment 1, detailed description thereof is omitted.

  FIG. 10 is a schematic diagram of a reduced still image of five still images to be combined and a combined still image obtained by combining five still images. FIG. 5A shows reduced images 41 to 45 displayed by the processes of steps S14 and S15 shown in FIG. 4, and FIG. 5B shows still images N, N ± d, A composite still image 141 obtained by combining N ± 2d by the processing of steps S202 to S208 is shown.

  In the moving image capturing apparatus according to Embodiment 2, by generating an average of pixel values for each pixel of a still image, a synthesized still image that can show the feature of the still image by one image is generated. Can do.

(Embodiment 3)
FIG. 11 is a flowchart illustrating a processing procedure of a control unit included in the moving image capturing apparatus according to the third embodiment. 12 and 13 are explanatory diagrams showing still images synthesized by the processing of the third embodiment. The control unit 20 performs the process shown in FIG. 11 in addition to the processes shown in FIGS. That is, after finishing the process of step S16, before performing the process of step S17, the process of step S301 thru | or step S315 is performed.

  When the process of step S16 is completed, the control unit 20 is configured to receive an instruction to create the composite still image 241 (see FIG. 14) according to the present invention in a state where the juxtaposed image is displayed. It is determined whether an instruction has been accepted (step S301). If it is determined that an instruction to create the composite still image 241 has not been received (step S301: NO), the control unit 20 executes the process of step S17 shown in FIG.

  If it is determined that an instruction to create the composite still image 241 has been received (step S301: YES), the control unit 20 displays the still images N, N ± d, N ± 2d, and N + 3d shown in FIGS. 12 and 13 from the recording medium A. Read (step S302). FIGS. 12A, 12B, and 12C show still image N-2d, still image Nd, and still image N, respectively, and FIGS. 13D, 13E, and 13F are shown. A still picture N + d, a still picture N + 2d, and a still picture N + 3d are shown. The still images N, N ± d, N ± 2d, and N + 3d have pixel values Iα (x, y) of 0 to 255 for each pixel (x, y) having the number of pixels X0 × Y0. Sets 0 to x and y indicating the pixel positions of the still images N, N ± d, N ± 2d, and N + 3d (steps S303 and S304). A subscript α of I is an integer of −2 to 5, and indicates pixel values corresponding to still images N, N ± d, N ± 2d, and N + 3d, respectively.

  Then, the control unit 20 compares the luminances of the corresponding pixels (x, y) of the still images N, N ± d, N ± 2d, and N + 3d to compare the pixel (x, y) having the maximum luminance. ) Is specified (step S305). For specifying Imax, for example, the luminance of the pixel (x, y) is compared in order from the still image N-2d to the still image N + 3d, and the pixel value of the pixel (x, y) having higher luminance is specified. To do.

  In the case of an RGB color image, the luminance of the pixel (x, y) is compared based on luminance information developed as still image data in the work memory 24. The luminance may be calculated from pixel values having RGB color components.

  Next, the control unit 20 compares the luminances of the corresponding pixels (x, y) of the still images N, N ± d, N ± 2d, and N + 3d to compare the pixel (x, y) having the minimum luminance. ) Is specified (step S306). Then, the average value of Imax and Imin specified in steps S305 and S306 is calculated, and the calculated average value is substituted into P (x, y) (step S307). The addition average value is calculated by (Imax + Imin) / 2.

  When the process of step S307 is completed, the control unit 20 determines whether x is X0 (step S308). When it determines with x not being X0 (step S308: NO), the control part 20 increments x by 1 (step S309), and returns a process to step S305.

  If it is determined that x is X0 (step S308: YES), the control unit 20 then determines whether y is Y0 (step S310). When it determines with y not being Y0 (step S310: NO), the control part 20 increments y by 1 (step S311), and returns a process to step S304.

  When it is determined that y is Y0 (step S310: YES), the control unit 20 displays the composite still image 241 having P (x, y) for each pixel on the display unit 4 (step S312). Next, the control unit 20 receives an instruction as to whether or not to display the displayed composite still image 241 on the recording medium A (step S313).

  When a recording instruction is received, the control unit 20 determines whether or not a recording instruction for the composite still image 241 is received in step S313 (step S314). If it is determined that an instruction to record the composite still image 241 has been received (step S314: YES), the control unit 20 calls a subroutine for recording a still image in order to record the composite still image 241 on the recording medium A (step S314). S315). The subroutine for recording a still image is the same as the subroutine shown in FIG.

  When it is determined that the recording instruction for the composite still image 241 has not been received (step S314: NO) or when the process of step S315 is completed, the control unit 20 executes the process of step S17 shown in FIG.

  Since the configuration, operation, and effects other than the processing content of the control unit 20 included in the moving image capturing apparatus according to the third embodiment are the same as those of the moving image capturing apparatus according to the first embodiment, detailed description thereof is omitted. Also, x, y, X0, and Y0 indicate the same pixel position and maximum value as in the second embodiment.

  FIG. 14 is an explanatory diagram showing an image having pixel values to be averaged and a synthesized image. FIG. 14A shows an image having the pixel value Imax specified in step S305 for each pixel, and FIG. 14B shows an image having the pixel value Imin specified in step S306 for each pixel. Show. As shown in FIGS. 14A and 14B, pixel values whose luminance changes brightly or darkly between the still images N, N ± d, N ± 2d, and N + 3d by the processing of steps S305 and S306, That is, information related to image changes is specified. FIG. 14C shows an image having an addition average value of the pixel values of the images in FIGS. 14A and 14B for each pixel, and corresponds to the image generated in step S307.

  In the moving image capturing apparatus according to Embodiment 3, as shown in FIG. 14C, the features relating to changes in the still images N, N ± d, N ± 2d, and N + 3d can be represented by one image. A composite still image can be generated.

1 is a schematic perspective view schematically illustrating a moving image capturing apparatus including a still image extracting apparatus according to the present invention. It is a block diagram which shows the structure of a moving image imaging device. It is a flowchart which shows the process sequence of the control part which concerns on extraction and recording of a still image. It is a flowchart which shows the process sequence of the control part which concerns on extraction and recording of a still image. It is a flowchart which shows the process sequence of the control part which concerns on extraction and recording of a still image. FIG. 6 is a conceptual diagram illustrating a still image file recorded on a recording medium by the processing illustrated in FIG. 5 and a directory structure of the recording medium. It is a schematic diagram of the juxtaposed image created by the juxtaposed image creation unit according to the present invention. It is a schematic diagram of a reduced image when a time interval between a plurality of still images displayed as a juxtaposed image is shortened stepwise to redisplay the juxtaposed image. 10 is a flowchart illustrating a processing procedure of a control unit included in the moving image capturing apparatus according to the second embodiment. It is the schematic diagram of the synthetic | combination still image which synthesize | combined the reduced image of five still images to synthesize | combine, and five still images. 10 is a flowchart illustrating a processing procedure of a control unit included in the moving image capturing apparatus according to Embodiment 3. FIG. 10 is an explanatory diagram showing a still image synthesized by the processing of the third embodiment. FIG. 10 is an explanatory diagram showing a still image synthesized by the processing of the third embodiment. It is explanatory drawing which shows the image which has the pixel value added and averaged, and the synthesized image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 3 Medium mounting part 4 Display part 5a Menu display button 5b Play button 5c Stop button 5d Specify button 5e Four-way controller 5f Enter button 5g Cancel button 5h Still image recording button 5i Power switch 6 Movie output part 10 Lens 11 Case 20 Control part 21 Image sensor 22 Timing generator 23 Imaging signal processing unit 24 Work memory 25a Image processing unit 25b Video codec unit 25c Video controller 25d Recording / playback unit 25e Parallel image creation unit 26 I / O unit 40 Cursor

Claims (6)

A reproduction unit that reproduces a moving image including information for generating a still image separated by a fixed time interval in time series, and a medium mounting unit to which a recording medium is mounted; In a still image extraction apparatus for extracting a still image and recording it on a recording medium mounted on the medium mounting means,
Designation accepting means for accepting designation of one still image from the video reproduced by the reproducing means;
When the designation accepting unit accepts the designation, a specifying unit that identifies the designated still image and still images before and after the still image;
A juxtaposed image creating unit that creates a juxtaposed image in which the still image identified by the identifying unit is reduced and juxtaposed;
Selection accepting means for accepting selection of a still image to be recorded from the juxtaposed image created by the juxtaposed image creating means;
A recording processing unit for performing processing for recording the selected still image on a recording medium mounted on the medium mounting unit according to a specific standard related to recording of a still image when the selection receiving unit receives the selection;
A combining unit that generates a combined still image by combining any or all of the still images specified by the specifying unit;
The synthesis means includes
A pixel specifying unit that compares the brightness of pixels corresponding to each other of a plurality of still images to be combined, and specifies the pixel value of the pixel having the maximum brightness and the minimum brightness for each pixel position;
Means for calculating, for each corresponding pixel, a pixel value related to the maximum luminance and a pixel value related to the minimum luminance specified by the pixel specifying means for each pixel position among the plurality of still images ;
And a means for generating a composite still image having an addition average value calculated for each pixel position as a pixel value. The recording processing means includes
Means for recording management information for hierarchically managing data to be recorded on the recording medium attached to the medium attaching means;
Compression means for compressing the selected still image;
Adding means for adding specific information to the still image compressed by the compression means;
The still image extracting apparatus according to claim 1, further comprising: a unit configured to record a still image to which specific information is added by the adding unit so as to be managed in a hierarchy lower than the highest level.   The still image extraction apparatus according to claim 1, wherein the specific standard is a DCF standard. The specifying means includes
A juxtaposed image is created by reducing and juxtaposing a specified still image and still images separated by an integer multiple of two or more of the predetermined time before and after the still image. The still image extraction device according to any one of claims 1 to 3. From the juxtaposed image created by the juxtaposed image creating unit, the receiving unit receives a selection of a still image to be redisplayed as a juxtaposed image,
The specifying means includes
When the accepting means accepts the selection, it comprises means for identifying the selected still image and still images having an interval shorter than the interval that is an integral multiple of 2 or more of the predetermined time before and after the still image. The still image extraction device according to claim 4, wherein the device is a still image extraction device. Imaging means for capturing still images separated by a fixed time interval in time series;
A moving image generating unit that generates a moving image including information for generating the still image captured by the imaging unit;
A still image extraction device according to any one of claims 1 to 5,
The moving image generated by the moving image generating means is reproduced by the still image extracting device, and one still image extracted from the reproduced moving image is recorded on a recording medium attached to the medium attaching means. A video imaging apparatus characterized by the above.