JP5859100B2 - Image recording device - Google Patents

Description

The present invention relates to an image recording apparatus which can write Mukoto take moving image data or we still image recorded on a recording medium such as a memory card or optical disk.

  In recent years, the resolution of video data captured by a video camera or the like has increased, and it has become possible to reproduce high-quality images from recorded video data. In addition to viewing recorded video data as a moving image, it is generally used such that a desired frame is extracted as a still image from the video data and viewed in a playback form such as a still image or a slide show. It is like that.

  As a technique for extracting a desired still image from recorded video data, a technique is known in which a user operates an operation button at a desired image timing to capture a still image depending on the timing (for example, , See Patent Document 1).

  By the way, some video cameras can record a captured image of 24 frames (seconds) per second corresponding to the frame rate of a movie. In addition, techniques for performing 2: 3: 2: 3 pull-down conversion processing and 2: 3: 3: 2 pull-down conversion processing on progressive video (24p) captured at 24 frames / second are also known. The so-called pull-down conversion process is a technique for generating an interlaced video (60i) of about 60 frames (fields) per second from 24p, for example, by inserting duplicate fields at a predetermined timing. A technique for recording a 60i interlaced video generated from 24p on a recording medium is also known (see, for example, Patent Document 2).

  In addition, when playing back recorded interlaced video, there are technologies for combining the top field and the bottom field according to motion adaptation processing, and intra-field interpolation technology for generating a field for synthesis from the top field or the bottom field. Are known. (For example, refer to Patent Document 3.) Such a technique is generally called IP conversion (interlace / progressive conversion). By performing the IP conversion, the video data recorded at 60i can be converted into a progressive video (60p) of 60 frames / second and output.

JP 2006-140901 A JP 2003-284007 A Japanese Patent Laid-Open No. 10-327393

  However, with the technique described in Patent Document 1, only one still image can be acquired by one still image capture operation. That is, in order to continuously capture still images from a moving image, it is necessary to repeatedly perform a still image capture operation. This is a troublesome operation for a user who wants to continuously capture a plurality of still images instead of one.

  In view of this, it is conceivable to capture a plurality of consecutive frames of still images at once in response to a single still image capture operation. However, as in the above-described prior art, interlaced video (pull-down converted) ( For example, it is assumed that 60i) is reproduced. In the case of interlaced video, a still image is captured from the frame after IP conversion. However, if it is an interlaced video that has undergone pull-down conversion processing, duplicate fields exist, so still image capture is possible. It is considered that unsuitable frame images are included.

Therefore, an object of the present invention is to enable continuous capture of a plurality of still images from moving image data recorded on a recording medium .

  The image recording apparatus according to the present invention is a reproducing means for reproducing moving image data from a recording medium, and the reproduction that starts frame-by-frame reproduction of the moving image data when an instruction to start recording of a still image is given. Means for determining whether an image of one frame reproduced from the recording medium is an interlaced image or a progressive image, and an image of one frame reproduced from the recording medium is an interlaced image In the case of the image, the conversion means for converting the image for one frame reproduced from the recording medium into the image in the progressive format, and the image for one frame reproduced from the recording medium are the images in the progressive format. In this case, a process for recording an image for one frame reproduced from the recording medium as still image data, or a reproduction from the recording medium. Generated based on a bottom field of a first image that is an image for a frame and a top field of a second image that is an image for one frame reproduced from the recording medium after the first image Recording means for performing processing for recording an image for one frame as still image data, and when the image for one frame reproduced from the recording medium is an interlaced image, the conversion means The processing for recording the image of one frame converted into the progressive image image as still image data is performed, and the image of one frame reproduced from the recording medium is an interlaced image or a progressive image. If the image cannot be determined, the image for one frame converted into the progressive format image by the converting means is recorded as still image data. Or performs processing for, characterized by having a said recording means terminates the processing for recording one frame image which has been reproduced from the recording medium as still image data.

According to the present invention, it becomes possible to continuously capture a plurality of still images from moving image data recorded on a recording medium, thereby improving user convenience.

1 is a block diagram illustrating a configuration of an image recording / reproducing apparatus according to Embodiment 1 of the present invention. 3 is a flowchart illustrating an operation of a still image capture process according to the first embodiment. It is an image figure at the time of performing a continuous still image capture process with respect to the 60-Hz interlace recording image. It is an image figure at the time of performing a continuous still image capture process with respect to a 30 Hz progressive recording image. It is an image figure at the time of performing a continuous still picture capture process with respect to the 2-3 pulldown recording image of 24 Hz. 10 is a flowchart illustrating an operation of still image capture processing according to the second embodiment. 10 is a flowchart illustrating an operation of still image capture processing according to the second embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The present invention is not limited to the embodiments described below. Further, the embodiment of the present invention shows the most preferable mode of the invention, and does not limit the scope of the invention.

  FIG. 1 is a block diagram showing a configuration of an image recording / reproducing apparatus according to Embodiment 1 of the present invention.

  In FIG. 1, a recording medium 2 which is a random access medium such as a removable memory card is connected to an image recording / reproducing apparatus 1.

  The image recording / playback apparatus 1 includes a recording / playback unit 101 having a media interface (I / F) function, a stream buffer 102, an MPEG decoder (decoder) 103, and an IP conversion unit 107 that performs interlace / progressive conversion. Is provided. Furthermore, the moving image format determination unit 104, the pull-down detection unit 105, the scene change detection unit 106, the frame image generation unit 108, the frame buffer 109, the JPEG encoder 110, the display unit 111, the operation key 112, and the control unit (CPU) 113. Is provided. The operation key 112 includes an operation unit for instructing still image capture, and the control unit 113 controls each unit of the image recording / reproducing apparatus 1 in accordance with a user instruction input from the operation key 112.

  The recording / reproducing unit 101 has a function of reproducing video data or still image data recorded on the recording medium 2 and a function of recording video data or still image data on the recording medium 2. When the still image capture operation is executed, the recording / reproducing unit 101 reproduces moving image video data (MPEG stream) from the recording medium 2 and generates still image data (in JPEG format) generated by a JPEG encoder 110 described later. Still image data) is recorded on the recording medium 2.

  The stream buffer 102 temporarily holds video data (MPEG stream) reproduced by the recording / reproducing unit 101. The video data stored in the stream buffer 102 is sequentially sent to the MPEG decoder 103, and the MPEG decoder 103 decodes the compressed state in the MPEG format. In the present embodiment, a configuration in which video data compression-encoded in MPEG format is reproduced from the recording medium 2 is described. However, the image compression-encoding method is not limited to MPEG. H.264 system or the like may be used.

  For the reproduced video data decoded by the MPEG decoder 103, the moving image format determination unit 104 determines the moving image format. Specifically, the moving image format determination unit 104 determines whether the video is a progressive video or an interlace video. In addition, the pull-down detection unit 105 detects whether or not the image is a pull-down recorded video by detecting information indicating that the video data has been pulled-down converted from the reproduced video data and the position of the duplicate field, and the field. Determine the type of each. Information indicating that recording was performed after pull-down conversion can be identified from a flag or the like recorded in a predetermined data area in the video data. Further, the scene change detection unit 106 detects a scene change point in the reproduced video data. A scene switching point is a change point of a title (clip) of video data, a point where a scene change occurs, a change point of a moving image format, or the like.

  The IP conversion unit 107 is a functional block that converts video data decoded by the MPEG decoder 103 into progressive video when the video data is interlaced video. The IP conversion process is performed by combining the top field and the bottom field according to the motion adaptation process, or by using intra-field interpolation that generates a field for synthesis from the top field or the bottom field. Note that when the video data is progressive video, the IP conversion unit 107 is configured to allow through.

  The frame image generation unit 108 uses the function of outputting the video data from the IP conversion unit 107 to the frame buffer 109, the previous frame image temporarily stored in the frame buffer 109, and the current frame image. It has a function of generating a frame image. The frame buffer 109 temporarily holds the frame image data sent from the frame image generation unit 108. When the still image capture operation is executed, a desired frame image is generated from the reproduced video data (progressive video), and a new still image is generated by the frame image generation unit 108.

  The JPEG encoder 110 is a still image encoding unit, and compresses and encodes a still image generated by still image capture using the JPEG method. The compressed still image data is recorded on the recording medium 2 via the recording / playback unit 101.

  The display unit 111 includes a liquid crystal monitor, an output unit that outputs to an external monitor, and the like. The display unit 111 displays a moving image related to the reproduced video data or captures a captured still image when executing a still image capture operation. Is displayed.

  FIG. 2 is a flowchart illustrating the operation of the still image capture process according to the first embodiment, which is executed under the control of the control unit 113 in response to a user instruction from the operation key 112.

  First, in accordance with the control of the control unit 113, an instruction to record a still image (still image capture) is input by the operation key 112 while the recording / playback unit 101 is playing back video data from the recording medium 2. This will start the flow.

  When the recording of the still image is instructed, the control unit 113 determines whether the current frame image in the reproduced moving image is a progressive video or an interlaced video from the moving image format determining unit 104. (S201).

  If the video is a progressive video in S201, the control unit 113 determines whether or not the current frame image is a video that has been subjected to pulldown conversion processing and is recorded based on the detection result from the pulldown detection unit 105 (S202). ).

  If the video is a pull-down converted video in S202, the control unit 113 determines whether the top field of the current frame image is a repeat field based on the detection result of the pull-down detection unit 105 (S203). The repeat field means an overlapping field.

  When the top field of the current frame image is a repeat field in S203, the control unit 113 controls the frame image generation unit 108 to hold the current frame image in the frame buffer 109 (S205). The current frame image held in the frame buffer 109 is used for synthesis with the next frame image.

  If the current frame image is held in S205, the control unit 113 controls the recording / playback unit 101 to perform frame advance playback for one frame (S206). The reproduced frame image after the frame advance is sent to the MPEG decoder 103.

  After the frame advance in step S206, the control unit 113 determines whether the scene of the moving image being played back has been switched or whether the user has instructed the end of recording of the still image (cancellation of the still image capture instruction). (S207). The control unit 113 determines that the scene of the moving image has been switched based on the detection result from the scene switching detection unit 106.

  As a result of the determination in S207, if the scene is switched or the end of recording of the still image is instructed by the user, the flow ends. Otherwise, the process returns to S201.

  On the other hand, if the top field of the current frame image is not a repeat field in S203, the flow moves to S208. Then, the control unit 113 determines whether or not the frame image immediately before the current frame image is held in the frame buffer 109 (S208).

  When the previous frame image is held in the frame buffer 109 in S208, the control unit 113 uses the frame image generation unit 108 to create a new frame using the data of the immediately previous frame image temporarily held in the frame buffer 109. Generate an image. Specifically, the frame image generation unit 108 combines the bottom field of the immediately preceding frame image held in the frame buffer 109 and the top field of the current frame image, so that the same frame image as before the pull-down conversion is performed. Is generated (S209).

  If the video is not a progressive video in S201, the control unit 113 determines that the video is an interlaced video. In this case, the control unit 113 performs IP conversion by the IP conversion unit 107, and generates a progressive frame image from the top field and the bottom field corresponding to the current frame image (S210).

  When a frame image is generated in S209 and S210, the flow proceeds to S211. The flow also proceeds to S211 when the video is not recorded by pull-down conversion in S202, and when the frame image immediately before the current frame image is not held in the frame buffer 109 in S208.

  In S211, the control unit 113 performs control so as to record (still image capture) the frame image generated in S209 or S210 or the current frame image based on the determination in S202 or S208 as a still image (S211 capture). ). The frame image that is the target of still image capture is compression-encoded by the JPEG encoder 110 and recorded on the recording medium 2 by the recording / playback unit 101. At this time, a recorded still image may be displayed on the display unit 111.

  When still image capture is executed for one frame image, the flow proceeds to S206. As described above, in S206 and subsequent steps, it is determined whether or not to capture a still image for the next frame image by performing frame-by-frame playback. Therefore, until the flow is determined to end in S207, the still image capture process for a plurality of frame images is continuously repeated.

  FIG. 3 is an image diagram in a case where the continuous still image capture process as shown in FIG. 2 is performed on a 60 Hz interlaced recorded image. In the example of FIG. 3, the moving image encoding format is 30 frames / second (30 fps) interlaced video, and the recorded image format is 60 Hz interlaced: 60i (no pull-down). FIG. 3 shows a field pair for recording a still image when such image data is captured by the procedure shown in FIG.

  Note that the “progressive flag”, “pull-down determination flag”, and “pull-down flag” described in FIG. 3 and the like are stored in a predetermined data area in the MPEG stream for each frame of the moving image encoding format when recording video data. Additional information to be multiplexed. The information is also detected by the moving image format determination unit 104 and the pull-down detection unit 105 during reproduction. In FIG. 3 and FIGS. 4 and 5 to be described later, as information given to each of the moving image encoded frames (F0 to F14), the progressive flag “0” indicates interlace and “1” indicates progressive. Further, the pull-down determination flag indicates that “0” is not pull-down recording, “1” indicates that it is pull-down recording, and the pull-down flag indicates that “0” is a repeat field and “1” is a non-repeat field. .

  When a playback image is captured for a stream of such a moving image encoding format and a recording image format, it is determined in S201 in FIG. 2 that the video is not progressive video (interlace video). In this case, a still image is recorded in units of frames that match the moving image encoding format. Since the recording image format is interlaced, the frame image IP-converted in S210 in FIG. 2 is recorded as a still image. Therefore, as shown in FIG. 3, 15 still images are recorded from 15 consecutive frames (F0 to F14) as the moving image encoding format.

  Next, FIG. 4 is an image diagram when the continuous still image capture process as shown in FIG. 2 is performed on a 30 Hz progressive recording image. In the example of FIG. 4, the moving image encoding format is 30 frames / second (30 fps) interlaced video, and the recording image format is 30 Hz progressive: 30 p (no pull-down). FIG. 4 shows a field pair for still image recording when still image capture is performed on such video data in the procedure shown in FIG.

  When a still image is captured with respect to a stream of such a moving image encoding format and a recording image format, the process proceeds from S202 to S211 in FIG. In this case, a still image is recorded in units of frames that match the moving image encoding format. Since the recording image format is progressive, the reproduced and decoded frame image is recorded as a still image as it is. Therefore, as shown in FIG. 4, 15 still images are recorded from 15 consecutive frames (F0 to F14) as the moving image encoding format.

  Next, FIG. 5 is an image diagram in a case where the continuous still image capturing process as shown in FIG. 2 is performed on a 2-3 pull-down recorded image of 24 Hz. In the example of FIG. 5, the moving image coding format is 30 frames / second (30 fps) interlaced video, and the recording image format is 24 Hz progressive pull-down: 24p (with pull-down). FIG. 5 shows a field pair for still image recording when still image capture is performed on such video data according to the procedure shown in FIG.

Each frame image in the stream of the moving image encoding format and the recording image format is progressive and is a pull-down recording image. For this reason, the following cases (1) and (2) are considered as frame images to be recorded when a reproduced image is captured as a still image.
(1) Current frame image when NO is determined in S208 (2) Frame image newly generated in S209

  In FIG. 5, any one of the above-mentioned (1) and (2) is indicated corresponding to the recorded still image. In the case of (1), the frame image corresponding to the moving image encoded frame decoded by the MPEG decoder is recorded as it is as a still image. In the case of (2), a new frame image generated from the previous frame image and the current frame image by the frame image generation unit 108 is recorded as a still image. Therefore, as shown in FIG. 5, 12 still images are recorded from 15 consecutive frames (F0 to F14) as the moving image encoding format.

  As described above, according to the image recording / reproducing apparatus described in the present embodiment, an appropriate frame image can be reproduced while repeating playback frame advance and still image capture by a user giving a still image capture instruction during video reproduction. Recording of still images obtained from the above can be performed continuously. Note that still image capture can be performed during video playback or from the playback pause state, and it is easy to record continuous still images without dropped frames from the playback image until the instruction is canceled from the recording start instruction. become able to.

  Further, it is possible to extract a frame image suitable for a still image by determining a moving image encoding format and performing image format conversion such as IP conversion.

  Also, it is possible to record an image frame suitable for a still image by performing pull-down determination, removing a repeat field, and newly generating an image frame before pull-down using previous and next frame images.

  In addition, when the switching of the moving image scene is detected, the recording of the still image is stopped, so that only the frame image of the desired scene period can be recorded as the still image.

  Further, it is possible to prevent a duplicated frame image from being recorded as a still image when the still image recording is resumed by determining the stop of the still image recording after the frame-by-frame playback of the moving image.

  Next, a second embodiment according to the present invention will be described. Note that the configuration block diagram of the image recording / reproducing apparatus 1 in the second embodiment is the same as that described in the first embodiment, and a description thereof will be omitted.

  FIGS. 6 and 7 are flowcharts illustrating the operation of still image capture processing according to the second embodiment, which is executed under the control of the control unit 113 in response to a user instruction from the operation key 112. In the second embodiment, a description will be given of contents to which an error determination process is added when still image capture is performed.

  First, in accordance with the control of the control unit 113, an instruction to record a still image (still image capture) is input by the operation key 112 while the recording / playback unit 101 is playing back video data from the recording medium 2. This will start the flow.

  When the recording of the still image is instructed, the control unit 113 determines whether a decoding error has occurred in the current frame image of the moving image decoded by the MPEG decoder 103 (S600).

  If decoding is possible in S600 (no decoding error occurs), the control unit 113 determines whether or not the moving image encoding format of the current frame image can be determined based on the determination result from the moving image format determination unit 104. (S601). That is, in S601, it is determined whether or not it is possible to determine whether the reproduced frame image is interlaced or progressive.

  When the moving image encoding format can be determined in S601, the control unit 113 determines whether or not the recording image format can be determined based on the detection result from the pull-down detection unit 105 (S602). That is, in S602, it is determined whether the reproduced frame image is a video recorded by being pulled down, and whether a pull-down flag or the like can be determined.

  If the recording image format can be determined in S602, the flow transitions to A in FIG. 7, and the flow after S201 is executed in the same process as described in FIG.

  On the other hand, if the moving image encoding format cannot be determined in S601, or if the recorded image format cannot be determined in S602, the flow transitions to B of FIG. 7, and the flow after S210 is executed in the same process as in FIG. Is done. In this case, the control unit 113 assumes that the reproduced current frame image is interlaced. By performing IP conversion assuming interlace, a progressive frame image can be generated. Even if the current frame image is a progressive image, only one field is interpolated and there is no problem due to IP conversion.

  If the current frame image cannot be decoded in S600, the flow transitions to D in FIG. 7, and the still image capturing process is terminated as it is.

  In FIG. 7, when the flow transitions to S207 in the same process as in FIG. 2, if the result of the determination in S207 is that the scene has been switched or the user has instructed the end of recording of a still image, The flow ends. On the other hand, in S207, otherwise, the process proceeds to C in FIG. 6 and returns to S600.

  If NO is determined in S600, S601, or S602, the result may be notified to the user, specifically, a warning display may be displayed on the display unit 111.

  In addition, when it is determined NO in S601 or S602, the process transits to B. However, when it is certain that the still image capture is to be finished, the process may be modified to transit to D.

  As described above, according to the image recording / reproducing apparatus described in the present embodiment, even when the moving image encoding format or the recording image format of the decoded frame image cannot be determined, the image recording / playback device obtained by performing the IP conversion is obtained. The frame image was recorded as a still image. As a result, the executable range of still image capture can be expanded, and interlaced images can be prevented from being recorded as they are.

DESCRIPTION OF SYMBOLS 1 Image recording / reproducing apparatus 2 Recording medium 101 Recording / reproducing part 102 Stream buffer 103 MPEG decoder 104 Moving image format discrimination | determination part 105 Pull-down detection part 106 Scene change detection part 107 IP conversion part 108 Frame image generation part 109 Frame buffer 110 JPEG decoder 111 Display Part 112 operation key 113 control part

Claims (4)

Replay means for replaying moving image data from a recording medium, the replay means for starting frame-by-frame replay of the moving image data when instructed to start recording of a still image;
Determining means for determining whether an image of one frame reproduced from the recording medium is an interlaced image or a progressive image;
When the image for one frame reproduced from the recording medium is an interlaced image, conversion means for converting the image for one frame reproduced from the recording medium into a progressive image;
When the image for one frame reproduced from the recording medium is an image in the progressive format, the processing for recording the image for one frame reproduced from the recording medium as still image data, or from the recording medium Based on a bottom field of a first image that is an image of one frame that is reproduced and a top field of a second image that is an image of one frame that is reproduced from the recording medium after the first image. Recording means for performing processing for recording an image for one frame generated as still image data, and when the image for one frame reproduced from the recording medium is an interlaced image, The recording medium performs processing for recording an image for one frame converted into a progressive image by the conversion means as still image data, and the recording medium. If it is not possible to determine whether the image of one frame reproduced from the image is an interlaced image or a progressive image, the image of one frame converted into a progressive image by the converting means is recorded as still image data. The recording means for performing the processing for recording or ending the processing for recording an image for one frame reproduced from the recording medium as still image data;
Image SL RokuSo location, characterized in that it comprises a. When an image for one frame reproduced from the recording medium is an image in a progressive format and is not an image recorded on the recording medium by performing pull-down conversion processing, the recording means reproduces from the recording medium. Process to record the image for one frame as still image data,
When an image for one frame reproduced from the recording medium is an image in a progressive format and is an image recorded on the recording medium by performing pull-down conversion processing, the recording means Based on a bottom field of a first image that is an image of one frame that is reproduced and a top field of a second image that is an image of one frame that is reproduced from the recording medium after the first image. The image recording apparatus according to claim 1, wherein a process for recording an image for one frame generated as described above is recorded as still image data.   If a scene change is detected when frame-by-frame playback of the moving image data is being performed, the playback unit ends frame-by-frame playback of the moving image data, and the recording unit The image recording apparatus according to claim 1 or 2, wherein the process for recording the reproduced image for one frame as still image data is terminated.   When the end of recording of still images is instructed when frame-by-frame playback of the moving image data is being performed, the playback means ends frame-by-frame playback of the moving image data, and the recording means 4. The image recording apparatus according to claim 1, wherein the processing for recording an image of one frame reproduced from the recording medium as still image data is terminated. 5.

Images