JP2010141717A - Image recording reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image recording reproducing device which can readily execute operation for capturing and recording a plurality of still images continuously from reproduced image data. <P>SOLUTION: The device has: a reproducing part for reproducing a moving image from a record medium; an operation key for instructing record of a still image; a record part for generating and recording still image data from the moving image reproduced by the reproducing part, according to an instruction from the operation key; and a control part which executes frame advance one by one until instruction from the operation key is canceled and controls it to continuously record still image data relating to a plurality of still images obtained by frame advance reproduction. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image recording / playback apparatus, and more particularly to a technique for capturing a still image from a playback image of video data recorded on a recording medium such as a memory card or an optical disk and recording the still image data.

  In recent years, the resolution of video data captured by a video camera or the like has increased, and it has become possible to reproduce high-quality images from recorded video data. In addition to viewing recorded video data as a moving image, it is generally used such that a desired frame is extracted as a still image from the video data and viewed in a playback form such as a still image or a slide show. It is like that.

  As a technique for extracting a desired still image from recorded video data, a technique is known in which a user operates an operation button at a desired image timing to capture a still image depending on the timing (for example, , See Patent Document 1).

  By the way, some video cameras can record a captured image of 24 frames (seconds) per second corresponding to the frame rate of a movie. In addition, techniques for performing 2: 3: 2: 3 pull-down conversion processing and 2: 3: 3: 2 pull-down conversion processing on progressive video (24p) captured at 24 frames / second are also known. The so-called pull-down conversion process is a technique for generating an interlaced video (60i) of about 60 frames (fields) per second from 24p, for example, by inserting duplicate fields at a predetermined timing. A technique for recording a 60i interlaced video generated from 24p on a recording medium is also known (see, for example, Patent Document 2).

In addition, when playing back recorded interlaced video, there are technologies for combining the top field and the bottom field according to motion adaptation processing, and intra-field interpolation technology for generating a field for synthesis from the top field or the bottom field. Are known. (For example, refer to Patent Document 3.) Such a technique is generally called IP conversion (interlace / progressive conversion). By performing the IP conversion, it is possible to convert the video data recorded at 60i into a progressive video (60p) of 60 frames / second and output it.
JP 2006-140901 A JP 2003-284007 A JP 10-327393 A

  However, with the technique described in Patent Document 1, only one still image can be acquired by one still image capture operation. That is, in order to continuously capture still images from a moving image, it is necessary to repeatedly perform a still image capture operation. This is a troublesome operation for a user who wants to continuously capture a plurality of still images instead of one.

  In view of this, it is conceivable to capture a plurality of consecutive frames of still images at once in response to a single still image capture operation. However, as in the above-described prior art, interlaced video (pull-down converted) ( For example, it is assumed that 60i) is reproduced. In the case of interlaced video, a still image is captured from the frame after IP conversion. However, if it is an interlaced video that has undergone pull-down conversion processing, duplicate fields exist, so still image capture is possible. It is considered that unsuitable frame images are included.

  SUMMARY OF THE INVENTION In view of such problems, it is an object of the present invention to provide an image recording / reproducing apparatus that can easily execute an operation of continuously capturing and recording a plurality of still images from reproduced video data. .

  In order to achieve the above object, an image recording / reproducing apparatus according to the present invention comprises a reproducing means for reproducing video data recorded on a recording medium, an operating means for instructing recording of a still image, and an instruction from the operating means. In response, the recording means for generating and recording still image data from the video data reproduced by the reproduction means, and the reproduction means for each frame until the instruction from the operation means is released. Control means for executing frame advance reproduction and controlling the recording means to continuously record still image data relating to a plurality of still images obtained by the frame advance reproduction. To do.

  According to the present invention, it becomes possible to continuously capture a plurality of still images from reproduced video data, thereby improving user convenience.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The present invention is not limited to the embodiments described below. Further, the embodiment of the present invention shows the most preferable mode of the invention, and does not limit the scope of the invention.

  FIG. 1 is a block diagram showing a configuration of an image recording / reproducing apparatus according to Embodiment 1 of the present invention.

  In FIG. 1, a recording medium 2 which is a random access medium such as a removable memory card is connected to an image recording / reproducing apparatus 1.

  The image recording / playback apparatus 1 includes a recording / playback unit 101 having a media interface (I / F) function, a stream buffer 102, an MPEG decoder (decoder) 103, and an IP conversion unit 107 that performs interlace / progressive conversion. Is provided. Furthermore, the moving image format determination unit 104, the pull-down detection unit 105, the scene change detection unit 106, the frame image generation unit 108, the frame buffer 109, the JPEG encoder 110, the display unit 111, the operation key 112, and the control unit (CPU) 113. Is provided. The operation key 112 includes an operation unit for instructing still image capture, and the control unit 113 controls each unit of the image recording / reproducing apparatus 1 in accordance with a user instruction input from the operation key 112.

  The recording / reproducing unit 101 has a function of reproducing video data or still image data recorded on the recording medium 2 and a function of recording video data or still image data on the recording medium 2. When the still image capture operation is executed, the recording / reproducing unit 101 reproduces moving image video data (MPEG stream) from the recording medium 2 and generates still image data (in JPEG format) generated by a JPEG encoder 110 described later. Still image data) is recorded on the recording medium 2.

  The stream buffer 102 temporarily holds video data (MPEG stream) reproduced by the recording / reproducing unit 101. The video data stored in the stream buffer 102 is sequentially sent to the MPEG decoder 103, and the MPEG decoder 103 decodes the compressed state in the MPEG format. In the present embodiment, a configuration in which video data compression-encoded in MPEG format is reproduced from the recording medium 2 is described. However, the image compression-encoding method is not limited to MPEG. H.264 system or the like may be used.

  For the reproduced video data decoded by the MPEG decoder 103, the moving image format determination unit 104 determines the moving image format. Specifically, the moving image format determination unit 104 determines whether the video is a progressive video or an interlace video. In addition, the pull-down detection unit 105 detects whether or not the image is a pull-down recorded video by detecting information indicating that the video data has been pulled-down converted from the reproduced video data and the position of the duplicate field, and the field. Determine the type of each. Information indicating that recording was performed after pull-down conversion can be identified from a flag or the like recorded in a predetermined data area in the video data. Further, the scene change detection unit 106 detects a scene change point in the reproduced video data. A scene switching point is a change point of a title (clip) of video data, a point where a scene change occurs, a change point of a moving image format, or the like.

  The IP conversion unit 107 is a functional block that converts video data decoded by the MPEG decoder 103 into progressive video when the video data is interlaced video. The IP conversion process is performed by combining the top field and the bottom field according to the motion adaptation process, or by using intra-field interpolation that generates a field for synthesis from the top field or the bottom field. Note that when the video data is progressive video, the IP conversion unit 107 is configured to allow through.

  The frame image generation unit 108 uses the function of outputting the video data from the IP conversion unit 107 to the frame buffer 109, the previous frame image temporarily stored in the frame buffer 109, and the current frame image. It has a function of generating a frame image. The frame buffer 109 temporarily holds the frame image data sent from the frame image generation unit 108. When the still image capture operation is executed, a desired frame image is generated from the reproduced video data (progressive video), and a new still image is generated by the frame image generation unit 108.

  The JPEG encoder 110 is a still image encoding unit, and compresses and encodes a still image generated by still image capture using the JPEG method. The compressed still image data is recorded on the recording medium 2 via the recording / playback unit 101.

  The display unit 111 includes a liquid crystal monitor, an output unit that outputs to an external monitor, and the like. The display unit 111 displays a moving image related to the reproduced video data or captures a captured still image when executing a still image capture operation. Is displayed.

  FIG. 2 is a flowchart illustrating the operation of the still image capture process according to the first embodiment, which is executed under the control of the control unit 113 in response to a user instruction from the operation key 112.

  First, in accordance with the control of the control unit 113, an instruction to record a still image (still image capture) is input by the operation key 112 while the recording / playback unit 101 is playing back video data from the recording medium 2. This will start the flow.

  When the recording of the still image is instructed, the control unit 113 determines whether the current frame image in the reproduced moving image is a progressive video or an interlaced video from the moving image format determining unit 104. (S201).

  If the video is a progressive video in S201, the control unit 113 determines whether or not the current frame image is a video that has been subjected to pulldown conversion processing and is recorded based on the detection result from the pulldown detection unit 105 (S202). ).

  If the video is a pull-down converted video in S202, the control unit 113 determines whether the top field of the current frame image is a repeat field based on the detection result of the pull-down detection unit 105 (S203). The repeat field means an overlapping field.

  When the top field of the current frame image is a repeat field in S203, the control unit 113 controls the frame image generation unit 108 to hold the current frame image in the frame buffer 109 (S205). The current frame image held in the frame buffer 109 is used for synthesis with the next frame image.

  If the current frame image is held in S205, the control unit 113 controls the recording / playback unit 101 to perform frame advance playback for one frame (S206). The reproduced frame image after the frame advance is sent to the MPEG decoder 103.

  After the frame advance in step S206, the control unit 113 determines whether the scene of the moving image being played back has been switched or whether the user has instructed the end of recording of the still image (cancellation of the still image capture instruction). (S207). The control unit 113 determines that the scene of the moving image has been switched based on the detection result from the scene switching detection unit 106.

  As a result of the determination in S207, if the scene is switched or the end of recording of the still image is instructed by the user, the flow ends. Otherwise, the process returns to S201.

  On the other hand, if the top field of the current frame image is not a repeat field in S203, the flow moves to S208. Then, the control unit 113 determines whether or not the frame image immediately before the current frame image is held in the frame buffer 109 (S208).

  When the previous frame image is held in the frame buffer 109 in S208, the control unit 113 uses the frame image generation unit 108 to create a new frame using the data of the immediately previous frame image temporarily held in the frame buffer 109. Generate an image. Specifically, the frame image generation unit 108 combines the bottom field of the immediately preceding frame image held in the frame buffer 109 and the top field of the current frame image, so that the same frame image as before the pull-down conversion is performed. Is generated (S209).

  If the video is not a progressive video in S201, the control unit 113 determines that the video is an interlaced video. In this case, the control unit 113 performs IP conversion by the IP conversion unit 107, and generates a progressive frame image from the top field and the bottom field corresponding to the current frame image (S210).

  When a frame image is generated in S209 and S210, the flow proceeds to S211. The flow also proceeds to S211 when the video is not recorded by pull-down conversion in S202, and when the frame image immediately before the current frame image is not held in the frame buffer 109 in S208.

  In S211, the control unit 113 performs control so as to record (still image capture) the frame image generated in S209 or S210 or the current frame image based on the determination in S202 or S208 as a still image (S211 capture). ). The frame image that is the target of still image capture is compression-encoded by the JPEG encoder 110 and recorded on the recording medium 2 by the recording / playback unit 101. At this time, a recorded still image may be displayed on the display unit 111.

  When still image capture is executed for one frame image, the flow proceeds to S206. As described above, in S206 and subsequent steps, it is determined whether or not to capture a still image for the next frame image by performing frame-by-frame playback. Therefore, until the flow is determined to end in S207, the still image capture process for a plurality of frame images is continuously repeated.

  FIG. 3 is an image diagram in a case where the continuous still image capture process as shown in FIG. 2 is performed on a 60 Hz interlaced recorded image. In the example of FIG. 3, the moving image encoding format is 30 frames / second (30 fps) interlaced video, and the recorded image format is 60 Hz interlaced: 60i (no pull-down). FIG. 3 shows a field pair for recording a still image when such image data is captured by the procedure shown in FIG.

  Note that the “progressive flag”, “pull-down determination flag”, and “pull-down flag” described in FIG. 3 and the like are stored in a predetermined data area in the MPEG stream for each frame of the moving image encoding format when recording video data. Additional information to be multiplexed. The information is also detected by the moving image format determination unit 104 and the pull-down detection unit 105 during reproduction. In FIG. 3 and FIGS. 4 and 5 to be described later, as information given to each of the moving image encoded frames (F0 to F14), the progressive flag “0” indicates interlace and “1” indicates progressive. Further, the pull-down determination flag indicates that “0” is not pull-down recording, “1” indicates that it is pull-down recording, and the pull-down flag indicates that “0” is a repeat field and “1” is a non-repeat field. .

  When a playback image is captured for a stream of such a moving image encoding format and a recording image format, it is determined in S201 in FIG. 2 that the video is not progressive video (interlace video). In this case, a still image is recorded in units of frames that match the moving image encoding format. Since the recording image format is interlaced, the frame image IP-converted in S210 in FIG. 2 is recorded as a still image. Therefore, as shown in FIG. 3, 15 still images are recorded from 15 consecutive frames (F0 to F14) as the moving image encoding format.

  Next, FIG. 4 is an image diagram when the continuous still image capture process as shown in FIG. 2 is performed on a 30 Hz progressive recording image. In the example of FIG. 4, the moving image encoding format is 30 frames / second (30 fps) interlaced video, and the recording image format is 30 Hz progressive: 30 p (no pull-down). FIG. 4 shows a field pair for still image recording when still image capture is performed on such video data in the procedure shown in FIG.

  When a still image is captured with respect to a stream of such a moving image encoding format and a recording image format, the process proceeds from S202 to S211 in FIG. In this case, a still image is recorded in units of frames that match the moving image encoding format. Since the recording image format is progressive, the reproduced and decoded frame image is recorded as a still image as it is. Therefore, as shown in FIG. 4, 15 still images are recorded from 15 consecutive frames (F0 to F14) as the moving image encoding format.

  Next, FIG. 5 is an image diagram in a case where the continuous still image capturing process as shown in FIG. 2 is performed on a 2-3 pull-down recorded image of 24 Hz. In the example of FIG. 5, the moving image coding format is 30 frames / second (30 fps) interlaced video, and the recording image format is 24 Hz progressive pull-down: 24p (with pull-down). FIG. 5 shows a field pair for still image recording when still image capture is performed on such video data according to the procedure shown in FIG.

Each frame image in the stream of the moving image encoding format and the recording image format is progressive and is a pull-down recording image. For this reason, the following cases (1) and (2) are considered as frame images to be recorded when a reproduced image is captured as a still image.
(1) Current frame image when NO is determined in S208 (2) Frame image newly generated in S209

  In FIG. 5, any one of the above-mentioned (1) and (2) is indicated corresponding to the recorded still image. In the case of (1), the frame image corresponding to the moving image encoded frame decoded by the MPEG decoder is recorded as it is as a still image. In the case of (2), a new frame image generated from the previous frame image and the current frame image by the frame image generation unit 108 is recorded as a still image. Therefore, as shown in FIG. 5, 12 still images are recorded from 15 consecutive frames (F0 to F14) as the moving image encoding format.

  As described above, according to the image recording / reproducing apparatus described in the present embodiment, an appropriate frame image can be reproduced while repeating playback frame advance and still image capture by a user giving a still image capture instruction during video reproduction. Recording of still images obtained from the above can be performed continuously. Note that still image capture can be performed during video playback or from the playback pause state, and it is easy to record continuous still images without dropped frames from the playback image until the instruction is canceled from the recording start instruction. become able to.

  Further, it is possible to extract a frame image suitable for a still image by determining a moving image encoding format and performing image format conversion such as IP conversion.

  Also, it is possible to record an image frame suitable for a still image by performing pull-down determination, removing a repeat field, and newly generating an image frame before pull-down using previous and next frame images.

  In addition, when the switching of the moving image scene is detected, the recording of the still image is stopped, so that only the frame image of the desired scene period can be recorded as the still image.

  Further, it is possible to prevent a duplicated frame image from being recorded as a still image when the still image recording is resumed by determining the stop of the still image recording after the frame-by-frame playback of the moving image.

  Next, a second embodiment according to the present invention will be described. Note that the configuration block diagram of the image recording / reproducing apparatus 1 in the second embodiment is the same as that described in the first embodiment, and a description thereof will be omitted.

  FIGS. 6 and 7 are flowcharts illustrating the operation of still image capture processing according to the second embodiment, which is executed under the control of the control unit 113 in response to a user instruction from the operation key 112. In the second embodiment, a description will be given of contents to which an error determination process is added when still image capture is performed.

  First, in accordance with the control of the control unit 113, an instruction to record a still image (still image capture) is input by the operation key 112 while the recording / playback unit 101 is playing back video data from the recording medium 2. This will start the flow.

  When the recording of the still image is instructed, the control unit 113 determines whether a decoding error has occurred in the current frame image of the moving image decoded by the MPEG decoder 103 (S600).

  If decoding is possible in S600 (no decoding error occurs), the control unit 113 determines whether or not the moving image encoding format of the current frame image can be determined based on the determination result from the moving image format determination unit 104. (S601). That is, in S601, it is determined whether or not it is possible to determine whether the reproduced frame image is interlaced or progressive.

  When the moving image encoding format can be determined in S601, the control unit 113 determines whether or not the recording image format can be determined based on the detection result from the pull-down detection unit 105 (S602). That is, in S602, it is determined whether the reproduced frame image is a video recorded by being pulled down, and whether a pull-down flag or the like can be determined.

  If the recording image format can be determined in S602, the flow transitions to A in FIG. 7, and the flow after S201 is executed in the same process as described in FIG.

  On the other hand, if the moving image encoding format cannot be determined in S601, or if the recorded image format cannot be determined in S602, the flow transitions to B of FIG. 7, and the flow after S210 is executed in the same process as in FIG. Is done. In this case, the control unit 113 assumes that the reproduced current frame image is interlaced. By performing IP conversion assuming interlace, a progressive frame image can be generated. Even if the current frame image is a progressive image, only one field is interpolated and there is no problem due to IP conversion.

  If the current frame image cannot be decoded in S600, the flow transitions to D in FIG. 7, and the still image capturing process is terminated as it is.

  In FIG. 7, when the flow transitions to S207 in the same process as in FIG. 2, if the result of the determination in S207 is that the scene has been switched or the user has instructed the end of recording of a still image, The flow ends. On the other hand, in S207, otherwise, the process proceeds to C in FIG. 6 and returns to S600.

  If NO is determined in S600, S601, or S602, the result may be notified to the user, specifically, a warning display may be displayed on the display unit 111.

  In addition, when it is determined NO in S601 or S602, the process transits to B. However, when it is certain that the still image capture is to be finished, the process may be modified to transit to D.

  As described above, according to the image recording / reproducing apparatus described in the present embodiment, even when the moving image encoding format or the recording image format of the decoded frame image cannot be determined, the image recording / reproducing apparatus obtained by performing IP conversion The frame image was recorded as a still image. As a result, the executable range of still image capture can be expanded, and interlaced images can be prevented from being recorded as they are.

1 is a block diagram illustrating a configuration of an image recording / reproducing apparatus according to Embodiment 1 of the present invention. 3 is a flowchart illustrating an operation of a still image capture process according to the first embodiment. It is an image figure at the time of performing a continuous still image capture process with respect to the 60-Hz interlace recording image. It is an image figure at the time of performing a continuous still image capture process with respect to a 30 Hz progressive recording image. It is an image figure at the time of performing a continuous still picture capture process with respect to the 2-3 pulldown recording image of 24 Hz. 10 is a flowchart illustrating an operation of still image capture processing according to the second embodiment. 10 is a flowchart illustrating an operation of still image capture processing according to the second embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image recording / reproducing apparatus 2 Recording medium 101 Recording / reproducing part 102 Stream buffer 103 MPEG decoder 104 Moving image format discrimination | determination part 105 Pull-down detection part 106 Scene change detection part 107 IP conversion part 108 Frame image generation part 109 Frame buffer 110 JPEG decoder 111 Display Part 112 operation key 113 control part

Claims (7)

Playback means for playing back video data recorded on a recording medium;
Operation means for instructing recording of a still image;
Recording means for generating and recording still image data from video data reproduced by the reproducing means in response to an instruction from the operating means;
Until the instruction from the operation means is released, the playback means executes frame-by-frame playback for each frame, and the recording means has a plurality of still images obtained by the frame-by-play playback. An image recording / reproducing apparatus comprising: control means for controlling the continuous image data to be recorded continuously. Moving image format determining means for determining whether the video data reproduced by the reproducing means is interlaced video or progressive video;
Conversion means for converting the interlaced video into the progressive video,
When the video data played back by the playback means is the interlaced video, the control means controls to generate the still image data from the frame image after being converted into the progressive video by the conversion means, 2. The image recording / reproducing apparatus according to claim 1, wherein when the video data reproduced by the reproducing means is the progressive video, control is performed so as to generate the still image data from the reproduced frame image. Pull-down detection means for detecting a frame image recorded by pull-down conversion from the video data reproduced by the reproduction means;
Frame buffer means for extracting and holding a frame image from video data reproduced by the reproducing means based on a detection result by the pull-down detecting means;
Frame image generation means for generating the frame image before the pull-down conversion using the reproduced current frame image and the previous frame image stored in the frame buffer means;
When the recording means generates the still image data from the pull-down converted video data, the recording means generates the still image data from the frame image reproduced by the reproduction means and the frame image generated by the frame image generation means. The image recording / reproducing apparatus according to claim 1, wherein:   The pull-down detection means detects a position of the duplicate field, and based on the detected position of the duplicate field, the control means records the still image data and then plays back the frame, 4. The image recording / reproducing apparatus according to claim 3, wherein it is determined whether to perform frame-by-frame reproduction without recording still image data. Further comprising a scene change detecting means for detecting a change of the scene of the video data reproduced by the reproducing means,
5. The image recording according to claim 1, wherein the control unit ends recording of the still image data by the recording unit based on a detection result of the scene change detection unit. Playback device.   When the moving image format cannot be determined by the moving image format determining unit with respect to the video data reproduced by the reproducing unit, the control unit converts the reproduced video data by the converting unit. The image recording / reproducing apparatus according to claim 2, wherein control is performed to generate the still image data from a subsequent frame image. Pull-down detection means for detecting video data recorded by pull-down conversion from the video data reproduced by the reproduction means,
When the pull-down detection by the pull-down detection unit cannot be performed on the video data reproduced by the reproduction unit, the control unit converts the reproduced video data by the conversion unit and uses the converted frame image The image recording / reproducing apparatus according to claim 2, wherein control is performed to generate the still image data.

Images