JP2013258510A - Imaging device, and method and program of controlling the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress reproduction of a relevant moving image during REC review display of a still picture, in an imaging device provided with a mode to record a moving image immediately before photographing of a still picture in conjunction with the photographing of the still picture.SOLUTION: A control unit (101) records a still picture photographed by an imaging unit (110) in a recording medium (141) via a recording reproduction unit (140). After recording of the still picture, the control unit (101) enters a REC review mode to reproduce the still picture having been just recorded in the recording medium (141) to display the still image on a display unit (130) for a predetermined time period. During REC review display, the control unit (101) does not receive operation to instruct reproduction of a relevant moving image.

Description

  The present invention relates to an imaging apparatus having a function of recording and reproducing a moving image in association with a still image, and a control method and program thereof.

  In recent years, with the enhancement of moving image shooting functions in digital cameras, it is possible to easily enjoy both still images and moving images with a single imaging device. Patent Document 1 describes an imaging apparatus that records a still image and a moving image immediately before shooting a still image by a single release operation and records association information between the moving image and the still image. When there is a moving image associated with the still image during reproduction of the still image, the imaging apparatus displays a moving image reproduction menu and reproduces the associated moving image in accordance with a reproduction instruction from the user. As a result, the user can check the shooting state of the still image with the moving image.

JP 2002-300445 A

  The digital camera has a display mode in which a recorded image is reproduced for a certain time immediately after recording so that the user can visually confirm the recorded image. Such an operation or display is called a REC review display.

  When the technique described in Patent Document 1 is incorporated as it is into a digital camera having a REC review display mode, there are the following problems. That is, when the user inputs a related video playback instruction during the REC review display, the user misunderstands whether the displayed video is a live image after the REC review is completed or a related video.

  It is an object of the present invention to present an imaging apparatus that solves such problems, a control method thereof, and a program.

  An imaging apparatus according to the present invention captures a still image in accordance with an imaging instruction, and controls the recording unit to control the captured still image and the captured moving image in association with each other, and imaging in accordance with the imaging instruction Display control means for controlling to perform a REC review display that automatically displays the captured still image following the imaging, and a related video playback operation when the still image is displayed in the REC review display Even when the still image is displayed in the playback mode in which a plurality of images can be sequentially displayed according to the image feed operation without displaying the moving image related to the still image, the related image is displayed. And a control unit that controls to display the moving image related to the still image when the moving image reproducing operation is received.

  According to the present invention, while providing a playback method capable of easily playing back a moving image related to a still image being played back, it is possible to prevent a malfunction during a REC review or to easily determine a malfunction during a REC review. Can be possible.

It is a schematic block diagram of one Example of this invention. It is a flowchart which shows the imaging | photography recording process in movie digest mode. It is a schematic diagram which shows the imaging sequence example and recording example of a moving image relevant to a still image. It is an example of a confirmation screen with respect to a related moving image reproduction instruction. It is an example of a display which notifies related animation reproduction from a REC review.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to the following examples. The examples described below are for the purpose of illustrating preferred embodiments of the present invention and are not intended to limit the scope of the invention.

  FIG. 1 shows a schematic block diagram of an embodiment of an imaging apparatus according to the present invention. Here, a digital camera will be described as an example of the image pickup apparatus, but a camera incorporated in a mobile phone may be used.

  The imaging apparatus 100 shown in FIG. 1 can record a moving image and a still image separately or simultaneously. The imaging apparatus 100 includes a movie digest mode that captures and records a still image and records a moving image for a predetermined number of seconds before the input of the still image recording instruction in response to a still image recording instruction input. In this movie digest mode, the current movie is combined with the movie previously recorded in the movie digest mode to form an integrated movie.

  The control unit 101 includes, for example, a CPU (MPU), a ROM, a RAM, and the like, and controls each block of the imaging apparatus 100 by loading various processing programs stored in the ROM into the RAM and executing them. Control data transfer in The control unit 101 controls each block of the imaging apparatus 100 according to an operation signal from the operation unit 102 that receives an operation from the user. The control unit 101 analyzes the image signal obtained by the image processing unit 111, and controls each block of the imaging device 100 according to the analysis result.

  The operation unit 102 includes switches for inputting various operations related to shooting such as a power button, a still image recording button, a moving image recording start button, a zoom adjustment button, and an autofocus button. The operation unit 102 further includes a video jump button, a REC review continuation button, a determination button, other cursor keys, a pointing device, a touch panel, and the like. When these keys and buttons are operated by the user, the operation unit 102 transmits an operation signal having contents corresponding to the control unit 101.

  The bus 103 is a general-purpose bus for sending various data, control signals, instruction signals, and the like to each block of the imaging apparatus 100.

  The imaging unit 110 includes an imaging element such as a CCD sensor or a CMOS sensor, a photographing lens that makes an optical image of a subject captured by the lens incident on the imaging element, and a diaphragm that limits the amount of incident light. The imaging unit 110 converts an image signal from the imaging element into a digital signal and supplies the digital signal to the image processing unit 111.

  The image processing unit 111 performs image quality adjustment processing for adjusting white balance, color, brightness, and the like on the digital image signal from the imaging unit 110 based on setting values. The control unit 101 transfers the image signal processed by the image processing unit 111 to the memory 104, the video output unit 150, and the display control unit 131.

  For example, the imaging unit 110 has an optical zoom function and an optical image stabilization function, and the image processing unit 111 has an electronic zoom function and an electronic image stabilization function. The control unit 101 causes these functions to act simultaneously or alternately according to the situation and user settings, and further causes them to act independently.

  The optical zoom function is a function in which when the user operates the zoom key of the operation unit 102, the control unit 101 moves the lens of the imaging unit 110 to enlarge / reduce the optical image of the captured subject. When the user operates the zoom key of the operation unit 102, the electronic zoom function is a function in which the control unit 101 generates an image signal of an enlarged image by cutting out a part from the image signal from the imaging unit 110 in the image processing unit 111. . The optical image stabilization function is a function that calculates the amount of movement of the lens based on an acceleration value detected by a vibration detection unit (not shown) and moves the lens to prevent the captured image from shaking. The electronic image stabilization function is a function that prevents image shaking by adjusting the position of the image signal acquired by the imaging unit 110 in the screen direction based on an acceleration value detected by a vibration detection unit (not shown). It is. The electronic image stabilization function can also be realized by shifting the reading position in the image sensor of the imaging unit 110 based on the acceleration value detected by the vibration detection unit. Since these functions are known techniques, a detailed description thereof will be omitted.

  The audio input unit 120 acoustically / electrically converts the sound around the imaging apparatus 100 using, for example, a built-in omnidirectional microphone or an external microphone connected via an audio input terminal, and converts the sound into a digital signal. Output to the audio processing unit 121. The audio processing unit 121 performs audio processing such as optimization of the level of the input digital audio signal. The audio signal processed by the audio processing unit 121 is transferred to the memory 104 by the control unit 101. The memory 104 temporarily stores image signals and audio signals from the image processing unit 111 and the audio processing unit 121.

  The image processing unit 111 and the audio processing unit 121 read the image signal and the audio signal temporarily stored in the memory 104, encode each of them, and generate a compressed image signal, a compressed audio signal, and the like. The control unit 101 transfers these compressed image signal and compressed audio signal to the recording / reproducing unit 140. The recording / reproducing unit 140 records the compressed image signal and the compressed audio signal from the image processing unit 111 and the audio processing unit 121 and the other control data related to shooting from the control unit 101 on the recording medium 141.

  When the audio signal is not compression-encoded, the control unit 101 transfers the audio signal from the audio processing unit 121 and the compressed image signal from the image processing unit 111 to the recording / reproducing unit 140 and records them on the recording medium 141. In the following description, unless otherwise specified, the compressed audio signal recorded on the recording medium 141 includes a case where the compressed audio signal is an uncompressed audio signal.

  The recording medium 141 may be a recording medium built in the imaging apparatus 100 or a removable recording medium as long as it can record a compressed image signal, a compressed audio signal, and various data generated by the imaging apparatus 100. For example, the recording medium 141 includes any type of recording medium such as a hard disk, an optical disk, a magneto-optical disk, a CD-R, a DVD-R, a magnetic tape, a nonvolatile semiconductor memory, or a flash memory.

  The recording / reproducing unit 140 can read (reproduce) a compressed image signal, a compressed audio signal, various data, and a program recorded on the recording medium 141. The control unit 101 transfers the compressed image signal and the compressed audio signal read by the recording / reproducing unit 140 to the image processing unit 111 and the audio processing unit 121, respectively. Each of the image processing unit 111 and the audio processing unit 121 temporarily stores the compressed image signal and the compressed audio signal in the memory 104 and decodes them according to a predetermined procedure. The decoded audio signal is supplied to the audio output unit 151, and the decoded image signal is supplied to the video output unit 150 or the display control unit 131. When an uncompressed audio signal is recorded on the recording medium 141, the control unit 101 directly transfers the audio signal from the memory 104 to the audio output unit 151.

  The audio output unit 151 includes an audio output terminal, for example, and outputs an audio signal to a connected earphone, speaker, or the like. The audio output unit 151 may be a speaker that is built in the imaging apparatus 100 and that acoustically outputs an audio signal. The video output unit 150 includes, for example, a video output terminal, and outputs an image signal to a connected external display or the like. The audio output unit 151 and the video output unit 150 may be a single integrated terminal, for example, a terminal such as an HDMI (High-Definition Multimedia Interface) (registered trademark) terminal.

  The display control unit 131 causes the display unit 130 to display an image based on the image signal supplied from the image processing unit 111, an operation screen (menu screen) for operating the imaging apparatus 100, and the like. The display unit 130 is a display device such as a liquid crystal display, an organic EL display, or electronic paper.

  The external device communication unit 152 includes, for example, a serial communication connector, can connect an external strobe or an external microphone, and includes a switch for detecting attachment / detachment. A USB connector, an IEEE 1394 connector, or the like can be used as the external device communication unit 152, and can be connected to a computer or the like to communicate image data. Other wireless communication means may be used.

  A basic operation of the imaging apparatus 100 will be described. When the user operates the power button of the operation unit 102, a start instruction is issued from the operation unit 102 to the control unit 101. In response to this instruction, the control unit 101 controls a power supply unit (not shown) to supply power to each block of the imaging apparatus 100.

  When the power is supplied, the control unit 101 instructs the operation unit 102 to indicate which mode, for example, the still image shooting mode, the moving image shooting mode, and the playback mode, etc. Check by signal.

  In the still image shooting mode, the imaging apparatus 100 is in a shooting standby state, and the user operates the still image recording button of the operation unit 102 to perform imaging by the imaging unit 110, and the compressed image signal is recorded on the recording medium 141. . After recording, the camera enters the shooting standby state again.

  In the moving image shooting mode, the imaging apparatus 100 is in a shooting standby state, and when the user operates the moving image recording start button of the operation unit 102, imaging by the imaging unit 110 is started, and a moving image including a compressed image signal and a compressed audio signal is generated. It is recorded on the recording medium 141. When the user operates the moving image recording end button of the operation unit 102, the imaging ends and the imaging standby state is entered again.

  In the reproduction mode, a compressed image signal or a compressed audio signal relating to a file selected by the user is reproduced from the recording medium 141, an audio signal is output from the audio output unit 151, and an image is displayed on the display unit 130.

  The operation in the still image shooting mode will be described in detail. When the still image shooting mode is set by the operation unit 102, the control unit 101 first sets each block of the imaging device 100 to a shooting standby state. In the shooting standby state, the image processing unit 111 supplies the image signal to the display control unit 131 and causes the display unit 130 to display the image indicated by the image signal. The user prepares for shooting while looking at the screen displayed in this way. That is, the live view display of the image captured by the imaging unit 110 is performed.

  When the user operates the still image recording button of the operation unit 102 in the shooting standby state, an imaging instruction is input to the control unit 101. In accordance with this imaging instruction, the control unit 101 controls each block of the imaging apparatus 100 to perform the following operation. That is, the imaging unit 110 converts the subject optical image captured by the photographing lens into an image signal by the imaging element, performs analog-digital conversion, and outputs the image signal to the image processing unit 111. The image processing unit 111 performs image quality adjustment processing (white balance, color, brightness, etc.) on the digital image signal from the imaging unit 110 according to the set value. The image signal processed by the image processing unit 111 is transferred by the control unit 101 to the memory 104, the video output unit 150, and the display control unit 131. By viewing the image displayed on the display unit 130, the user can visually confirm the captured still image.

  The image processing unit 111 reads the image signal temporarily stored in the memory 104, performs the above-described encoding, generates a compressed image signal, and outputs the compressed image signal to the recording / reproducing unit 140. The recording / playback unit 140 writes the compressed image signal to the recording medium 141 as a still image file under file system management such as UDF or FAT.

  When the encoding operation by the image processing unit 111 is completed, the control unit 101 supplies a control signal instructing transition to the shooting standby state to each block of the imaging apparatus 100, and returns to the shooting standby state.

  The operation in the movie shooting mode will be described in detail. When the moving image shooting mode is set by the operation unit 102, the control unit 101 first sets each block of the imaging apparatus 100 to a shooting standby state. In the shooting standby state, the image processing unit 111 supplies an image signal to the display control unit 131 and causes the display unit 130 to display an image of the image signal. The user prepares for shooting while viewing the screen displayed in this way.

  When the user operates the moving image recording start button of the operation unit 102 in the shooting standby state, an imaging start instruction is input to the control unit 101. In response to the imaging start instruction, the control unit 101 controls each block of the imaging apparatus 100 so as to perform the following operation. The imaging unit 110 converts the subject optical image captured by the photographing lens into an image signal by the imaging element, performs analog-digital conversion, and outputs the image signal to the image processing unit 111. The image processing unit 111 performs image quality adjustment processing (white balance, color, brightness, etc.) on the digital image signal from the imaging unit 110 according to the set value. The image signal processed by the image processing unit 111 is transferred to the memory 104 and the display control unit 131 by the control unit 101. The display control unit 131 displays the input image signal on the display unit 130. From the image displayed on the display unit 130, the user can visually confirm the composition in the field of view.

  On the other hand, the audio input unit 120 converts the analog audio signal obtained by the microphone into a digital signal and supplies the obtained digital audio signal to the audio processing unit 121. The sound processing unit 121 optimizes the level of the digital sound signal from the sound input unit 120. The control unit 101 transfers the audio signal processed by the audio processing unit 121 to the memory 104.

  The image processing unit 111 and the audio processing unit 121 read out and encode the image signal and the audio signal temporarily stored in the memory 104, and generate a compressed image signal and a compressed audio signal. The control unit 101 multiplexes the generated compressed image signal and the compressed audio signal in a predetermined format to form a data stream, and outputs the data stream to the recording / reproducing unit 140. The recording / playback unit 140 writes the data stream to the recording medium 141 as one moving image file under file system management such as UDF or FAT.

  When the audio is not compressed, the control unit 101 multiplexes the audio signal generated by the audio processing unit 121 with the compressed image signal generated by the image processing unit 111 and outputs the multiplexed signal to the recording / reproducing unit 140. The recording / playback unit 140 writes the data stream to the recording medium 141 as one moving image file under file system management such as UDF or FAT.

  During the moving image shooting (or moving image recording), the control unit 101 includes the imaging unit 110 and the image processing unit 111 according to the operation of the operation unit 102 by the user and the analysis result of the image signal generated by the image processing unit 111. And the audio processing unit 121 is controlled. For example, the control unit 101 supplies a control signal for moving the lens or adjusting the aperture to the imaging unit 110, and supplies a control signal for adjusting an image or sound to the image processing unit 111 and the sound processing unit 121. .

  During shooting, the user can operate the optical zoom function of the imaging unit 110 and / or the electronic zoom function of the image processing unit 111 by operating the zoom key of the operation unit 102. Further, the control unit 101 operates the optical image stabilization function of the imaging unit 110 or the electronic image stabilization function of the image processing unit 111 based on an acceleration value detected by a vibration detection unit (not shown).

  When the user operates the moving image recording end button of the operation unit 102, the operation unit 102 supplies a shooting end instruction signal to the control unit 101. The control unit 101 controls each block of the imaging apparatus 100 as follows according to the shooting end instruction signal, and ends the recording operation.

  The image processing unit 111 and the audio processing unit 121 stop supplying the image signal and the audio signal to the memory 104, respectively, read and encode the image signal and the audio signal remaining in the memory 104, and the remaining compressed image signal and the compression Generate an audio signal. The control unit 101 multiplexes these remaining compressed image signals and compressed audio signals to form a data stream, and outputs the data stream to the recording / reproducing unit 140. When the audio is not compressed, the control unit 101 multiplexes the audio signal generated by the audio processing unit 121 and the compressed image signal and outputs the multiplexed signal to the recording / reproducing unit 140.

  The recording / playback unit 140 writes the data stream to the recording medium 141 as one moving image file under file system management such as UDF or FAT. When the data stream is written to the recording medium 141 until the end of the data stream, the control unit 101 controls the recording / playback unit 140 and the image processing unit 111 to generate a thumbnail. That is, the recording / reproducing unit 140 reads the compressed image signal of the first frame of the moving image file recorded on the recording medium 141 and supplies it to the image processing unit 111. The image processing unit 111 temporarily stores the compressed image signal of the supplied frame in the memory 104 and decodes it. The image processing unit 111 generates and encodes a thumbnail image from the image signal obtained by decoding. As a result, a thumbnail compressed image signal is generated. The control unit 101 supplies the thumbnail compressed image signal to the recording / reproducing unit 140. The recording / playback unit 140 writes the compressed thumbnail image to the recording medium 141 so as to be combined with the underlying moving image file under the management of a file system such as UDF or FAT. Thereby, the moving image file is completed, and the recording / reproducing unit 140 ends the recording operation.

  When the control unit 101 confirms that the recording operation of each unit has been completed, the control unit 101 sequentially shifts to the shooting standby state.

  The shooting operation in the movie digest mode will be described with reference to the flowchart shown in FIG. The control unit 101 executes a control operation corresponding to the flowchart shown in FIG. 2 by a control program stored in a built-in ROM.

  When the user instructs the operation unit 102 to transition to the movie digest mode, the control unit 101 starts the above-described moving image shooting process in S201. The moving image data (compressed image data and compressed audio data) encoded by the image processing unit 111 and the audio processing unit 121 is temporarily stored in the memory 104.

  In step S <b> 202, the control unit 101 determines whether the number of seconds of moving image data stored in the memory 104 is equal to or greater than a predetermined number of seconds (predetermined recording time). The control unit 101 proceeds to S204 when it is equal to or greater than the predetermined number of seconds, and proceeds to S203 when it is less than the predetermined number of seconds. The predetermined number of seconds is set to be equal to or less than the number of seconds of moving image data that can be temporarily stored in the memory 104. In S203, the control unit 101 discards the oldest moving image data among the moving image data stored in the memory 104, and proceeds to S204. The unit of moving image data to be discarded may be a second unit, a screen unit, or a GOP (Group Of Pictures) unit of a moving image compression format. In this way, the latest moving image data of less than the predetermined number of seconds is always stored in the memory 104.

  In step S <b> 204, the control unit 101 determines whether a discarding condition for discarding the moving image data stored in the memory 104 is satisfied based on the camera operation state of the user. If the discard condition is satisfied, the control unit 101 discards the moving image data stored in the memory 104 (S205), and proceeds to S206. The discarding condition (S204) is the presence / absence of an event that is presumed that the user is not clearly performing the framing operation. Specifically, for example, external strobe connection to the external device communication unit 152, detection of a change in the connection state of an external monitor or an external speaker in the video output unit 150 or the audio output unit 151, and the like.

  In step S <b> 206, the control unit 101 determines whether the still image recording button (release button) of the operation unit 102 has been pressed. When it is determined that the still image recording button has been pressed, the control unit 101 proceeds to S207, and when it is determined NO, the control unit 101 proceeds to S201.

  In step S207, the control unit 101 determines whether the moving image data stored in the memory 104 in step S201 can be recorded on the recording medium 141. In this recording determination, the data size of the moving image data stored in the memory 104 is compared with the capacity obtained by reducing the estimated data amount of the still image captured in S209 from the free capacity of the recording medium 141. The control unit 101 determines that recording is possible when it is determined that the data size of the moving image data is smaller, and determines that recording is not possible when it is determined that the data size of the moving image data is larger. The control unit 101 may determine that recording is not possible when the moving image data stored in the memory 104 is less than a predetermined number of seconds. If it is determined that recording is possible, the control unit 101 proceeds to S208. If it is determined that recording is not possible, the control unit 101 proceeds to S211.

  In step S <b> 208, the control unit 101 determines whether the moving image data stored in the memory 104 can be additionally recorded, that is, additionally recorded, in the moving image file previously recorded on the recording medium 141. When it is determined that additional writing is possible, the control unit 101 proceeds to S209, and when it is determined that additional writing is not possible, the control unit 101 proceeds to S210. A typical example in which additional recording is impossible is a case where a moving image file to be additionally recorded is not recorded on the recording medium 141 and a case where a moving image file is recorded on the recording medium 141 but is protected.

  For example, the control unit 101 checks the moving image file to be added as a condition for allowing additional writing, and determines that additional writing is not possible when any of the following conditions is satisfied. First, the protection attribute is given. Second, the size of the moving image file after additional recording exceeds the upper limit data size of the file system of the recording medium 141. Third, it is a case where the movie file is not a movie file shot in the movie digest mode. Fourth, the shooting date is different from the date set in the imaging apparatus 100. Fifth, the region setting is different from the region set in the imaging device 100. Sixth, there is a case where the model of the imaging device that captured the video file to be added is different from the model of the imaging device that performs the additional recording. Seventh, the frame rate, the number of pixels, the compression method, the audio sampling rate or the number of channels, or the bit depth is different from the moving image data stored in the memory 104. Eighth, it is a case where the additional recording target moving image file could not be normally checked due to the recording medium 141 or the additional recording target moving image file being broken.

  In step S209, the control unit 101 adds the moving image data stored in the memory 104 to the additional recording target moving image file of the recording medium 141, and the process proceeds to step S211. In S210, the control unit 101 newly saves the moving image data stored in the memory 104 as a new moving image file in the recording medium 141, and proceeds to S211.

  In the first place, when there is no moving image file to be added to the recording medium 141 (S207), the control unit 101 bypasses steps S208 to 210 and proceeds to S11.

  In step S <b> 211, the control unit 101 performs still image shooting processing according to the above-described operation, and the still image is recorded on the recording medium 141. After recording the still image on the recording medium 141, the control unit 101 sets the REC review mode in S212. In the REC review mode, as described above, the still image recorded immediately before the predetermined reproduction time is reproduced and displayed on the display unit 130.

  When the user depresses the REC review continuation button on the operation unit 102 during REC review display (S213), the control unit 101 shifts to a REC review hold state in which the REC review mode is maintained regardless of the predetermined playback time (S215). In the REC review hold state, the control unit 101 continues the still image reproduction even when the reproduction time of the still image recorded immediately before has elapsed a predetermined reproduction time. However, when the user presses the REC review release button of the operation unit 102 (S216), the control unit 101 releases the REC review hold state and ends the processing shown in FIG.

  If the REC review state has passed the predetermined playback time (S214) without pressing the REC review continuation button (S213), the control unit 101 cancels the REC review mode and ends the process shown in FIG. When the REC review mode is canceled, the imaging apparatus 100 automatically returns to the through image display.

  In this way, in this embodiment, even if the playback time of the REC review is initially limited, it can be extended by the user's intention, so that the content of the still image that has been taken and recorded immediately before can be confirmed in detail.

  Even when a moving image of a predetermined recording time is recorded in conjunction with still image shooting, only the still image is reproduced in the REC review mode. That is, during still image reproduction in the REC review mode or the REC review hold state, the control unit 101 ignores such an instruction even if the user instructs the operation unit 102 to reproduce a related moving image.

  Furthermore, the control unit 101 accepts only the REC review continuation button in the REC review state before the hold, and accepts only the REC review release button in the REC review hold state. Thereby, unnecessary operation mode transition does not occur. In the REC review state and the REC review hold state, the still image file or the moving image file in the recording medium 141 cannot be sequentially displayed as in the playback mode. Further, during playback of a still image in the REC review state or the REC review hold state, the control unit 101 issues such an instruction even if the user instructs playback of a related movie using the movie jump button of the operation unit 102. ignore. Thereby, it is possible to prevent the user from being confused by the reproduction of the related moving image. Further, since the related moving image is not automatically reproduced after the end of the REC review mode, this also does not confuse the user.

  Instead of providing a specific operation means, in this case, a video jump button, for an operation for instructing the reproduction of a related moving image, an operation that can be distinguished from other operations such as a long press of the specific operation means can be used. For example, when a related video playback operation for a predetermined time or longer during still image display by REC Review is displayed, a video related to a still image is played back and displayed when the related video playback operation is less than a predetermined time. .

  FIG. 3 is a diagram for explaining the operation in the movie digest mode. FIG. 3A shows the temporal relationship between still images P1 to P5 and moving images M1 to M5 recorded for releases 1 to 5. FIG. 3B is an explanatory example of a still image file and a moving image file recorded on the recording medium 141 with respect to FIG.

  As shown in FIG. 3A, in the movie digest mode, for the releases 1 to 5 performed by the user, still images P1 to P5 immediately after the releases 1 to 5 and a predetermined recording time immediately before the releases 1 to 5 are provided. Are recorded on the recording medium 141 in association with each other. That is, P1 is a still image shot in accordance with the shooting instruction of release 1, and M1 is a moving image related to the still image P1. Similarly, still images P2 to P5 are photographed according to releases 2 to 5, and related moving images M2 to M5 are photographed. However, Releases 1 to 3 are performed on September 15, 2010, and Releases 4 and 5 are performed on September 16, 2010.

  The still images P1 to P5 and the moving images M1 to M5 described with reference to FIG. 3A are recorded on the recording medium 141 as illustrated in FIG. That is, the moving image M1 shot by the release 1 is stored as a moving image file “MDG — 0001.MOV” in the folder “100 — 0915” representing the shooting date in the recording medium 141. On the other hand, the still image P1 photographed at the same time is stored in the same folder as a still image file “IMG — 0002.JPG”. The moving image M2 photographed by the release 2 is added to the moving image file “MDG — 0001.MOV”. On the other hand, the still image P2 photographed at the same time is stored in the same folder as a still image file “IMG — 0003.JPG”. The moving image M3 taken by the release 3 is added to the moving image file “MDG — 0001.MOV”. On the other hand, the still image P3 taken at the same time is stored in the same folder as a still image file “IMG — 0004.JPG”. Thus, still images and moving images shot on the same day are stored in the same folder, and moving images are combined into one file.

  The moving image M4 shot by the release 4 is stored as a moving image file “MDG_0005.MOV” in the folder “100_0916” representing the shooting date in the recording medium 141. On the other hand, the still image P4 taken at the same time is stored in the same folder as a still image file “IMG — 0006.JPG”. Here, although the moving image M4 straddles the date, it is possible to maintain the relevance in folder units by being stored in the same folder as the related still image P4. Similarly, the moving image M5 by the release 5 is added to the moving image M4, and the still image P5 is stored as a separate file.

  In the present embodiment, a moving image file “MDG_XXXX.MOV” whose file name prefix is MDG in the same folder as the target still image is handled as a related moving image. However, a known inter-file association technique may be used.

  The operation in the playback mode of this embodiment will be described. When the playback mode is set by the operation unit 102, the control unit 101 supplies a control signal instructing transition to the playback state to each block of the imaging apparatus 100, and each block operates as follows.

  The recording / playback unit 140 reads a still image file (compressed image signal) or a moving image file (compressed image signal and compressed audio signal) recorded on the recording medium 141. The control unit 101 supplies the read compressed image signal and compressed audio signal to the image processing unit 111 and the audio processing unit 121, respectively. Each of the image processing unit 111 and the audio processing unit 121 temporarily stores the compressed image signal and the compressed audio signal in the memory 104 and decodes them according to a predetermined procedure. The control unit 101 supplies the decoded reproduced audio signal to the audio output unit 151, and supplies the decoded reproduced image signal to the video output unit 150 or the display control unit 131. The display control unit 131 causes the display unit 130 to display an image indicated by the input image signal. The audio output unit 151 outputs the input audio signal as sound from a built-in speaker or outputs it to a connected earphone or speaker.

  In the case of an uncompressed audio signal, the control unit 101 supplies the uncompressed audio signal from the recording / playback unit 140 to the audio output unit 151.

  The control unit 101 sequentially reproduces or sequentially displays the still image file or the moving image file in the recording medium 141 according to the above-described procedure every time the user inputs an image feed instruction using the operation unit 102. When the moving image jump button of the operation unit 102 is pressed during still image display in the reproduction mode, the control unit 101 reproduces and displays the associated moving image when there is a moving image associated with the displayed still image. .

  In the above embodiment, the related video playback instruction during still image playback in the REC review mode or the REC review hold state is ignored, but a confirmation dialog is presented to the user for confirmation of the necessity of playback. May be. That is, the control unit 101 causes the display unit 130 to display a confirmation screen for transition to moving image reproduction in response to a related moving image reproduction instruction by the moving image jump button during still image display as a REC review. FIG. 4 shows an example of such a confirmation display. Then, when the user instructs the transition to the moving image reproduction again, the moving image reproduction is performed, and when the transition is denied, the still image display is kept.

  In this way, by forcing the user to perform an explicit confirmation operation, it is possible to prevent an unintentional reproduction of a moving image having a relationship with the still image being reproduced.

  In addition, even if the video jump button is pressed in the REC review state, the related video is not played back. However, if the video jump button is pressed in the REC review hold state, transition to playback of the related video may be performed. . When the reproduction of the related operation is completed, the operation returns to the still image reproduction in the REC review hold state, so that the user is not confused with the operation state.

  In response to pressing of the video jump button in the REC review state or the REC review hold state, the control unit 101 reproduces and displays a related video, and displays an icon or a character string indicating that the video is being reproduced and displayed on the moving image. . FIG. 5 shows such a display example. This display is not performed as shown in FIG. 5 when transitioning from still image playback to related video playback in the playback mode.

  By adopting the display illustrated in FIG. 5, the user can easily identify whether the related moving image is reproduced or the live image (the image currently being captured by the imaging unit 110) is displayed on the display screen. Misunderstanding can be effectively prevented.

  Although the embodiments of the present invention have been described, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. For example, the function of the control unit 101 described with reference to FIG. 2 can be realized by a single hardware / software or a combination of a plurality of hardware / software. Furthermore, the above-described embodiments can be appropriately combined.

  Needless to say, the present invention is not limited to an object manufactured and sold as an imaging apparatus, but can also be applied to an object manufactured and sold in combination with another apparatus or incorporated in another apparatus. For example, the present invention can be applied to a personal computer, a PDA, a portable terminal device, a game machine, and the like that include an imaging device that satisfies the requirements defined in the claims.

  The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. To be executed. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (13)

Recording means for capturing a still image in accordance with an imaging instruction and controlling the captured still image and the captured moving image to be recorded in association with each other;
Display control means for controlling to perform a REC review display for automatically displaying a still image captured in accordance with the imaging instruction following the imaging;
While displaying the still image in the REC review display, even if there is a related video playback operation, the video related to the still image is not displayed, and a plurality of images are sequentially displayed according to the image forwarding operation. Control means for controlling to display the moving image related to the still image when the related moving image reproducing operation is received when the still image is displayed in a playback mode capable of An imaging device. Recording means for capturing a still image in accordance with an imaging instruction and controlling the captured still image and the captured moving image to be recorded in association with each other;
Display control means for controlling to perform a REC review display for automatically displaying a still image captured in accordance with the imaging instruction following the imaging;
When a related video playback operation is received when the still image is displayed in a playback mode in which a plurality of images are sequentially displayed according to an image feed operation, control is performed to display the video related to the still image, Control means for controlling to restrict display of the moving image related to the still image when the related moving image reproduction operation is accepted while the still image is displayed in the REC review display. An imaging apparatus characterized by the above. The control means includes
When the related video playback operation is accepted while the still image is displayed in the REC review display, a confirmation display as to whether or not to display the video related to the still image is performed, and the video is displayed. When the operation to display is received, the video is displayed,
The control is performed so as to display the moving image associated with the still image without performing the confirmation display when a related moving image reproduction operation is received while the still image is displayed. The imaging device described in 1. The display control means ends the REC review display when a predetermined playback time has elapsed without a specific operation, and displays the REC review display when the specific operation is received before the predetermined playback time has elapsed. To perform even if the predetermined playback time is exceeded,
The control means may be associated with the still image even if the related video playback operation is performed before the predetermined playback time has elapsed and the specific operation is not received during the REC review display. Control to display the video related to the still image in response to receiving the related video playback operation after receiving the specific operation after displaying the rec review without displaying the video. The imaging apparatus according to claim 2 or 3, wherein   The control means displays the moving image related to the still image when the related moving image reproduction operation for a predetermined time or longer is received while the still image is displayed in the REC review display. When the related video playback operation is performed for less than a predetermined time while the still image is displayed in the REC review display, the video related to the still image is displayed. The imaging apparatus according to claim 2, wherein the imaging apparatus is not provided.   In the case where the control means performs the playback display of the video related to the still image in response to receiving the related video playback operation while the still image is displayed in the REC review display, The imaging apparatus according to any one of claims 2 to 5, wherein the display is a display indicating that playback is being performed, and the display is different from the playback display of the moving image in the playback mode.   The display control unit performs control to perform live view display of an image captured by the imaging unit in a shooting standby state before receiving the imaging instruction, and automatically after the end of the REC review display. The imaging apparatus according to claim 1, wherein the imaging apparatus is controlled to perform the through image display.   8. The moving image recorded in association with the still image by the recording unit is a moving image including an image captured at a predetermined time before an imaging instruction for capturing the still image. The imaging device according to any one of the above.   9. The image pickup apparatus according to claim 1, wherein during the REC review display, even if the image feeding operation is performed, the displayed image is not switched. A recording step of capturing a still image in accordance with an imaging instruction and controlling the captured still image and the captured moving image to be recorded in association with each other;
A display control step for controlling to perform a REC review display for automatically displaying a still image captured in accordance with the imaging instruction following the imaging;
While displaying the still image in the REC review display, even if there is a related video playback operation, the video related to the still image is not displayed, and a plurality of images are sequentially displayed according to the image forwarding operation. And a control step for controlling to display the moving image related to the still image when the related moving image reproducing operation is received when the still image is displayed in the reproduction mode. Control method. A recording step of capturing a still image in accordance with an imaging instruction and controlling the captured still image and the captured moving image to be recorded in association with each other;
A display control step for controlling to perform a REC review display for automatically displaying a still image captured in accordance with the imaging instruction following the imaging;
When a related video playback operation is received while the still image is displayed in a playback mode in which a plurality of images are sequentially displayed according to an image forwarding operation, the video associated with the still image is controlled to be displayed. And a control step for controlling to limit the display of the moving image related to the still image when the related moving image reproduction operation is accepted while the still image is displayed in the REC review display. And a method of controlling the imaging apparatus.   A program that causes a computer to function as each unit of the imaging device according to any one of claims 1 to 9.   A computer-readable storage medium storing a program that causes a computer to function as each unit of the imaging apparatus according to any one of claims 1 to 9.

Images