JP2009111554A - Image display device, image display method, image reproducing device, camera and program for image display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device, an image display method, an image reproducing device, a camera and a program for image display, capable of reproducing the situation during photographing and displaying images with present when appreciating photographed images. <P>SOLUTION: The camera acquires camera operation information such as camera posture change information before photographing and records it in a recording medium 21 together with the image data of still images. When reproducing the image data, the camera operation information and the image data are read (S23, S24) and the images based on the image data are displayed according to the camera operation information (S26). At the time, when the camera posture change information is recorded, scroll display is executed on the basis of the information. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image display device, an image display method, an image reproduction device, a camera, and an image display program. More specifically, the present invention relates to an image display device, an image display method, an image reproduction device, a camera, and an image for a captured still image. It relates to a display program.

In recent years, with the widespread use of photographing devices such as digital cameras, it has become possible to easily obtain image data of still images. Recently, in addition to showing the acquired still image, a proposal for image reproduction with a display effect has been made in order to improve the visual effect. For example, Patent Literature 1 and Patent Literature 2 disclose an image reproducing device that displays a plurality of still image files with effects such as fade-out and wipe, and thereby performs user-preferred reproduction.
JP 2006-174134 A JP 2000-125191 A

  In the image reproduction apparatuses disclosed in these patent documents, the display method can be changed. However, this alone was not enough to get a sense of realism when shooting. That is, in shooting, there are cases where the user moves the camera for framing, and the composition examination process and subject movement, such as zoom operation, do not appear in the still image. In the image reproduction device disclosed in the above-mentioned patent document, a display effect is applied and the image reproduction lacks a sense of reality regardless of the operation at the time of shooting.

  The present invention has been made in view of such circumstances, and when appreciating a photographed image, reproduces the situation at the time of photographing, an image display device capable of displaying an image with a sense of reality, an image display method, An object is to provide an image reproduction device, a camera, and an image display program.

  In order to achieve the above object, an image display device according to a first aspect of the present invention is an operation information recording unit for recording operation information about a shooting operation and its temporal change within a predetermined time before or after shooting a still image. And an effect image generating unit that generates an effect image having a visual effect equivalent to that captured based on the operation information, and a display unit that continuously displays the effect image and the still image.

The image display device according to a second invention is the image display device according to the first invention, wherein the operation information is at least one of photographing field angle information, zoom magnification information, AF information, and exposure information of a camera that has photographed the still image. Information.
According to a third aspect of the present invention, in the first aspect, the effect image generation unit performs predetermined image processing on the still image based on the operation information, thereby obtaining the operation information. In response, an effect image having a visual effect equivalent to the imaged image is generated.
Furthermore, in the image display device according to a fourth aspect of the present invention, in the first aspect, the effect image generation unit generates a composite image of the images captured before and after capturing the still image and the still image, An image having an angle of view corresponding to the shooting angle of view information of the camera is cut out.

  In order to achieve the above object, an image display method according to a fifth aspect of the present invention includes a step of reading out from the recording unit operation information regarding a photographing operation and its temporal change within at least one predetermined time before or after photographing a still image. , Generating an effect image having a visual effect equivalent to that at the time of imaging according to the operation information, and continuously displaying the effect image and the still image.

  According to a sixth aspect of the present invention, there is provided an image reproduction apparatus comprising: at least one of a predetermined period of time before and after capturing a still image attached to image data; operation information relating to a temporal change thereof; A data reading unit for reading, an effect image generating unit for generating an effect image having a visual effect equivalent to that at the time of imaging based on the read operation information and the image data, and the effect image and the still image are continuously A display unit for displaying the image is provided.

A camera according to a seventh aspect of the invention is a mode setting unit that sets a realistic reproduction shooting mode, an information collection unit that collects camera operation information when the realistic reproduction shooting mode is set,
An imaging unit that acquires image data based on a subject image, the camera operation information, and a recording unit that records the image data are provided.
According to an eighth aspect of the present invention, in the seventh aspect of the invention, the camera includes a pre-capture unit that acquires a pre-capture image, and the recording unit records the pre-capture image together with the recording.

  According to a ninth aspect of the invention, there is provided a program for reproducing an image, the operation information relating to a photographing operation and its temporal change within a predetermined time before or after photographing a still image attached to the image data, and the image data And generating an effect image having a visual effect equivalent to that at the time of imaging based on the read operation information and the image data, and continuously displaying the effect image and the still image.

  According to a tenth aspect of the invention, in the ninth aspect of the invention, the image reproduction program reads the pre-capture image attached to the image data at the time of reading the image data, and generates the pre-capture image when generating the effect image. An effect image is generated also using the captured image.

  According to the present invention, an image display device, an image display method, an image reproduction device, a camera, and an image display program capable of reproducing the situation at the time of appreciation and displaying a realistic image when viewing a captured image. Can be provided.

  Hereinafter, preferred embodiments using a digital camera to which the present invention is applied will be described with reference to the drawings. This digital camera can convert a subject image into image data and record it on a recording medium. In addition, this digital camera can detect time-varying operation information such as camera movement, zooming and focusing of the taking lens, and exposure control values such as exposure correction values. This operation information is also recorded when recording. The image data recorded on the recording medium can be displayed on a display unit such as a liquid crystal monitor when a reproduction instruction is given. In this reproduction display, a display effect is applied to the image based on the operation information.

  FIG. 1 is a block diagram showing the configuration of a digital camera according to the first embodiment of the present invention. In this digital camera, a lens 1 for forming a subject image is disposed, and a CCD (Charge Coupled Device) 3 is provided in the vicinity of the imaging position of the lens 1. In addition to the CCD 3, a two-dimensional imaging device such as a CMOS (Complementary Metal Oxide Semiconductor) sensor may be used.

  The output of the CCD 3 is connected to an imaging circuit 5 that reads out and amplifies image signals. The output of the imaging circuit 5 is connected to an A / D (Analog Digital) converter 7 that performs analog-digital conversion. The A / D converter 7 is connected to a data bus 9, which includes a frame memory 11, a second CPU (Central Processing Unit) 13, a recording buffer 17, and a FIFO (First In First Out) memory. 23 is connected.

  The frame memory 11 is a memory for temporarily storing image data output from the A / D converter 7 and is configured by a memory such as an SDRAM (Synchronous Dynamic Random Access Memory). The frame memory 11 has a pre-capture image temporary holding function 11a.

  The recording buffer 17 is connected to a recording medium I / F (interface) 19, and the recording medium I / F 19 is connected to a recording medium 21. The recording medium 21 is a recording medium for image data, which is built into the camera body or can be attached to the camera body. The recording buffer 17 and the recording medium I / F 19 record and control image data.

  The FIFO memory 23 is a timing adjustment memory used when displaying image data stored in the frame memory 11 or the recording medium 21. If the timing adjustment is not particularly required when displaying the image data, it may be omitted. The output of the FIFO memory 23 is connected to a video output circuit 25 and a TFT (Thin Film Transistor) liquid crystal drive circuit 31.

  The video output circuit 25 is a circuit that generates a video signal for external output, and this output is connected to the video output terminal 27. The external image display device 29 is a display device for image data recorded on the recording medium 21 or the like, and the input terminal of the external image display device 29 can be connected to the video output terminal 27.

  The output of the TFT liquid crystal driving circuit 31 is connected to a TFT panel 33 which is a liquid crystal display monitor, and image data input through the FIFO memory 23 is displayed on the TFT panel 33. The subject image recorded on the recording medium 21 or the like is reproduced and displayed on the TFT panel 33. It is also used as a viewfinder for composition determination. An illumination backlight unit 35 is disposed in the vicinity of the TFT panel 33.

  A battery 39 serving as a power supply source is disposed in the camera, and an output of the battery 39 is connected to a battery state detection circuit 37. The battery state detection circuit 37 detects the output voltage of the battery 39 and outputs the detection result to the first CPU 15. The battery 39 is connected to a power supply circuit 41, and power is supplied from the power supply circuit 41 to each circuit. A backup power supply 43 is connected to the power supply circuit 41. The backup power source 43 is a power source for supplying power to a clock circuit (not shown).

The first CPU 15 includes a power supply circuit 41, an LCD (Liquid Crystal Display) display circuit 45, a key matrix 49, an external wired data I / F 51, a camera shake correction gyro sensor 53, an EEPROM (Electrically Erasable).
Programmable ROM) 55, a lens actuator drive circuit 57, and a camera shake correction actuator drive circuit 61 are connected. The LCD display circuit 45 is connected to the LCD panel 47. On the LCD panel 47, information related to camera control such as an exposure control value such as a shutter speed and an aperture value output from the first CPU 15 and a photographing mode is displayed.

  The key matrix 49 includes various operation buttons, dials, various detection switches and the like provided on the camera body, and is a switch group for detecting an operation state by the user and a camera state. This group of switches includes menu mode setting operation switches and shooting mode setting dials, and the realistic shooting mode and realistic playback mode described later can be set using this menu mode or shooting mode setting dial. Is done. Also included in the switch group are a switch linked to a playback button for instructing a playback mode for reproducing and displaying a recorded image on the TFT panel 33, a switch linked to an exposure correction instruction button, a switch linked to a zoom button, and the like. The external wired data I / F 51 is a data terminal for connection with an external device such as a USB (Universal Serial Bus).

  The camera shake correction gyro sensor 53 is a sensor that detects movement such as camera shake of the camera body. Based on this detection output, the CCD 3 is moved so as to remove the influence of vibrations such as camera shake. Further, by detecting the camera movement before and after photographing and recording it together with the image data, the camera movement before and after photographing is reproduced at the time of image reproduction. The camera shake correction gyro sensor 53 is not limited to the gyro sensor as long as it can detect the movement of the camera body, and may be a sensor such as an angular velocity sensor or an acceleration sensor.

  The EEPROM 55 is an electrically rewritable memory and includes a flash ROM or the like. In the EEPROM 55, various adjustment values of the camera and programs for controlling the first and second CPUs 13 and 15 are stored. Further, as will be described later, camera drive history information 55a such as camera movement before and after the photographing operation, zooming situation, and focusing situation at the time of the automatic focus adjustment operation is temporarily written.

  The lens actuator drive circuit 57 is connected to the actuator 59. The actuator 59 is an actuator for performing focus adjustment and zooming of the lens 1, and is configured by a DC motor, an ultrasonic motor, or the like. The camera shake correction actuator drive circuit 61 is connected to the second actuator 63. The second actuator 63 can move the CCD 3 in the x and y directions in a plane perpendicular to the optical axis of the lens 1. Based on the output of the above-described camera shake correction gyro sensor 53, the second actuator 63 moves the CCD 3 so as to remove vibration (movement) applied to the camera such as camera shake.

  The first CPU 15 mainly fulfills the system control function 15a of the camera and controls the basic operation of the entire camera. The first CPU 15 also has functions such as a camera drive management function 15b, a camera subject view angle management function 15c, and a pre-capture function 15d.

  The camera drive history management function 15b is a function for managing the drive history by zooming, focus adjustment operation, etc. by the drive actuator 59 of the lens 1, and the information obtained here is temporarily stored in the EEPROM 55 as camera drive history information 55a. Memorized.

  The camera subject angle-of-view management function 15c is a camera subject motion management function detected by the camera shake correction gyro sensor 53 or the subject motion detection function 13c in the second CPU 13. In other words, this function 13c manages the detection of movement when the camera is shaken in deciding the composition of the subject or shaking the camera in accordance with the movement of the subject. The camera subject field angle information managed here is temporarily stored in the EEPROM 55.

  The pre-capture control function 13d is a function for acquiring images before and after shooting in addition to the camera drive history information 55a and camera subject field angle information. When pre-capture is used, the image can be made more realistic. The pre-capture image managed here is stored in the pre-capture image temporary holding function 11 a in the frame memory 11. The pre-capture function is used in the second embodiment to be described later, and may be omitted in the first embodiment.

  The second CPU 13 is a CPU that mainly controls image processing of the camera, and has various functions such as a display image processing function 13a, an image compression / decompression function 13b, a subject motion detection function 13c, and a recording medium access function 13d. Have.

  The display image processing function performs image processing using the camera drive history information 55a recorded together with the image data. That is, as camera drive history information 55a, camera movements recorded before and after shooting, zooming status, focusing status during automatic focus adjustment operation, and the like are recorded. Based on this information, image scrolling, Processes such as enlargement / reduction and out-of-focus image processing. Details will be described later with reference to the flowchart of the reproduction mode shown in FIG. The subject motion detection function 13c detects the motion of the subject using a motion vector or the like using the image data.

  The image compression / decompression function 13 b compresses image data when recording the image data stored in the frame memory 11 on the recording medium 21. The function 13b decompresses image data when the compressed image data recorded on the recording medium 21 is reproduced and displayed on the TFT panel 33. The recording medium access function 13d performs reading for recording and reproducing image data on the recording medium 21.

  The operation of the digital camera according to the first embodiment configured as described above will be described with reference to the flowcharts shown in FIGS. The digital camera performs various controls such as exposure control, automatic focus adjustment, zooming operation, and the like. Here, the description will focus on processing related to image reproduction and information acquisition therefor.

  First, the photographing mode will be described with reference to the flowchart shown in FIG. When the shooting mode is entered, it is determined whether or not the realistic reproduction shooting mode is set (S1). As a result of the determination, if the realistic reproduction shooting mode is not set, the process jumps to step S4 and skips the processing for realistic shooting.

  On the other hand, as a result of the determination, when the realistic reproduction shooting mode is set, camera operation information is collected. The camera drive history management function 15b and the camera subject view angle management function 15c collect camera operation information (S2). As camera operation, camera posture (view angle) change information, zoom magnification change information, AF (Auto Focus) operation information, and brightness change information are collected.

  The camera posture (viewing angle) change information is movement information when the camera is moved to determine the subject composition. Based on the detection output of the camera shake correction gyro sensor 53, the movement time and the current time It is obtained as a movement amount (in this embodiment, a value converted into the number of pixels of the CCD 3). The zoom magnification change information obtains how many times it is based on the wide-angle focal length based on the change of the focal length by the focal length changing actuator 59. In addition, when performing digital zoom, it calculates | requires based on the image processing information for digital zoom.

  As the AF operation information, the AF drive time and the optical shift amount from the in-focus position are obtained based on the drive for focusing by the focus adjustment actuator 59. As the brightness change information, the time and the correction value at that time are obtained from the exposure correction change information.

  When the camera operation information is collected in step S2, the camera operation information obtained here is temporarily stored in the EEPROM 55 (S3). Subsequently, it is determined whether or not the release button is fully pressed, that is, whether the 2nd release has been operated (S4). As a result of the determination, if the 2nd release has not been operated, the process returns to step S2 and the above-described operation is repeated. The camera operation information is held in the EEPROM 55 for 5 seconds immediately before the 2nd release operation, and the camera operation information before that is erased by overwriting. The holding time of the camera operation information is not limited to 5 seconds and can be changed as appropriate.

  If the result of determination in step S4 is that the 2nd release has been operated, a shooting operation is performed (S5). The photographing operation is performed by photoelectrically converting a subject image formed on the CCD 3 and acquiring image data based on the photoelectric conversion signal. When the photographing operation ends, the camera operation information held in the EEPROM 55 is generated in a file header recording format (S6). An example of camera operation information recorded in the file header is shown in FIG.

  Here, what is generated in the file header recording format is recording of camera operation information performed during a predetermined time, such as operation information for 5 seconds immediately before shooting. The EEPROM 55 may hold camera operation information for a time longer than the time to be recorded here, and in this step, it may be extracted for recording from the held camera operation information.

  Subsequently, an image file is generated from the image data of the still image for recording and the file header (S7). As shown in FIG. 4, the image file includes a file header in which camera operation information and the like are recorded, and image data. When the image file is generated, the image file is then compressed and recorded on the recording medium 21 (S8). When the recording is finished, it is determined whether or not the photographing mode is finished (S9). If the photographing mode is not finished, the process returns to step S1, while if the result of the judgment is that the photographing mode is finished, the photographing mode is changed. finish.

  As described above, in the flow of the shooting mode, when the realistic reproduction shooting mode is selected, the camera operation information is collected and recorded, and when the release button is fully pressed, the shooting operation is performed. Camera operation information is recorded together with image data. It should be noted that the camera operation information is collected and recorded in steps S2 and S3 only when the first release is detected by half-pressing the release button, the realistic reproduction shooting mode is set, and the first release of the release button is operated. You may make it perform.

  Next, the playback mode will be described using the flowchart shown in FIG. When the reproduction mode is entered, it is first determined whether or not the realistic reproduction reproduction mode is set (S21). If the result of determination is that the realistic reproduction mode has not been set, the image reproduction processing sequence is generated as “no change” because it is the normal reproduction mode (S29). When the generation ends, the process jumps to step S24.

  If the result of determination in step S21 is realistic reproduction mode, camera operation information is read from the image file header for the selected image (S22). Based on the read camera operation information, an image reproduction processing sequence is generated (S23).

  Subsequently, the image data of the still image is read from the image file (S24), and the image data of the still image is expanded (S25). Since the image file recorded on the recording medium 21 is recorded in a compressed format, the decompression process is performed here. Next, the image is reproduced and displayed according to the image reproduction processing sequence generated in step S23 or step S29 (S26). The reproduction display here will be described later with reference to FIGS.

  Next, it is determined whether or not a frame change instruction has been issued (S27). If the result of determination is that a change instruction has been made, the image file after the change is read (S28), the process returns to step S22, and the above-described processing is repeated. On the other hand, if the frame change instruction has not been given as a result of the determination, it is determined whether or not to end the reproduction process (S30). If not, the process returns to step S26 to continue the reproduction mode, If it is completed, a process for termination is performed.

  As described above, in the playback mode in the present embodiment, a still image is played back and displayed based on the camera operation information recorded together with the still image data. This reproduction display and collection of camera operation information for performing the reproduction display will be described with reference to FIGS.

  First, when camera posture (view angle) change information is recorded as camera operation information, as shown in FIG. 6, an image scroll process is performed so as to reproduce a composition change made before photographing. The The example of FIG. 6A shows a state at the time of photographing with the camera 100, and the camera 100 is moving from the right (the direction of the dotted line) to the left (the direction of the solid line). The state of movement at this time is detected by the camera shake correction gyro sensor 53 (see S2 and S3), and is recorded in the file header of the image file when the image data of the still image is recorded (see S6 to S8).

  When playback is performed using the camera operation information recorded in this way (see S26), the image is scrolled in the direction of arrow A from right to left. That is, when the image 81 is scrolled from the left side to the right side with respect to the display surface 71 of the TFT panel 33, the same feeling as if the photographer moved the camera 100 to determine the composition just before shooting was reproduced. can do.

  Next, FIG. 7 shows a case where the zoom magnification changing operation is performed. In this case, image enlargement or reduction processing is performed so as to reproduce zooming performed before photographing. In the shooting mode, in the example of FIG. 7A, the camera 100 is zoomed down, that is, the focal length is changed from the long focal point side to the short focal point side. Although the subject image is displayed in a large size, the subject image in the short focus observation region 83 within the range of the solid line is displayed small by zooming to the short focus side.

  When determining the composition of the subject in such a state, a change in zoom magnification is detected by the camera drive history management function 15b (see S2 and S3). When the 2nd release is operated, a still image corresponding to the area 83 is acquired as image data (S5), and zoom magnification change information before photographing is recorded in the file header of the image file (see S6 to S8).

  In the reproduction mode, the recorded image data is a still image 84 corresponding to the short focus observation area 83, and since the zoom was down before photographing, the image is reduced. That is, at the beginning of reproduction display, an image corresponding to the long focus observation area 82 is displayed on the entire display surface 81 of the TFT panel 33, and then the still image 84 is reduced to the size of the display surface 81. This display process can reproduce the same feeling as if the photographer zoomed down the photographing lens when determining the composition before photographing.

  In the case of zooming up, image data of a still image is acquired on the long focal side. Therefore, first, the image is stationary in a range corresponding to the focal length on the short focal side on the display surface 81 of the TFT panel 33. The image is reduced and displayed. In this case, since there is no image information around the reduced still image, it is set to white or the like. Then, the reduced image is enlarged, and finally a still image is displayed on the entire display surface 81. This display process can reproduce the same feeling as if the photographer zoomed up the photographing lens when determining the composition before photographing.

  Next, FIG. 8 shows a case where the AF operation is performed. In this case, image processing from the out-of-focus state to the in-focus state is performed so as to reproduce the AF operation performed before photographing. In the example of FIG. 8A, the subject is initially out of focus and is brought into focus by performing an AF operation. At this time (see S2 and S3), AF operation information is stored, and focused image data is acquired according to the 2nd release operation (S5), and AF operation information before shooting is recorded in the file header of the image file. (See S6 to S8).

  In the playback mode, since the recorded image is in focus, first, an out-of-focus image is generated based on the amount of optical deviation from the AF in-focus position recorded as AF operation information. This is displayed (see FIG. 8B). Then, the focused image is gradually displayed, and finally an image based on the acquired still image is displayed (see S8 (C)). This display process can reproduce the same feeling as if the photographer performed the AF operation before photographing.

  Next, FIG. 9 shows a case where an exposure correction operation is performed. In this case, image processing is performed to change the brightness of the image so as to reproduce the exposure correction operation performed before shooting. In the example of FIG. 9A, the camera 100 performs an exposure correction operation. The state of the exposure correction operation at this time is detected and stored (see S2 and S3). In response to the second release operation, image data subjected to exposure correction is acquired (S5), and exposure correction information before photographing is recorded in the file header of the image file (see S6 to S8).

  In the playback mode, since the recorded image is a still image that has been subjected to final exposure correction (with a correction value of ± 0), the recorded image is based on the first exposure correction information that is available as camera operation information. Then, an image in the initial exposure correction state is generated and displayed (see FIG. 9B). Then, an image corresponding to the change in exposure correction is displayed, and finally an image based on the acquired still image is displayed (see FIG. 9C). This display process can reproduce the same feeling as if the photographer performed the exposure correction operation before photographing.

  As described above, in the first embodiment of the present invention, camera operation information before shooting a still image is recorded, and when reproducing a still image, an effect image is generated and displayed based on the camera operation information. I am doing so. For this reason, it is possible to reproduce the movement of the camera when determining the composition, reproduce the zooming operation, reproduce the AF operation, and the like. Compared to display of a mere still image, when a captured image is viewed, the situation at the time of shooting can be reproduced, and an image display with a sense of reality can be realized.

  Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, camera operation information is collected and recorded at the time of shooting, and playback display is performed using this camera operation information. In the second embodiment, a pre-capture operation is performed in addition to the collection of camera operation information, and image processing is performed at the time of reproduction display using the pre-capture image.

  The configuration of the second embodiment is the same as the block diagram shown in FIG. 1, and the flow of the shooting mode is replaced with the flowchart shown in FIG. 10, and the flow of the playback mode is replaced with the flowchart shown in FIG. The difference from the first embodiment will be mainly described.

  When the shooting mode is entered, first, as in step S1, it is determined whether or not it is the realistic reproduction shooting mode (S41). As a result of the determination, if it is not the realistic reproduction shooting mode, the process jumps to step S47. On the other hand, if it is in the realistic reproduction shooting mode, the pre-capture operation is started (S42). The pre-capture operation is controlled by the pre-capture control function 15d and acquires pre-capture image data based on the output of the CCD 3. The pre-capture image data is configured with a smaller number of pixels than the image data at the time of shooting.

  Subsequently, camera operation information is collected as in step S2 (S43), and the camera operation information is stored in the EEPROM 55 as in step S3 (S44). Next, it is determined whether or not the camera angle of view has been greatly changed (S45). This is a determination as to whether or not the camera 100 has been moved between left and right or up and down as shown in FIG. This determination is made based on the detection output of the camera shake correction gyro sensor 53.

  If the result of determination in step S45 is that the camera field angle has not changed, the routine jumps to step S47. On the other hand, if the camera angle of view has changed, the pre-capture data captured immediately before the change is stored in the pre-capture image temporary storage function 11a of the frame memory 11 (S46).

  Next, as in step S4, it is determined whether or not the 2nd release has been operated (S47). As a result of the determination, if the 2nd release has not been operated, the process returns to step S43 and the above-described processing is executed. On the other hand, when the 2nd release operation is performed, the photographing operation is executed as in step S5 (S48). At this time, image data of a still image is acquired based on the output of the CCD 3.

  Subsequently, camera operation information is generated in a file header recording format as in step S6 (S49). Thereafter, pre-capture data is generated in a file header recording format (S50). When the generation of the camera operation information and the pre-capture data in the file header recording format is completed, an image file is generated from the still image data and the generated file header as in step S7 (S51).

  Compared to the case of the first embodiment, the amount of data increases as the pre-capture data is added to the file header. However, the pre-capture data is data with a reduced number of pixels and the capacity of the file header. Since there is no particular limitation, pre-capture data can be recorded.

  When the image file is generated, the image file is recorded on the recording medium 21 as in step S8 (S52). Subsequently, as in step S9, it is determined whether or not the shooting mode is ended. If not, the flow returns to step S41 to continue the shooting mode. On the other hand, if the shooting mode is ended, the shooting mode is ended. To do.

  Thus, in the second embodiment of the present invention, pre-capture data is acquired in addition to the camera operation information when the realistic reproduction shooting mode is set in the shooting mode.

  Next, the playback mode will be described with reference to the flowchart shown in FIG. When the reproduction mode is entered, it is determined whether or not the realistic reproduction reproduction mode is set as in step 21 (S61). As a result of the determination, if the realistic reproduction mode is not set, the image reproduction processing sequence is generated as “no change” in the same manner as in step S29 in order to execute the normal reproduction mode (S71). . Subsequently, the image data of the still image is read from the image file recorded on the recording medium 21 (S72), and the still image data is expanded (S73). When the decompression process ends, the process proceeds to step S68.

  If the result of determination in step S61 is that realistic reproduction mode has been set, pre-capture data is read from the file header of the image file recorded on the recording medium 21 and the image data is expanded (S62). ). Thereafter, as in step S22, camera operation information is read from the image file header (S63). Subsequently, as in step S23, an image reproduction processing sequence is generated from the operation information (S64).

  Next, as in step S24, the image data of the still image is read from the image file (S65), and the still image data is decompressed (S66) as in step S26. Subsequently, image synthesis is performed using the still image data and the pre-capture data read in step S62 (S67). That is, since pre-capture data has been acquired when the camera angle of view changes greatly, an image that matches the movement of the camera in such a case is synthesized. This composite image will be described later with reference to FIG.

  Subsequently, as in step S26, the image is reproduced and displayed according to the reproduction processing sequence (S68). Thereafter, similarly to step S27, it is determined whether or not a frame change instruction has been issued (S69). If the change instruction has been issued, the changed image file is read (S70) as in step S28. ), The process returns to step S62. On the other hand, if no change instruction has been given, it is determined whether or not the reproduction process has been completed in the same manner as in step S30 (S74). If not, the process returns to step S68. Terminate the mode.

  As described above, in the playback mode, in addition to the image playback processing considering the camera operation information in the first embodiment, when pre-capture data is recorded in the image file, the pre-capture data and the still image data are recorded. Are combined and displayed.

  Next, a shooting mode and a playback mode in the case of changing the camera posture (view angle) in the second embodiment will be described with reference to FIG. As an example, assume that the composition of the camera 100 is changed from the right (dotted line side) to the left (solid line side) as shown in FIG. That is, first, the camera 100 is directed to the right area 85 and then moved to the left side, and a photographing operation is performed in the left area 86 at the time of the 2nd release.

  Since the pre-capture operation is started when the camera 100 is moved (see S42), the pre-capture image 88 acquired immediately before the angle of view is changed is temporarily held (see S46). Further, the movement of the camera 100 at this time is detected by the camera shake correction gyro sensor 53 (see S43) and recorded in the EEPROM 55 (see S44).

  As shown in FIG. 12B, the pre-capture image 88 temporarily stored in step S46 and the captured still image 87 of the still image acquired and recorded at the time of shooting in step S48 are combined as shown in FIG. The The synthesized image is reproduced and displayed in step S68. The reproduction is performed based on the movement of the camera 100 recorded as camera operation information.

  That is, in the example shown in FIG. 12, since the camera 100 changes the composition from right to left, first, the image 90a corresponding to the right region 85 is displayed on the display surface 71 of the TFT panel 33. Thereafter, the image 90b corresponding to the left area 86 is finally displayed on the display surface 71 while scrolling the composite image in the direction of arrow B. When there are a plurality of pre-capture images, they may be displayed in accordance with the timing information holding the pre-capture images, and the images may be corrected so as to change smoothly.

  As described above, in the second embodiment of the present invention, the pre-capture image and the captured main image are combined and the combined image is scroll-displayed, whereby the image can be scroll-displayed without any breaks. For this reason, a more realistic image display can be performed.

  In the present embodiment, the pre-capture image is recorded only when the camera posture (angle of view) is changed, and the image is combined at the time of reproduction. However, the present invention is not limited to this. Can be applied.

  As described above, in each embodiment of the present invention, when shooting a still image, the operation information regarding the shooting operation and its temporal change is recorded, and when reproducing the still image, the image is captured based on the operation information. An effect image having a visual effect equivalent to that of the image is generated. For this reason, when appreciating a photographed image, it is possible to reproduce the situation at the time of photographing and display an image with a sense of reality.

  In each embodiment, as camera operation information, at least one piece of information of camera field of view information, zoom magnification information, AF information, and exposure information is stored. Based on these information, It is possible to reproduce the situation at the time of shooting and to display an image with a sense of reality. Furthermore, in the second embodiment, a pre-capture image is stored at the time of shooting, and is reproduced and displayed using this. For this reason, a more realistic image display can be performed.

  In the present embodiment, the camera operation information is collected only before photographing. However, it may be collected only after photographing or before and after photographing. If collected after shooting, the situation after shooting can be reproduced. In reproduction, the time information may be reproduced non-linearly in addition to linear reproduction.

  In the embodiments of the present invention, a digital camera is used as the image display device. However, the camera may be a digital single-lens reflex camera or a compact digital camera, and may be a mobile phone or a personal digital assistant (PDA). Of course, a camera built in Personal Digital Assist) may be used.

  Further, although the digital camera performs playback display, the subject image may be captured with a digital camera or the like, and playback display may be performed with a personal computer or the like. In this case, the digital camera or the like may of course have a function of simply recording camera operation information or the like on the recording medium in accordance with the image data.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 is a block diagram illustrating a configuration of a digital camera according to a first embodiment of the present invention. It is a flowchart which shows the imaging | photography mode of the digital camera concerning 1st Embodiment of this invention. It is a flowchart which shows the reproduction | regeneration mode of the digital camera concerning 1st Embodiment of this invention. It is a figure which shows the file structure of the image file in the digital camera concerning 1st Embodiment of this invention. It is a figure which shows an example of the camera operation information recorded as a file header in the digital camera concerning 1st Embodiment of this invention. It is a figure which shows an example of the reproduction | regeneration when a camera attitude | position is changed in the digital camera concerning 1st Embodiment of this invention. It is a figure which shows an example of the reproduction | regeneration at the time of performing zoom magnification change operation in the digital camera concerning 1st Embodiment of this invention. It is a figure which shows an example of the reproduction | regeneration at the time of performing AF operation | movement in the digital camera concerning 1st Embodiment of this invention. It is a figure which shows an example of the reproduction | regeneration at the time of performing exposure correction operation in the digital camera concerning 1st Embodiment of this invention. It is a flowchart which shows the imaging | photography mode of the digital camera concerning 2nd Embodiment of this invention. It is a flowchart which shows the reproduction | regeneration mode of the digital camera concerning 2nd Embodiment of this invention. It is a figure which shows an example of the reproduction | regeneration when a camera attitude | position is changed in the digital camera concerning 2nd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Lens, 3 ... CCD, 5 ... Imaging circuit, 7 ... A / D converter, 9 ... Data bus, 11 ... Frame memory, 11a ... Pre-capture image Temporary holding function, 13 ... CPU2, 13a ... Display image processing function, 13b ... Image compression / expansion function, 13c ... Subject motion detection function, 13d ... Recording medium access function, 15 ... CPU1, 15a ... System control function, 15b ... Camera drive history management function, 15c ... Camera subject angle of view management function, 15d ... Pre-capture control function, 17 ... Recording buffer, 19 ... Recording medium I / F, 21 ... Recording medium, 23 ... FIFO memory, 25 ... Video output circuit, 27 ... Video output terminal, 29 ... External image display device, 31 ... FT liquid crystal drive circuit, 33 ... TFT panel, 35 ... backlight unit, 37 ... battery state detection circuit, 39 ... battery, 41 ... power supply circuit, 43 ... backup power supply, 45 ... LCD display circuit, 47 ... LCD panel, 49 ... key matrix, 51 ... external priority data I / F, 53 ... shake correction gyro sensor, 55 ... EEPROM, 55a ..Camera drive history information, 57... Actuator driving circuit for lens, 59... Actuator, 61... Actuator driving circuit for camera shake correction, 63. Display surface, 81 ... image, 82 ... long focus observation area, 83 ... short focus observation area, 84 ... still image, 85 ... right area, 86 ... Left area, 87 ... captured the image, 88 ... pre-capture image, 89 ... composite image, 100 ... camera

Claims (10)

An operation information recording section for recording operation information regarding a photographing operation and its temporal change within a predetermined time before or after capturing a still image;
An effect image generating unit that generates an effect image having a visual effect equivalent to that captured based on the operation information;
A display unit for continuously displaying the effect image and the still image;
An image display device comprising:   The image display apparatus according to claim 1, wherein the operation information is at least one of shooting field angle information, zoom magnification information, AF information, and exposure information of a camera that has shot the still image.   The effect image generation unit generates an effect image having a visual effect equivalent to that captured according to the motion information by performing predetermined image processing on the still image based on the motion information. The image display apparatus according to claim 1, wherein the image display apparatus is provided.   The effect image generation unit is configured to generate a composite image of the still image and the image captured before and after capturing the still image, and to cut out an image having an angle of view according to the captured field angle information of the camera. The image display device according to claim 1, wherein A step of reading from the recording unit operation information relating to a photographing operation and its temporal change within a predetermined time before or after photographing a still image;
Generating an effect image having a visual effect equivalent to that at the time of imaging according to the operation information;
Continuously displaying the effect image and the still image;
An image display method comprising: A shooting operation within at least one predetermined time before or after shooting a still image attached to the image data, operation information regarding the temporal change thereof, a data reading unit for reading the image data,
An effect image generation unit that generates an effect image having a visual effect equivalent to that at the time of imaging based on the read operation information and the image data;
A display unit for continuously displaying the effect image and the still image;
An image reproducing apparatus comprising: A mode setting section for setting a realistic reproduction shooting mode;
An information collecting unit that collects camera operation information when the realistic reproduction mode is set;
A photographing unit for obtaining image data based on the subject image;
A recording unit for recording the camera operation information and the image data;
A camera characterized by comprising   The camera according to claim 7, further comprising a pre-capture unit that acquires a pre-capture image, wherein the recording unit records the pre-capture image together with the recording. Read out the image data and the operation information regarding the imaging operation and its temporal change within at least one predetermined time before or after capturing the still image attached to the image data,
An effect image having a visual effect equivalent to that at the time of imaging is generated based on the read operation information and the image data,
Continuously displaying the effect image and the still image;
An image reproduction program for executing this. Read the pre-capture image attached to the image data together with the image data read-out,
The image reproduction program according to claim 9, wherein the effect image is generated using the pre-capture image when generating the effect image.