JP2006174086A - Image recording reproducing device and image recording reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a viewer to grasp excellently situations when an image was photographed by inserting and reproducing an effective intermediate image among a plurality of photographed images. <P>SOLUTION: In the image recording device, in parallel to photography of a subject to generate a plurality of pieces of image data, behavior history information related to behaviors of an image recording device during that time is recorded and the behavior history information is recorded in a recording medium together with the plurality of pieces of image data. On the other hand, in the image reproducing device, at the time of reproduction processing of the image data, the plurality of image data and the behavior history information are read from the recording medium, one or more intermediate image data which reflect the behaviors of the image recording device when the plurality of pieces of image data have been generated are generated in accordance with the behavior history information and both the plurality of pieces of image data and the intermediate image data are reproduced along time series. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image recording / reproducing technique, and more particularly to a technique for synthesizing and generating intermediate images of a plurality of captured images.

  As a conventional technique for efficiently browsing still images after photographing, there is one that automatically displays a plurality of images selected by a user as a slide show (Patent Document 1).

According to this prior art, a plurality of still images are reproduced as a slide show according to the reproduction order determined by the playlist. When a predetermined operation is performed on the operation unit during the slide show reproduction, the playlist is automatically performed. It is very good at correcting and playing slideshows in a new playback order.
JP 2002-209190 A

  However, according to the above-described prior art, when a still image was shot and another still image was shot later, what was the shooting situation during that time (for example, shooting while zooming on the subject) ) Was difficult to grasp during playback. In particular, this problem tends to occur when the photographer and the viewer are different.

  Although not a conventional technique, a plurality of still images are photographed at finer time intervals by the second imaging means in parallel with photographing two still images by the first imaging means. A solution technique is also conceivable in which a detailed motion vector is obtained from a plurality of still images and an intermediate image between two still images obtained by the first imaging means is created. In this solution, since the difference is small when the shooting interval between two still images taken by the first imaging means is short, an intermediate image can be efficiently created.

  However, according to the solution technique, it is very difficult to create a suitable intermediate image when the shooting interval between two still images is long or when the shooting interval is irregular. In addition, since a plurality of imaging means are required, there is a problem that the configuration of the device is complicated.

  Therefore, an object of the present invention is to solve at least one of such problems and other problems. Other issues can be understood throughout the specification.

  In order to solve the above-described problem, the present invention records behavior history information related to the behavior of the image recording apparatus in the meantime in parallel with the generation of a plurality of image data by imaging a subject in the image recording apparatus. Together with the image data, behavior history information is recorded on a recording medium.

  On the other hand, in the image reproduction apparatus, a plurality of image data and behavior history information are read from the recording medium during image data reproduction processing, and the behavior of the image recording apparatus when a plurality of the image data is generated is reflected. The above intermediate image data is generated according to the behavior history information, and a plurality of image data and intermediate image data are reproduced in time series.

  Of course, it goes without saying that such an image recording apparatus and an image reproduction apparatus can be integrated and provided as an image recording / reproduction apparatus.

  According to the present invention, it is possible to reproduce by inserting an effective intermediate image between a plurality of captured images. That is, the viewer can easily grasp the situation when the image is captured.

  In the following, an embodiment useful for understanding the high-level concept, middle-level concept, and low-level concept of the present invention will be described. Note that not all of the concepts included in the following embodiments are described in the claims. However, it should be understood that this is not intentionally excluded from the technical scope of the patented invention, but is not described in the scope of claims because it is equivalent to the patented invention.

  FIG. 1 is an exemplary block diagram relating to an image recording / reproducing apparatus according to an embodiment. In this example, the digital camera 100 is taken up as an image recording / reproducing apparatus. The image recording / reproducing apparatus according to the present invention may be realized separately as an image recording apparatus and an image reproducing apparatus, or may be realized as an image recording method, an image reproducing method, or a computer program. Needless to say, it may be realized as follows.

  The digital camera 100 according to the present embodiment encodes captured image data in accordance with an encoding method such as JPEG, and records and reproduces the data on a recording medium such as a memory card, a magnetic disk, or a magneto-optical disk. Is.

  In FIG. 1, reference numeral 101 denotes a vari-angle prism (hereinafter referred to as VAP) that optically corrects vibration due to camera shake of a photographer, 102 denotes a zoom lens, and 103 denotes a diaphragm that adjusts the amount of light. Needless to say, the digital camera 100 according to the present embodiment may be a lens-mounted type or a lens-exchangeable digital camera. In the case of the interchangeable lens type, the zoom lens 102, the diaphragm 103, and the like are mounted on the lens side. Needless to say, a single focus lens may be employed instead of the zoom lens 102.

  Reference numeral 104 denotes an image sensor represented by a CCD. Reference numeral 105 denotes a timing generator (hereinafter referred to as TG) for driving the image sensor. An A / D unit 106 performs double correlation sampling (CDS) on the output from the CCD 104 and performs gain control (AGC) and A / D conversion. Reference numeral 107 denotes a drive circuit that drives the VAP 101, the zoom lens 102, and the diaphragm 103. Needless to say, these drive mechanisms may be built in on the lens side or on the camera body side.

  An acceleration sensor (HS) 108 detects the horizontal movement of the camera. An acceleration sensor (VS) 109 detects the vertical movement of the camera. Reference numeral 110 denotes a CPU that controls the entire digital camera 100 in an integrated manner. A module 110 a that acquires behavior information (camera information and the like described later) is incorporated in the CPU 110. The module 110a may be incorporated as a circuit or may be incorporated as software.

  An operation unit 111 includes various switches for inputting operation instructions to the digital camera 100. A camera signal processing unit 112 processes the image data A / D converted by the A / D unit 106. A codec unit (CODEC) 113 encodes / decodes image data according to an encoding format such as JPEG. Reference numeral 114 denotes an image composition unit that synthesizes and generates an effect image such as an intermediate image corresponding to the camera information.

  Reference numeral 115 denotes an I / F unit that records and reproduces image data, audio data, camera information data, and the like. Reference numeral 116 denotes a recording unit including a recording medium such as a magnetic recording medium, a magneto-optical recording medium, or a memory card. 117 is a work memo such as a RAM. A display control unit 118 controls the display operation of the LCD 119. Reference numeral 119 denotes a display unit that displays image data including a liquid crystal panel (LCD). Reference numeral 120 denotes a system bus for transferring image data and control data between the blocks of the digital camera 100.

  The audio input unit 121 is a background sound acquisition circuit including a microphone, an amplifier circuit, an analog / digital conversion circuit, and the like. The acquired background sound may be recorded as part of the camera information.

  FIG. 2 is a diagram illustrating an example of main operation switches of the operation unit according to the embodiment. In FIG. 2, reference numeral 111a denotes a selection switch for setting the operation mode of the digital camera. This enables selection of a recording mode for recording an image, power-off, and a reproduction mode for reproducing the recorded image. Reference numeral 111b denotes a selection switch for selecting whether recording or reproduction is performed in a normal normal mode or an effect mode described later. A release switch 111c is used to input a shooting instruction for shooting an image in the recording mode. 111d and 111e are switches for inputting instructions for zooming operation of the zoom lens. 111f and 111g are switches for instructing the reproduction direction during reproduction.

  Hereinafter, the operation of the digital camera 100 when the selection switch 111a is set to the recording mode and the selection switch 111b is set to the effect mode as shown in FIG. 2 will be described with reference to FIGS.

  FIG. 3 is a flowchart illustrating an exemplary operation in the recording mode according to the embodiment. These operations are basically executed under the control of the CPU 110.

  In step S301, the CPU 110 reads the outputs of the acceleration sensors 108 and 109 in the horizontal and vertical directions, and detects camera shake and panning by the photographer. When camera shake is detected, the CPU 110 performs control for correcting the camera shake component on the VAP 101.

  In step S302, the CPU 110 executes autofocus control (AF) when detecting half-press of the release switch 111c, or zooms corresponding to the pressed switch when detecting that the zoom key of the operation unit 111 is pressed. The lens 102 is controlled.

  In step S303, the CPU 110 controls the aperture 103, the TG 105, and the A / D unit 106 in accordance with separately specified exposure conditions so that a desired exposure state is obtained.

  In step S304, the CPU 110 reads the state of the selection switch 111b and determines whether recording is performed in the normal mode or effect mode described later. If the effect mode is set as shown in FIG. 2, the process proceeds to step S305, and if the normal mode is set, the process skips step S305 and proceeds to step S306.

  In step S <b> 305, the CPU 110 acquires camera information and stores it in the memory 117. The camera information stored here includes, for example, panning detection information, tilt information, zoom operation information obtained by zoom AF control, subject brightness information obtained by exposure control, camera Color temperature information and the like obtained in color control of signal processing, all of which can be called behavior information in which a history related to the behavior of the digital camera 100 is accumulated. All the information is acquired by the CPU 110 in cooperation with each processing block. Reference numeral 117b indicates the camera information acquired in this way.

  In step S306, the CPU 110 determines whether or not the release switch 111c for starting image recording has been pressed. If it is detected that the release switch 111c has been pressed, the process proceeds to S307. If the release switch 111c has not been pressed, the process returns to S301 and accumulates camera information. In other words, unless the release switch is pressed, camera information is acquired and accumulated using a series of processing times from S301 to S306 as a unit period. The unit period for acquiring the camera information may be 1/30 second, which is the same as a general moving image frame period. Or you may set to the arbitrary periods shorter than the space | interval which records and image-records. Note that the interval at which each piece of camera information is acquired is not necessarily constant. On the other hand, if the effect mode is not set in S304, the camera information accumulation process in S305 is bypassed, and therefore no camera information is accumulated.

  In step S307, the CPU 110 executes processing for generating image data of the subject. In this generation process, the image signal output from the CCD 104 is converted into digital data by the A / D unit 106, a known camera signal process is performed by the camera signal processing unit 112, and the image signal is stored in the memory 117 via the system bus 120. The image data 117a is written.

  In step S308, the CPU 110 controls the compression process. For example, the CODEC 113 reads the image data 117 a from the memory 117, executes encoding compression in accordance with a predetermined format such as JPEG, and writes it again in the memory 117.

  In step S309, the CPU 110 performs processing for adding the accumulated camera information 117b to the compressed image data 117a.

  In step S <b> 310, the CPU 110 records the image data with the camera information added to the recording unit 116 via the I / F unit 115.

  In step S311, as a preparation for accumulating new camera information, the CPU 110 clears the camera information that has been recorded in the recording unit 116 from the memory 116b.

  In step S312, CPU 110 determines whether or not to continue the shooting operation. When continuing, it returns to S301 again. On the other hand, when the shooting is finished, the processing related to this flowchart is finished.

  As described above, according to the present embodiment, in parallel with the generation of a plurality of image data by the CCD 104, the camera signal processing unit 112, the CODEC 113, and the like, the behavior history information regarding the history of the behavior of the digital camera between them is obtained as camera information. It can be recorded in the recording unit 116.

  FIG. 4 is a diagram showing the concept of the invention according to the embodiment. This figure shows the relationship between the passage of time, image data, and camera information when the digital camera 100 is set to the effect mode and a still image is taken. In FIG. 4, TP1 and TP2 indicate the timing when the release switch 111c is pressed. Reference numerals 401a and 402a denote image data captured at each timing. TC indicates an acquisition interval of the camera information 401b, 402b, 403b. TR indicates an image recording interval.

  Reference numeral 4100B denotes camera data set data accumulated with respect to the image data 401a. In this example, individual camera information 401a to 405b is accumulated in the camera information set data 4100B. The camera information set data 4200B is set of camera information stored with respect to the image data 402a, and stores individual camera information 406a to 410b.

  Image data 401a is generated at the time of TP1, and is recorded on a recording medium together with the accumulated camera information set data 4100B. Similarly, at the time of TP2, image data 402a is generated and recorded on the recording medium together with the accumulated camera information set data 4200B. Thereafter, each time the release switch 111c is pressed in the effect mode, the image data and the accumulated camera information are recorded on the recording medium of the recording unit 116. If recording is performed in the normal mode, only the image data is recorded on the recording medium of the recording unit 116 when the release switch 111c is pressed. In this way, the recording capacity of the recording medium can be saved by controlling the camera information to be recorded only in the effect mode and not to record the camera information in the normal mode.

  FIG. 5 is a diagram illustrating a configuration example of an image file including image data and camera information according to the embodiment. As shown in FIG. 5, camera information set data 4100B and 4200B are recorded as header data of compressed image data 401a and 402a, respectively. File numbers are assigned such that 0001, 0002,... Do not overlap with each other. As a recording format for recording image data, image file management rules such as DCF (Design rule for Camera File system) established by the Japan Electronics Industry Promotion Association (JEIDA) have been proposed. The DCF format may be adopted, or another format may be adopted as long as each file can be distinguished.

  FIG. 6 is a diagram illustrating another setting state of the operation unit according to the embodiment. An image data reproduction / display operation will be described with reference to FIG. According to FIG. 6, the selection switch 111a is set to the reproduction mode, and the selection switch 111b is set to the effect mode.

  FIG. 7 is an exemplary flowchart regarding image data reproduction processing according to the embodiment. The reproduction process is basically executed according to the control of the CPU 110.

  In step S <b> 701, the CPU 110 reads image data and camera information relating to the file number N (N is a natural number) recorded on the recording medium of the recording unit 116 into the memory 117 via the I / F unit 115.

  In step S <b> 702, the CPU 110 supplies the read (compressed) image data to the CODEC 113, decompresses it, and restores it to baseband image data.

  In step S703, the setting state of the selection switch 111b is read, and it is determined whether the reproduction display operation is performed in the normal normal mode or the effect mode described later. If the effect mode is set as shown in FIG. 6, the process proceeds to step S704. If the normal mode is set, the process proceeds to step S712.

  In step S <b> 704, the CPU 110 determines whether camera information exists in the image file read into the memory 117. If camera information exists, the process proceeds to S705. If camera information does not exist, the process proceeds to step S712.

  In step S <b> 705, the CPU 110 reads out the image data of the next file number (N + 1) and camera information from the recording unit 116 to the memory 117.

  In step S706, the CPU 110 decompresses the image data and restores the baseband image data in the same manner as in step S702.

  In step S707, the CPU 110 determines a synthesis method based on behavior history information such as camera information. For example, the CPU 110 analyzes each camera information for the file numbers N and (N + 1), and determines an intermediate image synthesis method (for example, effect type) according to the analysis result. The intermediate image is inserted between the image with the file number N and the image with the file number (N + 1) during reproduction. A specific example of this determination method will be described later in detail.

  In step S708, the CPU 110 applies the determined synthesis method to generate an intermediate image. For example, the image composition unit 114 reads image data in the memory 117 under the control of the CPU 110 and executes a composition process corresponding to an instruction from the CPU 110.

  In step S709, the CPU 110 causes the display unit 119 to display the expanded image and the generated intermediate image via the display control unit 118.

  In step S710, CPU 110 determines whether or not to continue the reproduction operation. If the reproduction operation is to be continued, the process proceeds to S711, and if not, the process related to this flowchart is terminated.

  In step S711, the CPU 110 increments the file number N by one, returns to S701 again, and continues the reproduction operation.

  If it is determined in S703 that normal mode playback is to be performed, or if it is determined in S704 that there is no camera information in the file read in, the CPU 110 uses the display control unit 118 to display the file number N in S712. Is displayed on the display unit 119, and the process proceeds to step S710. That is, in the normal mode, the images recorded in the recording unit 116 are simply reproduced one by one. On the other hand, when the reproduction is performed in the effect mode, an intermediate image corresponding to the camera information is inserted and displayed between a plurality of reproduction images while reproducing the image recorded by the above-described procedure.

  As described above, according to the present embodiment, at the time of image data reproduction processing, a plurality of image data and behavior history information typified by camera information are read from the recording medium of the recording unit 116, and according to the read behavior history information. Thus, one or more intermediate image data reflecting the behavior of the image recording / reproducing apparatus when the plurality of image data are generated is generated. Therefore, it is possible to reproduce by inserting an effective intermediate image between a plurality of captured images. Thereby, the viewer will be able to easily grasp the situation when the image is captured.

  Next, an example in which a plurality of image data recorded in the effect mode is reproduced and displayed in the effect mode will be described with reference to FIGS.

  FIG. 8 is a diagram illustrating an example of the image recording process according to the embodiment. In this example, as a result of the release switch 111c being pressed at the timing of TP1 and TP2, image data 801 and 802 are generated, respectively. As camera information during that time, camera information indicating that the zoom lens is on the wide side is acquired at TP1, and some camera information indicating that the zoom lens has zoomed in on the tele side is acquired between TP1 and TP2. In TP2, it is assumed that camera information indicating that the zoom lens is on the telephoto side has been acquired.

  FIG. 9 is a diagram illustrating an example of two images acquired by the image recording process according to the embodiment. An image 801 is an image taken at time TP1 when the zoom lens is on the wide side. An image 802 is an image taken at time TP2 when the zoom lens is on the telephoto side.

  As described above, the plurality of camera information acquired between TP1 and TP2 is information indicating zoom-in. Accordingly, the CPU 110 selects an effect effect that effectively indicates zoom-in from the camera information (S707), and an intermediate image that has been subjected to the effect indicating zoom-in is generated.

  FIG. 10 is a diagram illustrating an example of a title image used for generating an intermediate image. The title images TPic101 and TPic102 are images used for effectively expressing zoom-in. The title image TPic101 is provided with an opening 1001, and the title image TPic101 is provided with an opening 1002 smaller than that. The image 801 or the image 802 is additively combined in the opening. When the openings of the title images TPic101 and TPic102 are compared, the latter opening is smaller toward the center of the image. Therefore, zoom-in can be expressed by using the title image TPic101 for the first intermediate image and the title image TPic102 for the next intermediate image. On the contrary, if the title image TPic102 is used for the first intermediate image and the title image TPic101 is used for the next intermediate image, zoom-out can be effectively expressed. How to use a plurality of title images depends on a synthesis method determined by camera information. The synthesis method can be used by the CPU 110 if it is ruled and stored in a ROM or the like.

  The CPU 110 generates an intermediate image by cutting out the image 801 according to the size of the opening portions 1001 and 1003 of the title image and pasting the cut out partial image into the opening portion in accordance with the determined combining method. As a result, the original image and the title image are combined to generate an intermediate image that makes it easy to visually grasp the zoom-in operation.

  FIG. 11 is a diagram illustrating an example of image reproduction processing according to the embodiment. The intermediate images Pic1100 and Pic1101 are images generated to express a zoom-in operation that is performed while the two images 801 and 802 are captured.

  The CPU 110 displays these images over time in the order shown in FIG. That is, an effective intermediate image indicating the zoom-in operation is inserted and displayed between the image 801 before zooming and the image 802 after zoom-in operation. Therefore, the viewer will be able to effectively and easily recognize that the images 801 and 802 are images taken while performing the zoom-in operation.

  Next, examples of other effect effects will be described with reference to FIGS.

  FIG. 12 is a diagram illustrating an example of the image recording process according to the embodiment. In FIG. 12, it is assumed that the release switch 111c is pressed at the timing of TP1 and TP2, and images 1201 and 1202 are generated, respectively. Also, the fact that the camera has been panned from left to right between TP1 and TP2 will be described as being recorded as camera information.

  FIG. 13 is a diagram illustrating an example of two images acquired by the image recording process according to the embodiment. An image 1201 is an image taken at the time of TP1 before panning. An image 1202 is an image taken at time TP2 after panning. As described above, the camera information between TP1 and TP2 is information indicating horizontal panning. Therefore, the CPU 110 determines an effect effect (synthesizing method) that effectively shows panning according to the camera information (S707), and thereby generates an intermediate image showing panning (S708).

  FIG. 14 is a diagram showing an example of an intermediate image effectively showing panning. In this example, when the recorded images 1201 and 1202 are reproduced, intermediate images Pic1400 and Pic1401 are synthesized and generated during the reproduction. Specifically, as shown in FIG. 14, an intermediate image that gradually fades while the two images 1201 and 1202 overlap is generated and displayed. The intermediate images Pic1400 and 1401 in this case are synthesized by adding the images 1201 and 1202 at an arbitrary ratio. In particular, in the example of FIG. 14, the images 1201 and 1202 are added at different ratios.

  By displaying these images over time in the order shown in FIG. 14, an effective intermediate image indicating panning is inserted between the image 1201 before panning and the image 1202 after panning. Therefore, the viewer will be able to effectively and easily recognize that these recorded images 1201 and 1202 are images taken while performing the panning operation.

  Next, an embodiment in which the present invention is applied to an effect of a focus (focusing control) operation will be described with reference to FIGS.

  FIG. 19 is a diagram illustrating an example of the image recording process according to the embodiment. In FIG. 19, it is assumed that the release switch 111c is pressed at the timing of TP1 and TP2, and images 2001 and 2002 are generated, respectively. In addition, it is assumed that the camera information is recorded that the subject moves greatly between TP1 and TP2, the camera defocuses from the subject, defocuses once, and is focused on the next subject again.

  FIG. 20 is a diagram illustrating an example of two images acquired by the image recording process according to the embodiment. An image 2001 is an image taken at the time of TP1. An image 2002 is an image taken at the time of TP2. As described above, the camera information between TP1 and TP2 is information indicating that the focus has changed from in-focus → in-focus → in-focus. Therefore, the CPU 110 determines an effect effect (synthesizing method) that effectively shows a blurred state due to defocusing according to the camera information (S707), and thereby generates an intermediate image showing defocusing (S708).

  FIG. 21 is a diagram illustrating an example of an intermediate image that effectively shows defocusing. In this example, when the recorded images 2001 and 2002 are reproduced, intermediate images Pic2200, Pic2201 and Pic2202 are synthesized and generated during the reproduction. Specifically, as shown in FIG. 21, an initial image 2001 is gradually faded out and completely faded by Pic 2201, and then an intermediate image that gradually fades in from Pic 2202 to 2002 is generated and displayed. .

  By displaying these images over time in the order shown in FIG. 21, an effective intermediate image indicating that defocusing has once occurred is inserted between the images 2001 and 2002. Therefore, the viewer will be able to effectively and easily recognize that the recorded image 2001, 2002 is an image that is in a defocused state. Further, by inserting a plurality of intermediate images in which the subject to be focused on gradually changes from the defocused state to the focused state, a more effective performance can be achieved. In the example shown in FIG. 21, intermediate images of fade-in and fade-out are created. However, even if it is not a fade process, any effect can be used as long as it can express the defocus state more effectively than the wipe process. For example, an image that has been subjected to low-pass filter processing that suppresses high-frequency components of the image 2001 may be referred to as Pic2200, and the image 2002 may be generated by performing low-pass filter processing on the image 2002 as well.

  In addition, as described above, when creating and displaying intermediate images for a plurality of actually captured images, it is more effective if audio information can be heard continuously. Therefore, when recording an image in the effect mode, the CPU 110 may acquire audio information of the digital camera 100 by the audio input unit 121 and record it in the memory 117 as part of the camera information. In this way, audio information is continuously recorded on a recording medium, and when reproducing an image, the audio information is also output in synchronization with the reproduction of the image, so that the viewer can further grasp the situation at the time of shooting. It will be easy.

  Note that the CPU 110 may control the audio information to be recorded continuously and the other behavior history information to be recorded at a predetermined interval shorter than the generation interval of the plurality of image data. That is, if the voice information is a conversation or the like, it is difficult to grasp the contents of the conversation at the time of reproduction unless it is continuously recorded. Moreover, if the above camera information etc. can grasp | ascertain the behavior of the digital camera which generate | occur | produced between the imaging | photography of a certain image and the imaging | photography of the next image at least, the viewer can grasp | ascertain the condition at the time of imaging | photography easily. .

  In the above-described embodiment, the synthesis method using the title image and the synthesis method of adding the preceding and succeeding images have been described as examples of the intermediate image synthesis method. However, the present invention is not limited to these synthesis methods. As long as it is a technique that can synthesize effective intermediate images, the present invention can adopt any composition technique. For example, various image processing methods such as wipe, monotone, mosaic, and character title composition may be employed as the composition method.

  Further, even with the same type of camera information value, the level to be combined may be changed depending on the value. For example, in FIG. 10, two intermediate images are synthesized and generated using two-stage title images in the zoom operation. However, when a zoom lens with a high zoom magnification is used, intermediate images are obtained using more title images. It may be synthesized and generated.

  FIG. 15 is a diagram illustrating an example of another title image according to the embodiment. In this example, four title images for facilitating the viewer to recognize the zoom operation are shown. From Tpic001 to Tpic004, the openings are gradually reduced, and four intermediate images can be generated by cutting out and synthesizing part of the images actually acquired in each opening.

  In the above-described embodiment, two or three intermediate images are synthesized and generated as shown in FIGS. 11, 14, and 19 as intermediate images of two captured images. The number of intermediate images to be performed is not limited to two or three. That is, the number of intermediate images may be one, or four or more. The number of intermediate images to be generated may be defined in the rules of the synthesis method.

  In some of the above-described embodiments, the camera information acquisition period is described as the entire period between the shooting of a certain image and the shooting of the next image. However, the present invention is not limited to this. For example, when the CPU 110 detects that the interval from when one image is captured to when the next image is captured exceeds a predetermined threshold, the CPU 110 stores the camera information within a predetermined period before and after the imaging time. The acquisition period may be limited.

  FIG. 16 is a diagram illustrating an example of a camera information acquisition period according to the embodiment. In this example, the CPU 110 controls to record the camera information in the recording unit 116 for the period TA before the shooting time and the period TB after the shooting time. This control method may be applied when the shooting interval exceeds a predetermined threshold, or may be applied without depending on the shooting interval. Further, camera information may be recorded only for TA or only for TB, or camera information may be stored for both periods of TA and TB. That is, behavior history information such as camera information may be recorded for at least one of a predetermined period before image data is generated and a predetermined period after generation.

  In this way, the behavior history information such as camera information is recorded over only a part of the effective period rather than recording over the entire period, thereby saving the recording capacity of the recording medium and Information can be recorded.

  As described above, camera information is acquired at intervals finer than the imaging interval, the acquired camera information is added to the captured image data, recorded, and recorded, and a plurality of images captured based on the camera information Thus, it is possible to insert an effective intermediate image between the images by combining the intermediate images and displaying the combined intermediate image. As a result, the viewer can effectively grasp the situation where the image is taken. Further, compared with a method of simply reproducing still images in order as in the conventional reproducing method, it is possible to reproduce with a variety of visual changes, and it is possible to browse more happily.

  In this embodiment, camera signal processing, encoding, decoding processing, image composition processing, and the like of image data are realized by a hardware configuration, but may be realized by software processing using a computer. In this case, the program code of the software itself realizes the functions of the above-described embodiments, and the program code itself and means for supplying the program code to the computer, for example, a memory storing the program code The medium constitutes the present invention. As a storage medium for storing the program code, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  Further, by executing the program code supplied by the computer, not only the functions described in the above embodiments are realized, but also the OS (Operating System) or other application in which the program code is running on the computer. It goes without saying that the program code is also included in the embodiment of the present invention even when the functions described in the above-described embodiment are realized in cooperation with software or the like.

  Further, after the supplied program code is stored in the memory provided in the function expansion board of the computer or the function expansion unit connected to the computer, the CPU provided in the function expansion board or function expansion unit based on the instruction of the program code The present invention also includes the case where the functions of the above-described embodiment are realized by performing part or all of the actual processing.

  FIG. 17 is an exemplary block diagram of the image reproducing device according to the embodiment. This image reproduction apparatus may be realized as a single image reproduction apparatus or a computer that executes an image reproduction program.

  A CPU 1701 is a control circuit that comprehensively controls each unit of the image reproduction apparatus. The RAM 1702 is a storage circuit used for storing temporary data. The ROM 1703 is a storage circuit that stores a boot program and the like. The display control unit 1704 is a circuit that generates an image signal to be displayed on the display device 1705. A recording medium interface 1706 is a control circuit for connecting the recording medium 1707 of the recording unit 116 and reading / writing image data and the like. The hard disk drive 1710 is a storage device that stores an image reproduction program 1711, a plurality of image data 1712 read from the recording medium 1707, behavior history related information 1713, and intermediate image data 1714.

  FIG. 18 is an exemplary flowchart of an image reproduction method according to the embodiment. Needless to say, the processing according to this flowchart is the same as the processing described in FIG. In the following description, it is assumed that a plurality of image data 1712 read from the recording medium 1707 and behavior history information 1713 are written in the hard disk drive 1710 before processing, but of course, the recording medium 1707 is directly accessed. Needless to say, the reproduction process may be executed. As described above, the image data 1712 and the behavior history information 1713 may form an image file.

  In step S1801, the CPU 1701 determines whether or not to reproduce in the effect mode. For example, according to the setting information by the user, it is determined whether to reproduce in the effect mode or normal mode. If the effect mode is selected, the process proceeds to step S1802, and if not, the process proceeds to step S1805 to execute normal slide show reproduction.

  In step S1802, the CPU 1701 generates a plurality of image data 1712 generated by capturing an image of a subject in an image recording apparatus such as the digital camera 100, and the digital camera 100 in between the generation of the plurality of image data. Behavior history information 1713 relating to the behavior of the hard disk drive 1710 or the recording medium 1707 is read out.

  In step S1803, the CPU 1701 generates one or more intermediate image data 1714 reflecting the behavior of the digital camera 100 when a plurality of image data 1712 is generated, according to the read behavior history information 1713. The synthesis method and the like when generating the intermediate image data are as described above.

  In step S1804, the CPU 1701 reproduces the plurality of image data 1712 and the generated intermediate image data in time series.

  As described above, the image reproducing method according to the present embodiment may be executed in the image recording / reproducing apparatus in which the image is recorded, or the recording medium in which the image and the behavior history information are recorded is connected to the image reproducing apparatus. It may be executed. Also, it goes without saying that the image reproduction method can be realized as an image reproduction program 1711 in FIG.

1 is an exemplary block diagram relating to an image recording / reproducing apparatus according to an embodiment. It is a figure which shows an example of the main operation switches of the operation part which concerns on embodiment. 6 is a flowchart showing an exemplary operation in a recording mode according to the embodiment. It is the figure which showed the concept of the invention which concerns on embodiment. It is a figure which shows the structural example of the image file containing the image data and camera information which concern on embodiment. It is a figure which shows the other setting state of the operation part which concerns on embodiment. 5 is an exemplary flowchart regarding image data reproduction processing according to the embodiment. It is a figure which shows the Example about the image recording process which concerns on embodiment. It is a figure which shows the Example of two images acquired by the image recording process which concerns on embodiment. It is a figure which shows the Example of the title image used for the production | generation of an intermediate image. It is a figure which shows the Example about the image reproduction process in embodiment. It is a figure which shows the Example about the image recording process which concerns on embodiment. It is a figure which shows the Example of two images acquired by the image recording process which concerns on embodiment. It is a figure which shows the Example of the intermediate image which shows panning effectively. It is a figure which shows an example of the other title image which concerns on embodiment. It is a figure which shows an example of the acquisition period of the camera information which concerns on embodiment. 1 is an exemplary block diagram of an image reproduction device according to an embodiment. 4 is an exemplary flowchart of an image reproduction method according to the embodiment. It is a figure which shows the Example about the image recording process which concerns on embodiment. It is a figure which shows the Example of two images acquired by the image recording process which concerns on embodiment. It is a figure which shows the Example of the intermediate image which shows a defocus state effectively.

Explanation of symbols

100: Digital camera 101: VAP
102: Zoom lens 103: Aperture 104: CCD (imaging device)
105: Timing generator 106: A / D converter 107: Drive circuit 108: Horizontal acceleration sensor 109: Vertical acceleration sensor 110: CPU
111: Operation unit 112: Camera signal processing unit 113: CODEC
114: Effect image composition unit 115: I / F unit 116: Recording unit 117: Memory 118: Display control unit 119: Display unit 120: System bus 121: Audio input unit

Claims (12)

An image recording / reproducing apparatus for recording / reproducing image data,
Image generating means for imaging a subject and generating image data of the subject;
In parallel with generating a plurality of image data by the image generation means, recording means for recording behavior information regarding the behavior of the image recording / playback apparatus in the meantime,
Storage means for storing a plurality of the image data and the behavior information;
One or more intermediate images reflecting the behavior of the image recording / reproducing apparatus when a plurality of the image data and the behavior information are read from the storage unit and a plurality of the image data are generated during the reproduction processing of the image data Intermediate image generating means for generating data according to the behavior information;
An image recording / reproducing apparatus including reproduction means for reproducing a plurality of the image data and the intermediate image data in time series.   2. The method according to claim 1, further comprising: a synthesis method determination unit that determines a synthesis method based on the behavior information when the intermediate image generation unit generates the intermediate image data from a plurality of the image data. Image recording and playback device.   The image recording / reproducing apparatus according to claim 2, wherein one of the combining methods is a method of combining and generating the intermediate image data by combining the image data and predetermined title image data.   4. The image recording / reproducing apparatus according to claim 2, wherein one of the combining methods is a method of combining and generating the intermediate image data by adding a plurality of the image data at an arbitrary ratio. 5. The image recording / reproducing apparatus according to claim 1, wherein the behavior information is camera information represented by pan, tilt, zoom control, exposure control, color control, focus control, and the like.   6. The behavior information is recorded for at least one of a predetermined period before the image data is generated and a predetermined period after the generation, and is stored in the storage unit as an image file together with the image data. An image recording / reproducing apparatus according to any one of the above.   The image recording / reproducing apparatus according to claim 1, further comprising an audio recording unit that records a background sound of the image recording / reproducing apparatus as part of the behavior information.   The image recording / reproducing according to claim 7, wherein the background sound is continuously recorded in the behavior information, and the other information is recorded at predetermined intervals shorter than a generation interval of the plurality of image data. apparatus. An image recording / reproducing method of an image recording / reproducing apparatus for recording / reproducing image data, comprising:
Imaging a subject to generate image data of the subject;
Concurrently with generating a plurality of the image data, recording behavior information relating to the behavior of the image recording / playback apparatus in the meantime,
Recording a plurality of the image data and the behavior information on a recording medium;
One or more intermediate images reflecting the behavior of the image recording / reproducing apparatus when a plurality of the image data and the behavior information are read from the recording medium and a plurality of the image data are generated during the reproduction processing of the image data Generating data according to the behavior information;
And a step of reproducing the plurality of image data and the intermediate image data in time series. An image reproduction device for reproducing image data generated in an image recording device,
A recording in which a plurality of image data generated by capturing an image of a subject in the image recording device and behavior information regarding the behavior of the image recording device in between are generated in parallel with the generation of the plurality of image data. A plurality of the image data and the behavior information are read from the medium, and one or more intermediate image data reflecting the behavior of the image recording apparatus when the plurality of the image data are generated are generated according to the behavior information. Intermediate image generating means;
An image reproduction apparatus including reproduction means for reproducing a plurality of the image data and the intermediate image data in time series. An image reproduction method for reproducing image data generated in an image recording apparatus,
A recording in which a plurality of image data generated by capturing an image of a subject in the image recording device and behavior information regarding the behavior of the image recording device in between are generated in parallel with the generation of the plurality of image data. A plurality of the image data and the behavior information are read from the medium, and one or more intermediate image data reflecting the behavior of the image recording apparatus when the plurality of the image data are generated are generated according to the behavior information. Steps,
And a step of reproducing the plurality of image data and the intermediate image data in time series. A computer program for reproducing image data generated in an image recording apparatus on a computer,
For the computer
A recording in which a plurality of image data generated by capturing an image of a subject in the image recording device and behavior information regarding the behavior of the image recording device in between are generated in parallel with the generation of the plurality of image data. A plurality of the image data and the behavior information are read from the medium, and one or more intermediate image data reflecting the behavior of the image recording apparatus when the plurality of the image data are generated are generated according to the behavior information. Steps,
A computer program for executing a step of reproducing a plurality of the image data and the intermediate image data in time series.

Images