JP4345608B2 - Image data reproducing apparatus and program - Google Patents

Description

  The present invention relates to a slide show display technique using image photographing information.

  There is a slide show display function that gives motion, music, and switching effects to still images on an image display device such as a personal computer or a digital camera, so that still images can be viewed on the screen. As a form of use of the slide show display function, a screen saver that shifts to the screen saver mode to prevent still images when the computer or digital camera is not operated for a specified time or longer when the power is turned on is well known. (For example, refer to Patent Document 1).

In the slide show of the prior art, as a method for selecting movement, music, and switching effect, (1) a method using predetermined “movement”, “music”, and “switching effect” that is irrelevant to the subject (for example, Patent Document 2) Or (2) a method in which the user designates “movement”, “music”, and “switching effect” that suits the subject (see, for example, Patent Document 3). The “movement” refers to a zoom-in operation shown in FIG. 19 or a panning operation shown in FIG.
JP-A-11-313229 JP 2004-64396 A JP 2004-95019 A

However, since the selection method (1) uses “movement”, “music”, and “switching effect” determined regardless of the subject, the subject and “movement”, “music”, and “switching effect” are If they do not match, for example, there is a problem of zooming in on an unimportant part.
As a specific example, in the zoom-in example shown in FIG. 19, if the zoom-in is simply zoomed in, the central part is zoomed in. Therefore, as shown in FIG. 19A, the main subject A may be shown in the central part. As shown in b), when the main subject A is not in the center, there is a problem that the zoomed-in portion is deviated from the main subject A.

In the selection method (2), the user selects “movement”, “music”, and “switching effect” one by one. Therefore, as in the selection method (1), the subject and the “movement”, “ There is no problem that “music” and “switching effect” do not match, but there is a problem that convenience is low in that the user is forced to “movement”, “music”, and “switching effect”.
The present invention has been made to solve the above-described problems, and an object of the present invention is to provide an image data reproducing apparatus and program capable of automatically determining “movement” at the time of slide show display from image photographing information. And

In order to solve the above problem, the invention described in claim 1 is directed to image data storage means for storing captured image data in association with shooting information at the time of shooting, and shooting conditions set at the time of shooting. Storage means for associating and storing motion information defining movement when reproducing captured image data, detection means for detecting an instruction to reproduce the image data stored in the image data storage means, and When the reproduction instruction is detected by the detection means, a reading means for reading the image data stored in the image data storage means, and the photographing conditions are stored in association with the image data read by the reading means. Determining means for determining whether or not the shooting conditions are stored by the determining means, the operation information corresponding to the shooting conditions is stored in the memory Reading from a first reproduction control means for controlling so as to reproduce the image data read out said in accordance with the operation information, when the photographing condition by the determining means is not stored, were the read And second reproduction control means for controlling to reproduce the image data according to the photographing information stored in association with the image data .

According to a second aspect of the present invention, in the first aspect of the present invention, the photographing information includes in-focus position information or distance information to a subject.

According to a third aspect of the present invention, in the first or second aspect of the present invention, the image pickup means and an image pickup control means for controlling the image pickup means by reading out the shooting conditions stored in the storage means. The image processing apparatus further comprises storage control means for storing the image data captured by the control by the imaging control means in the image data storage means in association with the read photographing condition.

According to a fourth aspect of the present invention, in the invention of the third aspect , the storage unit stores a plurality of types of the imaging conditions and the operation information in association with each other, and stores the plurality of types in the storage unit. It further comprises a selection means for selecting a specific shooting condition from the set shooting conditions.

The invention according to claim 5 is the invention according to any one of claims 1 to 4 , wherein the reading means sequentially reads the image data stored in the image data storage means. To do.

The invention according to claim 6 is the invention according to any one of claims 1 to 5 , further comprising display means for displaying image data to be reproduced.

The invention according to claim 7 is the invention according to any one of claims 1 to 5 , further comprising output means for outputting image data to be reproduced to the outside of the apparatus.

In order to solve the above-mentioned problem, the invention described in claim 8 is set at the time of imaging, and an image data storage unit that stores captured image data in association with shooting information at the time of shooting. A computer having a storage unit that stores the shooting conditions and the operation information that defines the movement when reproducing the captured image data in association with each other, and detects the reproduction instruction of the image data stored in the image data storage unit Detecting means for detecting, and when the reproduction instruction is detected by the detecting means, a reading means for reading out the image data stored in the image data storage unit, and the photographing condition in association with the image data read out by the reading means Determining means for determining whether or not is stored, and if the determining means determines that the shooting condition is stored, an operation corresponding to the shooting condition Reads broadcast from the storage unit, first control means for controlling so as to reproduce the image data read out said in accordance with the operation information, when the imaging condition is not stored by said determining means, said reading It is characterized by functioning as second control means for controlling reproduction of the output image data in accordance with the photographing information stored in association with the image data .

According to the present invention, it is possible to automatically determine the movement at the time of reproduction of the image data photographed under the photographing condition based on the photographing condition, and reproduce according to the decided movement . In addition, when the image data is not imaged under this imaging condition, the movement at the time of reproduction can be determined based on the imaging information at the time of imaging, and the reproduction can be performed according to the determined movement. Therefore, in any case of image data, the user does not need to select and set movements one by one, which is highly convenient.

(Embodiment 1)
<1-1. Digital camera configuration>
FIG. 1 is a block diagram showing an example of the internal configuration of a digital camera that can implement the slide show display method of the present invention. In the present embodiment, AF information or best shot mode by 3-focus AF (Automatic Focus) shown in FIG. 3 is used as shooting information, but the number of multi-focus areas of AF information is not limited to three. Also, the shooting information is not limited to AF information or best shot mode. For example, zoom magnification, still image / moving image classification, and the like can be used as shooting information. In the present embodiment, the AF information includes a focus position (AF1 to AF3) and a subject distance shown in FIG.

Here, the best shot mode is to display samples such as landscape, sunset, fireworks, people, etc., and to support each sample as a set with optimum shooting conditions (eg shutter speed, exposure, white balance, etc.) When the attached user selects a sample, the corresponding optimum photographing condition can be automatically set as the photographing condition and photographing can be performed. That is, the best shot mode is a set of shooting condition settings.
Examples of the shooting condition set include the following (1) to 3), but are not limited to these examples. Although it is preset by the manufacturer, it can also be set by the user. In the following, AF is an abbreviation for autofocus, and WB is an abbreviation for white balance.
(1) Landscape: AF = ∞, flash = off, WB = sunlight, color enhancement = blue, saturation = high (2) Sunset: AF = ∞, flash = off, WB = sunlight, color enhancement = red, Saturation = High (3) Person: AF = Auto, Flash = Auto, WB = Sunlight, Color enhancement = Skin color, Saturation = Normal

  In FIG. 1, a digital camera 100 includes an optical system 11, a signal conversion unit 12, a signal processing unit 13, a DRAM 14, a control unit 20, an operation unit 30, a display unit 40, a recording unit 50, an image counter 61, a reproduction counter 62, and a power source. 90.

  The optical system 11 includes an imaging lens 111, an automatic exposure mechanism 113, and an AF device 114, and focuses the luminous flux of the subject image collected through the imaging lens 111 on a subsequent imaging device (CCD). A plurality of in-focus positions (multi-focus area) in the camera field of view are set as temporary in-focus positions, and there are in-focus positions that are focused on the main subject among the plurality of in-focus positions during shooting standby. In this case, when the user gives an autofocus start instruction (half-press of the shutter button 36 in this embodiment), the AF device 114 acquires AF information (position information of the focus position and distance to the subject) and takes a shooting instruction. When there is (in this embodiment, the shutter button 36 is fully pressed), AF information is sent to the control unit 20.

  The signal conversion unit 12 includes a signal conversion circuit such as an A / D converter (not shown), converts an image formed through the preceding optical system 11 into an electrical signal by an imaging element such as a CCD, The electrical signal is converted into digital data and output at a constant cycle.

  The signal processing unit 13 receives the digital data from the signal conversion unit 12 and temporarily holds it in a Bayer-based form corresponding to the CCD pixels, interpolates it to create RGB data, and further, luminance and color difference multiplexes. Signal components such as signals (Y, Cb, Cr data) are obtained. The Y, Cb, Cr data (hereinafter referred to as image data) is transferred to the DRAM 14 and temporarily stored. In addition, the captured image data is thinned out and sent to the display unit 40 in order to display a through image (photographing standby image). When the shutter operation is performed, the image data at that time is sent to the display unit 40 to display a still image.

Further, the signal processing unit 13 reads out the image data written in the DRAM 14 at the time of recording and storage, performs JPEG compression processing, and stores and records it in a storage memory such as the memory card 51 (FIG. 2) of the recording unit 50. In addition, a compression / decompression unit that performs decompression processing on the compressed image data recorded in the memory card 51 during reproduction and reproduces the image data, and a thumbnail image generation unit that generates a thumbnail image (reduced image) are provided.
The compression / decompression unit supports a plurality of compression ratios, and the mode corresponding to the compression ratio is a mode corresponding to a high resolution (generally called high precision, fine, normal, etc.) with a low compression ratio. And a low-resolution (commonly called economy) mode with a high compression ratio.
It also supports high to low pixel counts. For example, there are image sizes called SXGA (1600 × 1200), XGA (1024 × 786), SVGA (800 × 600), VGA (640 × 480) and the like.

  The DRAM 14 is used as a work memory, and an image buffer area for temporarily storing captured still images, a work area for JPEG compression / expansion, and an image composition area are secured.

  The control unit 20 has a microprocessor configuration including a timekeeping mechanism such as a CPU, a RAM, a program storage ROM, and a timer. The CPU is connected to the above-described circuits and a power supply switch (not shown) via a bus line. The entire digital camera 100 is controlled by a control program stored in the program storage ROM, and each mode stored in the program storage ROM corresponds to the status signal from the operation unit 30. The operation program is extracted, and execution control of each function of the digital camera 100, for example, acquisition and recording of shooting conditions and shooting information is performed.

  The operation unit 30 includes keys and switches such as a mode switch 31, a liquid crystal monitor switch, a zoom key, a menu key, a cursor key, a shutter button 36, and a slide show button 38, and these keys and switches are operated. A status signal and a set value are sent to the control unit 20.

  The display unit 40 includes a video encoder (not required for a digital input / output display unit), a VRAM (not shown), a liquid crystal monitor screen (LCD), and the like. Display of images, display of playback images during playback, display of selection menus (or icons) when processing is selected, slide show display, and the like are performed.

  The recording unit 50 accesses a removable storage memory such as a memory card under the control of the control unit 20, writes / reads data, and stores image data (compressed image data) and imaging conditions associated with the image data. Records in association with the image data to be recorded. Also, an image information list (not shown) for registering image shooting modes and the like can be recorded. An internal memory such as a flash memory may be used instead of the memory card.

  FIG. 2 is a diagram showing an embodiment of the storage area configuration of the memory card 51. As shown in FIG. 2, the memory card 51 includes a management area 51-0 and compressed images of still images and moving images. An image data recording area 51-1 for recording data (image files), a reduced image storage area 51-2, a shooting information storage area 51-3 for recording shooting information, and the like are provided. Also, an audio data recording area for recording music data and audio data may be provided. Instead of the image data recording area 51-1, an area for storing still image data and an area for storing moving images may be secured separately.

  The management area 51-0 stores an image management file in which information of various images recorded in the memory card 51 is registered, a moving image management file in which moving image information for calendar display of the present invention is recorded, and the like.

<1-2. Multi-focus area>
FIG. 3 is an explanatory diagram of a multi-focus area, and is an example in which the number of focus areas is AF1, AF2, and AF3 indicated by rectangular frame lines. In the example shown in the figure, the arrangement of the areas is one horizontal row, but may be arranged in the vertical direction, or may be a cross-shaped arrangement or the like. In the illustrated example, the main subject A is at the in-focus position AF3. If there is a shooting instruction (full press of the shutter button 36) at this time, the AF device 114 causes the position information of the in-focus position AF3 and the main subject as shooting information. The distance information with A is acquired and sent to the control unit 20.
<1-3. Image movement>

Image data shot by an imaging device such as the digital camera 100 and recorded on the memory card 51 is reproduced by pressing the slide show button 38, and AF information obtained at the time of shooting, sample pattern identification information in the best shot mode, etc. An appropriate image movement is determined from the shooting information of the image, and a slide show is displayed.
In this specification, the image movement means a process of giving a visual change such as panning, tilting, and zooming to a single original still image.
Hereinafter, an operation example at the time of shooting of the digital camera 100 will be described with reference to the flowchart of FIG. The movement determining operation will be described with reference to the flowcharts of FIGS. 6 and 11. Examples of the movement, panning operation, zoom-in left operation, zoom-in center operation, and zoom-in right operation at this time are shown in FIGS. An example of the operation is shown in FIGS. In addition, the arrow in a figure shows the direction of a motion.

<1-4. Control action of digital camera in shooting mode>
FIG. 4 is a flowchart showing a control operation example of the control unit of the digital camera by the operation program in the shooting mode (schematic flowchart in which portions not directly related to the present invention are omitted). Hereinafter, a description will be given based on FIGS.
In the shooting mode, the control unit 20 checks whether or not the shooting mode is the best shot mode. If the shooting mode is the best shot mode, the control unit 20 proceeds to the shooting process (not shown) in the best shot mode. (Step S0).
The control unit 20 controls the optical system 11 to capture a subject image every predetermined time, converts it into image data by the signal conversion unit 12 and the signal processing unit 13, and temporarily stores (overwrites) it in the DRAM 14 (step S1). The signal processing unit 13 is controlled to generate a through image (shooting standby image), which is sent to the display unit 40 for through display (step S2).

The control unit 20 superimposes and displays the multi-focus areas AF1, AF2, and AF3 (FIG. 3) on the through image displayed on the display unit 40, and instructs the user to start automatic focusing (in this example, half of the shutter button 36). (Step S3), the signal from the operation unit 30 is examined, and if there is an automatic focusing start instruction, the process proceeds to Step S5, and if not, the process returns to Step S1 (Step S4).
When there is an automatic focusing start instruction, the control unit 20 locks the shutter button 36 and controls the AF device 114 to start automatic focusing. When the user operates the camera and the main subject image is set to one of the multi-focus areas AF1, AF2, and AF3, the AF device 114 operates so as to focus on that area. The shutter button 36 is unlocked and a shooting instruction can be issued (step S5).

  Since the user captures a desired timing and gives a shooting instruction (in the embodiment, the shutter button 36 is fully pressed), the control unit 20 checks the signal from the operation unit 30 and when a shooting instruction is given, the process proceeds to step S7. Otherwise, it waits for a shooting instruction (step S6).

  When there is a shooting instruction, AF information (in-focus position and distance X to the main subject) at the time of focusing is acquired from the AF device 114 and held in the DRAM 14 (step S7). The image data stored in is taken out and a still image is displayed on the display unit 40 (step S8).

  Next, it is checked whether or not the user has performed a recording instruction operation (step S9). If a recording instruction operation has been performed, the image data temporarily stored in the DRAM 14 is compressed and the image data storage area 51 of the memory card 51 is compressed. -1 and the AF information and other shooting information acquired in step S6 are recorded in the shooting information storage area 51-3 of the memory card 51 in association with the compressed image data (step S10). In addition, the control unit 20 adds 1 to the image counter 61 (step S10).

By the operation shown in the flowchart of FIG. 4 above, the digital camera 100 associates shooting information (in this example, AF information (focus position and subject distance)) that defines the movement during slide show display during shooting with a memory card. It can be recorded in a storage memory such as 51.
Note that the shooting information that regulates the movement during slide show display is not limited to AF information, and the best shot mode (optimum shooting condition setting mode), zoom magnification, still image / video classification, etc. The prescribed shooting information may be recorded in the storage memory in association with the shot image.
For example, in the best shot mode, as shown in FIG. 12A, the identification information (“landscape” → B001, “sunset” → B002,...) Of the sample pattern of the selected best shot is taken as the shooting information. As shown in FIG. 12B, an action table 120 in which action codes (P1, C1,...) Indicating movement are associated with these identification information is recorded in a storage memory of 51 memory cards in advance. Alternatively, the captured image can be configured to be recorded in association with the motion code in the operation table 120 when the captured image is stored.
In addition, music or sound may be recorded in association with a photographed image at the time of photographing or after photographing, and may be recorded in a storage memory in association with the photographed image together with photographing information that defines movement during slide show display.

<1-5. Control operation of digital camera in slideshow display mode>
FIG. 5 is a flowchart showing an example of the control operation of the control unit of the digital camera by the operation program in the slide show display mode. Hereinafter, a description will be given based on FIGS.
In the playback mode, the control unit 20 checks whether or not the slide show button 38 has been pressed (step T1). When the slide show button 38 is pressed, 1 is set in the playback counter 62 (step T2) and i (i = Value of the reproduction counter 62) The first image data (compressed image data) is read out and temporarily stored in the DRAM 14 (step T3). Further, the AF information associated with the image data read in step T3 is read from the memory card and held (temporarily stored) in the DRAM 14 (step T4).

  Next, the control unit 20 determines the motion of the reproduced image based on the AF information by the motion determination operation as shown in FIG. 6 (step T5), reads the image data stored in the DRAM 14 and controls the signal processing unit 13 to The decompression process is performed and the reproduction data is sent to the display unit 40 to be reproduced and displayed in accordance with the movement determined in step T5 (step T6). Next, 1 is added to the reproduction counter 62 (step T7), and the operations of steps T3 to T7 are repeated until the value of the reproduction counter 62 becomes larger than the value of the image counter 61 (step T8).

With the operation of the flowchart shown in FIG. 5, the digital camera 100 displays a reproduced image according to a motion (for example, pan operation, zoom-in operation, tilt operation) determined based on shooting information such as AF information and best shot mode. Can do.
That is, according to the operation determined in step T5 (the image operation determination algorithm shown in FIG. 6), in step T6, a replayed image is displayed on the distant subject so as to look around the entire distant view by panning, and the subject on the left side of the foreground is displayed. The zoomed-in left action zooms the playback image so that it is focused on the left side, the zoom-in center action zooms the playback image so that it is focused in the center, and the zoom-in right subject zooms right. Since the playback image is zoomed so as to focus on the center by the operation, the user can obtain movement and presence as if viewing a moving image even if it is a still image. In addition, images of landscapes taken in the best shot mode have a panoramic image with a panning to the side, while images of sunsets are displayed from top to bottom by tilt-down operation. The movement from dusk to the top and the ratio of bright sky at the time of death are reduced and the dusk progress is produced.
In addition, when outputting music and audio in association with a playback image together with movement during slide show display, for example, an output start step of music and audio is provided before step T6, and music and audio are output after step T6. By providing an audio output end step, music and audio output can be associated with image motion.
There are various methods for selecting data to be read and reproduced. For example, images in a predetermined folder may be displayed in a predetermined order, or images may be designated individually.

  4 and 5 have been described based on an example in which the digital camera 100 includes the image counter 61 and the reproduction counter 62. However, when the image display device is not an imaging device such as a digital camera, When the imaging device does not include the image counter 61 and the reproduction counter 62, for example, the imaging device side is configured to set the image counter in a predetermined area of a temporary storage memory such as a DRAM when the imaging mode is started. In step S11 of FIG. 4, 1 is added to the image counter value, and the image counter value is additionally recorded in the predetermined number of shots count area set in the predetermined area of the storage memory at the end of shooting. The playback counter is set in a predetermined area of the temporary storage memory. After operation of T3 to T7, by so comparing images counter value of the values and storage in memory of the playback counter in step T8, it is possible to perform similarly slideshow display mode and the digital camera 100.

<1-6. Operation Determination Algorithm (1)>
FIG. 6 is a flowchart showing the detailed operation of step T5 in FIG. 5 (and step V5 in FIG. 18), and is a flowchart showing an example of the control operation of the control unit by the motion determination operation program in the slide show display mode. FIGS. 7 to 10 are diagrams for explaining the movement of an image. FIG. 7 is a pan, FIG. 8 is a zoom-in left, FIG. 9 is a zoom-in center, and FIG. Moreover, the arrow in a figure shows the direction of a motion.
Hereinafter, description will be made based on FIGS. 1, 3, and 7 to 10. Note that V5, V5-0 to V5-7, V6 in parentheses in the reference numerals indicating the step order in FIG. 6 are applied when this flowchart is cited in step V5 of the flowchart of FIG. Is.

In FIG. 6, the control unit 20 checks whether or not the original image of the reproduced image is an image shot in the best shot mode. If the image is shot in the best shot mode, the control unit 20 performs step T5-10 (best shot shooting in FIG. 11). If not, the process proceeds to Step T5-1. Whether or not the shooting mode of the reproduced image is the best shot mode can be determined by referring to shooting information stored in the memory card 51 (for example, checking the presence or absence of identification information of the corresponding best shot sample pattern). (Step T5-0).
If the image is not shot in the best shot mode, the distance X (subject distance) from the main subject in the AF information held in step T4 in FIG. 5 or step V4 in FIG. K is compared, and if the distance X> K (K = 10 m in this example), the process proceeds to step T5-2, and if the distance X ≦ K, the process proceeds to T5-3 (T5-1). When the distance X> K, the image movement is determined as a panning operation for moving the display image so as to move in the horizontal direction or the vertical direction, and the process proceeds to step T6. The example of FIG. 7 is an example of a pan operation for moving an image from left to right (step T5-2).

  When the distance X ≦ K, the control unit 20 checks the in-focus position in the AF information held in the DRAM 14 in step T4 in FIG. 6. If the in-focus position is AF1, the process proceeds to step T5-4. Advances to step T5-5 (step T5-3). When the in-focus position is AF1, as shown in FIG. 8, it is determined to be a zoom-in left operation that zooms in to the left so as to focus on the focus area AF1, and proceeds to step T6 (step T5-4).

  If the in-focus position is AF2, the process proceeds to step T5-6, and if not, the process proceeds to step T5-7 (step T5-5). When the in-focus position is AF2, as shown in FIG. 9, it is determined to be a zoom-in center operation for zooming in in the center direction so as to focus on the focus area AF2, and the process proceeds to step T6 (step T5-6).

  When the in-focus position is AF3, the movement of the image is determined to be a zoom-in right operation that zooms in to the right to focus on the focus area AF3 as shown in FIG. 10, and the process proceeds to step T6 (step T5-7).

  According to the image operation determination algorithm shown in FIG. 6, the panning operation is performed when the main subject is a distant subject, the zoom-in left operation is performed for a subject on the left side of the foreground, and the zoom-in center operation is performed for a subject in the foreground center. In the case of a subject on the right side of the foreground, the right operation of zooming in can be determined as the “operation” of the image.

<1-7. Operation decision algorithm (2)>
FIG. 11 is a flowchart showing the detailed operation of step T5 of FIG. 5 (and step V5 of FIG. 18) when the original image of the reproduced image is an image taken in the best shot mode, and step T5 of FIG. It is a flowchart which shows the example of control operation | movement of the control part by the motion determination operation | movement program at the time of slide show display mode in case -0 (step V5-0) and the original image of a reproduction | regeneration image was image | photographed in the best shot mode.
FIG. 12 is a diagram showing an example of an operation table in the best shot mode. FIG. 12A is an explanatory diagram of each sample pattern in the best shot mode and movements set in advance in the best shot mode. b) is a diagram showing an example of an operation table. FIG. 13 and FIG. 14 are explanatory diagrams of image motion, FIG. 13 is a diagram showing pan, FIG. 14 is a diagram showing tilt-up motion, and arrows in the figure indicate the direction of motion.
Hereinafter, description will be made based on FIGS. 1, 3, and 12 to 14. In addition, V5-0, V5-10 to V5-12, V6 in parentheses in the reference numerals indicating the step order of FIG. 11 are used when quoting this flowchart in step V5 of the flowchart of FIG. Applicable.

  In FIG. 11, when the original image of the reproduced image is an image taken in the best shot mode, the operation table 120 in the best shot mode recorded in the memory card 51 in association with the image is referred to (step T5). -10) The motion code corresponding to the pattern code is extracted (step T5-11), the motion associated with the motion code is determined as the motion of the image, and the process proceeds to step T6 (step T5-12).

When the pattern of the image shot in the best shot mode is “landscape” by the operation shown in the flowchart of FIG. 11, the image is associated with the pattern code B001 of the operation table 120, so the corresponding motion code “ “P1” is extracted, and in accordance with the meaning of the movement code “P1” (see FIG. 12A), the movement of the image is determined as a panning operation for moving the display image in the horizontal direction or the vertical direction. The example of FIG. 12 is an example of a panning operation in which the “landscape” image is moved from left to right, and a wide panoramic feeling can be expressed by a horizontal panning operation.
When the image pattern is “sunset”, since the image is associated with the pattern code B002 of the operation table 120, the corresponding motion code “C1” is extracted, and the motion of the image is determined according to the meaning of the motion code “C1”. Is determined as a tilt-down operation in which the display image is moved so as to move vertically downward. The example of FIG. 12 is an example of a tilt-down operation in which the “sunset” image is moved from the upper direction to the lower direction, and the progress of dusk can be produced by reducing the movement from the top to the bottom and the ratio of the bright sky at sunset.
When the image pattern is “fireworks”, the image is associated with the pattern code B003 of the operation table 120, so the corresponding motion code “C2” is extracted, and the motion of the image is determined according to the meaning of the motion code “C2”. Is determined to be a tilt-up operation in which the display image is moved so as to move vertically upward.
When the image pattern is “person”, since the image is associated with the pattern code B004 of the operation table 120, the corresponding motion code “Z2” is extracted, and the image is displayed according to the meaning of the motion code “Z2”. It is determined to be a zoom-in central operation that zooms in the movement in the center direction.

  In the same manner, since the image shot in the best shot mode is associated with the pattern code of the operation table 120, the corresponding motion code can be extracted and the motion of the image can be determined according to the meaning of the motion code. That is, by determining the movement of the slide show corresponding to the shooting condition set, it is possible to perform a slide show display that is optimal for the subject.

Note that the shooting information that defines movement during slide show display is not limited to AF information or the best shot mode, and zoom magnification, still image / moving image classification, and the like are used as shooting information that defines movement during slide show display during shooting. Such shooting information can also be added to the operation determination algorithm of FIG.
Specifically, determination steps as shown in steps T5-1, T5-3, and T5-5 in FIG. 6 are provided in association with each piece of shooting information, and steps T5-2, T5-4, T5-6, A motion regulation step as shown in T5-7 is provided in association with the determination step, or an operation table as shown in FIG. 11 is set in association with the shooting information, and the operation table is referred to during reproduction. Then, the motion code is taken out and the motion is determined.

  In the above embodiment, the digital camera has been described as an example of an image display device, but the term image display device is not limited to a digital camera. The present invention is also applied to, for example, an electronic camera or an imaging device having a display unit, a mobile phone with a camera, a portable information terminal, a personal computer, a communication terminal having an image storage unit and a display unit, a cradle having an image display unit, and the like. Applicable.

(Embodiment 2)
In the first embodiment, the case where the slide show display method of the present invention is applied to an imaging apparatus such as a digital camera or an image display apparatus has been described. However, the present invention includes a storage memory for storing image data, and reproduces an image to externally. The present invention can also be applied to an image reproduction device such as a digital album device that outputs to a display device and displays it on an external display device.

FIG. 15 is a schematic explanatory diagram of slide show display by the image playback apparatus, where reference numeral 100 is a digital camera (FIG. 1), reference numeral 150 is a cradle equipped with the digital camera 100, and reference numeral 200 is an image playback apparatus (in this example, a stationary type). No. 230 is an external display device (in this example, a television monitor), and No. 300 is a personal computer.
The cradle 150 and the image reproduction device 200 can be connected by a USB cable 160. The image reproduction device 200 can be connected to an external display device 230 such as a television monitor via a cable 240. Furthermore, the image reproduction apparatus 200 and the personal computer 300 can be connected to a local area network (LAN) via a LAN cable (or wireless LAN) 310, and the personal computer 300 is connected to the Internet (not shown) via an ADSL (Asymmetric Digital Subscriber Line). ). Note that the image reproduction device 200 and the personal computer 300 may be connected by a USB cable.

  The image reproducing device 200 is transferred in the storage / recording mode via the cradle 150. The image data and shooting information of the digital camera 100 (in this embodiment, AF information (focus position information and subject distance) and the best shot mode are used. Pattern information) is stored and stored in the storage memory in association with the image data and the image data and shooting information such as AF information. In the slide show display mode, the image data of the designated image is read together with the shooting information of the AF information, the image motion is determined and output to the external display device 230 such as a television monitor, and the determined motion is followed. Make a slide show display.

  In addition, the image reproduction apparatus 200 takes in image data and AF information shooting information transferred via the LAN cable 310 or the like in the save / record mode, and associates the image data and the image data with AF information shooting information in the save memory. Can be saved and recorded. In the slide show display mode, the image data of the designated image is read together with the shooting information such as the AF information, the movement of the image is determined, and the image data is output to the monitor screen of the personal computer 300 via the LAN cable 310 or the like. It is also possible to display a slide show according to the movement determined at 200. Furthermore, the personal computer 300 can be connected to the Internet via ADSL, and can transmit image data accompanied by the movement determined by the image reproducing device 200 to a display device or a browsing site connected to the Internet.

  FIG. 16 is a block diagram illustrating an example of an electronic circuit configuration of an image reproduction apparatus to which the present invention can be applied. The image reproduction apparatus 200 includes a control unit 210, a key input unit 211, a USB unit 213, a DRAM 220, a JPEG circuit 221, and a storage. A cable connection unit (not shown) for connecting the memory 222, the VRAM 223, the VRAM controller 224, the digital video encoder 225, and the external display device 230 with a cable is provided. As an external image data receiving unit, a short-distance communication unit 214 such as infrared communication or Bluetooth, or a wireless communication unit 215 that transmits and receives data wirelessly is provided outside the USB unit 213 (or instead of the USB unit 213). It may be.

  The control unit 210 has a microprocessor configuration including a timing mechanism such as a CPU, a RAM, a program storage ROM, and a timer. The CPU is connected to the above-described circuits and a power supply switch (not shown) via a bus line. The image reproduction apparatus 200 is controlled by the control program stored in the program storage ROM, and each mode stored in the program storage ROM corresponding to the status signal from the key input unit 11 is connected. The operation program corresponding to the above is taken out, and execution control of each function of the image reproduction device 200, for example, movement of the reproduction image, that is, visual change such as panning, tilting, zooming, etc. for one original still image is performed. The processing to be performed, and the actual image data to be output and displayed on the external display device according to the determined processing. Perform the control and the like.

In the storage recording mode, the control unit 210 receives the image data (compressed image data) for one frame taken into the DRAM 220 from the external imaging device (in this embodiment, the digital camera 100 (FIG. 1)) via the USB unit 213. The image data is stored in the storage memory 222 in association with the AF information. As the writing of the image data for one frame is completed, the control unit 210 activates the path from the USB unit 213 to the DRAM 220 again.
During playback, the image data recorded in the storage memory 222 is selectively read out, the image data compressed by the JPEG circuit 221 is expanded, and the expanded image data is expanded into the VRAM 223 via the VRAM controller 224. Then, the digital video encoder 225 periodically reads out from the VRAM 223, generates a video signal based on these image data, sends it to the display unit 230, and reproduces it.

  The operation unit 211 includes operation keys including a power button 2111, a mode selection button 2112, an image selection button 2113 (FIG. 15), and a lamp such as a display lamp 2114 that is lit during operation. Is sent directly to the control unit 210.

  The USB unit 213 is a USB interface that exchanges data when a USB cable such as the USB cable 160 is connected. In the storage / recording mode, image data transmitted from an imaging device such as a digital camera or a transfer device such as a cradle Receive shooting data.

  The DRAM 220 is used as a work memory, and in the slide show display mode, an image buffer area for temporarily storing received image data, a thumbnail image storage area, a shooting information storage area such as AF information, and a work area at the time of JPEG decompression Etc. are secured.

  A JPEG circuit (Joint Photograph Cording Experts Group) 221 decompresses compressed image data by inverse processing such as ADCT (Adaptive Discrete Cosine Transform), Huffman coding which is an entropy coding method. In this embodiment, the JPEG circuit 221 is used as a compressed data expansion unit for expanding compressed data. However, a well-known compressed data expansion program may be used instead of the JPEG circuit 221.

  The storage memory 222 includes a recording medium such as a flash memory or an optical disk, and stores and records image data (compressed image data). An image information registration list (not shown) for registering shooting information such as AF information is recorded. Note that a removable storage medium such as a memory card may be used instead of the flash memory.

  The digital video encoder 225 expands and stores the image data decompressed by the JPEG circuit 221 in exactly the reverse procedure of the data compression procedure in the VRAM 23 via the VRAM controller 224, and periodically reads out from the VRAM 223. A video signal is generated based on the image data and sent to an external display device 230 such as a television monitor for reproduction output. When the external display device 230 is a digital input / output display device, the digital video encoder 225 is not necessary.

  The external display device 230 is connected to the image reproduction device 200 via the cable 240 and performs display based on the video signal from the digital video encoder 225, so that the image data captured from the VRAM controller 224 at that time is displayed. The images based on the slide show are displayed.

  FIG. 17 is a flowchart showing an example of the control operation of the control unit of the image reproduction apparatus according to the operation program in the storage recording mode. Hereinafter, an example of capturing image data and the like from the digital camera 100 via the cradle 150 will be described with reference to FIGS. 15 and 16.

  The user checks whether or not the cradle 150 equipped with the digital camera 100 is connected to the image playback apparatus 200 with the USB cable 160. If the cradle 150 is connected, the user operates the selection button 2112 (FIG. 16) to set the storage recording mode. A selection is made (step U0). Based on the signal from the operation unit 211, the control unit 210 checks whether or not the user has selected the storage recording mode. If the storage recording mode is selected, the control unit 210 proceeds to step U2 (step U1), and passes through the cradle 150. The image data transferred from the digital camera 100, the shooting information of the AF information, and the thumbnail image data are received (step U2), and the received image data, the shooting information of the AF information, and the thumbnail image data are temporarily stored in the DRAM 220. Then (step U3), the image data, thumbnail image data, and AF information are associated with each other and recorded in the storage memory 222 (step U4).

With the operation shown in the flowchart of FIG. 17, the image playback apparatus 200 captures captured images of the digital camera 100 and the like, and shooting information that defines movement during slide show display (in this example, AF information and identification information of the best shot sample pattern (see FIG. 12)) can be recorded in the storage memory in association with the photographed image.
For example, in the best shot mode, as shown in FIG. 12A, the identification information (“landscape” → B001, “sunset” → B002,...) Of the sample pattern of the selected best shot is photographed. As shown in FIG. 12B, an action table 120 in which action codes (P1, C1,...) Indicating movement are associated with these identification information as shown in FIG. The captured image can be configured to be associated with the operation code in the operation table 120 and recorded when the image is stored.
The shooting information that defines the movement during slide show display is not limited to AF information or the best shot (optimal shooting mode), and the shooting information that defines the movement during slide show display during shooting such as zoom magnification, still image / video classification, etc. Information may be recorded in a storage memory in association with a captured image.
In addition, music or sound may be recorded in association with a photographed image at the time of photographing or after photographing, and may be recorded in a storage memory in association with the photographed image together with photographing information that defines movement during slide show display.

FIG. 18 is a flowchart showing an example of the control operation of the control unit of the image reproduction apparatus by the operation program in the slide show display mode. Hereinafter, a description will be given based on FIGS. 15 and 16.
First, the control unit 210 checks whether or not the user has selected the slide show display mode by operating the mode selection button 2112 (step V1). If the slide show display mode is selected, a plurality of thumbnail images are displayed on the external display device 230. To display a multi-display to prompt the user to select an image, and when the user selects an image, the process proceeds to step V3 (step V2).
When an image is selected, the image data (compressed image data) of the selected image is read from the storage memory 222 and temporarily stored in the DRAM 220 (step V3). Further, photographing information such as AF information associated with the image data read in step V3 is read from the storage memory 222 and held (temporarily stored) in the DRAM 220 (step V4).

Next, the control unit 210 determines the movement of the reproduced image based on the AF information held in the DRAM 220 by the determination operation as shown in FIG. 6 or FIG. 11 (step V5), reads out the image data stored in the DRAM 220, and performs JPEG The circuit 221 is controlled to perform expansion processing (step V6),
The decompressed image data is expanded and stored in the VRAM 223 via the VRAM controller 224 (step V7), and then the digital video encoder 225 is read from the VRAM 223 according to the motion determined in step V5 to obtain the original image data. Then, a video signal is generated (step V8) and sent to the external display device 230 for slide show display (step V9).
Note that step T4, step T5-0 to step T5-7, and step T6 in the operation determination flowchart of FIG. 6 cited in step V5 are read as step V4, step V5-0 to step V5-7, and step V6. The steps T5, T5-0, T5-10 to T5-12 in the operation determination flowchart of FIG. 11 are read as steps V5, V5-0, V5-10 to step V5-12, and the memory card 51 is read as the storage memory 222. DRAM 14 should be read as DRAM 220.

Movement determined based on photographing information such as AF information and best shot mode (for example, pan operation, tilt operation, zoom-in operation) for the image stored in the image reproduction apparatus 200 by the operation of the flowchart shown in FIG. And an external display device 230 such as a television monitor can display an optimal slide show for the subject.
That is, according to the operation determined in step V5 (the image operation determination algorithm shown in FIG. 6 or FIG. 11), in step V6, the subject in the distant view or landscape is panned over the entire distant view on the screen of the external display device 230. The playback image is displayed as if looking around, and the playback image is zoomed so that the subject on the left side of the foreground is in focus on the left side by zooming in on the left side, and the subject in the center of the foreground is played back so that it is in focus on the center by zooming in on the center. The image is zoomed, and the playback image is zoomed so that the subject on the right side of the foreground is focused on the center by zooming in right, so that the user can feel the motion and presence of a still image as if it were watching a movie. Can be obtained. In addition, images of landscapes taken in the best shot mode have a panoramic image with a panning to the side, while images of sunsets are displayed from top to bottom by tilt-down operation. The movement from dusk to the top and the ratio of bright sky at the time of death are reduced and the dusk progress is produced.
In addition, when outputting music or audio in association with a reproduced image together with movement when displaying a slide show, for example, an output start step of music or audio is provided before the step V6, and the music or audio is output after the step V6. By providing an audio output end step, music and audio output can be associated with image motion.
There are various methods for selecting data to be read and reproduced. For example, the images in a predetermined folder may be displayed in a predetermined order.

  In the second embodiment, the image playback device is described as a dedicated device. However, the present invention includes an electronic camera, an imaging device, a portable information terminal, a personal computer, a communication terminal including an image storage unit, and an image storage unit as the image playback device. Applicable to cradle, etc.

  As mentioned above, although several Example of this invention was described, it cannot be overemphasized that this invention is not limited to said each Example, A various deformation | transformation implementation is possible.

It is a block diagram which shows the example of an internal structure of the digital camera which can implement the slide show display method of this invention. It is a figure which shows one Example of the memory area structure of a memory card. It is explanatory drawing of multi-area AF. It is a flowchart which shows the example of control operation of the control part of a digital camera by the operation | movement program at the time of imaging | photography mode. It is a flowchart which shows the control operation example of the control part of the digital camera by the operation program at the time of a slide show display mode. It is a flowchart which shows the example of control operation of the control part by the movement determination operation | movement program at the time of a slide show display mode. It is explanatory drawing of the motion by pan operation | movement. It is explanatory drawing of the movement to zoom-in left. It is explanatory drawing of the movement to the zoom-in center. It is explanatory drawing of the movement to zoom in right. It is a flowchart which shows the control operation example of the control part by the motion determination operation | movement program at the time of the slide show display mode of the image image | photographed by the best shot mode. It is a figure which shows an example of the operation | movement table at the time of best shot mode. It is explanatory drawing of the motion by pan operation | movement. It is explanatory drawing of the motion of tilt up. It is a schematic explanatory drawing of the slide show display by an image reproduction apparatus. It is a block diagram which shows the example of an electronic circuit structure of the image reproduction apparatus which can apply this invention. It is a flowchart which shows the control operation example of the control part of the image reproduction apparatus by the operation | movement program at the time of a preservation | save recording mode. It is a flowchart which shows the example of control of the control part of the image reproduction apparatus by the operation | movement program at the time of a slide show display mode. It is explanatory drawing of a zoom-in operation.

Explanation of symbols

11 Optical system (imaging means)
12 Signal converter (imaging means)
13 Signal processing unit 20 Control unit (motion determining unit, data reading control unit, storage control unit, display control unit)
51 Memory card (storage memory)
100 Digital camera (image display device, imaging device)
114 AF device (AF information acquisition means, photographing information acquisition means)
200 Image Playback Device 220 Storage Memory 230 External Display Device 300 Personal Computer

Claims (8)

Image data storage means for storing the captured image data and the shooting information at the time of shooting in association with each other ;
Storage means for storing the shooting conditions set at the time of shooting and operation information defining the movement when reproducing the shot image data in association with each other;
Detection means for detecting an instruction to reproduce the image data stored in the image data storage means;
A reading means for reading out image data stored in the image data storage means when a reproduction instruction is detected by the detection means;
Determining means for determining whether or not the photographing condition is stored in association with the image data read by the reading means;
When the photographing condition is judged to be stored by the determining means reads the operation information corresponding to the imaging condition from the storage means, and controls so as to reproduce the image data read out said in accordance with the operation information First regeneration control means;
When the determination unit determines that the shooting condition is not stored, a second playback control that controls to read the read image data in accordance with the shooting information stored in association with the image data. Means,
An image data reproducing apparatus comprising: The image data reproducing apparatus according to claim 1 , wherein the shooting information includes information on a focus position or distance to a subject. Imaging means;
An imaging control unit that reads out imaging conditions stored in the storage unit and controls the imaging unit;
Storage control means for storing image data captured by the control of the imaging control means in the image data storage means in association with the read imaging conditions;
Image data reproducing apparatus according to claim 1 or 2, further comprising a. The storage means stores a plurality of types in association with the shooting conditions and the operation information,
4. The image data reproducing apparatus according to claim 3 , further comprising selection means for selecting a specific shooting condition from a plurality of shooting conditions stored in the storage means. The reading means, the image data reproducing apparatus according to any one of claims 1 to 4, wherein the sequentially reading image data stored in said image data storage means. Image data reproducing apparatus according to any one of claims 1 to 5, further comprising a display means for displaying the image data to be reproduced. Image data reproducing apparatus according to any one of claims 1 to 5, further comprising output means for outputting the image data to be reproduced on the outside of the apparatus. An image data storage unit that stores captured image data and shooting information at the time of shooting in association with each other , and an operation that defines shooting conditions set at the time of shooting and movement at the time of playing back the shot image data A computer including a storage unit that stores information in association with each other.
Detecting means for detecting an instruction to reproduce the image data stored in the image data storage unit;
A reading unit that reads out image data stored in the image data storage unit when a reproduction instruction is detected by the detection unit;
Determining means for determining whether or not the photographing condition is stored in association with the image data read by the reading means;
When the photographing condition is judged to be stored by the determining means reads the operation information corresponding to the imaging condition from the storage unit, controls so as to reproduce the image data read out said in accordance with the operation information First control means,
If the determination means determines that the shooting condition is not stored, second control means for controlling the read image data to be reproduced in accordance with the shooting information stored in association with the image data ,
A program characterized by functioning as

Images