JP2012216215A - Image display device, image display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device, an image display method, and the like, capable of easily search an intended image from among a plurality of images.SOLUTION: Images for three frames with equal frame intervals, including a leading frame and a last frame, are extracted from among a plurality of images of two or more frames, and the extracted images 101 to 103 are displayed side by side on a display screen. When a hierarchy movement operation to a lower layer side is carried out in a state (d) with the two adjoining images 102, 103 selected, the images 101 to 103 for three frames, having the two selected images 102, 103 at both ends and having the equal frame intervals are newly displayed (g). By gradually narrowing down a range where a desired image is located, the desired image can be found efficiently.

Description

  The present invention relates to an image display device that searches and displays a desired image from a plurality of images, and an image display method thereof.

  Conventionally, when playing a moving image consisting of a plurality of still images (hereinafter simply referred to as images) along the time axis, a still image at a predetermined interval is displayed on the screen as a video index simultaneously with the moving image. An image display method that makes it possible to easily grasp the flow of time and the situation in the time axis direction in the past and future with respect to a moving image is described in Patent Document 1 below.

Japanese Patent Application No. 5-289650

  The above image display method is effective when performing playback operations in the time axis direction such as fast-forwarding and rewinding during the playback of a moving image, but for example from a large number (several tens) of images taken continuously by a digital camera or the like. When searching for a desired image from the continuous images (continuous images), even if the image display method described above is used, an intended image, for example, an arbitrary image at an arbitrary position on the time axis is selected. There was a problem that it was not easy to find out.

  The present invention has been made in view of such a conventional problem, and is used for realizing an image display device and an image display method capable of easily finding an intended image from a plurality of images. The purpose is to provide a program.

  In order to solve the above-mentioned problem, in the invention of claim 1, a recording unit that records a plurality of images in a predetermined order, a display unit that displays the images, and a recording unit that records the images in a predetermined order. Extracting means for extracting a prescribed number of images from the plurality of images as an extraction range, and a prescribed number of extracted images extracted by the extracting means on the display screen of the display means By selecting two images by an image selection operation from among the specified number of extracted images displayed by the display control means, the display control means for displaying them side by side and the extraction range of the specified number of extracted images by the extracting means And an extraction range changing means for changing each image between the two selected images to a new extraction range and causing the extraction means to extract a predetermined number of images from the new extraction range.

  In the invention of claim 2, the images extracted by the extracting means are images at both ends of the extraction range and images extracted from the images at the front end for every predetermined number of images.

  According to a third aspect of the present invention, the display control means enlarges any one extracted image selected by an image selection operation among a prescribed number of extracted images displayed side by side on the display screen. It is assumed that the display means enlarges the display according to the display operation.

  In the invention of claim 4, the display control means enlarges each time an image change operation is performed in a state where the display means enlarges the extracted image in response to the enlargement display operation. The image to be displayed is changed by frame advance in a predetermined direction.

  In the invention of claim 5, the extraction range at the beginning of the operation by the extraction means is the entire range of the predetermined plurality of images.

  Further, in the invention of claim 6, the extraction range changing means expands the extraction range of the specified number of extracted images by the extracting means stepwise in response to a predetermined first extraction range changing operation. In addition, the extraction range of the specified number of extraction images by the extraction unit is changed in a stepwise manner in accordance with a predetermined second extraction range change operation.

  In the invention of claim 7, the display control means displays on the display screen of the display means a position indicating the position of a specified number of extracted images in the predetermined plurality of images being displayed. The bar was displayed.

  Further, in the invention according to claim 8, the image processing apparatus further includes a continuous imaging unit that captures a series of continuous shot images and records the images in the recording unit, and the predetermined plurality of images arranged in order by the extraction unit are recorded in the recording unit. Among the plurality of images recorded in the means, the predetermined series of continuous shot images are assumed.

  Further, in the invention of claim 9, an extraction step of extracting a prescribed number of images from a plurality of images recorded in a predetermined order on the recording means, with an extraction range between two of the images, and extraction A display step of displaying the specified number of extracted images side by side on the display screen of the display means, and the extraction range of the specified number of extracted images from the specified number of extracted images displayed side by side on the display screen of the display means A re-extraction step of selecting two images by an image selection operation, changing each image between the two selected images to a new extraction range, and extracting a specified number of images from the new extraction range after the change; It was set as the method including.

  According to a tenth aspect of the present invention, a computer having an image display device provided with a display means for displaying an image is selected from the plurality of images recorded in the recording means in a predetermined order. An extraction means for extracting a prescribed number of images with an extraction range between two images, a display control means for displaying the prescribed number of extracted images extracted by the extraction means side by side on the display screen of the display means, and the extraction By selecting two images by an image selection operation from the specified number of extracted images displayed by the display control means, the image range between the two selected images is extracted. Is changed to a new extraction range, and the program is made to function as an extraction range changing unit that causes the extraction unit to extract a prescribed number of images from the new extraction range.

  In the invention of claim 11, a display means for displaying an image, and a plurality of images of a plurality of frames arranged in order, a predetermined frame range as an extraction range, and the first and last images of the frame range And a predetermined number of representative images having a predetermined frame interval between them, and a predetermined number of representative images extracted by the first extracting means. A first display control unit configured to display the display screen side by side in a first direction; and a prescribed number displayed from the plurality of images side by side on the display screen by the first display control unit. A second extracting means for extracting a specified number of detailed images in which the frame positions between an arbitrary representative image selected by a selection operation among the representative images and another representative image adjacent to the representative image are continuous. This second drawing Second display control means for displaying a prescribed number of detailed images extracted by the means along with the prescribed number of representative images in a second direction different from the first direction on the display screen of the display means; Was provided.

  In the twelfth aspect of the invention, a specified number of representative images displayed on the display screen by the first display control means, and display on the display screen by the second display control means. And a third display control unit that enlarges and displays the image selected by the selection operation from the specified number of detailed images together with the specified number of representative images and the specified number of detailed images on the display screen. It was assumed.

  According to the invention of claim 13, the extraction range of the prescribed number of extracted images by the first extracting means is set to 2 by selecting an image from the prescribed number of extracted images displayed by the display control means. Extraction range changing means for selecting one image and changing each image between the two selected images to a new extraction range and causing the first extraction means to extract a prescribed number of images from the new extraction range Was provided.

  In the fourteenth aspect of the present invention, on the display screen of the display means, a position display bar indicating the frame positions in the plurality of images of the image enlarged and displayed by the third display control means is displayed. The fourth display control means is provided.

  In the fifteenth aspect of the present invention, the first extraction is provided with an imaging unit that images a subject, and an image recording unit that records a plurality of images that are continuous images of the subject captured by the imaging unit. The means extracts the prescribed number of representative images from the plurality of images recorded in the image recording means.

  Further, in the invention of claim 15, a predetermined frame range is extracted from a plurality of images arranged in order, and the leading and trailing images of the frame range are included and predetermined between each of the images. A predetermined number of representative images in which a frame interval is secured, a first step of displaying the extracted predetermined number of representative images side by side in a first direction on the display screen, and the first image from the plurality of images. The frame position between an arbitrary representative image selected by the selection operation from the specified number of representative images displayed side by side in the first direction on the display screen in the step and another representative image adjacent to the representative image A predetermined number of detailed images consecutively extracted, and the extracted predetermined number of detailed images are displayed side by side in a second direction different from the first direction on the display screen together with the predetermined number of representative images. It was set as the method including these processes.

  According to another aspect of the present invention, a computer having an image display device having a display means for displaying an image is extracted from a plurality of images arranged in order as a predetermined frame range. A first extraction means for extracting a specified number of representative images including the top and bottom images of the frame range and having a predetermined frame interval between each of the images, and the first extraction means A first display control means for displaying a prescribed number of representative images side by side in a first direction on the display screen of the display means, and the first display control means from the plurality of images to the first on the display screen. The details of the prescribed number in which the frame positions are continuous between an arbitrary representative image selected by the selection operation and the other representative images adjacent to the representative image among the prescribed number of representative images displayed side by side in the direction the image The second extracting means to be output and the specified number of detailed images extracted by the second extracting means together with the specified number of representative images on the display screen of the display means are different from the first direction. The program is made to function as a second display control unit that displays the images in the two directions.

  According to the present invention, it is possible to easily find an intended image from a plurality of images.

It is a block diagram of the digital camera common to each embodiment of this invention. It is a flowchart which shows operation | movement of the digital camera in 1st Embodiment. It is a flowchart following FIG. It is a figure which shows an example of the search screen displayed by the embodiment. It is the figure which showed the movement of the selection cursor in the same search screen. It is the figure which illustrated the change of the display contents in the search screen. It is the figure which showed the relationship between the search screen and an image expansion screen. It is a flowchart which shows operation | movement of the digital camera in 2nd Embodiment. It is a figure which shows the search screen displayed in the embodiment, and its change. It is a flowchart which shows operation | movement of the digital camera in 3rd Embodiment. It is a figure which shows the search screen displayed in the embodiment, and its change. It is the figure which showed the modification of the position display bar common to each embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing an outline of an electrical configuration of a digital camera 1 common to the embodiments. The digital camera 1 has general functions such as AE (automatic exposure) and AF (autofocus). In addition, the basic mode includes a shooting mode for taking still images and moving images, and a playback mode for playing back still images and moving images recorded in the shooting mode, and the shutter key is pressed in the shooting mode. It has a high-speed continuous shooting function that continuously captures and records still images at high speed (several frames / second).

  In the following description, in the photographing mode which is the basic mode, the focus position and the aperture position of the lens optical system 12 are moved by driving the motor (M) 11. A CCD 13 that is an image sensor is disposed behind the photographing optical axis of the lens optical system 12.

  The CCD 13 forms, for example, an RGB primary color filter, and is driven by a timing generator (TG) 14 and a vertical driver 15 to detect photoelectric signals corresponding to an optical image formed at regular intervals. Output the converted output for one screen.

  The photoelectric conversion output is appropriately gain-adjusted for each RGB primary color component in the state of an analog value signal, sampled and held by a sample hold circuit (S / H) 16, and converted into digital data by an A / D converter 17. After being converted, the color process circuit 18 performs pixel interpolation processing, gamma correction processing, and color processing processing including matrix calculation to generate a digital luminance signal Y and color difference signals Cb, Cr, and DMA (Direct Memory Access). ) Is output to the controller 19.

  The DMA controller 19 once uses the luminance signal Y and the color difference signals Cb and Cr output from the color process circuit 18 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 18 once. And the DMA transfer to the DRAM 21 used as a buffer memory via the DRAM interface (I / F) 20.

  The control unit 22 includes a CPU, a ROM in which various operation programs executed by the CPU are fixedly stored, a RAM used as a work memory, and the like, and controls the entire digital camera 1. In the present embodiment, when the search display mode, which is a lower mode of the playback mode described later, is set in the ROM, the CPU performs the processing described later, thereby allowing the CPU to perform the extraction means, display control means, An operation program for functioning as extraction range changing means is stored.

  After the DMA transfer of the luminance and color difference signals to the DRAM 21 is completed, the control unit 22 reads the luminance and color difference signals from the DRAM 21 via the DRAM interface 20 and writes them to the VRAM 24 via the VRAM controller 23.

  The digital video encoder 25 periodically reads the luminance and color difference signals from the VRAM 24 via the VRAM controller 23, generates a video signal based on these data, and outputs the video signal to the display unit 26.

  The display unit 26 includes a liquid crystal display disposed on the back of the main body (not shown) of the digital camera 1 and a driving circuit thereof, and performs image display based on a video signal from the digital video encoder 25. In the shooting mode, an image based on the image information captured from the VRAM controller 23 at that time is displayed in real time as a through image, thereby functioning as an electronic viewfinder.

  When the through key is displayed on the display unit 26, a trigger signal is generated when the shutter key is operated at a timing at which still image shooting is desired.

  In response to the trigger signal, the control unit 22 cancels the DMA transfer of the luminance and color difference signals for one screen captured from the CCD 13 at that time to the DRAM 21, and again with an aperture value and a shutter speed according to appropriate exposure conditions. The CCD 13 is driven to scan to obtain the start-up and color difference signals for one screen and transfer them to the DRAM 21. Thereafter, this path is stopped, and the recording and storage state is entered.

  In this recording and storage state, the control unit 22 transmits the luminance and color difference signals for one frame written in the DRAM 21 via the DRAM interface 20 to the basic 8 pixels × 8 pixels horizontal for each of Y, Cb, and Cr components. A unit called a block is read out and written to the image processing unit 27. The image processing unit 27 uses ADCT (Adaptive Discrete Cosine Transform) according to the JPEG (Joint Photographic Coding Experts Group) standard and entropy coding. Data compression is performed by a process such as Huffman coding.

  Then, the obtained code data is read out from the image processing unit 27 as a data file of one image, and written in a memory card 28 that is detachably mounted as a recording medium of the digital camera 1.

  In addition, the control unit 22 activates the path from the CCD 13 to the DRAM 21 again with the completion of the compression processing of the luminance and color difference signals for one frame and the writing of all the compressed data to the memory card 28.

  In addition, a key input unit 29, an audio processing unit 30, and a strobe driving unit 31 are connected to the control unit 22.

  The key input unit 29 includes a power key, a shutter key, a mode switch, a menu key, a cross key, a set key, and the like, and signals associated with these key operations are sent directly to the control unit 22. The cross key is a key used for various setting screens displayed on the display unit 26 as necessary, and for directions in the up, down, left, and right directions on the operation screen, and is also used in a search display mode to be described later. .

  The sound processing unit 30 includes a sound source circuit such as a PCM sound source, and digitizes the sound signal input from the microphone unit (MIC) 32 at the time of recording the sound, and a predetermined data file format such as MP3 (MPEG-1 audio layer 3). ) Data compression is performed in accordance with the standard to create an audio data file and send it to the memory card 28. On the other hand, at the time of reproducing the audio, the audio data file sent from the memory card 28 is uncompressed and converted into an analog signal. The speaker unit (SP) 33 provided on the back side of the main body 1 is driven to emit loud sounds.

  The strobe driving unit 31 charges a strobe large-capacity capacitor (not shown) at the time of still image shooting, and then flash-drives the strobe light emitting unit 34 based on the control from the control unit 22.

  When shooting a moving image, recording of the still image data file obtained by compressing the above-described still image data by the image processing unit 27 to the memory card 28 is started when the first shutter key is operated. Thereafter, this is continuously executed at a predetermined frame rate, for example, 30 [frame / second], and when the shutter key is operated for the second time or when a predetermined time limit, for example, 30 seconds elapses, A series of still image data files are collectively set as a motion JPEG data file (AVI file).

  In the playback mode, which is the basic mode, the control unit 22 selectively reads out the image data recorded on the memory card 28, and the image processing unit 27 compresses the data by a procedure that is completely opposite to the procedure of data compression in the shooting mode. The decompressed image data is decompressed, and the decompressed image data is retained in the DRAM 21 via the DRAM interface 20, and the retained content of the DRAM 21 is stored in the VRAM 24 via the VRAM controller 23. The image data is read to generate a video signal, which is reproduced and output by the display unit 26.

  If the selected image data is not a still image but a moving image, playback of the individual still image data constituting the selected moving image file is executed continuously in time, and playback of all the still image data is finished. At that time, the image is reproduced and displayed using only the still image data located at the head until the next reproduction instruction is given.

  Next, an operation according to the present invention in the first embodiment having the above configuration will be described. 2 and 3 are flowcharts showing a processing procedure of the control unit 22 in the digital camera 1 when the search display mode which is a lower mode of the playback mode is set by the user. The search display mode is an operation mode that is provided assuming that a desired image is searched for from among the continuous shot images (continuous images) photographed mainly by the high-speed continuous shooting function described above. May be used to search for a desired image.

  As will be described below, in the search display mode as shown in FIG. 2, when the search display mode is executed, the control unit 22 first captures a series of continuous shot images or single shot images taken by the user. When a desired image group (for example, a series of continuous shot images, that is, a still image of a plurality of frames) is selected from a plurality of stored images that are stored in order, the desired image group (for example, a series of continuous shot images, That is, the display image extraction range for a plurality of frames (still images) and the display image extraction position within the extraction range are initialized (step SA1). In the initialization, the first frame of the continuous shot image to the last frame (all frame range) is set as the extraction range (frame range), and the first frame is set as the extraction position. At this time, the order in which the frames are arranged is the order in which the images were taken, but depending on the situation, the reverse may also be possible. You may comprise so that an image may be arranged in the imaging | photography order. Further, here, the extraction range is selected from a predetermined series of continuous shot images. However, this may not be the case. For example, images taken one by one in a single shot instead of continuous shooting are arranged in the shooting order. The extraction range may be selected from the ones selected, or vice versa.

  Next, three frames of images with the same frame interval (shooting time interval) are extracted from the continuous shot image, and more specifically, the corresponding three frames of still images are stopped. The image data is read from the memory card 28, and the three frames are arranged in the order of shooting on the screen of the display unit 26 and displayed as thumbnails (step SA2). In the present embodiment, the above three-frame images are the prescribed number of extracted images in the present invention.

  Note that the three-frame image includes the first frame and the last frame of the continuous shot image described above, and when extracting them, the frame position of the intermediate image is calculated based on the total number of frames in the continuous shot image. Is done. At that time, if the completely same frame interval cannot be secured, the frame position may be extracted and set at predetermined intervals from the top frame, or the frame position of the intermediate image may be adjusted appropriately. good.

  Further, a position display bar indicating the position of the frame in the continuous image of the three frames is displayed on the same screen (step SA3).

  FIG. 4 is a diagram showing an example of the display screen displayed in steps SA2 and SA3, that is, the search screen G1, and is an example in the case where the total number of frames of the continuous shot image is 20. In the following description, the description will be made on the assumption of this.

  Then, as shown in the figure, in step SA2, the top image 101, the final image 103, and the image 102 located in the middle are extracted and displayed side by side in the horizontal direction. Note that “No. 0”, “No. 10”, and “No. 20” in the figure are the frame numbers of the respective images (hereinafter referred to as display images), that is, the frame positions in the continuous shot image. . In step SA2, a selection cursor 201 for selecting any one or two of the display images 101, 102, 103 is also displayed. Note that the selection cursor 201 at the beginning of the process is in a state where the leftmost display image 101 having the lowest frame number is selected, as shown in FIG.

  Further, the position display bar 104 described above includes a scale bar 104a extending above the display images 101, 102, and 103 of the three frames, and the display images 101, 102, and 103 with the extended area as the entire frame range. Are composed of three pointers 104b indicating the frame positions.

  Subsequently, after displaying the above-described search screen G1, the control unit 22 performs the following processing according to the operation content of the cross key by the user.

  First, if there is an instruction operation in either the left or right direction (YES in step SA4), an arbitrary image is not enlarged and displayed at that point in time as in the beginning of the process, and the selection cursor 201 indicates If it is not located at the end of the direction (both steps SA5 and SA7 are NO), the selection cursor 201 is instructed after changing from the image selection state to the range selection state, and conversely from the range selection state to the image selection state. Move in the direction (step SA8).

  That is, in the present embodiment, as shown in FIG. 5, the selection cursor 201 is an image selection state surrounding any one of the display images 101, 102, and 103 ((a) and (c) in FIG. 5). , (E)) and a range selection state surrounding any two images (states shown in (b) and (d) of the figure) while moving alternately. That is, the user can perform an image selection operation for selecting any one image and a range selection operation for selecting any two adjacent images simply by instructing either the left or right direction.

  Then, after moving the selection cursor 201 in step SA8, the process once returns to step SA4.

  If the determination result in step SA7 is YES and the selection cursor 201 is at the end in the indicated direction as shown in FIGS. 5A and 5B, for example, the continuous shot image is once set. It is determined whether or not the end image (the first frame or the 20th frame at the beginning of the process) in the extraction range for the extraction range is displayed on the search screen G1 (step SA9). When the end image is displayed as in the beginning of the process (YES in step SA9), the process directly returns to step SA4. In this case, for example, the states of FIGS. 5A and 5B are maintained.

  On the other hand, if the determination result in step SA4 described above is NO and there is no instruction operation in the left-right direction, it is continuously checked whether there is an instruction operation in the downward direction or the upward direction. Both are NO), and the process returns to the above-described step SA4.

  If a downward pointing operation is performed (YES in step SA11), it is determined whether or not the selection cursor 201 is in the two-image selection state at that time, and if it is in the two-image selection state (step SA12). YES), the display image extraction range is changed to a frame range having the frame positions of the two display images being selected at both ends (step SA13), and the process returns to step SA2.

  Then, in step SA2, three new frames with equal frame intervals are newly extracted from the extraction range after the change, that is, the extraction range narrower than before, arranged in the order of shooting, and displayed as thumbnails. Accordingly, the position of the pointer 104b of the position display bar 104 is corrected. As a result, the previous search screen G1 is updated to a lower-level search screen G1 in which three new display images 101, 102, 103 with a frame interval narrower than before are arranged.

  FIG. 6 is a diagram showing an example of the display content of the search screen G1 at an arbitrary time point, in which (a) to (c) are the first-layer search screens G1 and (d) to FIG. (F) is the second-layer search screen G1, and (d) to (f) are the third-layer search screen G1. That is, the user operates the search screen G1 in the order of, for example, (a), (d), and (g) by performing a downward pointing operation with the selection cursor 201 in a range selection state surrounding any two images. G1 can be changed.

  Further, when the instruction operation in either the left or right direction is performed while the above-described processing is repeated, the selection cursor 201 is positioned at the end of the instruction direction (YES in step SA7), and the search screen G1 is displayed. If the end image on the pointing direction side in the extraction range for the continuous image is not displayed (NO in step SA9), the extraction position of the display image described above is set as the frame interval between the current display images 101, 102, and 103. After moving in the indicated direction (setting change) by the amount (step SA10), the process returns to step SA2 described above.

  Then, in step SA2, images of three frames whose frame intervals are newly equal from the extracted position after movement, that is, images whose frame positions are shifted by one by the frame interval are extracted and arranged in the order of photographing. While displaying thumbnails, the position of the pointer 104b of the position display bar 104 is corrected accordingly. That is, the display images 101, 102, and 103 are scrolled while maintaining the frame interval on the search screen G1 in the same hierarchy.

  For example, when the display image 103 with the frame number “10” is selected in the state of FIG. 6A during the display of the second-layer search screen G1, the display images 101, 102, and 103 are displayed as shown in FIG. If the display image 103 with the frame number “10” is selected in the state of FIG. 6G during the display of the search screen G1 in the third layer, the display image is displayed. 101, 102 and 103 are scrolled to the state shown in FIG. In FIG. 6, (e) is a state when the right direction operation is performed twice in the state of FIG. 6 (d), and FIG. 6 (h) is a state of the right direction in the state of FIG. This is the state when there are four instruction operations.

  On the other hand, when the selection cursor 201 is in an image selection state surrounding one image when a downward pointing operation is performed (NO in step SA12), the display image selected by the selection cursor 201 is enlarged (step). SA14). At this time, the position display bar 104 described above is also displayed at the same time. That is, when the first-layer search screen G1 is displayed on the display unit 26 as shown in FIG. 7A, the image enlargement screen G2 as shown in FIG. 7B is displayed.

  If there is an instruction operation in either of the left and right directions while the image enlargement screen G2 is displayed (both steps SA4 and SA5 are YES), an image to be enlarged according to the instruction direction is displayed at the frame position. The previous image is changed, or the frame position is changed to the subsequent image (step SA6). That is, when the image enlargement screen G2 of FIG. 7B is displayed, the enlarged display image 301 in the image enlargement screen G2 is switched as shown in FIG. 7C or FIG. That is, frame advance is performed in either direction. Although not shown in the flowchart, in the case where the enlarged display image 301 is an image at the frame position at the end in the pointing direction (here, the first frame or the 20th frame) at the extraction position described above, The process is skipped and the process returns to step SA4.

  Furthermore, if the determination result in step SA15 described above is YES and an upward pointing operation has been performed (YES in step SA15), one of the images is enlarged and displayed, that is, the image enlargement screen G2 Is displayed (YES in step SA16), the process returns to step SA3, and the search screen G1 is displayed according to the extraction range and extraction position set at that time. That is, the search screen G1 of any hierarchy displayed immediately before is displayed.

  Further, when the image enlargement screen G2 is not displayed, that is, when the search screen G1 of any hierarchy is displayed (NO in step SA16), the display image extraction range and extraction position are set to one level higher. After changing to the value used in the search screen G1 (step SA17), the process returns to step SA3. Thereby, the upper layer search screen G1 is displayed. Note that the extraction range and extraction position used in the search screen G1 in the upper layer are, for example, when the search screen G1 is switched from the first layer to the second layer and when the search screen G1 is switched from the second layer to the third layer. It should be memorized in advance.

  As described above, in the search display mode, when searching for a desired image from continuous shot images, the search hierarchy on the search screen G1 is changed from the first layer (FIGS. 6A to 6C) to the second layer ( As shown in FIGS. 6D to 6F and the third layer (FIGS. 6G to 6I), the frame intervals of the display images 101, 102, and 103 are sequentially switched to the lower layer side. Can be narrowed. At the same time, on the search screen G1 of each hierarchy, it is possible to select a frame range from which the display images 101, 102, 103 in the next hierarchy (lower layer) are extracted. Therefore, by narrowing down the range where the desired image is located, the image can be efficiently searched.

  Further, in the search screen G1, the search hierarchy can be switched to the upper layer for each step as necessary, so that a desired image can be searched more efficiently.

  In addition, an enlarged image of any display image 101, 102, 103 can be displayed as necessary, that is, an image enlargement screen G2 can be displayed regardless of the search hierarchy. Therefore, when selecting a frame range on the search screen G1 of each hierarchy, it is possible to select a more appropriate frame range after confirming the details of the display image. Therefore, a desired image can be found more efficiently.

  In the image enlargement screen G2, the enlarged display image can be changed by frame advance if necessary, so that a desired image can be found more efficiently.

  Here, in the above description, the extraction range of the display image initially set in step SA1 is the full frame range of the continuous shot image, but it is not necessarily required to be the full frame range. Moreover, it is good also as a structure which can set the initial extraction range manually or arbitrarily arbitrarily. If it is not the full frame range, the display images 101, 102, 103 can be scrolled on the search screen G1 displayed at the beginning of the process. In this case, the search hierarchy may be switched to the upper layer side until the extraction range reaches the entire frame range.

  In addition, in the image enlargement screen G2, the selection cursor 201 is moved while changing alternately between the image selection state and the range selection state in response to an instruction operation in the left-right direction (FIG. 5). Not limited to this, the selection cursor 201 can be switched between the image selection state and the range selection state in accordance with a predetermined key operation, and when there is an instruction operation in the left-right direction, it is simply moved in either state. It is good.

  In addition, although the images to be displayed as thumbnails on the image enlargement screen G2 are three frames, images having more frames may be displayed. Further, the display form of each image in that case may be arbitrary as long as the shooting order is known. Furthermore, in that case, a set of images that are not adjacent to each other can be selected by a predetermined key operation, and the search hierarchy is switched to the lower layer side with the frame range having these frame positions as both ends as the extraction range. It may be possible.

  Further, the display of the position display bar 104 on the search screen G1 and the image enlargement screen G2 is arbitrary, and it may be displayed only on one of them, or the display may be abolished.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In the present embodiment, a search display mode for displaying the search screen G11 as shown in FIG. 9 different from that in the first embodiment is performed by the control unit 22 performing a process described later on the digital camera 1 shown in FIG. Provided, the CPU of the control unit 22 functions as the first extraction means, the second extraction means, and the first to fourth display control means of the present invention.

  FIG. 8 is a flowchart illustrating a processing procedure of the control unit 22 when the search display mode is set in the present embodiment.

  As will be described below, in the search display mode, the control unit 22 firstly selects five consecutive images (hereinafter referred to as “photographing time intervals”) from consecutive images (a plurality of still images) selected in advance by the user. , Referred to as an index image). More specifically, the still image data of the corresponding five-frame index image is read from the memory card 28 (step SB1). In the present embodiment, the five-frame index image is the specified number of extracted images in the present invention.

  Note that the five-frame index image includes the first frame and the last frame of the continuous shot image. Further, when the completely same frame interval cannot be secured between the index images, the frame interval of one or a plurality of portions is adjusted as appropriate.

  Thereafter, as shown in FIG. 9A, the extracted five-frame index images 401 to 405 are arranged in the horizontal direction in the photographing direction along the upper side of the screen of the display unit 26 and displayed as thumbnails (step SB2).

  Subsequently, four consecutive frames (hereinafter referred to as detailed images) between the first and second images at the display positions in the index images 401 to 405 are extracted (step SB3), and the extracted four frames are detailed. The images 501 to 504 are displayed as thumbnails in the vertical direction in the shooting order below the first index image 401 located on the left side of the display 26 (step SB4).

  Further, the enlarged image 401 a of the first index image 401 is displayed with the upper side in contact with the index images 401 to 405 and the left side in contact with the detailed images 501 to 504, and on the upper side of the index images 401 to 405. A position display bar 104 indicating the frame position of the first index image 401 (enlarged image 401a) in the captured image is displayed (step SB5). That is, unlike the case of the first embodiment, the position display bar 104 of the present embodiment is composed of only a scale bar 104a and a single pointer 104b indicating the frame position of the first index image 401.

  FIG. 9A is a diagram showing an example of the display screen displayed by the above processing, that is, the search screen G11, and is an example in the case where the total number of continuous shot images is 20 frames. In the following description, the description will be made on the assumption of this. Also, “No. 0” to “No. 5”, “No. 10”, “No. 15”, and “No. 20” in the figure are the detailed images 501 to 505 written as the index images 401 to 405, respectively. The frame number, that is, the frame position in the continuous shot image.

  Subsequently, after displaying the above-described search screen G11, the control unit 22 waits for the above-described operation of the cross key by the user and performs the following processing according to the operation content.

  First, if there is an instruction operation in either the left or right direction (YES in step SB6), the display positions of the index images 401 to 405 are moved in the instruction direction by one image in a cyclic manner (step SB7). For example, when there is an instruction in the left direction, as shown in FIG. 9B, the images of the second to fifth index images 402 to 405 in FIG. And the image of the first index image 401 is moved to the fifth position.

  Thereafter, the process returns to step SB5, and the enlarged image 401a is updated to an enlarged image of the frame number image that has newly become the first index image 401. In the above example, an enlarged image of the frame number “No. 5” is displayed as the enlarged image 401a. At the same time, the pointer 104b of the position display bar 104 is moved correspondingly.

  If there is an instruction operation in either the upper or lower direction (YES in step SB8), the first index image 401 and each of the detailed images 501 to 505 are moved by one image in the instruction direction in a cyclic manner. (Step SB9). For example, when there is an upward instruction, as shown in FIG. 9C, the first detailed image 501 in FIG. 9A is moved to the position of the first index image 401, At the same time, the images of the second to fourth detail images 502 to 504 are moved to the first to third, and the image of the first index image 401 is moved to the position of the fourth detail image 504.

  Thereafter, the process returns to step SB5, and the enlarged image 401a is updated to an enlarged image of the frame number image that has newly become the first index image 401. In the above example, an enlarged image of the image having the frame number “No. 1” is displayed as the enlarged image 401a. At the same time, the pointer 104b of the position display bar 104 is moved correspondingly. Thereafter, the processes of SB5 to SB9 described above are repeated.

  From the above, in the search display mode of the present embodiment, when searching for a desired image from the continuous shot images by displaying the search screen G11 described above, first, the frame interval is equal (or substantially equal) 5. The outline of the continuous shot image can be confirmed by the frame index images 401 to 405. Next, a predetermined frame range typified by any index image 401 to 405 is selected by an instruction operation in the left-right direction, and all images in the selected frame range are confirmed by the detailed images 501 to 504 of four frames. Can do. If each image in the selected frame range is sequentially selected by an instruction operation in the vertical direction, the details of the selected image can be confirmed from the enlarged image 401a of each image. Therefore, a desired image can be found efficiently.

  In the present embodiment, the five frames displayed as the initial index images 401 to 405 are images having the same frame interval (shooting time interval) including the first frame and the last frame of the continuous shot image. In other words, although the extraction range is the entire frame range of the continuous shot image, it is not necessarily required to be the entire frame range. That is, as described in the first embodiment, the initial extraction range may be manually or arbitrarily set by the user.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. In the present embodiment, the digital camera 1 shown in FIG. 1 includes a search screen G1 described in the first embodiment, that is, a horizontal search image G1 in which thumbnails are arranged in the horizontal direction (see FIG. 4), A search display mode is provided in which the search screen G11 described in the second embodiment, that is, the search image G11 (see FIG. 9) in the vertical and horizontal directions in which thumbnails are arranged in the vertical and horizontal directions can be switched.

  FIG. 10 is a flowchart illustrating a processing procedure of the control unit 22 when the search display mode is set in the present embodiment.

  Explained below, in the search display mode, the control unit 22 starts displaying the search image G1 in the horizontal direction for the continuous shot image selected in advance by the user. Then, during the display of the search image G1 in the horizontal direction, the display images 101, 102, and 103 described above are appropriately updated according to the user's key operation by performing the same processing as in the first embodiment (Step S1). SC1).

  In the meantime, if the user performs a screen switching operation with a predetermined key (NO in step SC2), the frame interval and the extraction position in the display images 101, 102, and 103 at that time are taken over. In this state, display of the search image G11 in the vertical and horizontal directions is started. For example, as shown in FIG. 11, when a screen switching operation is performed in a state where the horizontal search image G1 is displayed as shown in FIG. Is switched to a vertical search image G11 as shown in FIG.

  Thereafter, during the display of the search image G11 in the vertical and horizontal directions, the index image 401 to 405 and the detailed images 501 to 502 are appropriately displayed according to the user's key operation by performing the same processing as in the second embodiment. Update (step SC3). In the meantime, when there are five or more images to be displayed as index images 401 to 405, for example, when there are seven frames as in the example of FIG. Then, all the seven frames are scrolled and displayed as a display target in a circulating manner.

  If a screen switching operation is performed during display of the search image G11 in the vertical and horizontal directions (YES in step SC4), the process returns to step SC1 to display the search image G1 in the horizontal direction again.

  On the other hand, when there is an image determination operation while displaying the search image G11 in the vertical and horizontal directions (YES in step SC5), the above-described enlarged image 401a at that time is displayed on the full screen as shown in FIG. (Step SC6). Thereafter, until there is an instruction to end full screen display (for example, the same key operation as the image determination operation) (NO in step SC7), the above full screen display is continued, and if there is an end instruction (in step SC7). YES), the process returns to step SC3 at that time, and the search screen G11 in the immediately previous state is displayed. Thereafter, the above process is repeated.

  As described above, according to the present embodiment, similar to the search screen G1 in the first embodiment, the extraction range (simultaneously the frame interval) of the five frames displayed as the index images 401 to 405 on the search screen G11 is as follows. The user can squeeze in steps toward the desired frame position direction as needed. Therefore, as compared with the second embodiment described above, when searching for a desired image from continuous shot images, it can be found more efficiently.

  In the present embodiment, when the horizontal search image G1 is switched to the vertical and horizontal search images G11, the frame interval and the extraction position in the display images 101, 102, and 103 of the horizontal search image G1 are taken over. However, only the frame interval may be taken over.

  In the first to third embodiments described above, display images 101, 102, 103 (FIG. 4) displayed as thumbnails on the search screens G1, 11 (FIG. 4) and an enlarged image 401a (FIG. 4) are displayed. 9) The position display bar 104 indicating the frame position in the continuous shot image of the index images 401 to 405 (FIG. 11) is displayed. Instead, for example, the position display bar 601 shown in FIG. You may display the position display bar 602 shown to the same figure (b).

  That is, FIG. 12 is a diagram showing a modified example of the position display bar. The position display bar 601 in FIG. 12A has a thick scale bar 104a, and in addition to the pointer 104b described above, continuous shooting is performed. This is a configuration in which a line graph 601a indicating a change in volume in an image and a change in intensity of correlation (brightness, difference in motion, etc.) with the image of the previous frame is arranged.

  By using the position display bar 601, in addition to the information about the time axis by the pointer 104 b, reference information such as a change in the shooting environment of a series of images in a continuous shot image and a change in the series of images themselves is provided to the user. be able to. Therefore, it is possible to improve convenience when the user selects a frame range to be searched on the search screens G1 and G11 described above.

  In addition, the position display bar 602 in FIG. 12B further includes an auxiliary line 601b indicating the threshold of volume and correlation strength in addition to the above-described line graph 601a in the scale bar 104a. This is a configuration in which the portion beyond the frame, that is, the frame position (or frame range) A corresponding to the singular point in the continuous shot image is shown in black. When such a position display bar 602 is used, compared with the case where the position display bar 601 is used, the convenience when the user selects a frame range to be searched by the search screens G1 and 11 described above is improved. This can be further improved.

  FIG. 12 shows position display bars 601 and 602 for displaying the above-described line graph 601a and auxiliary line 601b together with the pointer 104b inside the scale bar 104a, but the line graph 601a and auxiliary line 601b are shown in FIG. It may be displayed side by side above and below the position display bar 104 shown in the first to third embodiments.

  Further, in the first to third embodiments described above, it is assumed that the search display mode searches for a desired image from continuous images (continuous images) photographed mainly by the high-speed continuous shooting function described above. However, the search display mode described above searches for a desired image from a moving image in addition to a continuous image. It can also be used in some cases. Even in this case, the user can efficiently search for a desired image by using the search display mode.

  Although the present invention has been described with reference to the case where the present invention is applied to a digital camera, particularly a digital camera having a high-speed continuous shooting function, the present invention is not limited to this and has a function of displaying an image acquired by shooting. If so, the present invention can be applied to other devices such as a PDA having a photographing function, a digital video camera, a camera-equipped mobile phone device, and a personal computer having a general configuration not having a photographing function. .

1 Digital Camera 12 Lens Optical System 13 CCD
22 control unit 26 display unit 27 image processing unit 28 memory card 29 key input unit 101-103 display image 104 position display bar 104a scale bar 104b pointer 201 selection cursor 301 enlarged display image 401-405 index image 401a enlarged image 501-502 details Image 601 Position display bar 601a Line graph 601b Auxiliary line 602 Position display bar

In order to solve the above-mentioned problem, in the invention of claim 1 , a predetermined frame range is extracted from a plurality of images of a plurality of frames arranged in order and display means for displaying an image. A first extracting means for extracting a prescribed number of representative images including a leading image and a trailing image and having a predetermined frame interval between them; and a prescribed number of representative images extracted by the first extracting means. Display means arranged in a first direction on the display screen of the display means, and the plurality of images are arranged and displayed in the first direction on the display screen by the first display control means. A predetermined number of detailed images in which the frame positions between an arbitrary representative image selected by a selection operation and another representative image adjacent to the representative image are continuous are extracted from the specified number of representative images. 2 extraction means A second number of detailed images extracted by the second extraction means are displayed side by side in a second direction different from the first direction on the display screen of the display means together with the predetermined number of representative images. 2 display control means.

According to a second aspect of the present invention, a prescribed number of representative images displayed on the display screen by the first display control means, and a display on the display screen by the second display control means. And a third display control unit that enlarges and displays the image selected by the selection operation from the specified number of detailed images together with the specified number of representative images and the specified number of detailed images on the display screen. It was assumed.

According to a third aspect of the present invention, the extraction range of the specified number of extracted images by the first extracting means is set to 2 by selecting an image from the specified number of extracted images displayed by the display control means. Extraction range changing means for selecting one image and changing each image between the two selected images to a new extraction range and causing the first extraction means to extract a prescribed number of images from the new extraction range Was provided.

According to a fourth aspect of the present invention, a position display bar indicating a frame position in the plurality of images of the image enlarged and displayed by the third display control means is displayed on the display screen of the display means. The fourth display control means is provided.

According to a fifth aspect of the present invention, the first extraction includes an imaging unit that images a subject, and an image recording unit that records a plurality of images that are continuous images of the subject captured by the imaging unit. The means extracts the prescribed number of representative images from the plurality of images recorded in the image recording means.

In the invention of claim 6 , a predetermined frame range is defined as an extraction range from a plurality of images arranged in sequence, and the leading and trailing images of the frame range are included, and a predetermined interval is provided between them. A predetermined number of representative images in which a frame interval is secured, a first step of displaying the extracted predetermined number of representative images side by side in a first direction on the display screen, and the first image from the plurality of images. The frame position between an arbitrary representative image selected by the selection operation from the specified number of representative images displayed side by side in the first direction on the display screen in the step and another representative image adjacent to the representative image A predetermined number of detailed images consecutively extracted, and the extracted predetermined number of detailed images are displayed side by side in a second direction different from the first direction on the display screen together with the predetermined number of representative images. It was set as the method including these processes.

Further, in the invention of claim 7, a computer having an image display device provided with a display means for displaying an image is extracted from a plurality of images arranged in order as a predetermined frame range. A first extraction means for extracting a specified number of representative images including the top and bottom images of the frame range and having a predetermined frame interval between each of the images, and the first extraction means A first display control means for displaying a prescribed number of representative images side by side in a first direction on the display screen of the display means, and the first display control means from the plurality of images to the first on the display screen. The details of the prescribed number in which the frame positions are continuous between an arbitrary representative image selected by the selection operation and the other representative images adjacent to the representative image among the prescribed number of representative images displayed side by side in the direction Extract images And a second number of detailed images extracted by the second extraction unit and a second number of detailed images that are different from the first direction on the display screen of the display unit together with the second number of representative images. The program is made to function as second display control means for displaying the images side by side.

Claims (17)

Recording means for recording a plurality of images in a predetermined order;
Display means for displaying the image;
Extraction means for extracting a prescribed number of images from the plurality of images recorded in the recording means in a predetermined order, with an interval between the two images as an extraction range;
Display control means for displaying a prescribed number of extracted images extracted by the extracting means side by side on the display screen of the display means;
By selecting two images by the image selection operation from the specified number of extracted images displayed by the display control unit, the extraction range of the specified number of extracted images by the extracting unit is determined between the two selected images. Extraction range changing means for changing each image to a new extraction range and causing the extraction means to extract a prescribed number of images from the new extraction range;
An image display device comprising: The image display apparatus according to claim 1, wherein the images extracted by the extraction unit are images at both ends of the extraction range and images extracted for each predetermined number of images from the image at the tip.   The display control means causes the display means to enlarge and display any one extracted image selected by the image selection operation among the prescribed number of extracted images displayed side by side on the display screen in accordance with the enlargement display operation. The image display device according to claim 1, wherein the image display device is an image display device.   The display control means changes the image to be enlarged by frame advance in a predetermined direction every time an image change operation is performed in a state where the extracted image is enlarged and displayed on the display means according to the enlargement display operation. The image display device according to claim 3, wherein:   5. The image display device according to claim 1, wherein an extraction range at the start of operation by the extraction unit is the entire range of the predetermined plurality of images. 6.   The extraction range changing unit changes the extraction range of a specified number of extracted images by the extraction unit in accordance with a predetermined first extraction range changing operation in a stepwise manner, and a predetermined second extraction range. 6. The image display device according to claim 1, wherein the extraction range of the specified number of extracted images by the extraction unit is changed in a stepwise manner in accordance with a changing operation.   The display control means displays on the display screen of the display means a position display bar indicating the position of a specified number of extracted images in the predetermined plurality of images being displayed. The image display apparatus as described in any one of thru | or 6. It further comprises continuous imaging means for taking a series of continuous shot images and recording them in the recording means,
The predetermined plurality of images arranged in order by the extracting unit are the predetermined series of continuous shot images among the plurality of images recorded in the recording unit. The image display device according to one item. An extraction step of extracting a prescribed number of images from a plurality of images recorded in a predetermined order in the recording means, with an interval between two of the images as an extraction range;
A display step of arranging and displaying the extracted number of extracted images arranged on the display screen of the display means;
The extraction range of the specified number of extracted images is selected from the specified number of extracted images displayed side by side on the display screen of the display means, and two images are selected by an image selection operation. And a re-extraction step of changing the image to a new extraction range and extracting a specified number of images from the new extraction range after the change. A computer having an image display device having display means for displaying an image,
Extraction means for extracting a prescribed number of images from the plurality of images recorded in the recording means in a predetermined order, with an interval between the two images as an extraction range;
Display control means for displaying a prescribed number of extracted images extracted by the extracting means side by side on the display screen of the display means;
By selecting two images by the image selection operation from the specified number of extracted images displayed by the display control unit, the extraction range of the specified number of extracted images by the extracting unit is determined between the two selected images. A program that functions as an extraction range changing unit that changes each image to a new extraction range and causes the extraction unit to extract a specified number of images from the new extraction range. Display means for displaying an image;
From a plurality of images arranged in order, a predetermined number of representative images including a predetermined frame range as an extraction range, including the first and last images of the frame range and a predetermined frame interval between them. First extracting means for extracting
First display control means for displaying a prescribed number of representative images extracted by the first extraction means side by side in a first direction on the display screen of the display means;
An arbitrary representative image selected by a selection operation from among the prescribed number of representative images displayed side by side in the first direction on the display screen by the first display control means from the plurality of images and the representative image A second extraction means for extracting a specified number of detailed images in which the frame positions between other representative images adjacent to the image are continuous;
A second number of detailed images extracted by the second extracting means are displayed side by side in a second direction different from the first direction on the display screen of the display means together with the prescribed number of representative images. An image display device comprising: a display control unit.   Select from a specified number of representative images displayed on the display screen by the first display control means and a specified number of detailed images displayed on the display screen by the second display control means 12. The third display control unit according to claim 11, further comprising a third display control unit that enlarges and displays the image selected by the operation on the display screen together with the specified number of representative images and the specified number of detailed images. Image display device.   By selecting two images by the image selection operation from the specified number of extracted images displayed by the display control unit, the two selection ranges of the extraction range of the specified number of extracted images by the first extracting unit are selected. 13. The apparatus according to claim 12, further comprising extraction range changing means for changing each image between images to a new extraction range and causing the first extraction means to extract a prescribed number of images from the new extraction range. The image display device described.   4th display control means which displays on the display screen of the said display means the position display bar which shows the frame position in the said several image of the image enlargedly displayed by the said 3rd display control means was provided. The image display device according to claim 12 or 13. Imaging means for imaging a subject;
Image recording means for recording a plurality of images that are continuous images of the subject imaged by the imaging means,
15. The image display according to claim 11, wherein the first extraction unit extracts the specified number of representative images from the plurality of images recorded in the image recording unit. apparatus. From a plurality of images arranged in order, a predetermined number of representative images including a predetermined frame range as an extraction range, including the first and last images of the frame range and a predetermined frame interval between them. A first step of extracting and displaying the extracted prescribed number of representative images side by side in a first direction on the display screen;
Among the plurality of images, an arbitrary representative image selected by a selection operation from among the prescribed number of representative images displayed side by side in the first direction on the display screen in the first step, and another adjacent to the representative image. A specified number of detailed images having continuous frame positions with respect to the representative image are extracted, and the extracted specified number of detailed images are displayed on the display screen together with the specified number of representative images in a second direction different from the first direction. And a second step of displaying the images side by side in the direction. A computer having an image display device having display means for displaying an image,
From a plurality of images arranged in order, a predetermined number of representative images including a predetermined frame range as an extraction range, including the first and last images of the frame range and a predetermined frame interval between them. First extracting means for extracting
First display control means for displaying a prescribed number of representative images extracted by the first extraction means side by side in a first direction on the display screen of the display means;
An arbitrary representative image selected by a selection operation from among the prescribed number of representative images displayed side by side in the first direction on the display screen by the first display control means from the plurality of images and the representative image A second extraction means for extracting a specified number of detailed images in which the frame positions between other representative images adjacent to the image are continuous;
A second number of detailed images extracted by the second extracting means are displayed side by side in a second direction different from the first direction on the display screen of the display means together with the prescribed number of representative images. Program that functions as a display control means.

Images