JP2014175716A - Image processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability on retrieval of main image data by referring to thumbnail image data.SOLUTION: When a shutter button 30sh is operated in a camera mode, a CPU 28 generates main image data of one frame showing an imaged scene on the basis of output of an imaging device 16; and generates thumbnail image data of 5 frames, each of which shows part of the imaged scene, on the main image data. The generated main image data of one frame and thumbnail image data of 5 frames are stored in a single image file. When a reproduction mode is selected, the CPU 28 performs multi-display of a thumbnail image of 9 frames on an LCD monitor 38 in order to support retrieval of the main image data.

Description

  The present invention relates to an image processing apparatus, and more particularly to an image processing apparatus having a function of creating a heading image corresponding to a main image.

  An example of this type of device is disclosed in Patent Document 1. According to this background art, a plurality of main images forming a single reproduction image are stored in a common image file. Further, a plurality of thumbnail images are created based on the plurality of main images, and an integrated thumbnail image is created based on the plurality of thumbnail images. The integrated thumbnail image has the same angle of view as that of the reproduced image, and is additionally stored in an image file in which the main image of the creation source is stored.

JP 2010-81589 A

  However, since the angle of view of the integrated thumbnail image is the same as the angle of view of the reproduced image, it is difficult to recognize the details of the reproduced image from the integrated thumbnail image. is there.

  Therefore, a main object of the present invention is to provide an image processing apparatus capable of enhancing the operability related to searching for a main image with reference to a heading image.

  An image processing apparatus according to the present invention (10: reference numeral corresponding to the embodiment; hereinafter the same) creates a main image representing a first imaging scene having a first angle of view based on the output of the imaging means (16). 1 creation means (S15), a second creation means for creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the processing of the first creation means. Creating means (S17), assigning means (S19) for assigning one or more headline images created by the second creating means to the main image created by the first creating means, and a main image based on the assignment result of the assigning means Replaying means (S31 to S43) for replaying at least one of one or more heading images created by the second creating means to support the search of

  Preferably, the second creation means is a cut-out means (S21 to S23, S27 to S29) for cutting out one or more partial images from one or more partial areas on the main image created by the first creation means, And conversion means (S25) for converting one or more partial images cut out by the cut-out means into one or more heading images.

  More preferably, a search means (S71) for searching for a specific object image from the main image created by the first creation means is further provided, and the second creation means is 1 or 2 in different ways depending on the search result of the search means. It further includes definition means (S77) for defining the above partial areas.

  More preferably, the specific object image corresponds to a human or animal face image.

  Preferably, receiving means (S45) for accepting a selection operation for selecting a desired headline image in relation to the processing of the reproduction means, and a main image corresponding to the headline image selected by the selection operation based on the assignment result of the assignment means Identification means (S47 to S51) is further provided.

  More preferably, the reproducing means includes heading image display means (S33 to S35) for displaying at least one of one or more heading images on the monitor screen (38), and the specifying means is the heading image selected by the selection operation. Main image display means (S51) for displaying a main image corresponding to the above on the monitor screen.

  More preferably, the reproduction means further includes scroll means (S39) for scrolling the display target of the headline image display means in response to the scroll instruction.

  An image processing program according to the present invention creates a first image representing a first imaging scene having a first angle of view on a processor (28) of an image processing device (10) based on an output of an imaging means (16). Creation step (S15), a second creation for creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the processing of the first creation step A step (S17), an assignment step (S19) for assigning one or more headline images created in the second creation step to a main image created in the first creation step, and a main image based on the assignment result of the assignment step An image processing program for executing a reproduction step (S31 to S43) for reproducing at least one of one or more headline images created by the second creation step to support the search. It is.

  The image processing method according to the present invention is an image processing method executed by the image processing device (10), and based on the output of the imaging means (16), a main image representing a first imaging scene having a first angle of view. First creation step (S15) for creating, creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the processing of the first creation step A second creation step (S17), an assignment step (S19) for assigning one or more headline images created in the second creation step to the main image created in the first creation step, and an assignment result of the assignment step A playback step (S31 to S43) for playing back at least one of one or more headline images created by the second creation step to support the search of the main image based thereon.

  An external control program according to the present invention is an external control program supplied to an image processing apparatus (10) including a processor (28) that executes processing according to an internal control program stored in a memory (46). A first creation step (S15) for creating a main image representing a first imaging scene having an angle based on the output of the imaging means (16), and a second imaging scene having a second angle of view smaller than the first angle of view. A second creation step (S17) for creating one or more headline images represented by each in relation to the processing of the first creation step, and the first creation of one or more headline images created by the second creation step An assignment step (S19) to be assigned to the main image created by the step, and one or more steps created by the second creation step to support the search of the main image based on the assignment result of the assignment step Is an external control program for causing a processor to execute a reproduction step (S31 to S43) for reproducing at least one of two or more headline images in cooperation with the internal control program.

  An image processing apparatus (10) according to the present invention executes a process according to a fetching means (48) for fetching an external control program, and an external control program fetched by the fetching means and an internal control program stored in a memory (46). An image processing apparatus including a processor (28), wherein an external control program creates a main image representing a first imaging scene having a first angle of view based on an output of an imaging means (16) ( S15), a second creation step (S17) for creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in association with the process of the first creation step (S17). ), An assigning step (S19) for assigning one or more headline images created in the second creating step to the main image created in the first creating step, and an assigning step In cooperation with the internal control program, the reproduction step (S31 to S43) for reproducing at least one of one or more headline images created by the second creation step to support the search of the main image based on the assignment result of the group Corresponds to a program to be executed.

  The image processing apparatus according to the present invention includes a first creating means (S15) for creating a main image representing an imaging scene based on an output of the imaging means (16), and one or more specific objects appearing in the imaging scene are emphasized. Second creation means (S85 to S99) for creating one or two or more headline images related to the processing of the first creation means, and one or more headline images created by the second creation means are first Assignment means (S19) assigned to the main image created by the creation means, and at least one of one or more headline images created by the second creation means to support the search of the main image based on the assignment result of the assignment means Reproduction means (S31 to S43).

  Preferably, search means (S81) for searching for a specific object image from the main image created by the first creation means is further provided, and the second creation means executes enhancement processing in a different manner depending on the search result of the search means. Further includes an enhancing means (S85, S93).

  According to the present invention, the main image represents the first imaging scene having the first angle of view, while the heading image assigned to the main image represents the second imaging scene having the second angle of view smaller than the first angle of view. . The headline image is reproduced to assist the search for the main image. This improves the operability related to the search for the main image with reference to the heading image.

  According to the present invention, the main image corresponds to an image representing a captured scene, and the heading image assigned to the main image corresponds to an image in which a specific object appearing in the captured scene is emphasized. The headline image is reproduced to assist the search for the main image. This improves the operability related to the search for the main image with reference to the heading image.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

(A) is a block diagram showing a basic configuration of one embodiment of the present invention, and (B) is a block diagram showing a basic configuration of another embodiment of the present invention. It is a block diagram which shows the structure of one Example of this invention. FIG. 3 is an illustrative view showing one example of a mapping state of an SDRAM applied to the embodiment in FIG. 2; It is an illustration figure which shows an example of the allocation state of the evaluation area in an imaging surface. It is an illustration figure which shows an example of the allocation state of the cut-out area | region in a main image. FIG. 3 is an illustrative view showing one example of a structure of an image file created by the embodiment in FIG. 2; (A) is an illustrative view showing an example of main image data, and (B) is an illustrative view showing an example of cut-out image data. (A) is an illustrative view showing another example of main image data, and (B) is an illustrative view showing another example of cut-out image data. It is an illustration figure which shows an example of the mapping state of the thumbnail image data expand | deployed by the thumbnail area. It is an illustration figure which shows an example of the thumbnail image multi-displayed on the monitor screen. It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 2 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of operation | movement of CPU applied to another Example. It is a flowchart which shows a part of operation | movement of CPU applied to another Example. It is a block diagram which shows the structure of the other Example of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
[Basic configuration 1A]

  Referring to FIG. 1A, the image processing apparatus of this embodiment is basically configured as follows. The first creation means 1a creates a main image representing the first imaging scene having the first angle of view based on the output of the imaging means 5a. The second creating means 2a creates one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in association with the processing of the first creating means 1a. The assigning unit 3a assigns one or more headline images created by the second creating unit 2a to the main image created by the first creating unit 1a. The reproducing unit 4a reproduces at least one of one or more headline images created by the second creating unit 2a so as to support the search of the main image based on the assignment result of the assigning unit 3a.

The main image represents a first imaging scene having a first angle of view, while the heading image assigned to the main image represents a second imaging scene having a second angle of view smaller than the first angle of view. The headline image is reproduced to assist the search for the main image. This improves the operability related to the search for the main image with reference to the heading image.
[Basic configuration 1B]

  Referring to FIG. 1B, an image processing apparatus according to another embodiment is basically configured as follows. The first creation means 1b creates a main image representing an imaging scene based on the output of the imaging means 5b. The second creating means 2b creates one or more headline images in which one or more specific objects appearing in the imaging scene are emphasized in relation to the processing of the first creating means 1b. The assigning unit 3b assigns one or more headline images created by the second creating unit 2b to the main image created by the first creating unit 1b. The reproducing unit 4b reproduces at least one of one or more headline images created by the second creating unit 2b so as to support the search of the main image based on the assignment result of the assigning unit 3b.

The main image corresponds to an image representing a captured scene, and the heading image assigned to the main image corresponds to an image in which a specific object appearing in the captured scene is emphasized. The headline image is reproduced to assist the search for the main image. This improves the operability related to the search for the main image with reference to the heading image.
[Example]

  Referring to FIG. 2, the digital camera 10 of this embodiment includes a focus lens 12, an aperture unit 14, and an imaging device 16 that are driven by a lens driver 18, an aperture driver 20, and a sensor driver 22, respectively. The optical image that has passed through the focus lens 12 and the aperture unit 14 is irradiated onto an imaging surface provided in the imaging device 16, and charges corresponding to the irradiated optical image are generated by photoelectric conversion.

  When the camera mode is selected by the mode switch 30md provided in the key input device 30, the CPU 28 instructs the sensor driver 22 and the camera processing circuit 24 to execute the moving image capturing process, and executes the moving image display process to the LCD driver 36. To order.

  In response to a vertical synchronization signal Vsync periodically generated from an SG (Signal Generator) (not shown), the sensor driver 22 exposes the imaging surface of the imaging device 16 and charges generated on the imaging surface in a raster scanning manner. read out. From the imaging device 16, raw image data based on the read charges is periodically output.

  The camera processing circuit 24 performs a series of processes of color separation, white balance adjustment, and YUV conversion on the raw image data output from the imaging device 16, and outputs the YUV image data generated thereby through the memory control circuit 32 to the SDRAM 34. Is written in the moving image area 34a (see FIG. 3).

  The LCD driver 36 repeatedly reads out the image data thus written from the moving image area 34a through the memory control circuit 32, and drives the LCD monitor 38 based on the read image data. As a result, a moving image (through image) representing the imaging scene is displayed on the LCD monitor 38.

  With reference to FIG. 4, an evaluation area EVA is allocated to the imaging surface of the imaging device 16. The evaluation area EVA is divided into 16 in each of the horizontal direction and the vertical direction, and 256 divided areas form the evaluation area EVA. In addition to the above-described processing, the camera processing circuit 24 shown in FIG. 2 executes simple Y conversion processing that simply converts raw image data into Y data.

  The AE / AF evaluation circuit 26 integrates Y data belonging to the evaluation area EVA among the Y data generated by the camera processing circuit 24 every time the vertical synchronization signal Vsync is generated. As a result, 256 integral values, that is, 256 AE evaluation values, are output from the AE / AF evaluation circuit 26 in response to the vertical synchronization signal Vsync.

  The AE / AF evaluation circuit 26 also integrates the high-frequency component of Y data belonging to the evaluation area EVA among the Y data generated by the camera processing circuit 24 every time the vertical synchronization signal Vsync is generated. As a result, 256 integral values, that is, 256 AF evaluation values, are output from the AE / AF evaluation circuit 26 in response to the vertical synchronization signal Vsync.

  When the shutter button 30sh provided in the key input device 30 is in a non-operating state, the CPU 28 executes the simple AE process based on the 256 AE evaluation values output from the AE / AF evaluation circuit 26, and sets the appropriate EV. Calculate the value. The aperture amount and exposure time that define the calculated appropriate EV value are set in the aperture driver 20 and the sensor driver 22, whereby the brightness of the through image is roughly adjusted.

  When the shutter button 30 sh is half-pressed, the CPU 28 executes a strict AE process based on the 256 AE evaluation values output from the AE / AF evaluation circuit 26. As a result, the optimum EV value is calculated, and the aperture amount and the exposure time that define the calculated optimum EV value are also set in the aperture driver 20 and the sensor driver 22. As a result, the brightness of the through image is adjusted to the optimum value.

  The CPU 28 also executes AF processing based on the 256 AF evaluation values output from the AE / AF evaluation circuit 26. The focus lens 12 is moved in the optical axis direction by the lens driver 18 in order to search for a focal point, and is arranged at the focal point found by this. As a result, the sharpness of the through image is improved.

  When the shutter button 30sh is fully pressed, the CPU 28 executes the still image capturing process and the thumbnail creating process by itself and instructs the memory I / F 42 to execute the recording process. One frame of image data representing the scene at the time when the shutter button 30sh is fully pressed, that is, main image data, is saved from the moving image area 34a to the recorded image area 34b (see FIG. 4) by the still image capturing process.

  Referring to FIG. 5, five cutout areas having a common size are assigned to main image data. The first cut-out area is arranged at the upper left of the main image data, the second cut-out area is arranged at the upper right of the main image data, the third cut-out area is arranged at the center of the main image data, and the fourth cut-out area Is arranged at the lower left of the main image data, and the fifth cutout area is arranged at the lower right of the main image data. Therefore, the angle of view of a part of the imaging scene corresponding to each cut-out area is smaller than the angle of view of the imaging scene corresponding to the main image.

  In the thumbnail creation process, partial image data of a total of 5 frames is cut out from these cut-out areas, and the resolution of the partial image data of each cut-out frame is reduced. The five-frame thumbnail image data created in this way is stored in the thumbnail area 34d.

  When the main image data represents the scene shown in FIG. 7A, the 5-frame thumbnail image data represents the scene shown in FIG. When the main image data represents the scene shown in FIG. 8A, the 5-frame thumbnail image data represents the scene shown in FIG.

  The memory I / F 42 reads out one frame of main image data stored in the recording image area 34b and five frames of thumbnail image data stored in the thumbnail area 34d through the memory control circuit 30, and reads the read image data. The stored image file is recorded on the recording medium 46. The thumbnail image data is embedded in the file header, and the image file is created as shown in FIG. Accordingly, the 5-frame thumbnail image data is assigned to the main image data of the creation source in the image file.

  When the playback mode is selected by the mode switch 30md, the CPU 28 commands the corresponding command to the memory I / F 42 in order to expand the 60-frame thumbnail image data in the thumbnail area 34d.

  The memory I / F 42 reads thumbnail image data of a total of 60 frames from 12 image files retroactive to the latest image file stored in the recording medium 44, and reads the read thumbnail image data into the thumbnail area through the memory control circuit 32. Write to 34d. The thumbnail image data is stored in the thumbnail area 34d in the manner shown in FIG.

  Subsequently, the CPU 28 sets the display area for the latest nine frames of thumbnail image data as the thumbnail area 34d as shown in FIG. 9, and instructs the LCD monitor 36 to start displaying thumbnail images.

  The LCD driver 36 reads out nine frames of thumbnail image data belonging to the display area from the thumbnail area 34d through the memory control circuit 30, and drives the LCD monitor 40 based on the read thumbnail image data. As a result, 9-frame thumbnail images are displayed in multiple on the LCD monitor 40.

  The image file containing the main image data shown in FIG. 8A and the thumbnail image data shown in FIG. 8B is the latest image file. The main image data shown in FIG. 9A and the image file shown in FIG. When the image file containing the thumbnail image data shown is the next new image file, 9-frame thumbnail images are displayed in multiple on the LCD monitor 40 in the manner shown in FIG.

  The touch sensor 40 detects a touch on the LCD monitor 38 and gives a detection result to the CPU 28. In the detection result, position information indicating the touch position and mode information indicating whether the touch mode is “flick” or “tap” are described. If the touch mode is “flick”, direction information indicating the flick direction is added to the detection result.

  When the detection result given from the touch sensor 40 indicates a vertical flick operation in a state where the thumbnail images are multi-displayed, the CPU 28 considers that the scroll operation has been performed and scrolls the display area in the vertical direction. As a result, the thumbnail images displayed in multiple on the LCD monitor 40 are also scrolled.

  When the display area reaches the end of the thumbnail image data expanded in the thumbnail area 34d, the CPU 28 issues a corresponding command to the memory I / F 42 to expand the unexpanded 15-frame thumbnail image data in the thumbnail area 34d. To do.

  The memory I / F 42 detects three image files retroactive from the image file containing the thumbnail images displayed at the lower right of the monitor screen from the recording medium 44, and a total of 15 thumbnail images from the detected image files. The data is read, and the read thumbnail image data is written into the thumbnail area 34d through the memory control circuit 32.

  The thumbnail area 34d forms a so-called ring buffer. When the write destination reaches the end address of the thumbnail area 34d, the start address of the thumbnail area 34d is designated as the write destination.

  When the detection result given from the touch sensor 40 indicates a tap operation on any thumbnail image, the CPU 28 considers that an image selection operation has been performed, designates an image file containing the tapped thumbnail image, and designates the designated image. The memory I / F 44 is instructed to reproduce the main image data stored in the file. The memory I / F 44 reads the main image data stored in the designated image file, and writes the read main image data into the reproduction image area 34 c of the SDRAM 34 through the memory control circuit 30.

  Subsequently, the CPU 28 instructs the LCD driver 36 to start displaying the main image. The LCD driver 36 reads the main image data stored in the reproduction image area 34c through the memory control circuit 30, and drives the LCD monitor 40 based on the read image data. As a result, the main image is displayed on the LCD monitor 40 in place of the multi-displayed thumbnail image.

  Therefore, when any one of the preceding five frames of thumbnail images shown in FIG. 10 is tapped, the main image shown in FIG. When any one of the subsequent four frames of the same nine-frame thumbnail images is tapped, the main image shown in FIG. 9A is displayed on the LCD monitor 40 instead.

  When the detection result given from the touch sensor 40 in the state where the main image is displayed indicates a horizontal flick operation, the CPU 28 considers that the main image update operation has been performed, and the previous image recorded in the recording medium 46. The file or the next image file is designated, and the memory I / F 44 is instructed to reproduce the main image data stored in the designated image file. As a result, the main image displayed on the LCD monitor 40 is updated to the main image of the previous frame or the next frame.

  If at least a part of the 5-frame thumbnail image data corresponding to the main image displayed on the LCD monitor 40 has not been developed in the thumbnail area 34d, the CPU 28 develops the unexpanded thumbnail image data in the memory I. / F42 is commanded. The memory I / F 42 reads unexpanded thumbnail image data from the image file containing the main image being displayed, and writes the read thumbnail image data to the thumbnail area 34d through the memory control circuit 32.

  When the detection result given from the touch sensor 40 in the state where the main image is displayed indicates two consecutive tap operations, the CPU 28 considers that the thumbnail display operation has been performed and sets the display area. The display area is set in the thumbnail area 34d for 9-frame thumbnail image data including thumbnail image data corresponding to the main image being displayed. When the setting of the display area is completed, the CPU 28 instructs the LCD monitor 36 to start displaying thumbnail images. As a result, 9-frame thumbnail images are displayed in a multi-display on the LCD monitor 40 instead of the main image.

  Therefore, if the tap operation is performed twice in succession while the main image shown in FIG. 8A is displayed, the nine-frame thumbnail image shown in FIG.

  The CPU 28 executes a plurality of tasks including the imaging task shown in FIGS. 11 to 12 and the reproduction task shown in FIGS. 13 to 14 in parallel under the control of the multitask OS. Note that control programs corresponding to these tasks are stored in the flash memory 48.

  Referring to FIG. 11, in step S1, a moving image capturing process is started, and in step S3, a moving image display process is started. As a result, YUV format image data representing the imaged scene is repeatedly output from the camera processing circuit 24, and a through image based on the image data is displayed on the LCD monitor 40 by the LCD driver 36. In step S5, it is determined whether or not the shutter button 30sh is half-pressed, and the simple AE process is repeated in step S7 as long as the determination result is NO. As a result, the brightness of the through image is roughly adjusted.

  When the determination result in step S5 is updated from NO to YES, a strict AE process and an AF process are executed in step S9. As a result, the brightness and sharpness of the through image are adjusted to optimum values. In step S11, it is determined whether or not the shutter button 30sh has been fully pressed. In step S13, it is determined whether or not the operation of the shutter button 30sh has been released. If the determination result of step S13 is YES, it will return to step S5, and if the determination result of step S11 is YES, it will progress to step S15.

  In step S15, a still image capturing process is executed, and in step S17, a thumbnail creating process is executed. One frame of image data representing the scene at the time when the shutter button 30sh is fully pressed, that is, main image data, is saved from the moving image area 34a to the recorded image area 34b by still image capturing processing. In the thumbnail creation process, 5-frame thumbnail image data is created based on the saved main image data. The created thumbnail image data is stored in the thumbnail area 34d.

  In step S19, the memory I / F 42 is commanded to execute the recording process. The memory I / F 42 reads out one frame of main image data stored in the recording image area 34c and five frames of thumbnail image data stored in the thumbnail area 34d through the memory control circuit 30, and reads the read image data. The stored image file is recorded on the recording medium 46. When the process of step S19 is completed, the process returns to step S5.

  The thumbnail creation process in step S17 is executed according to a subroutine shown in FIG. First, the variable K is set to “1” in step S21. In step S23, partial image data belonging to the Kth cutout area assigned to the main image data is cut out. In step S25, thumbnail image data is created by reducing the resolution of the cut out partial image data. The created thumbnail image data is stored in the thumbnail area 34d. In step S27, it is determined whether or not the variable K has reached “5”. If the determination result is NO, the variable K is incremented in step S29 and then the process returns to step S23. If the determination result is YES, the process returns to the upper layer routine.

  Referring to FIG. 13, in step S31, a corresponding command is commanded to memory I / F 42 in order to develop 60-frame thumbnail image data in thumbnail area 34d. The memory I / F 42 reads thumbnail image data of a total of 60 frames from 12 image files retroactive to the latest image file stored in the recording medium 44, and reads the read thumbnail image data into the thumbnail area through the memory control circuit 32. Write to 34d.

  In step S33, the display area for the latest nine frames of thumbnail image data is set in the thumbnail area 34d. In step S35, the LCD monitor 36 is instructed to start displaying thumbnail images. The LCD driver 36 reads out nine frames of thumbnail image data belonging to the display area from the thumbnail area 34d through the memory control circuit 30, and drives the LCD monitor 40 based on the read thumbnail image data. As a result, 9-frame thumbnail images are displayed in multiple on the LCD monitor 40.

  In step S37, it is determined whether or not a scroll operation (= flick operation in the vertical direction) has been performed. In step S45, it is determined whether or not an image selection operation (= tap operation on any thumbnail image) has been performed. Any discrimination process is executed based on the output of the touch sensor 40.

  If the decision result in the step S37 is YES, the display area is scrolled in a step S39. As a result, the thumbnail images displayed in multiple on the LCD monitor 40 are also scrolled. In step S41, it is determined whether or not the display area has reached the end of the thumbnail image data developed in the thumbnail area 34d. If a determination result is NO, it will return to step S37 as it is, and if a determination result is YES, it will return to step S37 through the process of step S43.

  In step S43, a corresponding command is commanded to the memory I / F 42 in order to develop the unexpanded 15-frame thumbnail image data in the thumbnail area 34d. The memory I / F 42 detects from the recording medium 44 three image files that are further retroactive from the image file subjected to the processing in step S31 or the previous step S43, and a total of 15 thumbnail images from the detected image files. The data is read, and the read thumbnail image data is written into the thumbnail area 34d through the memory control circuit 32.

  If the decision result in the step S45 is YES, an image file containing the tapped thumbnail image is designated in a step S47, and the reproduction of the main image data contained in the designated image file is instructed to the memory I / F 44 in a step S49. To do. The memory I / F 44 reads the main image data stored in the designated image file, and writes the read main image data into the reproduction image area 34 c of the SDRAM 34 through the memory control circuit 30.

  In step S51, the LCD driver 36 is instructed to start main image display. The LCD driver 36 reads the main image data stored in the reproduction image area 34c through the memory control circuit 30, and drives the LCD monitor 40 based on the read image data. As a result, the main image is displayed on the LCD monitor 40 in place of the multi-displayed thumbnail image.

  In step S53, it is determined whether or not a main image update operation (= horizontal flick operation) has been performed. In step S63, it is determined whether or not a thumbnail display operation (= two consecutive tap operations) has been performed. This discrimination process is also executed based on the output of the touch sensor 40.

  If the decision result in the step S53 is YES, the previous image file or the next image file recorded on the recording medium 46 is designated in a step S55, and the main image data stored in the designated image file is reproduced in the memory I in a step S57. / F44 is commanded. As a result, the main image displayed on the LCD monitor 40 is updated to the main image of the previous frame or the next frame. In step S59, it is determined whether or not the 5-frame thumbnail image data stored in the designated image file has been developed in the thumbnail area 34d. If a determination result is YES, it will return to Step S53, and if a determination result is NO, it will progress to Step S61.

  In step S61, the memory I / F 42 is instructed to expand the unexpanded thumbnail image data among the five thumbnail image data stored in the designated image file. The memory I / F 42 reads desired thumbnail image data from the designated image file, and writes the read thumbnail image data into the thumbnail area 34d through the memory control circuit 32. When the process of step S61 is completed, the process returns to step S53.

  If the determination result of step S63 is YES, a display area is set in step S65. The display area is set in the thumbnail area 34d so as to target 9 frames of thumbnail image data including 5 frames of thumbnail image data stored in the designated image file. When the setting of the display area is completed, the process advances to step S67 to instruct the LCD monitor 36 to start displaying the thumbnail image. As a result, 9-frame thumbnail images are displayed in a multi-display on the LCD monitor 40 instead of the main image. When the process of step S67 is completed, the process returns to step S37.

  As can be understood from the above description, when the shutter button 30sh is operated in the camera mode, the CPU 28 creates one frame of main image data representing an imaging scene based on the output of the imaging device 16 (S15), Five-frame thumbnail image data each representing a part of the imaging scene is created based on the main image data (S17). The 1-frame main image data and 5-frame thumbnail image data created in this way are stored in a common image file (S19). The 5-frame thumbnail image data is thus assigned to the main image data of the creation source. When the playback mode is selected, the CPU 28 multi-displays nine-frame thumbnail images on the LCD monitor 38 to support the search for main image data (S31 to S43).

  As described above, the main image data represents the entire captured scene, while the thumbnail image data assigned to the main image data represents a part of the captured scene. The thumbnail image data is reproduced in order to support searching for main image data. As a result, the operability related to the search for the main image data with reference to the thumbnail image data is improved.

  In this embodiment, five cutout areas are fixedly assigned to the main image data. However, a face image of a person or animal may be searched from the main image data, and the cutout area may be assigned to the main image data in a different manner depending on the search result. In this case, the subroutine shown in FIG. 12 is preferably partially modified to the subroutine shown in FIG.

  First, in step S71, a face image of a person or animal is searched from the main image data stored in the recorded image area 34b. In step S73, it is determined whether or not a face image has been detected. If the determination result is YES, the process proceeds directly to step S21, and if the determination result is NO, the process proceeds to step S21 through steps S75 to S77. In step S75, a main face image is determined from one or more detected face images. In step S77, a third cutout region is set at a position covering the determined main face image. This further improves the operability related to the search for the main image data with reference to the thumbnail image data.

  In this embodiment, five cutout areas are assigned to the main image data, and five-frame thumbnail image data representing objects belonging to these cutout areas is created. However, the main image data may be processed so that a specific object appearing in the imaging scene is emphasized, and thumbnail image data may be generated based on the processed image data. In this case, preferably, a subroutine shown in FIG. 16 is executed instead of the subroutine shown in FIG.

  First, in step S81, a face image of a person or animal is searched from the main image data stored in the recorded image area 34b. In step S83, it is determined whether or not a face image has been detected. If the determination result is NO, the process proceeds to step S85, and if the determination result is YES, the process proceeds to step S89.

  In step S85, the object existing in the center of the imaging scene is regarded as a specific object, and the main image data is processed so that the central area of the imaging scene is enlarged. In step S87, thumbnail image data is created based on the processed image data, and then the process returns to the upper layer routine. Therefore, unlike the above-described embodiment, when a face image is not detected, thumbnail image data of a single frame is assigned to main image data.

  In step S89, the number of detected face images is set as the maximum value Kmax, and in step S91, the variable K is set to “1”. In step S93, the main image data is processed so that the area of the Kth face image is enlarged, and in step S95, thumbnail image data is created based on the processed image data. That is, when a face image is detected, the face of a person is regarded as a specific object, and thumbnail image data is created so that the face image is emphasized. In step S97, it is determined whether or not the variable K has reached the maximum value Kmax. If the determination result is NO, the variable K is incremented in step S99 and the process returns to step S93. Return to the hierarchy routine.

  This further improves the operability related to the search for the main image data with reference to the thumbnail image data. If the main image data is image data having distortion such as an omnidirectional image, preferably a process for correcting the distortion is additionally executed in step S85 or S93.

  In this embodiment, the multitask OS and control programs corresponding to a plurality of tasks executed thereby are stored in the flash memory 48 in advance. However, as shown in FIG. 17, a communication I / F 48 is provided in the digital camera 10, and some control programs are prepared as internal control programs in the flash memory 46 from the beginning, while some other control programs are prepared as external control programs. May be acquired from an external server. In this case, the above-described operation is realized by cooperation of the internal control program and the external control program.

  In this embodiment, the process executed by the CPU 28 is divided into a plurality of tasks as described above. However, each task may be further divided into a plurality of small tasks, and a part of the divided plurality of small tasks may be integrated with other tasks. Further, when each task is divided into a plurality of small tasks, all or part of the tasks may be acquired from an external server.

DESCRIPTION OF SYMBOLS 10 ... Digital camera 16 ... Image sensor 24 ... Camera processing circuit 28 ... CPU
36 ... LCD driver 38 ... LCD monitor

Claims (13)

First creation means for creating a main image representing a first imaging scene having a first angle of view based on an output of the imaging means;
Second creation means for creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the processing of the first creation means;
An assignment unit that assigns one or more headline images created by the second creation unit to a main image created by the first creation unit, and a search for a main image based on an assignment result of the assignment unit An image processing apparatus, comprising: reproducing means for reproducing at least one of one or more headline images created by the second creating means.   The second creation means includes a cutout means for cutting out one or more partial images from one or more partial areas on the main image created by the first creation means, and 1 or 2 cut out by the cutout means The image processing apparatus according to claim 1, further comprising conversion means for converting two or more partial images into the one or more heading images. Search means for searching for a specific object image from the main image created by the first creation means,
The image processing apparatus according to claim 2, wherein the second creation unit further includes a definition unit that defines the one or more partial areas in different manners according to a search result of the search unit.   The image processing apparatus according to claim 3, wherein the specific object image corresponds to a face image of a person or an animal. A receiving unit that accepts a selection operation for selecting a desired heading image in association with the processing of the reproduction unit; and a main image corresponding to the heading image selected by the selection operation is specified based on an allocation result of the allocation unit The image processing apparatus according to claim 1, further comprising a specifying unit. The reproduction means includes heading image display means for displaying at least one of the one or more heading images on a monitor screen,
The image processing apparatus according to claim 5, wherein the specifying unit includes a main image display unit that displays a main image corresponding to the heading image selected by the selection operation on the monitor screen.   The image processing apparatus according to claim 6, wherein the reproduction unit further includes a scroll unit that scrolls a display target of the heading image display unit in response to a scroll instruction. In the processor of the image processing device,
A first creation step of creating a main image representing a first imaging scene having a first angle of view based on an output of the imaging means;
A second creation step of creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the process of the first creation step;
An assignment step for assigning one or more headline images created by the second creation step to a main image created by the first creation step, and a search for the main image based on the assignment result of the assignment step An image processing program for executing a reproduction step of reproducing at least one of one or more headline images created by the second creation step. An image processing method executed by an image processing apparatus,
A first creation step of creating a main image representing a first imaging scene having a first angle of view based on an output of the imaging means;
A second creation step of creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the process of the first creation step;
An assignment step for assigning one or more headline images created by the second creation step to a main image created by the first creation step, and a search for the main image based on the assignment result of the assignment step An image processing method comprising: a reproduction step of reproducing at least one of one or more headline images created by the second creation step. An external control program supplied to an image processing apparatus including a processor that executes processing according to an internal control program stored in a memory,
A first creation step of creating a main image representing a first imaging scene having a first angle of view based on an output of the imaging means;
A second creation step of creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the process of the first creation step;
An assignment step for assigning one or more headline images created by the second creation step to a main image created by the first creation step, and a search for the main image based on the assignment result of the assignment step An external control program for causing the processor to execute a reproduction step of reproducing at least one of one or more headline images created by the second creation step in cooperation with the internal control program. An image processing apparatus comprising: a capturing unit that captures an external control program; and a processor that executes processing according to the external control program captured by the capturing unit and an internal control program stored in a memory,
The external control program is
A first creation step of creating a main image representing a first imaging scene having a first angle of view based on an output of the imaging means;
A second creation step of creating one or more headline images each representing a second imaging scene having a second angle of view smaller than the first angle of view in relation to the process of the first creation step;
An assignment step for assigning one or more headline images created by the second creation step to a main image created by the first creation step, and a search for the main image based on the assignment result of the assignment step An image processing apparatus corresponding to a program that executes a reproduction step of reproducing at least one of one or more headline images created by the second creation step in cooperation with the internal control program. First creation means for creating a main image representing an imaging scene based on an output of the imaging means;
Second creation means for creating one or more headline images in which one or more specific objects appearing in the imaging scene are emphasized in association with the processing of the first creation means;
An assignment unit that assigns one or more headline images created by the second creation unit to a main image created by the first creation unit, and a search for a main image based on an assignment result of the assignment unit An image processing apparatus, comprising: reproducing means for reproducing at least one of one or more headline images created by the second creating means. Search means for searching for a specific object image from the main image created by the first creation means,
The image processing apparatus according to claim 12, wherein the second creating unit further includes an emphasizing unit that executes an emphasizing process in a different manner according to a search result of the searching unit.

Images