JP4679030B2 - Image search apparatus and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image transmission apparatus and an image retrieval method for retrieving desired image data based on time information, position information, and the like added to image data in an apparatus that handles a large number of image data.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, an image search device that searches image data based on time information added to image data is known as an image search device that searches a large number of image data simply and intuitively. For example, in Japanese Patent Laid-Open No. 11-328209, a time axis is displayed on a screen in order to search for image data to which time information is added, and the image data exists at a position corresponding to the time information on the time axis. An image search apparatus for searching for image data by displaying a mark indicating the above is disclosed.
[0003]
[Problems to be solved by the invention]
In the image search apparatus disclosed in Japanese Patent Laid-Open No. 11-328209, in order to search for image data on a desired time scale, it is necessary to enlarge / reduce the time axis displayed on the screen as needed. there were. For example, when the time axis is displayed on a yearly scale, if it is desired to search for image data on the time axis on a monthly scale, it is necessary to update to a screen with an expanded time axis. Further, when it is desired to search for image data on a daily scale or hourly scale, the time axis must be enlarged and displayed on the daily scale or hourly scale. Conversely, when searching for image data on a monthly scale or yearly scale after searching for image data on a time scale or a daily scale, it is necessary to reduce the time axis and display the search screen. was there.
[0004]
As described above, in the conventional image search apparatus, it is necessary to search the desired image data by changing the scale of the time axis while following the hierarchy, and the time axis is displayed only on one scale on one screen. Positioning of the image data on the entire time scale and positioning on the microscopic time scale cannot be viewed at the same time, making it difficult to grasp the positional relationship of the image data on the overall time axis. Therefore, the labor for searching for image data has been increased.
[0005]
SUMMARY OF THE INVENTION An object of the present invention is to provide an image search apparatus and an image search method capable of searching image data intuitively, easily and simply.
[0006]
[Means for Solving the Problems]
  To achieve the above object, in the image search apparatus and program according to the present invention, a plurality of time axes are displayed at different time scales on a search screen for searching image data, and the plurality of time axes are linked. By displaying them, the positions of the image data on a plurality of time scales can be comprehensively grasped at a time.
[0007]
  Also, an image search device according to the present invention andprogramIn the search screen for searching for image data, the time axis and the thumbnail image are displayed at the same time, and the time axis and the thumbnail image are displayed in conjunction with each other, whereby the position of the image data on the time scale is displayed. And an overview of the image data can be comprehensively grasped at a time.
[0009]
  Also, an image search device according to the present invention andprogramIn the search screen for searching image data, the time axis and the map are displayed at the same time, and the time axis and the map are linked to each other so that the position on the time axis and the spatial position of the image data are once Can be comprehensively grasped.
[0010]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. 1 and 2 are external views (front view and back view) of an embodiment of an electronic camera 100 that is an image search apparatus to which the present invention is applied. As shown in FIG. 1, a photographing lens 10 for forming a subject image, a finder 11 for confirming a photographing screen, a strobe 12 for illuminating the subject during photographing, and the brightness of the subject are formed on the front surface of the electronic camera 100. A photometric circuit 13 for detection and a grip portion 14 protruding from the camera body are provided to make it easier for the user to hold the electronic camera 100 by hand. A release button 16 for instructing photographing is provided on the upper surface, and the electronic camera 100. Is provided with a power switch 17 for ON / OFF control of the power.
[0011]
As shown in FIG. 2, on the back of the electronic camera 100, an eyepiece of the finder 11, a left LCD (left screen) 21 having a substantially rectangular screen for displaying text and images, and for displaying text and images. A right LCD (right screen) 22 having a substantially rectangular screen is arranged, and below the right LCD 22 are an up button 23, a down button 24, a left button 25, a right button 26 used for image search, A determination button 27 is arranged, a shooting mode button 28 for setting the electronic camera 100 to a shooting mode, a playback mode button 29 for setting the electronic camera 100 to a playback mode, and an image in the playback mode. A search button 31 for displaying a search screen for searching for data is arranged. The side surface is provided with a memory card slot 30 for mounting a memory card 77 for storing image data.
[0012]
The release button 16, the up button 23, the down button 24, the left button 25, the right button 26, the enter button 27, the shooting mode button 28, the playback mode button 29, and the search button 31 are all operated by the user. Key.
[0013]
On the surface of the left LCD 21 and the right LCD 22, a so-called touch screen 66 having a function of outputting contact position data corresponding to a position instructed by a finger touch operation is arranged, and a selection item displayed on the screen. And can be used to select image data. The touch screen 66 is made of a transparent material such as glass or resin, and the user can observe an image or text formed inside the touch screen 66 through the touch screen 66.
[0014]
FIG. 3 is a block diagram showing an example of the internal electrical configuration of the electronic camera 100 shown in FIGS. 1 and 2, and each component has a data / control bus 51 for transmitting various information data and control data. Are connected to each other. Each component is roughly a block centered on the shooting control circuit 60 that executes the shooting operation of the image data, a block of the memory card 77 that stores and saves the image file, and a screen that displays the image data and related information. It can be divided into a block centering on the control circuit 92 and a block centering on the user interface such as the operation key 65 and the CPU 50 that performs overall control on each control circuit.
[0015]
The CPU 50 (central processing unit) is a means for controlling the entire electronic camera 100, and includes an operation key 65, a touch screen 66, a power switch 17, a timer 74, and a photographing control circuit 60 according to input information from the photometry circuit 13. Various instructions are given to the screen control circuit 92 and the power supply control circuit 64. The photometry circuit 13 measures the luminance of the subject and outputs photometry data as the measurement result to the CPU 50. The CPU 50 sets the exposure time and sensitivity of the CCD 55 by the CCD drive circuit 56 according to the photometric data, and controls the aperture value of the diaphragm 53 by the aperture control circuit 54 via the photographing control circuit 60 according to the set data.
[0016]
In the shooting mode, the CPU 50 controls the shooting operation via the shooting control circuit 60 according to the operation of the release button 16. Further, when the subject is dark based on the photometric data, the CPU 50 causes the strobe 12 to emit light via the strobe driving circuit 73 at the time of shooting. The timer 74 has a built-in clock circuit, detects date / time information corresponding to the current date / time, and supplies the shooting date / time information to the CPU 50 at the time of shooting. The CPU 50 adds the shooting date / time information to the image data and stores it in the memory card 77. CPU50 controls each part according to the control program memorize | stored in ROM67 (read-only memory). An EEPROM 68 (electrically erasable and writable ROM) is a non-volatile memory and stores setting information and the like necessary for the operation of the electronic camera 100. The RAM 70 is a volatile memory and is used as a temporary work area for the CPU 50. The CPU 50 detects the operation state of the power switch 17 and controls the power source 63 via the power control circuit 64.
[0017]
The photographing control circuit 60 performs focusing and zooming of the photographing lens 10 by the lens driving circuit 52, controls the exposure amount of the CCD 55 by controlling the diaphragm 53 by the diaphragm control circuit 54, and controls the operation of the CCD 55 by the CCD driving circuit 56. To do. The light flux from the subject is formed as a subject image on the CCD 55 through the diaphragm 53 for adjusting the amount of light by the photographing lens 10, and this subject image is picked up by the CCD 55. A CCD 55 (charge coupled device) having a plurality of pixels is a charge storage type image sensor for capturing a subject image, and an electric image signal corresponding to the strength of the subject image formed on the CCD 55 is driven by the CCD. In response to the drive pulse supplied by the circuit 56, the signal is output to the analog processing unit 57.
[0018]
The analog processing unit 57 samples the image signal photoelectrically converted by the CCD 55 at a predetermined timing, and amplifies the sampled signal to a predetermined level. The A / D conversion circuit 58 (analog / digital conversion circuit) digitizes the image signal sampled by the analog processing unit 57 to convert it into digital data, and the photographing buffer memory 59 temporarily stores the digital data.
[0019]
The shooting control circuit 60 repeats the above operation during the shooting mode, and the screen control circuit 92 reads digital data sequentially stored in the shooting buffer memory 59 via the data / control bus 51 and temporarily stores it in the frame memory 69. The through image display operation of converting the digital data into display image data and re-storing it in the frame memory 69 and displaying the display image data on the left screen 21 is repeated. The screen control circuit 92 obtains text display information from the CPU 50 as necessary, converts it into display text data, stores it in the frame memory 69, and displays the display text data on the left screen 21 and the right screen 22. . In this manner, in the shooting mode, the image captured by the CCD 50 is displayed in real time on the left screen 21, so that it is possible to perform composition setting for shooting using this through image as a monitor screen. Become. The photographing control circuit 60 detects the focus adjustment state of the photographing lens 10 by analyzing the degree of the high frequency component of the digital data stored in the photographing buffer memory 59, and the lens driving circuit 52 adjusts the focus of the photographing lens 10 according to the detection result. Do.
[0020]
When the shooting control circuit 60 receives a shooting instruction from the CPU 50 at the time of release, the CCD 55 causes the CCD 55 to pick up a subject image, and the image signal generated by the shooting is sent through the analog processing unit 57 and the A / D conversion circuit 58. And temporarily stored as digital data (raw data) in the photographing buffer memory 59. The shooting control circuit 60 converts or compresses the digital data once stored in the shooting buffer memory 59 into a predetermined recording format (JPEG or the like) to form image data, and records and saves the image data in the memory card 77.
[0021]
A GPS circuit 61 (global positioning system circuit) detects position information (longitude data, latitude data) of the electronic camera 100 using information from a plurality of satellites orbiting around the earth, and a shooting position at the time of image shooting. Information is supplied to the CPU 50. The CPU 50 adds the shooting position information to the image data and stores it in the memory card.
[0022]
Note that the CPU 50 transmits image data stored in the memory card 77 to the outside via the radio telephone circuit 72 and the antenna 76 as needed, or conversely, an image received from the outside via the radio telephone circuit 72 and the antenna 76. Data can be stored in the memory card 77. ,
In the reproduction mode, the screen control circuit 92 reads out the image data instructed to the CPU 50 from the memory card 77, temporarily stores it in the frame memory 69, displays the image data on the left screen 21, and reproduces according to the instruction of the CPU 50. Text data such as a description of the mode is stored in the frame memory 69 and the text data is displayed on the right screen 22.
[0023]
When the search button is operated in the reproduction mode, the CPU 50 controls the screen control circuit 92 to display the search screen on the right screen 22 and display the thumbnail image of the image data stored in the memory card on the right screen 22. To display. The user can search for desired image data by operating the search screen using the operation keys 65 and can finally display it on the left screen 21.
[0024]
FIG. 4 shows the data structure of the image file stored in the memory card 77. As shown in FIG. 4, the memory card 77 stores a plurality of image files. Each image file is composed of image data and additional information data. As shown in FIG. 5, the additional information data includes shooting data indicating various settings at the time of shooting, shooting date / time data, and shooting position data.
[0025]
FIG. 6 is a state transition diagram of an embodiment of an electronic camera according to the present invention. When the power is turned on, the camera enters a shooting mode. By operating the release button 16, a shooting operation, creation of an image file after shooting, and storage of the image file in the memory card 77 are performed. In the playback mode, the playback display operation of the image data stored in the memory card 77 is performed. When the search button 31 is operated in the reproduction mode, an image data search operation is performed. When the shooting mode button 28 is operated, the playback mode is shifted to the shooting mode, and when the playback mode button 29 is operated, the shooting mode is switched to the playback mode.
[0026]
FIG. 7 is a main flowchart of the operation of the electronic camera 100 (CPU 50) in the above embodiment. First, when the power switch 17 is operated in S10, the power supply is turned on, and in S20, a shooting mode subroutine is executed to enable shooting. When the release button 16 is operated during the shooting mode, a release interrupt processing subroutine of S30 is executed and a shooting operation is performed. When the playback mode button 29 is operated during the shooting mode, the mode switching interrupt processing subroutine of S40 is executed, the playback mode subroutine of S50 is executed, and the image data stored in the memory card 77 is played back and displayed on the left screen 21. The Conversely, when the shooting mode button 28 is operated during the playback mode, the mode switching interrupt processing subroutine of S40 is executed, and the process proceeds to the shooting mode subroutine of S20. When the search button 31 is operated during the reproduction mode, the search interruption processing subroutine of S60 is executed to search for image data.
[0027]
FIG. 8 is a detailed flowchart of the shooting mode subroutine. When the shooting mode subroutine is started in S20, the process of S201 is repeated. In S201, image data sequentially generated by the CCD 55 under the camera setting conditions set by the user is displayed on the left screen 21 as shown in FIG. 9, and the camera setting conditions, date / time information data (time data), and shooting position data at that time are displayed. (Position data) is displayed as text on the right screen 22.
[0028]
FIG. 10 is a detailed flowchart of the release interrupt processing subroutine. When it is activated in S30, it is checked in S301 whether or not it is in the shooting mode. If it is not in the shooting mode, the process returns in S304. In the case of the shooting mode, the imaging operation is executed under the shooting conditions set by the user or the camera in S302, the time data and the position data are added to the image data obtained in S303 and stored in the memory card 77, and S304. Return at.
[0029]
FIG. 11 is a detailed flowchart of the mode switching interrupt processing subroutine. When the shooting mode button 28 or the playback mode button 29 is activated in S40, it is checked whether the button operated in S401 is the shooting mode button 28. If it is the mode button 28, the playback mode is terminated and the process proceeds to the shooting mode subroutine of S20. If the operated button is not the shooting mode button 28, the shooting mode is terminated, and the process proceeds to the reproduction mode subroutine of S50.
[0030]
FIG. 12 is a detailed flowchart of the playback mode subroutine. When the playback mode subroutine is activated in S50, the processing in S501 is repeated. In S501, the image data stored in the memory card 77 is selected and read in accordance with the operation of the left direction button 25 and the right direction button 26, and is reproduced and displayed on the left screen 21 as shown in FIG. Displays a description of the operation method. The latest image data is displayed immediately after the power is turned on, and after that, the image data with the old time data is sequentially displayed according to the operation of the left direction button 25, and the new time data is sequentially displayed according to the operation of the right direction button 26. Display image data.
[0031]
FIG. 14 is a detailed flowchart of the search interrupt processing subroutine activated by the operation of the search button 31. When activated in S60, it is checked in S601 whether or not the reproduction mode is selected, and if not in the reproduction mode, the process returns in S602. In the reproduction mode, a screen for searching for image data is displayed on the right screen 22 in S603, and thereafter, the user uses the up button 23, the down button 24, the left button 25, and the right button 26, The image data to be displayed on the left screen 21 is searched.
[0032]
FIG. 15 is a display example of the search screen displayed on the right screen 22, and the screen includes four timelines (time axes) of different time scales (year, month, day, time), a plurality of thumbnail images, and the like. Are displayed separately in the vertical direction of the screen. Also, five time zone data for each time axis and five thumbnail images are displayed in the left and right direction of the screen in order of time (the time is old in the left direction and the time is new in the right direction). A central column surrounded by a thick frame at the center of the screen indicates a time zone currently selected by the user. It should be noted that the display is omitted for the time zone where there is no image data, and the time zone including the next image data is displayed. For example, in FIG. 15, the 23rd to 27th days are omitted on the time axis of the date.
[0033]
In S <b> 606 and S <b> 607, the user can select any of the four timelines and the thumbnail image sequence using the up button 23 and the down button 24. FIG. 15 shows an example in which the user has selected the time axis of the date, and a frame indicating the 28th (Sat) on the time axis of the selected date is a thick frame and is displayed larger than the other frames. In this state, image data photographed from 15:00 to 16:00 on July 28, 2000 is displayed as a thumbnail image in the center column (a column surrounded by a thick frame). If there are multiple image data shot during this time period, the thumbnail image of the oldest image data among the image data shot during this time period is displayed in this thick frame, and the subsequent image data Are displayed on the right side of this frame. When the up button 23 is operated in the state of FIG. 15, the time axis of the month is selected as shown in FIG. 16, and the frame indicating July on the time axis of the selected month is a thick frame and is displayed larger than the other frames. Is done.
[0034]
In S604 and S605, the user can sequentially send the selected time axis or thumbnail image sequence in the direction of the old time or the new time using the left direction button 25 and the right direction button 26. For example, when the right button 26 is operated in FIG. 15, the time axis of the date is shifted to the left as shown in FIG. 17, 29 days are sent and displayed in the center thick frame, and a new date is displayed from the right side of the time axis. Newly entered. If the operation of the right button 26 is continued and the date of the next month falls within the central thick frame, the time axis of the month is also changed from July to August. Similarly, if it becomes necessary to change the contents of the time zone other than the selected time axis as a result of the operation on the selected time axis in the left-right direction, the selected time axis is selected in conjunction with the left-right operation on the selected time axis. Time zones other than the time axis are also shifted sequentially. It should be noted that the lower time axis may or may not be linked to the operation of the upper time axis (for example, the month and year are higher than time and day). For example, if you move to the next month by manipulating the time axis of the month, the date time axis may be changed to the date on which the first image data of the month exists (for example, one day), or the date as it is or near (For example, if the current date is 31 days, and the changed month does not have 31 days, it is 30 days).
[0035]
Further, when the thumbnail image sequence is operated in the left-right direction, the data on the four time axes are sequentially shifted in conjunction with the shift of the thumbnail image. That is, each time axis is shifted so that the data of each time axis displayed in the central thick frame matches the time data added to the thumbnail image displayed in the central thick frame.
[0036]
If the enter button 27 is operated in S608, the image data corresponding to the thumbnail image currently displayed in the center thick frame is displayed on the left screen 21, the search interrupt process is terminated in S609, and the playback mode Return to
In the above embodiment (FIGS. 1 to 17), when searching for image data, a plurality of time scales (timelines) of different scales are displayed at the same time, and one of the plurality of time axes is selected and the time axis direction is selected. The desired image data can be searched by shifting to another time axis in conjunction with the shift, and the image data can be searched by following the time axis at the user's favorite speed or unit. Image search can be performed quickly. In addition, since a plurality of time axes are always displayed, it is possible to comprehensively grasp the temporal position of the image data from both the macroscopic time scale and the microscopic time scale. In addition, since thumbnail images are displayed in time order simultaneously with the time axis, after narrowing down on the time axis to the vicinity of the desired image data while browsing the thumbnail pixel image, the thumbnail image is forwarded to the desired image data. It can be reached quickly.
[0037]
In the above embodiment (FIGS. 1 to 17), when searching for image data, the time axis and the thumbnail image sequence are displayed at the same time, and the other is shifted in conjunction with one shift. The image search based on the image search and the image search based on the image image can be used together, and the efficiency of the image search can be improved.
[0038]
In the above embodiment (FIGS. 1 to 17), the time axis is displayed when searching for image data, and the time zone that does not include the time data added to the image data is displayed on the time axis. Is omitted, the time axis can be shifted quickly, and the efficiency of image search can be improved.
(Description of Modifications) The present invention is not limited to the embodiment described above, and various modifications and changes can be made.
[0039]
In the above embodiment (FIGS. 1 to 17), the image data is searched using the time axis, but information other than time may be used. For example, when position data (longitude data, latitude data) at the time of shooting is recorded by the GPS circuit 61, an image search can be performed using the position data. FIG. 28 shows a display example of a search screen in such an image search. A world map is displayed at the upper right of the right screen 22, and a range mark (□) is displayed superimposed on the world map. The region of the world map (Japan in the case of FIG. 18) included in the range mark is displayed on the upper left of the right screen 22. A range mark (□) is also displayed at the center of the map, superimposed on this national scale map. The area including the range mark (in the case of FIG. 18, a map at the prefecture level) is displayed at the lower left of the right screen 22. A range mark (□) is also displayed at the center of the map, superimposed on this prefecture-level map. The area including the range mark (in the case of FIG. 18, a municipal level map) is displayed at the lower right of the right screen 22. Thumbnail image data corresponding to image data to which position data included in the lower right map (ie, the most enlarged map = the largest scale map) is added is displayed at the bottom of the right screen 22 in time order. Is done. If there is no image data to which position data included in the lower right map is added, thumbnail image data may not be displayed. The thumbnail image data of the image data to which the position data included in is added may be displayed.
[0040]
The user can use the touch screen 66 to select one map from four different scale maps. In addition, a thumbnail image sequence can be selected using the touch screen 66. When the world map (upper right) is selected, the range mark in the map can be moved using the touch screen 66 or the four direction buttons. As the range mark is moved on the world map, the country level map that displays the map within the range mark has been changed, and as the country level map has changed, it has been placed at the center of the country level map. The prefecture level map for displaying the range mark is changed, and the municipal level map for displaying the range mark arranged at the center of the prefecture level map is also changed in accordance with the change of the prefecture level map.
[0041]
When a map at a country level, a prefecture level, or a municipal level is selected, the selected map can be moved two-dimensionally using four direction buttons. The map which is not selected in conjunction with this also moves. That is, with the movement on the selected map, the map in the range mark on the world map in the upper right matches the map in the country level in the upper left, and the map in the range mark in the map at the country level is in the lower left The map is matched with the map at the prefecture level, and the map in the range mark in the map at the prefecture level is changed to match the map at the municipal level in the lower left. In this case, the map is not moved on the world map in the upper right, but the range mark is moved instead.
[0042]
The thumbnail image sequence is also changed with the change of the range mark. In the thumbnail image row, thumbnail images corresponding to image data having position data on a map at the municipality level with the largest scale are displayed in time order. If there is no image data having position data in the municipal level map, the thumbnail image is not displayed.
[0043]
On the other hand, when the thumbnail image row is selected on the touch screen 66, the thumbnail image is shifted left and right by the left button 25 and the right button 26. A thumbnail image surrounded by a central thick frame indicates a selected thumbnail image. When the enter button 27 is operated, image data corresponding to the thumbnail image within the thick frame at that time is displayed on the left screen 21.
[0044]
In this way, when searching for an image, a plurality of different scale maps are displayed simultaneously, one of the plurality of maps is selected and the map is shifted, and other maps are also shifted in conjunction with the shift. Thus, since the desired image data can be searched, it is possible to search the image data by changing the scale map of the user's favorite scale. In addition, since a plurality of maps are always displayed, the spatial positioning of the image data can be comprehensively grasped from both the macro scale scale and the micro scale scale. Since thumbnail images are displayed in time order simultaneously with the map, after narrowing down on the map to the vicinity of the desired image data while browsing the thumbnail image, the thumbnail image is forwarded to the desired image data quickly. You can reach it. The map data may be stored in a memory built in the electronic camera or a memory card attached, or may be downloaded from a map information server on the network via a wireless telephone line.
[0045]
In the above embodiment (FIG. 18), thumbnail images corresponding to image data having position data are displayed in time order on a map at the municipal level with the largest scale, and there is no image data having position data in the map. Shows that there is no image data in the map without displaying thumbnail images, but if there is no image data with location data in the map at the municipal level, the prefecture level with the next largest scale Thumbnail images corresponding to image data having position data on the map may be displayed in time order. If there is no image data on the map at the prefectural level, thumbnail images are displayed by further moving down to the national level and the world level. In this way, even when there is no image data having position data in the selected municipal level map, a thumbnail image corresponding to the image data having position data in the vicinity of the area can be displayed.
[0046]
In the above embodiment (FIG. 18), the map is continuously moved. However, when moving an area not including the position data added to the image data, the moving speed is increased or the area is skipped. You may make it. For example, when a position on the map that does not include the position data added to the image data in the world map is designated by the touch screen 66, the position is changed to a position including the position data added to the image data closest to the position. The range mark is moved to this position. Alternatively, when the map is moved using the four direction buttons, the position on the map not including the position data added to the image data in the selected direction is omitted, and the position data added to the image data is included. Skip to a location and move the map to that location. In this way, the trouble of moving the map is reduced, and it becomes possible to quickly search for desired image data.
[0047]
In the above embodiment (FIG. 18), the position of the image data is not displayed on the map, but a mark indicating the presence of the image data is displayed at the corresponding position on the map according to the position data added to the image data. It may be displayed. In this way, the moving direction of the map can be determined using the mark as a clue. Further, by directly designating the mark on the touch screen 66, the image data corresponding to the mark may be displayed on the left screen 21. In this way, it is possible to quickly browse the image data based on the storage of the shooting location.
[0048]
In the above embodiment (FIGS. 1 to 18), image data is searched based on information on a time axis or a map (on spatial coordinates). However, image data is obtained by combining time data and position data. You may make it search. FIG. 19 is a display example of a search screen in such an image search. A world map is displayed at the upper right of the right screen 22, and a country level map is displayed at the upper left. In the middle of the right screen 22, the time axis of the year and the time axis of the month are displayed. A time zone surrounded by a thick frame on the time axis is a selected time zone. In addition, thumbnail images of image data having position data in the country level map displayed in the upper left and having time data of July 2000 are displayed in the lower part of the right screen 22 in time order. A thumbnail image surrounded by a thick frame in the thumbnail image row is a thumbnail image selected. The maps in the range mark on the world map in the upper right are linked to each other so that they match the country level map in the upper left. The year time axis and month time axis are also changed in conjunction with each other.
[0049]
The world map, country map, year time axis, month time axis, and thumbnail image sequence are selected by the touch screen 66. The selected world map, country map, year time axis, month time axis, and thumbnail image sequence can be identified by a text display or a frame display form on the screen. The movement of the range mark on the world map is performed by operating the touch screen 66 or the four direction buttons. Further, the shift or selection of the time zone on the time axis is performed by operating the left direction button 25 and the right direction button 26. Further, the shift or selection of thumbnail images on the thumbnail image sequence is performed by operating the left direction button 25 and the right direction button 26.
[0050]
In this way, when searching for an image, it is possible to search the image data from both position data and time data in a multifaceted manner, and narrow down on the map to the vicinity of the desired image data while browsing the thumbnail pixel images. After that, it is possible to quickly reach the desired image data by sequentially feeding the thumbnail images.
[0051]
In addition to time data and position data, if other information is simultaneously displayed on one screen and used, it becomes possible to search for image data in various ways. For example, if shooting data (focal length, aperture value, lens type, etc. at the time of shooting) is used, the image data can also be retrieved by storing the shooting data at the time of shooting. In addition, by incorporating a direction sensor in the camera and adding direction data at the time of shooting to the image data, the image data can also be retrieved from the storage of the direction at the time of shooting. If identification information of a photographer or a subject is added to the image data, the image data can also be retrieved from the storage of the identification data.
[0052]
In the above embodiment (FIGS. 1 to 17), image data is searched using the time axis. However, in the time axis display, information on the density of image data (quantity of image data per unit time) is displayed. May be displayed together. FIG. 20 is a display example in which the density of the image data is indicated by the display density for every certain time zone, and shows that the density of the image data is higher in the time zone where the density is higher. The density of the image data may be displayed depending on the color difference. In addition, it is easy to view the display in three levels of high density, medium density, and low density. The density may be a relative density or an absolute density. Similarly, in FIG. 18, the density of image data may be displayed on the map by color, density, or the like. In this way, the density information (quantity information) of the image data along the time axis and the density information (quantity information) of the image data on the map can be viewed at the same time, which is linked to the storage of the shooting frequency at the time of shooting. This makes it possible to search for a desired image more quickly.
[0053]
In the above embodiment (FIGS. 1 to 17), when displaying the time axis, the display is omitted for the time zone not including the time data to which the image data is added, but the image data is added. For a time zone that does not include time data, the display may be simplified (such as reduction) or the shift movement speed may be increased.
[0054]
In the above embodiment (FIGS. 1 to 17), the shooting date / time data is used as the time data added to the image data. However, as the time data, the processing date / time data when the image data is processed and the image data are used. The reception date / time data received from the outside may be used.
[0055]
In the above embodiment (FIGS. 1 to 20), image data is targeted for retrieval, but the retrieval target is not limited to image data. For example, the present invention can be applied to a case where text data is searched according to creation date / time data. The present invention can also be applied to a case where the search for audio data is performed according to the recording date / time data.
[0056]
In the above embodiment (FIGS. 1 to 20), a plurality of time axes, a plurality of maps, and thumbnail image sequences are simultaneously displayed on one screen (right screen 22). May be used. For example, a time axis or a map may be displayed on the right screen 22, and thumbnail images may be displayed as a list on the left screen 21.
[0057]
In the above embodiment (FIGS. 1 to 20), the image data is stored in the memory card. However, the image data is stored in the image server by connecting to the image server installed on the internetwork using a wireless telephone line. The present invention can also be applied when browsing / searching existing image data.
[0058]
【The invention's effect】
As described above, in the image search device and the image search method according to the present invention, desired image data is searched based on a plurality of time axes or a plurality of maps, or based on a combination of a time axis and a map. Intuitive, easy and simple image search
[Brief description of the drawings]
FIG. 1 is an external view (front view) of an electronic camera.
FIG. 2 is an external view (back view) of the electronic camera.
FIG. 3 is a block diagram showing an electrical configuration of the electronic camera.
FIG. 4 is a data configuration diagram of a memory card.
FIG. 5 is a configuration diagram of additional information data.
FIG. 6 is a state transition diagram of the electronic camera.
FIG. 7 is a main flowchart of the CPU.
FIG. 8 is a flowchart of a subroutine.
FIG. 9 is a display example of a screen.
FIG. 10 is a flowchart of a subroutine.
FIG. 11 is a flowchart of a subroutine.
FIG. 12 is a flowchart of a subroutine.
FIG. 13 is a display example of a screen.
FIG. 14 is a flowchart of a subroutine.
FIG. 15 is a display example of a screen.
FIG. 16 is a display example of a screen.
FIG. 17 is a display example of a screen.
FIG. 18 is a display example of a screen.
FIG. 19 is a display example of a screen.
FIG. 20 is a display example of a screen.
[Explanation of symbols]
10 Shooting lens
16 Release button
21 Left LCD (left screen)
22 Right LCD (right screen)
23 Up button
24 Down button
25 Left button
26 Right button
27 OK button
28 Shooting mode button
29 Playback mode button
31 Search button
50 CPU
51 Data / Control Bus
55 CCD
60 Shooting control circuit
61 GPS circuit
63 Power supply
65 Operation keys
66 touch screen
67 ROM
68 EEPROM
70 RAM
72 Radio telephone circuit
74 timer
77 memory card
100 electronic camera

Claims (10)

An image search device for searching for desired image data from a plurality of image data to which time data is added,
A time axis display means for simultaneously displaying a plurality of time axes having different scales in the time axis direction in parallel on the screen;
Together select one of the plurality of time-axis shifts in the screen in the direction of the time time axis is selected axis, said selected time on the time axis on a vertical selection column to the time axis direction A selection means for selecting a part of the time region of the time axis as a selected time region by arranging a part of the region ;
In conjunction with the shift of the selected time axis, said shift the selected small time axis scales than the time axis in the time axis direction on the screen, also, therefore the shift of the selected time axis When the time range indicated by the selected time region is out of the time range indicated by the region arranged on the selected column on the time axis having a scale larger than the selected time axis, the time range indicated by the selected time region is The time axis having a scale larger than the selected time axis is set to be the time range indicated by the region arranged on the selected column of the time axis having a scale larger than the selected time axis. Interlocking means for shifting on the screen in the time axis direction in conjunction with the shift of
An image search apparatus comprising: an image display unit configured to display image data to which time data corresponding to a plurality of time domains on the time axis displayed on the selected row is added.   2. The image search device according to claim 1, wherein the image display means displays the image data as thumbnail images on the screen. The image search device according to claim 1 or 2,
The image display means causes the thumbnail images of the plurality of image data to be displayed on the screen simultaneously with the time axis as an image sequence in time order,
Said selecting means shifts in the direction of the image sequence further the thumbnail images on the screen,
The interlocking unit further includes an image to which time data corresponding to the time range indicated by the time regions of the plurality of time axes displayed on the selection column is added in conjunction with the shift of the time axis by the selecting unit. The image sequence is shifted in the direction of the image sequence on the screen so that data is displayed on the screen, and is displayed on the screen in conjunction with the shift of the image sequence by the selection means. The time axis is shifted in the direction of the time axis on the screen so that a time region corresponding to the time range corresponding to the time data added to the image data of the portion of the image sequence is arranged on the selected sequence. An image search apparatus characterized by that. 4. The image search apparatus according to claim 1, wherein the time axis display means includes a time range corresponding to time data added to the image data when the time axis is displayed on the screen. An image search apparatus characterized by simply displaying a portion on a time axis that is not present. The image search device according to claim 1 further includes:
Map display means for displaying a map simultaneously with the time axis on the screen;
The image display means includes time data included in a time range indicated by a time region of a plurality of time axes displayed on the selected column, and a map of a portion displayed on the screen. An image search apparatus comprising: image display means for displaying image data to which position data included is added. 6. The image search device according to claim 1, wherein the time axis display unit includes the time axis according to a density on the time axis of a time range corresponding to the time data added to the image data. The image search device is characterized in that the display form is changed.   6. The image search device according to claim 5, wherein the time map display means changes a display form of the map in accordance with a density of the position data added to the image data on the map. Image search device. A program for executing the image search to find the desired image data to the computer over from among the plurality of image data added time data,
A time axis display step of simultaneously displaying a plurality of time axes having different scales in the time axis direction in parallel on the screen;
Depending on the selection instruction input, wherein while selecting one of the time axis of the plurality of shifts in the screen in the direction of the time time axis is selected axes, on a vertical selection column to the time axis direction A selection step of selecting a part of the time region of the time axis as a selection time region by arranging a part of the time region of the selected time axis ;
In conjunction with the shift of the selected time axis, a small time axis scales than the time axis said selected by the shift on the screen in the time axis direction, the shift of the selected time axis thus When the time range indicated by the selection time region is out of the time range indicated by the region arranged on the selection column on the time axis having a scale larger than the selected time axis, the time range indicated by the selection time region is The time axis having a scale larger than the selected time axis is set to be within the time range indicated by the area arranged on the selected column of the time axis having a larger scale than the selected time axis . An interlocking step of shifting on the screen in the time axis direction in conjunction with the shift of the time axis;
Program for executing the image search and an image display step of displaying the image data added time data corresponding to a plurality of time domain of the time axis displayed on the selected column to the computer. A program for causing a computer to execute the image search according to claim 8.
The image display step further displays a thumbnail image of the plurality of image data as an image sequence in time order on the screen simultaneously with the time axis,
The selecting step further includes a step of shifting the thumbnail image in the direction of the image sequence on the screen,
In the interlocking step, image data to which time data corresponding to a plurality of time regions on the time axis displayed on the selection column is added in conjunction with the shift of the time axis in the selection step is displayed on the screen. The image sequence is shifted in the direction of the image sequence on the screen so as to be displayed above, and the image of the portion displayed on the screen in conjunction with the shift of the image sequence by the selection step An image characterized in that the time axis is shifted in the direction of the time axis on the screen so that the time range of the time axis corresponding to the time data added to the image data of the column is arranged on the selected column. A program that causes a computer to perform a search. Program for executing the image search according to the computer over to claim 8 further
A map display step of displaying a map on the screen simultaneously with the time axis;
In the image display step, time data included in a time range indicated by a time region of a plurality of time axes displayed on the selected row is added, and a map of a portion displayed on the screen is added. program for executing the image search on the computer over to and displaying the image data position data is added included.

Images