JP4129143B2 - Graphical user interface device for search - Google Patents

Description

[0001]
【Technical field】
The present invention relates to a search graphical user interface.
[0002]
BACKGROUND OF THE INVENTION
When extracting data stored in the database, keywords are entered into the database. Data matching the entered keyword is extracted from the database. A user familiar with database operations can input appropriate keywords and find desired data. However, it is relatively difficult for a user unfamiliar with database operations to input appropriate keywords.
[0003]
DISCLOSURE OF THE INVENTION
For this purpose, a bar or the like may be displayed on the display screen of the display device, and the search range may be designated using the bar. When a search range is specified, data having characteristics determined by the specified upper and lower limits are found from the database.
[0004]
However, only data having characteristics within the search range can be searched.
[0005]
An object of the present invention is to extend the search range.
[0006]
The search graphical user interface according to the present invention moves in accordance with the coordinate axis on which the scale defining the search range is expressed and the scale according to the movement instruction from the user, and defines the upper limit of the search range. Defined by the first display control means for controlling the first display device to display the mark and the lower limit mark that defines the lower limit of the search range on the display screen, the search range defined by the upper limit mark and the lower limit mark Search means for searching for data having a characteristic to be searched from the database, second display control means for controlling the second display device so as to display the result of the data found by the search means on the display screen, In addition, the upper limit mark or the lower limit mark moves to a predetermined range extension search instruction position. Particular response, characterized in that it comprises a search control means for controlling said search means to perform a search process than the lower of the upper or the search range of the search range.
[0007]
The present invention may provide a method suitable for a search graphical user interface. In other words, this method moves in accordance with the coordinate axis on which the scale defining the search range is represented and the scale according to the movement instruction from the user, and the upper limit mark that defines the upper limit of the search range and the lower limit of the search range. Is displayed on the display screen, data having characteristics determined by the search range specified by the upper limit mark and the lower limit mark is searched for from the database, and the result of the found data is displayed. The second display device is controlled to display on the screen, and the upper limit of the search range or the search range according to the movement of the upper limit mark or the lower limit mark to a predetermined range extension search instruction position. The search processing is performed exceeding the lower limit of the above.
[0008]
You may make it provide the program for implementing the said method, and the recording medium which stored such a program.
[0009]
The first display device and the second display device may be the same.
[0010]
According to the present invention, the coordinate axis, the upper limit mark and the lower limit mark are displayed on the display screen of the first display device. Data having characteristics defined by the search range defined by the upper limit mark and the lower limit mark is searched from the database. The result of the found data is displayed on the display screen of the second display device.
[0011]
When the upper limit mark or the lower limit mark is moved to a predetermined range extension search instruction position, the search process is performed beyond the upper limit or lower limit of the search range.
[0012]
A range expansion search instruction position is determined in advance, and when the upper limit mark or the lower limit mark is moved to this range expansion search instruction position, the search process exceeds the upper limit or lower limit of the search range (the search range is expanded). Done. It is possible to search for a range that exceeds the scale that defines the search range (expansion of the search range).
[0013]
The second display control means is not moved to the display mode of the search result obtained when the upper limit mark or the lower limit mark is moved to the range extension search instruction position and the range extension search instruction position. It is good also as what changes the display mode of the search result obtained sometimes.
[0014]
It is preferable that the second display control means displays a search result by the search means corresponding to the scale.
[0015]
[Explanation of Examples]
FIG. 1 shows an embodiment of the present invention, and is a block diagram showing an electrical configuration of an image database apparatus.
[0016]
The overall operation of the image database apparatus is controlled by the CPU 2.
[0017]
The image database device includes an image database 4 in which image data representing a large number of images is stored. The image database 4 also stores data representing the characteristics of the image data corresponding to the stored image data. The characteristics of the image data include the shooting date of the image, the average brightness of the image, the average saturation of the image, and the color ratio of the image.
[0018]
The input device 3 includes a keyboard and a mouse. A signal for dragging the cursor output from the input device 3, a signal indicating that the mouse has been clicked, and the like are input to the CPU 2.
[0019]
Also connected to the CPU 2 is a video random access memory (VRAM) 1 that temporarily stores image data representing an image displayed on the display screen of the display device 6. Display of images on the display device 6 is controlled by the display control device 5.
[0020]
FIG. 2 is an example of a window displayed on the display screen of the display device 6.
[0021]
In the window 20, the search range setting image 10 is displayed at substantially the center thereof.
[0022]
The search range setting image 10 indicates the search range (search condition) of the image database 4. In this embodiment, the shooting date is used as the search range. There is a horizontal axis 13 on which the shooting month (scale) from April to October is displayed. Near the center of the horizontal axis 13 is displayed an operator 15 that can be moved up and down and left and right by dragging with a pointer 14 moved by a mouse. On the horizontal axis 13, a left cursor (lower limit mark) 12A and a right cursor (upper limit mark) 12B are displayed so as to be movable left and right in the same manner as the operation element 15. The range between these left cursor 12A and right cursor 12B is the main search range. Images corresponding to this main search range (images taken from June to August 2001 in the example shown in FIG. 2) are found by searching from the image database 4, and the corresponding thumbnail images I are searched as described below. It is displayed in the result display area 30.
[0023]
The number of frames of the image found by the search (result of the found data) is displayed in a graph corresponding to the shooting month. In this embodiment, as will be described in detail later, an image corresponding to the main search range defined by the cursors 12A and 12B can be found by the search, and the shooting month displayed on the horizontal axis 13 beyond the main search range. Are also found from the image database 4 by searching. In the example shown in Fig. 2, since the horizontal axis 13 displays April 2001 through October 2001, images from the April 2001 through October 2001 shooting month excluding June 2001 through August 2001 are displayed. Are further found from the image database 4 (sub-search range). The number of frames of the image corresponding to the main search range is displayed as a black graph 17 (indicated by hatching in FIG. 2), and the number of frames of the image corresponding to the sub search range (sub search) is displayed as a white graph 16. Is displayed.
[0024]
Search range expansion regions (range expansion search instruction positions) 11A and 11B are formed on both sides of the horizontal axis 13. When the left cursor 12A is positioned in the search range expansion area 11A on the left side of the horizontal axis 13, an image of a shooting month that is less than or equal to the upper limit of the search range defined by the right cursor 12B is found by the search. Specifically, in the example shown in FIG. 2, since the right cursor 12B is between August and September 2001, all the images taken before September 2001 are displayed from the image data 4. can be found. Similarly, when the right cursor 12B is positioned in the search range expansion area 11B on the left side of the horizontal axis 13, an image of a shooting month that is equal to or greater than the lower limit of the search range defined by the left cursor 12A is found by the search. Specifically, in the example shown in FIG. 2, since the left cursor 12A is between May and June 2001, all images taken after June 2001 are retrieved from the image database 4. can be found.
[0025]
The window 20 includes a search result display area 30 for displaying a thumbnail image I (not the thumbnail image but the image itself) I of the image found as a result of the search. The search result display area 30 includes a horizontal axis and a vertical axis. The horizontal axis defines lightness and the vertical axis defines saturation, but it goes without saying that other image characteristics may be used as the axis. However, it goes without saying that the images found by the search may be simply listed and displayed without defining the horizontal and vertical axes.
[0026]
FIG. 3 is an example of the search range setting image 10 and shows a case where the search is performed with the left cursor 12A positioned in the search range expansion area 11A.
[0027]
As described above, when the left cursor 12A is positioned in the search range expansion area 11A and a search command is given, the shooting date and time below the upper limit defined by the right cursor 12B is set as the main search range. Images taken within the main search range are found from the image database 4. Of the images found by the search (main search), the number of frames corresponding to the shooting month displayed on the horizontal axis 13 is displayed by the black graph 17 as described above. Of the images found by the search, the number of frames in the shooting month image not displayed on the horizontal axis 13 is displayed as a graph for each shooting year in the upper part of the search range expansion area 11A.
[0028]
Graphs 18 and 19 are displayed above the search range expansion area 11A.
[0029]
One graph 18 represents the number of frames in the image of the shooting month that does not appear on the horizontal axis 13. The graph 18 includes two regions 18A and 18B. Since the graph 18 includes the two regions 18A and 18B, it can be seen that there are photographed images in two months of the year 2001 less than April 2001 (January to March 2001). That is, there is no photographed image in one month out of the months less than April 2001 in 2001. Further, it is possible to grasp how many frames there are from the sizes of the areas 18A and 18B.
[0030]
The other graph 19 shows that there are images taken in the year before 2000. The other graph 19 includes five regions 19A to 19E. The size of each of these areas 19A to 19E represents the number of frames in the image of the shooting month. By looking at the graphs 18 and 19, it is possible to grasp the approximate number of frames of images taken before the shooting month defined on the horizontal axis 13.
[0031]
But you may make it decide the color for every photography month beforehand. By setting the color of each area included in the graphs 18 and 19 to the color of the corresponding month, it is possible to check how many captured images are in which month.
[0032]
FIG. 4 is an example of the search range setting image 10 and shows a case where the search is performed with the right cursor 12A positioned in the search range expansion area 11B.
[0033]
As described above, when the right cursor 12B is positioned in the search range expansion area 11B and a search command is given, the shooting date and time defined by the left cursor 12A is set as the main search range. Images taken within the main search range are found from the image database 4. Of the images found by the search, the number of frames corresponding to the shooting month displayed on the horizontal axis 13 is displayed in the black graph 17 as described above. Of the images found by the search, the number of frames in the shooting month that is not displayed on the horizontal axis 13 is displayed as a graph for each shooting year at the top of the search range expansion area 11B.
[0034]
Graphs 20 and 21 are displayed above the search range expansion area 11B.
[0035]
One graph 20 represents the number of frames of the image of the shooting month that does not appear on the horizontal axis 13. The graph 20 includes two regions 20A and 20B. Since the graph 20 includes two regions 20A and 20B, it can be seen that two months between 2001 and October 2001 (November 2001 and December) have a photographed image. It is also possible to grasp how many frames there are from the sizes of the areas 20A and 20B.
[0036]
The other graph 21 shows that there are images taken in one year after 2002. The other graph 21 also includes two regions 21A and 21B. The size of each of these areas 21A and 21B represents the number of frames in the image of the shooting month. By looking at the graphs 20 and 21, it is possible to grasp the approximate number of frames of images taken after the shooting month specified on the horizontal axis 13.
[0037]
In this case as well, the color for each shooting month may be determined in advance. By setting the color of each region included in the graphs 20 and 21 to the color of the corresponding month, it is possible to check how many captured images are in which month.
[0038]
FIG. 5 is a flowchart showing the processing procedure of the image database apparatus.
[0039]
Assume that a window 20 shown in FIG. 2 is displayed on the display screen of the display device 6.
[0040]
In a state where the operator 15 is not dragged by the user of the image database device (NO in step 41), it is confirmed whether the left cursor 12A or the right cursor 12B is dragged (step 46). When the left or right cursor 12A or 12B is dragged (YES in step 46), the position after dragging is read (step 47).
[0041]
It is confirmed whether the left cursor 12A is in the search range extension area 11A and the right cursor 12B is in the search range extension area 11B (YES in step 48).
[0042]
As shown in FIG. 2, when the left cursor 12A is in the search range expansion area 11A, the search is less than the upper limit of the main search range defined by the right cursor 12B and the upper limit defined by the right cursor 12B. A search for an image corresponding to the sub-search range of the shooting month displayed on the horizontal axis 13 is executed. Further, as shown in FIG. 3, when the right cursor 12B is in the search range expansion area 11B, the search is greater than the lower limit of the main search range defined by the left cursor 12A and less than the lower limit defined by the left cursor 12A. Thus, a search for an image corresponding to the sub-search range of the shooting month displayed on the horizontal axis 13 is executed. A thumbnail image corresponding to the image found by the search (thumbnail image corresponding to the main search range) is displayed in the search result display area 30 (step 49).
[0043]
The number of frames of the image corresponding to the shooting month attached to the horizontal axis 13 is displayed at the top of the horizontal axis 13 corresponding to the shooting month. In addition, as described above, the number of frames of an image shot in the shooting month not attached to the horizontal axis 13 is displayed in a graph above the search range expansion area 11A or 11B.
[0044]
When neither the left cursor 12A nor the right cursor 12B is positioned in the search range expansion area 11A or 11B (NO in step 48), the main search range defined by the left cursor 12A and the right cursor 12B as described above and A search process is executed based on the sub-search range determined by the shooting month displayed on the coordinate axis 13 (step 45).
[0045]
When the operator 15 is dragged by the user of the image database device (YES in step 41), in response to a search command given from the input device 3, the operator after dragging with the center of the horizontal axis 13 as the origin. Fifteen coordinate positions are read (step 42).
[0046]
When the coordinate position is read, the scale value on the horizontal axis 13 is changed based on the read X coordinate value (distance from the center) (step 43). If the X coordinate value is positive, the value is increased, and if the X coordinate value is negative, the value is decreased. Further, the change amount is large if the X coordinate value is large, and the change amount is small if the X coordinate value is small.
[0047]
Subsequently, the scale of the scale is changed based on the read Y coordinate value (distance from the center) (step 44). Again, if the Y coordinate value is positive, the scale is increased, and if the Y coordinate value is negative, the scale is decreased. If the Y coordinate value is large, the change amount is large, and if the Y coordinate value is small, the change amount is small.
[0048]
A search is executed in the set main search range and sub-search range, and a thumbnail image I corresponding to an image corresponding to the main search range is displayed in the search result display area 30 (step 45). For example, when the operator 15 is dragged upward, the window 20 with the scale scale enlarged is displayed on the display screen of the display device 6 by a new search.
[0049]
In the above-described embodiment, the operator 13 is dragged using the mouse. However, when the image database apparatus according to this embodiment is used for a PDA (personal digital assistants), a pen device is used. And drag it.
[0050]
In the search result display area 30, thumbnail images of representative images among images obtained by the search are displayed, and an image is designated by the operator among these representative thumbnail images. A thumbnail image corresponding to an image similar to the designated image may be displayed in the display area 30.
[0051]
Further, a program for causing the computer device to perform the above-described operation may be created. In that case, the program may be stored in a recording medium such as a CD-ROM (compact disk-read only memory). When the program is stored in a recording medium, the image database device is provided with a reading device that reads the program stored in the recording medium.
[0052]
Furthermore, although the image database for searching for images has been described in the above-described embodiments, it goes without saying that not only searching for images but also searching for other information can be used. The characteristics displayed on the coordinate axes are not limited to the shooting date, but may be other information about the image, brightness, saturation, and the like.
[0053]
6 and 7 show a modification example and are examples of a search range setting image. 6 corresponds to the search range setting image shown in FIG. 3, and FIG. 7 corresponds to the search range setting image shown in FIG. In these drawings, the same components as those shown in FIG. 3 or FIG.
[0054]
In the search range setting image 10A shown in FIG. 6, the left cursor 12A is positioned in the search range expansion area 11A. Images taken in the shooting date and time below the upper limit defined by the right cursor 12B are found, and the number of frames is displayed corresponding to the shooting date.
[0055]
As shown in FIG. 3, the graphs 18 and 19 displayed at the upper part of the search range expansion area 11A have one graph even if they represent the number of frames taken in different shooting months if the shooting years are the same. Displayed as 18 or 19. On the other hand, in the search range setting image 10A shown in FIG. 6, graph groups 23 and 24 composed of a plurality of graph sets are displayed above the search range expansion area 11A. Each of these graph groups 23 and 24 corresponds to the shooting year. There is a space between the graph groups 23 and 24. This shows that the shooting years are different. The graph group 23 includes graphs 23A to 23B corresponding to the shooting month, and the graph group 24 includes graphs 24A to 24E.
[0056]
One graph group 23 has the same shooting year (2001) as the year of the shooting month displayed on the horizontal axis 13. This indicates that there is an image taken in two months before the shooting month displayed on the horizontal axis 13 and the same year as the shooting year displayed on the horizontal axis 13. Similarly, the other graph group 24 indicates the number of frames taken in the year before the shooting year displayed on the horizontal axis 13. By looking at the graphs 24A to 24E constituting the graph group 24, it can be seen that there are images taken for five months in a certain year before 2001.
[0057]
The widths of the graphs included in the graph groups 23 and 24 are narrower than the widths of the graphs 16 and 17 displayed at the top of the horizontal axis 13 to which the shooting month is attached. For this reason, it is possible to prevent the entire size of the search range setting image 10A from increasing. Since the graph is divided for each shooting month, it is possible to see at a glance how many images are in which shooting month. Also in this case, a color may be determined in advance corresponding to the shooting month, and a graph of the corresponding color may be displayed. It is possible to grasp the number of frames of an image for each shooting month relatively accurately.
[0058]
Referring to FIG. 7, in search range setting image 10A, right cursor 12B is positioned in search range expansion region 11B. An image photographed in the photographing date and time not less than the lower limit specified by the left cursor 12A is found, and the number of frames is displayed corresponding to the photographing date.
[0059]
On the upper part of the search range expansion area 11B, graph groups 25 and 26 composed of a plurality of graph sets are displayed. Each of these graph groups 25 and 26 corresponds to a shooting year. There is a space between the graph groups 25 and 26. This shows that the shooting years are different. The graph group 25 includes graphs 25A to 25B corresponding to the shooting month, and the graph group 26 includes graphs 26A to 26E.
[0060]
In the case shown in FIG. 7 as well, as shown in FIG. 6, it is easy to know how many images are taken in addition to the image of the shooting date displayed on the horizontal axis 13. It will be understood.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an electrical configuration of an image database apparatus.
FIG. 2 is an example of an image displayed on a display screen.
FIG. 3 is an example of a search range setting image.
FIG. 4 is an example of a search range setting image.
FIG. 5 is a flowchart showing a processing procedure of the image database apparatus.
FIG. 6 is an example of a search range setting image.
FIG. 7 is an example of a search range setting image.
[Explanation of symbols]
2 CPU
3 Input device 4 Image database 5 Display control device 6 Display device
10, 10A Search range setting image
11A, 11B Search range expansion area
12A Left cursor
12B Right cursor
13 Horizontal axis
16, 17, 18A, 18B, 19A-19E, 20A, 20B, 21A, 21B, 23A, 23B, 24A-24E, 25A, 25B, 26A-26E
18, 19, 20, 21, 23, 24, 25, 26 graphs

Claims (2)

A coordinate axis indicating a scale defining a search range, a search range extension area formed on both sides of the coordinate axis, and a position on the coordinate axis corresponding to the scale according to a movement instruction from the user, or the search range First display control means for controlling the display device to display an upper limit mark and a lower limit mark positioned in the extended area on the display screen;
When the upper limit mark and the lower limit mark are positioned on the coordinate axis, data having characteristics determined by a search range between the upper limit mark and the lower limit mark is searched and searched from the database. Second display control means for controlling the display device to display a bar graph representing the number of data on the coordinate axes, and the lower limit in response to the upper limit mark being positioned in the search range expansion region. The search range is the lower limit determined by the scale where the mark is positioned, the data with the characteristics determined by the search range is searched and searched from the database, and a bar graph showing the number of searched data is displayed on the coordinate axis. Or displayed on the search range expansion area where the upper limit mark is positioned and When the lower limit mark is positioned in the search range expansion area, the search range is defined as the upper limit determined by the scale where the upper limit mark is positioned, and data having characteristics determined by the search range is searched. A third display for controlling the display device so as to display a bar graph searched from the database and displaying the number of searched data on the coordinate axis or the search range expansion area where the lower limit mark is positioned. Control means,
Graphical user interface device for search with The first display control means is arranged on the coordinate axis corresponding to the scale according to the coordinate axis on which the scale defining the search range is represented, the search range expansion area formed on both sides of the coordinate axis, and the movement instruction from the user. The display device is controlled to display the upper limit mark and the lower limit mark positioned on the display range or the search range extension area on the display screen,
The second display control means searches for data having characteristics determined by a search range between the upper limit mark and the lower limit mark in response to the upper limit mark and the lower limit mark being positioned on the coordinate axis. The display device is controlled so as to display a bar graph on the coordinate axis, which is searched from the database, and indicates the number of found data.
The third display control means sets the search range to a search range that is not less than the lower limit determined by the scale on which the lower limit mark is positioned in response to the upper limit mark being positioned in the search range expansion region, and is determined by the search range. Search for data having characteristics, search from the database, and display a bar graph indicating the number of searched data on the coordinate axis or the search range expansion area where the upper limit mark is positioned, and the lower limit. In response to the mark being positioned in the search range expansion area, the search range is set to the upper limit determined by the scale on which the upper limit mark is positioned, and data having characteristics determined by the search range is searched and the database is searched. finding from the bar graph representing the number of data sought, the coordinate axis or the lower Third display control means for controlling the display device so as to display on the search range expansion region on which the mark is positioned,
A method for controlling a graphical user interface device for search.

Images