JP2003331258A - Graphical user interface for retrieval - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To increase a retrieval range. <P>SOLUTION: An image photographed on a photographing month in a main retrieval range is found from an image database where an area held by a left cursor 12A and a right cursor 12B is the main retrieval range. The number of frames for the found images is displayed as a graph 17. When the left cursor 12A is positioned at a retrieval range expansion area 11A, all images photographed before the photographing month specified by the right cursor 12B with the right cursor 12B positioned at the upper limit are found out and the number of the frames for the images is displayed. The number of the frames for the images corresponding to the photographing month indicated on an abscissa 13 is displayed correspondingly with the photographing month on the abscissa 13. The number of the frames for the images photographed before the photographing month displayed on the abscissa 13 is displayed at the upper part of the area 11A for each photographing year. The retrieval processing can be performed for not only a range determined by the cursors 12A and 12B but also for the range determined between the upper and lower limits. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a search graphical user interface.

[0002]

BACKGROUND OF THE INVENTION When extracting data stored in a database, keywords are input to the database. Data that matches the entered keyword is extracted from the database. If you are familiar with database operations, you can enter appropriate keywords,
You can find the desired data. However,
It is relatively difficult for a user who is unfamiliar with database operation to input an appropriate keyword.

[0003]

DISCLOSURE OF THE INVENTION Therefore, it is conceivable to display a bar or the like on the display screen of a display device and use the bar to specify a search range. When you specify a search range, data is found in the database that has the characteristics defined by the specified upper and lower bounds.

However, only data having a characteristic within the search range can be searched.

The present invention aims to extend the search range.

The graphical user interface for retrieval according to the present invention moves in accordance with the coordinate axis in which the scale defining the search range is expressed and the movement instruction from the user, and the upper limit of the search range is set. First display control means for controlling the first display device to display the upper limit mark to be defined and the lower limit mark to define the lower limit of the search range on the display screen, the search defined by the upper limit mark and the lower limit mark Retrieval means for retrieving data having a characteristic defined by the range and retrieving it from the database, and second display for controlling the second display device so as to display the result of the data retrieved by the retrieving means on the display screen Control means and range expansion search instruction in which the upper limit mark or the lower limit mark is predetermined In response to the move to location, characterized in that it comprises a search control means for controlling said search means to perform a search process than the lower of the upper or the search range of the search range.

The present invention may provide a method suitable for a graphical user interface for searching. That is, this method is such that the coordinate axis that represents the scale that defines the search range and the upper limit mark that defines the upper limit of the search range and the lower limit of the search range that moves in accordance with the scale according to the user's movement instruction. The lower limit mark that defines the above is displayed on the display screen, the data having the characteristics defined by the search range defined by the above upper limit mark and the above lower limit mark is searched for from the database, and the result of the found data is displayed. The second display device is controlled so as to be displayed on the screen, and the upper limit of the search range or the search range is determined in response to the upper limit mark or the lower limit mark being moved to a predetermined range expansion search instruction position. The search processing is performed below the lower limit of.

A program for carrying out the above method and a recording medium storing such a program may be provided.

The first display device and the second display device may be the same.

According to the present invention, the coordinate axis and the upper limit mark and the lower limit mark are displayed on the display screen of the first display device. Data having a characteristic defined by the search range defined by the upper limit mark and the lower limit mark is retrieved from the database. The result of the found data is displayed on the display screen of the second display device.

When the upper limit mark or the lower limit mark is moved to a predetermined range expansion search instruction position,
The search processing is performed beyond the upper limit or the lower limit of the search range.

The range expansion search instruction position is predetermined, and when the upper limit mark or the lower limit mark is moved to this range expansion search instruction position, the upper limit or the lower limit of the above search range is exceeded (the search range expands). Search processing is performed. It is possible to perform a search in a range beyond the scale defining the search range (extension of the search range).

The second display control means is moved to the range expansion search instructing position and the display mode of the search result obtained when the upper limit mark or the lower limit mark is moved to the range expanding search instructing position. The display mode of the search result obtained when the search is not performed may be changed.

It is preferable that the second display control means displays the search result by the search means in correspondence with the scale.

[0015]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows an embodiment of the present invention and is a block diagram showing an electrical configuration of an image database device.

The overall operation of the image database device is C
It is managed by PU2.

The image database device includes an image database 4 in which image data representing a large number of images is stored. The image database 4 also stores data representing the characteristics of the image data corresponding to the stored image data. The characteristics of the image data include the date when the image was taken, the average brightness of the image, the average saturation of the image, and the ratio of the color of the image.

The input device 3 includes a keyboard, a mouse and the like. A signal for dragging the cursor, a signal indicating that the mouse is clicked, and the like output from the input device 3 are input to the CPU 2.

The CPU 2 temporarily stores V image data representing an image displayed on the display screen of the display device 6.
A RAM (video random access memory) 1 is also connected. The display of images on the display device 6 is controlled by the display control device 5.

FIG. 2 is an example of a window displayed on the display screen of the display device 6.

In the window 20, the search range setting image 10 is displayed in a substantially central portion thereof.

The search range setting image 10 indicates the search range (search condition) of the image database 4. In this embodiment, the shooting date is used as the search range. There is a horizontal axis 13 and this horizontal axis 13 is from April 10
The shooting month (scale) of the moon is displayed. A manipulator that can be moved up, down, left, and right by dragging with a pointer 14 that is moved by a mouse at approximately the center of the horizontal axis 13.
15 is displayed. Also, on the horizontal axis 13, a left cursor (lower limit mark) 12A and a right cursor (upper limit mark) 12A
B is displayed so as to be movable left and right like the operator 15. The range between the left cursor 12A and the right cursor 12B is the main search range. Images corresponding to this main search range (images taken in June to August 2001 in the example of FIG. 2) are found by searching in the image database 4, and the corresponding thumbnail image I is searched as described below. It is displayed in the result display area 30.

The number of frames of the image found by the search (the result of the searched data) is displayed in a graph corresponding to the shooting month. In this embodiment, as will be described later in detail, an image corresponding to the main search range defined by the cursors 12A and 12B can be found by the search, and the shooting month displayed on the horizontal axis 13 beyond the main search range. The image of is also found from the image database 4 by searching. Figure 2
In the example shown in, the horizontal axis 13 shows April to October 2001, so 6 of 2001 from April 2001 to October 2001 is displayed.
Images of the photographed months excluding the months from August to August are further found from the image database 4 (sub-search range). The number of frames in the image corresponding to the main search range is displayed in a black graph (indicated by hatching in FIG. 2) 17, and the number of frames in the image corresponding to the sub-search range (sub-search) is a white graph 16 Is displayed.

On both sides of the horizontal axis 13, search range expansion areas (range expansion search instruction positions) 11A and 11B are formed.
The left cursor 12A is the search range expansion area 11A on the left side of the horizontal axis 13.
When it is positioned at, the image of the photographed month which is less than or equal to the upper limit of the search range defined by the right cursor 12B can be found by the search. Specifically, in the example shown in FIG. 2, since the right cursor 12B is located between August and September 2001, all the images captured before September 2001 are recorded in the image data 4 from the image data 4. can be found. Similarly, when the right cursor 12B is positioned in the search range expansion area 11B on the left side of the horizontal axis 13, an image of a shooting month that is equal to or higher than the lower limit of the search range defined by the left cursor 12A is found. Specifically, Fig. 2
In the example shown in FIG.
Since it is between the moon, all images taken after June 2001 can be found in the image database 4.

The window 20 includes a search result display area 30 for displaying a thumbnail image (not the thumbnail image but the image itself) I of the image found as a result of the search at the lower part thereof. The search result display area 30 includes a horizontal axis and a vertical axis. Brightness is defined on the horizontal axis and saturation is defined on the vertical axis, but it goes without saying that other image characteristics may be used for the axis. However, it goes without saying that the images found by the search may simply be listed and displayed without specifying the horizontal axis and the vertical axis.

FIG. 3 is an example of the search range setting image 10 and shows a case where the left cursor 12A is positioned in the search range expansion area 11A and a search is performed.

As described above, when the left cursor 12A is positioned in the search range expansion area 11A and a search command is given, the main search range is the shooting date which is less than the upper limit defined by the right cursor 12B. Images taken within the main search range can be found in the image database 4. Among the images found by the search (main search), the number of frames of the image corresponding to the shooting month displayed on the horizontal axis 13 is displayed by the black graph 17 as described above. Further, among the images found by the search, the number of frames of the image of the shooting month which is not displayed on the horizontal axis 13 is displayed as a graph for each shooting year in the upper part of the search range expansion area 11A.

A graph 18 is provided above the search range extension area 11A.
And 19 are displayed.

On the other hand, the graph 18 represents the number of frames of the image of the photographed month which does not appear on the horizontal axis 13. Graph 18 includes two regions 18A and 18B. Since the graph 18 includes the two regions 18A and 18B, it can be seen that the photographed images are present for two months in 2001, which is less than April 2001 (January to March 2001). That is, 2001
No images were taken for one month out of April 2001 of the year. Further, it is possible to grasp how many frames there are images from the size of the areas 18A and 18B.

The other graph 19 shows that there are images taken in the year before 2000. The other graph 19
Contains five regions 19A to 19E. The size of each of these areas 19A to 19E represents the number of frames of the image of the shooting month. By looking at the graphs 18 and 19, it is possible to grasp the approximate number of frames of the images taken before the shooting month defined on the horizontal axis 13.

However, the color for each photographing month may be determined in advance. By setting the color of each area included in the graphs 18 and 19 to the color of the corresponding moon, it is possible to confirm how many photographed images exist in which month.

FIG. 4 is an example of the search range setting image 10 and shows a case where the right cursor 12A is positioned in the search range expansion area 11B and a search is performed.

As described above, when the right cursor 12B is positioned in the search range expansion area 11B and a search command is given, the main search range is the shooting date which is equal to or higher than the lower limit defined by the left cursor 12A. Images taken within the main search range can be found in the image database 4. Among the images found by the search, the number of frames of the image corresponding to the shooting month displayed on the horizontal axis 13 is displayed by the black graph 17 as described above. Further, among the images found by the search, the number of frames of the image of the shooting month which is not displayed on the horizontal axis 13 is displayed as a graph for each shooting year in the upper part of the search range expansion area 11B.

A graph 20 is displayed above the search range expansion area 11B.
And 21 are displayed.

On the other hand, the graph 20 represents the number of frames of the image of the photographed month which does not appear on the horizontal axis 13. The graph 20 includes two areas 20A and 20B. Since the graph 20 includes the two areas 20A and 20B, it can be seen that there are captured images for two months from October 2001 (November 2001 and December 2001) after 2001. In addition, area 20
From the size of A and 20B, it is possible to understand how many frames there are images.

The other graph 21 shows that there is an image taken in one year after 2002. The other graph 21
Also contains two regions 21A and 21B. The size of each of these areas 21A and 21B represents the number of frames of the image of the shooting month. By looking at the graphs 20 and 21, it is possible to grasp the approximate number of frames of images taken after the shooting month specified on the horizontal axis 13.

In this case as well, the color for each photographing month may be determined in advance. By setting the color of each area included in the graphs 20 and 21 to the color of the corresponding month, it is possible to confirm which photographed image is in which month.

FIG. 5 is a flowchart showing the processing procedure of the image database device.

It is assumed that the window 20 shown in FIG. 2 is displayed on the display screen of the display device 6.

It is confirmed whether the left cursor 12A or the right cursor 12B is dragged while the operator of the image database device is not dragging the operator 15 (NO in step 41) (step 46). When the left or right cursor 12A or 12B is dragged (YES in step 46), the position after dragging is read (step 47).

It is confirmed whether the left cursor 12A is in the search range expansion area 11A or the right cursor 12B is in the search range expansion area 11B (YES in step 48).

As shown in FIG. 2, when the left cursor 12A is in the search range expansion area 11A, the search is below the upper limit of the main search range defined by the right cursor 12B and the upper limit defined by the right cursor 12B. Then, the search for the image corresponding to the sub-search range of the shooting month displayed on the horizontal axis 13 is executed. Also, as shown in FIG. 3, the right cursor 12
If B is in the search range expansion area 11B, left cursor
The search is performed over the lower limit of the main search range defined by 12A and the image that is less than the lower limit defined by the left cursor 12A and falls within the sub-search range of the shooting month displayed on the horizontal axis 13. . Thumbnail images corresponding to the images found by the search (thumbnail images corresponding to the main search range) are displayed in the search result display area 30 (step 49).

The number of frames of the image corresponding to the shooting month attached to the horizontal axis 13 is displayed above the horizontal axis 13 corresponding to the shooting month. In addition, as described above, the number of frames of the image taken in the shooting month which is not attached to the horizontal axis 13 is displayed as a graph above the search range expansion area 11A or 11B.

If neither the left cursor 12A nor the right cursor 12B is positioned in the search range expansion area 11A or 11B (NO in step 48), the main cursor determined by the left cursor 12A and the right cursor 12B as described above. Search processing is executed based on the search range and the sub-search range defined by the shooting month displayed on the coordinate axis 13 (step 45).

When the operator of the image database device drags the manipulator 15 (YES in step 41), in response to the search command given from the input device 3, after the dragging with the center of the horizontal axis 13 as the origin. The coordinate position of the operator 15 is read (step 42).

When the coordinate position is read, the value of the scale on the horizontal axis 13 is changed based on the read X coordinate value (distance from the center) (step 43). If the X coordinate value is positive, the value is increased, and if the X coordinate value is negative, the value is decreased. The larger the X coordinate value, the larger the change amount, and the smaller the X coordinate value, the smaller the change amount.

Subsequently, the scale of the scale is changed based on the read Y coordinate value (distance from the center) (step 44). Also in this case, if the Y coordinate value is positive, the scale is increased, and if the Y coordinate value is negative, the scale is decreased. Also, if the Y coordinate value is large, the change amount is large,
If the Y coordinate value is small, the change amount is small.

The search is executed within the set main search range and sub-search range, and the thumbnail image I corresponding to the image corresponding to the main search range is displayed in the search result display area 30 (step 45). For example, when the manipulator 15 is dragged in the upward direction, a window 20 with an increased scale is displayed on the display screen of the display device 6 by a new search.

In the above-mentioned embodiment, the manipulator 13 is dragged with the mouse. However, the image database device according to this embodiment is used as a PDA (personal digital assista).
If you want to use it for something like nts), you will have to drag it using a pen device.

Further, in the search result display area 30, thumbnail images of typical images among the images obtained by the search are displayed in advance, and the image is designated by the operator among these typical thumbnail images. Thus, the thumbnail image corresponding to the image similar to the designated image may be displayed in the display area 30.

Further, a program for causing the computer device to perform the above-described operation may be created. In that case, the program may be stored in a recording medium such as a CD-ROM (compact disc-read only memory). When the program is stored in the recording medium, the image database device is provided with a reading device that reads the program stored in the recording medium.

Further, although the image database for searching for an image has been described in the above-mentioned embodiment, it goes without saying that a database for searching for an image as well as other information can be used. Further, the characteristic displayed on the coordinate axis is not limited to the shooting date, but may be other information about the image, brightness, saturation, or the like.

FIGS. 6 and 7 show a modified example,
It is an example of a search range setting image. FIG. 6 corresponds to the search range setting image shown in FIG. 3, and FIG. 7 corresponds to the search range setting image shown in FIG. In these figures, the same parts as those shown in FIG. 3 or FIG.

In the search range setting image 10A shown in FIG. 6, the left cursor 12A is positioned within the search range expansion area 11A. An image photographed in the photographing date less than the upper limit defined by the right cursor 12B is found, and the number of frames thereof is displayed in correspondence with the photographing date.

As shown in FIG. 3, graphs 18 and 19 displayed above the search range expansion area 11A may represent the number of frames of images taken in different shooting months if the shooting years are the same. It is displayed as one graph 18 or 19.
On the other hand, in the search range setting image 10A shown in FIG.
Graph groups 23 and 24 composed of a plurality of graph sets are displayed above the search range expansion area 11A. Each of these graph groups 23 and 24 corresponds to the shooting year. There is a space between the graph groups 23 and 24.
This shows that the shooting years are different. Graph group 23
Includes graphs 23A to 23B corresponding to the shooting month, and the graph group 24 includes graphs 24A to 24E.

On the other hand, the graph group 23 has the same shooting year (2001) as the year of the shooting month displayed on the horizontal axis 13. Horizontal axis 13
It is indicated that there is an image that is the same as the shooting year displayed on the screen, and that has been shot for two months before the shooting month displayed on the horizontal axis 13. Similarly, the other graph group 24 shows the number of frames of images photographed in the year before the photographing year displayed on the horizontal axis 13. By looking at the graphs 24A to 24E that form the graph group 24, it can be seen that there are images taken for 5 months in a certain year before 2001.

The widths of the graphs included in the graph groups 23 and 24 are narrower than the widths of the graphs 16 and 17 displayed above the horizontal axis 13 to which the photographed month is attached. For this reason, it is possible to prevent the entire size of the search range setting image 10A from becoming large. Since the graph is divided for each shooting month, you can see at a glance how many images are in which shooting month. In this case also, the color may be determined in advance corresponding to the shooting month and the graph of the corresponding color may be displayed. The number of frames of the image for each shooting month can be grasped relatively accurately.

Referring to FIG. 7, in search range setting image 10A, right cursor 12B is positioned within search range expansion area 11B. An image photographed in a photographing date equal to or higher than the lower limit defined by the left cursor 12A is found, and the number of frames thereof is displayed corresponding to the photographing date.

Graph groups 25 and 26 each composed of a plurality of graph sets are displayed above the search range expansion area 11B. Each of these graph groups 25 and 26 corresponds to the shooting year. There is a space between graph groups 25 and 26. This shows that the shooting years are different. Graph group 25 includes graphs 25A corresponding to the shooting month.
25B is included, and the graph group 26 includes graphs 26A to 26A.
E is included.

In the case shown in FIG. 7 as well, as in the case shown in FIG. 6, it is possible to grasp how many images are taken in addition to the image of the shooting date displayed on the horizontal axis 13. Will be easily understood.

[Brief description of drawings]

FIG. 1 is a block diagram showing an electrical configuration of an image database device.

FIG. 2 is an example of an image displayed on a display screen.

FIG. 3 is an example of a search range setting image.

FIG. 4 is an example of a search range setting image.

FIG. 5 is a flowchart showing a processing procedure of the image database device.

FIG. 6 is an example of a search range setting image.

FIG. 7 is an example of a search range setting image.

[Explanation of symbols]

2 CPU 3 Input device 4 Image database 5 Display control device 6 Display device 10, 10A Search range setting image 11A, 11B Search range expansion area 12A Left cursor 12B Right cursor 13 Horizontal axis 16, 17, 18A, 18B, 19A to 19E, 20A, 20B, 21A,
21B, 23A, 23B, 24A-24E, 25A, 25B, 26A-26
E Graph 18, 19, 20, 21, 23, 24, 25, 26 Graph group

Claims (3)

[Claims] 1. A coordinate axis on which a scale defining a search range is displayed, and an upper limit mark that defines the upper limit of the search range and a lower limit of the search range that move according to the scale according to a user's movement instruction. First display control means for controlling the first display device so as to display the specified lower limit mark on the display screen, and search for data having characteristics defined by the search range defined by the upper limit mark and the lower limit mark. Means for searching the database from the database, second display control means for controlling the second display device to display the result of the data found by the searching means on the display screen, and the upper limit mark or the lower limit. Depending on whether the mark has moved to a predetermined range expansion search instruction position, the upper limit of the search range or the search range A search graphical user interface comprising search control means for controlling the search means so that the search processing is performed beyond the lower limit of the range. 2. The second display control means displays a search result obtained when the upper limit mark or the lower limit mark is moved to the range expansion search instruction position and the range expansion search instruction position. The graphical user interface for search according to claim 1, which is different from the display mode of the search result obtained when the user has not moved to. 3. The search graphical user interface according to claim 1, wherein the second display control means displays the search result by the search means in correspondence with the scale.