JPH07271814A - Electronic filing device for retrieving data from visual position or shape without requiring keyword - Google Patents

Abstract

PURPOSE:To provide a picture retrieving device capable of retrieving picture information to be registered without requiring the registration of additional data such as a title value and a keyword and the design of title structure. CONSTITUTION:The picture retrieving means for storing and retrieving picture information is provided with a means for storing plural pictures together with retrieving information corresponding to each picture, icons 71 to 77 corresponding to plural prescribed picture information out of the stored picture information and allowed to be pointed out by a pointer, a displaying means for displaying the icons 71 to 77 and the pointer on a screen, and a means for retrieving picture information corresponding to a certain retrieving information by specifying the retrieving information and retrieving picture information corresponding to a certain icon specified by the pointer out of the plural icons 71 to 77.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image retrieving apparatus such as an image filing apparatus for registering and retrieving images.

[0002]

2. Description of the Related Art In recent years, an image such as a large amount of documents is read by a scanner (two-dimensional scanning device), the read image is stored in an optical disc, and the stored arbitrary image is searched and read out. Output it to an output device such as C
2. Description of the Related Art An image filing device that outputs (displays or prints) in a state that can be viewed by an RT display device or a recording device has been put into practical use.

In the electronic file search operation in this case, a logical search is mainly performed by using a title value and a keyword assigned at the time of registration as a clue. However, for that purpose, it is necessary to design the title structure, assign the title value, and add the keyword in consideration of later retrieval at the time of registration, which is a serious obstacle to promotion of electronic conversion of paper files.

[0004]

In consideration of the above problems, the present invention registers additional data such as a title value and a keyword and designs a title structure for the purpose of searching when registering image information. It is an object of the present invention to provide an image search device that does not need to be operated.

[0005]

SUMMARY OF THE INVENTION The present invention relates to an image search apparatus for storing image information and searching it, and storing a plurality of images together with search information corresponding to each image;
An icon corresponding to a predetermined plurality of pieces of screen information among the screen information, the icon being capable of being designated by a pointer, and a display unit for displaying the pointer on the screen; Means for searching screen information corresponding to the search information by specifying information, and further searching for screen information corresponding to the icon specified by the pointer; Is.

According to the present invention, in an image retrieving apparatus for retrieving and retrieving image information, storage means for storing a plurality of images together with retrieval information corresponding to each image; and a predetermined plurality of the screen information. It corresponds to the screen information of, and can be specified by the pointer.
First display means for displaying an icon and the pointer on the screen; and one corresponding to the screen information of one screen of the screen information, which can be designated by the pointer. Second display means for displaying on the screen a second icon displayed in contact with one icon;
Means for searching screen information corresponding to the search information by specifying the search information, and further searching for screen information corresponding to the first icon or the second icon specified by the pointer. This is an image search device characterized by the above.

According to the present invention, in an image retrieving apparatus for retrieving and retrieving image information, storage means for storing a plurality of images together with retrieval information corresponding to each image; and a predetermined screen among the screen information. An icon corresponding to information,
An icon capable of designating this with a pointer, and display means for displaying the pointer on the screen;
First determining means for determining whether or not the operator has input to the image retrieval device; and second for determining whether or not the pointer has designated the icon when input is made by the first determining means. Determination means; and the second
Indexing means for indexing the search information of the image information corresponding to the icon when the determining means determines that the pointer has designated the icon; and the search information indexed by the indexing means. And a display unit for displaying the image information searched by the searching unit; and an image searching apparatus for displaying the image information searched by the searching unit.

According to the present invention, in an image retrieving apparatus for retrieving and retrieving image information, storage means for storing a plurality of images together with retrieval information corresponding to each image; and a predetermined plurality of the screen information. It corresponds to the screen information of, and can be specified by the pointer.
First display means for displaying an icon and the pointer on the screen; and one corresponding to the screen information of one screen of the screen information, which can be designated by the pointer. Second display means for displaying on the screen a second icon displayed in contact with one icon;
First determining means for determining whether or not the operator has input to the image search device; and determining whether or not the pointer has designated the first icon when input is made by the first determining means. Second determining means; and determining the plurality of search information of the plurality of image information corresponding to the first icon when the second determining means determines that the pointer has designated the first icon. 1 indexing means; a third display means for displaying a plurality of third icons according to the plurality of search information indexed by the first indexing means; and a third display means. Third judgment means for judging whether or not at least one of the plurality of third icons is designated by the pointer; and, if it is judged by the third determination means that the third icon is designated, It said second indexing means for indexing the search information according to the third icon that is a constant; and, the second
First searching means for searching the image corresponding to the search information by the indexing means; fourth displaying means for displaying the image information searched by the first searching means; and the second icon for displaying the image information. Third determining means for determining whether or not the pointer is designated; and third indexing means for determining the search information corresponding to the second icon when it is determined to be designated by the third determining means; A second search means for searching the image corresponding to the search information by the third indexing means; and a fifth display means for displaying the image searched by the second search means. An image search device characterized by the following.

[0009]

With the above structure, the present invention forms the binder icon corresponding to the image information on the screen, and specifies it with a pointer such as a mouse to specify the document to be searched. This allows you to register additional data such as title values for search, keywords, etc.
There is no need to design the title structure. Further, by providing such a screen, it becomes possible to perform document management and search closer to the world of ordinary paper files.

[0010]

[Embodiment] In order to reduce the burden of registration work of image information using an electronic filing device and promote the conversion to an electronic file, it is necessary to provide a means that enables a search without adding a keyword. is there. For that purpose, it is desirable that the clue of the search is not the character string that requires keyboard input such as the title value or the keyword but the icon on the screen.

In the ordinary paper file world, a document is searched by a method such as "a document put in the middle of a binder" or "a page marked with sticky notes." The present invention introduces the concept into the world of electronic files, and proposes a means for performing a search from the visual position and shape of an icon on the screen.

An embodiment of the present invention will be described below with reference to the drawings. FIG. 10 shows an example of the configuration of the image retrieval apparatus of the present invention, for example, an electronic filing apparatus.

That is, the electronic filing apparatus 1 in this figure is connected to each other via a network 2, and has a control module 10, a memory module 12, an image processing module 14, a communication control module 16, and a scanner apparatus 1.
8. Optical disk 20 and optical disk device 22, keyboard 23, CRT display device 24, printer device 25, magnetic disk 26 and magnetic disk device 27,
It is composed of a mouse 29, a system bus 30, and an image bus 32.

The control module 10 includes a CPU 34 for performing various controls for storing, retrieving and editing images.
And an interface circuit 36.
The interface circuit 36 is used in the optical disc device 2
2. The magnetic disk device 27, the keyboard 23 and the mouse 29 are connected to the CPU 34.

The memory module 12 is a main memory 38 for storing various control programs for image storage, retrieval, editing, etc., and management information, and an image having a storage capacity corresponding to several pages of an A4 size document. Memory as a page
The memory 40, a display memory 42 as a display interface, a display controller 44, and the like.

Displayed in the main memory 38 at the time of page turning or document turning (described later) (optical disk 2).
A record recall table 38a is provided in which a list of image record numbers (read from 0) is stored. As shown in FIG. 2, the record calling table 38a stores a document number, a page number, and a record number in association with each other, and also serves as an identifier used in the second mode described later. Extraction flag (identification flag)
An extraction flag storage area to which is added is provided corresponding to each record number. The value of the pointer PTR for scanning the record calling table 38a is the CPU 34.
Is stored in the internal memory 34a.

The record calling table 38a may be composed of only a record number storage area and an extraction flag storage area. A buffer memory area 40a is provided in a part of the page memory 40. The buffer memory area 40a is controlled to write and read by a counter (not shown). The page memory 40 is a memory for temporarily storing, for example, an image stored in the optical disc 20 or an image read from the optical disc 20. Further, the display memory 42 is the CRT display device 2
It is for temporarily storing the image displayed by 4. In the display memory 42, the image actually displayed in the display window of the CRT display device 24, that is, the image in the page memory 40 is enlarged, reduced, rotated, inserted, or inverted in black and white. The stored images are stored. Display control unit 4
Reference numeral 4 controls the display processing of the CRT display device 24.

The image processing module 14 includes an enlarging / reducing circuit 46 for enlarging and reducing an image, a vertical / horizontal converting circuit 48 for rotating an image, and an image compression (encoding process for reducing redundancy. A compression / decompression circuit (CODEC) 50 for performing a decoding process for applying and expanding (restoring the reduced redundancy), a scanner interface 52 for the scanner device 18, and a printer interface for the printer device 25. The internal bus 56 connects the face 54, the enlarging / reducing circuit 46, the vertical / horizontal converting circuit 48, the compression / expansion circuit 50, the scanner interface 52, and the printer interface 54.

The compression / expansion circuit 50 uses an MH (Modify).
ed Huffman) method or MR (Modi)
Bandwidth compression or bandwidth expansion is performed using a fied read) method or the like.

The communication control module 16 is, for example, an LA.
BCP (Bus Communicat) connected to N
Ion Processor) and other communication interfaces
It is composed of a space 58. In addition, the communication control module 16 is connected to an external device such as an FCP (facsimile connection mechanism) or a personal computer through an interface, and a UCP (Universal Communicat).
Ion Processor) may be provided.

The system bus 30 is a bus for control signals of various devices, and includes a control module 10 and a memory module.
The module 12, the image processing module 14, and the communication control module 16 are connected to each other. The image bus 32 is an image bus and connects the memory module 12, the image processing module 14, and the communication control module 16.

The scanner device 18 is, for example, a two-dimensional scanning device and obtains an electric signal corresponding to an image on the original by scanning the original (document) two-dimensionally with a laser beam.

The optical disk device 22 is a scanner device 18.
The images read by the method are sequentially stored in the optical disc 20. Further, the optical disc 20 is searched for an image corresponding to the search information designated by the keyboard 23 or the like.

The key board 23 is specific retrieval information corresponding to the image stored in the optical disc 20 and storage, retrieval,
It is for inputting various operation commands for editing processing and the like.
The mouse 29 is, for example, the CRT display device 2
By moving the cursor (not shown) displayed on the display window of 4 up and down, left and right, and giving an instruction at the desired position, the display contents (various contents of the cursor are displayed) CRT for selecting or instructing area designation or icon etc. for image editing
The display device (cathode ray tube display device) 24 displays an image read by the scanner device 18, an image retrieved from the optical disc 20, and the like. This CRT
The display area for displaying the image of the display device 24 is
A multi-window display device capable of simultaneously displaying six images by using display windows capable of being divided into 1, 2, and 46, that is, a maximum of six display windows. The image data displayed in each display window is
Editing processing such as enlargement, reduction, and rotation scroll is independently performed.

Further, FIG. 1 is an explanatory view showing a search step of the electronic filing apparatus in one embodiment of the present invention, and FIG. 2 shows a guidance line area and a bookmark area in a binder icon in one embodiment of the present invention. It is a top view.

FIG. 1 is a search screen of the electronic filing apparatus according to the present invention, and FIG. 1A is an initial screen of this search screen, which is a binder 1 to a plurality of collections of files which are units of image information. 4 binder icons 7
1, 72, 73, 74 are displayed on the screen. Further, on the binder 3 73 and the binder 4 74, icons 75 to 77 imitating bookmarks are displayed.

(B) is a screen that appears when the binder 2 is clicked with a mouse in (a), and a plurality of files 78 to 82 possessed by this binder are displayed on the screen. (C)
Is a search screen that appears when the bookmark 76 of the binder 4 is clicked with a mouse in (a), and the screen of the file 83 corresponding to the bookmark 76 is displayed.

In FIG. 2, for example, the icon 91 of the binder 3 has six guide lines 111 to 116 and the cover sheet 1.
It is composed of 17 and. Here, in FIG. 1A, each of the binders 71 to 74 is composed of a plurality of guidelines clickable with a mouse and a cover of the binder. On this cover, the number of documents that this binder has and the total number of pages of this document are displayed.
FIG. 2 shows the details of the binder, which is representative of a plurality of predetermined files, in which a guideline 111 that can be clicked with a mouse in the area G is shown, and the other guidelines 112 to 116 are also almost the same. It has a similar clickable area. The bookmark icon corresponding to only one file can be mouse-clicked on the area S.

In FIG. 1A, when searching for a file on this screen, the user uses a mouse to select an appropriate binder from among the binders 71 to 74 so as to search for a document in an actual binder. Click a guideline with the mouse. As a result, the files 78 to 82 corresponding to the guidelines of the clicked binder are displayed as shown in (b). This screen allows the user to determine whether the file they are looking for is included in a file that complies with this guideline, and if not, return to the screen in (a), click the nearby guideline, and click Display the file according to the guideline on the screen and search.

The bookmark icon 75 shown in FIG.
Items 77 to 77 correspond to one file, and can be freely set by the user, as in the case of using a bookmark in filing in the real world. On the screen of (a), the user sets the bookmark icon 7
By clicking 6 with the mouse, a screen (c) is obtained. On this screen, the file 83 corresponding to the bookmark icon 76 can be confirmed, and it can be confirmed whether or not the file is a desired file.

FIG. 3 is a flow chart showing the process of creating the screen of the binder icon in the embodiment of the present invention. As an example, the electronic filing device of the present invention creates a binder icon screen for search by the following procedure.

An optical disk to be searched is loaded, and a database for table management is constructed on the hard disk from image information and history information on the optical disk (S1).
Next, the database on the hard disk contains information on how images on the optical disc are managed (number of binders, binder name, total number of documents in the binder, total number of pages, total number of pages of each document, title information). , The image record number, the record number of the bookmarked image, etc.) are managed in a table and the necessary information is returned in response to an inquiry from the search application side.

Since the first operation in the search operation is binder selection, the binder information (the number of binders, the name of the binder, the total number of documents in each binder, the total number of pages, and the information of the bookmarked image (the number and which document (S2), a search screen is created based on the information, that is, i = 0 is set to form the binder icons for the number of binders (S3), i
The first binder icon is formed (S4). Next, the i-th name of the binder is formed as an icon label (S5). Next, based on the number of documents and the number of bookmarks in the binder i, it is determined how many guidelines and bookmarks are to be imaged (S6). Next, a clickable guideline is created as a visible image (S7). Next, a clickable bookmark is formed as a visible image on the screen (S8). Next, i = i + 1 is set and incremented (S9). Here, it is determined whether i is satisfied with the initial number of binders (S10). If there is a shortage, the process returns to step 4, and if completed, the user waits for input until the user clicks this icon and starts searching (S11).

FIG. 4 is a flow chart showing a process of searching for a file by the binder icon in the embodiment of the present invention. In the search screen of FIG. 1, first, it is confirmed whether or not there is an operator's input (S21). For example, if there is a mouse click, it is determined whether or not this is on the binder icon (S22). Return to the beginning. Next, it is determined whether or not the mouse click is on the bookmark (S23). If it is on the bookmark, the bookmark ID is used to determine which bookmark, and the record number of the file information corresponding to the bookmark. Is confirmed (S26). Furthermore, this record number. Is displayed (S30).

If the mouse click is not on the bookmark, it is determined whether the mouse click is on the guideline (S24). If it is on the guideline, determine which document on the guideline was selected, and record the record number. (S25), and the record number. Is displayed (S30).

If the mouse click is not on the guideline, information on all the documents in the binder is taken into the buffer (S27), and a list of this document is displayed (S2).
8). Next, record N of the document selected by the operator
o. (S29), and the record number. The document is displayed (S30). By performing the search according to the above procedure, it is possible to narrow down the images desired by the user without a keyword, title value, document name, or the like.

The icon image forming or retrieval procedure of the present invention will be described in more detail below. That is, for the screen to be searched, screen data that is a prototype is created in advance on the hard disk. Parts such as function keys and binder icons are placed on the screen data, and the toolkit library of the screen display controls the visibility of these individual parts and the attributes of whether they respond to mouse clicks. Then, display and event processing are performed according to the request from the application. Guidelines and bookmarks are invisible on the binder selection screen data,
Insert a space etc. in the character string displayed on the icon.

Next, the binder icon is supported in the library as an editor part of the toolkit library. When a mouse click occurs in the area, an editor component such as a button is flipped and returns an ID indicating which button is pressed to the application. In that application,
Decide the area of the icon, draw a picture of the binder on it,
Include guidelines.

The number of guide lines is specified by the application at the time of creating a part, as in the case where the number of button editors can be specified. A mouse click event that occurs on the area of this guideline is processed by the toolkit library, and the ID of the number of the guideline clicked is returned to the application. The same event processing is performed for the protruding portion corresponding to the bookmark. In addition, it is set up so that whether or not to react to mouse clicks and whether or not to make the guideline and bookmark visible can be individually set.

The toolkit library can load the layout and attributes of each part from a data file, and creates a screen based on that information. The binder selection screen for search is created from the binder information and the screen data. Load the screen data, change the character string on the icon to the binder name, the number of documents, the number of pages, and determine the visibility of the guideline from the number of documents and the number of pages. When there is a bookmark, which document is attached, and the position of the document is calculated from the document number managed in ascending order in the binder. Then decide which guideline part of the guideline is visible and responds to mouse clicks. Display the screen when all the data has been created.

On this display screen, the user selects a guideline or a bookmark portion on the icon with the mouse.
Here, which guideline and which bookmark section has been selected are returned to the application via the toolkit library, so that the application can determine the number of the selected document based on the ID (the document number table in the binder). use). Then, the image record numbers of several documents before and after the document at the selected position are inquired and obtained in the database, and the images are displayed as a list.

At this time, even when there is no search image in the image list, since the image is narrowed down to some extent, it is possible to obtain the desired image by the page turning function and the document turning function. When the bookmark part is selected, the record number of the bookmarked image in the binder is obtained from the database, the record number of the image to be displayed is determined from the ID indicating which bookmark part was selected, and the direct purpose is set. To display the image.

FIG. 5 is an example of a software configuration diagram in one embodiment of the present invention. In FIG. 5, this software is the operation software OS 106.
The filing database DB 103 and the image input control unit 104 are built on the server software DFS1 for bridging the application software 101.
02 is built. Furthermore, the application software 10 is added to the operation software OS 106.
An image input / output control unit X105 is provided for the first unit.

Further, FIG. 6 is a diagram showing the relationship between the binder information timetable and the screen data in one embodiment of the present invention. In FIG. 6, as an example of data in the case of three binders, the binder name, the number of documents, the number of bookmarks, and the document number of a document with bookmarks. There is.
In this case, the other binders are invisible on the screen.

FIG. 7 shows the icon on the screen and the binder No. in the embodiment of the present invention. It is a table showing a relation with. In this figure, corresponding to the icon ID,
Binder No. , The number of guidelines, and the number of bookmarks exist as parameters.

FIG. 8 is a table showing the correspondence between the guideline ID on each icon and the document ID of the bookmark ID in one embodiment of the present invention. In this figure, each icon has a plurality of guidelines, and each guideline is registered in correspondence with a plurality of (possibly single) documents. Furthermore, the guideline icon may have a bookmark, and the bookmark is registered corresponding to some documents.

FIG. 9 is a plan view of the binder icon showing the relationship between the guideline, the number of documents and the bookmark in one embodiment of the present invention. If the number of documents is small,
As shown in (a), the guideline for each document is entered, and if there are many documents, the guideline cannot be entered for each document. Therefore, as shown in (b), the guideline is entered in units of 10, 50 documents. As shown in (c), when there is a bookmarked image, the bookmarked portion is projected.

Furthermore, the following is an example of the binder icon of the present invention. Binder icon data structure Data name Contents editorRect Part area editorState Part-wide attribute (visible or invisible, etc.) bin-iconLabel Binder name numDocGuideLine Number of guidelines docGuideLineStates Guideline pointer to each attribute (visible or invisible, Etc.) guideLineRects Guideline Pointer to each area numBookMark Number of bookmarks bookMarkStates Bookmark Pointer to each attribute (whether visible or invisible) bookMarkRects Bookmark Pointer to each area Where the above attributes are Visible (VISIBLE),
Two attributes bit that responds to mouse click (SENSITIVE)
Is expressed as an OR.

Furthermore, the following is an example of the contents of the return event to the CPU. Contents of return event ID of icon; What number icon on screen? Which part of the icon happened; on the guidelines,
IDs of other parts on bookmarks; guideline or bookmark I
D Here, since each editor component manages the area on its own screen, the ID of the event generating component is returned depending on whether or not the mouse click occurred within its management area.

The features of the present invention described above include the following points: (1) A guideline indicating a document is put in the binder of the binder, and the document is visually narrowed down to perform the search. (2) When there is a bookmarked image, an image in which the bookmark portion is projected from the binder icon is created to facilitate selection of the bookmarked image. (3) It is not necessary to add a title value or a keyword when registering an image.

[0051]

As described above, according to the present invention, it is possible to perform a visual search in a search of an electronic filing apparatus, and it is not necessary to add a title structure, a title value, and a keyword at the time of registration. In addition, the ability to perform a visual search brings the world of electronic files closer to the world of paper files, and provides humans, machines, and interfaces that are easy for beginners to understand.

Further, the conventional electronic filing apparatus has been optimized for organizing the fixed format documents in the office, but by incorporating this search method, the personal fixed format documents can be converted into electronic files. (If you know where you put it, you can search from it).
It can be said to be a useful search tool for promoting the use of electronic filing in personal / small groups.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing a search stage of an electronic filing device according to an embodiment of the present invention.

FIG. 2 is a plan view showing a guidance line area and a bookmark area in the binder icon according to the embodiment of the present invention.

FIG. 3 is a flowchart showing a process of creating a screen of a binder icon according to the embodiment of the present invention.

FIG. 4 is a flowchart showing a process of searching for a file by a binder icon according to an embodiment of the present invention.

FIG. 5 is a block diagram of software according to an embodiment of the present invention.

FIG. 6 is a diagram showing a relationship between a binder information timetable and screen data in one embodiment of the present invention.

FIG. 7 shows an icon on the screen and a binder No. in the embodiment of the present invention. A table showing the association with.

FIG. 8 is a table showing the correspondence between the guideline ID on each icon and the document ID of the bookmark ID according to the embodiment of the present invention.

FIG. 9 is a plan view of a binder icon showing the relationship between the guideline, the number of documents, and the bookmark in one embodiment of the present invention.

FIG. 10 is a block diagram showing the overall configuration of an electronic filing device according to an embodiment of the present invention.

[Explanation of symbols]

 20 ... Optical disc 22 ... Optical disc device 23 ... Keyboard 24 ... CRT display device 25 ... Printer device 26 ... Magnetic disc 27 ... Magnetic disc device 29 ... Mouse 34 ... CPU 38 ... Main memory 38a ... Record calling table Bull 40 ... Page memory 71-74 ... Binder 75-77 ... Bookmark 78-83 ... Document 111-116 ... Guidance area

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI technical display location G06T 1/00

Claims (4)

[Claims] 1. An image search apparatus for storing image information and searching the image information, storing means for storing a plurality of images together with search information corresponding to each image; and a predetermined plurality of screen information among the screen information. A corresponding icon, which can be designated by a pointer, a display unit for displaying the pointer on the screen; and screen information corresponding to the search information by designating the search information And a means for searching screen information corresponding to the icon designated by the pointer; and the image search apparatus. 2. An image search apparatus for storing image information and searching the image information, storing means for storing a plurality of images together with search information corresponding to each image; and a predetermined plurality of screen information among the screen information. Corresponding to a first icon which can be designated with a pointer, first display means for displaying the pointer on the screen, and corresponding to screen information of one screen of the screen information And a second display means for displaying the second icon displayed on the screen in contact with the first icon, and the search information. Means for searching screen information according to the search information, and further searching for screen information corresponding to the first icon or the second icon designated by the pointer; Image retrieval apparatus according to claim. 3. An image search apparatus for storing image information and searching the image information, storing means for storing a plurality of images together with search information corresponding to each image; and corresponding to predetermined screen information among the screen information. An icon, which can be designated by a pointer, and a display means for displaying the pointer on the screen; and a first judgment for judging whether or not the operator has input to the image search device. Second determining means for determining whether or not the pointer has designated the icon when an input is made by the first determining means; and the pointer designates the icon by the second determining means. Indexing means for indexing the search information of the image information corresponding to the icon, and the search information indexed by the indexing means, An image retrieval apparatus comprising: a retrieval unit that retrieves the image corresponding to it; and a display unit that displays the image information retrieved by the retrieval unit. 4. An image search apparatus for storing image information and searching the image information, storing means for storing a plurality of images together with search information corresponding to each image; and a predetermined plurality of screen information among the screen information. Corresponding to a first icon which can be designated with a pointer, first display means for displaying the pointer on the screen, and corresponding to screen information of one screen of the screen information Second display means for displaying on the screen a second icon displayed in contact with the first icon, which can be designated by a pointer; First determining means for determining whether or not the pointer has designated the first icon when there is an input in the first determining means; First determining the plurality of search information of the plurality of image information corresponding to the first icon when the second determining means determines that the pointer has designated the first icon. Indexing means; third display means for displaying a plurality of third icons corresponding to the plurality of search information indexed by the first indexing means; and the third display means for displaying the plurality of third icons. Third determining means for determining whether at least one of the plurality of third icons is designated by the pointer; and, when it is determined by the third determining means that the third icon is designated, the designated third icon The second indexing means for indexing the search information according to the first search means for searching the image corresponding to the search information by the second indexing means; and the first search means. Fourth display means for displaying the searched image information; third determination means for determining whether the second icon is designated by the pointer; and it is determined that the third determination means is designated. In this case, third indexing means for indexing the search information corresponding to the second icon; second search means for searching the image corresponding to the search information by the third indexing means; Fifth, displaying images searched by the searching means
An image retrieval device comprising: a display unit;