JPH08329097A - Image data retrieval device - Google Patents

Abstract

PURPOSE: To facilitate the setting of retrieval conditions at the time of retrieval of a similar image by storing image data together with additional information, and extracting additional information of optionally set image data and automatically setting retrieval conditions of desired image data from the stored image data group. CONSTITUTION: When image data retrieval is selected, an image data retrieving process for retrieving a desired image from a data base recorded on a hard disk, etc., is performed and image data on which the retrieval is based is specified. To perform retrieval on an image map with the distance from the image data, retrieval information is automatically set. At this time, additional information related to the image data is set and the image data is stored together with the additional information. Then arbitrary image data is specified and the additional information of the specified image data is extracted. Then the extracted additional information is automatically set as a retrieval condition for obtaining the stored image data. Consequently, retrieval conditions can easily be set.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image data search device, and more particularly to an image data search device in which search conditions can be easily set.

[0002]

2. Description of the Related Art Conventionally, an apparatus has been proposed in which a keyword is added to image data and the keyword is designated to search for an image to which the keyword is added.

[0003]

The conventional apparatus for retrieving image data is configured as described above. However, according to this conventional technique, it is necessary to consider what kind of keyword is set before search. There is a case where it is desired to retrieve an image similar to a certain image, but according to this conventional technique, a keyword expressing this image must be examined and set, which is troublesome.

The present invention has been made to solve the above problems, and an object of the present invention is to provide an image data search device in which search conditions can be easily set when searching for similar images. And

[0005]

According to a first aspect of the present invention, there is provided an image data searching apparatus, wherein a means for setting additional information related to the image data, a means for storing the additional information together with the image data, and an arbitrary image data are designated. Means for extracting the additional information of the designated image data, and means for automatically setting the extracted additional information as a search condition for obtaining desired image data from the stored image data group.

In the image data retrieving apparatus according to the second aspect, the automatic setting means of the first aspect includes means for adding or changing the retrieval condition.

[0007]

In the image data retrieving apparatus according to the first aspect, the image data is stored together with the additional information related to the image. When any image data is specified, the additional information of the specified image data is extracted, and the search condition of the desired image data from the saved image data group is automatically set based on the extracted additional information. It

In the image data search device according to the second aspect, the automatically set search conditions can be added or changed.

[0009]

【Example】

<Overall Configuration of Device> An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a schematic perspective view showing the configuration of an information processing apparatus (hereinafter referred to as a system) applied to an image data search apparatus (/ design support system) according to the present invention. The system 100 includes a control device 1 which is mainly composed of a CPU and controls the entire system, a display 2 which displays images or characters and performs various displays for operation, and various input and instruction operations. Keyboard 3 and mouse 4, a floppy disk 5 and a hard disk 6 which are data storage media, a printer 7 for outputting image data or drawings created by image organization, a scanner 8 for capturing image data, It comprises a CD-ROM device 9, a speaker 10 for voice output, and a microphone 11 for voice input. In the figure, arrows indicate the direction of data flow.

FIG. 2 is a block diagram centering on the control device 1 shown in FIG. Referring to FIG. 2, the control device 1
For example, CP such as Intel product number i80486DX
It is constructed around U201. The CPU 201 has
From the ROM 203 in which programs and the like for controlling the system 100 via the data bus 220 are stored, the RAM 204 in which data and programs are stored, the display control circuit 205 for displaying images or characters on the display 2, and the keyboard 3 Keyboard control circuit 206 for controlling the transfer of the input from the mouse 4, a mouse control circuit 207 for controlling the transfer of the input from the mouse 4, and the floppy disk 5
Floppy disk control circuit 208 for controlling the hard disk and a hard disk control circuit 209 for controlling the hard disk 6
And a printer control circuit 2 for controlling the output to the printer 7.
10 and a scanner control circuit 211 for controlling the scanner 8
A CD-ROM control circuit 212 that controls the CD-ROM device 9, a speaker control circuit 213 that controls the speaker 10, and a microphone control circuit 214 that controls the microphone 11 are connected.

A clock 202 for generating a reference clock necessary for operating the present system is connected to the CPU 201, and an expansion slot 2 for connecting various expansion boards via a data bus 220.
15 are connected. In addition, the SCS is installed in the expansion slot 215.
The I board may be connected to connect the floppy disk 5, the hard disk 6, the scanner 8 and the CD-ROM device 9.

In the above system, the floppy disk 5 and the hard disk 6 are used as the image data storage medium, but this may be another information storage device such as MO (magneto-optical disk). The image data input device includes a scanner 8 and a CD-ROM device 9
However, this may be another input device such as a still video camera. Although the printer 7 is used as the output device, it may be another output device such as a digital copier.

Further, in this embodiment, the program for controlling the system is stored in the ROM 203, but it is conceivable that the program relating to the present invention is read and executed by a device such as a personal computer.

<Program> FIG. 3 is a flowchart showing a main routine of a program of the image information retrieval apparatus (/ design support system) according to the present invention using the system 100 of FIGS. 1 and 2.

Referring to FIG. 3, when the program is started, first, in step S1 (hereinafter abbreviated as step), initialization processing such as initialization of flags and the like necessary for each of the following processing, initial screen display, etc. is performed. Is performed. Next, the menu screen is displayed on the display 2,
It is determined whether an item is selected from the menu (S2). If the map creation is selected in S2, the process proceeds to a map creation process (S3) that performs processes such as creating various maps used in the search. When the map setting is selected, a map setting process (S4) such as selecting and setting a map to be used in the search is performed. When the image data input is selected, an image data input process (S5) for performing a process such as capturing an image from an image input device such as the scanner 8 is performed. When the image data search is selected, an image data search process (S6) for performing a process of searching for a desired image from the database recorded in the hard disk 6 or the like is performed. When the image data organization is selected, an image data organization process (S7) for performing a grouping of image data or a panel creation for collage is performed. If a presentation is selected, a presentation process (S to perform a process of presenting image data) (S
8) is performed, and if the printing is selected, a printing process (S9) for printing the image data is performed. When other menu is selected, other menu processing (S
If no selection is made on the menu screen, the program proceeds to other processing (S11) without doing anything. A detailed description of the above steps S3 to S9 will be given later.

When all the processing is completed, the program returns to step S2, and the same processing is repeated thereafter. In addition,
The other menu processing (S10) and the other processing (S11) are basically the same as those of the conventional search system and are not directly related to the invention of the present application, and therefore description thereof is omitted.

FIG. 4 is a flow chart showing the details of the map creating process shown in FIG. Referring to FIG. 4, when the map creation process is started, it is first determined whether or not an image map is created (S31), and if YES, the process proceeds to the image map creation process (S32). If NO, this process is skipped. Next, it is determined whether or not to create a keyword map (S33). If YES, the process proceeds to a keyword map creation process (S34), and if NO, this process is skipped. Further, it is determined whether or not to create an icon map (S35), and if YES, the process proceeds to an icon map creating process (S36), and if NO, this process is skipped. Finally, it is determined whether or not to create a voice map (S37), and if YES, a voice map creation process (S3).
The process proceeds to 8), and if NO, skips this process and returns.

Image map creation processing of S32, S34
The details of the keyword map creation process of S, the icon map creation process of S36, and the voice map creation process of S38 will be described later.

Of the various maps created in FIG. 4, examples of image maps, keyword maps and icon maps displayed on the display 2 are shown in FIGS. In the figure, each map has a two-dimensional axis, and an image, keyword or icon is arranged on each axis. With reference to FIGS. 5 to 7, a menu bar 21 for selecting each work is displayed on the screen of the display 2. On each map, a toolbar 22 for selecting a tool for working on the map and a current layer name 23 indicating the layer of the displayed map are displayed.

FIG. 8 is a flow chart showing the details of the image map creating process shown in FIG. Here, an image map for registering the position of each image data is created. Referring to FIG. 8, first create a new image map (S
321), name the image map (S322),
A process of assigning a map axis name is performed (S323).

Here, the axis name of the map means a traditional-modern axis as shown in FIG. 5, a Western-style axis, or the like. Thus, as the axis name, words having mutually opposite meanings are selected.

FIG. 9 is a flow chart showing the details of the keyword map creating process shown in FIG. Here, a keyword map for registering the positions of keywords to be added to each image data is created. Referring to FIG. 9, a process of creating a new keyword map (S341), naming the keyword map (S342), and assigning map axis names (for example, strong-weak axis and pleasant-uncomfortable axis in FIG. 6) Is performed (S343).

Thereafter, it is determined whether or not the keyword is registered (S344), and if YES, the keyword registration process is performed (S345). Details of the keyword registration processing will be described later. Next, it is determined whether the keyword registration is completed (S346), and in the case of NO, S345.
Return to and continue the keyword registration process, and if YES, return. If NO in S344, the process directly returns.

FIG. 10 is a flow chart showing the details of the icon map creating process shown in FIG. Here, an icon map for registering the position of the icon added to each image data is created. First, a new icon map is created (S361), and the icon map is named (S36).
2), a process of assigning the axis name of the map (for example, referring to FIG. 7, traditional-modern axis and artificial-natural axis) is performed (S363). After that, it is determined whether or not to register the icon (S364), and if YES, the icon registration process is performed (S365). Details of the icon registration process will be described later. Next, it is determined whether or not the icon registration processing is to be ended (S366), and if NO, S36.
The process returns to step 5 to continue the icon registration process. If YES, the process returns. If NO in S364, the process directly returns.

FIG. 11 is a flow chart showing the details of the voice map creating process shown in FIG. Here, a voice map for registering the position of the voice added to each image data is created. Referring to FIG. 11, a new voice map is created (S381), the voice map is named (S382),
A process of assigning a map axis name is performed (S383).

Thereafter, it is determined whether or not to register the voice (S384), and if YES, a voice registration process is performed (S385). Details of the voice registration process will be described later. Next, it is determined whether or not the voice registration processing is to be ended (S386). If NO, the process returns to S385 to continue the voice registration process, and if YES, the process returns. If NO in S384, the process directly returns.

FIG. 12 is a flow chart showing details of registration of the keyword shown in FIG. Here, the keyword added to each image data is input, registered in the keyword map, and added to the keyword list. Referring to FIG. 12, a new keyword is input as text (S34).
41). Next, it is determined whether the input keyword is a compound word of the already registered keywords (S3442),
In the case of YES, the position of the new keyword is automatically calculated from the already registered keywords and is automatically arranged in the keyword map (S3443). In the case of NO, the process of arranging in the keyword map is manually performed (S34).
45). As a method of automatic calculation, a method of calculating the center position of each keyword forming the compound word can be considered. After that, the newly input keyword is added to the keyword list (S3444), and the process returns.

FIG. 13 is a flow chart showing details of registration of the icon shown in FIG. Here, the icon added to each image data is input, registered in the icon map, and added to the icon list. Referring to FIG.
A new icon is created and input by the drawing function or the painting function of the system 100 (S364).
1). Next, a process of arranging a new icon on the icon map is performed (S3642). After that, the newly input icon is placed on the icon list (S3643), and the process returns.

FIG. 14 is a flow chart showing details of the voice registration shown in FIG. Here, the voice added to each image data is input, registered in the voice map, and added to the voice list. Referring to FIG. 14, a new voice is input through microphone 11 (S3841). Next, a process of arranging a new voice (displayed as a picture or a code in place of the voice on the screen) on the voice map is performed (S3842). After that, the newly input voice is put on the voice list (S3843), and the process returns.

FIG. 15 is a flow chart showing the details of the map setting process shown in FIG. Here, the image map to be used is set and whether or not to use the map learning function is selected. Referring to FIG. 15, an image map to be used is selected from the image maps already created in the map creating process (FIG. 3, S3) and set (S41). Next, in the map creation process (FIG. 3, S3), the keyword map to be used is selected and set from the created keyword maps (S42). The icon map to be used is selected and set from the icon maps already created in the map creation process (FIG. 3, S3) (S43). Next, in the map creation process (FIG. 3, S3), the audio map to be used is selected and set from the created audio maps (S44).

The maps set in S41 to S44 are used in the image data input process (FIG. 3, S5) and the image data search process (FIG. 3, S6).

Next, it is judged whether or not the image map learning function is used (S45), and if YES, the image map learning flag is turned ON, and the keyword / icon / speech map learning flag is turned OFF (S46), and the return is made. To do.
If NO in S45, it is determined whether to use the keyword / icon / voice map learning function (S47). Y
In the case of ES, the image map learning flag is turned off, and the keyword / icon / voice map learning flag is turned on (S4
8) Return. In the case of NO in S47, the image map learning flag is turned off, the keyword / icon / voice map learning flag is turned off (S49), and the process returns.
Here, the map learning function means a function of automatically setting position information on the map. Details will be described later.

<Image Data Input> Next, image data input will be described. FIG. 16 is a flow chart showing details of the image data input processing shown in FIG. First, it is determined whether image data is newly input (S51), and if new, image data is taken in (S52). If not new, select one of the existing image data (S
53). Next, it is determined whether or not additional information is input (S5
4) If input, additional information is input (S55). After inputting the additional information, the image data is stored together with the additional information in a storage device such as the hard disk 6 (S56). Then return.

FIG. 17 is a flow chart showing details of the image data fetching process of FIG. First, image data is captured from an image input device such as the scanner 8 or an image data storage medium such as the hard disk 6 (S52).
1). Next, an image data storage destination such as the hard disk 6 is set (S522). Next, the image data name is input (S523) and the process returns.

FIG. 18 is a flow chart showing details of the additional information input processing shown in FIG. In this process, first, a menu screen for additional information input process appears on the screen of the display 2. The menu screen includes addition of position attributes on the image map, addition of keywords, addition of icons, addition of tints, and addition of voice. The user then selects a desired item from the menu (S55).
1). When the menu is selected, the corresponding processing is performed (S552 to S556). When the processing is over,
It is determined whether or not the input of additional information is completed (S55
7) If it ends, return. If not completed, the following process is repeated from S551.

FIG. 19 is a flow chart showing details of the processing for adding the position attribute on the image map shown in FIG. Referring to FIG. 19, first, the image map is called (S5521). Next, the image is arranged on the image map (S5522). Next, a process for automatically setting the key position attribute value is performed (S5523), and the process returns.

Here, the key is additional information such as a keyword and an icon, and the position attribute value represents the x, y coordinate value on each map. Therefore, the key position attribute value is the x, y coordinate value on the map of the additional information such as the keyword map and the icon map. FIG. 20 is a flowchart showing the details of the keyword adding process of FIG. . First, it is determined whether a newly input keyword is added or an already registered keyword is added (S5531), and if new, a keyword registration process (S5532) is performed. When the registration of the keyword is completed, the registered keyword is added as additional information of the image data (S5533), the process of automatically setting the position attribute value of the image map is performed (S5537), and the process returns. When adding a registered keyword (S5
If NO in 531), the keyword list is called (S553).
4) Select a keyword from the keyword list (S5535), add the selected keyword as additional information of the image data (S5536), and automatically set the position attribute value of the image map (S553).
7) Return.

FIG. 21 is a flow chart showing details of the icon addition processing shown in FIG. First, it is determined whether a newly input icon is added or an already registered icon is added (S5541). If new,
The icon registration process (S5542) is performed. When the registration of the icon is completed, the registered icon is added as additional information of the image data (S5543), and the process of automatically setting the position attribute value of the image map is performed (S5).
547), and returns. When adding a registered icon (NO in S5541), the icon list is called (S5544), an icon is selected from the icon list (S5545), and the selected icon is added to the additional information of the image data. As (S554
6) The position attribute value of the image map is automatically set (S5547), and the process returns.

FIG. 22 is a flow chart showing details of the tint addition processing shown in FIG. First, it is determined whether a specific rectangle of the image is designated (S5551). When designating (YES in S5551), the tint of the designated rectangle is calculated, and the calculated value is approximated to the tint on the closest color wheel (S5552). To calculate the tint, a color for each bit (pixel) in the rectangle may be weighted and averaged, or the most used color may be taken. The approximated tint is added as additional information of the image data (S555).
3) Return. When the specific rectangle of the image is not designated (NO in S5551), one point on the color wheel is designated (S5554). The tint of the designated point is added as additional information of the image data (S55
55) and return.

FIG. 23 is a diagram showing an example of an image viewer screen described later. The above-mentioned specific rectangle is an area (a portion A in the figure) surrounding a predetermined portion on such a screen.

FIG. 24 is a flow chart showing the details of the voice addition processing shown in FIG. First, it is determined whether to add a newly input voice or an already registered voice (S5561). If new (S5561
YES), the voice registration process is performed (S556).
2). When the registration of the voice is completed, the registered voice is added as additional information of the image data (S5563), the process of automatically setting the position attribute value of the image map is performed (S5567), and the process returns. When the registered voice is added (NO in S5561), the voice list is called (S5564), the voice is selected from the voice list (S5565), and the selected voice is added to the additional information of the image data. (S5566), the automatic setting process of the position attribute value of the image map is performed (S556).
7) Return. Note that even voice information is displayed as a code or a picture on the map and list.

FIG. 25 is a flow chart showing details of the automatic setting processing of the position attribute value of the key shown in FIG. First, the keyword / icon / voice map learning flag is O
It is determined whether it is N (S55231). If it is ON (YES in S55231), it is checked whether or not the image data has a keyword, an icon, and additional information of voice (S55232). If you have the above additional information, a map (keyword map, icon map, etc.) corresponding to the type of additional information (keyword, icon, voice)
It is checked whether or not there is the same name as the axis name of the image map currently used in the (voice map) (S55233).
If there is one with the same axis name (YES in S5523),
The above additional information is arranged on the map and set as the position attribute value on the map (S55234).

For example, it is assumed that the image data has a plurality of keyword maps having different axis names, and the image data has one keyword as additional information. And
It is assumed that the keyword is placed in some of the keyword maps but not in some. Now, when the keyword / icon / voice map learning flag is ON in the above-described processing of S55231, first, since the keyword is included as additional information of the image data, the keyword is arranged as “present” or “not present”. Regardless, a keyword map whose axis name matches the axis name of the image map is searched for among a plurality of keyword maps. Specifically, the axes having the same axis names are searched for on the maps shown in FIGS.
If there is a matching keyword map, the above keyword is arranged on the keyword map at the same coordinate position as the position of the image data on the image map. If the above-mentioned keyword is already arranged on the keyword map, it is arranged again at the same coordinate position as the position of the image data on the image map. If the target image data has a plurality of additional information and there is a map in which the axis names match with each other, the position attribute value is set for all the matching maps. If the keyword / icon / voice map learning flag is OFF in the process of S55231, the process directly returns.

FIG. 26 is a flow chart showing the details of the automatic setting process of the position attribute value of the image map shown in FIGS. 20, 21 and 24. First, it is determined whether the image map learning flag is ON or OFF (S5537).
1). If ON (YES in S55371), it is determined whether or not the axis name of the map in which the added additional information is arranged is the same as the axis name of the currently set image map (S55372). If a plurality of maps of the same type (keyword map, icon map, voice map) are created during the map creation process of S3 (FIG. 3), the same as the currently set map. There are maps with different axis names depending on the type. In that case, S553
In the process of 72, the axis name of the map that is not set is also checked to determine whether the axis names match. If there is the same axis name (YES in S55372), the position attribute value (coordinate position on the arranged map) of the additional information added above is checked (S55373). Then, the image data is arranged at the same position on the image map and set as the position attribute value (S55374). Return after processing. Image map learning flag is OFF (NO in S55371)
Alternatively, if the axis names are different (NO in S55372), the process directly returns.

Here, the following will become clear with reference to this processing (automatic setting of the position attribute value of the image map), the keyword registration processing shown in FIG. 9 and the keyword addition processing shown in FIG. That is, it is possible that the keyword is automatically arranged on the keyword map and the image data is also automatically arranged on the image map simply by adding the keyword to the image data. In other words, no manual work to place on the map is required.

For example, now, both the image map and the keyword map are two-dimensional maps having axis names of hot-cold and distant-close, and the keywords "every summer" and "Hawaii" have already been added to the keyword map. It is supposed to have been placed. At this time, simply add the keyword "Eternal summer Hawaii" to the image to be newly input (registered) in the database, and the calculation will be performed automatically, and "Eternal summer Hawaii" will be automatically displayed on the keyword map. Will be placed. This position can be obtained, for example, by performing an operation such that it is exactly in the middle of both keywords or the center of gravity of the origin and the two points is taken. In addition, images with the keyword "Hawaii in Everlasting Summer" are automatically placed on the image map and entered (registered) in the database.
Will be completed.

<Image Data Search> Next, the image data search will be described. FIG. 27 is a flowchart showing details of the image data search processing shown in FIG.

Referring to FIG. 27, it is first determined from the history whether or not the search condition is reproduced (S61). Here, the history means a process of image data search performed in the past. Further, the search condition is search information and ambiguity (described later). Specific display of history will be described later.
When reproducing from the history (YES in S61), reproduction processing of the search condition is performed (S67). As will be described later, the search condition playback process displays the past search process and selects the search to be played back to display the search conditions and search results for that search. This is processing for setting new search conditions. When not reproducing from the history (NO in S61), when the image data to be the basis of the search is designated and the image map is searched by the distance from the image data, automatic setting processing of the search information is performed (S63). ). Here, the distance to the image data is the range of image data close to the image of the user, and is the ambiguity described later. After that, the search information is set (changed) (S64), and the ambiguity is set (S65). By setting the ambiguity here, a data range close to the image of the user is designated as the search range.

The search condition at that time is stored in the history list (S66). When it is stored, it is also stored whether or not the previous search was executed by the search condition reproduced from the history. This is because the history is displayed in a tree structure as described later. Then, a search execution process is performed (S68). The search result at this time is stored in the history list in association with the search condition. It is determined whether or not the search is to be ended (S69). If the search is not to be ended, the process returns to S61 and the process is repeated. Returns when finished.

FIG. 28 is a flow chart showing details of the search execution process shown in FIG. First, it is determined whether this search is a narrow-down search (S681). This determination is made by selecting the menu bar 21. If it is a narrow-down search (YES in S681), a narrow-down search is performed. In the refined search, the image data extracted by the previous search is set as the search target (S682). If it is not a narrow-down search (NO in S681), all the image data on the set image map are targeted for search (S6).
83). Next, a search process is performed (S684). After executing the search process, the image of the image data acquired by the search is displayed in the search result display area (S685), the search history display is updated (S686), and the process returns.

The search history may be displayed in the form of a list, or the process of the search may be explicitly displayed in the form of a picture display. In the latter example, a tree-like pictorial display format can be considered. That is, a circle mark (= node) is set for each search, and circle marks (= node) are generated one after another as the search proceeds. After returning to a certain point, when further search information is set and the search is performed, it is written so as to branch from the circle (= node). In this way, a tree-like pictorial display is branched according to the search process.

At this time, by displaying a normal search with a large circle and a narrowed search with a small circle,
It is preferable to be able to identify them. The display of each search may be displayed by various display methods such as a block display (enclosing with a square) of a character string listing the search conditions, instead of the circle mark. A specific display example will be described later.

FIG. 29A is a flow chart showing details of the reproduction processing of the search condition shown in FIG. FIG. 29
Referring to (A), the history is displayed first (S67).
1). This history is based on the history list stored in S66. Next, one of the histories is selected (S672). The history can be selected either in list form or in a tree-like pictorial form with branches by clicking the part that represents one execution information item (for example, the circle in the latter case) with the mouse or the keyboard. Good. When the execution information is selected, the search condition and the search result of the selected execution information are acquired from the history list and displayed on the screen (S673). In this way, the next search condition is set (or the acquired search condition is changed) with reference to the search condition and the search result acquired from the history list (S674). However, the previous search condition and the next search condition are independent. It returns when the next search condition is set.

FIG. 29B is a diagram showing a display screen of the search history shown in S671 of FIG. 29A. FIG. 29
Referring to (B), A1 to A8 in the figure respectively indicate the search process. More specifically, it is assumed that search A1 is first performed under a certain search condition, then search A2 is performed under another search condition, and then search A3 and search A4 are performed under different search conditions. That is, it is assumed that the images are sequentially searched from the search A1 to the search A4 by expanding or narrowing down the image. In this case, the search processes from search A1 to A4 are vertically connected. Next search A2
It is assumed that a new search condition is conceived by referring to the search condition and the search result and the search A5 is performed with the search condition. In this case, since the search A2 is performed starting from the search A2, the search process of the search A5 is displayed as if it is branched from the search A2. Similarly, a search A6 and a search A7 are sequentially performed from the search A5. Further, the search A8 is performed starting from the search A5.

When the search result (image data) searched by the search condition of the search A2 is used as a target and the narrowed search B1 is performed by the new search condition, the search process of the search B1 is as follows.
It is displayed in a different shape from the normal search process. Similarly, in the figure, the search results (image data) searched by the search condition of the search A5 are targeted, and the narrowed search B is performed by the new search condition.
You can see that 2 was done. In this way, since the search history is displayed in different shapes depending on the search method, it is possible to know the search procedure and the search history in detail. When such a search is performed, in the present invention, such a search history (search condition and search result) is R.
It is stored in the AM 204 or the hard disk 6 or the like.
Therefore, it is not only necessary to re-input the search condition input in the past, but also it is possible to know the search procedure and the search history.

It should be noted that FIG. 2 displayed on the display 2
Each search process shown in FIG. 9 (B) is a GUI like an icon.
(Graphical user interface), and by clicking the desired GUI, it is possible to return to the search condition and search result at that time.

FIG. 30 is a flow chart showing details of the search processing shown in FIG. First, an image map search process is performed (S6841). Next, a keyword search process is performed (S6842). Next, icon search processing is performed (S6843), and tint search processing is performed (S684).
4) A voice search process is performed (S6845). And
The setting for AND or OR processing of the image data group extracted by the search processing of S6841 to S6845 is read (S6846), and AND or OR processing is performed on the extracted image data group (S684).
7). The resulting image data group is saved (S68
48) and return.

FIG. 31 is a flow chart showing details of the image map search process of FIG. First, it is determined whether or not the image data to be the center of the range of ambiguity on the image map is designated as the search condition (S6).
8411). If specified, the image data is set as the center of the ambiguity range (S68412). If it is not specified, it returns as it is. Next, the set ambiguity is read (S68413), and all the image data on the image map within the ambiguity range are extracted (S68414). Finally, the extracted image data group is saved (S68415), and the process returns.

FIG. 32 is a flow chart showing details of the keyword search process of FIG. First, it is determined whether or not a keyword to be the center of the range of ambiguity is specified on the keyword map in the search condition (S684).
21). If specified, the keyword is set as the center of the ambiguity range (S68422). If it is not specified, it returns as it is. Next, the set ambiguity is read (S68423), and all keywords on the keyword map that are within the ambiguity range are extracted (S68424). For all the keywords, all image data having the keyword as additional information is extracted (S68425). Finally, the extracted image data group is saved (S6842).
6) Return.

FIG. 33 is a flow chart showing details of the icon search process shown in FIG. First, it is determined whether or not an icon to be the center of the range of ambiguity is specified on the icon map in the search condition (S6843).
1). If so, the icon is set as the center of the ambiguity range (S68432). If it is not specified, it returns as it is. Next, the set ambiguity is read (S68433), and all the icons on the icon map that are within the ambiguity range are extracted (S68434). For each of all the icons, all image data having the icon as additional information is extracted (S68435). Finally, the extracted image data group is saved (S68436), and the process returns.

FIG. 34 is a flow chart showing details of the tint search process of FIG. First, it is determined whether or not the tint to be the center of the ambiguity range is designated on the tint map as the search condition (S68441). If specified, the tint is set as the center of the range of ambiguity (S68).
442). If it is not specified, it returns as it is. Next, the set ambiguity is read (S6844).
3) Extract all the tints on the color wheel that are within the range of ambiguity (S68444). For each of all the tints, all image data having that tint as additional information is extracted (S68445). Finally,
The extracted image data group is saved (S68446),
To return.

FIG. 35 is a flow chart showing details of the voice search process shown in FIG. First, in the search condition,
It is determined whether or not the voice to be the center of the range of ambiguity is designated on the voice map (S68451). If so, the voice is set as the center of the range of ambiguity (S68452). If it is not specified, it returns as it is. Next, the set ambiguity is read (S68
453), all the voices on the voice map that are within the range of ambiguity are extracted (S68454). For each of all the voices, all image data having the voice as additional information is extracted (S6845).
5). Finally, the extracted image data group is saved (S
68456), and returns. FIG. 36 is a flow chart showing details of the search information automatic setting process shown in FIG. First, the image data that is the basis of the search is designated (S
631). The position of this image data on the image map becomes the center of the range when the ambiguity is set. The method of specifying the image data may be selected from a list of image data, or images of the image data arranged on the display may be selected. After specifying the image data, it is next checked whether or not the image data has a keyword as additional information (S632). If it has (YES in S632), the keyword is automatically set in the search information (S633). Next, it is checked whether or not the image data has an icon as additional information (S634). If so (YES in S634), the icon is automatically set in the search information (S635).
Next, it is checked whether or not the image data has a tint as additional information (S636). If you have it (S636
YES), the tint is automatically set in the search information (S
637). Then, it is checked whether or not the image data has voice as additional information (S638). If so (YES in S638), the voice is automatically set as search information (S639). When there are a plurality of pieces of additional information of the image data, they are all set as search information. It returns when the automatic setting of search information is completed.

FIG. 37 is a flow chart showing details of the search information setting process shown in FIG. First, it is determined whether or not a keyword is set as search information (S64
1). To set a keyword (YE in S641)
S), keyword setting processing is performed (S642). Next, it is determined whether or not an icon is set as search information (S643), and if it is set, icon setting processing is performed (S644). Next, it is determined whether or not the tint is set as the search information (S645), and if it is determined, the tint setting process is performed (S646). Next, it is determined whether or not voice is set as search information (S647), and if it is set, voice setting processing is performed (S648). At the time of setting the search information, if the search key is already set by automatic setting or the like, the search information is set again. It returns when the search information is set.

FIG. 38 is a flow chart showing details of the keyword setting process shown in FIG. First, the keyword list is called (S6421). Next, one or more keywords are selected from the keyword list (S6422). Next, those selected keywords are set as search information (S6423). It returns when the setting is complete.

FIG. 39 is a flow chart showing the details of the icon setting process shown in FIG. First, the icon list is called (S6441). Next, select one or more keywords from the icon list (S64
42), those selected icons are set as search information (S6443). It returns when the setting is complete.

FIG. 40 is a flow chart showing details of the tint setting process shown in FIG. First, it is determined whether a specific rectangle in the image of the image data is designated (S
6461). When the specific rectangle is designated (YES in S6461), the tint of the designated rectangle is calculated (S646).
2, S6463). The tint may be calculated by weighted averaging the colors of each bit in the rectangle, or by taking the most used color. As a result of the calculation, the obtained tint is set as search information (S6464). If the specific rectangle is not specified (NO in S6461), the specific point on the color wheel is specified (S6465). The designated color is set as the search information (S6466), and the process returns when the setting is completed.

FIG. 41 is a flow chart showing details of the voice setting process shown in FIG. First, the voice list is called (S6481). Then 1 from the audio list
One or more keywords are selected (S6482), and those selected voices are set as search information (S6).
483). It returns when the setting is complete.

FIG. 42 is a flow chart showing details of the ambiguity setting process shown in FIG. First, it is determined whether the ambiguity setting menu is selected (S651). Depending on the determination, each setting process (S652 to S65
Perform 6). After the setting process, if the setting of the ambiguity is ended (YES in S657), the process returns. If it is not ended (NO in S657), the process returns to S651 to repeat the process.

FIG. 43 is a flow chart showing details of the ambiguity setting process for the image map shown in FIG.
First, it is determined whether the ambiguity of the image map is set in a range or a numerical value (S6521). When the range is set (YES in S6521), a figure such as a circle is displayed around the image of the image data as the basis of the search on the image map to display the search range (S652).
2) Select the position of the figure with the mouse (S652
3), drag the mouse to change the size of the figure (S6524). The ambiguity is calculated and obtained based on the size of the figure (S6525).

When setting numerical values (N in S6521)
O), first, input the numerical value of the ambiguity (S6526).
A figure such as a circle representing the range of ambiguity according to the numerical value is displayed (S6527). This allows you to check the range of ambiguity of the entered numbers.

Next, it is determined whether or not the setting of the ambiguity is completed (S6528). If not finished (S652
(NO in step 8), the process returns to step S6521 to continue the process. If the processing is to end (YES in S6528), the value obtained in S6525 or the value input in S6526 is set as the ambiguity of the image map (S6529), and the process returns.

FIG. 44 is a flow chart showing details of the keyword ambiguity setting process shown in FIG. First,
It is determined whether the ambiguity of the keyword is set in the range or in the numerical value (S6531). When the range is set (YES in S6531), a figure such as a circle centering on the keyword serving as the search base is displayed on the keyword map to indicate the search range (S6532). A part of the figure is selected with the mouse (S6533), and the size of the figure is changed by dragging the mouse (S6534). The ambiguity is calculated and obtained based on the size of the figure (S653).
5).

When setting numerical values (N in S6531)
O), first, the numerical value of the ambiguity is input (S6536).
A graphic such as a circle representing the range of ambiguity corresponding to a numerical value is displayed (S6537). Next, it is determined whether or not the setting of the ambiguity is completed (S6538). If the setting of the ambiguity is not completed (NO in S6538), the process returns to S6531 to continue the processing. To end (YE in S6538)
S), the value obtained in the above S6535, or S6536
Set the value entered in step 3 as the keyword ambiguity (S
6539).

FIG. 45 is a flow chart showing details of the ambiguity setting process for the icon shown in FIG. First, it is determined whether to set the ambiguity of the icon in the range or in the numerical value (S6541). If the range is set (YES in S6541), a graphic such as a circle is displayed on the icon map centering on the icon as the search base to indicate the search range (S6542), and a part of the graphic is moused. Is selected (S6543), and the size of the figure is changed by dragging the mouse (S6544). The ambiguity is calculated and obtained based on the size of the figure (S6545).

When setting numerical values (N in S6541)
O), first, the numerical value of the ambiguity is input (S6546). A graphic such as a circle representing the range of ambiguity is displayed according to the numerical value (S6547). Next, it is determined whether or not the setting of the ambiguity is completed (S6548). If not finished (S65
(No in 48), the process returns to S6541 to continue the processing. When ending (YES in S6548), the value obtained in S6545 or the value input in S6546 is set as the ambiguity of the icon (S6549).

FIG. 46 is a flow chart showing details of the tint ambiguity setting process shown in FIG. First, it is determined whether to set the ambiguity of the tint in a range or in a numerical value (S6551). To set the range (S65
If YES in step 51, a figure such as a circle is displayed on the color wheel centering on the tint that is the basis of the search to indicate the search range (S65
52) and select a part of the figure with the mouse (S655).
3) The size of the figure is changed by dragging the mouse (S6554). The ambiguity is calculated and obtained based on the size of the figure (S6555).

When setting numerical values (N in S6551)
O), first, when inputting the numerical value of the ambiguity (S6556),
A figure such as a circle representing the range of ambiguity is displayed according to the numerical value (S6557). Next, it is determined whether the setting of the ambiguity is completed (S6558). If the setting is not completed (NO in S6558), the process returns to S6551 to continue the processing. When ending, the value obtained in S6555 or the value input in S6556 is set as the ambiguity of the tint (S6559).

FIG. 47 is a flow chart showing details of the voice ambiguity setting process shown in FIG. First, it is determined whether the ambiguity of the voice is set in a range or a numerical value (S6561). To set the range (S6
(YES in 561), a figure such as a circle is displayed centering on the voice that is the basis of the search on the voice map to indicate the search range (S6562), and a part of the figure is selected with the mouse (S).
6563), and the size of the figure is changed by dragging the mouse (S6564). The ambiguity is calculated and obtained based on the size of the figure (S6565).

When setting numerical values (N in S6561)
O), first, the ambiguity value is input (S6566). A figure such as a circle representing the range of ambiguity is displayed according to the numerical value (S6567). Next, it is determined whether or not to end the setting (S6568). When the setting is not completed (S65
If NO at 68), the process returns to S6561 to continue the processing. When ending, the value obtained in S6565 or the value input in S6566 is set as the ambiguity of the voice (S656).
9).

Although a circle is used as the figure for displaying the ambiguity, the figure is not limited to the circle and may be a quadrangle or another figure.

As described above, since the degree of ambiguity of each additional information can be set when searching for image data, even if the search target is not clear, it is possible to search by using an ambiguous image. Also, because you can associate it with an ambiguous image, when you do not know what you are looking for,
You can get the stimulus of your ideas and search beyond your imagination. Further, since the degree of ambiguity can be set, the search condition can have a wide range, and it becomes possible to search for data having various degrees of association.

FIG. 48 is a flow chart showing details of the image data organization process (S7) shown in FIG. The image organization consists of image editing, browser, panel creation, and image viewer functions. First, the type of image data organization is selected (S71). Processing shifts according to the type. In case of the image editing function, the process proceeds to S72, in case of the browser function, proceeds to S73, and in case of the panel creating function, S.
74, and in the case of the image viewer function, proceeds to S75. Each processing will be described later.

FIG. 49 shows the image editing function (S
72) is a flowchart showing details of (72). Image editing is a function of pasting, cutting, and painting (drawing) image data. First, select the type of image editing (S72
1). If the image data is pasted, the process proceeds to S722, if the image data is cut, the process proceeds to S723, and if the image data is painted, the process proceeds to S724. Details of each will be described later. Next, it is determined whether or not to finish the image editing (S725). If it is finished (YES in S725), the process returns, and if it is not finished (N in S725, N
O), the process returns to the step of selecting the image type in S721.

FIG. 50 is a flow chart showing details of the image data pasting process (S722) shown in FIG.
Here, a case where the image data 1 is pasted on the image data 2 will be described. First, the image data 1 is read and displayed on the display 2 (S7221). A necessary portion of the image data is cut off (S7222), and the cut out image data is temporarily saved (S7223). Next, the image data 2 is read and displayed on the display 2 (S722).
4). Next, the cut-out image data that has been temporarily saved is pasted to the image data 2 (S7225). Next, the image data 1 is closed (S7226) and the image data 2 is stored (S7).
227) and close (S7228). Finally, the temporarily saved image data 1 is discarded (S7229).

FIG. 51 is a flow chart showing details of the image data cutting process (S723) shown in FIG. Here, a process of cutting out an unnecessary portion of the image data 1 will be described. First, the image data 1 is read and displayed on the display 2 (S7231). Unnecessary part of the image data 1 is cut (S7322), and the cut image data 1
Is stored (S7233) and closed (S7234).

FIG. 52 is a flow chart of the image data painting process (S724) shown in FIG. First, the image data 1 is read and displayed on the display 2 (S7241). Define the type of pen, brush, etc. (S7
242), and draw on the image data 1 using a pen and a brush (S7243). Finally, save the image data 1 (S
7244) and close (S7245).

FIG. 53 shows the browser function (S7
It is a flow chart which shows details of processing of 3). The browser function is a function for listing image data and browsing. First, the display mode is set (S7).
31). In the tile format display mode, the process proceeds to S732, in the list format display mode, the process proceeds to S733, and in the slide format display mode, the process proceeds to S734. Each processing will be described later. Next, it is determined whether the browser is to be terminated (S735). When ending (YES in S735), the browser function is ended (S7).
37), if not ending (NO in S735), S7
Return to the display mode setting of 31.

FIG. 54 is a flow chart showing details of the tile format display mode process (S732) of FIG.
The tile format display mode is a display mode in which image data is displayed in a tile shape with a specified size and a large number of image data can be viewed at the same time. In this mode, the size at which the image is first displayed is set (S7321). The image display size includes (80 x 60) pixels and (120 x 90)
Two types of pixels are prepared. Next, the image data group is read (S7322). If the read image data group is larger than the display area, a scroll bar is displayed (S732).
3) The image data is displayed (S7324). Next, it is determined whether the scroll bar is operated (S732).
5). When the scroll bar is not operated (S7325)
(NO), the process proceeds to S7327. When the scroll bar is operated (YES in S7325), the display position of the image data is moved (S7326) and the image data is displayed (S7324). Finally, it is determined whether or not the tile format display is to be ended (S7327), and if it is to be ended (YES in S7327), the process returns, and if it is not to be ended (NO in S7327), the process returns to the determination of the scroll bar operation of S7325. .

FIG. 55 is a flow chart showing details of the list format display mode process (S733) shown in FIG. The list format display mode is a display mode in which additional information is displayed together with the image data. First, the image data group is read (S7331). If the read image data group is larger than the display area, a scroll bar is displayed (S73
32), the image data and the additional information are displayed (S733).
3). Next, it is determined whether the scroll bar has been operated (S7334). If the scroll bar is not operated (NO in S7334), the process proceeds to S7336. If the scroll bar is operated (YES in S7334), the display position of the image data and the additional information is moved (S733).
5) The image data and the additional information are displayed (S733).
3). Finally, it is determined whether to end the list format display (S7336). When finished (Y in S7336)
S) returns and does not end (N in S7336)
O), and returns to the determination of the scroll bar operation in S7334.

FIG. 56 is a flow chart showing details of the slide format display mode process (S734) shown in FIG. The slide format display mode is a function of sequentially displaying one by one in viewer size (640 × 480) pixels. The viewer-sized graphic is as shown in FIG. First, the image data group is read (S734
1). One image data is displayed (S7342). Next, it is determined whether the commands on the previous page and the next page have been operated (S7
343). If the commands on the previous page and the next page have not been operated (NO in S7343), the process advances to S7345. Previous page,
If the command on the next page is operated (YES in S7343
S), preparation for the previous image data or the next image data display is made (S7344), and the image data is displayed (S734).
2). Finally, it is determined whether or not the slide format display is ended (S7345). When ending (S7354)
If YES, the process returns, and if not completed (S734
(NO in 5), and returns to the determination of the scroll bar operation in S7343.

57 and 58 are flowcharts showing the details of the panel creating function processing (S74) shown in FIG. Panel creation is a function of arranging image data and items (graphics drawn by the paint function) and creating and editing panel data. This panel is used as a collage diagram that summarizes map creation, grouping and design concepts.

First, it is determined whether the stored panel is edited / organized (S7401). When editing / organizing (YES in S7401), 1 of the stored panels
Select one (S7402), load the selected panel,
It is displayed on the display 2 (S7403). When not editing / organizing (NO in S7401), a new panel is created (S7404) and displayed on the display 2 (S).
7405).

Next, it is determined whether or not an image is attached to the panel (S7406). When pasting (S7406
If YES, the image is pasted on the panel (S740).
7). The details will be described later. If not attached (S74
If NO in 06), this process is skipped. Next, it is determined whether or not to paint on the panel (S7408). If the paint is to be performed (YES in S7408), the panel is painted (S7409). If the paint is not to be performed (NO in S7408), this process is skipped. Details of this processing will be described later. Next, it is determined whether or not a map axis is inserted in the panel (S7410). When the map axis is inserted (YES in S7410), the map axis is created (S7411), and when the map axis is not inserted (S741).
If 0, the process is skipped. Details of creating the panel map axis will be described later.

Next, with reference to FIG. 58, it is determined whether or not to perform grouping (S7412). If the grouping is performed (YES in S7412), the images are grouped (S7413), and if the grouping is not performed (NO in S7412), this process is skipped. Details of grouping the image data will be described later. Next, it is determined whether or not the image data on the panel is moved (S741).
4). When moving (YES in S7414), the image data is moved (S7415), and when not moving (NO in S7414), this process is skipped. Details of moving the image data will be described later. Next, it is determined whether or not the panel creation is completed (S7416). When it is to be ended (YES in S7416), the created panel is stored in the storage device such as the hard disk 6 (S7417), and the panel creating function process is ended (S7418). If not completed (NO in S7416), the process returns to S7406. FIG. 59 shows a specific example of the panel displayed on the display 2.

FIG. 60 is a flow chart showing details of the processing (S7407) of pasting image data on the panel shown in FIG. Select the image data to paste (S7407
1) Specify the attachment position on the panel (S7407)
2) Paste the image data (S74073). Next, it is determined whether the map axis is set on the panel (S74074). If YES, the coordinate data on the map is added to the image data (S74075). If NO, this process is skipped and the process returns. To do.

FIG. 61 is a flow chart showing details of the panel paint processing (S7409) shown in FIG.
Define pen, brush type, color, etc. (S7409
1) Draw on the panel using the pen and brush (S74)
092).

FIG. 62 is a flow chart showing details of the panel map axis creation processing (S7411) shown in FIG. The axis name is input (S74111), the origin position of the axis is designated on the panel (S74112), and the map axis is created (S74113).

Next, it is determined whether the image data is pasted on the panel (S74114), and if YES, the coordinate data on the map is added to the image data (S741).
15), if NO, skip this process and return.

FIG. 63 is a flow chart showing details of the image data grouping process (S7413) shown in FIG. Specify the image data group to be grouped (S7
4131), and encloses the specified image data group in a frame (S74
132), and stores the designated image data group as a group (S74133).

FIG. 64 is a flow chart showing details of the image data moving process (S7415) shown in FIG. The image data to be moved is selected (S74151), the destination position is specified on the panel (S74152), and the image data is moved (S74153).

By the way, in an atypical creative work such as a design work, it is important that the process can be freely moved during the work. That is, the design process is a cyclic process, and the functions required in each process must be organically integrated. For example, consider the case of creating a collage image that summarizes design concepts from images retrieved by searching. At this time, it is not a one-way operation of searching and extracting images and then collating them. In many cases, I collaborate and study various things, and then return to the search task again. In some cases, collages are presented to multiple people to get their opinions, and edited. At this time as well, the user returns to the search work again to retrieve another image. In some cases, the drawings created for reference of the next design may be stocked. In order to put together the design concept, it is necessary to repeat the work such as grouping using the KJ method, organizing ideas by using a map, obtaining an opinion while conducting a presentation and retrieving another image. is there.

In the present invention, as described above, an image is searched, the searched image is processed and edited, and a panel which becomes a collage image is created based on the processed and edited image and displayed. Since various tasks can be repeated, it is possible to support design work and ideas.

FIG. 65 is a flow chart showing details of the image viewer function processing (S75) shown in FIG. The image viewer has a function of displaying designated image data in an arbitrary size and adding item and mask information to the image data. Here, the item is text or a vector graphic, and the mask is masking a part of an image to be displayed.

Referring to FIG. 65, first, designated image data is read (S751). Next, a desired menu is selected from the viewer menus displayed on the display 2 (S752). If it is the edit menu, the process proceeds to S753, and if it is the display menu, the process proceeds to S754. Details of these menu contents will be described later. If nothing is done, the process proceeds to S755. Next, it is determined whether or not to store the image data (S755). When the image data is stored (YES in S755), the image data is stored (S756), and when not stored (NO in S755), this process is skipped. Next, it is determined whether or not the viewer has ended (S75).
7). If it is ended (YES in S757), the viewer is ended (S758), and if not ended (NO in S757), the process returns to the viewer menu selection in S752.

FIG. 66 is a flow chart showing details of the edit menu process (S753) shown in FIG. Here, first, what is to be edited is selected (S7531), the process proceeds to S7532 when the item is edited according to the editing target, and the process proceeds to S7533 when the mask is edited. Details of these processes will be described later.

FIG. 67 is a flow chart showing details of the processing for editing the item shown in S7532 of FIG. Here, first, edit contents are selected (S75321), and items are created according to the edit contents (S75322).
Item transformation (S75323), item movement (S
75324), copy item (S75325), and delete item (S75326).

FIG. 68 is a flow chart showing details of the mask editing process (S7533) shown in FIG. Here, first, the editing content is selected (S75331), a mask is created (S75332), the mask is deformed (S75333), and the mask is moved (S753) according to the editing content.
34), copy mask (S75335), and delete mask (S7536).

FIG. 69 shows the display menu (S
754) is a flowchart showing details of processing. First, the change of the display size is selected (S7541). For size change, enlarge (S7542) and reduce (S754).
3), there is no change (S7544). Next, it is determined whether or not the mask is displayed (S7545). When displaying (YES in S7545), the mask information is displayed (S7546), and when not displaying (NO in S7545), the mask information is hidden (S7547). Next, it is determined whether or not to display the item (S7).
548). When displaying (YES in S7548),
The item information is displayed (S7549), and if not displayed (NO in S7548), the item information is hidden (S75410). Next, it is determined whether or not the additional information is displayed (S75411). When displaying (YES in S75411), the additional information is displayed (S75).
412), if not displayed (NO in S75411),
The additional information is hidden (S75413).

FIG. 70 is a flow chart showing details of the presentation process (S8) shown in FIG. The presentation is a function of displaying the image data page by page. When the presentation process starts, each flag (automatic display flag, item display flag, mask display flag, continuous display mode flag) is initialized (S81).

Here, the automatic display flag means a flag which is automatically displayed while switching a plurality of image data at a predetermined time interval. The item display flag is a flag for displaying items such as text and vector graphics. The mask display flag is a flag for masking and displaying a part of the image to be displayed, and the continuous display mode flag is a flag for continuously displaying the image data until the user explicitly indicates. Is. Each of these flags is set on a screen (not shown).

Next, a parameter setting dialog box for executing the presentation process is displayed (S8).
2) Input into the dialog box (S83). S
Details of the parameter input process to the dialog box 83 will be described later.

Next, it is judged whether or not to execute (S8).
4). If it is to be executed (YES in S84), proceed to parameter input check (S85), and if not to execute (S85).
If NO at 84), the process returns. Next, the parameter input is checked (S85), and if it is OK (YES in S85), the process proceeds to the presentation execution process (S8).
6) If not OK (NO in S85), S83 again
Proceed to enter the parameters in the dialog. Details of the presentation execution process of S86 will be described later.

FIG. 71 is a flow chart showing details of parameter input processing to the dialog shown in FIG.
First, it is determined whether or not the item is displayed (S8).
31). To display items (YES in S831)
S), and set the item display flag to TRUE (S83
2) If the item is not displayed (NO in S831),
Set the item display flag to FALSE (S83
3). Next, it is determined whether or not the mask display is performed (S834). To display a mask (Y in S834
S), and set the mask display flag to TRUE (S83
5) If the mask display is not performed (NO in S834), the mask display flag is set to FALSE (S836). Other parameters such as background color and effect are set (S837). Here, the effect means a display effect such as the next image coming out from the right side of the screen.

FIG. 72 is a flow chart showing details of the presentation execution process (S86) shown in FIG. The item display flag is determined (S860
1) If the item display flag is TRUE (S86
If YES at 01), preparation for item display (memory reservation for item display, etc.) is performed (S8602). When the item display flag is FALSE (N in S8601
O), and proceeds to the mask display flag determination (S8603).
In the determination of the mask display flag (S8603), if the mask display flag is TRUE (Y in S8603).
ES), mask display preparation (memory reservation for mask display) is performed (S8604), and the mask display flag is set to F.
In the case of ALSE (NO in S8603), the mask display preparation (S8604) is skipped.

Next, other setting (background color, effect, etc.) preparation processing is performed (S8605), and image data is displayed (S8606). Next, it is determined whether or not the image display interruption key has been input (S8607). If the interruption key has not been input (YES in S8607).
S) Then, it is determined whether or not a key input for advancing to the next image is made (S8608). If the interrupt key is pressed (NO in step S8607), the process advances to the end of presentation in step S8611.

If it is determined that the key input has been made to advance to the next image, it is determined (S86).
08: YES), and proceed to the preparation for displaying the next image (S860)
9), if not input (NO in step S8608),
Proceeds to S8607. That is, it waits until a key is input to advance to the next image. In step S8609, preparation for displaying the next image (reading of the next image data, etc.) is performed. It is determined whether there is an image to display (S
8610), if there is no image (YES in S8610),
The presentation ends (S8611). If there is an image (NO in S8610), the process proceeds to the display of image data in S866. In the step of ending the presentation in S8611, the presentation is ended and the memory is released.

FIG. 73 is a flow chart showing details of the printing process (S9) shown in FIG. Here, image data to be printed and paper size are selected, a preview is displayed, and then printing is performed. The preview may not be displayed or printed in some cases. Referring to FIG. 67, first, image data to be printed is selected (S91), and a paper size is selected (S92). Next, it is determined whether or not preview display is performed (S93). When the preview display is performed (YES in S93), the preview display is performed (S94), and when the preview display is not performed (NO in S93), this process is skipped. Next, it is determined whether or not to print (S95). If printing is to be performed (YES in S95), printing is started (S96), and if printing is not to be performed (N in S95).
O), skip this process and return.

In the above embodiment, the various maps are two-dimensional maps, but the present invention is not limited to this and may be one-dimensional maps or three-dimensional maps.

Further, although the still image data has been described in the above embodiment, this can be similarly realized even if it is moving image data, character data, voice data or multimedia data which is a combination thereof. .

Further, although details of the search means are not particularly described in the above-mentioned embodiment, the search may be performed by AND, OR or a combination of the search means other than the single search by each search means.

In the image data retrieving apparatus according to the present invention, since the additional information of a plurality of image data is attached to a plurality of types of additional information maps based on the additional information of the image data, the map itself is used as an image classification drawing. Available as In addition, by arranging image data that is difficult to classify with only simple keywords or titles on a multidimensional map, multi-dimensional classification can be performed and classification by image becomes possible.

[0123]

As described above, according to the first aspect of the invention, the image data is saved together with the additional information related to the image data, and when the arbitrary image data is designated, the designated image data is added. Since the information is extracted and the search condition for the desired image data is set from the image data group stored based on the extracted additional information, the search condition for the image data is automatically set. As a result, it is possible to provide an image data search device capable of easily setting search conditions.

According to the second aspect of the present invention, the automatically set search conditions can be added or changed, so that it is possible to provide an image data search device in which the search conditions can be set more easily.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing a configuration of an information processing apparatus to which the present invention is applied.

FIG. 2 is a block diagram showing a connection relationship of main parts of a control device that controls the entire system.

FIG. 3 is a flowchart showing a main routine of a program of the image information search device.

FIG. 4 is a flowchart showing the contents of map creation processing.

FIG. 5 is a diagram showing an example of an image map.

FIG. 6 is a diagram showing an example of a keyword map.

FIG. 7 is a diagram showing an example of an icon map.

FIG. 8 is a flowchart showing the contents of image map creation processing.

FIG. 9 is a flowchart showing the contents of a keyword map creation process.

FIG. 10 is a flowchart showing the content of an icon map creation process.

FIG. 11 is a flowchart showing the contents of a voice map creation process.

FIG. 12 is a flowchart showing the contents of keyword registration processing.

FIG. 13 is a flowchart showing the content of icon registration processing.

FIG. 14 is a flowchart showing the contents of voice registration processing.

FIG. 15 is a flowchart showing the contents of map setting processing.

FIG. 16 is a flowchart showing the contents of image data input processing.

FIG. 17 is a flowchart showing the content of image data import processing.

FIG. 18 is a flowchart showing the contents of additional information input processing.

FIG. 19 is a flowchart showing the contents of processing of adding a position attribute on an image map.

FIG. 20 is a flowchart showing keyword addition processing.

FIG. 21 is a flowchart showing icon addition processing.

FIG. 22 is a flowchart showing a tint addition process.

FIG. 23 is a diagram showing an example of a viewer and an additional information display mode.

FIG. 24 is a flowchart showing a voice addition process.

FIG. 25 is a flowchart showing an automatic setting process of a key position attribute value.

FIG. 26 is a flowchart showing an automatic setting process of a position attribute value of an image map.

FIG. 27 is a flowchart showing image data search processing.

FIG. 28 is a flowchart showing a search execution process.

FIG. 29 is a flowchart showing a reproduction process of search information.

FIG. 30 is a flowchart showing details of the search processing shown in FIG. 29.

FIG. 31 is a flowchart showing details of the image map search process shown in FIG. 30.

FIG. 32 is a flowchart showing details of the keyword search process shown in FIG. 30.

FIG. 33 is a flowchart showing details of the icon search process shown in FIG. 30.

FIG. 34 is a flowchart showing details of the tint search processing shown in FIG. 30.

FIG. 35 is a flowchart showing details of the voice search process shown in FIG. 30.

FIG. 36 is a flowchart showing an inspection information automatic setting process.

FIG. 37 is a flowchart showing a search information setting process.

FIG. 38 is a flowchart showing a keyword setting process.

FIG. 39 is a flowchart showing icon setting processing.

FIG. 40 is a flowchart showing a tint setting process.

FIG. 41 is a flowchart showing a voice setting process.

[Fig. 42] Fig. 42 is a flowchart showing ambiguity setting processing.

FIG. 43 is a flowchart showing an image map ambiguity setting process;

FIG. 44 is a flowchart showing keyword ambiguity setting processing.

FIG. 45 is a flowchart showing an ambiguity setting process for an icon.

FIG. 46 is a flowchart showing a tint ambiguity setting process.

FIG. 47 is a flowchart showing a voice ambiguity setting process.

FIG. 48 is a flowchart showing image data organization processing.

FIG. 49 is a flowchart showing image editing function processing.

FIG. 50 is a flowchart showing a pasting process of image data.

FIG. 51 is a flowchart showing a cutting process of image data.

FIG. 52 is a flowchart showing a painting process of image data.

FIG. 53 is a flowchart showing browser function processing.

FIG. 54 is a flowchart showing tile format display mode processing.

FIG. 55 is a flowchart showing list format display mode processing.

FIG. 56 is a flowchart showing a slide format display mode process.

FIG. 57 is a flowchart showing panel creation function processing.

FIG. 58 is a flowchart showing panel creation function processing.

FIG. 59 is a diagram showing an example of a panel.

FIG. 60 is a flowchart showing a process of pasting image data on a panel.

FIG. 61 is a flowchart showing a panel paint process.

FIG. 62 is a flowchart showing a panel map axis creation process.

FIG. 63 is a flowchart showing a grouping process of image data.

FIG. 64 is a flowchart showing image data movement processing.

FIG. 65 is a flowchart showing image viewer function processing.

FIG. 66 is a flowchart showing edit menu processing.

FIG. 67 is a flowchart showing a process of editing an item.

FIG. 68 is a flowchart showing a process of editing a mask.

FIG. 69 is a flowchart showing display menu processing.

FIG. 70 is a flowchart showing a presentation process.

FIG. 71 is a flowchart showing parameter input processing to a dialog.

FIG. 72 is a flowchart showing a presentation execution process.

FIG. 73 is a flowchart showing print processing.

[Explanation of symbols]

 1 Control Device 2 Display 3 Keyboard 4 Mouse 5 Floppy Disk 6 Hard Disk 7 Printer 8 Scanner 201 CPU 203 ROM 204 RAM

Front page continuation (72) Inventor Takahiro Fujii 2-3-13 Azuchi-cho, Chuo-ku, Osaka City Minamita Co., Ltd. (72) Inventor Kimihiko Higao 2-3-3 Azuchi-cho, Chuo-ku, Osaka Osaka International Building Minolta Co., Ltd. (72) Inventor Shuhei Taguchi 1006 Kadoma, Kadoma City, Osaka Prefecture Matsushita Electric Industrial Co., Ltd. (72) Masayuki Mukai 1006 Kadoma, Kadoma City, Osaka Matsushita Electric Industrial Co., Ltd.

Claims (2)

[Claims] 1. A means for setting additional information related to image data, a means for storing image data together with the additional information, a means for designating arbitrary image data, and additional information for the designated image data. An image data search device comprising: a means for extracting; and a means for automatically setting the extracted additional information as a search condition for obtaining desired image data from the stored image data group. 2. The image data search device according to claim 1, wherein the means for automatically setting includes means for adding or changing the search condition.