JPH0460770A - Method and device for retrieving picture using schematic picture - Google Patents

Abstract

PURPOSE:To retrieve a picture based on visual information by retrieving the picture adjusted to a condition through the use of a schematic picture where the shape, color, size and position of a constitution body are mentioned and indicating a candidate picture. CONSTITUTION:A picture collation means 4 selects the candidate picture by collating the retrieval condition (color, position, size and shape of constitution body, relation between constitution bodies and the like) with the schematic picture stored in a schematic picture storage means 3. A schematic picture display means 5 displays the candidate pictures (plural pictures exist). A user can designate the picture to be retrieved among the pictures displayed in the schematic picture display means 5 or he can correct the retrieval condition by using the input means 1. When correction is added to the retrieval condition, collation is executed. When the picture is instructed, an output means 6 fetches the corresponding picture from a picture storage means 2 and outputs it.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to an image retrieval method and apparatus using a schematic image for retrieving image information in a system such as an image data source.

[Conventional technology]

Conventionally, the method for searching image information based on the spatial information of an image is to extract the circumscribed rectangle of a structure, describe the relationship between these circumscribed rectangles, and search based on the description of this positional relationship. A method has been proposed to do so. Furthermore, in ink paintings, a method has also been proposed in which structures are described as squares and triangles and images are searched from the description of their positional relationships.

[Problem to be solved by the invention]

However, with these methods, information about the shape of the construct is largely lost, making shape-based retrieval difficult. Furthermore, because information is reduced to attribute information, it is difficult to perform searches from various viewpoints, and there is a lack of flexibility when dealing with ambiguous information. Furthermore, since these do not handle color information, color-based searches cannot be performed.

An object of the present invention is to solve such problems and enable search based on visual information.

[Means for Solving the Problems] The image search method using a schematic image of the present invention specifies, when searching for an image, one or multiple pieces of information regarding components in the image as search conditions; A candidate image is selected by comparing it with a pre-extracted image that includes information about the components in the image and is simplified from the original image.

The image retrieval device using a schematic image of the present invention includes input means for inputting image search conditions and necessary image instructions, image storage means for storing image information, and component conditions. a general image storage means for storing an image smaller than the image; an image matching means for receiving a search condition from the input means and comparing it with the general image in the general image storage means to derive a candidate image to be searched; It has an image display means that receives a candidate image from the image matching means and displays the result, and an output means that selects and outputs the image displayed by the image display means from the image storage means according to an instruction from the input means.

[Operation] In the present invention, images that meet the conditions are searched for using image information that describes the shape, color, size, position, etc. of components, and candidate images are presented. Information-based searches can be easily performed.

〔Example〕

Next, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a functional block diagram showing an example of an image search device using a schematic image according to the present invention. This image search device using a schematic image includes an input means 1 for inputting image search conditions and necessary image instructions, an image storage means 2 for storing image information, and shapes and colors of constituent elements. ,size,
Receives search conditions from a schematic image storage means 3 for storing images smaller than the original image including positions etc. and input means 1, compares them with the outline images in the outline image storage means 3, and derives candidate images to be searched. an image matching means 4, an image displaying means 5 for receiving candidate images from the image matching means 4 and displaying the results, and an image displayed by the image displaying means 5 being selected by the image storage means 2 according to an instruction from the inputting means 1 and outputted. It is equipped with an output means 6 for outputting.

In such an image search device using a schematic image, the input means 1 is an input means for inputting conditions for searching images, and is a pointing device such as a mouse, or an input device such as a keyboard. Further, the image storage means 2 is a means for storing digitized images, and is composed of, for example, an optical disk device, a CD-ROM device, a magnetic disk device, or the like. In addition, the schematic image storage means 3
The schematic image stored in is a smaller image than the original image in which the rough position, size, shape, and color of the components are extracted from the original image.For example, the schematic image shown in Fig. 3(a) It's something like this. This image may be automatically extracted from the original image, or the image may be entered manually by the data heir constructor.

Next, the operation of the image retrieval device using this schematic image will be explained with reference to the flow chart of FIG.

First, the user inputs conditions for searching for images using the input means 1. At this time, the user can input conditions that are a combination of conditions based on the color, position, size, shape, relationship between the components, etc. of the components. For example, the user can input only the color of the component, ie, search by color as shown in FIG. 3(b). It is also possible to input the shape, position, and color of a particular notable structure, that is, to search based on the position, color, and shape of the structure, as shown in FIG. 3(C). It is also possible to input the position and composition of a component, that is, search by composition as shown in FIG. 3(d) (step 21).

The image matching means 4 selects candidate images by comparing the conditions input by the input means 1 with the general images stored in the general image storage means 3.

For example, there are methods to investigate the similarity between components in the vicinity of a specified region and the input region, to compare the configured color information between the two, or to directly compare the input image and the general image. This is achieved by a method such as evaluating differences in colors and structural units (step 22).

The outline image display means 5 displays the candidate images (a plurality of images exist) selected in step 22 (the result may be performed using the outline image, the original image, or other information). (Step 23). Using the input means 1, the user can specify an image to be searched for among the images displayed on the general image display means 5, or can modify the search conditions (step 24). If the search conditions have been modified, the process returns to step 22 for verification, and if an image is specified, the output means 6 takes out the corresponding image from the image storage means 2 and outputs it (step 25). Thereafter, it is possible to return to step 24 or end the process if necessary (step 26).

In this way, in this embodiment, the image information is a schematic image that describes the shape, color, size, position, etc. of the component, and images that meet the conditions are searched and candidate images are presented. , it is possible to easily perform searches based on visual information.

〔Effect of the invention〕

As explained above, according to the present invention, it becomes possible to search images by a combination of visual information such as the color, position, size, shape, relative relationship, etc. of components, and the interface is improved. information can be used effectively.

[Brief explanation of drawings]

FIG. 1 is a functional block diagram showing an example of an image search device using a schematic image according to the present invention, FIG. 2 is a flowchart of the device in FIG. 1, and section 3 is a search diagram of the device in FIG. 1. FIG. 1...Input means 2...Image storage means 3...Outline image storage means 4...Image matching means 5...Image display means 6...・Output means

Claims (2)

[Claims] (1) When searching for an image, specify one or more pieces of information about the constituents in the image as search conditions, and extract the original image containing information about the constituents in the image that has been extracted in advance. An image search method using a schematic image that selects a candidate image by comparing it with a more simplified image. (2) An input means for inputting image search conditions and necessary image instructions, an image storage means for storing image information, and an outline for storing images smaller than the original image including component conditions. image storage means; image matching means for receiving a search condition from the input means and comparing it with the general image in the general image storage means to derive a candidate image to be searched; receiving the candidate image from the image matching means; An image retrieval device using a schematic image, comprising: an image display means for displaying an image; and an output means for selecting and outputting the image displayed by the image display means from an image storage means according to an instruction from the input means.