JP3614235B2 - Information search device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a method and apparatus for searching an information group in which a large amount of information of books (books), photographs, videos, and other various types is collected.
[0002]
In order to make the advanced information society a reality in the future, it is necessary to make the most effective use of multimedia information. As a basic technology, there is a multimedia information retrieval system, and one of the points of the information retrieval technology is a browsing technology of multimedia information. In this technology, it is important how efficiently a large amount of information can be presented and searched using a widely used input / output device.
[0003]
[Prior art]
Conventionally, various information search systems have been proposed in order to search for target information from a large amount of information to be searched. In the information search system, a list of hit information is displayed on the screen by inputting a keyword related to information that the user is searching for. If the number of hits is large, enter more keywords and narrow down until the number is appropriate.
[0004]
In such an information search system, the user needs to think of specific keywords. For example, to find a book you want to read from a database of books, you can find keywords relevant to the book you are interested in, such as the title, author, publisher, date of publication, and some important content. It is necessary to remember and input words and phrases.
[0005]
In addition, in order to search for a target article from a database of newspaper articles issued in the past, keyword relationships are automatically extracted based on the contents of the articles, and the relations are displayed in a three-dimensional space. Then, a search system has been proposed that reaches the title of an article while tracing related keywords and displays the contents of the article of that title (Galaxy of News: MIT). However, this search system requires keywords, and text information sufficient to extract the relationship between the keywords needs to be added to the target information.
[0006]
On the other hand, a technique has been proposed in which information is related to a large amount of information to be searched and the relationship between information is presented as a three-dimensional information structure (for example, Information Visualizer: Xerox). According to this, the state of walking through the three-dimensional information structure is displayed on the screen, and the user searches for target information while walking through.
[0007]
[Problems to be solved by the invention]
As described above, in the conventional information retrieval system, the user needs to input a specific keyword. If the user has a clear purpose or consciousness, keywords can be retrieved relatively easily, but it is a book that feels like you have seen it once in the past, or an article that feels like it was there In the case where the atmosphere of the information is such a level that it is softly thought out, a specific image about the information does not easily come up, so that the keyword cannot be drawn out. Even if it is pulled out, it is doubtful whether the keyword is appropriate.
[0008]
The method of tracing the hierarchical relationship between keywords depends on the technology for automatically extracting the relationship between keywords and the quality and quantity of information to be extracted, and thus the information that is being sought cannot always be reached. In addition, this method is difficult to apply to image information or the like that is not attached with a symbol such as a keyword.
[0009]
According to the method of presenting a large amount of information as an information structure, it is possible to freely search the information structure by walkthrough, but it is not easy to reach the target information. In this conventional method, a large amount of information is structured according to the relationship of the information itself, and it is displayed on the screen as a walkthrough, so that the target information can be efficiently reached. Requires the user to understand its structure. In other words, attention has been paid to how a large amount of information is visualized and presented to the user, and it is still insufficient in terms of improving the efficiency of information search.
[0010]
The present invention has been made in view of the above circumstances, and an object thereof is to provide an information search method and apparatus for efficiently searching a large amount of information to be searched, and a display method therefor.
[0011]
[Means for Solving the Problems]
According to the invention of claim 1apparatusIs a search target information group composed of a large number of search target information.Using a computerInformation searchapparatusSo2Consists of 3D or 3D spaceThe search target information is based on hierarchical space arrangement means for arranging the first to nth hierarchical spaces and storing them in a storage device, and each feature quantity extracted from each search target information included in the search target information group. Are arranged in the nth hierarchical space so that the items having high similarity between the search target information are close to each other.Forming a search target layer,The search target information of the n-th search target layer is divided into blocks for each one or a plurality of search target information close to the arranged position, and is located at a position near the center of the block included in each block. The search target information is selected as representative search target information, and the selected representative search target information corresponds to a position in the nth search target layer in the (n-1) th hierarchical space. By mappingAnd (n-1) th search target layer is formed, and this is recursively repeated to change the first to nth search target layers.at leastA virtual 3D object search space includingSearch space construction means for storing in the storage device,Display on the screen a search image obtained by looking in the target search space from a viewpoint having a line of sight from the top to the bottom of the target search spaceIn response to an operation input from the search image display control means and the operation input meansMove the viewpoint in the target search spaceViewpoint control means.
[0014]
Claim2An apparatus according to the invention for searching a search object information group composed of a large number of search object information, Information using a computerAn information search device,Based on each feature amount extracted from each search target information included in the search target information group,Each search object information isSo that the high similarity between the search target information is close to each other,From 2D or 3D spaceInformation arrangement to form a search target layer and store it in a storage deviceMeans and search objectThe search target information selected as a representative from the search target information included in each block divided into a plurality of blocks is set as the nth search target layer in another hierarchical space.The (n-1) th search target layers are arranged to recursively repeat the first to nth search target layers.IncludingVirtual 3D object search spaceAnd store in the storage deviceA search image for performing control for displaying a search image obtained by looking in the target search space by a search space construction means and a viewpoint having a line of sight from the top to the bottom of the target search space. Display control means;According to the operation input from the operation input meansViewpoint control means for moving the viewpoint in the target search space.
[0015]
Claim3An apparatus according to the invention for searching a search object information group composed of a large number of search object informationUsing a computerInformation search apparatus, each search target information included in the search target information groupBased on each feature amount extracted from the search target information, so that the high similarity between the search target information is close to each other,Form a search target layer by placing it in a hierarchical space consisting of 2D or 3D spaceDisplay data representing the search object information and its position are stored in a storage device.The information arrangement means and the search target layer as the nth search target layer, and search target information selected as representative from the search target information included in each block divided into a plurality of blocks The (n-1) th search target layer is formed by arranging in the inside, and this is recursively repeated to virtually construct a three-dimensional target search space including the first to nth search target layersThen, the size of the outline of the search information included in each search target is increased as it becomes higher, and the distance between each search target layer and the search target layer above it is Search space construction means for arranging each search target layer so as to become larger as it becomes a hierarchy, and storing display data of each search target information and its position in the storage device,Search image display control means for performing control for displaying on the screen a search image obtained by looking inside the target search space with a viewpoint having a line of sight directed from the top to the bottom of the hierarchy of the target search space;According to the operation input from the operation input meansViewpoint control means for moving the viewpoint in the target search space.
[0017]
Claim4In the apparatus according to the invention, the search space constructing unit arranges a symbol display layer on the first search target layer, and displays a symbol expressing the content of the similarity on the symbol display layer. The viewpoint control means moves the viewpoint in the target search space that also includes the symbol display layer.
[0018]
Claim5In the apparatus according to the invention, the viewpoint control means includes a depth direction movement control means for moving the viewpoint in a depth direction along a direction penetrating each search target layer, and the viewpoint in the spreading direction of each search target layer. Expanding direction movement control means for moving; and line-of-sight control means for holding the line of sight while moving the viewpoint in a state facing the depth direction.
[0019]
Claim6In the device according to the invention,PreviousThe point of view control meansA viewpoint operation input means for instructing movement of the viewpoint;Holding the viewing angle of the viewpoint at a certain size,Increase the relative movement speed of the viewpoint with respect to the movement speed indicated by the viewpoint operation input means,The search image display control means displays each search target information on the screen so that its outer shape becomes smaller according to the distance between each search target information and the viewpoint.
[0021]
Claim7In the device according to the invention, the search image display control means displays the search target layers with different background colors.
Claim8The apparatus according to the invention is for a view consisting of a reduced target search space image indicating a positional relationship of each search target layer in the target search space, and a viewpoint position display image indicating the position of the viewpoint in the target search space. A view image display control unit that performs control for displaying a reduced image on the screen on which the search image is displayed.
[0022]
The search space constructed by the present invention will be described with reference to the drawings.
1 and 2, three search target layers SL1 to 3 and a symbol display layer BL are arranged in the search space SS. In the search target layer SL3 that is the deepest layer, all of the search target information SJ that is the search target is arranged. At that time, the search target information SJs are arranged so that those having high similarity are close to each other. For this purpose, various clustering methods are used.
[0023]
In the search target layer SL2, a part of the search target information SJ selected as a representative from the search target information SJ of the search target layer SL3 is arranged. In order to select the representative search target information SJ, as shown in FIG. 3, the search target layer SLm is divided into a plurality of blocks BK. From among the search target information SJm included in each block BK, one or a plurality of representative search target information SJ are selected. The representative search target information SJr is arranged by mapping to the (m−1) th hierarchical space SQ (m−1) which is a layer above it. The first to nth search target layers SL1 to SLn are formed by recursively repeating the process shown in FIG. The search target information SJ1 included in the first search target layer SL1 is about 10, and the search target information SJ1 is simultaneously displayed on the same screen.
[0024]
In the symbol display layer BL, a symbol representing the similarity used in arranging the search target information SJ is displayed at a corresponding position. The symbol display layer BL is an entrance for searching the search target information group DB1, and is an index for quickly reaching the target search target information SJ.
[0025]
In FIG. 1 and FIG. 2, the viewpoint PV is set in order to display the search space SS on the screen HG of the display device 12. The viewpoint PV has a line of sight from the top to the bottom of the hierarchy. Things close to the viewpoint PV appear large, and those far away appear small. What is visible from the viewpoint PV is displayed on the screen HG while still visible. By moving the viewpoint PV in the search space SS, all search target information SJ in the search space SS is displayed on the screen. That is, it is possible to freely search through the search space SS, that is, the search target information group DB1 by moving the viewpoint PV.
[0026]
DETAILED DESCRIPTION OF THE INVENTION
First, the search space SS constructed by the present invention will be described.
1 is a perspective view showing a concept of a search space SS constructed in the present invention, FIG. 2 is a side view of the search space SS, and FIG. 3 is an (m−1) th search target layer from the mth search target layer SLm. FIG. 4 is a diagram schematically illustrating a process of forming SL (m−1), and FIG. 4 is a diagram schematically illustrating a process of performing the same process as FIG.
[0027]
1 and 2, first to third search target layers SL1 to SL3 are arranged at a distance from each other in the search space SS. A symbol display layer BL is disposed on the first search target layer SL1. The symbol display layer BL may be referred to as the 0th layer. In such a case, the fourth to fourth layers are arranged.
[0028]
Each of the search target layers SL1 to SL3 includes all or one of the search target information SJ in a hierarchical space SQ1 to SQ3 that is a three-dimensional space whose thickness (size in the depth direction) is smaller than the vertical and horizontal sizes. The parts are arranged and formed. The hierarchical spaces SQ1 to SQ3 are virtually equal in vertical and horizontal sizes.
[0029]
In the nth search target layer SLn, which is the deepest layer, in the example of FIG. 1, all of the search target information SJ that is the search target is arranged in the third search target layer SL3. When the search target information SJ is arranged on the search target layer SLn, the search target information SJ is arranged so that those having high similarity are close to each other. For this purpose, various known clustering techniques are used. For example, in the technique used in SOM (SOM), feature amounts are extracted for each piece of search target information SJ, and clustering is performed according to the similarity of feature amount vectors generated from the feature amounts. As the similarity, for example, the Euclidean distance is used. The color, shape, size, type, usage, price, time, content, keyword, etc. of the search target information SJ are used as criteria or elements of similarity. These can be automatically determined according to the type or content of the search target information SJ, or can be selected independently by the user. When the search target information SJ is arranged, if similar search target information SJ overlaps each other two-dimensionally, they are arranged with an interval in the depth direction so as not to overlap three-dimensionally. Therefore, the hierarchical space SQ is three-dimensional.
[0030]
In the second search target layer SL2 that is one layer above the third search target layer SL3, a part of the search target information SJ selected as a representative from the search target information SJ is arranged. The search target information SJ arranged in the second search target layer SL2 may be particularly referred to as “search target information SJ2”. Similarly, in the first search target layer SL1 that is one layer above the second search target layer SL2, a part of the search target information SJ selected as a representative from the search target information SJ2 is arranged. . The search target information SJ arranged in the first search target layer SL1 may be particularly referred to as “search target information SJ1”. It should be noted that “m” is used when expressing layers of any depth from the first to the nth, for example, “search target information SJm arranged in the m-th search target layer SLm”. May be described.
[0031]
In the search target layer SLm, in order to select the representative search target information SJ from the search target information SJm, the search target layer SLm is divided into a plurality of blocks BK as shown in FIG. Here, the blocks BK are divided into a matrix so that the areas of the blocks BK are equal and each block BK includes about 9 to 10 pieces of search target information SJ on average. For the search target information SJm included in each block BK, one or a plurality of representative search target information SJ are selected. The representative search target information SJ may be described as “representative search target information SJr”. In selecting the representative search target information SJr, for example, the search target information SJ located at the center most in each block BK is selected. Although the representative search target information SJr is one for each block BK, at least one representative search target information SJr is set for each block BK. It may be increased to one. When there is no search target information SJ in the block BK, the representative search target information SJr is zero.
[0032]
The representative search target information SJr selected in the search target layer SLm is arranged by mapping to the (m−1) th hierarchical space SQ (m−1), which is the upper layer. That is, the representative search target information SJr of the search target layer SLm is arranged at the same position as the hierarchical space SQm in the hierarchical space SQ (m−1). At that time, the representative search target information SJr is expanded three times in both vertical and horizontal depths. Accordingly, the search target layer SL (m−1) includes about nine times as many search target information SJs as the search target information SJm included in the search target layer SLm. When the search target information SJm and the search target information SJ (m−1) included in each of the SLm and the search target layer SL (m−1) are seen to have the same size, the average The density also looks the same.
[0033]
The first to nth search target layers SL1 to SLn are formed by recursively repeating the process shown in FIG. The search target information SJ1 included in the first search target layer SL1 is about 10, and the search target information SJ1 is simultaneously displayed on the same screen. That is, the number of search target information SJ1 included in the first search target layer SL1 is about ten, which makes it easy for the user to recognize the search target information SJ1 displayed on the screen at one time and meets the purpose of the search. The process shown in FIG. 3 is recursively repeated until it becomes possible to easily determine whether or not to proceed.
[0034]
In FIG. 4, the search target information SJm arranged in the m-th search target layer SLm is divided into an appropriate number of search target information SJm having a high degree of similarity, and each is defined as a block BK. One representative search target information SJr is selected from each block BK, and is arranged by mapping to the (m−1) th hierarchical space SQ (m−1).
[0035]
In the sorting method shown in FIG. 3, the sorting process is easy, but the number of search target information SJ included in each block BK is uneven. In the classification method shown in FIG. 4, the classification process takes time, but the search target information SJ having a high degree of similarity enter the same block BK, and the representative search target information SJr represents the block BK. Meaning is high.
[0036]
In the symbol display layer BL, the symbol of the element of the feature amount vector indicating the similarity used in the arrangement of the search target information SJ in the nth search target layer SLn corresponds to the center of the similar search target information SJ. Place and display in position. For example, when a color is used as a reference for similarity, a character representing each color or the color itself is displayed as a symbol. When a keyword is used as a criterion for similarity, the keyword is displayed by characters.
[0037]
Thus, the symbol display layer BL is an entrance when searching the search target information group DB1, and is an index for quickly reaching the target search target information SJ. Therefore, for example, when the search target information SJ itself of the first search target layer SL1 serves as an index, the symbol display layer BL may not be provided.
[0038]
In FIGS. 1 and 2 again, the viewpoint PV is set in order to display the search space SS on the screen HG of the display device 12. The viewpoint PV has a line of sight in a direction from the first search target layer SL1 toward the third search target layer SL3. The direction of the line of sight is usually parallel to an axis that vertically penetrates each of the search target layers SL1 to SL3, but an angle β can be given to the axis by an operation input. By appropriately taking the angle β, the search space SS is displayed three-dimensionally. By increasing the angle β, the search target layers SL1 to SL3 can be viewed from the back side. The viewing angle α of the line of sight is constant, but can be changed by an operation input. Things close to the viewpoint PV appear large, and those far away appear small. What is visible from the viewpoint PV is displayed on the screen HG while still visible. By moving the viewpoint PV in the search space SS, all items in the search space SS, that is, arbitrary search target information SJ arranged in the search target layers SL1 to SL3 can be displayed on the screen. . That is, it is possible to freely search through the search space SS, that is, the search target information group DB1 by moving the viewpoint PV.
[0039]
As well shown in FIG. 2, there are spaces SP1 to SP3 between the symbol display layer BL and the search target layers SL1 to SL3, respectively. The depth dimensions of the spaces SP1 to SP3, that is, the distances L1 to L3 between the symbol display layers BL and the search target layers SL1 to SL3 are set to have the following relationship.
[0040]
L1: L2: L3 = 3²: 3¹: 3⁰= 9: 3: 1
This relationship is the reciprocal of the ratio of the average intervals between the search target information SJ included in the search target layers SL1 to SL3. That is, since the number of the representative search target information SJr is divided into about one ninth of the number of the search target layers SLm of the original search target layer SL, the search target information included in each of the search target layers SL1 to SL3. For the number of SJs N1-3,
N1: N2: N3 = 1: 9: 81
= (3⁰× 3⁰): (3¹× 3¹): (3²× 3²)
It becomes. Therefore, the average intervals D1 to D3 of the search target information SJ in the search target layers SL1 to SL3 are inversely proportional to the square root of the ratio of the numbers N1 to N3.
D1: D2: D3 = 3²: 3¹: 3⁰= 9: 3: 1
It becomes. Further, the average sizes Z1 to Z3 of the search target information SJ in the search target layers SL1 to SL3 are as follows:
Z1: Z2: Z3 = 3²: 3¹: 3⁰= 9: 3: 1
It becomes.
[0041]
Accordingly, when the search target layer SLm is viewed from the position of the search target layer SL (m−1), the state of the search target information SJm seen there, that is, the size, interval, number, etc. of the search target information SJm is m The state is almost the same regardless of the value of. Therefore, the state of the search target information SJm displayed on the screen when the viewpoint PV is at those positions is almost the same regardless of the value of m.
[0042]
When moving the viewpoint PV, the values V1 to V3 of the ratio between the operation speed of the operation input unit 14 and the movement speed of the viewpoint PV in the spaces SP1 to SP3 are as follows.
V1: V2: V3 = 3²: 3¹: 3⁰= 9: 3: 1
It becomes. Therefore, if the operation speeds in the spaces SP1 to SP3 are the same, the time required for moving in the spaces SP1 to SP3 in the depth direction is the same, and the spreading direction of the layers in each search target layer SLm, that is, the horizontal direction. Alternatively, the search speed of the search target information SJm is also the same by moving in the vertical direction.
[0043]
Thus, the distances L1 to L3, the number N1 to N3, the average interval D1 to 3, the average size Z1 to Z3, the values V1 to V3 of the ratio between the operation speed of the operation input unit 14 and the moving speed of the viewpoint PV, etc. As described above, the two-dimensional screen HG of the display device 12 can be used effectively, and the uniformity among the search target layers SL in the search image FS viewed from the user can be maintained. Further, all the search target layers SL can be searched uniformly by the operation input of the operation input unit 14.
[0044]
Further, during the movement of the viewpoint PV, the direction of the line of sight is fixed in a direction parallel to the axis, so that it is displayed on the screen in the search target layer SL (m−1) when moving in the direction parallel to the axis. The search target information SJ is also displayed on the screen in the next search target layer SLm. This stabilizes the displayed search image FS and facilitates searching for the search target information SJ.
[0045]
Next, an embodiment of the information search apparatus 1 for creating a search space SS and displaying a search image FS to perform information search will be described.
FIG. 5 is a block diagram showing a hardware configuration of the information search apparatus 1 according to the present invention.
[0046]
In FIG. 5, the information search device 1 includes a processing device 10, a storage device 11, a display device 12, a printer 13, a keyboard 14, and a mouse 15.
The storage device 11 stores a search target information group DB1 composed of a large number of search target information SJ that are search targets, other data and databases, a program group that performs processing for information search, and the like. The keyboard 14 and the mouse 15 are used for performing an operation input by a user, giving a command to the processing apparatus 10, or inputting data. The keyboard 14 or the mouse 15 may be referred to as the operation input unit 14. The processing device 10 includes an arithmetic unit, a memory area including a RAM, a ROM storing a program, and the like. The processing device 10 executes various processes in accordance with a command by an operation input from the operation input unit 14, and performs a search image FS, a prospect. The reduced image FV and other images are displayed on the screen of the display device 12.
[0047]
The information search apparatus 1 is connected to another computer (not shown), a host computer, a server, a network, or the like via a line 19, and can access various databases and receive necessary information through communication therewith. Such an information search apparatus 1 can be realized by a workstation or a personal computer.
[0048]
FIG. 6 is a block diagram functionally showing the information search apparatus 1.
6, the information search apparatus 1 includes a search target information group DB1, a search space information group DB2 including information such as a search target layer SL and a symbol display layer BL related to the search space SS, an information arrangement unit 21, and a search space construction. A unit 22, a viewpoint control unit 23, a search image display control unit 24, and a perspective image display control unit 25. The viewpoint control unit 23 includes a depth direction movement control unit 31, a spread direction movement control unit 32, a line-of-sight control unit 33, and an operation input unit 14.
[0049]
The information arrangement unit 21 arranges the search target information SJ in a hierarchical space SQ composed of a two-dimensional or three-dimensional space to form a search target layer SL. When the search target information SJ is arranged in the hierarchical space SQ, the search target information SJ is arranged so that highly similar ones are close to each other. Therefore, processing by various clustering methods is also performed. The search target layer SL formed here is the deepest nth search target layer SLn that is a basis for constructing the search space SS.
[0050]
The search space construction unit 22 performs a process for virtually constructing a three-dimensional search space SS including the first to n-th search target layers SL1 to SL and the symbol display layer BL. In constructing the search space SS, the search target layer formed by the information placement unit 21 is defined as the nth search target layer SLn, and each of the search target information SJ included in each block BK divided into a plurality of blocks. The search target information (representative search target information SJr) selected as the representative is arranged by mapping in another hierarchical space SQ to form the (n-1) th search target layer SL (n-1), and this Repeat recursively.
[0051]
The viewpoint control unit 23 performs various controls for moving the viewpoint PV having a line of sight from the top to the bottom of the search space SS in the search space SS.
The search image display control unit 24 displays a search image FS obtained by looking in the search space SS from the viewpoint PV on the screen HG. At this time, a background color determined in advance corresponding to the closest displayed search target layer SL is displayed. That is, if the nearest search target layer SL is changed, the background color is also changed. Accordingly, the user can easily recognize the hierarchy in which the viewpoint PV exists, the fact that the viewpoint PV has passed through the hierarchy, and the like, and search efficiency can be improved.
[0052]
The perspective image display control unit 25 includes a reduction target search space image FR indicating the positional relationship of each search target layer SL in the search space SS, and a viewpoint position display image FP indicating the position of the viewpoint PV in the search space SS. The reduced image for viewing FV is displayed on the screen on which the search image FS is displayed. The reduced-view image FV allows the user to immediately recognize the structure of the search space SS and the position of the viewpoint PV in the search space SS.
[0053]
The depth direction movement control unit 31 performs control for moving the viewpoint in the depth direction (axial direction) along the direction penetrating each search target layer SL. The spread direction movement control unit 32 performs control for moving the viewpoint PV in the spread direction of each search target layer SL. The line-of-sight control unit 33 controls the direction of the line of sight of the viewpoint PV, and controls the line of sight in a direction parallel to the axis, particularly during movement of the viewpoint PV. Accordingly, the moving speed of the viewpoint PV based on the operation input from the operation input unit 14 is also controlled.
[0054]
Next, a description will be given of a case where the information search apparatus 1 performs an information search using the book data as the search target information SJ. In the example shown below, the book data SJD is obtained by searching “file” from a large number of book data as a keyword.
[0055]
FIG. 7 is a flowchart showing a flow of processing for creating the search space data SSD based on the book data SJD, and FIG. 8 shows a case where the search space SS is displayed on the screen as the search image FS based on the search space data SSD and the search is performed. 9 to 13 are diagrams showing examples of the screens HG1 to HG5 on which the search image FS is displayed. FIG. 9 shows the search image FS1 and the reduced image for viewing on the symbol display layer BL1. FIG. 10 shows a screen HG1 of the search target layer SL1, FIG. 10 shows a screen HG2 of the search image FS2 of the search target layer SL1, FIG. 11 shows a screen HG3 of the search image FS3 of the search target layer SL2, and FIG. FIG. 13 is a diagram showing a screen HG4 of the search image FS4 of SL3, and FIG. 13 is a diagram showing a display image of the searched book SJB1 and bibliographic data GMD.
[0056]
In FIG. 7, book data SJD as search object information SJ is prepared (# 11). The book data SJD may be, for example, an entire library of books provided in a library or the like, but if the database is too large, a specific field, classification, The book data extracted by searching for the item, age, etc. using keywords is used. The book data SJD is, for example, forms such as title (book title), author name, publisher, publication date, etc. of each book, cover image, number of pages, size (A4 size, B5 size, etc.) Includes data and table of contents data. It may contain an abstract of the contents of the book or all data of the contents. The cover image is data obtained by reading an actual cover image of a book with an image reader, or data created by CG (computer graphics) or the like. The form data is mainly used to create a three-dimensional image of a book.
Using the book data SJD as an input, the feature quantity of the book is extracted (# 12), and a feature quantity vector is obtained (# 13). For example, keywords are extracted from the title and table of contents, and hue data is extracted from the cover image. The feature amount may be extracted in advance. In that case, the feature amount suitable for the purpose of the search is extracted from the feature amount extracted in advance at the time of the search, and the number of elements is small. A feature vector is used. For example, when the frequency of appearance for each book for a certain keyword divided by the appearance frequency in all books is used as the feature amount, only the keywords suitable for dividing the entire book to be searched into two Is adopted. That is, a keyword that is divided into a book with a high appearance frequency and a book with a low appearance frequency is adopted. It is not practical to use a feature vector whose elements are all the appearing keywords from the purpose of searching for a target book.
[0057]
Next, using the selected feature vector as an input, for example, using the Euclidean distance as the similarity, clustering is performed on the book data SJD using an appropriate clustering method, and the result is mapped to the hierarchical space SQn. (# 14) The search target layer SLn is obtained (# 15).
[0058]
Based on the search target layer SLn, another search target layer SL is formed and layered (# 16). At this time, representative book data SJr1 is selected for each divided block BK, and upper search target layers SL1 to (n-1) are created. It is not necessary to select the representative book data SJr1 for the block BK in which the book data SJD does not exist. When the symbol display layer BL is necessary, the symbol BLS is created and arranged based on the feature vector and its elements.
[0059]
In creating the search target layer SL, the number of hierarchies b is determined as follows. If a is the number of books existing in the highest hierarchy (first search target layer SL1), a^bIs determined to be equal to the smallest integer exceeding the number of books existing in the lowest hierarchy (the nth search target layer SLn). a needs to be determined depending on the resolution of the screen, but if the display device 12 has a resolution of about 600 × 600 dots, a value of about a = 10 is set when displaying an image of about 100 × 100 dots. Is desirable. If A is the number of books in the lowest hierarchy,
b = logA / loga
However, round up after the decimal point.
It becomes. For example, when a = 10 and A = 100, b = 2.
[0060]
Since the vertical and horizontal sizes of each hierarchy are the same, the size of the book image in each hierarchy is made different as follows according to the number of books in the hierarchy. That is, if the size of the image of the book in the lowest hierarchy (the vertical and horizontal dimensions) is determined, the size of the image of the book in the m-th hierarchy and the (m−1) -th hierarchy is set to U, respectively._m, U_m-1And the number of books belonging to each level is d_m, D_m-1Then, the following formula
U_m-1= U_m(D_m/ D_m-1)^1/2
The size of the book image in the upper hierarchy is determined from the lower hierarchy. The distance L between the layers is set based on the position of the viewpoint PV at which the size of the book displayed on the screen HG of the display device 12 is the same in each layer. Therefore, the ratio of the distance L between the levels is set to be the same as the ratio of the size of the books in each level. However, for example, it may be set so that all books in one layer are displayed on the screen HG at a time.
[0061]
Next, for each book, form data such as a cover image, the number of pages, size, and the like are extracted from the book data SJD, and book display data SSDB for displaying the book as a three-dimensional image on the screen is created (# 17). ). Thus, search space data SSD for displaying the search space SS on the screen is created (# 18). Search space data SSD includes hierarchical space data SSDL such as the position of books in each hierarchy, the distance between hierarchies, the background color of the hierarchy, and the size of the display book, and the cover image, the number of pages, the size, etc. It consists of book display data SSDB. The created search space data SSD is stored in the storage device 11.
[0062]
In FIG. 8, the search space data SSD is input (# 21), and a three-dimensional image of the search space SS is generated (# 22). The three-dimensional image of the search space SS includes a three-dimensional image of a hierarchical space based on the hierarchical space data SSDL and a three-dimensional image of a book based on the book display data SSDB. A 3D image of a book uses a cover image to generate a 2D image of the cover, determines the thickness of the book according to the number of pages, determines the vertical and horizontal dimensions of the book according to the size, and combines them. It was obtained.
[0063]
Then, based on the three-dimensional image of the search space SS, a two-dimensional search image FS is created by a three-dimensional display routine (# 23), and this is displayed on the screen HG of the display device 12 (# 26). Walk-through is realized by moving the viewpoint PV in the search space SS in accordance with an operation input from the operation input unit 14 and displaying the search image FS viewed from the viewpoint PV (# 25). For example, when the mouse 15 is moved back and forth with the left button of the mouse 15 being pressed, the viewpoint PV is moved in the depth direction of the search space SS and the mouse 15 is moved. When the right button is pressed, the viewpoint PV is moved in the vertical and horizontal directions of the search space SS.
[0064]
Based on the three-dimensional image of the search space SS, a reduced-view image FV is created (# 24) and displayed on the upper left of the screen of the display device 12 (# 26). The reduced image for viewing FV changes in conjunction with the search image FS when the viewpoint PV is walked through.
[0065]
Note that the above-described flowchart and each block of the information search apparatus 1 shown in FIG. 6 generally correspond as follows. Steps # 12 to 15 in the flowchart are performed by the information placement unit 21, steps # 16 and 17 are performed by the search space construction unit 22, steps # 22 and 23 are performed by the search image display control unit 24, and step # 24 is a view image display control unit. 25, the process of step # 25 is executed by the viewpoint control unit 23. The book data SJD corresponds to the search target information SJ or the search target information group DB1, and the search space data SSD corresponds to the search space SS or the search space information group DB2.
[0066]
Next, a specific example of the search image FS will be described.
When the search is started, the viewpoint PV is at a position where the entire symbol display layer BL enters the field of view. The search image FS1 at that time is shown in FIG. In FIG. 9, a search image FS1 and a reduced image for viewing FV1 are displayed on the screen HG1. On the upper left of the screen HG1, a button BT1 for changing the viewing direction of the viewpoint PV1, a button BT2 for displaying the book SJB as a three-dimensional image, and the like are displayed.
[0067]
In the search image FS1, a symbol display layer BL1 having a symbol BLS arranged in the foreground is displayed, a search target layer SL1 in which a book SJB is arranged in the back, and a search target layer SL2 in which a book SJB is arranged in the back. Is displayed extremely small. Further, the search target layer SL3 is also displayed in the back, but it is too small and hidden behind the book SJB in front, and is not recognized in FIG. That is, the entire search space SS1 is temporarily displayed in the search image FS1. The reduced image for viewing FV1 displays a perspective view of the search space SS1 and the position of the viewpoint PV1. The overall structure of the search space SS1 and the current position of the viewpoint PV1 are obvious at a glance by the reduced image for viewing FV1.
[0068]
By the operation input of the mouse 15, the viewpoint PV1 can be freely moved up and down, left and right, and back and forth within the search space SS1. For example, to search for a book SJB related to “command”, if the viewpoint PV1 is moved in the upper left direction in the search image FS1 and the “command” that is the symbol BLS is moved to the center of the search image FS1, the subsequent operation is performed. Simple.
[0069]
When the viewpoint PV1 is gradually moved in the depth direction on the screen HG1, the image in the search image FS1 gradually increases, and finally, only the image of the symbol BLS present at the center at that time is transmitted therethrough. The state is displayed on the screen HG as the search image FS. When the symbol display layer BL1 is transmitted in this manner, the next search target layer SL1 is displayed in the forefront. The search image FS2 at that time is shown in FIG.
[0070]
In FIG. 10, the search image FS2 is displayed on the screen HG2. Although the reduced image for viewing FV is also displayed, the illustration is omitted. In the search image FS2, the search target layer SL1 in which the book SJB is arranged in the foreground is displayed, and the search target layer SL2 in which the book SJB is arranged in the back is displayed small.
[0071]
Although illustration is omitted, the cover image is displayed on each book SJB, and the book SJB is displayed as a three-dimensional image (see FIG. 13). Therefore, for the book SJB of the search target layer SL1, the contents of the cover can be confirmed on the screen HG2, and whether or not the book is the target book and whether it is close to it or not is displayed on the screen HG2. Can be confirmed. Since the thickness of the book SJB is expressed by a three-dimensional image, the book SJB is close to an actual image, and an intuitive search is easy. On the screen HG2 (as in the following screens HG3 to HG5), when the book SJB is designated with the cursor and the mouse 15 is clicked, the bibliographic data GMD for the book SJB is displayed. If necessary, the table of contents data of the book SJB can be displayed, and further, the contents data of the book SJB can be obtained from another database via the line 19 and displayed.
[0072]
In the search image FS2, when it is desired to enlarge a specific book SJB, the viewpoint PV1 may be brought close to the book SJB. When a plurality of books SJB are displayed in an overlapping manner, the entire book SJB behind the book SJB is displayed by passing through the previous book SJB. In the search target layer SL1, the position of the viewpoint PV is corrected so as to approach the target book SJB. When the viewpoint PV1 is further advanced in the depth direction, the search target layer SL1 is transmitted, and the next search target layer SL2 is displayed in the forefront. At the moment of passing through the search target layer SL1, the background color of the screen HG changes to the color set for the next search target layer SL2. A search image FS3 immediately after transmission is shown in FIG.
[0073]
In FIG. 11, the search image FS3 is displayed on the screen HG3. In the search image FS3, the search target layer SL2 in which the book SJB is arranged in the foreground is displayed, and the search target layer SL3 in which the book SJB is arranged in the back is displayed small. The book SJB displayed in the search image FS3 is a part of the book SJB arranged in the search target layer SL2. In order to view another book SJB of the search target layer SL2, the viewpoint PV1 may be moved up, down, left and right. Other points are the same as those of the search image FS2.
[0074]
When the viewpoint PV1 is further advanced in the depth direction, the search target layer SL2 is transmitted and the next search target layer SL3 is displayed. A search image FS4 immediately after transmission is shown in FIG.
[0075]
In FIG. 12, a search image FS4 is displayed on the screen HG4. In the search image FS4, a search target layer SL3 in which the book SJB is arranged is displayed. All of the book data SJD to be searched are arranged in the search target layer SL3, and all the books SJB arranged in the search target layer SL3 are moved by moving the viewpoint PV1 up and down and left and right in the search image FS4. It is possible to see. The target book SJB or the book SJB that seems to be the target book SJB is brought to the center of the screen HG and displayed in a large size, and the bibliographic data of the book SJB is displayed by specifying it by clicking on it.
[0076]
In FIG. 13, the image of the designated book SJB1 and the bibliographic data GMD are displayed on the screen HG5. If necessary, you can display the table of contents data and check the contents. If the book SJB1 is for the purpose of search, the management information of the library for the book SJB1 can be displayed by the operation input, and the lending procedure can be performed. In addition, the content data can be received via the line 19 and the content can be viewed on the screen HG of the display device 12.
[0077]
As described above, according to the information search apparatus 1, a three-dimensional search space SS is constructed based on a large amount of search target information SJ, and the search image FS is displayed on the screen HG through a walk-through. The foremost search target layer SL1 is composed of about ten representatives selected from all the search target information SJ, and the one closest to the target search target information SJ is selected from among the ten search target information SJ. Then, by proceeding to the next search target layer SL while correcting the position of the viewpoint PV toward the target in each search target layer SL, such as proceeding to the next search target layer SL2, finally the target The search target information SJ or the search target information SJ having a high degree of similarity to the search target information SJ can be easily reached. In this way, the search target information SJ such as book data can be efficiently searched.
[0078]
Further, in the search space SS, the viewpoint PV can move in any direction, and in any search target layer SL, the viewpoint PV can be moved in the vertical and horizontal directions so that the entire search target layer SL can be viewed. The trajectory of the position or traveling direction of the viewpoint PV can be corrected without returning to the reverse direction of the hierarchy.
[0079]
Since the distance is provided between the search target layers SL, the position where the viewpoint PV exists, the state of the currently displayed search target layer SL, and the like can be easily recognized. The processing time for constructing the search space SS, that is, creating the search space data SSD can be shortened by vectorizing the similarity of the search target information SJ and selecting or determining an element to be used according to the purpose of the search. In addition, the search space SS can be configured to meet the purpose and search efficiency can be improved. In addition, by displaying the search target information SJ in an image viewed from the optimal direction for grasping the search target information SJ, such as displaying the book SJB as a three-dimensional image, the time for the user to recognize the search target information SJ is shortened. Can be made more efficient.
[0080]
In the search image FS, at the time when it passes through each search target layer SL, about 10 search target information SJ arranged in the next search target layer SL is displayed in the foreground. The user can easily discriminate and it is easy to correct the position of the viewpoint PV. If it is desired to increase the number, the distance L should be increased or the viewing angle α should be increased.
[0081]
In the above-described embodiment, the example in which the book data SJD is the search target information SJ has been described, but the present invention can be applied to other various search target information SJ. An example is given below.
(1) A product posted in a catalog for mail order sales or the like is set as search target information SJ. The product is arranged in the nth search target layer SLn. At that time, the similarity is determined and arranged according to the use, type, color, price, etc. of the product. In the search image FS, for example, about 10 types of bag images are displayed on the search target layer SL1, and the user moves the viewpoint PV according to a desired shape or color, and walks through the search space SS. When you find a product you want to purchase, you can click on it to get information such as the model number and price of the product. The product is ordered by inputting the number of purchases.
(2) For each of a number of paintings, obtain impressions from the paintings, such as warm, lonely, and refreshing impressions in advance through questionnaires, and determine the degree of similarity according to the impression and the color of the painting. It arrange | positions in search object layer SLn. The user searches for a picture he / she wants to see according to his / her mood.
(3) For many photographs taken in the past, the degree of similarity is determined according to the shooting date, shooting location, person, impression, weather, etc., and the search space SS is constructed and organized. When a photograph of a specific image is desired to be viewed, the search space SS is searched along with the image.
(4) The search space SS is constructed by determining the similarity of a large number of haikus according to the season, impressions, and the like. When creating a new haiku, the search space SS is searched according to the mood at that time, and it is used as a stimulus for creating a haiku.
[0082]
In the embodiment of the information search device 1 described above, the hierarchical space SQ is a three-dimensional space. However, if the search target information SJ does not overlap two-dimensionally or can be overlapped, the two-dimensional It can be a space. The vertical and horizontal dimensions of the hierarchical spaces SQ1 to SQ3 are the same size, but may be different sizes. For example, the hierarchical spaces SQ1, 2, and 3 may be increased in a ratio of 1: 3: 9 in this order. In this case, for example, the search target information SJ is arranged in the same size in any of the hierarchical spaces SQ1 to SQ3, and the distance L between them and the ratio of the moving speed of the viewpoint PV to the operation input are made the same. That is, by doing so, it is possible to maintain uniformity among the search target layers SL in the search image FS as seen from the user. Further, all the search target layers SL can be searched uniformly by the operation input of the operation input unit 14. However, such a configuration of the search space SS is virtual and may be regarded as substantially the same as the configuration described in the above example.
[0083]
In the above-described embodiment, the number of search target layers SL, the number of search target information SJ, the ratio of the representative search target information SJr, the configuration of the search image FS or the reduced view image FV, the configuration of the entire information search apparatus 1 or each unit The contents or order of the processing can be appropriately changed in accordance with the gist of the present invention.
[0084]
【The invention's effect】
Claims 1 to8According to the invention, it is possible to efficiently search a large amount of information that is a search target.
[0085]
Claim4According to the present invention, when starting the search, the entrance for quickly reaching the target search target information becomes clear, and an efficient search can be performed.
Claim5According to the invention, the displayed search image is stable, and the search for the search target information becomes easy.
[0086]
Claim4And claims6According to the invention, the screen of the display device can be used effectively, and the uniformity between the search target layers in the search image viewed from the user can be maintained. Further, all search target layers can be searched uniformly by operation input.
[0087]
Claim7According to this invention, it is possible to easily recognize the hierarchy in which the viewpoint exists, the fact that the viewpoint has passed through the hierarchy, and the like, and the search efficiency can be improved.
Claim8According to the invention, the structure of the search space and the position of the viewpoint in the search space can be recognized immediately.
[Brief description of the drawings]
FIG. 1 is a perspective view showing a concept of a search space constructed in the present invention.
FIG. 2 is a side view of a search space.
FIG. 3 is a diagram schematically illustrating a process of forming an (m−1) th search target layer SL (m−1) from an mth search target layer SLm.
FIG. 4 is a diagram schematically showing a state in which the same processing as that in FIG. 3 is performed by another type of classification method.
FIG. 5 is a block diagram showing a hardware configuration of an information search apparatus according to the present invention.
FIG. 6 is a block diagram functionally showing the information search apparatus.
FIG. 7 is a flowchart showing a flow of processing for creating search space data based on book data.
FIG. 8 is a flowchart showing a flow of processes and operations when a search space is displayed on a screen as a search image based on search space data and a search is performed.
FIG. 9 is a diagram illustrating an example of a screen displaying a search image.
FIG. 10 is a diagram illustrating an example of a screen displaying a search image.
FIG. 11 is a diagram illustrating an example of a screen displaying a search image.
FIG. 12 is a diagram illustrating an example of a screen displaying a search image.
FIG. 13 is a diagram showing a display image and bibliographic data of a searched book.
[Explanation of symbols]
1 Information search device
14 Keyboard (viewpoint operation input means)
15 Mouse (viewpoint operation input means)
21 Information arrangement part (information arrangement means)
22 Search space construction part (search space construction means)
23 Viewpoint control unit (viewpoint control means)
24 Search image display control unit (search image display control means)
25 View image display control unit (view image display control means)
31 Depth direction movement control unit (depth direction movement control means)
32 Spreading direction movement control unit (Spreading direction movement control means)
33 Gaze Control Unit (Gaze Control Unit)
SJ search target information
DB1 search target information group
SQ hierarchical space
SL search target layer
SS search space (target search space)
PV perspective
FS search image
BL symbol display layer
BLS symbol
FR reduction target search space image
FP viewpoint position display image
FV view reduced image

Claims (8)

An information search device using a computer for searching in a search target information group composed of a large number of search target information,
And hierarchical spatial arrangement means for storing first to each layer space of the n consisting of two-dimensional or three-dimensional spatial placement into storage,
Based on each feature quantity extracted from each search target information included in the search target information group, the search target information is set so that the ones having high similarity between the search target information are close to each other . The n-th search target layer is formed by arranging in the n hierarchical space, and the search target information of the n-th search target layer is classified for each one or a plurality of search target information close to the arranged position. And the search target information located near the center of the block included in each block is selected as representative search target information, and the selected representative search target information is selected from the (n-1) -th items. The (n-1) th search target layer is formed by mapping at a position corresponding to the position in the nth search target layer in the hierarchical space, and this is repeated recursively from the first. Includes at least the nth search target layer A search space construction unit to be stored in the storage device a three-dimensional target search space by virtually constructed,
Search image display control means for performing control for displaying on the screen a search image obtained by looking inside the target search space with a viewpoint having a line of sight directed from the top to the bottom of the hierarchy of the target search space;
Viewpoint control means for moving the viewpoint in the target search space in response to an operation input from the operation input means;
An information search apparatus comprising: For searching through the search target information group composed of a number of search target information, a information search apparatus using a computer,
Based on each feature amount extracted from each search target information included in the search target information group , each search target information is positioned so that those having high similarity between the search target information are close to each other. An information arrangement means for arranging a search target layer in a hierarchical space composed of a two-dimensional or three-dimensional space and storing it in a storage device ;
The search target layer is the nth search target layer, and search target information selected as a representative from the search target information included in each block divided into a plurality of blocks is arranged in another hierarchical space. An (n−1) -th search target layer is formed, and this is recursively repeated to virtually construct a three-dimensional target search space including the first to n-th search target layers and store it in the storage device and the search space construction means that,
Search image display control means for performing control for displaying on the screen a search image obtained by looking inside the target search space with a viewpoint having a line of sight directed from the top to the bottom of the hierarchy of the target search space;
Viewpoint control means for moving the viewpoint in the target search space in response to an operation input from the operation input means;
An information search apparatus comprising: An information search device using a computer for searching in a search target information group composed of a large number of search target information,
Based on each feature amount extracted from each search target information included in the search target information group, each search target information is positioned so that those having high similarity between the search target information are close to each other. An information arrangement means for forming a search target layer by arranging in a hierarchical space composed of a two-dimensional or three-dimensional space, and storing display data representing the search target information and its position in a storage device;
The search target layer is the nth search target layer, and search target information selected as a representative from the search target information included in each block divided into a plurality of blocks is arranged in another hierarchical space. (N-1) search target layers are formed, and this is recursively repeated to virtually construct a three-dimensional target search space including the first to nth search target layers, and each of the search targets So that the outer size of the search information included in the search information layer becomes larger as it becomes higher, and the distance between each search target layer and the search target layer above becomes larger as it becomes higher. A search space construction means for arranging each search target layer, and storing display data of each search target information and its position in the storage device;
Search image display control means for performing control for displaying on the screen a search image obtained by looking inside the target search space with a viewpoint having a line of sight directed from the top to the bottom of the hierarchy of the target search space;
Viewpoint control means for moving the viewpoint in the target search space in response to an operation input from the operation input means;
An information search apparatus comprising: The search space construction means includes
A symbol display layer is disposed on the first search target layer;
In the symbol display layer, a symbol expressing the content of the similarity is arranged at a position corresponding to a position near the center of the similarity,
The viewpoint control means includes
Moving the viewpoint in the target search space including the symbol display layer;
The information search device according to claim 2 or claim 3 . The viewpoint control means includes
A depth direction movement control means for moving the viewpoint in a depth direction along a direction penetrating each search target layer;
Spreading direction movement control means for moving the viewpoint in the spreading direction of each search target layer;
Line-of-sight control means for holding the line of sight during movement of the viewpoint in a state facing the depth direction;
Information search apparatus according to claims 2 to 4 having a. The viewpoint control means includes
It has a viewpoint operation input means for instructing movement of the viewpoint , holds a visual angle of the viewpoint at a constant size, and sets a relative movement speed of the viewpoint with respect to a movement speed instructed by the viewpoint operation input means. , Make it bigger to the upper layer,
The search image display control means includes
Displaying each of the search target information on the screen so that its outer shape becomes smaller according to the size of the distance between each search target information and the viewpoint;
The information search device according to claim 5 . The search image display control means displays each search target layer with a different background color.
The information search device according to any one of claims 2 to 6 . A reduced image for perspective consisting of a reduced target search space image showing the positional relationship of each search target layer in the target search space and a viewpoint position display image showing the position of the viewpoint in the target search space, the search image Having a perspective image display control means for performing control for displaying on the screen on which is displayed.
Information search apparatus according to any one of claims 2 to 7.

Images