JP2001167119A - Device for constructing and retrieving library information retrieving space and computer-readable recording medium with program for constructing and retrieving library information retrieving space recorded thereon - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device for constructing and retrieving library information retrieving space enabling a retrieving person to retrieve related information from parts information by displaying parts information to him/her. SOLUTION: This device is provided with the constructing part 700 of a data inputting means 50 for inputting data required for constructing a three-dimensional retrieving space and a three-dimensional retrieving space constructing means 200 consisting of a video retrieving space constructing means 800 for constructing a retrieving space by a video from inputted data and a video parts anchor constructing means 270 for constructing an anchor to the parts of the video. The device is also provided with the retrieving part 710 of a mouse instruction means 250 for instructing on the three-dimensional space, a three-dimensional retrieving space retrieving means 210 consisting of a video display mans 350 for displaying the three- dimensional retrieving space and a video parts anchor selecting means 470 for generating/ displaying the parts anchor and deciding a retrieving object anchor in accordance with the instruction of the mouse to obtain the retrieving key and a video retrieving means 550 for retrieving three-dimensional related information from the retrieving key of the anchor and displaying it, and a library retrieving means 600 for retrieving library information by using the retrieving key of the anchor and displaying the result.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention relates to a method for searching for a book related information on a three-dimensional space constructed on a computer.
The present invention relates to a book information search space construction / search apparatus that constructs a search space for searching for desired book information and searches for book information, and a computer-readable recording medium that stores a book information search space construction / search program.

[0002]

2. Description of the Related Art As a conventional device of this type, for example, a product, Quick Time VR Authoring Studio, is known.
There is a device called a device that can create an interactive virtual reality scene using photographs and graphics. This device can make a panoramic movie using photos taken with a digital camera or a panoramic camera.

FIG. 19 shows the configuration of this quick time virtual reality authoring studio. In FIG. 19, a 360-degree three-dimensional rendering image on a computer is displayed by a data input unit 2050.
The input data 2005, which is data of a panoramic picture or a picture with an overlap, is read, and the movie generating means 21
00 is used to generate a movie.

FIG. 20 shows a processing flow of the panorama movie generation means (panorama maker) 2130. First, a node in a virtual reality (VR) space for creating a panoramic movie is selected (S3000), and data input means 2 is selected.
A panorama movie is created based on the data input at 050 (S3030). When the panorama data is not 360-degree panorama data (in the case of overlapping pictures), the pictures can be joined to generate panorama data.

When a link to another location is generated from a panoramic movie, a hot spot (anchor as a link source) is generated (S3060). When there are a plurality of nodes, the respective information is linked by manually designating the respective positional relationships (S30).
90). Then, the panoramic image and hot spot information are compressed into finely divided sections to generate a panoramic movie.
(S3100).

FIG. 21 shows an object movie generating means.
The processing flow of (object maker) 2150 is shown. When the input data is an object on a computer (computer graphic (hereinafter, CG) etc.) (3505),
Images are taken at regular intervals around the object (S350
0), if the input data is an image (3510), the image is input and converted to the object movie format
(S3530). The movie generated in S3500 or S3530 is compressed to reduce the size (S3550), and an object movie (3570) is generated.

[0007] In the movie display means 2210 of FIG.
The viewpoint is determined by the mouse instruction of the mouse instruction means 2250, and the video frame selection / display means 2 is determined.
At 300, three-dimensional information is reconstructed by selecting and displaying a video frame that matches the viewpoint in a panoramic movie or an object movie. If there is a link destination, the link destination is acquired by the link destination acquisition unit 2350, and the linked movie is displayed.

As described above, in the quick time virtual reality, an anchor (hot spot or node) as a link source is manually set in the authoring studio which is the construction unit 2700, and the anchor is set at the time of search. Search for linked information based on the information in
It is possible to play the next movie or take another action.

[0009]

In such a conventional apparatus as described above, the more complex the contents of the three-dimensional CG, the larger the number of polygons and the larger the data size. A high-speed personal computer (hereinafter referred to as a PC) with a graphics board can process such data at a high speed, but a low-function, low-cost PC (hereinafter a low-end PC) increases the data size. In such a case, there is a problem in that it takes a long time to read, and walk-through (movement of a viewpoint in a virtual three-dimensional space) cannot be performed naturally.

In the above-mentioned Quick Time Virtual Reality Authoring Studio, an anchor (hot spot) as a link source is set on a panorama movie, a link is established, and another movie is called.
It is possible to take other actions, and it is possible to link multiple panoramic movies, but manually register the position and size of the anchor and the positional relationship of each movie Needed and time-consuming.

Also, by creating an object movie, it is possible to view the object in the panorama movie from the outside. However, since a link source (hot spot) cannot be created in a part of the object movie, the object movie cannot be created. There was a problem that information search for the information could not be performed.

[0012] Therefore, it is not suitable for the application of displaying related information of a book and searching a part of the related information as an anchor in order to search for a book dealing with various wide-ranging events.

[0013] These quick time virtual reality movies have a unique format, and therefore cannot coexist with contents such as CG data in another three-dimensional virtual space. There are various contents indicating the information of the book classification system.
In many cases, it is more effective to use the expression, and in such a case, a problem occurs.

The present invention has been made to solve the above-described problem. When expressing three-dimensional information in video data, the present invention accumulates part information, displays the part information to a searcher, and displays the part information. It is an object of the present invention to provide a book information search space construction / search apparatus capable of searching related information from a computer and a computer-readable storage medium storing a book information search space construction / search program.

[0015]

SUMMARY OF THE INVENTION In view of the above objects, a first invention of the present invention is to search for relevant information of a book in a three-dimensional space constructed on a computer while retrieving the desired book information. A book information search space construction / search apparatus for constructing a search space for searching and searching for book information, wherein data input means for inputting data necessary for constructing a three-dimensional search space; A construction unit composed of a video search space construction means for constructing a video search space based on the data, and a three-dimensional search space construction means comprising a video part anchor construction means for constructing an anchor for a video part; Mouse pointing means for pointing on the top with a mouse, video display means for displaying a three-dimensional search space, generating and displaying anchors of parts, and searching for objects according to the instructions of the mouse That determines the anchor video parts anchor selection means for obtaining a search key of the anchor,
And video search means for searching for and displaying three-dimensional and two-dimensional related information using the search key of the anchor and the anchor.
A book information search space construction / search comprising: a search unit comprising: a dimensional search space search means; and a book search means for searching for book information using an anchor search key and displaying a result. In the device.

According to a second aspect of the present invention, a search space for retrieving desired book information is constructed while retrieving related information of a book on a three-dimensional space constructed on a computer. A book information search space construction / search apparatus for retrieving information, a data input means for inputting data necessary for constructing a three-dimensional search space, and a video search for constructing a video search space based on the input data. A three-dimensional search space construction means comprising a space construction means, a video part anchor construction means comprising an index creation means for storing index information of each part and a part information storage means for storing information for each part. A construction unit, a mouse instructing unit for instructing a three-dimensional space with a mouse, a video display unit for displaying a video in a three-dimensional search space, Video part anchor selecting means for generating and displaying an anchor, determining an anchor to be searched according to a mouse instruction, and obtaining a search key for the anchor, and obtaining three-dimensional and two-dimensional related information using the anchor search key. A search unit comprising: a three-dimensional search space search unit including a video search unit for searching and displaying; and a book search unit for searching for book information using an anchor search key and displaying a result. Book information search space construction / search device.

According to a third aspect of the present invention, the video / parts anchor selecting means has a parts anchor generating means for generating a part anchor from information of the parts stored in the parts information storing means. Anchor generation means for reconstructing each part using information of each part accumulated in the parts information storage means, and an anchor necessary for displaying an anchor at the current viewpoint from the reconstructed parts. The book information search space construction / search apparatus according to the second invention, further comprising: a part anchor information generating means for generating information.

According to a fourth aspect of the present invention, the video / parts anchor selecting means generates a parts anchor from information of the accumulated parts, and a parts anchor for displaying the anchor of each part. A third aspect of the invention according to the third aspect, comprising: display means; anchor designating means for designating an anchor; and search key acquiring means for acquiring a search key for retrieving related information from the selected anchor. Library information search space construction
In the search device.

According to a fifth aspect of the present invention, the video / parts anchor selecting means generates a parts anchor from information of the accumulated parts, and a parts display means for displaying the anchor of the part. When,
Range designating means for designating a range, anchor extracting means for extracting anchors included in the designated range and to be searched, and retrieval key acquisition for acquiring a search key for retrieving related information from the selected anchor Means for constructing and searching for a book information search space according to a third aspect of the present invention.

According to a sixth aspect of the present invention, a search space for retrieving desired book information is constructed while retrieving relevant information of a book in a three-dimensional space constructed on a computer. A computer-readable storage medium storing a book information search space construction / search program for retrieving information, wherein a data input step of inputting data necessary for constructing a three-dimensional search space; A three-dimensional search space construction step including a video search space construction step of constructing a video search space and a video part anchor construction step of constructing an anchor for a video part; Mouse instruction step to instruct with mouse, video display step to display 3D search space, generation of parts anchor,
A video part for selecting an anchor to be searched according to a mouse instruction and obtaining a search key for the anchor; and a video for searching and displaying three-dimensional and two-dimensional related information using the anchor search key. A search procedure comprising: a three-dimensional search space search step including a search step; and a book search step of searching for book information using an anchor search key and displaying a result; and a computer-readable storage medium recording the search procedure. is there.

According to a seventh aspect of the present invention, a search space for retrieving desired book information is constructed while retrieving related information of a book in a three-dimensional space constructed on a computer. A computer-readable storage medium storing a book information search space construction / search program for retrieving information, wherein a data input step of inputting data necessary for constructing a three-dimensional search space; A three-dimensional search consisting of a video search space construction step of constructing a video search space, a video part anchor construction step of an index creation step of storing index information of each part, and a part information storage step of storing information of each part. A space construction step, a construction procedure composed of: a mouse instruction step of instructing a three-dimensional space with a mouse; A video display step of displaying a video in a dimensional search space, a video / parts anchor selection step of generating and displaying a part anchor, determining an anchor to be searched according to a mouse instruction, and obtaining a search key of the anchor, and an anchor A three-dimensional search space search step including a video search step of searching and displaying three-dimensional and two-dimensional related information using the search key of the book; a book search step of searching book information using the anchor search key and displaying the result; And a computer-readable storage medium that records a search procedure composed of:

According to an eighth aspect of the present invention, the video / parts anchor selecting step has a parts anchor generating step of generating a part anchor from information of the parts accumulated in the parts information storing step. Anchor generation step is a part rebuilding step of rebuilding each part using the information of each part accumulated in the part information storage step, and necessary to display an anchor at the current viewpoint from the reconstructed part. 7. A computer-readable storage medium storing a book information search space construction / search program according to the seventh aspect, further comprising: a part anchor information generation step of generating information.

According to a ninth aspect of the present invention, in the video / parts anchor selecting step, a part anchor generating step of generating a part anchor from the accumulated information of the parts, and a part anchor displaying the anchor of each part are provided. An eighth aspect of the present invention is characterized by comprising a display step, an anchor specifying step of specifying an anchor, and a search key obtaining step of obtaining a search key for searching for the related information from the selected anchor. Library information search space construction
The search program is stored in a computer-readable storage medium.

According to a tenth aspect of the present invention, in the video / parts anchor selecting step, a part anchor generating step of generating a part anchor from accumulated part information and a part displaying step of displaying the part anchor are provided. And a range specifying step of specifying a range, an anchor extracting step of extracting an anchor included in the specified range to be searched, and a search of obtaining a search key for searching the relevant information from the selected anchor A computer-readable storage medium storing a book information search space construction / search program according to an eighth aspect of the present invention, comprising a key acquisition step.

[0025]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 FIG. 1 is a schematic configuration diagram of hardware of a book information search space construction / search apparatus according to the present invention. A book information search space construction / search apparatus according to the present invention is generally composed of a computer and peripheral devices connected thereto. In FIG. 1, reference numeral 11 denotes an arithmetic processing unit which is a computer main body, and 12 denotes an arithmetic processing unit which is executed by the arithmetic processing unit 11. A memory device that stores programs and the like for a construction unit 700 and a search unit 710 described below,
Reference numerals 5, 6, 8, 22, and 25 denote various databases storing various data, 14 denotes a display device for displaying, and 15 denotes an input device including a mouse, a keyboard, and the like for inputting by a user.

FIG. 2 shows the construction of a book information search space according to Embodiment 1 of the present invention for searching for information in a three-dimensional space.
FIG. 2 is a functional configuration diagram of a search device. In FIG. 1, reference numeral 50 denotes data input means for inputting input data 5 for constructing a search space; 800, video search space construction means for constructing video data to be displayed on a three-dimensional search space from the input data; Is a video part anchor construction means for constructing an anchor in a video part (a part of one video frame, which conveys a set of information for humans).
And Note that 200 is a three-dimensional search space construction unit.

Reference numeral 5 denotes input data, for example, three-dimensional CG
Data. 6 is a database of video data, 8
Is a database storing data of anchor information, and 22 is a database of book information.

The search unit 710 specifies a target in the three-dimensional search space constructed by the construction unit 700 and retrieves related information and book information. Reference numeral 350 denotes video display means for expressing three-dimensional information as video data, and 250 denotes mouse indicating means for indicating a search target in a three-dimensional space.
70, a video part anchor selecting means for displaying an anchor and obtaining a search key of the anchor selected by the searcher;
Reference numeral 550 denotes a video search unit that searches for information related to the selected video or anchor, and 600 denotes a book search unit that searches for book information and displays the result. The search result of the video related information is displayed by the video search means 550. In addition, 2
10 is a three-dimensional search space search means.

FIG. 3 is a diagram showing details of the video / parts anchor selection means 470 of FIG.

Next, the operation will be described. Referring to FIG. 2, first, in construction section 700, information of an object to be displayed in a three-dimensional space is input by data input means 50. As an example, the input object is a three-dimensional CG built in the digestive organ of FIG. By designating any of the CG models as search targets, related models or book information can be searched. Each model has a keyword for search. The information of the keyword may be interactively input from the data input unit 50, or may be input in a predetermined format in the input data.

If the CG model is a model in which objects are different in each part, such as the stomach, intestine, and liver, when expressed in a three-dimensional graphics space, each is defined as an anchor. Can be searched from the site.

However, when the number of CG polygons of the digestive organ is large, it takes time to read data, and a natural walk-through (movement of a viewpoint in a virtual three-dimensional space) cannot be realized. Therefore, the video search space construction means 800
Then, as shown in FIG. 5, a rendering image viewed from all viewpoints around this data is stored as video data.

In the case of such reconstruction of the three-dimensional information based on the video data, as in the case of the CG, a video frame at each viewpoint is photographed at the same time as a video part anchor so that part information can be provided to the user. The construction unit 270 automatically stores information of each part at each viewpoint. For example, information on all vertices of a rectangular parallelepiped circumscribing a part (hereinafter, circumscribed information) is automatically stored.

The video frame is photographed, for example, from the viewpoint sampled at every 15 degrees in the longitude and latitude directions.

In the case of the digestive system shown in FIG.
The circumscribed information as shown in (b) is stored. In the case of parts of the stomach, intestine, and liver, the information is as shown in FIG.

By using the position information of the parts in the video display means 350, not only the information of the whole video but also the rough position of the parts can be obtained.
Display and search from there. Note that the rectangular parallelepiped does not directly represent the complicated form of a part (stomach, intestine, etc.), but this is enough information for the purpose of searching for parts.

Here, since the object called digestive organ is represented as a video and displayed as a single polygon, it is necessary to define this polygon as an anchor which is a link source and to search for related information therefrom. Is possible. But the stomach, which is shown as part of the video
For the intestine, liver, etc., since the position in each video frame with a different viewpoint changes,
It is difficult to define and specify easily with a small amount of data.

Therefore, the video / parts anchor construction means 270 automatically stores information of each part at each viewpoint.

In the search unit 710, for example, the video display means 350 selects and maps a video frame suitable for the viewpoint to one polygon (called a virtual panel) as shown in FIG. Reconstruct dimensional information. Also, a virtual panel on which the video data is mapped is set as an anchor so that related information can be searched from the video data.

On the other hand, the part information is obtained from the circumscribed information stored in the video / parts anchor construction means 270 by the parts anchor generation means 472 of the video / parts anchor selection means 470 shown in FIG. Is generated, and is represented by a three-dimensional wire frame by the part display means 480 as shown in FIG.

In the part designating means 482, the circumscribed rectangular parallelepiped wire frame can be selected as a part anchor. In order to explicitly indicate the anchor that has been searched, the color of the wire frame is changed by the parts display unit 480.

The searcher specifies a search target by clicking a mouse on the rectangular parallelepiped of the intestine, and the search key obtaining means 49
At 0, a search key required to search for related information is obtained. With this search key, the video search means 550 can search for intestinal related information. The three-dimensional related information can be displayed by video data or three-dimensional CG by the video search means 550 in the same manner as the digestive organs, and further related information can be traced by the same processing. .

With the search key obtained by the search key obtaining means 490, the related book information can be searched by the book searching means 600.

As described above, even when an object is represented by a video, the position information of the part, which is a part of the part, is automatically stored, so that the user can obtain the part information in the same manner as in the case of the three-dimensional CG. The anchor information is presented, and a search from the anchor information is enabled.

By converting the three-dimensional CG into a video, it is possible to walk through a low-end PC even for three-dimensional information having a large data amount. Also, not only the information of the entire object but also the parts that are a part of the object are stored with less data than the original polygon information, so that the information is displayed at the time of the search and the search from there is possible.

Embodiment 2 FIG. 10 is a functional configuration diagram of a book information search space construction / search apparatus according to Embodiment 2 of the present invention for searching for information in a three-dimensional space. FIG.
, 50 is a data input means for inputting input data 5 for constructing a search space, 800 is a video search space construction means for constructing video data to be displayed on a three-dimensional search space from the input data, 1270 Is a video / parts anchor construction means for constructing an anchor in a video part.
Note that 200 is a three-dimensional search space construction unit.

Video / parts anchor construction means 1270
Includes index creation means 1280 for storing index information of parts of objects represented by video,
There is a parts information storage unit 1290 for storing parts information. The anchor of the part is displayed and searchable by the search unit 710 using the information stored here.

Reference numeral 6 denotes a database of video data, 8 denotes a database storing data of anchor information, and 22 denotes a database of book information.

The search unit 710 specifies a target in the three-dimensional search space constructed by the construction unit 700, and retrieves related information and book information. Reference numeral 350 denotes video display means for expressing three-dimensional information in a video, 250 denotes mouse indicating means for indicating a search target in a three-dimensional space, 470 displays information on parts, and becomes a search target in accordance with a mouse instruction. A video part anchor selecting means for determining an anchor and obtaining a search key of the anchor, a video searching means 550 for searching for a selected video and related information of the anchor, and a 600 for searching book information and displaying a result. Book search means. Search results for relevant information about the video
It is displayed by the video search means 550. Note that 210 is a three-dimensional search space search unit.

Next, the operation will be described. First, in the constructing unit 700, information of an object to be displayed in a three-dimensional space is input by the data input unit 50. As an example,
The input object is a three-dimensional CG built in the digestive organ of FIG. By specifying any of the CG models as search targets, related models or book information can be searched, and each model has a keyword for search. The keyword information is input to the data input means 5
It is also possible to input data interactively from 0 or to input data in a predetermined format.

If the CG model is a model in which objects are different in each part, such as the stomach, intestine, and liver, each object is defined as an anchor when expressed in a three-dimensional graphics space, and from this part, Can be searched.

However, when the number of CG polygons of the digestive organ is large, it takes time to read data, and a natural walkthrough cannot be realized. Therefore, as shown in FIG. 5, the video search space construction means 800 stores, as video data, rendered images viewed from all viewpoints at 360 degrees around this data.

In the case of reconstructing the three-dimensional information using the video data, similarly to the CG, the video data is created so that the information of the parts can be provided to the user. The index creation unit 1280 creates index information of the object represented by the video and its parts, and stores the created index information in the index information 25. Index information is the file name, keyword,
An anchor ID or the like. The anchor ID is a unique number unique to each anchor for identification, and is generated here.

Next, in the part information storage means 1290, information of each part is stored. In the case of the digestive system of FIG. 6A, for example, circumscribed information as shown in FIG.
Add to index information. In the case of parts of the stomach, intestine, and liver, the information is as shown in FIG.

For example, as shown in FIG. 8, the video display means 350 selects and maps a video frame suitable for the viewpoint on one polygon (virtual panel), thereby reconstructing three-dimensional information by video. Do. Also, a virtual panel on which the video data is mapped is set as an anchor so that related information can be searched from the video data.

On the other hand, the part information is stored in the part information storing means 129 in the part anchor generating means 472 of the video / part anchor selecting means 470 shown in FIG.
From the circumscribed information stored in 0, a circumscribed cuboid when viewed from the front is generated, and expressed by a three-dimensional wire frame by the parts display means 480, so that one circumscribed cuboid can be used to anchor parts from all viewpoints. Express.

The part designating means 482 allows the searcher to select the circumscribed rectangular parallelepiped wire frame as a part anchor. In order to explicitly indicate the anchor that has been searched, the color of the wire frame is changed by the parts display unit 480.

An object can be designated by clicking the cuboid of the intestine with a mouse, and related information of the intestine can be searched by the video search means 550. The three-dimensional related information can be displayed by the video search means 550 using video data or a three-dimensional CG as in the digestive organs and the like, and further related information can be traced by similar processing.

As described above, even when an object is represented by a video, information of parts which are a part of the object is stored,
It is presented to the user, and a search from the part information is enabled.

By converting a three-dimensional CG into a video, the amount of data can be reduced and a walk-through on a low-end PC can be performed. At this time, only circumscribed information as viewed from the front is stored as part information. As a result, the data amount is reduced, and high-speed reconstruction of parts information is realized.

Embodiment 3 FIG. 11 is a view for explaining the book information search space construction / search apparatus according to the third embodiment of the present invention, and is a diagram showing details of the part anchor generation means 472 of FIG.

The viewpoint of the searcher is determined based on the information on the position of the mouse from the mouse pointing means 250 shown in FIG. 10, and the video display means 350 selects and displays a video frame that matches the viewpoint.

At this time, the parts / reconstruction means 380 uses the circumscribing information as viewed from the front stored by the video / parts anchor construction means 1270, as shown in FIG. Rebuild the cuboid.

In the part anchor information generating means 390,
Eight vertices of the circumscribed rectangular parallelepiped of each part are projected on a virtual panel prepared according to the viewpoint. On the virtual panel, a polygon (see [1] in FIG. 13) indicating a rough position of each part is drawn.

The vertices of the rectangles circumscribing these polygons are obtained on the virtual panel and added to the index information 25. This rectangle (see [2] in FIG. 13) is used as an anchor indicating a rough position of each part.

The part display means 480 of FIG. 3 extracts the anchor information from the index information 25 of the anchor to be displayed, and expresses the anchor based on the information.
For example, when the mouse enters the range of a rectangle of a certain anchor, a candidate of a selectable part is shown by displaying the rectangle in a wire frame of the polygon of the rectangle.

Alternatively, an interface in which the coordinates around the coordinates of the center of gravity of the rectangle are presented, and when the mouse is moved to the coordinates, the keyword of the selected anchor is specified is also possible.

As described above, even when an object is represented by a video, information on parts that are a part of the object is stored.
Part information is presented to the user, and retrieval from parts is enabled.

By converting the three-dimensional CG into a video, the data amount can be reduced, a walk-through on a low-end PC can be performed, and the data amount can be minimized by storing only the circumscribed information of each part viewed from the front. It is possible to present information about parts and search from parts.

Although the information is rougher than the case of displaying the entire circumscribed rectangular parallelepiped, the whole is easy to see because there is no extra line (polygonal wire frame). Therefore, it can be used properly depending on the use and purpose.

Embodiment 4 FIG. 14 is a view for explaining the book information search space construction / search apparatus according to the fourth embodiment of the present invention, and is a diagram showing details of the video / parts anchor selection means 470 of FIG. The part anchor generating means 472 is shown in FIG.

The part information is generated by the part anchor generating means 472 from the information stored in the part information storing means 1290, such as the circumscribed information of the parts. The part anchor display means 485 generates a virtual panel for the anchor by one rectangular polygon based on the vertex information of the rectangle of the anchor obtained by the part anchor information generating means 390 in FIG. The polygon indicating the anchor should be transparent so that the contents of the video behind it can be seen. If the whole is transparent, it is not possible to determine where the anchor is, so put a texture with a blue line on the frame,
Indicates the position. An example is shown in FIG.

When the searcher selects the anchor virtual panel by the anchor specifying means 487, the keyword obtaining means 4
At 90, the keyword of the anchor is acquired by tracing the index information 25 from the anchor ID held by the anchor. The video search means 550 searches the database of the anchor information 8 based on the anchor keyword of the anchor specified by the searcher as the search target, and searches and displays related information.

In order to explicitly indicate the anchor designated by the anchor designation means 487, the part anchor display means 4
At 85, the texture is drawn with a red line.

If necessary, an anchor keyword or the like can be written at the edge of the texture or the like.

Thus, it is possible to reconstruct three-dimensional information with video data, and to set an anchor as a link source in a part of information of a video object as in the case of three-dimensional CG. Then, related information can be searched.

Also, by displaying the anchors with a texture on a single polygon that shows the approximate shape at all times, the information of all anchors can be roughly understood, and the current selection status, anchor keywords, It is possible to visualize information behind the anchor, and to provide more detailed information to the user.

Although the information is rough compared to the case where all the circumscribed rectangular parallelepipeds are displayed, the extra lines (the sides of the polygon) are reduced, so that the whole is easy to see. Therefore, it can be used properly depending on the use and purpose.

Embodiment 5 FIG. FIG. 16 is a view for explaining a book information search space construction / search apparatus according to the fourth embodiment of the present invention, and is a diagram showing details of the video / parts anchor selection means 470 of FIG.

The part display means 480 generates and displays an anchor based on the circumscribed information stored in the part information storage means 1290 or the rectangular vertex information of the anchor obtained by the part anchor information generation means 390 in FIG.

The range designating means 495 allows the searcher to determine the position and size of a CG such as a sphere in a three-dimensional virtual space, thereby designating a search target in a range. The anchor extracting unit 497 automatically extracts the anchors included in the range specified by the range specifying unit 495, and determines the anchor to be searched. FIG. 17 shows how the range is specified when the anchor is displayed as shown in FIG.

Since the anchor and the video are represented by a rectangular parallelepiped consisting of one polygon or six polygons, the inclusion relation with a CG such as a sphere can be easily determined. However, since the polygon represents a rough position, a parameter can be set depending on the difference in accuracy required by the system, such as performing a process of including 90% of the polygon if it is included in the sphere.

The search key obtaining means 490 obtains the keyword of the anchor by tracing the index information 25 from the anchor ID held by these anchors. The video search means 550 searches the database of the anchor information 8 based on the anchor keyword of the anchor specified by the searcher as the search target, and searches and displays related information.

Further, in order to explicitly indicate the anchor that has been searched, the color of the wire frame is changed by the parts display means 480 as shown in FIG.

Thus, it is possible to reconstruct three-dimensional information with video data. As in the case of three-dimensional CG, a part of information of a video object can be linked to an anchor which is a link source. A range is designated as a search target, and related information can be searched.

In the first, second, third, fourth and fifth embodiments,
The invention described above is effective not only when input data is three-dimensional CG but also for real objects. If the vertex information of the circumscribed cuboid of the object in the scene to be photographed can be obtained, the objects in the scene are automatically generated as anchors, and information can be searched from the anchor, as in the case of three-dimensional CG. .

In the first, second, third, fourth and fifth embodiments,
In the invention described above, the generated video data is stored in a conventional format, for example, AVI (Audio Visual
rleaved) format is available, and in the 3D virtual space, since the video frame is texture-mapped to one CG polygon, the same virtual space can be used to express other 3D computer graphics. Can coexist. Therefore, a certain three-dimensional C
From a two-dimensional image mapped to a G or a polygon in a three-dimensional space, a link to three-dimensional information of the video is created.
Alternatively, it is possible to link a two-dimensional image.

Further, in Embodiments 1, 2, 3, 4,
The contents described in the paragraphs 5 and 6 describe the retrieval of book information, but this can also be used for information retrieval of one version other than books.

[0089]

As described above, the first and sixth embodiments of the present invention are described.
According to the invention, while searching for related information of a book in a three-dimensional space constructed on a computer, a search space for searching for desired book information is constructed, and a book information search for searching book information is performed. A space construction / retrieval device, comprising: data input means for inputting data necessary for constructing a three-dimensional search space; video search space construction means for constructing a search space by video based on the inputted data; and parts of video A three-dimensional search space constructing means comprising video / parts anchor constructing means for constructing an anchor in the camera, a mouse instructing means for instructing the three-dimensional space with a mouse, and displaying the three-dimensional search space. Video display means,
Video / parts anchor selection means for generating and displaying an anchor of a part, determining an anchor to be searched according to an instruction of a mouse, and obtaining a search key of the anchor, and three-dimensional and two-dimensional related information by the anchor search key A book search unit comprising: a three-dimensional search space search means comprising video search means for searching for and displaying a book; and a book search means for searching for book information using an anchor search key and displaying the result. Information retrieval space construction / search device, and book information retrieval space construction /
Since the storage medium on which the search program is recorded is used, even when an object is represented by a video, the position information of the part, which is a part of the object, is automatically stored, so that 3
As in the case of the dimension CG, the anchor information of the part is presented to the user, and a search can be performed from the anchor information. Further, by converting the three-dimensional CG into a video, even a three-dimensional information having a large data amount can be walked through on a low-end PC. Further, not only the information on the entire object but also the parts that are part of the object are stored with less data than the original polygon information, so that the information is displayed at the time of the search, and the search can be performed therefrom.

According to the second and seventh aspects of the present invention, a search space for searching for desired book information while searching for related information of books in a three-dimensional space constructed on a computer. And a data input means for inputting data necessary for constructing a three-dimensional search space, comprising:
Video / parts anchor construction means comprising video search space construction means for constructing a video search space based on input data, index creation means for storing index information of each part, and parts information storage means for storing information for each part. A construction unit composed of: a three-dimensional search space constructing unit; a mouse instructing unit for instructing the three-dimensional space with a mouse; a video display unit for displaying a video in the three-dimensional search space; A video part anchor selecting means for determining an anchor to be searched according to a mouse instruction and obtaining a search key for the anchor; and searching and displaying three-dimensional and two-dimensional related information using the anchor search key. Three-dimensional search space search means comprising video search means;
A book information search space construction / search apparatus including a book search unit configured to search for book information using an anchor search key and display the result, and a book information search space construction to execute the same -Since the search program is used as a storage medium, even when an object is expressed as a video, information on parts as a part of the object can be stored, presented to the user, and searched from the part information. In addition, by converting the three-dimensional CG into a video, the data amount can be reduced and a walk-through with a low-end PC can be performed. At this time, only the circumscribed information when viewed from the front is stored as part information. Thus, the data amount can be reduced, and high-speed reconstruction of parts information can be realized.

Further, according to the third and eighth aspects of the present invention, the video / parts anchor selecting means includes a parts anchor generating means for generating a part anchor from the part information stored in the parts information storing means. The part anchor generating means has a part reconstructing means for reconstructing each part using the information of each part accumulated in the parts information storage means, and displays an anchor at the current viewpoint from the reconstructed parts. Book information search space construction / search apparatus according to the second invention having a part anchor information generation means for generating information necessary for performing the operation, and a book information search space construction / search program for executing the apparatus. Since the storage medium of the present invention is used, even when an object is expressed as a video, information on parts as a part of the object is stored, and information on the parts is stored. Was presented to the user, it is possible to search from the parts. Also, by converting the three-dimensional CG into a video, the amount of data can be reduced, a walk-through on a low-end PC becomes possible, and the data amount is minimized by storing only the circumscribed information of each part viewed from the front. It is possible to present information on parts and search from parts. Furthermore, the information is rougher than when displaying the entire circumscribed rectangular parallelepiped, but the whole is easier to see because there is no extra line (polygonal wire frame). Therefore, it can be used properly depending on the use and purpose.

Further, according to the fourth and ninth aspects of the present invention, the video / parts anchor selecting means includes a parts anchor generating means for generating a part anchor from the stored information of the parts, and an anchor for each part. Book according to the third aspect of the present invention, comprising: a part anchor display means for displaying a character, an anchor designation means for designating an anchor, and a search key acquisition means for acquiring a search key for searching for the related information from the selected anchor. Since the information search space construction / search device and the storage medium of the eighth invention including the book information search space construction / search program for executing the same are used,
It is possible to reconstruct three-dimensional information with video data, and, similarly to the case of three-dimensional CG, set an anchor as a link source in a part of information of a video object and search for related information. Will be able to In addition, the anchors are always displayed with a texture on a single polygon that shows the approximate shape, so that information on all anchors can be roughly understood, and the current selection status, anchor keywords, and the back of the anchors are displayed. Can be visualized, and more detailed information can be provided to the user. In addition, compared to the case of displaying the entire circumscribed rectangular parallelepiped, the information becomes rougher, but since the extra lines (the sides of the polygon) are reduced, the whole becomes easier to see. Therefore, it can be used properly depending on the use and purpose.

According to the fifth and tenth aspects of the present invention, the video / parts anchor selecting means includes a part anchor generating means for generating a part anchor from the accumulated part information, and a part anchor generating means. A part display unit to be displayed, a range designating unit for designating a range, an anchor extracting unit for extracting an anchor included in the designated range and to be searched, and a search for retrieving related information from the selected anchor A book information search space according to the third invention having a search key obtaining means for obtaining a key;
Since the storage device of the eighth invention includes a search device and a book information search space construction / search program for executing the same, it is possible to reconstruct three-dimensional information with video data. Similarly to the case of the dimension CG, a range of an anchor which is a link source to a part of information of a video object is designated as a search target, and related information thereof can be searched.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of hardware of a book information search space construction / search apparatus according to the present invention.

FIG. 2 is a functional configuration diagram of a book information search space construction / search apparatus according to Embodiment 1 of the present invention for searching for information in a three-dimensional space.

FIG. 3 is a diagram showing details of a video / parts anchor selection unit of FIG. 2;

FIG. 4 is a diagram showing a digestive organ 3 for explaining the operation of the book information search space construction / search apparatus according to the first embodiment of the present invention.
It is a figure of dimension CG.

FIG. 5 is a view showing a photograph of a rendering image from all viewpoints for explaining the operation of the book information search space construction / search apparatus according to the first embodiment of the present invention.

FIG. 6 is a diagram illustrating a digestive system 3 for explaining the operation of the book information search space construction / search apparatus according to the first embodiment of the present invention.
FIG. 4 is a diagram of a cubic cuboid of a dimension CG and an intestine.

FIG. 7 is a diagram illustrating a digestive system 3 for explaining the operation of the book information search space construction / search device according to the first embodiment of the present invention.
It is a figure of a circumscribed box of a stomach, a liver, and an intestine in dimension CG.

FIG. 8 is a diagram illustrating a state in which a video frame is selected according to a viewpoint and three-dimensional information is represented, for explaining an operation of the book information search space construction / search apparatus according to the first embodiment of the present invention; It is.

FIG. 9 is a diagram illustrating the information of the intestinal part anchor (rectangular wire frame) together with the digestive organ video frame for explaining the operation of the book information search space construction / search apparatus according to the first embodiment of the present invention. FIG.

FIG. 10 is a functional configuration diagram of a book information search space construction / search apparatus according to a second embodiment of the present invention for searching for information in a three-dimensional space.

11 is a diagram illustrating a book information search space construction / search apparatus according to a third embodiment of the present invention, and is a diagram illustrating details of a part anchor generation unit in FIG. 3; FIG.

FIG. 12 is a diagram illustrating a state in which a circumscribed cuboid as viewed from the front is reconstructed, for explaining an operation of the book information search space construction / search apparatus according to the third embodiment of the present invention.

FIG. 13 is a diagram showing video frames and intestinal parts anchors selected for each viewpoint, for explaining the operation of the book information search space construction / search device according to the third embodiment of the present invention.

14 is a diagram for explaining a book information search space construction / search apparatus according to a fourth embodiment of the present invention, and is a diagram illustrating details of a video / parts anchor selection unit in FIG. 2; FIG.

FIG. 15 is a diagram illustrating a stomach, an intestine, and a stomach for explaining the operation of the book information search space construction / search apparatus according to the fourth embodiment of the present invention;
FIG. 4 is a diagram illustrating a state in which a frame of a liver part anchor is indicated by a texture on a polygon;

FIG. 16 is a view for explaining a book information search space construction / search apparatus according to a fifth embodiment of the present invention, and is a diagram illustrating details of a video / parts anchor selection unit in FIG. 2;

FIG. 17 is a diagram illustrating an operation of the book information search space construction / search apparatus according to the fifth embodiment of the present invention, in which an upper part of a digestive organ is designated by a sphere.

FIG. 18 is a diagram illustrating the operation of the book information search space construction / search device according to the fifth embodiment of the present invention, showing a state where the selected anchor is displayed in another color.

FIG. 19 is a diagram showing a configuration of a quick time virtual reality authoring studio which is one of the conventional main apparatuses.

FIG. 20 is a diagram showing a processing flow of a panorama movie generation unit in FIG. 19;

FIG. 21 is a diagram showing a processing flow of the object movie generating means of FIG. 19;

[Explanation of symbols]

5 input data, 6 video data, 8 anchor information, 11 arithmetic processing unit, 12 memory device, 14 display device, 15 input device, 22 book information, 25 index information, 50 data input means, 200 three-dimensional search space construction means, 210 3D search space search means, 2
50 mouse instruction means, 270 video / parts anchor construction means, 350 video display means, 380 parts / reconstruction means, 390 parts anchor information generation means,
470 Video / parts anchor selection means, 472 parts anchor generation means, 480 parts display means, 48
2 parts designation means, 485 parts anchor display means,
487 anchor designation means, 490 search key acquisition means, 495 range designation means, 497 anchor extraction means, 550 video search means, 600 book search means,
700 construction unit, 710 search unit, 800 video search space construction means, 1270 video / parts anchor construction means, 1280 index creation means, 1290 parts information storage means.

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Norihiro Minegishi 2-3-2 Marunouchi, Chiyoda-ku, Tokyo Mitsui Electric Co., Ltd. (72) Inventor Satoshi Tanaka 2-3-2 Marunouchi, Chiyoda-ku, Tokyo 3 F term in Ryo Denki Co., Ltd. (reference) 5B050 AA02 BA07 BA09 EA23 EA26 FA02 FA19 GA08 5B075 ND08 ND20 PP13 5E501 AA20 AC15 AC33 BA03 CB09 EA05 EB05 FA27

Claims (10)

[Claims] 1. A book information retrieval space for retrieving book information by constructing a search space for retrieving target book information while retrieving related information of books in a three-dimensional space constructed on a computer. A construction / search device, comprising: data input means for inputting data necessary for constructing a three-dimensional search space; video search space construction means for constructing a video search space based on the input data; and video parts. A video / parts constructing anchor; a three-dimensional search space constructing means comprising an anchor constructing means; a constructing unit comprising: a mouse pointing means for pointing on the three-dimensional space with a mouse; and a video displaying the three-dimensional search space. Display means, generates and displays an anchor of a part, determines an anchor to be searched according to an instruction of a mouse, and obtains a search key of the anchor. E-parts anchor selection means, a three-dimensional search space search means comprising video search means for searching and displaying three-dimensional and two-dimensional related information by an anchor search key, and a book information search by an anchor search key A book information search space construction / search apparatus, comprising: a book search means for displaying results; and a search unit comprising: 2. A book information retrieval space for retrieving book information by constructing a search space for retrieving target book information while retrieving related information of books in a three-dimensional space constructed on a computer. A construction / search device, comprising: data input means for inputting data necessary for constructing a three-dimensional search space; video search space construction means for constructing a video search space based on the input data; A three-dimensional search space structuring means comprising a video / parts anchor structuring means which is an index creating means for storing index information and a part information storing means for storing information for each part; Instruction means for instructing with a mouse, video display means for displaying a video in a three-dimensional search space, generating and displaying anchors of parts Video part anchor selecting means for determining an anchor to be searched according to a mouse instruction and obtaining a search key for the anchor; and video search means for searching and displaying three-dimensional and two-dimensional related information using the anchor search key. A book information search space comprising: a three-dimensional search space search means comprising: a book search means for searching for book information using an anchor search key and displaying a result; and a search unit comprising: -Search device. 3. The video / parts anchor selecting means has a parts anchor generating means for generating a part anchor from the parts information stored in the parts information storing means, wherein the parts anchor generating means comprises: Parts reconstructing means for reconstructing each part using the information of each part accumulated in the storage means, and parts anchor information generation for generating information necessary for displaying an anchor at the current viewpoint from the reconstructed parts 3. The book information search space construction / search device according to claim 2, comprising: 4. The video / parts anchor selecting means: a parts anchor generating means for generating a part anchor from accumulated part information; a parts anchor displaying means for displaying an anchor of each part; and an anchor designation. 4. The book information search space construction / search apparatus according to claim 3, comprising: an anchor designating means; and a search key obtaining means for obtaining a search key for searching for the related information from the selected anchor. . 5. The video / parts anchor selecting means, a parts anchor generating means for generating a part anchor from accumulated part information, a parts displaying means for displaying a part anchor, a range designating a range Means, an anchor extracting means for extracting an anchor included in the specified range and to be searched, and a search key obtaining means for obtaining a search key for searching the relevant information from the selected anchor. The book information search space construction / search apparatus according to claim 3, characterized in that: 6. A book information search space for retrieving book information by constructing a search space for retrieving target book information while searching for related information of books in a three-dimensional space constructed on a computer. A computer-readable storage medium recording a construction / search program, a data input step of inputting data necessary for constructing a three-dimensional search space, and a video for constructing a search space by video using the input data. A three-dimensional search space construction step consisting of a search space construction step and a video / parts anchor construction step of constructing an anchor in a video part; and a construction step consisting of: a mouse instruction step of pointing the three-dimensional space with a mouse , A video display process that displays a 3D search space, generates and displays anchors for parts, and searches according to mouse instructions A video part anchor selecting step of determining an anchor and obtaining a search key of the anchor; and a video search step of searching and displaying three-dimensional and two-dimensional related information using the anchor search key, and a three-dimensional search space searching step. A book search step of searching for book information using an anchor search key and displaying the result; and a search procedure comprising: 7. A book information search space for retrieving book information by constructing a search space for retrieving target book information while searching for related information of books in a three-dimensional space constructed on a computer. A computer-readable storage medium recording a construction / search program, a data input step of inputting data necessary for constructing a three-dimensional search space, and a video for constructing a search space by video using the input data. A three-dimensional search space construction step comprising a video part anchor construction step, which comprises a search space construction step, an index creation step for storing index information of each part, and a part information storage step for storing information for each part. Construction procedure, mouse pointing step to point in the 3D space with a mouse, video to 3D search space A video / parts anchor selection step of generating and displaying a part anchor, determining an anchor to be searched according to a mouse instruction, and obtaining a search key for the anchor, and a three-dimensional anchor search key And a three-dimensional search space search step including a video search step for searching and displaying two-dimensional related information, and a book search step for searching book information using an anchor search key and displaying the result. And a computer-readable storage medium recording the information. 8. The video / parts anchor selecting step includes a parts anchor generating step of generating a part anchor from information of the parts accumulated in the parts information storing step. A part rebuilding process that rebuilds each part using the information of each part accumulated in the storage process, and a part anchor information generation that generates information necessary for displaying an anchor at the current viewpoint from the rebuilt parts A computer-readable storage medium storing a book information search space construction / search program according to claim 7, comprising: 9. The video / parts anchor selecting step includes: a parts anchor generating step of generating a part anchor from accumulated part information; a parts anchor displaying step of displaying an anchor of each part; and specifying an anchor. 9. The book information search space construction / search program according to claim 8, comprising: an anchor designating step; and a search key obtaining step of obtaining a search key for searching the relevant information from the selected anchor. A computer-readable storage medium on which is recorded. 10. The video / parts anchor selection step includes: a parts anchor generation step of generating a part anchor from accumulated part information; a parts display step of displaying a part anchor; and a range specification for specifying a range. And an anchor extraction step of extracting an anchor included in the specified range and serving as a search target, and a search key obtaining step of obtaining a search key for searching the relevant information from the selected anchor. A computer-readable storage medium storing the book information search space construction / search program according to claim 8.