JP4070057B2 - Library information search space construction / retrieval apparatus and computer-readable recording medium recording a book information retrieval space construction / retrieval program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention constructs a search space for searching for target book information while searching for related information of books in a three-dimensional space constructed on a computer, and constructs a book information search space for searching for book information. The present invention relates to a search device and a book information search space construction / computer-readable recording medium in which a search program is recorded.
[0002]
[Prior art]
A conventional device of this type, for example, is a product called Quick Time VR Authoring Studio, which is an interactive virtual device that uses photographs and graphics. It is a device that can create reality scenes. This device can create panoramic movies using photos taken with digital cameras and panoramic cameras.
[0003]
FIG. 19 shows the configuration of this quick time virtual reality authoring studio. In FIG. 19, the data input means 2050 reads input data 2005 which is data of a 360-degree three-dimensional rendering image, panoramic photograph or overlapping photograph on the computer, and the movie generation means 2100 generates a movie.
[0004]
FIG. 20 shows a processing flow of the panorama movie generation means (panorama maker) 2130. First, a node on a virtual reality (hereinafter referred to as VR) space for creating a panoramic movie is selected (S3000), and a panoramic movie is created from the data input by the data input means 2050 (S3030). When the panorama data is not 360 degrees (in the case of photographs with overlap), the photographs can be joined to generate panorama data.
[0005]
When a link to another location is generated from the panoramic movie, a hot spot (an anchor that is a link source) is generated (S3060). When there are a plurality of nodes, the information is linked by manually specifying the positional relationship (S3090). Then, the panoramic image and hot spot information are finely divided and compressed to generate a panoramic movie (S3100).
[0006]
FIG. 21 shows a processing flow of the object movie generating means (object maker) 2150. When the input data is an object on a computer (computer graphic (hereinafter referred to as CG), etc.) (3505), the object is photographed at regular intervals (S3500), and when the input data is an image (3510), an image is taken. Is converted into the object movie format (S3530). The movie generated in S3500 or S3530 is compressed to reduce the size (S3550), and an object movie (3570) is generated.
[0007]
The movie display means 2210 in FIG. 19 determines the viewpoint based on the user's mouse instruction in the mouse instruction means 2250, and the video frame selection / display means 2300 selects a video frame that matches the viewpoint from the panoramic movie or object movie. Then, the three-dimensional information is reconstructed by displaying. If there is a link destination, the link destination acquisition means 2350 acquires the link destination and displays the linked movie.
[0008]
As described above, in Quick Time Virtual Reality, the anchor (hot spot or node) that is the source of the link is manually set in the authoring studio, which is the construction unit 2700, and the information of the anchor is used when searching. Originally, it is possible to search for linked information and play the next movie or take other actions.
[0009]
[Problems to be solved by the invention]
In the conventional apparatus of this type as described above, the more complicated the content represented by the three-dimensional CG, the greater the number of polygons and the larger the data size. A high-speed personal computer (hereinafter referred to as a PC) on which a graphics board is mounted can process such data at a high speed, but a low-function, low-cost PC (hereinafter referred to as a low-end PC) increases the data size. However, it takes time to read, and there is a problem that walk-through (moving viewpoint in a virtual three-dimensional space) cannot be performed naturally.
[0010]
In the quick time virtual reality authoring studio described above, you can set an anchor (hot spot) as a link source on a panoramic movie, link it, call another movie, or cause other actions It is possible to link multiple panoramic movies, but it is necessary to manually set the position and size of anchors and the positional relationship of each movie, which is troublesome. It was.
[0011]
In addition, by creating an object movie, it is possible to view the object in the panorama movie from the outside, but since a link source (hot spot) cannot be created in a part of the object movie, information about the information can be obtained from a part of the object. There was a problem that information retrieval was not possible.
[0012]
Therefore, in order to search for books that handle a wide variety of events, it is not suitable for applications in which related information of books is displayed and a part thereof is searched as an anchor.
[0013]
These quick time virtual reality movies have a unique format, and therefore cannot coexist with contents such as CG data in other three-dimensional virtual spaces. There are various contents indicating the information of the book classification system, and there are many cases where it is more effective to represent the information in three-dimensional CG instead of video, and in such a case, a problem arises.
[0014]
The present invention has been made to solve the above problems. When 3D information is expressed by video data, the part information is accumulated, the part information is displayed to the searcher, and the related information is obtained from the part information. It is an object of the present invention to provide a book information search space construction / retrieval device and a computer readable storage medium that records a book information search space construction / retrieval program that enables retrieval.
[0015]
[Means for Solving the Problems]
In view of the above object, the present invention constructs a search space for searching for target book information while searching for related information of the book in the three-dimensional space constructed on the computer, and searches for the book information. A book information search space construction / retrieval device that reads and inputs 3D CG data necessary for constructing a 3D search space, and a plurality of parts having an input search key Including 3D CG A rendering image viewed from a plurality of surrounding viewpoints of the 3D CG Video data to be displayed on the 3D search space As A three-dimensional search space constructing means comprising a video search space constructing means for creating and storing a search space by a stored video, and a video part anchor constructing means for storing circumscribed information for the anchor of each part of the video A construction unit that is configured, and means for acquiring an input for pointing on a three-dimensional space by a mouse; By selecting from the stored video data and mapping video frames that match the viewpoint to the virtual panel A video display means for displaying a three-dimensional search space, a circumscribed body to be an anchor is generated and displayed from the circumscribed information of the part, an anchor to be searched is determined according to a mouse instruction, and a search key set in advance for the anchor part 3 part search space search means comprising video part anchor selection means for obtaining the information, video search means for searching and displaying related information of 3D and 2D with the anchor search key, and book information with the anchor search key A book information search space construction and search device comprising: a book search means for searching for and displaying a result; It is in .
[0016]
In addition, while searching for related information of books in a three-dimensional space constructed on a computer, a search space for searching for target book information is built, and a book information search space for searching for book information is constructed and searched. 3D CG including a data input means for reading and inputting 3D CG data necessary for constructing a 3D search space, and an object composed of a plurality of parts having an input search key A rendering image viewed from a plurality of surrounding viewpoints of the 3D CG Video data to be displayed on the 3D search space As Video search space construction means for creating a search space by generating and storing videos, and index creation means and parts for creating and storing index information including search keys and anchor information of objects and their parts expressed in video Per anchor Predetermined A three-dimensional search space construction means comprising a video part anchor construction means comprising a parts information storage means for generating and storing circumscribed information when viewed from the front, a construction unit comprising a mouse, and a three-dimensional space using a mouse Means for obtaining an input indicating By selecting from the stored video data and mapping video frames that match the viewpoint to the virtual panel Video display means for displaying video in a three-dimensional search space, circumscribing body when viewed from the front as an anchor is generated and displayed from the circumscribing information of the part, and the anchor to be searched is determined according to the instruction of the mouse, and the anchor 3D search space search means comprising video / part anchor selection means for obtaining a search key set as the index information, and video search means for searching and displaying 3D and 2D related information using the search key of the anchor. The book information retrieval space construction / retrieval device comprises a book search means for searching for book information using an anchor search key and displaying the result, and a search unit.
[0017]
In addition, the video / part anchor selecting means can determine the parts from the circumscribed information when viewed from the front accumulated in the parts information storing means. anchor A part anchor generating means for generating the anchor, and the part anchor generating means uses the circumscribing information when viewed from the front of each part accumulated in the part information storage means, and the anchor when viewed from the front of each part. Parts reconstruction means to reconstruct the circumscribed body and parts to add to the index information as anchors by finding the vertices of the rectangle circumscribing the polygon formed by projecting the circumscribed body of each part to the virtual panel according to the viewpoint Anchor information generation means, and the video / part anchor selection means displays the anchor based on the index information.
[0018]
Further, the video / part anchor selecting means comprises circumscribing information when viewed from the front of the part from the accumulated part information. anchor Parts anchor generating means for generating information to be obtained, and for each part obtained by the part anchor information generating means Anchor Rectangular each Part anchor display means for displaying a transparent virtual panel having a colored frame for anchor from the apex, means for obtaining input for specifying the anchor, and related information based on the index information for retrieving the related information Search key acquisition means for acquiring the search key.
[0019]
Further, the video / part anchor selecting means comprises circumscribing information when viewed from the front of the part from the accumulated part information. anchor Parts anchor generating means for generating information and circumscribing information when viewed from the front or Anchor Rectangular each Part display means for displaying an anchor of a part from the vertex, means for acquiring an input for specifying a search range in the three-dimensional search space, anchor extraction means for extracting an anchor included in the specified range to be searched Search key acquisition means for acquiring a search key for searching related information based on the index information from the extracted anchor.
[0020]
In addition, while searching for related information of books in a three-dimensional space constructed on a computer, a search space for searching for target book information is built, and a book information search space for searching for book information is constructed and searched. A computer-readable storage medium storing a program, a data input process for reading and inputting 3D CG data necessary for constructing a 3D search space, and a plurality of parts having an input search key 3D CG including A rendering image viewed from a plurality of surrounding viewpoints of the 3D CG Video data to be displayed on the 3D search space As A three-dimensional search space construction process comprising a video search space construction process for creating and storing a search space by storing and storing video and a video part anchor construction process for storing circumscribed information for anchors of each part of the video A construction procedure that is performed, and a step of obtaining an input indicating on a three-dimensional space by a mouse; By selecting from the stored video data and mapping video frames that match the viewpoint to the virtual panel A video display process for displaying a three-dimensional search space, a circumscribed body to be an anchor is generated and displayed from the circumscribing information of the part, an anchor to be searched is determined according to a mouse instruction, and a search key set in advance for the anchor part 3D search space search process comprising a video / part anchor selection process for acquiring a video, a video search process for searching for and displaying 3D and 2D related information using an anchor search key, and book information using an anchor search key. A computer-readable storage medium storing a search procedure comprising a book search step for searching for and displaying the results.
[0021]
In addition, while searching for related information of books in a three-dimensional space constructed on a computer, a search space for searching for target book information is built, and a book information search space for searching for book information is constructed and searched. A computer-readable storage medium storing a program, a data input process for reading and inputting 3D CG data necessary for constructing a 3D search space, and a plurality of parts having an input search key 3D CG including objects consisting of A rendering image viewed from a plurality of surrounding viewpoints of the 3D CG Video data to be displayed on the 3D search space As A video search space construction process for creating and storing a search space by storing and storing videos, and an index creation process and parts for creating and storing index information including search keys and anchor information of objects and their parts expressed in the video Per anchor Predetermined A three-dimensional search space construction step comprising a video / part anchor construction step comprising a parts information storage step for generating and storing circumscribed information when viewed from the front, a construction procedure comprising a three-dimensional space using a mouse Obtaining an input indicating By selecting from the stored video data and mapping video frames that match the viewpoint to the virtual panel A video display process for displaying a video in a three-dimensional search space, a circumscribed body when viewed from the front as an anchor is generated from the circumscribed information of the part, displayed, and an anchor to be searched is determined according to the instruction of the mouse, and the anchor A three-dimensional search space search step comprising a video / part anchor selection step for obtaining a search key set as the index information, and a video search step for searching for and displaying three-dimensional and two-dimensional related information using the anchor search key; A computer-readable storage medium storing a book search step for searching for book information by using an anchor search key and displaying the result, and a search procedure.
[0022]
In addition, the video / part anchor selection process is based on the circumscribing information when viewed from the front accumulated in the part information storage process. anchor A part anchor generating step for generating the part anchor. This part anchor generating step is an anchor when viewed from the front of each part using circumscribed information when viewed from the front of each part accumulated in the part information storing step. Part reconstruction process to reconstruct the circumscribed body and parts that are attached to the index information as anchors by finding the vertices of the rectangle circumscribing the polygon formed by projecting the circumscribed body of each part on the virtual panel according to the viewpoint An anchor information generation step, wherein the video / part anchor selection step displays the anchor based on the index information.
[0023]
In addition, the video / part anchor selection step includes circumscribing information when viewed from the front of the part from the accumulated part information. anchor A part anchor generation process for generating information to be obtained, and for each part obtained in the part anchor information generation process Anchor Rectangular each To display a part anchor display process for displaying a transparent virtual panel having a colored frame for anchor from the vertex, a process for obtaining an input for specifying the anchor, and retrieving related information from the specified anchor based on the index information And a search key acquisition step of acquiring the search key.
[0024]
In addition, the video / part anchor selection step includes circumscribing information when viewed from the front of the part from the accumulated part information. anchor Part anchor generation process for generating information and circumscribing information when viewed from the front or Anchor Rectangular each A part display step for displaying an anchor of a part from a vertex, a step for obtaining an input for designating a search range in a three-dimensional search space, and an anchor extraction step for extracting an anchor included in the designated range as a search target; And a search key acquisition step of acquiring a search key for searching related information based on the index information from the extracted anchor.
[0025]
DETAILED DESCRIPTION OF THE INVENTION
Embodiment 1 FIG.
FIG. 1 is a schematic configuration diagram of hardware of a book information search space construction / search apparatus according to the present invention. A book information retrieval space construction / retrieval apparatus according to the present invention is generally composed of a computer and peripheral devices connected thereto. In FIG. 1, 11 is an arithmetic processing unit which is a computer main body, and 12 is executed by the arithmetic processing unit 11. A memory device storing programs for a construction unit 700 and a search unit 710, which will be described later, 5, 6, 8, 22, 25 are various databases storing various data, 14 is a display device for displaying, 15 is This is an input device composed of a mouse, a keyboard, and the like for input by the user.
[0026]
FIG. 2 is a functional configuration diagram of the book information search space construction / search apparatus according to Embodiment 1 of the present invention for searching for information in a three-dimensional space. In FIG. 1, 50 is a data input means for inputting input data 5 for constructing a search space, 800 is a video search space construction means for constructing video data for display on a three-dimensional search space from the input data, 270 Is a video / part anchor construction means for constructing an anchor in a video part (a part of one video frame, which conveys a piece of information for human beings). . Note that 200 is a three-dimensional search space construction means.
[0027]
Reference numeral 5 denotes input data, for example, three-dimensional CG data. Reference numeral 6 is a video data database, 8 is a database storing anchor information data, and 22 is a book information database.
[0028]
The search unit 710 searches for related information and book information by specifying a target on the three-dimensional search space constructed by the construction unit 700. 350 is a video display means for expressing three-dimensional information as video data, 250 is a mouse instruction means for specifying a search target in the three-dimensional space, 470 is an anchor, and a search key for the anchor selected by the searcher is displayed. The obtained video / part anchor selecting means 550 is a video searching means for searching related information of the selected video or anchor, and 600 is a book searching means for searching for book information and displaying the result. The search result of the video related information is displayed by the video search means 550. Note that 210 is a three-dimensional search space search means.
[0029]
FIG. 3 shows the details of the video / part anchor selecting means 470 shown in FIG.
[0030]
Next, the operation will be described. With reference to FIG. 2, first, in the construction unit 700, information on an object to be displayed on the three-dimensional space is input by the data input unit 50. As an example, the input object is a three-dimensional CG built in the digestive apparatus of FIG. Each model has a keyword for searching in order to search related information or book information by designating one of the CG models as a search target. The keyword information may be input interactively from the data input means 50, or may be input in a predetermined format in the input data.
[0031]
If this CG model is a model with different objects in each part such as stomach, intestine, liver, etc., each is defined as an anchor when expressed in 3D graphics space. Can be searched.
[0032]
However, when the number of CG polygons in this digestive organ is large, it takes time to read data, and natural walk-through (viewpoint movement in a virtual three-dimensional space) cannot be realized. Therefore, as shown in FIG. 5, the video search space construction means 800 stores rendering images viewed from all viewpoints around this data as video data.
[0033]
In the case of such reconstruction of the three-dimensional information by video data, the video / part anchor construction means 270 is simultaneously taken to shoot the video frame at each viewpoint so that the parts information can be provided to the user as in the case of CG. In, information of each part at each viewpoint is automatically stored. For example, information on all the vertices of a cuboid circumscribing a part (hereinafter referred to as circumscribing information) is automatically stored.
[0034]
For example, the video frame is shot at a viewpoint in which the longitude direction and the latitude direction are sampled every 15 degrees.
[0035]
In the case of the digestive organ of FIG. 6A, for example, circumscribing information as shown in FIG. 6B is stored. In the case of parts of the stomach, intestine, and liver, the information is as shown in FIG.
[0036]
By using the position information of this part in the video display means 350, not only the information of the entire video but also the rough position of the part can be displayed and searched from there. The rectangular parallelepiped does not represent the complicated form of the part (stomach, intestine, etc.) as it is, but this is sufficient information for the purpose of searching for the part.
[0037]
Here, the digestive organ object is expressed as a video and displayed as a single polygon, so it is possible to define this polygon as an anchor that is the link source and to retrieve related information from there. is there. However, for the stomach, intestine, liver, etc. displayed as part of the video, the position in each video frame with different viewpoints changes, so it is easy to define and specify the position with a small amount of data. Is difficult.
[0038]
Therefore, the video / part anchor construction means 270 automatically stores information of each part at each viewpoint.
[0039]
In the search unit 710, for example, the video display unit 350 selects and maps a video frame suitable for the viewpoint to one polygon (referred to as a virtual panel) as shown in FIG. Rebuild. In addition, a virtual panel for mapping video data is set as an anchor so that related information can be searched from the video data.
[0040]
On the other hand, the part information is generated by the part anchor generating unit 472 of the video / part anchor selecting unit 470 shown in FIG. 3 from the circumscribing information stored in the video / part anchor constructing unit 270. Then, the part display means 480 represents the anchor of the part by representing it with a three-dimensional wire frame as shown in FIG.
[0041]
In the part designating means 482, this circumscribed cuboid wire frame can be selected as an anchor for the part. In order to explicitly indicate the anchor to be searched, the color of the wire frame is changed by the parts display means 480.
[0042]
The searcher designates a search target by clicking the mouse with a rectangular parallelepiped of the intestine, and the search key acquisition unit 490 acquires a search key necessary for searching for related information. This search key allows the video search means 550 to search for intestinal related information. The three-dimensional related information can be displayed by the video search means 550 by video data or by a three-dimensional CG as in the digestive organ and the like, and further related information can be traced by the same processing. .
[0043]
With the search key acquired by the search key acquisition means 490, the book search means 600 can also search related book information.
[0044]
As described above, even when an object is represented by a video, by automatically storing information on the position of a part that is a part of the object, the anchor information of the part is given to the user as in the case of the three-dimensional CG. Present and enable search from there.
[0045]
By converting the 3D CG into a video, it is possible to walk through the low-end PC even for 3D information having a large amount of data. Further, not only information on the entire object but also parts that are part of the object are stored with less data than the original polygon information, so that information can be displayed at the time of search and search from there can be performed.
[0046]
Embodiment 2. FIG.
FIG. 10 is a functional configuration diagram of a book information search space construction / search apparatus according to Embodiment 2 of the present invention for searching for information in a three-dimensional space. In FIG. 10, 50 is a data input means for inputting input data 5 for constructing a search space, and 800 is a video search space construction means for constructing video data to be displayed on a three-dimensional search space from the input data. , 1270 is a video part anchor construction means for constructing anchors in video parts, and these are collectively referred to as a construction unit 700. Note that 200 is a three-dimensional search space construction means.
[0047]
The video / part anchor constructing unit 1270 includes an index creating unit 1280 that stores index information of parts of an object represented by a video, and a part information storage unit 1290 that stores part information. Using the information stored here, the search unit 710 can display and search for the part anchor.
[0048]
Reference numeral 6 is a video data database, 8 is a database storing anchor information data, and 22 is a book information database.
[0049]
The search unit 710 searches for related information and book information by specifying a target on the three-dimensional search space constructed by the construction unit 700. 350 is a video display means for expressing the three-dimensional information as a video, 250 is a mouse instruction means for indicating a search target in the three-dimensional space, 470 is a part display information, and becomes a search target in accordance with the mouse instruction. Video part anchor selection means for determining an anchor and obtaining a search key for the anchor, 550 for video search means for searching for related information of the selected video and anchor, and 600 for searching for book information and displaying the result. It is a book search means. The search result of the video related information is displayed by the video search means 550. Note that 210 is a three-dimensional search space search means.
[0050]
Next, the operation will be described. First, in the construction unit 700, information on an object to be displayed in the three-dimensional space is input by the data input unit 50. As an example, the input object is a three-dimensional CG built in the digestive apparatus of FIG. Each model has a keyword for searching in order to search related information or book information by designating one of the CG models as a search target. The keyword information may be input interactively from the data input means 50, or may be input in a predetermined format in the input data.
[0051]
If this CG model is a model with different objects in each part such as stomach, intestine, and liver, each is defined as an anchor when expressed in a three-dimensional graphics space. Yes.
[0052]
However, when the number of CG polygons in this digestive organ is large, it takes time to read data, and a natural walk-through cannot be realized. Therefore, as shown in FIG. 5, the video search space construction means 800 stores, as video data, rendering images viewed from all 360 ° viewpoints around this data.
[0053]
In the case of reconstructing three-dimensional information using such video data, as in the case of CG, the video data is created so that parts information can be provided to the user. At 1280, index information of the object represented by the video and its parts is created and stored in the index information 25. The index information is the file name, keyword, anchor ID, etc. of each object. The anchor ID is a unique number uniquely identifying each anchor, and is generated here.
[0054]
Next, in the part information storage means 1290, information on each part is stored. In the case of the digester of FIG. 6A, for example, circumscribing information as shown in FIG. 6B is stored and added to the index information. In the case of parts of the stomach, intestine, and liver, the information is as shown in FIG.
[0055]
For example, the video display unit 350 reconstructs three-dimensional information by video by selecting and mapping a video frame suitable for the viewpoint on one polygon (virtual panel) as shown in FIG. In addition, a virtual panel for mapping video data is set as an anchor so that related information can be searched from the video data.
[0056]
On the other hand, the part information is generated from the circumscribing information stored in the part information storing unit 1290 in the part anchor generating unit 472 of the video / part anchor selecting unit 470 shown in FIG. Then, by expressing the parts display means 480 with a three-dimensional wire frame, the anchors of the parts from all viewpoints are expressed by one circumscribed rectangular parallelepiped.
[0057]
The searcher can select the circumscribed cuboid wire frame as an anchor of the parts by the part specifying means 482. In order to explicitly indicate the anchor to be searched, the color of the wire frame is changed by the parts display means 480.
[0058]
An object can be specified by clicking the mouse on the rectangular parallelepiped of the intestine, and the video search means 550 can search for intestinal related information. The three-dimensional related information can be displayed by the video search means 550 using video data or three-dimensional CG in the same manner as in the digestive organ and the like, and further related information can be traced by the same processing.
[0059]
As described above, even when an object is represented by a video, information on parts that are a part of the object is stored, presented to the user, and retrieval from the part information is enabled.
[0060]
By converting the 3D CG into a video, the amount of data can be reduced and a walk-through on a low-end PC is possible. However, by storing only the circumscribing information when viewed from the front as part information, the data Reduce the amount and realize high-speed parts information reconstruction.
[0061]
Embodiment 3 FIG.
FIG. 11 is a diagram for explaining the book information retrieval space construction / retrieval apparatus according to the third embodiment of the present invention, and shows details of the part anchor generation means 472 of FIG.
[0062]
The viewpoint of the searcher is determined based on the mouse position information from the mouse instruction unit 250 in FIG. 10, and the video display unit 350 selects and displays a video frame suitable for the viewpoint.
[0063]
At that time, the part / reconstruction means 380 reconstructs the circumscribed cuboid when viewed from the front of each part as shown in FIG. 12, based on the circumscribing information when viewed from the front stored in the video / part anchor construction means 1270. To construct.
[0064]
The parts anchor information generation means 390 projects the eight vertices of the circumscribed cuboid of each part on the virtual panel prepared according to the viewpoint. On the virtual panel, a polygon (see [1] in FIG. 13) indicating the rough position of each part is drawn.
[0065]
On the virtual panel, the vertices of the rectangle circumscribing these polygons are obtained and added to the index information 25. This rectangle (see [2] in FIG. 13) is an anchor indicating the approximate position of each part.
[0066]
The part display means 480 in FIG. 3 extracts anchor information from the index information 25 of the anchor to be displayed, and expresses the anchor based on the information. For example, when a mouse enters a rectangular range of a certain anchor, a candidate for a part that can be selected is displayed by displaying it with a wire frame of the rectangular polygon.
[0067]
Alternatively, it is possible to provide an interface that presents the coordinates around the center of gravity of the rectangle, and moves the mouse to specify the keyword of the selected anchor.
[0068]
As described above, even when an object is represented by a video, information on parts that are a part of the object is stored, information on the parts is presented to the user, and retrieval from the parts is enabled.
[0069]
By converting 3D CG to video, the amount of data can be reduced, and walk-through on low-end PCs is also possible. Furthermore, by storing only the circumscribing information of each part viewed from the front, the amount of data can be minimized. To present information about parts and search from parts.
[0070]
In addition, the information is rough compared to the case of displaying all circumscribed rectangular parallelepipeds, but since there is no extra line (polygonal wire frame), the whole is easy to see. Therefore, it can be used properly depending on the purpose and purpose.
[0071]
Embodiment 4 FIG.
FIG. 14 is a diagram for explaining a book information retrieval space construction / retrieval apparatus according to Embodiment 4 of the present invention, and shows details of the video / part anchor selection means 470 of FIG. The part anchor generating means 472 is shown in FIG.
[0072]
For the part information, the part anchor generating unit 472 generates information on the basis of the anchor, such as part circumscribing information, from the information stored in the part information storing unit 1290. The part anchor display means 485 generates an anchor virtual panel from one rectangular polygon based on the vertex information of the anchor rectangle obtained by the part anchor information generation means 390 of FIG. Make the anchor polygons transparent so you can see the video content behind them. If the whole is transparent, it is impossible to determine where the anchor is, so the position is indicated by, for example, applying a blue line texture on the frame. An example is shown in FIG.
[0073]
When the searcher selects a virtual panel of the anchor with the anchor designation means 487, the keyword acquisition means 490 follows the index information 25 from the anchor ID held by the anchor and acquires the anchor keyword. The video search means 550 searches the database of anchor information 8 using the anchor keyword of the anchor designated as the search target by the searcher, and searches and displays related information.
[0074]
In order to explicitly indicate the anchor designated by the anchor designation means 487, the part anchor display means 485 replaces the texture with a red line.
[0075]
If necessary, an anchor keyword or the like can be written at the edge of the texture.
[0076]
As a result, it is possible to reconstruct three-dimensional information with video data. Similarly to the case of three-dimensional CG, an anchor that is a link source is set to a part of information of a video object, You can search for information.
[0077]
In addition, by always showing the anchor with a texture on one polygon that shows an approximate shape, the information of all anchors can be roughly understood, and the current selection status, anchor keywords, the back of the anchor It is possible to visualize the information in the information, and to provide more detailed information to the user.
[0078]
In addition, the information is rough compared to the case of displaying all circumscribed rectangular parallelepipeds, but the number of extra lines (polygonal sides) is reduced, so that the whole is easy to see. Therefore, it can be used properly depending on the purpose and purpose.
[0079]
Embodiment 5. FIG.
FIG. 16 is a diagram for explaining a book information search space construction / search apparatus according to Embodiment 4 of the present invention, and shows details of the video / part anchor selection means 470 of FIG.
[0080]
The parts display means 480 generates and displays anchors based on the circumscribing information stored in the parts information storage means 1290 or the vertex information of the anchor rectangle obtained by the parts anchor information generation means 390 in FIG.
[0081]
The range designation means 495 designates the search target by the range by the searcher determining the position and size of the CG such as a sphere in the three-dimensional virtual space. The anchor extraction unit 497 automatically extracts an anchor included in the range designated by the range designation unit 495, and determines an anchor to be searched. FIG. 17 shows how the range is specified when anchors are displayed as shown in FIG.
[0082]
Since the anchor and the video are expressed by a rectangular parallelepiped composed of one polygon or six polygons, the inclusion relation with a CG such as a sphere can be easily determined. However, since the polygon represents a rough position, the parameter can be set depending on the difference in accuracy required by the system, such as performing a process of inclusion when 90% of the polygon is included in the sphere.
[0083]
The search key acquisition means 490 follows the index information 25 from the anchor IDs held by these anchors, and acquires the anchor keywords. The video search means 550 searches the database of anchor information 8 using the anchor keyword of the anchor designated as the search target by the searcher, and searches and displays related information.
[0084]
Further, in order to explicitly indicate the anchor that has been searched, the part display means 480 changes the color of the wire frame as shown in FIG.
[0085]
As a result, it is possible to reconstruct three-dimensional information with video data, and, as in the case of three-dimensional CG, a range is specified for an anchor that is a link source to a part of information of a video object. Thus, it becomes a search target, and the related information can be searched.
[0086]
Note that the inventions described in the first, second, third, fourth, and fifth embodiments are effective not only when the input data is a three-dimensional CG but also for an actual object. If the vertex information of the circumscribed cuboid of the object in the scene to be photographed can be acquired, each object in the scene is automatically generated as an anchor as in the case of 3D CG, and information retrieval from the anchor becomes possible. .
[0087]
In the inventions described in the first, second, third, fourth, and fifth embodiments, the generated video data can use a conventional format, for example, an AVI (Audio Visual Interleaved) format, and a three-dimensional virtual Since the video frame is texture-mapped to one CG polygon in the space, it is possible to coexist in the same virtual space when it is desired to express other 3D computer graphics. Therefore, from a 3D CG or a 2D image mapped to a polygon in a 3D space, a link is made to the 3D information of the video, and conversely, from a video anchor, a 3D CG or 2D You can also link to images.
[0088]
Further, the contents described in the above-mentioned Embodiments 1, 2, 3, 4, 5, and 6 describe the search for book information, but this can also be used for information search of one version other than books. .
[0089]
【The invention's effect】
As described above, according to the first and sixth aspects of the present invention, a search space for searching for target book information while searching for related information of a book in a three-dimensional space constructed on a computer. Is a book information search space construction / retrieval device for searching for book information, a data input means for inputting data necessary for constructing a three-dimensional search space, and a video search space based on the input data 3D search space construction means comprising a video search space construction means for constructing a video and a video part anchor construction means for constructing an anchor in a video part, and a mouse is used to indicate on the 3D space Mouse instruction means, video display means for displaying a three-dimensional search space, generating and displaying part anchors, and determining anchors to be searched according to mouse instructions 3D search space search means comprising video part anchor selection means for obtaining the search key for the anchor, and video search means for searching for and displaying 3D and 2D related information using the search key for the anchor, and search for the anchor Library information search space construction / retrieval device comprising: a book retrieval means for retrieving book information by key and displaying the results; and a book information retrieval space construction / retrieval program for executing the same Since the recording medium is recorded, even when the object is represented by video, the position information of the parts that are part of the object is automatically stored, so that the parts can be displayed to the user in the same way as in the case of 3D CG. It is possible to search from there. Also, by converting the 3D CG into a video, it is possible to walk through the low-end PC even for 3D information with a large amount of data. Further, not only information on the entire object but also parts which are part of the object are stored with less data than the original polygon information, so that information can be displayed at the time of search and search from there can be performed.
[0090]
According to the second and seventh inventions of the present invention, a search space for searching for target book information is constructed while searching for related information of books in a three-dimensional space constructed on a computer. A library information search space construction / retrieval device for retrieving book information, wherein data input means for inputting data necessary for constructing a three-dimensional search space, and a video search space are constructed by the input data 3D search space construction means comprising video search space construction means, index creation means for storing index information of each part, and video / part anchor construction means comprising part information storage means for storing information for each part. A construction unit to be constructed, mouse pointing means for pointing on the 3D space with a mouse, and video display means for displaying a video in the 3D search space, A video part anchor selection means for generating and displaying an anchor of a part, determining an anchor to be searched according to a mouse instruction, and obtaining a search key of the anchor, and a 3D and 2D relation by an anchor search key A search unit comprising: a three-dimensional search space search means comprising a video search means for searching and displaying information; and a book search means for searching for book information by using an anchor search key and displaying the result. Since the book information search space construction / retrieval device and the storage medium storing the book information search space construction / retrieval program for executing this are used, even if the object is expressed in video, the information on the parts that are part of it is displayed. It can be stored, presented to the user, and retrieved from the part information. In addition, by converting the 3D CG into a video, the amount of data can be reduced and a walk-through on a low-end PC is possible. However, by storing only the circumscribing information when viewed from the front as part information at that time , Reduce the amount of data, can achieve high-speed parts information reconstruction.
[0091]
Further, according to the third and eighth aspects of the present invention, the video / part anchor selecting means includes a part anchor generating means for generating a part anchor from the part information stored in the part information storing means, In order to display the anchor at the current viewpoint from the reconstructed part, the part anchor generating unit is configured to reconstruct each part using the information of each part accumulated in the part information storage unit. A library information search space construction / retrieval device of the second invention having parts anchor information generation means for generating necessary information, and a memory of the seventh invention including a book information search space construction / retrieval program for executing the same Because it is a medium, even when an object is represented by a video, information on the parts that are part of it is stored, and the information on the parts is sent to the user. Shown, it is possible to search from the parts. In addition, by converting the 3D CG into a video, the amount of data can be reduced, and a walk-through with a low-end PC is also possible. Furthermore, by storing only the circumscribing information of each part viewed from the front, the amount of data is minimized It is possible to present information about parts and search from parts. Furthermore, the information is rough compared to the case of displaying all the circumscribed rectangular parallelepipeds, but since there is no extra line (polygonal wire frame), the whole is easy to see. Therefore, it can be used properly depending on the purpose and purpose.
[0092]
According to the fourth and ninth inventions of the present invention, the video / part anchor selecting means displays a part anchor generating means for generating a part anchor from the stored part information and an anchor for each part. A book information search space according to a third aspect of the present invention, comprising: a part anchor display means; an anchor designation means for designating an anchor; and a search key acquisition means for obtaining a search key for searching related information from the selected anchor. Since the storage medium of the eighth invention including the construction / retrieval apparatus and the book information retrieval space construction / retrieval program for executing the construction / retrieval apparatus, it is possible to reconstruct three-dimensional information with video data, and As in the case of 3D CG, it is possible to set an anchor that is a link source to a part of information of a video object and search related information. It made. In addition, by always showing the anchor with a texture on one polygon that shows an approximate shape, the information of all anchors can be roughly understood, and the current selection status, anchor keywords, the back of the anchor It is possible to visualize the information in the information, and to provide more detailed information to the user. In addition, the information is rough compared to the case of displaying all circumscribed rectangular parallelepipeds, but the number of extra lines (polygonal sides) is reduced, so that the whole is easy to see. Therefore, it can be used properly depending on the purpose and purpose.
[0093]
According to the fifth and tenth aspects of the present invention, the video / part anchor selecting means generates a part anchor from the stored part information and a part displaying the part anchor. Display means, range designation means for designating a range, anchor extraction means for extracting an anchor included in the designated range to be searched, and a search key for retrieving related information from the selected anchor Since the book information search space construction / retrieval device of the third invention having the search key acquisition means for performing the above and the storage medium of the eighth invention including the book information search space construction / retrieval program for executing the same are provided, 3 Dimensional information can be reconstructed with video data, and as with 3D CG, it can be reconstructed as part of the video object information. For anchoring a click source by specifying a range to be searched can search for related information.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram of hardware of a book information search space construction / search apparatus according to the present invention.
FIG. 2 is a functional configuration diagram of a book information retrieval space construction / retrieval device according to Embodiment 1 of the present invention for retrieving information in a three-dimensional space.
FIG. 3 is a diagram showing details of the video / part anchor selecting means of FIG. 2;
FIG. 4 is a diagram of a three-dimensional CG of a digestive organ for explaining the operation of the book information search space construction / search apparatus according to Embodiment 1 of the present invention.
FIG. 5 is a drawing of rendering images from all viewpoints for explaining the operation of the book information search space construction / search apparatus according to Embodiment 1 of the present invention;
FIG. 6 is a diagram of a three-dimensional CG of the digestive organ and a circumscribed cuboid of the intestine for explaining the operation of the book information retrieval space construction / retrieval device according to the first embodiment of the present invention.
FIG. 7 is a diagram of a circumscribed cuboid of the stomach, liver, and intestine in the three-dimensional CG of the digestive organ for explaining the operation of the book information search space construction / search apparatus according to Embodiment 1 of the present invention;
FIG. 8 is a diagram showing a state in which a three-dimensional information is expressed by selecting a video frame in accordance with the viewpoint for explaining the operation of the book information search space construction / search apparatus according to Embodiment 1 of the present invention; It is.
FIG. 9 represents information on intestinal part anchors (rectangular wire frame) together with a digestive organ video frame for explaining the operation of the book information retrieval space construction / retrieval apparatus according to Embodiment 1 of the present invention. FIG.
FIG. 10 is a functional configuration diagram of a book information retrieval space construction / retrieval device according to Embodiment 2 of the present invention for retrieving information in a three-dimensional space.
11 is a diagram for explaining a book information retrieval space construction / retrieval apparatus according to a third embodiment of the present invention, and shows details of the part anchor generation means of FIG. 3;
FIG. 12 is a diagram showing a state in which a circumscribed cuboid is reconstructed when viewed from the front, for explaining the operation of the book information retrieval space construction / retrieval device according to Embodiment 3 of the present invention;
FIG. 13 is a diagram showing video frames and intestinal part anchors selected for each viewpoint for explaining the operation of the book information search space construction / retrieval apparatus according to Embodiment 3 of the present invention;
FIG. 14 is a diagram for explaining a book information retrieval space construction / retrieval device according to a fourth embodiment of the present invention, and shows details of the video / part anchor selection means of FIG. 2;
FIG. 15 shows a state where a part anchor frame of the stomach, intestine, and liver is shown by a texture on a polygon for explaining the operation of the book information search space construction / retrieval apparatus according to Embodiment 4 of the present invention; FIG.
FIG. 16 is a diagram for explaining a book information retrieval space construction / retrieval apparatus according to a fifth embodiment of the present invention, and shows details of the video / part anchor selection means of FIG. 2;
FIG. 17 is a diagram showing a state in which the upper part of the digestive organ is designated by a sphere for explaining the operation of the book information search space construction / retrieval apparatus according to Embodiment 5 of the present invention;
FIG. 18 is a diagram showing a state in which selected anchors are displayed in another color for explaining the operation of the book information search space construction / search apparatus according to Embodiment 5 of the present invention;
FIG. 19 is a diagram showing a configuration of a quick time virtual reality authoring studio which is one of the main devices of the prior art.
20 is a diagram showing a processing flow of the panoramic movie generating means of FIG.
FIG. 21 is a diagram showing a processing flow of the object movie generating means of FIG. 19;
[Explanation of symbols]
5 input data, 6 video data, 8 anchor information, 11 arithmetic processing device, 12 memory device, 14 display device, 15 input device, 22 book information, 25 index information, 50 data input means, 200 3D search space construction means, 210 Three-dimensional search space search means, 250 mouse instruction means, 270 video / part anchor construction means, 350 video display means, 380 parts / reconstruction means, 390 parts anchor information generation means, 470 video / part anchor selection means, 472 parts Anchor generation means, 480 Parts display means, 482 Parts specification means, 485 Parts anchor display means, 487 Anchor specification means, 490 Search key acquisition means, 495 Range specification means, 497 Anchor extraction means, 550 Video search means, 600 Book search means 700 Built in part, 710 search unit, 800 video search space construction means, 1270 video part anchor construction means, 1280 indexing means, 1290 parts information storage means.

Claims (10)

A library information retrieval space construction / retrieval device that retrieves book information by constructing a search space for retrieving target book information while searching for related information of books in a three-dimensional space constructed on a computer There,
Data input means for reading and inputting 3D CG data necessary for constructing a 3D search space;
A rendering image viewed from a plurality of viewpoints around a three-dimensional CG including a plurality of parts having an input search key is generated as video data to be displayed on the three-dimensional search space of the three- dimensional CG and stored and searched by video. A three-dimensional search space construction means comprising a video search space construction means for constructing a space and a video part anchor construction means for storing circumscribed information for the anchor of each part of the video;
A construction part consisting of:
Means for acquiring an input for pointing on a three-dimensional space by a mouse;
Select from the stored video data, and display the 3D search space by mapping the video frame that matches the viewpoint on the virtual panel, generate and display the circumscribing body as the anchor from the circumscribing information of the parts, A video / anchor selection means for determining an anchor to be searched according to an instruction from the mouse and obtaining a search key set in advance for the part of the anchor, and 3D and 2D related information are searched using the anchor search key. Three-dimensional search space search means comprising video search means for displaying;
A book search means for searching for book information using an anchor search key and displaying the results,
A search unit comprising:
A library information retrieval space construction / retrieval device characterized by comprising: A library information retrieval space construction / retrieval device that retrieves book information by constructing a search space for retrieving target book information while searching for related information of books in a three-dimensional space constructed on a computer There,
Data input means for reading and inputting 3D CG data necessary for constructing a 3D search space;
A rendering image viewed from a plurality of viewpoints around a 3D CG including an object composed of a plurality of parts having an input search key is generated and stored as video data to be displayed on the 3D search space of the 3D CG. Video search space construction means for constructing a search space by video, and index creation means for creating and storing index information including search keys and anchor information of objects and their parts expressed in video, and anchors for each part Three-dimensional search space construction means comprising video part anchor construction means comprising parts information storage means for generating and storing circumscribed information when viewed from a predetermined front for
A construction part consisting of:
Means for acquiring an input for pointing on a three-dimensional space by a mouse;
Video display means for displaying video in a three-dimensional search space by mapping video frames that match the viewpoint on the virtual panel by selecting from the stored video data , when viewed from the front as an anchor from the circumscribing information of the parts Video part anchor selection means for generating and displaying a circumscribed body, determining an anchor to be searched according to a mouse instruction, and obtaining a search key set as the index information for the anchor, and a three-dimensional search by the anchor search key 3D search space search means comprising video search means for searching for and displaying 2D related information;
A book search means for searching for book information using an anchor search key and displaying the results,
A book information retrieval space construction / retrieval device comprising: a retrieval unit comprising: It has a part anchoring generating means for generating an anchor part from circumscribing information when viewed from the front of the video part anchoring selection means is accumulated in the part information storing unit, this part anchoring generating means,
Parts restructuring means for reconstructing the circumscribed body as an anchor when viewed from the front of each part using the circumscribed information when viewed from the front of each part accumulated in the parts information storage means;
Part anchor information generation means for obtaining a vertex of a rectangle circumscribing a polygon formed by projecting the circumscribed body of each part on a virtual panel that matches the viewpoint, and adding it to the index information as an anchor;
Have
3. The book information retrieval space construction / retrieval apparatus according to claim 2, wherein the video / part anchor selection means displays an anchor based on the index information. The video part anchor selecting means is
A part anchor generating means for generating information serving as an anchor composed of circumscribed information when viewed from the front of the part from the accumulated part information;
Part anchor display means for displaying a transparent virtual panel having a colored frame for anchor from each vertex of the rectangle of the anchor of each part obtained by the part anchor information generating means;
Means for obtaining an input for specifying an anchor;
Search key acquisition means for acquiring a search key for searching related information based on index information from a specified anchor;
The book information retrieval space construction / retrieval apparatus according to claim 3, wherein: The video part anchor selecting means is
A part anchor generating means for generating information serving as an anchor composed of circumscribed information when viewed from the front of the part from the accumulated part information;
Parts display means for displaying the anchor of the part from each vertex of the circumscribed information or anchor rectangle when viewed from the front,
Means for acquiring an input for designating a search range in a three-dimensional search space;
An anchor extraction means for extracting an anchor to be searched within a specified range;
Search key acquisition means for acquiring a search key for searching related information based on index information from the extracted anchor;
The book information retrieval space construction / retrieval apparatus according to claim 3, wherein: A library information search space construction / retrieval program for searching for book information by building a search space for searching target book information while searching for related information of books in a three-dimensional space constructed on a computer A recorded computer-readable storage medium,
A data input step of reading and inputting 3D CG data necessary to construct a 3D search space;
A rendering image viewed from a plurality of viewpoints around a three-dimensional CG including a plurality of parts having an input search key is generated as video data to be displayed on the three-dimensional search space of the three- dimensional CG and stored and searched by video. A three-dimensional search space construction step comprising a video search space construction step for constructing a space and a video part anchor construction step for storing circumscribed information for the anchor of each part of the video;
A construction procedure consisting of:
Obtaining an input indicating a three-dimensional space by a mouse;
Select from the stored video data, and display a 3D search space by mapping video frames that match the viewpoint on the virtual panel. Generate and display a circumscribing body as an anchor from the circumscribing information of the parts. A video / part anchor selection process for determining an anchor to be searched according to an instruction from the mouse and obtaining a search key set in advance for the part of the anchor, and searching for 3D and 2D related information using the anchor search key A three-dimensional search space search step comprising a video search step for displaying;
A book search process for searching for book information using the anchor search key and displaying the results,
A search procedure consisting of:
A computer-readable storage medium on which is recorded. A library information search space construction / retrieval program for searching for book information by building a search space for searching target book information while searching for related information of books in a three-dimensional space constructed on a computer A recorded computer-readable storage medium,
A data input step of reading and inputting 3D CG data necessary to construct a 3D search space;
A rendering image viewed from a plurality of viewpoints around a 3D CG including an object composed of a plurality of parts having an input search key is generated and stored as video data to be displayed on the 3D search space of the 3D CG. A video search space construction process for building a video search space, and an index creation process for creating and storing index information including search keys and anchor information of objects and their parts expressed in video, and anchors for each part A three-dimensional search space construction step comprising a video / part anchor construction step comprising a part information storage step of generating and storing circumscribing information when viewed from a predetermined front for
A construction procedure consisting of:
Obtaining an input indicating a three-dimensional space by a mouse;
A video display process that displays video in a three-dimensional search space by selecting video data that has been stored and mapping video frames that match the viewpoint on the virtual panel . A video part anchor selection step for generating and displaying a circumscribed body, determining an anchor to be searched according to a mouse instruction, and obtaining a search key set as the index information for the anchor, and a three-dimensional search by the anchor search key And a three-dimensional search space search step comprising a video search step for searching and displaying related information in two dimensions.
A book search process for searching for book information using the anchor search key and displaying the results,
A computer-readable storage medium storing a search procedure comprising: Has a part anchor generation step of generating an anchor part from circumscribing information when the video part anchor selection process is viewed from the stored front by the part information storing step, the part anchor generation step,
A part rebuilding process for rebuilding a circumscribed body that is an anchor when viewed from the front of each part using the circumscribed information when viewed from the front of each part accumulated in the part information storing process;
A part anchor information generation step of finding a vertex of a rectangle circumscribing a polygon formed by projecting the circumscribed body of each part on a virtual panel that matches the viewpoint, and adding it to the index information as an anchor,
Have
8. The computer-readable storage medium storing a book information retrieval space construction / retrieval program according to claim 7, wherein the video / part anchor selection step displays an anchor based on index information. The video / part anchor selection step includes:
A part anchor generation process for generating information serving as an anchor consisting of circumscribed information when viewed from the front of the part from the accumulated part information;
A part anchor display step for displaying a transparent virtual panel having a colored frame for anchor from each vertex of the rectangle of the anchor of each part obtained in the part anchor information generation step;
Obtaining an input specifying an anchor;
A search key acquisition step of acquiring a search key for searching related information based on index information from a specified anchor;
The computer-readable storage medium which recorded the book information search space construction and search program of Claim 8 characterized by the above-mentioned. The video / part anchor selection step includes:
A part anchor generation process for generating information serving as an anchor consisting of circumscribed information when viewed from the front of the part from the accumulated part information;
A part display process for displaying the anchor of the part from each vertex of the circumscribed information or the rectangle of the anchor when viewed from the front,
Obtaining an input for specifying a search range in a three-dimensional search space;
An anchor extraction step for extracting an anchor to be searched within a specified range;
A search key acquisition step of acquiring a search key for searching related information based on the index information from the extracted anchor;
The computer-readable storage medium which recorded the book information search space construction and search program of Claim 8 characterized by the above-mentioned.

Images