JPH08329281A - Image display method - Google Patents

Abstract

PURPOSE: To improve the display efficiency of respective videos and additional information by rearranging and displaying plural still pictures together with relation information attached to the still images on the basis of time and logical connections. CONSTITUTION: An inputted image is sent to a sampling part 121 and stored in a memory 120, and a representative still image is extracted by a representative scene segmentation part 122 from the image as a representative scene and stored as scene data 131 in a data base. Further, the representative scene segmentation part 122 extracts information on the title of the representative scene, a user's comment, a menu that the user prepares, the category of the image, and the arrangement position of the representative scene and stores it in the scene data 131. Then plural still pictures and relation information attached to the still pictures are rearranged in time series on three-dimensional CG(computer graphics) on the basis of time-series links and still images which have logical connections are arranged and displayed closely on the basis of hyperlinks.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video display technology,
Especially, the data of the database that has a lot of video information,
The present invention relates to a technique effectively applied to a method and apparatus for displaying on three-dimensional computer graphics (hereinafter, referred to as CG).

[0002]

2. Description of the Related Art Conventionally, when displaying a video on a three-dimensional CG, a two-dimensional video display method, a video display method for searching and displaying video information by a keyword, or a video displaying only video information and its link The display method etc. were used.

The two-dimensional video display method is a method of extracting a typical still image from a video and displaying the extracted still images in a plane on a paper surface or a display and displaying the still image on the display. When arranging still images, they are often displayed in a menu format so that the still images do not overlap.

Further, in a video display method for searching and displaying video information by a keyword, a keyword for searching the video is set for each video, and the keyword is stored as a part of the video information and displayed. This is a method of searching the video information based on the keyword of the video desired and displaying the searched video.

The above-mentioned video display method of displaying only the video information and its link is to display a still image on the display and at the same time, to link the still image with another still image related to the still image. This is a method of accumulating the storage locations of other still images, and when a still image related to a certain still image is selected and other video information is extracted, it is embedded in the currently displayed still image. Following the link, other still images are displayed.

In the above video display method, when moving from the display of a specific still image to the display of another still image, another still image two-dimensionally displayed in the menu is selected or another still image is displayed. Searching for other still images by keywords, or moving to other still images by following the link of the still image currently displayed, for discrete movement to specific predetermined video information. It was limited.

[0007]

The present inventor has found the following problems as a result of examining the above-mentioned prior art.

(1) In the conventional two-dimensional image display method,
Since a plurality of still images are displayed side by side so as not to overlap and most of the additional information is not displayed, there is a problem that the display efficiency of the plurality of videos and the additional information is poor.

(2) In the conventional video display method for displaying only the video information and its link, since the video information related to a certain video information is represented by the link, the video information space related by the link is displayed. There is a problem that it is not possible to grasp the above and display the relationship between a plurality of pieces of video information at once.

(3) When a video is selected by a menu or keyword search of the two-dimensional video display method, or when a link for extracting video information is traced by the video display method for displaying only the video information and its link. Has a problem that it is not possible to search for video information that is not selected by the menu, keyword, and link because the video displayed in the menu in advance or the video with keywords and links set is selected. It was

(4) In the conventional discrete information walk, the two-dimensional video display method or the video display method for displaying only the video information and its link, one video information to another video information is displayed. Since the destination was limited to the video information displayed two-dimensionally or the video information with the link set,
There is a problem that it is not possible to take a cross-sectional view of a video information space that moves from a certain video information to a video that is not two-dimensionally displayed or a video that has no link.

An object of the present invention is to provide a technique capable of improving the display efficiency of a plurality of videos and their additional information.

Another object of the present invention is to provide a technique capable of visually grasping a video information space in which a plurality of videos are displayed.

Another object of the present invention is to provide a technique capable of displaying images that are temporally and logically connected.

Another object of the present invention is to provide a technique capable of selecting and displaying any video in a video information space in which a plurality of videos are displayed.

The above and other objects and novel features of the present invention will be apparent from the description of this specification and the accompanying drawings.

[0017]

The outline of the representative one of the inventions disclosed in the present application will be briefly described as follows.

(1) An image display method for displaying an image on a three-dimensional CG, wherein a plurality of still images are extracted from a plurality of moving images, relational information associated with the plurality of still images is extracted, and A time-series link indicating a temporal connection of a plurality of still images is created, a hyperlink indicating a logical connection of the plurality of still images is created, and a plurality of still images and related information associated with the still images are created. The time series links and the hyperlinks are accumulated, and the plurality of still images and related information associated with the still images are arranged and displayed on the three-dimensional CG based on the time series links and the hyperlinks. It is a thing.

(2) In the image display method of (1), the plurality of still images extracted from the plurality of moving images become a plurality of representative scenes representing the video of each scene of the moving picture. is there.

(3) In the image display method according to (1) or (2), the time-series link is created by another method that is temporally connected to a predetermined still image among the plurality of still images. The identification code of the still image is stored in the data of the predetermined still image, and the hyperlink is created by selecting an arbitrary still image with respect to the predetermined still image among the plurality of still images, The identification code of the selected still image is stored in the data of the predetermined still image.

(4) An image display method for displaying an image on a three-dimensional CG, wherein a plurality of still images are extracted from a plurality of moving images, relational information associated with the plurality of still images is extracted, and A time-series link indicating a temporal connection of a plurality of still images is created, a hyperlink indicating a logical connection of the plurality of still images is created, and a plurality of still images and related information associated with the still images are created. The time-series links and the hyperlinks are accumulated, and the accumulated still images and the relational information associated with the still images are stored in a three-dimensional virtual space virtually generated in a computer in a three-dimensional virtual space. A plurality of three-dimensional CG objects, which are combined with a three-dimensional CG object that is an object and combined with the still image and relationship information, are created based on the accumulated time series links and hyperlinks. Place the dimension virtual space, displays a 3-dimensional CG object group viewed from a predetermined viewpoint position of the three-dimensional virtual space, in which to visualize the relationship between a plurality of images.

(5) In the image display method of (4), when the three-dimensional CG object is arranged in a three-dimensional virtual space virtually generated in a computer, a plurality of pieces connected by the time-series link are connected. When arranging the three-dimensional CG objects, the three-dimensional CG objects are arranged adjacent to each other, and when the plurality of three-dimensional CG objects connected by the hyperlink are arranged, the three-dimensional CG objects are arranged. They are arranged close to each other up to a predetermined distance.

(6) In the image display method according to (4) or (5), the viewpoint position is input when displaying a three-dimensional CG object group viewed from a predetermined viewpoint position in the three-dimensional virtual space. Then, the viewpoint position in the three-dimensional virtual space is changed based on the input viewpoint position, a three-dimensional CG object group viewed from the changed viewpoint position is displayed, and a plurality of viewpoints viewed from an arbitrary viewpoint position are displayed. To visualize the relationship between the images.

[0024]

According to the above-mentioned means, first, the plurality of still images are extracted from the plurality of moving images displayed on the three-dimensional CG, and the relational information associated with the plurality of still images is extracted.

Next, a time-series link showing the temporal connection of the extracted still images and a hyperlink showing the logical connection of the still images are created.

The plurality of still images, relational information associated with the still images, the time series links, and the hyperlinks are stored in a database.

The plurality of still images stored in the database and the relational information associated with the still images are arranged in time series on the three-dimensional CG based on the time series links, and then arranged in the hyperlink. Based on this, still images that are logically connected are placed close to each other and displayed.

It is assumed that the plurality of still images extracted from the moving image are a plurality of representative scenes that are representative scenes in the plurality of videos, and the relation information of the plurality of still images is It is assumed that the information is the title of the plurality of still images extracted from the information of the moving image, the user's comment, the category of the video, and the like.

Here, the method of extracting the representative scene is not particularly specified. For example, the representative scene is extracted on the basis of the scene change in the moving image, or the scene at a constant time in the moving image is extracted. A representative scene may be extracted based on the above.

The time-series link is created by accumulating an identification code of another still image temporally connected to a predetermined still image among the plurality of still images in the data of the predetermined still image. To do.

To create the hyperlink, an arbitrary still image is selected with respect to a predetermined still image among the plurality of still images, and the identification code of the selected still image is used as the data of the predetermined still image. Accumulate in.

As described above, since a plurality of still images are displayed side by side with related information associated with the still images based on temporal or logical connection, the display efficiency of a plurality of videos and their additional information is improved. It is possible.

Further, a plurality of still images are extracted from a plurality of moving images displayed on the three-dimensional CG, relational information associated with the plurality of still images is extracted, and the temporal connection of the plurality of still images is determined. A time-series link shown is created, a hyperlink showing a logical connection between the plurality of still images is created, and a plurality of still images, relational information associated with the still images, the time-series link, and the hyperlink are stored in a database. Accumulate in.

Next, a three-dimensional CG which is a three-dimensional object in a three-dimensional virtual space virtually generated in a computer from the plurality of accumulated still images and related information associated with the still images. Combine into an object.

For example, a certain still image, a title of the still image, a user's comment, time data in time series, and the like are synthesized on each surface of the rectangular parallelepiped three-dimensional CG object.

Next, a plurality of three-dimensional CG objects combined with the still image and relationship information are arranged in the three-dimensional virtual space based on the time series links and the hyperlinks.

Displaying the plurality of three-dimensional CG object groups viewed from a predetermined viewpoint in the three-dimensional virtual space,
The relationship between the plurality of images is visualized by displaying the relationship between the plurality of 3D CG objects.

As described above, since the plurality of three-dimensional CG objects obtained by synthesizing the still images are arranged on the three-dimensional CG to visualize the relationship between the plurality of images, the plurality of three-dimensional CG objects are displayed. It is possible to visually comprehend the video information space.

When arranging the three-dimensional CG objects in a three-dimensional virtual space virtually generated in the computer, when arranging a plurality of three-dimensional CG objects connected by the time series links, , The three-dimensional CG objects connected by the time series link are arranged adjacent to each other.

Next, if there is a three-dimensional CG object connected by the hyperlink in the three-dimensional CG objects arranged by the time-series link, the three-dimensional CG objects connected by the hyperlink are comrades. Are arranged close to each other up to a predetermined constant distance.

As described above, since the plurality of three-dimensional CG objects are arranged close to each other based on the time-series link and the hyperlink, it is possible to display images that are temporally and logically connected. It is possible.

In the image display method, the above 3
When displaying a three-dimensional CG object group viewed from a predetermined viewpoint position in the three-dimensional virtual space, the viewpoint position is input,
Based on the input viewpoint position, the viewpoint position in the three-dimensional virtual space is changed, a three-dimensional CG object group viewed from the changed viewpoint position is displayed, and a plurality of images viewed from arbitrary viewpoint positions are displayed. Visualize the relationships between.

As described above, by changing the viewpoint position in the three-dimensional virtual space, the image of an arbitrary three-dimensional CG object on the three-dimensional CG is displayed with emphasis, so that a plurality of images are displayed. It is possible to select and display any video in the video information space.

[0044]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the drawings together with embodiments.

In all the drawings for explaining the embodiments, parts having the same function are designated by the same reference numerals, and the repeated description thereof will be omitted.

FIG. 1 is a diagram showing a schematic configuration of an apparatus of an embodiment for carrying out the image display method of the present invention. In FIG. 1, 100 is a CPU, 110 is a video input device, and 120.
Is a memory, 121 is a sampling unit, 122 is a representative scene cutout unit, 123 is a combining unit, 130 is an external storage device,
131 is scene data, 140 is a graphical user,
An interface (GUI) device, 141 is a placement unit, 15
Reference numeral 0 is an additional information input device.

As shown in FIG. 1, the apparatus for implementing the image display method of this embodiment is a video input device 110 for inputting a video.
A memory 120 storing a program for processing a video image input by the video input device 110, an external storage device 130 storing a database accumulating video scene data 131, and a GUI displaying the scene data 131.
The device 140, the additional information input device 150 for inputting an instruction from the user, the video input device 110, and the memory 120.
The CPU 100 controls the operations of the external storage device 130, the GUI device 140, and the additional information input device 150.

In the embodying device for carrying out the image display method of the present embodiment, the image input from the video input device 110 is sent to the sampling unit 121 to store the image in the memory 120, and the representative scene cutout unit 122 outputs the image. A typical still image is extracted as a representative scene from, and the extracted representative scene is stored in the database of the external storage device 130 as scene data 131.

Further, in the representative scene cutout unit 122, as the relational information of the representative scene, the title of the representative scene, the user's comment, the menu prepared by the user, the video category, and the place in the video of the representative scene are shown. The time data and the information on the arrangement position of the representative scene are extracted and stored in the scene data 131.

Here, the method for extracting the representative scene is not particularly specified. For example, the first image of the scene change is extracted as the representative scene based on the scene change in the input video, and the representative scene is extracted. You may extract the image of the scene for every fixed time in a video as a representative scene.

The scene data 131 stored in the database of the external storage device 130 is stored in the G
After being combined with the three-dimensional CG object on the three-dimensional CG displayed on the UI device 140, the arranging unit 141 arranges the three-dimensional CG object on the three-dimensional CG.

Further, the user uses the additional information input device 150 to specify the viewpoint position of the 3D CG displayed on the GUI device 140 and the 3D CG object forming the hyperlink.

(Synthesis Processing of Scene Data into Three-Dimensional CG Object) In the image display method of this embodiment, the scene data of a video is three-dimensional CG in a three-dimensional virtual space.
The process of combining with an object will be described.

FIG. 2 is a diagram showing an outline of a process of synthesizing scene data into a three-dimensional CG object in the image display method of this embodiment. In FIG. 2, 210 is a video scene, 220 is additional information, 230 is media information, 24
0 is the three-dimensional CG object, 241 is the front of the three-dimensional CG object 240, 242 is the back of the three-dimensional CG object 240, and 243 is the three-dimensional CG object 24.
The upper surface of 0, 244 and 245 are side surfaces of the three-dimensional CG object 240, 251 is an audio reproduction area, and 252 is a video reproduction area.

As shown in FIG. 2, the scene data 131 stored in the database of the external storage device 130 of the image display method of this embodiment includes the video scene 210 which is a representative scene, the additional information 220, and the media information 230. And the scene data 131 in the three-dimensional CG object 240 of the rectangular parallelepiped.
Is synthesized.

The additional information 220 is composed of relational information and attribute information. The relational information is the title of the video scene 210, the user's comment, the menu prepared by the user,
The attribute information includes a video category, time data indicating a location of the video scene 210 in the video, and an arrangement position of the video scene 210, and the attribute information is an identification code of other scene data connected by the time-series link and the hyperlink. have.

The media information 230 is media information attached to the video scene 210, and is composed of audio information and video information from the scene data to the next scene data connected by a time series link. This video scene 210
Is mapped to the space around the three-dimensional CG object 240, and when the user specifies the coordinates around the three-dimensional CG object 240 by the additional information input device 150, the specified coordinate value Is within the audio reproduction area 251 of radius R, the audio information is reproduced, and when the designated coordinate value is within the video reproduction area 252 of radius r, the video information is reproduced.

In the synthesizing section 122 of the image display method of this embodiment, the scene data 131 is converted into the three-dimensional CG object 240.
To synthesize. The video scene 210, which is a representative scene, has a color on the front 241 of the three-dimensional CG object 240 and a back 2
42 in black and white.

The time data indicating the place in the video of the video scene 210, which is the related information in the additional information 220 of the video scene 210, is the upper surface 243 of the three-dimensional CG object 240.
The title of the video scene 210, the user's comment, the menu prepared by the user, and the video category are composited on the side surfaces 244 and 245 of the three-dimensional CG object 240.

FIG. 3 is a diagram showing an outline of a three-dimensional CG object in which scene data is combined in the image display method of this embodiment. In FIG. 3, 310 is a three-dimensional CG object in which the title and comment of the video scene 210 are combined, and 320 is a menu prepared by the user and the video scene 2.
It is a three-dimensional CG object that is a composite of 10 categories.

As shown in FIG. 3, the front side 241 and the back side 242 of the three-dimensional CG object 310 and the three-dimensional CG object 320 of the image display method of this embodiment are combined with a video scene 210 as a representative scene. On the upper surface 243, the time which is the position in the image of the image scene 210 is combined.

Side surface 24 of three-dimensional CG object 310
4 and the side surface 245, the title of the video scene 210 and the user's comment are combined, and the three-dimensional CG object 320 is displayed.
On the side surface 244 and the side surface 245, the menu prepared by the user and the category of the video scene 210 are combined, and as shown in FIG. 3, in the image display method of the present embodiment, the information to be combined by the related information. The content of may be selected.

As described above, according to the image display method of this embodiment, since a plurality of still images are displayed together with the related information associated with the still images, the display efficiency of a plurality of videos and their additional information is improved. It is possible.

(3D CG Object Arrangement Processing) In the image display method of this embodiment, the processing procedure for arranging a 3D CG object obtained by synthesizing scene data in a 3D virtual space based on a time series link is as follows. Will be described.

FIG. 4 is a flow chart showing a processing procedure for arranging a three-dimensional CG object in which scene data is combined based on a time series link in the image display method of this embodiment.

As shown in FIG. 4, in the image display method of this embodiment, a plurality of three-dimensional CG objects in which temporally connected video scenes 210 are combined are added to the additional information 22.
It is arranged in the virtual three-dimensional virtual space in the computer based on the time-series link which is the attribute information of 0.

In the processing of step 401, scene data 1
31 is stored in the related information of the additional information 220,
Of the representative scenes connected by the time series link, referring to the time data indicating the place in the video of the video scene 210,
The entry scene that is first in time is taken out.

Next, in the processing of step 402, the arrangement position accumulated in the relational information of the additional information 220 of the scene data 131 of the extracted entry scene is read out, and the three-dimensional CG object is virtualized in the three-dimensional virtual image. Place in space.

In the processing of step 403, the time-series link in the attribute information of the additional information 220 of the arranged scene data 131 is examined to see if the representative scene is temporally connected to another representative scene.

When the representative scene is temporally connected to another representative scene, the identification code for the other representative scene accumulated in the time series link is referred to in the processing of step 404, and A three-dimensional CG object combined with the scene data 131 of another representative scene is arranged at a position separated from the three-dimensional CG object combined with the scene data 131 of the representative scene by a constant distance t.

Next, returning to the processing of step 403, all of the three-dimensional CG objects that are composed of the representative scenes connected by the time series link are arranged in the three-dimensional virtual space.

In the processing of step 403, when the three-dimensional CG object that combines the representative screens connected by the time series link disappears, the process returns to step 401 and the first representative connected by another time series link. The entry scene, which is a scene, is searched for, and if the entry scene is not found, the process ends.

FIG. 5 is a diagram showing a process of arranging a three-dimensional CG object based on a time series link in the image display method of this embodiment. In FIG. 5, 510 to
Reference numeral 560 is an arrangement step showing the arrangement of the three-dimensional CG objects.

As shown in FIG. 5, in the process of arranging the three-dimensional CG objects in the image display method of this embodiment, starting from the arranging step 510 for specifying the position of the three-dimensional CG object obtained by combining the entry scenes, the arranging step 510 is performed. 3D C based on time series link from 520 through placement step 540
Place G objects.

If there is a three-dimensional CG object connected by a hyperlink among the three-dimensional CG objects arranged in time series,
A hyperlink sequence is created as in the placement step 550, and a three-dimensional CG object is placed based on the hyperlink as in the placement step 560.

In the image display method of this embodiment, a specific three-dimensional CG object is designated by the additional information input device 150 to create a hyperlink that is a logical connection. When the hyperlink is created, a three-dimensional CG based on the time-series links that have been displayed until then.
The placement position of the object is changed.

FIG. 6 is a flow chart showing a processing procedure for updating the arrangement position of the three-dimensional CG object based on the hyperlink in the image display method of this embodiment.

In the image display method of this embodiment, after the existence of the hyperlink is checked and the arrangement position of the three-dimensional CG object connected by the hyperlink is changed,
Another three-dimensional CG affected by the change of the arrangement position
The process of updating the arrangement position of the object is repeated at regular intervals.

In the image display method of this embodiment, a processing procedure for updating the arrangement position of the three-dimensional CG object arranged based on the time series link based on the hyperlink will be described below.

As shown in FIG. 6, in the processing of step 601, it is checked whether or not a hyperlink indicating a logical connection of three-dimensional CG objects exists.

If the hyperlink exists,
In the process of step 602, for all hyperlinks, hyperfunctions of a plurality of three-dimensional CG objects connected by the hyperlinks are calculated, and new placement positions are obtained by the steepest descent method.

In the processing of step 603, the three-dimensional CG object connected by the hyperlink is moved to the obtained arrangement position.

Next, in the processing of step 604, it is checked whether or not there is a three-dimensional CG object connected by a time series link from the above-mentioned moved three-dimensional CG object.

When there is a three-dimensional CG object connected by the time series link from the moved three-dimensional CG object, in the processing of step 605, when there are a plurality of three-dimensional CG objects connected by the time series link. A series function is calculated and a new location is obtained by the steepest descent method.

In the processing of step 606, the 3 positions connected by the time-series link to the above-mentioned obtained arrangement position.
Move the dimensional CG object.

Next, returning to the processing of step 604, another three-dimensional C linked by the time series link to the three-dimensional CG object moved to the above-mentioned obtained arrangement position.
Check if a G object exists.

As described above, the process of moving all the three-dimensional CG objects connected by the time-series links of the three-dimensional CG objects moved by the creation of the hyperlink is repeated at regular intervals.

The hyper function in the image display method of this embodiment will be described below.

The hyper function in the image display method of this embodiment is a function that defines a force virtually generated between a plurality of three-dimensional CG objects arranged in a three-dimensional virtual space and is connected by hyperlinks. A virtual attractive force acts between the two three-dimensional CG objects, and a virtual repulsive force acts between the two three-dimensional CG objects that are not connected by the hyperlink.

For example, in the image display method of this embodiment, as shown in FIG. 5, a hyperlink is created between the representative scene of the three-dimensional CG object b and the representative scene of the three-dimensional CG object a. , Between the hyperlinks

[0091]

[Equation 1]

The attractive force of is working. Where H (a,
b) is a three-dimensional CG connected by hyperlinks
The attractive force generated between the object a and the three-dimensional CG object b, r is the distance between the three-dimensional CG object a and the three-dimensional CG object b, and h is the two three-dimensional CG objects connected by hyperlinks. The ideal distances between, A and B, are constants.

When the hyperlink is not defined between the 3D CG object a and the 3D CG object b, the two 3D CG objects are:

[0094]

[Equation 2]

The repulsive force of works. Where G (a, b) is
C is a constant, which is a repulsive force generated between the three-dimensional CG object a and the three-dimensional CG object b which are not connected by the hyperlink.

Since the force by the hyper function is generated on all the three-dimensional CG objects in the three-dimensional virtual space, a potential which is a force field by the hyper function is generated in the three-dimensional virtual space. Therefore, each three-dimensional CG object in the three-dimensional virtual space is most stable at the arrangement position where the potential is the lowest.

Therefore, in the image display method of this embodiment, when a hyperlink is created in a specific three-dimensional CG object, the lowest coordinate of the potential state changed by the created hyperlink is the steepest descent method. The three-dimensional CG
It is the placement position of the object.

Here, the steepest descent method is one of methods for obtaining the minimum value of a certain function, and the coordinates are changed in small increments in the negative direction of the differential value of the certain function to determine the minimum value of the function. It is a method of seeking.

For example, as shown in FIG. 5, at the placement step 550 of the image display method of this embodiment, the three-dimensional CG object a and the three-dimensional CG object b connected by the hyperlink are the three-dimensional CG object a and the three-dimensional CG object a. Dimension CG
Although the three-dimensional CG object a moves in the arrangement position direction due to the attractive force acting between the three-dimensional CG object a and the three-dimensional CG object a, the repulsive force is generated from the three-dimensional CG objects around the three-dimensional CG object a. Finally, the 3D CG object a is received.
Are arranged in the vicinity of the arrangement position where the distance between and is r = h.

Three-dimensional C in which the hyperlink is created
As the G object moves, the arrangement positions of other three-dimensional CG objects connected by the time series link also change.

An attractive force by the following time series function is generated between the two three-dimensional CG objects connected by the time series link.

[0102]

(Equation 3)

Here, T (a, b) is a three-dimensional CG object a and a three-dimensional CG connected by a time series link.
The attractive force generated between the objects b, t is an ideal distance between two three-dimensional CG objects connected by a time series link.

The attractive force generated by the time series function is generated only between the two three-dimensional CG objects connected by the time series link, but since all the three-dimensional CG objects are affected by the hyper function,
The arrangement position of the three-dimensional CG objects connected by the time series link is also obtained using the steepest descent method.

With the movement of the three-dimensional CG object by the hyperlink, the three-dimensional CG object connected by the time series link is moved so that the potential generated by the hyper function and the time series function is minimized. Become. In addition, representative scenes that are temporally connected are spline-interpolated and arranged in smooth rows so that continuous scenes can be presented.

As shown in FIG. 5, in the placement step 560 of the image display method of this embodiment, the three-dimensional CG object b is finally placed at the position r = h.

FIG. 7 is a diagram showing a process in which hyperlinks are newly added to a plurality of 3D CG objects arranged in a 3D virtual space in the image display method of this embodiment. In FIG. 7, 710 to 750 are three-dimensional CG objects.

As shown in FIG. 7, in the image display method of this embodiment, the three-dimensional CG object 710, the three-dimensional CG object 720, and the three-dimensional CG object 71 are used.
The 0 and the three-dimensional CG object 730 are connected by a time series link, and the three-dimensional CG object 710 and the three-dimensional CG object 740 are connected by a hyperlink.

At this time, if the user creates a hyperlink to the 3D CG object 710 and the 3D CG object 750, the 3D CG objects 710 and 3
An attractive force acts between the three-dimensional CG object 750 and the three-dimensional CG object 750 and the three-dimensional CG object 7.
Between 20 and 3D CG object 750 and 3D C
Repulsive force acts between the G object 730 and between the three-dimensional CG object 750 and the three-dimensional CG object 740.

The coordinate that minimizes the value obtained by adding the attractive force or the repulsive force acting on the two three-dimensional CG objects is obtained by the steepest descent method.

That is, the differential of equation 1 is obtained.

[0112]

[Equation 4]

By differentiating equation 2,

[0114]

(Equation 5)

According to the above equation, r is updated, the coordinates of the three-dimensional CG object 750 are moved, and the coordinates at which the sum of the attractive force and the repulsive force is minimized are obtained.
The G object 750 is arranged.

In the image display method of this embodiment, the effective range of repulsive force acting between two three-dimensional CG objects is r
= 2h distance region. Due to the repulsive force acting on the area, the three-dimensional CG object 720, the three-dimensional CG object 730, the three-dimensional CG object 740, and the three-dimensional CG object 750 repel each other, and as shown in FIG. The arrangement position in the dimensional virtual space has changed.

FIG. 8 is a diagram showing an arrangement example of three-dimensional CG objects in the image display method of this embodiment.
In FIG. 8, reference numerals 810 to 830 are arrangements indicating the arrangement of a plurality of three-dimensional CG objects.

As shown in FIG. 8, in the arrangement of a plurality of three-dimensional CG objects by the image display method of the present embodiment, the arrangement 810 in which the three-dimensional CG objects are arranged based on the time series link, and the arrangement based on the hyperlink is three. There are an arrangement 820 in which three-dimensional CG objects are arranged, and an arrangement 830 in which three-dimensional CG objects are arranged based on a time series link and a hyperlink.

In the arrangement 810 in which the three-dimensional CG objects are arranged on the basis of the time-series link, a plurality of representative scenes are arranged in the direction in which the time elapses. And promotes understanding of the contents of the video.

Also, three-dimensional C based on hyperlinks
In the arrangement 820 in which the G objects are arranged, the logically related representative scenes are arranged at positions close to each other by the hyperlink, and therefore, when one representative scene is viewed, the representative scenes are related to the representative scene by peripheral vision. It is possible to see the information that has been given, and to see the scenery of the person's car or the neighborhood of the house around the representative scene where the person is standing.

In the arrangement 830 in which the three-dimensional CG objects are arranged based on the time series link and the hyperlink, the viewpoint position is changed by moving in the three-dimensional virtual space and the arrangement of the representative scene is viewed from a distance. It is possible to understand the structure of information, and the other two
It turns out that there is one related information.

As described above, according to the image display method of this embodiment, a plurality of three-dimensional CG objects obtained by combining the still images are arranged on the three-dimensional CG to visualize the relationship between a plurality of videos. The visual information space in which the plurality of three-dimensional CG objects are displayed can be visually recognized.

In addition, according to the image display method of this embodiment,
Since the plurality of three-dimensional CG objects are arranged close to each other based on the time series link and the hyperlink, it is possible to display images that are temporally and logically connected.

(3D CG Object Display Change Process) In the image display method of this embodiment, the process of changing the display of the 3D CG object by inputting the viewpoint position in the 3D virtual space will be described below. .

FIG. 9 is a diagram showing changes in the display of the three-dimensional CG object when the viewpoint position in the three-dimensional virtual space is changed in the image display method of this embodiment. Figure 9
In 901, 901 is a video sequence showing a sequence of three-dimensional CG objects in the center, 902 is a video sequence showing a sequence of three-dimensional CG objects on the left side, 903 is a video sequence showing a sequence of three-dimensional CG objects on the right side, and 910 to 980. Is a display of a three-dimensional CG object when the viewpoint position is changed.

As shown in FIG. 9, in the image display method of this embodiment, the user changes the viewpoint position in the three-dimensional virtual space by inputting the viewpoint position from the additional information input device 150, and the virtual position is changed. In addition, the display of the three-dimensional CG object is changed as if the user were freely strolling in the three-dimensional virtual space.

In the image display method of this embodiment, the input of the viewpoint position in the three-dimensional virtual space is performed by the additional information input device 15
It is performed by four buttons that are input to the four directions of up, down, left, and right provided for 0. If you keep pressing the up button, the viewpoint position goes to the back of the screen, and if you press the down button, the viewpoint position changes. If you return to this side and keep pressing the left and right buttons, the viewpoint position will move left and right.

As shown in FIG. 9, in the image display method of this embodiment, first, as in the display 910, the representative scene group is viewed from a distant viewpoint position. Next, the viewpoint position is moved to the central video sequence 901 as shown in the display 920, and then the viewpoint position is moved along a hyperlink to the left video sequence 902 as shown in the display 930 to display 940 and the display 940. Looking at the left video sequence 902, such as 950.

Then, as shown in the display 960, when passing between representative scenes of the left video sequence 902 and moving the viewpoint position to the central video sequence 901, the left video sequence 902 changes the viewpoint to the central video sequence 901. Moves behind the position and disappears from the display screen.

When the viewpoint position is further moved to the right video sequence 903 across the central video sequence 901, a part of the central video sequence 901 is moved to the rear of the viewpoint position as shown in the display 980. Disappeared,
The video sequence 903 on the right side is displayed large.

As described above, according to the image display method of this embodiment,
By freely moving in the three-dimensional virtual space, the video information can be viewed in a crosswise manner without depending on the hyperlink.

FIG. 10 is a diagram showing a representative screen displayed on the three-dimensional CG in the image display method of this embodiment.

As shown in FIG. 10, a virtual three-dimensional virtual space is displayed on the display of the GUI device 140 for implementing the image display method of this embodiment, and a plurality of three-dimensional CGs in which representative scenes are combined are displayed. Objects are arranged in the three-dimensional virtual space. The representative scenes lined up in series are made from images that are temporally continuous. In some places, hyperlinks are where representative scenes from different lines approach each other.

The user can move in the arbitrary direction in the three-dimensional virtual space in which the representative scene is arranged and view the video information.

As described above, according to the image display method of this embodiment, the image of an arbitrary 3D CG object on the 3D CG is emphasized by changing the viewpoint position in the 3D virtual space. Since it is displayed in, it is possible to select and display any video in the video information space in which a plurality of videos are displayed.

Although the present invention has been specifically described based on the above embodiment, the present invention is not limited to the above embodiment, and various modifications can be made without departing from the scope of the invention. Of course.

[0137]

The effects obtained by the typical ones of the inventions disclosed in the present application will be briefly described as follows.

That is, since a plurality of still images are displayed side by side along with related information associated with the still images based on temporal or logical connection, it is possible to improve the display efficiency of a plurality of videos and their additional information. Is.

Also, a plurality of three-dimensional Cs obtained by combining still images
Since the G object is arranged on the three-dimensional CG to visualize the relationship between the plurality of images, it is possible to visually grasp the image information space in which the plurality of three-dimensional CG objects are displayed.

Further, since a plurality of three-dimensional CG objects are arranged close to each other based on the time-series links and hyperlinks, it is possible to display videos that are temporally and logically connected.

By changing the viewpoint position in the three-dimensional virtual space, an arbitrary three-dimensional CG on the three-dimensional CG can be obtained.
Since the video of the object is displayed with emphasis, it is possible to select and display any video in the video information space in which a plurality of videos are displayed.

[Brief description of drawings]

FIG. 1 is a diagram showing a schematic configuration of an apparatus of an embodiment for carrying out an image display method of the present invention.

FIG. 2 is a diagram showing an outline of a process of synthesizing scene data into a three-dimensional CG object in the image display method of this embodiment.

FIG. 3 is a diagram showing an outline of a three-dimensional CG object in which scene data of the image display method of this embodiment is combined.

FIG. 4 is a flowchart showing a processing procedure for arranging a three-dimensional CG object obtained by combining scene data according to the image display method of the present embodiment based on a time series link.

FIG. 5 is a diagram showing a process of arranging a three-dimensional CG object based on a time series link of the image display method of the present embodiment.

FIG. 6 is a flowchart showing a processing procedure for updating a placement position of a three-dimensional CG object based on a hyperlink in the image display method of this embodiment.

FIG. 7 is a diagram showing a process of newly adding hyperlinks to a plurality of three-dimensional CG objects arranged in a three-dimensional virtual space in the image display method of the present embodiment.

FIG. 8 is a diagram showing an arrangement example of three-dimensional CG objects in the image display method of this embodiment.

FIG. 9 is a diagram showing a change in display of a three-dimensional CG object when the viewpoint position in the three-dimensional virtual space of the image display method of the present embodiment is changed.

FIG. 10 is a diagram showing a representative screen displayed on a three-dimensional CG in the image display method of this embodiment.

[Explanation of symbols]

100 ... CPU, 110 ... Video input device, 120 ... Memory, 121 ... Sampling unit, 122 ... Representative scene cutout unit, 123 ... Compositing unit, 130 ... External storage device, 13
1 ... Scene data, 140 ... Graphical user interface (GUI) device, 141 ... Arrangement part, 150 ...
Additional information input device, 210 ... Video scene, 220 ... Additional information, 230 ... Media information, 240 ... Three-dimensional CG object.

Claims (6)

[Claims] 1. A method of displaying an image on three-dimensional computer graphics, comprising extracting a plurality of still images from a plurality of moving images and extracting relational information associated with the plurality of still images. , Creating a time-series link indicating the temporal connection between the plurality of still images, creating a hyperlink indicating the logical connection between the plurality of still images, and a relationship associated with the plurality of still images Information, the time-series links, and the hyperlinks are accumulated, and the plurality of still images and related information associated with the still images are displayed on the three-dimensional computer graphics based on the time-series links and the hyperlinks. An image display method characterized by arranging and displaying. 2. The image according to claim 1, wherein the plurality of still images extracted from the plurality of moving images are a plurality of representative scenes representative of videos of respective scenes of the moving picture. Display method. 3. The time-series link is created by adding an identification code of another still image temporally connected to a predetermined still image among the plurality of still images to the data of the predetermined still image. The accumulation is performed, and the hyperlink is created by selecting an arbitrary still image with respect to a predetermined still image among the plurality of still images, and identifying code of the selected still image is the predetermined still image. The image display method according to claim 1 or 2, wherein the image display method is performed by accumulating the data in the data. 4. An image display method for displaying an image on three-dimensional computer graphics, comprising extracting a plurality of still images from a plurality of moving images and extracting relational information associated with the plurality of still images. , Creating a time-series link indicating temporal connection between the plurality of still images, creating a hyperlink indicating logical connection between the plurality of still images, and relating the plurality of still images to the relation associated with the still images. Information, the time-series link, and the hyperlink are accumulated, and the plurality of accumulated still images and related information associated with the still images are virtually generated in a computer.
3D computer graphics object which is a 3D object in a 3D virtual space, and a plurality of 3D computer graphics objects in which the still image and the relationship information are combined are accumulated at each time. Arranged in the three-dimensional virtual space based on a series link and each hyperlink, a group of three-dimensional computer graphics objects viewed from a predetermined viewpoint position in the three-dimensional virtual space is displayed, and a plurality of video images are displayed. An image display method characterized by visualizing the relationship between. 5. A plurality of three-dimensional computer graphics connected by the time-series links when the three-dimensional computer graphics objects are arranged in a three-dimensional virtual space virtually generated in a computer. When the objects are arranged, the three-dimensional computer graphics objects are arranged adjacent to each other, and when the plurality of three-dimensional computer graphics objects connected by the hyperlink are arranged, the three-dimensional computer graphics objects are arranged. The image display method according to claim 4, wherein the three-dimensional computer graphics objects are arranged close to each other up to a predetermined constant distance. 6. When displaying a three-dimensional computer graphics object group viewed from a predetermined viewpoint position in the three-dimensional virtual space, the viewpoint position is input and based on the input viewpoint position. The viewpoint position in the three-dimensional virtual space is changed, and the viewpoint 3 is viewed from the changed viewpoint position.
The image display method according to claim 4 or 5, wherein a three-dimensional computer graphics object group is displayed to visualize a relationship between a plurality of videos viewed from an arbitrary viewpoint position.