JP3295672B2 - Information processing device having operation history output function - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus having an operation history output function for verifying and confirming a previously defined operation history.

[0002]

2. Description of the Related Art As a method of displaying an operation history in computer graphics, a method of superimposing a locus as a line drawing on a map on a display screen and displaying it, a method of MACLIFE, N
o43, (March 1992) pp. 226-229 (MACLIFE, No4
3, MARCH, (1992), pp226-229), a method of expressing a history using a speed graph is known.

There is also a multi-sampling play function of a video deck. This method has a function of displaying a plurality of reduced child screens on a screen, and samples television or video playback images at regular time intervals and sequentially reduces and displays the images on the screen.

Further, as a system for displaying a plurality of time-series images on a display device, there is a technique described in JP-A-63-170778.

[0005]

However, in the above-described method of displaying a locus on a map, the locus is only displayed as a line drawing, so that the image of the visual field obtained from the operating viewpoint position is displayed on the screen. Can not be recognized from.

Further, the multi-sampling function of the VCR and the technique described in Japanese Patent Application Laid-Open No. 63-170778 can allow a user to recognize an image generated in the course of operation. Therefore, the sampled position of the image in the entire operation cannot be recognized at a glance.

SUMMARY OF THE INVENTION It is an object of the present invention to display not only a history of a predefined operation as a trajectory but also an image of a visual field at a viewpoint position of the operation, so that the user can recognize the operation history at a glance. An object of the present invention is to provide an information processing apparatus having an operation history output function capable of causing an operation history output function. Another object of the present invention is to provide an information processing apparatus having an operation history output function capable of restarting a simulation from a viewpoint position of the history image only by instructing the history image when combined with a simulation system.

[0008]

According to the present invention, there is provided an information processing apparatus having an operation history output function, comprising: an input device for receiving an external input; an output device for outputting a processing result; a processing device for processing information; An information processing apparatus comprising: a storage device that holds information; wherein the storage device is a shape holding unit that holds shape data, which is data of a shape of an object included in a visual field; Is,
An operation holding unit that holds motion data, a history image holding unit that holds history image data for expressing a visual field as an image, and a range in which a viewpoint moves within an arbitrary time as a whole view image And a panoramic image holding unit for storing panoramic image data. The processing device may further include: a history display unit that determines a viewpoint position for obtaining a history image to be output; a shape state determination unit that creates shape data at the viewpoint position determined by the history display unit; An image generation unit that creates history image data at the viewpoint position determined by the unit, a trajectory position determination unit that determines a trajectory of movement of the viewpoint based on the operation data, and a viewpoint determined by the trajectory position determination unit A line drawing unit that creates line drawing image data, which is image data for expressing the trajectory by a line, a panorama display viewpoint determination unit that determines the position of the viewpoint of the panorama image, and the panorama display viewpoint determination A panoramic image generating unit that generates panoramic image data, which is image data of a panoramic image at the viewpoint position determined by the unit, the history image data, the line drawing image data, and Synthesizing the panoramic image data, edit, and a screen control section which outputs to the output device.

[0009]

An information processing apparatus having an operation history output function according to the present invention moves in the past when image data of a visual field is collected while moving the viewpoint in a virtual or actual street. This is a device that displays the history that has been obtained by associating the image with the position or time of the viewpoint at which the image was obtained.

The information processing apparatus having the operation history output function according to the present invention is an overall image of the shape in which the operation has been performed (an image such as a street (202 in FIG. 3) capable of displaying the operation performed within a certain period of time). Hereinafter, the whole scene image is displayed), and the locus of the operation can be displayed on the whole scene image.
Further, a history image (an image of a visual field at a specific viewpoint position, such as 501 in FIG. 5) can be displayed.

[0011] The history image is displayed at regular time intervals when the operation greatly changes, or at an arbitrary viewpoint position on the locus specified by the user. Further, the sub screen beside the viewpoint position on the trajectory, can be correlated with the visual point position, etc. arrows, also this to collapse the history image. Also, a history image can be displayed at a fixed position on the screen.

Examples of applications using the present invention include, for example,
A driving guidance system such as a drive simulator, a sightseeing guide system, and the like are conceivable. In these systems, the shape handled is a real city building or the like. At this time, in addition to the method of generating the whole scene image and the history image by computer graphics, an actual landscape photograph or the like can be used as image data.
Further, the present invention may be applied to a system for verifying a building to be constructed or a product under design for design confirmation or the like. At this time, the shapes to be handled are buildings and product design data.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment using the present invention will be described below with reference to the drawings. First, the input data will be described. Here, data created by a simulation system that interactively moves around in a virtual cityscape created by computer graphics is used as an input, but an information processing apparatus having an operation history output function according to the present invention is used. Is not limited to this. A set of image data recorded over time can be used as input data of an information processing device having an operation history output function according to the present invention, and may be image data of a photographed image by a video recording device or the like.

FIG. 2 shows an example of an interactive screen of the simulation system when the input data of this embodiment is created. By selecting the direction indication display 201 displayed on the display screen 200 of the simulation system, the user can move forward and backward, turn right and left, and move around the street 202. Note that selection of the direction indication display 201 is performed using a cursor 203 or the like controlled by the input device of the simulation system.

The above simulation system is used for
02, the operation data according to the instruction of the soft key 201 from the user, and the image data of the screen at the arbitrarily specified time and viewpoint are output. here,
The motion data includes a moving time, a position, a direction, a speed, and the like at each time. The shape is, for example, the shape and color of a building,
It refers to the shape of things included in the field of view, such as the shape of a road.

Here, an example of the simulation system processing will be described. The simulation system includes, as shown in FIG.
91, a control device 198 for creating the data, a storage device 199 for holding the data, and a display device 197 for displaying processing results and the like.

The control unit 198 includes a moving image control unit 109
, A shape state determination unit 104, and an image generation unit 105. The storage device includes a shape holding unit 193 that holds shape data, and an operation holding unit 19 that stores operation data.
4 and a history image holding unit 195 for storing image data.

The moving image control unit 109 manages the relationship between the operation and the time, and outputs the shape and the operation at each time to the shape state determination unit 104. The shape state determination unit 104 calculates a state such as the positional relationship of each shape from the data. Specifically, from the motion information of each shape, where the coordinates of each shape are arranged is obtained by coordinate conversion or the like. The calculation result is generated as an image by the image generation unit 105. That is, the image generation unit 105 performs the projection process so that the shape state determined by the shape state determination unit 104 can be displayed on the screen. At this time, the screen control unit 196 determines which position on the screen the image is to be displayed, and the image is finally displayed on the display device 197. The screen control unit 196 manages coordinate conversion information for outputting the generated image to the screen, such as a display position and a scaling ratio.

As shown in FIG. 7, the moving image control unit 109 is a control unit that defines an operation in response to an instruction from a user received via the input device 191 of the simulation system. The moving image control unit 109 includes the input device 19
1 is received (step 701), and it is checked in step 702 whether the input is completed. When the input is completed, the moving image generation processing ends. If not, the operation is generated by input in step 703, and the generated operation is stored in the operation holding unit 194 in the storage device 199 of the simulation system in step 704.
Next, in step 705, the shape state determination unit 104 is requested to generate image data from the shape data read from the shape holding unit 193 and the operation information. The processes of steps 701 to 705 are repeated until the end is input.

Next, the processing of the shape state determining unit 104 will be described with reference to FIG. When the stored shape data passed from the moving image control unit 109 is defined by an independent coordinate system for each shape, the shape state determination unit 104 calculates the coordinate value of the shape by using the motion information. Converted,
Projection is performed on values in the world coordinate system (step 1101). After the projection, the image generation unit 105 requests the image generation unit 105 to generate an image viewed from the viewpoint (step 1102).

As shown in FIG. 11, the image generation unit 105 first converts the position of each shape into coordinates from the viewpoint determined by the operation control unit 109 in step 1201. In step 1202, a coloring process is performed on each shape to generate image data. At this time, if illumination information, surface attributes of the shape, and the like are given, image data is generated according to the information. Regarding the coloring image generation processing, a method generally performed in three-dimensional computer graphics may be used, and thus description thereof is omitted.
In step 1203, the screen control unit 196 is requested to display the generated image. In step 1204, the generated image data may be stored in the history image holding unit 195. The image control unit 196 controls the image generation unit 1
Display device 197 using the image data passed from
To display the image.

The above simulation system is
Although the system may be realized on a device different from the information processing device having the operation history output function of the present embodiment, software may be installed on the control device of the information processing device having the operation history output function of the present embodiment. It may be realized as.

FIG. 18 is a hardware configuration diagram of an information processing apparatus having an operation history output function according to the present embodiment, which receives data created by the simulation system as an input.
Shown in The information processing apparatus according to the present exemplary embodiment includes a storage device 1904 that stores information necessary for generating an image,
The image processing apparatus includes a processing device 1901 that generates an image from the information and processes an interactive operation, a display device 107 that is an output device that outputs a processing result, and an input device 1903 that receives an input from an operator. In this embodiment, the display device 107 is used as an output device, but another output device such as a printer may be used.

The storage device 1904 includes a shape holding unit 101 for holding the shape data, an operation holding unit 102 for holding the operation data, a history image holding unit 110 for holding the image data, and an image of the panoramic image. Data (hereafter,
It is called whole-view image data. ) Holding the whole view image holding unit 1
And 17. As the shape data, the operation data, and the image data, data created by a simulation system is stored in advance in each holding unit.

The information processing apparatus according to the present embodiment has a functional configuration as shown in FIG. The processing device 1901 includes an input processing unit 103 that processes an input from the input device 1903, a history display unit 108 that determines a viewpoint position to obtain a history image to be output, and a viewpoint position determined by the history display unit. Shape state determination unit 111 for creating shape data
An image generation unit 112 that creates history image data at the viewpoint position determined by the history display unit; a trajectory position determination unit 113 that determines a trajectory of movement of the viewpoint based on the operation data; A line drawing unit 114 that creates line drawing image data, which is image data for expressing the trajectory of the viewpoint determined by the unit 113 with lines, and a panoramic view viewpoint determining unit that determines the position of the viewpoint of the panoramic image. 115 and a panoramic image generating unit 116 that generates panoramic image data, which is image data of a panoramic image at the viewpoint position determined by the panoramic view viewpoint determining unit 115.
And a screen control unit 106 for synthesizing and editing the history image data, the line drawing image data, and the panoramic image data, and outputting the resultant to an output device. When the simulation system is implemented as software on the control device of the information processing apparatus of the present embodiment, the input processing unit 10
3 allows the processing to be divided into the above-described simulation system and the processing of the information processing apparatus according to the present embodiment in accordance with a user's instruction input from the input device 1903. FIG. 9 shows the processing of the input processing unit in such a case. An instruction from the input device 1903 is sent to step 1001
If it is an operation generation instruction, the operation display unit 1
08 (step 1002). If the instruction is a history display instruction, the control is passed to the moving image control unit 109 (step 10).
03). If the processing is to be terminated, the system is terminated.

The processing flow of the processing device 1902 is as follows. First, the input processing unit 103 includes the input device 1
Interpret the data entered by the user via 903,
Among them, an instruction regarding the history display control is issued to the history display unit 1.
Hand over to 08. The history display unit 108 first displays the storage device 19
From the shape holding unit 101 and the operation holding unit 102 in 04,
The shape data and the operation data are read.

The image data to be displayed is created by the following three methods.

(1) When displaying the full-view image, the history display unit 108 requests the display device 107 to determine the viewpoint position to the full-view display viewpoint determining unit 115. The whole-view display viewpoint determination unit 115 calculates the viewpoint position so as to place the viewpoint at a position where the whole image of the shape can be seen, and requests the whole-view image generation unit 116 to generate image data. At this time, the viewpoint is a position overlooking the city, that is, a position above the city.

FIG. 1 shows the processing of the whole-view display viewpoint determining unit 115.
It is shown in FIG. First, in step 1601, a position at which the entire shape can be seen is determined. For example, if a planar object such as a street map is the target, the position looking down from above is set as the viewpoint position. Further, when an object having a three-dimensional arrangement such as a building interior is a target, a position that looks down from a slant is set as a viewpoint position. Then, in step 1602, the image generation unit 116 is requested to generate an image. If the whole scene image has already been stored in the whole scene image holding unit 117, the processing of steps 1601 and 1602 can be omitted.

The panoramic image generating unit 116 uses the image data of the requested viewpoint if the panoramic image storing unit 117 in the storage device 1904 has already stored the image data. The image data of the image that can be seen over the row 202 is created, and the data is stored in the whole-view image holding unit 11.
7 and passed to the screen control unit 106.

Image generator 11 for generating whole-view image data
6 is shown in FIG. First, the panoramic image holding unit 117
It is checked whether or not the entire view image data is stored (step 1701). If there is, the whole view image data is read from the full view image holding unit 117 (step 1702), and the screen control unit 106 is requested to display an image. (Step 1706). If there is no whole-view image data, in step 1703, the position of each shape is converted to coordinates from the viewpoint. In step 1704, a coloring process is performed on each shape to generate image data. At this time, if lighting information, a surface attribute of the shape, and the like are given, image data is generated according to the information. Regarding the coloring image generation processing, a method generally performed in three-dimensional computer graphics may be used. Further, the generated image data is stored in the panoramic image holding unit 117 (step 17).
05). Thereafter, in step 1706, the screen control unit 106 is requested to display the whole scene image.

(2) When displaying the trajectory of the operation on the whole scenery image, the history display unit 108 stores the storage device 1904.
The operation data stored in the operation storage unit 102 is read, and the trajectory position determination unit 113 is requested to determine the viewpoint passing position. The trajectory position determination unit 113 obtains the coordinates of the point at which the viewpoint has passed, and passes the coordinates to the line drawing unit 114.

FIG. 1 shows the flow of the process performed by the locus position determining unit 113.
3 is shown. First, the viewpoint position is read from the operation holding unit 102 via the history display unit 108 at predetermined time intervals or at predetermined moving distances (step 1401). Next, a request is made to the line drawing unit 114 to connect the viewpoint positions with a straight line or a curve (step 1402).

The line drawing section 114 creates image data by connecting the passing points with a straight line or an interpolated curve, and transfers it to the screen control section (step 1501 in FIG. 14).

(3) When displaying a history image, the history display unit 108 determines a viewpoint position at which the history image is to be displayed, and passes it to the shape state determination unit 111. In addition, the viewpoint position is, according to the user's instruction, during the operation of moving the viewpoint, the viewpoint position at every elapse of a certain time, the viewpoint position at the time of moving a certain distance, the time at which the direction or speed of the operation changes. , The viewpoint position at the time designated by the user, and the like.
These viewpoint positions are obtained by the history display unit 108 integrating the movement distance of the viewpoint and the change in the line-of-sight direction based on the operation data held by the operation holding unit 102. The shape state determination unit 111 calculates the state of an object included in the visual field, such as the positional relationship between the shapes at the designated viewpoint position, and passes the calculated state to the image generation unit 112.

The shape state determining unit 111 performs the same processing as the above-described shape state determining unit 104 of the simulation system for creating input data of the operation history editing apparatus of the present embodiment. That is, as shown in FIG. 10, when the stored shape is defined by a coordinate system independent of each shape, the shape state determining unit 111 determines the coordinate value of the shape in step 1101 based on the motion information. Performs coordinate transformation and projects to values in the world coordinate system. After the projection, the image viewed from the viewpoint is requested to the image generation units 105 and 112 in step 1102 to display a history image. Note that the shape state determining unit 1
In step 11, if a history image is held in the history image holding unit 110, control is passed to the image generation unit 112 without performing the projection process.

If the history image at the designated viewpoint position is stored in the history image holding unit 110 in the storage device 1904, the image generation unit 112 uses the history image. The image data of the history image is created based on the data of (1) and is passed to the screen control unit 106. The image generation unit 112 also determines the position on the display screen where the history image is displayed. For example, as shown in FIG. 4, when displaying a history image as a child screen near the position where the obtained viewpoint of the history screen exists on the display screen, the image generation unit 112 Near, for example, at the upper right position, the position at which the history image is displayed and the enlargement / reduction ratio are determined so as not to overlap with the other reduced screens and trajectories, and to be transferred to the screen control unit 106.

FIG. 12 shows the flow of the process of the image generation unit 112. The image generation unit 112 checks whether an image is stored in the history image holding unit 110 (step 1301).
If there is, the history image from the designated viewpoint position is read from the history image holding unit 110 (step 1302), and the screen control unit 106 is requested to display the image on the screen (step 1305). If there is no history image of the viewpoint position, the position of each shape is converted into coordinates from the viewpoint (step 1303). Further, step 1304
Performs an attaching process on each shape to generate image data. At this time, if illumination information, surface attributes of the shape, and the like are given, image data is generated according to the information. In step 1305, the generated image data is requested to be displayed on the screen.

Next, an example of display processing by the screen control unit 106 will be described. The screen control unit 106 is configured as shown in FIG.
As shown in (1), image data and arrangement information for designating where to display the image data on the screen of the display device 107 are received (step 1801). Since the history image at the time of history display is displayed as a sub-screen on the whole scene image, an enlargement / reduction ratio is also specified. Based on the received data, the screen control unit 106 performs coordinate conversion for output, and displays the coordinates on the screen of the display device 107 (step 1802). The processing in step 1802 is performed as follows depending on the display mode.

First, FIG. 3 shows an example of the display of only the trajectory. When performing such display, the screen control unit 106
Using the image data created by the above method (1), coordinate conversion for output is performed and displayed on the screen 107a of the display device 107. Then, the screen control unit 10
Reference numeral 6 denotes a street 20 on the screen 107a as a trajectory 301 using the image data created by the method (2).
2 is superimposed and displayed.

Next, in addition to the trajectory, a plurality of history images
FIG. 4 shows an example of display in which the image is displayed beside the display of the position of the viewpoint from which the image was collected. In the case of performing such display, the screen control unit 106 firstly sets the street 20 in the same manner as described above.
2 and the trajectory 301 are displayed. Next, the screen 107a is displayed on the screen 107a using the image data created by the method (3).
The image data is reduced, and the child screens 401, 402, 403
And so on. At this time, a line, an arrow 404, or the like can be displayed in order to associate the child screen with the viewpoint position on the trajectory where the image was obtained.

As another history display method, FIG. 5 shows an example of a display in the case where a history image is displayed when the user designates an arbitrary position on the trajectory. Also in the case of performing such display, the screen control unit 106 first displays the street 202 and the trajectory 301 on the screen 107a by the methods (1) and (2) described above. Next, the screen control unit 106
Indicates that the history display unit 108 inputs a user instruction to the input device 190
3 and displays the history image at the determined viewpoint position on the child screen 501 by the method (3). The user specifies the viewpoint position of the history image displayed on the child screen 501 by using the cursor 203 linked with the input device 1903. That is, the history display unit 108 obtains a point on the trajectory 301 closest to the point designated by the cursor 203 and notifies the shape state determination unit 111 as a viewpoint position. When the user moves the cursor 203, the history display unit 108 notifies the shape state determination unit 111 of a point on the locus closest to the point indicated by the moved cursor 203 as a viewpoint position for each movement. As a result, the history image in the child screen 501 is changed with the movement of the cursor. In addition, the history image in the child screen 501 can be a moving image showing a change in the visual field due to the movement of the viewpoint position due to the operation performed for a certain period of time from the designated viewpoint position. In this case, the distance between the viewpoint positions on the trajectory may be extremely short, or the image may be a moving image by a computer graphics technique.

FIG. 6 shows an example of a display of only a history image as another history display. When such a display is performed, the screen control unit 106 arranges the child screens 601, 602, and 603 horizontally or vertically according to the time of the operation by the method (3) described above, and As with the screen, an image at the viewpoint position determined according to designated conditions, such as at regular intervals, is displayed. In this case, when the user designates an arbitrary child screen using the cursor 203 or the like, the passing time at the viewpoint position of the history image displayed on the child screen may be displayed.

Here, the flow of processing of the history display unit 108 will be described with reference to FIG. First, when history display is requested by the input processing unit 108, the history display unit 108 performs processing according to the type of display screen (step 900).
When a look is displayed on a trajectory, a full view display and a trajectory display are performed by the methods (1) and (2) (step 901).
That is, display of a panoramic image and trajectory display of a moving object so that a moving object can be seen can be performed by the panoramic-viewpoint determining unit 1.
15 and the trajectory position determination unit 113 to be executed.

Next, when both the trajectory and the history screen are to be displayed, the whole view display and the trajectory display are performed (step 901) as in step 901, and the process merges with the processing when only the history screen is displayed. Next, the history display unit 108 receives an instruction regarding the viewpoint position from the user (step 903), and in the case of an end instruction, ends the processing. If it is not the end instruction, the viewpoint position is determined based on the given instruction, and the shape state determination unit is requested to generate the history image data (step 905). As a result, the history image
It will be displayed as a child screen. Step 90 above
By repeating the processes from 3 to 905, a plurality of history images can be displayed.

The history display can be speeded up as follows. In other words, when image data is stored in the history image holding unit 110 in advance, the image data is associated with the generation time and the viewpoint position of the image data. In this way, the history display unit 108, at the time when the history display is requested, converts the image data stored in the history image holding unit 110 without passing through the shape state determination unit 112 and the image generation unit 112. It can be passed to the screen control unit 106. For this reason,
Processing for generating image data can be omitted, and history display can be performed at high speed.

When the above-described simulation system for creating data to be input to the information processing apparatus of the present embodiment is realized as software on the control device of the information processing apparatus of the present embodiment, When the user sets the child screen (401, 402, 403, 501, 601, 60
2, 603) can be restarted from the viewpoint position where the history image displayed on the child screen is created. That is, it is possible to move around the virtual street again from the state where the image is obtained simply by specifying the image at the viewpoint position to be re-executed. This function can be realized as follows. First,
The history display device 108 detects a sub-screen including a position on the screen designated by the user, which is input via the input processing unit, determines which sub-screen is selected, and displays the selected sub-screen. Obtain the viewpoint position of the obtained history image. Thereafter, the history display device 108 sets the moving image control unit 109 of the simulation system to the state of the viewpoint position. As a result, the history image is displayed on the display screen, and an interactive screen as shown in FIG. 2 is obtained, and the operation definition by the simulation system can be performed again.

[0048]

According to the present invention, since a history of a predefined operation can be displayed not only as a trajectory but also with an image of a visual field at a viewpoint position of the operation, the user can display the history of the operation. It can be recognized at a glance. Also, in combination with the simulation system, the simulation can be restarted from the viewpoint position of the history image only by instructing the history image.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing functions of one embodiment of the present invention.

FIG. 2 is an example of an interactive screen for creating data to be input to one embodiment of the present invention.

FIG. 3 is a history display example in one embodiment of the present invention.

FIG. 4 is a history display example according to one embodiment of the present invention.

FIG. 5 is a history display example according to an embodiment of the present invention.

FIG. 6 is a history display example according to an embodiment of the present invention.

FIG. 7 is a flowchart of processing of a moving image control unit.

FIG. 8 is a flowchart of processing of a history display unit.

FIG. 9 is a flowchart of processing of an input processing unit.

FIG. 10 is a flowchart of a process performed by a shape state determination unit.

FIG. 11 is a flowchart of processing of an image generation unit 105;

FIG. 12 is a flowchart of processing of an image generation unit 112;

FIG. 13 is a flowchart of a process performed by a trajectory position determination unit.

FIG. 14 is a flowchart of processing of a line drawing unit.

FIG. 15 is a flowchart of a process performed by the whole-view display viewpoint unit;

FIG. 16 is a flowchart of processing of an image generation unit.

FIG. 17 is a flowchart of processing of a screen control unit.

FIG. 18 is a hardware configuration diagram of the present embodiment.

FIG. 19 is an explanatory diagram of an example of a simulation system that creates data to be input to the device of the present embodiment.

[Explanation of symbols]

1903: input device, 101: shape holding unit, 102: operation holding unit 117: whole view image holding unit, 103: input processing unit, 104: shape state determination unit of the simulation system, 105: image generation unit of the simulation system,
106: screen control unit, 107: image display device, 108:
History display unit, 109: animation control unit of the simulation system, 110: history image holding unit, 111: shape state determination unit, 112: image generation unit, 113: locus position determination unit, 114: line drawing unit, 115: whole view Display viewpoint determination unit, 116: whole view image generation unit, 203: cursor, 30
1 ... locus, 401, 402, 403, 501, 601,
602, 603: child screen.

──────────────────────────────────────────────────続 き Continuation of front page (72) Inventor Yoshifumi Fukuda 7-1-1, Omika-cho, Hitachi City, Ibaraki Prefecture Within Hitachi Research Laboratory, Hitachi, Ltd. (56) References JP-A-62-212776 (JP, A) JP-A-61-95386 (JP, A) JP-A-4-233578 (JP, A) JP-A-4-273281 (JP, A) JP-A-5-27661 (JP, A) JP, U) (58) Fields investigated (Int. Cl. ⁷ , DB name) G06T 11/60 300 G06T 1/00

Claims (9)

(57) [Claims] 1. An information processing apparatus comprising: an input device for receiving an input of input data from outside, an output device for outputting a processing result, a processing device for processing information, and a storage device for holding information. The storage device stores in advance a shape holding unit that holds shape data, which is data on the shape of an object that can be included in the field of view, and motion data, which is data regarding movement of the viewpoint .
Oh and operation holding portion for holding because the history image data for representing a field of view as an image
And a history image holding unit for beforehand holds, the operation data includes the position and orientation information for every time, the processor, the input data a viewpoint position for obtaining the history image to be output
A history display section for determining in accordance with the data, the shape state determination unit that creates the shape data at the viewpoint position determined by the history display unit, history image data at the viewpoint position determined by the history display section is already above Stored in the history image storage
Then, the history image data is read from the history image holding unit.
Means, and the viewpoint position determined by the history display unit
The history image data at the location is stored in the history image storage
If not, it is generated by the shape state determination unit.
Means for generating historical image data based on the
And obtain image generation unit, at an arbitrary viewpoint position on the locus of the viewpoint indicated by the operation data, historical image data obtained by the image generating unit
The history image based on, and having a means for displaying the child screen that is part of the display image <br/> surface having the above-described output apparatus, an information processing apparatus having an operating history output function. 2. The history display unit according to claim 1, wherein the position of a viewpoint for displaying a history image is determined by:
During the operation of moving the viewpoint, the position of the viewpoint has changed over a predetermined constant time, the position at which the direction of the viewpoint has changed over a predetermined constant value, or the moving speed has changed over a predetermined constant value. An information processing apparatus having an operation history output function, wherein the operation history output function is at least one of a position, a position designated externally via an input device, and a position on a trajectory at a predetermined distance. 3. The storage device according to claim 1, wherein the storage device stores a range in which the viewpoint moves within an arbitrary time.
To represent as including panoramic images, the panoramic image holding unit for holding the panoramic image data, further comprising, the controller viewpoint of disposed overview overlooking position of the shape of the range
A panoramic view viewpoint determining unit that calculates and determines a viewpoint position such that the panoramic view image data is panoramic image data that is image data of the panoramic image at the viewpoint position determined by the panoramic view viewpoint determining unit. synthesis and generating unit, the historical image data, and the panoramic image data
An information processing apparatus having an operation history output function, further comprising: a screen control unit that outputs the data to an output device. 4. The tracing device according to claim 3, wherein the control device determines a trajectory of the movement of the viewpoint based on the operation data, and a trajectory of the viewpoint determined by the trajectory position determining unit. A line drawing unit that creates line drawing image data, which is image data to be represented by a line, wherein the screen control unit further synthesizes the line drawing image data
Characterized in that it has a function that the information processing apparatus having an operating history output function. 5. A trajectory of a viewpoint is displayed on a whole view image, and a history image at an arbitrary viewpoint position on the trajectory is associated with the viewpoint position by a symbol near the viewpoint position on the trajectory. An information processing apparatus having an operation history output function, wherein the information is displayed in a displayed child screen. 6. The processing device according to claim 1, wherein said processing device manages a relationship between operation and time, and executes a simulation.
Is specified, the visual information determined according to the input data
Creates shape data and motion information at each time based on the point position.
Form, a video controller for sequentially output to the shape condition determining unit, characterized in that it comprises further, an information processing apparatus having an operating history output function. 7. The method of claim 1, receiving the designation of said child screen, against to the history image displayed on the specified child screen
And outputting the passage time of the viewpoint position that, the information processing apparatus having an operating history output function. 8. The history display section is instructed by a user.
Was to detect the sub-screen, it obtains a resultant viewpoint position of the displayed history image on the sub-screen, characterized by having a means for setting a viewpoint position determined the viewpoint position in the video control unit, An information processing apparatus having the operation history output function according to claim 6. 9. The input data includes video image data recorded by a video recording device, and the history image data held by the history image holding unit is:
2. The information processing apparatus having an operation history output function according to claim 1, wherein the information is the video image data.