JP3149386B2 - Method and apparatus for generating and displaying hotlinks in a panoramic 3D scene - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention generally relates to an image processing system, and more particularly to an image processing system which enables a user to generate a panoramic three-dimensional image from data representing one scene by a large number of images and display the image on a screen. About the system.

[0002]

2. Description of the Related Art Conventional three-dimensional graphics applications and associated hardware render scenes composed of one or more one-dimensional objects. Normal,
The object is represented by a geometric basic shape, for example, a triangle. The object is represented by graphic data representing the position and color of the basic shape in the model coordinate system. The graphics device draws the scene to display objects of the scene that are viewable in a view window based on the viewpoint. The user can move through the scene by changing the position and orientation of the viewpoint reference (camera). In addition, the execution of the animation can be performed by navigating through a series of preselected viewpoint reference positions and orientations.

[0003] The drawing operation is a labor intensive process for a computer, and is usually performed by dedicated graphic hardware. While such systems are sophisticated, they are expensive because they require dedicated hardware allocated for that purpose.

In addition, in conventional three-dimensional graphic application systems, a user provides a three-dimensional model of the scene (ie, graphic data representing the position and color of the scene's geometric reference in the model coordinate system). . Such models may be generated by software used with peripherals (pen tablets, scanners, cameras, etc.). For example, French Da
Ussault allows the user to create a three-dimensional model of the scene using software sold under the trade name CATIA. However, such modeling software is expensive, and the labor costs required for modeling even relatively imperfect scenes can be high.

[0005] The high costs associated with conventional three-dimensional graphics systems have provided an alternative solution. This solution is effective. However, there is a limit in the ability to generate and visualize the generation of three-dimensional scenes suitable for use on a standard personal computer and without the need for dedicated graphics hardware. One example of such a solution is the trade name Qu
IcktimeVR software is Apple
Developed and sold by Computer. The Quicktime VR software is divided into two different packages. The first package is for sale to a content provider and is an authoring tool that allows the content provider to develop stereoscopic 3D images from multiple views of a scene. The second package is
It is a viewer distributed to consumers, and allows viewing of a three-dimensional image created by an authoring tool. For a more detailed description of the operation of the Quicktime VR system, see Chen, "Quickti.
meR VR-An Image-based Approach to Virtual Environment
ent Navigation ", SIGGRAPH 1995, Los Angeles, CA, p
See p. 29-38, and U.S. Patent No. 5,396,583 to Chen et al., assigned to Apple Computer.

The Quicktime VR system uses a cylindrical environment map to display a three-dimensional image of one scene (or a collection of multiple images). Different perspective views are drawn by mapping the cylindrical environment map to the desired viewing window. A hot link is an area of a panoramic scene associated with an action. For example, the hotlink action is
Load and display an environment map, or generate multimedia events such as audio or video clips.

[0007] The Quicktime VR system provides hotlinks that are embedded in panoramic scenes.
When the user moves the cursor to the area of the scene corresponding to the hot link, the shape of the cursor on the display changes, so that the user knows the position of the hot link.

[0008]

However, the above conventional methods have limitations. This is because the user has to move around in the panoramic scene to locate hotlinks embedded in the scene.
Therefore, there has been a demand for a more effective system for incorporating a hot link into a three-dimensional panoramic image.

[0009] Accordingly, the present invention has been made in view of the above circumstances, and has as its object to provide a method and apparatus for generating and displaying a hot link in a panoramic three-dimensional scene by improving interactive graphical feedback. And

[0010]

DISCLOSURE OF THE INVENTION The above-mentioned conventional problems and the problems related thereto are described in the panorama 3 according to the present invention.
A solution is provided by a method and apparatus for creating and displaying hotlinks in a dimensional scene. In a panoramic scene represented by a first environment map that includes a plurality of elements each associated with a color value representing the color of a corresponding element, a hotlink area in the scene may include a second element that includes a plurality of elements. Environment map. Elements of the second environment map correspond to elements of the first environment map based on the mapping function. Also, at least one element of the second environment map identifies an action to be performed when a user selects at least one of the first environment maps corresponding to at least one element of the second environment map. It is associated with the hot link data. Preferably, the hot link data associated with at least one element of the second environment map includes a color value associated with an element of the second environment map and at least one element of the first environment map. And an item of a table to be associated with the data for identifying an action to be executed when the user selects the data item.

[0011] The hotlink area defined by the second environment map is displayed by identifying at least one element of the second environment map and changing at least one color value of the second environment map. , Whereby a modified first environment map is generated. Then, the changed first environment map is drawn for display.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A method and apparatus for defining and displaying hot links in an environment map will be described below. The invention could be applied to any computer processing system, such as a personal computer, a workstation, a graphics adapter operating with a personal computer or a workstation. As shown in FIG. 1, a computer processing system as used in the present invention generally comprises a memory 01, at least one central processing unit (CPU).
101 and at least one user input device 107
(For example, a keyboard, a mouse, a joystick, a voice recognition device, or a handwriting recognition device). Also,
The computer processing system includes non-volatile memory, such as ROM, and / or other non-volatile storage 108, such as a fixed disk drive. This non-volatile storage device 108 is read into the memory 101,
It stores an operating system executed by the PU 103 and one or more application programs. In executing the operating system and the application programs, the CPU may use data stored in the nonvolatile storage device 108 and / or the memory 101.

Further, the computer processing system comprises:
A frame buffer 1 is provided between the PU 103 and a display device 104 such as a CRT display or an LCD display.
04. The frame buffer 104 contains pixel data for driving the display device 105. In some systems, a drawing device (not shown), also called a graphic accelerator,
And the frame buffer 104.

Further, the computer processing system may include:
A communication link 109 (eg, a network adapter, an RF link, or a modem) connected to the PU 103 may be provided. The CPU 103 can communicate with another computer system via the communication link 109 (for example, via the Internet). CPU 103 may receive an operating system portion, an application program portion, or a portion of data used by CPU 103 in executing the operating system and application programs.

It should be noted here that the application program executed by the CPU 103 can execute the following drawing method of the present invention.
Alternatively, a part or the whole of the drawing method described below may be incorporated in hardware that operates together with an application program executed by the CPU 103.

Hereinafter, an environment map and a hot link environment map for defining a range of a hot link area in the environment map will be described. The environment map described below is a cylindrical environment map. However, the present invention is not limited to this, and any environmental map, for example, US Pat.
The present invention may be applied to a spherical environment map or a polyhedron environment map disclosed in Japanese Patent No. 0 / 022,428. The entirety of this U.S. patent application is incorporated herein by reference.

The cylindrical environment map consists of a rectangular array of elements or pixels, each pixel having a narrow area defined by the starting point of the axis of the cylinder and a rectangular area on the circumference of the cylinder. Data representing a part of the three-dimensional scene including the pyramid is included.

Each pixel of the cylindrical environment map may be characterized by a column index and a column index. The column index corresponds to the azimuth associated with the cylinder axis and the cylinder origin, and the column index corresponds to the elevation associated with the cylinder axis and the cylinder origin. FIG. 2 shows the developed cylindrical environment map. The map has a horizontal axis corresponding to the column index / azimuth of the pixel, and a vertical axis corresponding to the column index / elevation of the pixel. The cylindrical environment map has a PanRow column and a PanCol column as shown. A complete panorama may have color values for azimuths in the range of 0 to 2 °, and a partial panorama may contain color values for azimuths of a subset of this range. The Mobus Panorama may include color values for azimuth angles in the range of 0-4 °. A more detailed description of a cylindrical map may be found in US patent application Ser. No. 60 / 023,143. The description of the entire U.S. patent application is incorporated herein by reference.

According to the present invention, the hot link area of the cylindrical environment map is defined by the hot link environment map, and the mapping function maps the pixels of the hot link environment map to the pixels of the cylindrical environment map. As shown in FIG. 3, preferably, the hot link environment map is a cylindrical environment map having an HRow column and an HCol column, and the HRow column is obtained by replacing the PanRow column of the cylindrical environment map with a scale factor SR.
And the HCol column is determined by dividing the PanCol column of the cylindrical environment map by the scale factor SC. That is, the number of columns and columns of the hot link environment map (HRow, HCol) is derived by reducing the number of columns and columns of the cylindrical environment map (PanRow).

In this embodiment, the pixels of the hotlink environment map can be represented by the formula H (i, j).
In this equation, i is a column index ranging from 0 to (HCol-1), and j is a column index ranging from 0 to (HRow-1). Also, the pixels of the cylindrical environment map can be represented by the formula P (x, y). In this equation, x is a column index ranging from 0 to (PanCol-1), and y is a column index ranging from 0 to (PanRow-1). In this case, each pixel in the hotlink environment map is one SRx of pixels in the cylindrical environment map.
Corresponds to SC block. This relationship can be expressed by the following equation. That is,

H (i, j) == P (x, y) P (x + 1, y) P (x + sc-1, y) P (x, y + 1) P (x + 1, y + 1) ・ ・ ・ P (x + sc-1, y + 1) ・ ・ ・ ・ ・ ・ ・ ・ ・ P (x, y + SR-1) P (x + 1, y + SR -1)... P (x + SC-1, y + SR-1) where x = SR * i and y = SC * i For example, a hot link environment map (HRow, HCo
l) The number of columns and columns is a cylindrical environment map (Pan
Row, PanCol), the number of rows and columns and a coefficient of 4
Is derived by shrinking. In this case, a mapping function for mapping pixels of the hot link environment map H (i, j) to 16 pixels of the cylindrical environment map can be expressed by the following equation. That is,

(Equation 2)

For each pixel of the hot link environment map, a data value for specifying whether the corresponding pixel of the cylindrical environment map is a hot link area is stored. Further, for each pixel of the hot link environment map, information indicating (or defining) a command or an action executed when the user selects a corresponding pixel of the hot link in the cylindrical environment map may be stored.

The stored data value for each pixel of the hotlink environment map, which specifies whether the corresponding pixel of the cylindrical environment map is a hotlink area, is represented by the red, green, or blue value of the pixel of the hotlink environment map. It may be coded. For example, the red value of each pixel may be used to determine whether the corresponding pixel in the cylindrical environment map is a hotlink area. In this case, the blue and green color values can be ignored. In addition, a null value is stored for pixels in the hotlink environment map that correspond to pixels in the hotlink environment map that are not part of the hotlink area. However, for pixels of the hotlink environment map that correspond to pixels of the cylindrical environment map that are not part of the hotlink region, values are preferably stored because they are within a predetermined range of color values. That is, if the red value is within a predetermined range of color values, the red value indicates that the associated pixel corresponds to a pixel of the cylindrical environment map that is part of the hotlink area.

For example, the red value range of the system may be from 0 to 255. In this case, a red value of 0 (absent) is stored for pixels of the hotlink environment map that correspond to pixels of the cylindrical environment map that are not part of the hotlink area. However, for the pixels of the hotlink environment map that correspond to the pixels of the cylindrical environment map that are part of the hotlink area, red values with a range of 1 to 250 are stored.

Further, each hotlink area is preferably colored to associate the hotlink area with an appropriate command / action to be executed when the user selects a corresponding pixel of the hotlink area in the cylindrical environment map. Corresponds to red values that fall within a predetermined range of values. In this case, a red value that is within a predetermined range of color values is assigned to a pixel in the hotlink environment map that identifies a given hotlink area in the cylindrical environment map. Furthermore, commands / commands corresponding to each hot link area
A table for identifying the action is stored. This table is indexed by the red value assigned to the hotlink area as shown in FIG. For example, the red value of 105 may correspond to data representing a hot link command DisplayPan. This command controls the system to display the panoramic cylindrical environment identified by the parameter PanID. In another example embodiment, the red value of 170 is the hotlink command Play
It may be one corresponding to data representing Audio. This command controls the system and sets the parameter Cl
Play the audio clip identified by ipID.

As mentioned above, the red value of a pixel may be used to identify a hot link area of a hot link environment map. However, the invention is not limited in this regard, and the red value of a pixel can be used to index a hot link area.

A mechanism for displaying the hot link area defined by the hot link environment by describing the hot link environment map defining the hot link area of the cylindrical environment map will be described with reference to FIG.
The start of the operation is step 501, where it is checked whether a user input command requesting that the display of the hotlink area be switched on (or off). User input commands are generally identified by I / O events (or messages). In step 501, if a user input command requesting that the display of the hotlink area be turned on (or off) is received, operation continues to step 503.

At step 503, a column index icol corresponding to one of the columns of the hot link environment map is selected. Preferably, the column index icol is from 0 to (HC
ol-1) is set to a continuous value in the range up to ol-1).

In step 505, for each column of the selected column icol of the hot link environment map,
The column index irow is selected. Preferably, the column index ir
ow is set to a continuous value in a range from 0 to (Hrow-1). Next, each pixel (irow, icol) of the hot link environment map is processed in step 505 as follows.

The data value corresponding to the pixel (irow, icol) is first checked to identify whether the data value indicates that the corresponding pixel of the cylindrical environment map is a hotlink area. If the red value of a pixel identifies whether the corresponding pixel of the cylindrical environment map is a hot link as described above, this means that the red value of the pixel is within a predetermined range of red values. It may be achieved by checking. If the corresponding pixel of the cylindrical environment map is not part of the hotlink area, step 505
Goes to the next pixel in the column.

However, if the corresponding pixel of the cylindrical environment map is part of the hotlink area, preferably the table is searched to determine if the red value corresponding to the pixel is stored as a valid entry in the table. To determine. This step verifies that the pixel corresponds to the hot link area. If no matching entry is found in the table, the process of step 505 proceeds to the next pixel in the column.

If a matching entry is found, the pixel of the cylindrical environment map that matches the pixel (irow, icol) is determined based on the mapping function. In addition, for each corresponding pixel of the cylindrical environment map, the color value of the pixel is modified to identify the pixel as part of the hot link area.

Preferably, the color values of the corresponding pixels in the hot link area of the cylindrical environment map are modified by reversible operations on the red, blue and / or green color values. For example, if a 24-bit true color value is stored for each pixel of the cylindrical environment map,
The red, blue and / or green components can also be determined as follows. That is,

## EQU3 ## new value = changed (2.56, old value + 128) In another example, if an 8-bit palette color pointer is stored for each pixel of the cylindrical environment map, the changed palette The color pointer can also be determined as follows: That is,

## EQU00004 ## The new pointer = change (256, old pointer + 128) The advantage of such an operation is that the change can be reversed by performing the operation twice. Therefore, after the user inputs a command to switch off the display of the hot link area, there is no need to search for the unchanged cylindrical environment map data or load it again.

In step 507, it is determined whether the last column of the hot link environment map has been processed. If it is determined that the processing has not been performed, the operation proceeds to step 50.
Return to 3 and select the next value of icol. If it is determined that the last column of the hot link environment map has been processed, the operation proceeds to the next step 509.

In step 509, after all columns and columns of the hotlink environment map have been processed, a modified cylindrical environment map is drawn for display purposes. Details of the drawing operation are disclosed in US patent application Ser. No. 60 / 023,143, which is hereby incorporated by reference in its entirety. As a result, if the user's input command is a command to switch on, the hot link area defined by the hot link environment map is displayed. However, if the user's input command is a switch off command, step 509 displays the unchanged cylindrical environment (ie, no hotlink area is displayed).

The outline of the above procedure is that the number of pixels in the hot link environment map is considerably smaller than the number of pixels in the cylindrical environment map, and most of the pixels in the hot link environment map are not associated with any action ( That is, it is advantageous in the case where most are cold.

Another procedure for displaying the hot link area defined by the hot link environment map will be described with reference to FIG. In step 601, the operation is started to check whether the user input command requires the display of the hot link area to be switched on (or off). User input commands are generally identified by I / O events (or messages).
If in step 601 the user input command receives a user input command requesting to turn on (or off) the display of the hotlink area, operation proceeds to step 603.

At step 603, a column index icol corresponding to one of the columns of the cylindrical environment map is selected. Preferably, the column index icol is set to consecutive values in the range from 0 to (PanCol-1).

In step 605, a column index is selected for each column of the selected column icol of the cylindrical environment map. Preferably, the column index irow is set to a continuous value in the range from 0 to (PanRow-1). Next, each pixel (i
row, icol) in step 605 as follows:
Is processed.

First, identify the pixel in the hotlink environment map that corresponds to the current pixel (irow, icol) in the cylindrical environment map. For example, the pixel of the hotlink environment map (jrow, jcol) corresponding to the current pixel (irow, icol) of the cylindrical environment map can be identified as follows. That is,

Jcol = icol / SC jrow = irow / SC where SC = PanRow / HRow, and represents the ratio between the number of columns in the cylindrical environment map and the number of columns in the hotlink environment map.

Second, the data value associated with the pixel (jrow, jcol) of the hotlink environment map is checked to determine whether the data value is the corresponding pixel of the cylindrical environment map is a hotlink area. If the red value of a pixel is the hot link area as described above for the corresponding pixel of the cylindrical environment map, the pixel is within a predetermined range of the red value. If the red value of the pixel does not indicate that the corresponding pixel of the cylindrical environment map is part of the hot link area as described above, the process of step 605 is performed for the next pixel in the column of the cylindrical environment map.

However, if the corresponding pixel in the cylindrical environment map is part of the hotlink area, preferably the table is searched and the red value associated with the pixel (jrow, jcol) is stored as a valid entry in the table. Judge whether or not. This step allows pixels (jro
w, jcol) correspond to the hot link area. If no matching entry is found in the table, processing at step 605 continues with the next pixel in the column of the cylindrical environment map.

If a matching item is found, the color value of the pixel (irow, icol) in the cylindrical environment map is changed to identify the pixel as part of the hot link area. Preferably, the color values of the pixels (irow, icol) in the hotlink area of the cylindrical environment map are changed by a reversible operation on the pixel red, blue, and / or green values. For example, if a 24-bit true color value is stored for each pixel of the cylindrical environment map, the modified values of the red, blue, and / or green components are determined as follows. Can be. That is,

## EQU6 ## new value = changed (256, old value + 126)

As another example, if an 8-bit palette
If a color pointer is stored for each pixel of the cylindrical environment map, the modified palette color pointer can be determined as follows. That is,

(7) new pointer = change (256, old pointer + 128)

An advantage of this operation is that the change can be reversed by repeating the operation twice. Thus, there is no need to retrieve (or reload) the unchanged cylindrical environment map data after a user input command to switch off the display of the hotlink area is received.

In step 607, it is determined whether or not the last column (PanCol-1) of the cylindrical environment map has been processed. If not, operation returns to step 603 to select the next value of icol. If the last column (pancol-1) of the cylindrical environment map is to be processed, operation proceeds to step 609.

In step 609, after processing of all columns and columns of the cylindrical environment map is completed, a modified cylindrical environment map is drawn for display. Details of the drawing method are described in US Patent Application No. 60 / 023,143. The entire disclosure of this specification is incorporated as a part of this specification. As a result, if the user's input command is a command to switch on, the hot link area defined by the hot link environment map is displayed. However, if the user's input command is a switch off command, step 509 displays the unchanged cylindrical environment (ie, no hotlink area is displayed).

Another procedure for displaying the hot link area defined by the hot link environment map will be described with reference to FIGS. 7 and 8. The operation starts in step 701, where it is checked whether a user input command requires the display of the hotlink area to be turned on (or off). User input commands are generally identified by I / O events (or messages). If at step 701 the user input command receives a user input command requesting to switch on (or off) the display of the hotlink area, operation proceeds to step 703.

At step 703, a column index icol corresponding to one of the columns of the cylindrical environment map is selected. Preferably, the column index icol is set to consecutive values in the range from 0 to (PanCol-1).

In step 705, the current column (ic
ol) corresponding to the column (j) of the hot link environment map
col). For example, the column (icol) of the hotlink environment map corresponding to the current column (icol) of the cylindrical environment map may be determined as follows. That is,

Jcol = icol / SC where SC = PanRow / HRow, and represents the ratio between the number of columns in the cylindrical environment map and the number of columns in the hotlink environment map.

In step 707, it is determined whether one of the following two conditions is satisfied. (A) The condition that the current column (icol) is the first column of the cylindrical environment map (for example, icol = 0). Alternatively, (b) the condition that the corresponding column (jcol) of the hot link environment map is different from the already identified column (jcolprev) of the hot link environment map (for example, jcol ≠ jcolprev, jcol in the formula)
prev = (icol-1) / SC).

If one of the above two conditions is satisfied, the operation proceeds to step 709, and if neither is satisfied, the operation proceeds to step 711 (FIG. 8).

In step 709, in the hot link,
Column index j corresponding to one of the columns of the hotlink environment map
row is selected. Preferably, the column index jcol is 0
Is set to a continuous value in the range from to (jrow, jcol). The data value associated with the pixel (jrow, jcol) in the hotlink environment map is checked to determine whether the data value indicates that the corresponding pixel in the cylindrical environment map is a hotlink area. When processing the column of the current column (jcol), the first column storing a data value indicating that the corresponding pixel of the cylindrical environment map is a hot link area is jrowl.
And the last column storing the data value indicating that the corresponding pixel of the cylindrical environment map is a hot link area is stored as jrow2. If there is no column in the current column (icol) of the hot link environment map that stores a data value indicating that the corresponding pixel of the cylindrical environment map is a hot link area, jrow
l and jrow2 are preferably each (Hrow-
1) and stored as 0 (or jrowl
> Any row consisting of numbers satisfying jrow2). After checking all columns of the current column (icol), the columns (irow1, irow2) of the cylindrical environment map corresponding to columns jrowl and jrow2 are identified. For example, the columns of the cylindrical environment map (irow1, irow2) can be identified as follows. That is,

[Equation 9] arrow1 = jrowl * SC arrow2 = jrow2 * SC

Thus, the operation of step 709 is completed,
The operation proceeds to step 711.

In step 711, the selected column (icol) of the cylindrical environment map is checked for hot pixels. However, the selected column (ico
l) (for example, from row = 0 to (panRow)
Instead of checking -1), the selected column (i
Consider the pixels corresponding to columns irow1 to irow2 of (col). This means that the column index irow
This may be achieved by setting successive values in the range from w1 to irow2. The pixels (irow, icol) of the cylindrical environment map are processed as follows.

First, it is determined whether or not irow1 is larger than irow2. As described below, this condition is based on the current column (jc
ol) is cold (ie, does not store a data value indicating that the corresponding pixel in the cylindrical environment map is a hotlink area). If irow2 is larger than irow1, the operation for the current column (icol) is completed, and the process proceeds to step 713, where the operation for processing the next column in the cylindrical environment map is performed.

However, if irow2 is not greater than irow1, the pixel (jrow, jcol) of the hotlink environment map corresponding to the current pixel (irow, icol) of the cylindrical environment map is identified. For example, the pixel (jrow, jcol) of the hotlink environment map corresponding to the current pixel (irow, icol) of the cylindrical environment map may be determined as follows. That is,

[Equation 10] jcol = icol / SC irow = irow / SC

The pixels (jr) of the hot link environment map
ow, jcol) to determine if the data value indicates that the corresponding pixel of the cylindrical environment map is a hotlink area. If the corresponding pixel of the cylindrical environment map is not part of the hotlink area, processing proceeds to the next pixel in the hotlink environment map column (jrow). However, if the corresponding pixel of the cylindrical environment map is not a part of the hot link area, the color value of the pixel (irow, icol) of the cylindrical environment map is changed to identify the pixel as a part of the hot link area. . Preferably, the color values of the pixels (irow, icol) in the hot link area of the cylindrical environment map are set to the red, blue,
And / or by a reversible operation on the green color values. For example, if a 24-bit true color value is stored for each pixel of the cylindrical environment map, the modified values of the red, blue, and / or green components are determined as follows. Can be. That is,

## EQU11 ## new value = changed (256, old value + 128)

As another example, if an 8-bit palette
If a color pointer is stored for each pixel of the cylindrical environment map, the modified palette color pointer can be determined as follows. That is,

## EQU12 ## new pointer = change (256, old pointer + 128)

The advantage of this operation is that the change can be reversed by repeating the operation twice. Therefore, after a user input command for switching off the display of the hot link area is received,
There is no need to search (or reload) data for the cylindrical environment map that has not changed.

The above range (irow = irow1 to ir
After processing all pixels in the current column (ico1) of ow2), the operation proceeds to step 713. In step 713, the last column (Pan
It is determined whether or not Col-1) has been processed. If not, operation returns to step 703 and i
Select the next value for col. If the last column (pancol-1) of the cylindrical environment map is processed,
Operation proceeds to step 715.

At step 715, after processing of all columns and columns of the cylindrical environment map is completed, a modified cylindrical environment map is rendered for display. Details of the drawing method are described in US Patent Application No. 60 / 023,143. The entire disclosure of this specification is incorporated as a part of this specification. As a result, if the user's input command is a command to switch on, the hot link area defined by the hot link environment map is displayed. However, if the user's input command is a command to switch off, step 715 displays the unchanged cylindrical environment (ie, no hotlink area is displayed).

The system preferably implements step 71 above.
In step 1, the following operation is used to determine whether the data value stored by the hot link environment map indicates that the corresponding pixel of the cylindrical environment map is a hot link area. As an example, consider the above case where the red value of a pixel identifies whether the corresponding pixel in the cylindrical environment map is a hotlink area or not. In this scenario,
The red value of the previous pixel (jrowl) and the link status bit associated with the previous pixel (jrowl, jcol) are stored. Previous pixel (jrowl, jco
The red value of l) is preferably initialized to zero. The link status bit when set to "1" indicates that the pixel in the cylindrical environment map corresponding to the previous pixel (jrowl, jcol) is not part of the hot link area. The current pixel of the hotlink environment (jrow, j
col) with the red value of the previous pixel (jrowl, jcol) in the hotlink environment map.

If the two values are equal, the link state bit of the previous pixel (jrowl, jcol) is read. If the link status bit is set to "1", it is determined that the pixel is a pixel of the cylindrical environment map corresponding to the current pixel (jrow, jcol).
However, if the link status bit is set to "0", it is determined that the pixel of the cylindrical environment map corresponding to the current pixel (jrowl, jcol) is not part of the hot link area. Further, processing proceeds to the next pixel of the current column (icol) of the hotlink environment map.

However, if the two red values are not equal, the table is searched and the pixel (jrow,
jcol) is stored as a valid entry in the table.

In this step, the pixel (jrow, j
col) corresponds to the hot link area. If no matching entry is found in the table, the red value of the previous pixel (jrowl, jcol) is set to the red value of the current pixel (jrowl, jcol), the link state is set to "0", and It is determined that the pixel of the cylindrical environment map corresponding to the current pixel (jrow, jcol) is not part of the hot link area. Thus, processing proceeds to the next pixel in the current column (icol) of the hotlink environment map. If a matching item is found, the red value of the previous pixel (jrowl, jcol) is set to the current pixel (jrow, jcol), the link status bit is set to "1", and the current Pixel (jro
It is determined that the pixel of the cylindrical environment map corresponding to (w, jcol) is a part of the hot link area. further,
Processing is performed using the current column (ico
Go to the next pixel in l).

It should be noted here that other data values (other than the red value of the pixel) may be stored in the hot link environment map to indicate that the corresponding pixel in the cylindrical environment map is a hot link area. That is.

As described above, the hot link environment map of the present invention provides a function of effectively displaying a large number of hot link areas in a panoramic scene (and switching such a display). Provides improved interactive feedback to users of the system.

In summary, the following matters are disclosed regarding the configuration of the present invention. (1) A method for defining a hotlink region in a panoramic scene, wherein the first method includes a plurality of elements representing the panoramic scene and each of which is associated with a color value representing a color of a corresponding element. Providing an environment map; and generating a second environment map including a plurality of elements corresponding to the elements of the first environment map based on a mapping function, further comprising: At least one element of the environment map is a hotlink identifying an action to be performed when a user selects at least one of the first environment maps corresponding to at least one element of the second environment map. A method for defining a hot link area, wherein the hot link area is associated with data. (2) The hot link area definition method according to (1), wherein each element of the second environment map corresponds to one or more of the first environment map. (3) The first environment map and the second environment map are cylindrical environment maps, and the elements of the first environment map and the elements of the second environment map include columns and columns. The hot link area defining method according to (1), wherein the hot link area is defined by a matrix. (4) The hot link area defining method according to (3), wherein the number of columns in the second environment map is a predetermined part of the first environment map. (5) The number of columns in the second environment map is
The hot link area defining method according to (3), wherein the hot link area defining method is a predetermined part of the environment map. (6) the hot link data associated with at least one element of the second environment map is
A color value associated with at least one element of the environment map; and the data identifying the color value and an action to be performed when a user selects at least one element of the first environment map. The hot link area defining method according to the above (1), further comprising an item of a table to be associated. (7) A program storage device readable by the device, which reliably embodies the data used by the device in executing the instruction program, wherein the data represents the panoramic scene and the color of the corresponding element A plurality of elements each associated with a color value representing
Providing an environment map, and generating a second environment map including a plurality of elements corresponding to the elements of the first environment map based on a mapping function, further comprising: At least one element of the environment map is a hot link identifying an action to be performed when a user selects at least one of the first environment maps corresponding to at least one element of the second environment map. -A program storage device characterized by being associated with data. (8) The method according to (7), wherein each element of the second environment map corresponds to one or more of the first environment map. (9) The first environment map and the second environment map are cylindrical environment maps, and the elements of the first environment map and the elements of the second environment map include columns and columns. The program storage method according to the above (7), wherein the program is partitioned into a matrix. (10) The program storage method according to (9), wherein the number of columns in the second environment map is a predetermined part of the first environment map. (11) The program storage method according to (9), wherein the number of columns of the second environment map is a predetermined part of the second environment map. (12) The hot link data associated with at least one element of the second environment map includes a color value associated with at least one element of the second environment map, and the color value. The program storage according to (7), further comprising: a table item to be associated with the data for identifying an action to be performed when a user selects at least one element of the first environment map. Method. (13) A method of displaying, in a hotlink area, a panoramic scene represented by a first environment map including a plurality of elements each associated with a color value representing a color of a corresponding element, the mapping function comprising: A plurality of elements corresponding to the elements of the first environment map, and at least one element is selected by a user based on at least one of the first environment maps corresponding to the at least one element Storing in a memory a second environment map associated with hotlink data identifying an action to be performed when storing the data; and storing at least one element of the second environment map. Changing the color value of the element of the first environment map corresponding to at least one element of the second environment map, A changing step of generating an environmental map, the hot link area display method characterized in that it comprises a drawing step of drawing the first environment map that is the change. (14) The hot link area display method according to (13), wherein the changing step is reversible. (15) The hot link area display method according to (14), wherein the changing step uses a MOD function. (16) The hot link area display method according to (14), wherein the identifying step, the changing step, and the drawing step are performed in response to a predetermined user input command. (17) The identification step includes a step of analyzing the hot link data associated with a plurality of elements of the second environment map.
The hot link area display method according to 3). (18) The hot link data associated with the at least one element of the second environment map includes a color value associated with the element of the second environment map. The hot link area display method according to the above (17). (19) The hot link data associated with the at least one element of the second environment map is executed when a user selects the at least one element of the first environment map. The hot link area display method according to (18), further including an item of a table for associating the color value with data for identifying an action. (20) Executed by an apparatus that performs a method of displaying a panoramic scene represented by a first environment map including a plurality of elements each corresponding to a color value representing a color of a corresponding element in a hotlink area in a hotlink area A program storage device readable by the device for reliably embodying a program of instructions to be executed, the method comprising: a plurality of elements corresponding to the elements of the first environment map based on a mapping function. And at least one element is associated with hotlink data identifying an action to be performed when a user selects at least one of the first environment maps corresponding to the at least one element. Storing the stored second environment map in a memory; and storing at least one element of the second environment map. And another storing step, said corresponding at least one element of said second environment map first
Changing the color values of the elements of the environment map to generate a changed first environment map; and drawing the changed first environment map. Program storage device. (21) The program storage device according to (20), wherein the changing step is reversible. (22) The program storage device according to (21), wherein the changing step uses a MOD function. (23) The program storage device according to (20), wherein the identifying step, the changing step, and the drawing step are executed in response to a predetermined user input command. (24) The identification step includes a step of analyzing the hot link data associated with a plurality of elements of the second environment map.
The program storage device according to 1). (25) The hot link data associated with the at least one element of the second environment map includes a color value associated with the element of the second environment map. The program storage device according to (24). (26) The hot link data associated with the at least one element of the second environment map is executed when a user selects the at least one element of the first environment map. The program storage device according to (25), further including an item of a table that associates the color value with data identifying an action.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a functional configuration of a computer processing system applied to a preferred embodiment of the present invention.

FIG. 2 is a schematic diagram for explaining a cylindrical environment map applied to the present invention.

FIG. 3 is a schematic diagram for explaining a hot link environment map applied to the present invention.

FIG. 4 is a table for explaining a table for storing data for associating a hot link and an action of a hot link environment map applied to the present invention;

5 is a flowchart illustrating an operation of displaying a hot link area of the cylindrical environment map of FIG. 2 based on the hot link environment map of FIG. 3 according to an embodiment of the present invention.

FIG. 6 is a flowchart illustrating an operation of displaying a hot link area of the cylindrical environment map of FIG. 2 based on the hot link environment map of FIG. 3 according to another embodiment of the present invention.

FIG. 7 shows a still further embodiment of the present invention.
4 is a flowchart for explaining an operation of displaying a hot link area of the cylindrical environment map of FIG. 2 based on the hot link environment map of FIG. 3;

FIG. 8 shows a still further embodiment of the present invention.
4 is a flowchart for explaining an operation of displaying a hot link area of the cylindrical environment map of FIG. 2 based on the hot link environment map of FIG. 3;

[Explanation of symbols]

 101 memory 103 CPU 104 frame buffer 105 display device 107 input device 108 static storage device 109 communication link

──────────────────────────────────────────────────の Continued on the front page (72) Inventor William Louis Luken United States 10598, Yorktown Heights Farm Walk Road, New York 2924 (72) Inventor J.P. Menon 10566, United States Peakskill Campus Road 55, New York 55 72) Inventor Benkt-Olav Schneider United States 10598, Yorktown Heights, New York Croton Heights Road 515 (56) References JP-A-63-163967 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , (DB name) G06T 11/00-17/50

Claims (17)

(57) [Claims] 1. A method for defining a hotlink area in a panoramic scene, comprising: a plurality of elements representing the panoramic scene and each associated with a color value representing a color of a corresponding element. Providing a first environment map; and generating a second environment map including a plurality of elements corresponding to the elements of the first environment map based on a mapping function, further comprising: The at least one element of the second environment map is a hot identification identifying an action to be performed when a user selects at least one of the first environment maps corresponding to the at least one element of the second environment map. Link·
Associated with the data, with corresponding to at least one element of said second environment map
The generated hot link data is associated with at least one element of the second environment map.
And at least one color value of the first environment map.
Knows what action is taken when a user selects an element.
Having the items of the table to be associated with the data to be separated
A hot link area defining method. 2. The method according to claim 1, wherein each element of the second environment map corresponds to one or more of the first environment map. 3. The first environment map and the second environment map are cylindrical environment maps, and the elements of the first environment map and the elements of the second environment map are columns and columns. The hot link area defining method according to claim 1, wherein the hot link area is defined by a matrix consisting of: 4. The hot link area definition method according to claim 3, wherein the number of columns of the second environment map is a predetermined part of the first environment map. 5. The hot link area defining method according to claim 3, wherein the number of columns of the second environment map is a predetermined part of the second environment map. 6. A program storage device readable by said apparatus to reliably embody data used by the apparatus in the execution of the instruction program, the data represents the panoramic scene, and corresponding elements Providing a first environment map that includes a plurality of elements each associated with a color value representing the color of the color of the color of the first environment map; Generating a second environment map, wherein at least one element of the second environment map corresponds to at least one element of the second environment map. A hotlink that identifies the action to be taken when the user selects at least one of
Associated with the data, with corresponding to at least one element of said second environment map
The generated hot link data is associated with at least one element of the second environment map.
And at least one color value of the first environment map.
Knows what action is taken when a user selects an element.
Having the items of the table to be associated with the data to be separated
A program storage device. 7. Each element of the second environment map corresponds to one or more of the first environment map.
A program storage device according to claim 6 . Wherein said first environment map and the second environment map is cylindrical environment map, the element and the element of said second environment map of the first environment map, the column and the column The program storage device according to claim 6 , wherein the program storage device is partitioned into a matrix consisting of: The number of 9. The column of said second environment map, characterized in that it is a predetermined portion of said first environment map 請
The program storage device according to claim 8 . 10. A number of columns of said second environment map,
The program storage device according to claim 8 , wherein the program storage device is a predetermined portion of the second environment map . 11. A method for displaying, in a hotlink area, a panoramic scene represented by a first environment map including a plurality of elements each associated with a color value representing a color of a corresponding element, A plurality of elements corresponding to the elements of the first environment map based on a mapping function, wherein at least one element includes at least one of the first environment maps corresponding to the at least one element; Storing in a memory a second environment map associated with the hotlink data identifying an action to be performed when the second environment map is selected; and identifying at least one element of the second environment map. Storing, changing a color value of the element of the first environment map corresponding to at least one element of the second environment map,
Includes a changing step of generating a modified first environment map has, and drawing step of drawing the first environment map that is the change, the identification step, a plurality of principal of the second environment map
Analyzing the hot link data associated with the element.
Corresponding to the at least one element of the second environment map.
The assigned hot link data is the second hot link data.
Including color values associated with said elements of the environment map
A hot link area display method characterized by the following. 12. The method of claim 11, wherein changing step, the hot link region display method according to claim 11, characterized in that it is reversible. 13. The step of identifying, the step of changing,
The method according to claim 12 , wherein the drawing step is performed in response to a predetermined user input command. 14. The hot link data associated with the at least one element of the second environment map is executed when a user selects the at least one element of the first environment map. 12. The hot link area display method according to claim 11 , further comprising an item of a table that associates the color value with data identifying the action. 15. An apparatus for performing a method of displaying a panoramic scene represented by a first environment map including a plurality of elements each associated with a color value representing a color of a corresponding element in a hotlink area. A program storage device readable by the device for reliably embodying a program of instructions to be executed by the device, the method comprising: a plurality of programs corresponding to the elements of the first environment map based on a mapping function. And at least one element corresponds to hotlink data identifying an action to be performed when a user selects at least one of the first environment maps corresponding to the at least one element. Storing the attached second environment map in a memory; and at least one of the second environment maps A storage step of identifying elements, by changing the color values of said elements of said first environment map corresponding to at least one element of said second environment map,
Possess a changing step of generating a modified first environment map has, and drawing step of drawing the first environment map that is the change, the changing step is a reversible, the identification step, A plurality of elements of the second environment map;
Analyzing the hot link data associated with the element.
Corresponding to the at least one element of the second environment map.
Response the hot TRINC data attached, the second
Including color values associated with said elements of the environment map
A program storage device. 16. The method according to claim 16, wherein the identifying step, the changing step,
16. The program storage device according to claim 15 , wherein said drawing step is executed in response to a predetermined user input command. 17. The hot link data associated with the at least one element of the second environment map is executed when a user selects the at least one element of the first environment map. 16. The program storage device according to claim 15 , further comprising an item of a table that associates the color value with data identifying the action.