KR19980018106A - Method and apparatus for generating and displaying a hot link in a panoramic three-dimensional view - Google Patents

Abstract

In a panoramic view represented by a first environment map including a plurality of elements each connected to a color value representing a color of a corresponding element, the hot link area of the landscape is defined by a second environment map including a plurality of elements do. The elements of the second environment map correspond to the elements of the first environment map according to the mapping function. At least one element of the second environment map is associated with the hot link data identifying an action to be performed as the user selects at least one element of the first environment map corresponding to the at least one element of the second environment map. Preferably, the hotlink data associated with at least one element of the second environment map includes data identifying the action to be performed as a result of selecting a color value associated with an element of the second environment map and at least one element of the first environment map, Lt; RTI ID = 0.0 > a < / RTI >

The hot link region defined by the second environment map identifies at least one element of the second environment map, modifies the color value of the element of the first environment map corresponding to at least one element of the second environment map, Lt; RTI ID = 0.0 > environment map. ≪ / RTI > The modified first environment map is then rendered for display.

Description

A method and apparatus for generating and displaying hot links in a panoramic three dimensional view.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing system, and more particularly, to an image processing system for creating and displaying a panoramic three-dimensional image to a user from data representing a plurality of views for one scene.

Conventional 3D graphics applications and connection hardware renders scenery made of one or more 3D objects. Typically, the subject is represented by a geometric primitive, for example a triangle. The subject is represented by graphic data representing the position and color of the primitives in the model coordinate system. The graphics system renders scenery so that the subject (s) of the scenery viewable in the viewing window according to the viewpoint. The user may navigate through the desired scenery by changing the location and orientation of the viewing criteria (camera). In addition, animation can be performed by finding a series of previously selected positions and orientations of the observation reference.

Rendering operations are computationally intensive and are typically performed by specialized graphics hardware. Such a system is still expensive because its performance is powerful but requires specialized hardware dedicated to this purpose.

In addition, in the conventional three-dimensional graphics system, the user must provide a three-dimensional model of the scenery (i.e., graphic data indicating the position and color of the geometric circle of the scenery in the model coordinate system). Such models can be made into software by connecting them with peripheral devices (pen tablets, scanners, cameras, etc.). For example, software sold under the name CATIA by the Daussault of France allows the user to establish a three-dimensional model of the scenery. However, such modeling software requires a lot of work even when modeling scenes that are expensive and relatively uncomplicated.

Because of the cost associated with conventional 3D graphics systems, there are other solutions that do not require dedicated graphics hardware and yet provide effective but still limited functionality in creating and displaying three-dimensional scenes suitable for use in standard personal computers . One such solution is software developed by Apple Computer, Inc. of Cupertino, Calif., And sold under the name Quicktime VR. QuickTime VIR software is divided into two different packages. The first package, which is sold to a content privider, is an authoring tool that allows a content provider to create a panoramic 3-D image from multiple views of a scene. The second package is a viewer that is distributed to the consumer and allows the consumer to view the panoramic 3-D images that are autonomous by the authoring tool. A more detailed description of the operation of the QuickTime VIR system is provided in U.S. Patent No. 5,396,538 issued to Chen et al. VR-An Image-based Approach to Virtual Environment Navigation, SIGGRAPH 1995, Los Angeles, CA, pp. 29-38.

The QuickTime VIR system uses a cylindrical environment map to represent a panoramic view (or set of images) of the scenery. A different perspective view is rendered by mapping the cylindrical environment map to the desired viewing window.

A hotlink is a region of a panoramic view connected to an action. For example, the action associated with the hotlink may be loading and displaying a second environment map, or may be a multimedia event, such as an audio clip or a video clip.

The QuickTime VIR system provides a hot link to be integrated into the panoramic view. The location of such a hot link can be made clear to the user by changing the shape of the cursor in the display window when the user moves the cursor to the area of the scenery connected to the hotlink. This method is limited in its use because it requires users to navigate through panoramic views to find scenic hot links.

Accordingly, there is a need in the art to provide a more efficient system for integrating hot links into three-dimensional panoramic images to provide enhanced levels of interactive graphical feedback.

The above-described conventional problems and related problems are solved by the principles of the present invention, which is a method and apparatus for generating and displaying hot links on a panoramic three-dimensional ground. In a panoramic view represented by a first environment map including a plurality of elements each connected to a color value representing a color of a corresponding element, the hot link area of the landscape is defined by a second environment map including a plurality of elements Where the elements of the second environment map correspond to the elements of the first environment map according to the mapping function. At least one element of the second environment map is coupled to the hot link data identifying an action to be performed as the user selects at least one element of the first environment map corresponding to the at least one element of the second environment map. Preferably, the hotlink data associated with at least one element of the second environment map is an entry in the table that links data identifying the action to be performed to the color value as the user selects at least one element of the first environment map in a table and a color value connected to an element of the second environment map.

The hot link region defined by the second environment map identifies at least one element of the second environment map and modifies the color value of the element of the first environment map corresponding to at least one element of the second environment map, Is created by creating a first environment map modified by the first environment map. The modified first environment map is then rendered for display.

1 is a functional block diagram of a computer processing system that may be used in accordance with a preferred embodiment of the present invention;

Figure 2 shows a cylindrical environment map.

3 shows a hotlink environment map of the present invention.

4 is a table for storing data linking an action and a hot link of a hot link environment map;

5 is a flow diagram illustrating an operation for displaying a hot-link region of the environment map of FIG. 2 based on the hot-link environment map of FIG. 3 according to the present invention;

Figure 6 is a flow diagram illustrating an operation to display a hot-link region of the environment map of Figure 2 based on the hot-link environment map of Figure 3 according to another embodiment of the present invention.

7A and 7B are flow charts illustrating an operation to display a hot-link region of the environment map of FIG. 2 based on the hot-link environment map of FIG. 3 according to another embodiment of the present invention;

Description of the Related Art [0002]

101: memory 103: central processing unit

104: frame buffer 105: display device

107: user input device 108: non-volatile storage device

109: Communication link

Hereinafter, a method and apparatus for specifying and displaying a hot link area in the environment map will be described. The present invention may be implemented on any computer processing system including, for example, a personal computer, a workstation, or a graphics adapter that works in conjunction with a personal computer or workstation. 1, a computer processing system that may be used with the present invention generally includes a memory 101, at least one central processing unit (CPU) 103 (only one shown), and at least one user input device (E.g., a keyboard, a mouse, a stick, a speech recognition system, or a handwriting recognition system). The computer processing system also includes other non-volatile storage 108, such as non-volatile memory, such as ROM, and / or fixed disk drives, which are loaded into memory 101 and connected to CPU 103 Lt; RTI ID = 0.0 > and / or < / RTI > Upon execution of the operating system and application program (s), the CPU may use the data stored in the non-volatile storage 108 and / or the memory 101. [

The computer processing system also includes a frame buffer 104 coupled between the CPU 103 and the display device 105, such as a CRT display or an LCD display. In some systems, a rendering device (not shown), also known as a graphics accelerator, may be coupled between the CPU 103 and the frame buffer 104.

The computer processing system also includes a communication link 109 (a network adapter, a radio frequency (RF) link, etc.) coupled to the CPU 103 to allow the CPU 103 to communicate with other computer processing systems via a communication link, Or a modem). The CPU 103 may receive a portion of the operating system, a portion of the application program (s), or a portion of the data used by the CPU 103 in executing the operating system and application program (s).

It goes without saying that the application program (s) executed by the CPU 103 can execute the rendering method of the present invention described below. In addition, some or all of the rendering methods described below can be implemented in hardware that works in conjunction with an application program executed by the CPU 103. [

Hereinafter, the hot link environment map for defining the hot link area in the environment map and the environment map will be described. The following environment map is a cylindrical environment map, but the present invention is not limited to this, and any environmental map, for example, described in U.S. Patent Application No. 60 / 022,428, which is hereby incorporated by reference in its entirety And can also be applied to a spherical environmental map or a multi-sided environment map.

The cylindrical environment map consists of a rectangular array of elements or pixels, where each pixel is a three-dimensional scene included in a narrow pyramid defined by the rectangular region on the surface of the cylinder and the origin of the cylindrical axis As shown in FIG.

Each pixel in the map of the cylindrical environment is defined by a column index and a row index, where the column index corresponds to the origin of the cylinder and the azimuth angle associated with the axis of the cylinder, and the row index corresponds to the origin of the cylinder and Corresponds to the elevation angle connected to the axis of the cylinder. Figure 2 shows an expanded cylindrical environment map in which the horizontal axis corresponds to the column index / azimuth of the pixel and the vertical axis to the row index / elevation of the pixel. The cylindrical environment map has PanRow row and PanCol columns as shown. Includes a color value for azimuths in the range of complete panoramas 0 to 2 pi, where the partial panorama includes a color value for the azimuth of the subset of this range. Mobius bus panorama contains color values for azimuths in the range of 0 to 4 [pi]. A more detailed description of the cylindrical environment map can be found in U. S. Patent Application Serial No. 60 / 023,143, which is hereby incorporated by reference in its entirety.

According to the present invention, the hot link area of the cylindrical environment map is defined by the hot link environment map, and the mapping function is to map the pixels of the hot link environment map to the pixels of the cylindrical environment map. As shown in FIG. 3, the hot link environment map is preferably a cylindrical environment map with HRow row and HCol columns, where HRow is determined by dividing the row number PanRow of the cylindrical environment map into a scale factor SR , And HCol is determined by dividing the number of columns PanCol in the cylindrical environment map by the reference magnification SC. That is, the number of rows and columns (HRow, HCol) in the hot link environment map is determined by reducing the number of rows and columns (PanRow, PanCol) of the cylindrical environment map to the number of rows and columns .

In this example, the pixels of the hot link environment map can be represented by the formula H (i, j), where i is a column index ranging from 0 to (HCol-1) Lt; / RTI > The pixels of the cylindrical environment map can be represented by the formula P (x, y), where x is a column index ranging from 0 to (PanCol-1) and y is a row index ranging from 0 to (PanRow-1). In this case, each pixel of the hot link environment map corresponds to a pixel of the SRxSC block in the cylindrical environment map. This relationship can be expressed as:

H (i, j) == P (x, y) P (x + 1, y) P (x + SC-1, y)

P (x, y + 1) P (x + 1, y + 1) P (x + SC-1, y + 1)

. ...

. ...

. ...

P (x, y + SR-1) P (x + 1, y + SR-1) P (x + SC-1, y + SR-1)

Where x = SR ^* i and y = SC ^* i.

For example, consider the case where the number of rows and columns (HRow, HCol) in the hotlink environment map is derived by reducing the ratio to 1/4 of the number of rows and columns (PanRow, PanCol) in the cylindrical environment map. In this case, the mapping function of mapping the pixel H (i, j) of the hot link environment map to the cylindrical environment map can be expressed as follows.

H (i, j) == P (4i, 4j) ... P (4i + 3, 4j)

...

...

...

P (4i, 4j + 3) ... P (4i + 3, 4j + 3)

For each pixel of the hot link environment map, a data value that identifies whether or not the corresponding pixel (s) of the cylindrical environment map has a hot link area is stored. Further, for each pixel of the hot link environment map, information for designating (or defining) a command or an action to be executed in accordance with the user selection of the corresponding pixel in the hot link area in the cylindrical environment map can be stored .

The data value stored for each pixel in the hotlink environment map that identifies whether the corresponding pixel (s) of the cylindrical environment map is a hotlink area is encoded by the red, green or blue value of the pixel in the hotlink environment map encode. For example, the red value of each pixel can be used to identify whether the corresponding pixel (s) of the cylindrical environment map is a hot link area. In this case, the blue and green values of the pixels of the hot link environment map can be ignored. In addition, a null red value is stored for the pixels of the hot link environment map corresponding to the pixels of the cylindrical environment map, not the hot link region portion. However, it is preferable that a red value within a predetermined color value range is stored for the pixels of the hot link environment map corresponding to the pixels of the cylindrical environment map which is the hot link region portion. That is, a red value within a predetermined color value range indicates that the connected pixel corresponds to the pixel of the cylindrical environment map which is the hot link region portion.

For example, the red value of the system ranges from 0 to 225. In this case, a null red value is stored for the pixels of the hot link environment map corresponding to the pixels of the cylindrical environment map, not the hot link region portion. However, a red value in the range of 1 to 255 is stored for the pixels of the hot link environment map corresponding to the pixels of the cylindrical environment map which is the hot link area portion.

Further, in order to connect the hot-link area with a proper command / action to be executed as the user selects the corresponding pixel of the hot-link area of the cylindrical environment map, each hot-link is connected to a red value within a predetermined color value range desirable. In this case, the pixels of the hot link environment map identifying a given hot link area of the cylindrical environment map are assigned a red value within a predetermined color value range. In addition, a table identifying the command / action connected to each hot-link area indexed by the red value assigned to the hot-link area as shown in Fig. 4 is stored. For example, the red value 105 may be associated with data representing a hotlink command DisplayPan that controls the system and displays a panoramic cylindrical environment labeled with the parameter PanID. In another example, the red value 175 may be associated with data representing a hotlink command PlayAudio that controls the system to play an audio clip labeled with the parameter ClipID.

As described above, the red value of the pixel can be used to identify the hot link area of the hot link environment map, but the present invention is not limited to this feature, and any other data value may be used as an index .

In the above description, the hot link environment map for defining the hot link area of the cylindrical environment map has been described, and the mechanism for displaying the hot link area defined by the hot link environment map will be described below with reference to FIG. The start of this operation is a step (501) of checking whether a user input command has been received requesting to toggle on (or off) the indication of the hot link area. The user input command is typically identified by an I / O event (or message). In step 501, a user input request to toggle on (or off) the indication of the hot link area has been received and continues to operation step 503.

At step 503, the column index icol corresponding to one of the columns of the hotlink environment map is selected. Preferably, the column index icol is set to a continuous value in the range from 0 to (HCol-1). Then, each pixel (jrow, jcol) of the hot link environment map is processed in step 505 as follows.

First, the data value connected to the pixel (jrow, jcol) is examined and it is checked whether the data value indicates whether the corresponding pixel of the cylindrical environment map is the hot link area. If the red value of the pixel identifies whether the corresponding pixel of the cylindrical environment map is the hot link area as described above, this is achieved by checking whether the red value of the pixel is within the predetermined red value range. If the corresponding pixel in the cylindrical environment map is not a hot-link region portion, then the processing in step 505 leads to the next pixel in the row.

However, if the corresponding pixel in the cylindrical environment map is a hot link region portion, it is desirable to darken the table and determine whether the red value associated with that pixel is stored as a valid entry in the table. This step ensures that the pixel corresponds to the hotlink area. If no matching entry is found in the table, the processing of step 505 consists of the next pixel of the row.

When a matching entry is found, the pixel of the cylindrical environment map corresponding to the pixel (jrow, jcol) is determined according to the mapping function. Further, for each of the corresponding pixels of the cylindrical environment map, the pixel value is modified to identify the pixel as a hot-link region portion.

Preferably, the color value of the corresponding pixel (s) in the hot link region of the cylindrical environment map is modified by a reverible operation on the red, blue and / or green values of the pixel. For example, if a color value of 24 bits is stored for each pixel of the cylindrical environment map, the correction value of the red, blue and / or green component can be determined as follows.

NewValue = Mod (256, OldValue + 128)

In another example, if an 8-bit palette color pointer is stored for each pixel of the cylindrical environment map, the modified palette color pointer can be determined as follows.

NewPointer = Mod (256, OldPointer + 128)

The effect of this action is that it can be reversed by performing the action twice. Thus, there is no need to search (or reload) the unmodified cylindrical environment map data after the user input command is received to toggle off the display of the hotlink area.

In step 507, it is determined whether the last column of the hotlink environment map has been processed. If not, the operation returns to step 503 and the next value of jcol is selected. If the last column of the hot link environment map has been processed, operation continues to step 509.

At step 509, after all columns and rows of the hotlink environment map have been processed, the modified cylindrical environment map is rendered for display. Rendering operations are described in detail in U.S. Patent Application No. 60 / 023,143, which is hereby incorporated by reference in its entirety. Thus, if the user input command is a toggle on command, the hot link area defined by the hot link environment map is displayed. However, if the user input command is a toggle off command, then in step 509 an indication of the unmodified cylindrical environment is made (i. E., The hot link area is not displayed)

The above process is performed when the number of pixels of the hot link environment map is much smaller than the number of pixels of the cylindrical environment map and when most pixels of the hot link environment map are not connected to any action (i.e., ), It is effective.

Hereinafter, another mechanism for displaying the hot link area defined by the hot link environment map will be described with reference to FIG. The start of operation is a step (601) of checking whether a user input command has been received requesting to toggle on (or off) the indication of the hotlink area. The user input command is typically identified by an I / O event (or message). At step 601, if a user input command has been received requesting to toggle on (or off) the indication of the hotlink area, operation continues to step 603.

In step 603, the column index icol corresponding to one of the columns of the cylindrical environment map is selected. Preferably, the column index icol is set to a continuous value in the range from 0 to (PanCol-1).

In step 605, for each row of the selected column icol of the cylindrical environment map, the row index irow is selected. Preferably, the row index irow is set to a continuous value in the range from 0 to (Panrow-1). Then, each pixel (jrow, jcol) of the cylindrical environment map is processed at step 605 as follows.

First, the pixels of the hot link environment map corresponding to the current pixel (jrow, jcol) of the cylindrical environment map are identified. For example, the pixel (jrow, jcol) of the hot link environment map corresponding to the current pixel (jrow, jcol) of the cylindrical environment map can be determined as follows.

jocl = icol / SC

jrow = irow / SR

Here, SC = PanCol / HCol, which represents the ratio of the number of columns in the cylindrical environment map to the number of columns in the hotlink environment map, SR = PanRow / HRow, Represents the ratio of the number of columns in the cylindrical environment map to the number of rows in the environment map.

Second, the data value associated with the pixel (jrow, jcol) in the hotlink environment map is examined to determine if the data value represents the hotlink region of the corresponding pixel in the cylindrical environment map. As described above, if the red value of the pixel is discriminated whether the corresponding pixel of the cylindrical environment map is the hot link area, this is achieved by checking whether or not the red value of the pixel is within the predetermined red value range. If the corresponding pixel (s) of the cylindrical environment map is not a hot link region portion, then the processing at step 605 consists of the next pixel of the cylinder of the cylindrical environment map.

However, if the corresponding pixel (s) of the cylindrical environment map is a hot link region portion, it is desirable to search the table to determine whether the red value associated with the pixel jrow, jcol is stored as a valid entry in the table . This step ensures that the pixel (jrow, jcol) corresponds to the hotlink region. If no matching entry is found in the table, the processing of step 605 leads to the next pixel of the curve of the cylindrical environment map.

If a matching entry is found, the color value of the pixel (jrow, jcol) in the cylindrical environment map is modified to identify the pixel as the hotlink region portion. Preferably, the color value of the pixel (jrow, jcol) in the hot link region of the cylindrical environment map is modified by the reversible operation on the red, blue and / or green values of the pixel. For example, if a true color value of 24 bits is stored for each pixel of the cylindrical environment map, the correction value of the red, blue and / or green component can be determined as follows.

NewValue = Mod (256, OldValue + 128)

In another example, if an 8-bit palette color pointer is stored for each pixel of the cylindrical environment map, the modified palette color pointer can be determined as follows.

NewPointer = Mod (256, OldPointer + 128)

The effect of this operation is that it can be reversed by executing this operation twice. Therefore, after receiving the user input command to toggle off the display of the hot link area, there is no need to search (or reload) the unmodified cylindrical environment map data.

In step 607, it is determined whether the last column (PanCol-1) of the cylindrical environment map has been processed. If not, the operation returns to step 603 and the next value of icol is selected. If the last column of the cylindrical environment map (PanCol-1) has been processed, operation continues to step 609. [

In step 609, after all the columns and rows of the cylindrical environment map have been processed, the modified cylindrical environment map is rendered for display. Rendering operations are described in detail in U.S. Patent Application No. 60 / 023,143, which is hereby incorporated by reference in its entirety. Thus, if the user input command is a toggle on command, the hot link area defined by the hot link environment map is displayed. However, if the user input command is a toggle off command, then in step 609 an indication of the unmodified cylindrical environment is made (i. E., The hot link area is not displayed).

Hereinafter, another mechanism for displaying the hot link area defined by the hot link environment map will be described with reference to FIG. The start of operation is a step 701 of checking whether a user input command has been received requesting to toggle on (or off) the indication of the hot link area. User input commands are typically identified by an I / O event (or message). At step 701, if a user input command requesting to toggle on (or off) the indication of the hotlink area is received, then operation proceeds to step 703.

In step 703, the column index icol corresponding to one of the columns of the cylindrical environment map is selected. Preferably, the column index icol is set to a continuous value in the range from 0 to (PanCol-1).

In step 705, the column jcol of the hotlink environment map corresponding to the current column icol is identified. For example, the column jcol of the hotlink environment map corresponding to the current column icol of the cylindrical environment map can be determined as follows.

jcol = icol / SC

Where SC = PanCol / HCol, which represents the ratio of the number of columns in the cylindrical environment map to the number of columns in the hotlink environment map.

In step 707, it is determined whether one of the following two conditions is met:

(a) the current column (icol) is the first column of the cylindrical environment map (for example, icol = 0); or

(b) the corresponding column (jcol) of the hotlink environment map is different from the previously identified column (jcolprev) of the hotlink environment map (e.g., jcol jcolprev, where jcolprev = (icol-1) / SC).

If one of the two conditions is met, operation continues to step 709; otherwise, operation continues to step 711.

At step 709, for each row of the selected column jcol in the hotlink environment map, the row index jrow is selected. Preferably, the row index jrow is set to a continuous value in the range from 0 to (Hrow-1). For each pixel (jrow, jcol) in the column (jcol) of the hot link environment map, the data value connected to the pixel (jrow, jcol) of the hot link environment map indicates that the corresponding pixel of the cylindrical environment map is the hot link area Value (as described in step 503). In the row processing of the current column jcol, the first row storing the data value indicating that the corresponding pixel (s) of the cylindrical environment map is the hot link region is saved as jrowl and the corresponding pixel ) The last row that stores the data value indicating this hot-link region is saved as jrow2. If there is no row in the current column (jcol) of the hot link environment map that stores the data value indicating that the corresponding pixel (s) of the cylindrical environment map is the hot link region, then jrow1 and jrow2 are the number of all pairs satisfying jrow1jrow2). After examining all the rows of the current column icol, the rows (irow1, irow2) of the cylindrical environment map corresponding to jrow1 and jrow2 are identified. For example, the rows (irow1, irow2) of the cylindrical environment map can be identified as follows.

irow1 = jrow1 * SR

irow2 = jrow2 * SR

Thereafter, the operation of the step 709 is completed and the operation proceeds to the step 711. [

In step 711, the selected column icol of the cylindrical environment map is checked against the hot pixel. However, instead of checking every row in the selected column icol (e.g., from irow = 0 to (panRow-1)), only pixels corresponding to rows irow1 through irow2 of the selected column icol are considered. This is achieved by setting the row index irow to a value in the range from irow1 to irow2. The pixels (irow, icol) of the cylindrical environment map are processed as follows.

First, it is determined whether or not irow1 is larger than irow2. As described above, this condition is such that the full row of pixels for the current column jcol in the hotlink environment map is cold (i.e., the data value indicating that the corresponding pixel (s) in the cylindrical environment map is the hotlink region) Is not stored). If irow2 is greater than irow1, the operation for the current column icol is terminated and operation proceeds to step 713 to process the next column of the cylindrical environment map.

However, if irow2 is not larger than irow1, the pixel (jrow, jcol) of the hot link environment map corresponding to the current pixel (irow, icol) of the cylindrical environment map is identified. For example, the pixel (jrow, jcol) of the hot link environment map corresponding to the current pixel (irow, icol) of the cylindrical environment map can be determined as follows.

jcol = icol / SC

jrow = irow / SR

Thereafter, the data value associated with the pixel (jrow, jcol) of the hotlink environment map is examined and it is determined whether the data value represents the hotlink region of the corresponding pixel (s) of the cylindrical environment map. If the corresponding pixel (s) of the cylindrical environment map is not the hot link region portion, then the next pixel of the jowl of the processing hot link environment map is reached. However, if the corresponding pixel (s) of the cylindrical environment map is the hot link region portion, the color value of the pixel (irow, icol) of the cylindrical environment map is modified such that the pixel is identified as the hot link region portion. Preferably, the color value of the pixel (irow, icol) in the hot link region of the cylindrical environment map is modified by the reversible operation on the red, blue and / or green values of the pixel. For example, if a true color value of 24 bits is stored for each pixel of the cylindrical environment map, the correction value of the red, blue and / or green component can be determined as follows.

NewValue = Mod (256, OldValue + 128)

In another example, if an 8-bit palette color pointer is stored for each pixel of the cylindrical environment map, then the modified palette color pointer can be determined as follows.

NewPointer = Mod (256, OldPointer + 128)

The effect of this action is that the action can be reversed by running the action twice. Therefore, after receiving the user input command to toggle off the display of the hot link area, there is no need to search (or reload) the unmodified cylindrical environment map data.

After all the pixels of the current column icol in the range (irow = irow1 to irow2), operation proceeds to step 713. [

In step 713, it is determined whether the last column (PanCol-1) of the cylindrical environment map has been processed. If not, the operation returns to step 703 to select the next value of icol. If the last column of the cylindrical environment map (PanCol-1) has been processed, then operation proceeds to step 715.

In step 715, after all columns and rows of the cylindrical environment map have been processed, the modified cylindrical environment map is rendered for display. Rendering operations are described in detail in U.S. Patent Application No. 60 / 023,143, which is incorporated herein by reference in its entirety, which is incorporated herein by reference. Thus, if the user input command is a toggle on command, the hot link area defined by the hot link environment map is displayed.

However, if the user input command is a toggle off command, then in step 715 an indication of the unmodified cylindrical environment is made (gain, hotlink area not shown).

The system preferably uses the following operation in step 711 to determine whether the data value stored by the hotlink environment map indicates that the corresponding pixel (s) of the cylindrical environment map is the hotlink area . For the purposes of illustration, consider the above case where the red value of a pixel identifies whether the corresponding pixel (s) of the cylindrical environment map is a hot link area. In this scenario, the red value of the previous pixel (jrow-1, jcol) and the link status bit connected to the previous pixel (jrow-1, jcol) are stored. It is preferable to initialize the red value of the previous pixel (jrow-1, jcol) to zero. When the link status bit is set to '1', it indicates that the pixel of the cylindrical environment map corresponding to the previous pixel (jrow-1, jcol) is the hot link area. When the link status bit is set to '0', it indicates that the pixel of the cylindrical environment map corresponding to the previous pixel (jrow-1, jcol) is not the hot link area portion. The red value of the current pixel (jrow, jcol) of the hot link environment map is compared with the red value of the previous pixel (jrow-1, jcol) of the hot link environment map.

If the two values are equal, the link status bits of the previous pixel jrow-1, jcol are read. When the link status bit is set to '1', the pixel (s) of the cylindrical environment map corresponding to the current pixel (jrow, jcol) is determined as the hot link area. However, if the link status bit is set to '0', it is determined that the pixel (s) of the cylindrical environment map corresponding to the current pixel (jrow, jcol) is not the hot link area portion. The process then proceeds to the next pixel of the current column (icol) of the hotlink environment map.

However, if the two red values are not equal, the table is searched to determine whether the red value associated with the pixel (jrow, jcol) is stored as a valid entry in the table. This step ensures that the pixel (jrow, jcol) corresponds to the hotlink region. If the matching entry is not found in the table, the red value of the previous pixel jrow-1, jcol is set to the red value of the current pixel jrow, jcol, the link status bit is set to 0, it is determined that the pixel (s) of the cylindrical environment map corresponding to the jrow, jcol, jrow, jcol is not the hot link region portion. The process then continues to the next pixel of the current column icol of the hotlink environment map. If a matching entry is found, the red value of the previous pixel jrow-1, jcol is determined to be the hot-link region portion of the cylindrical environment map pixel (s) corresponding to the current pixel jrow, jcol. The process then continues to the next pixel of the current column icol of the hotlink environment map.

It should be noted that other data values (other than the red values of the pixels) may be stored by the hotlink environment map to indicate that the corresponding pixel (s) of the cylindrical environment map is the hotlink area.

The hotlink environment map of the present invention has the effect of improving the interactive feedback provided to the system user by providing the function of effectively displaying (and reversing such display) a plurality of hotlink areas in a panoramic view.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (26)

A method for defining a hotlink region in a panoramic scene, Providing a first environment map representing the panoramic view, wherein the first environment map comprises a plurality of elements each associated with a color value representing a color of a corresponding element; And A second environment map comprising a plurality of elements, wherein elements of the second environment map correspond to elements of the first environment map according to a mapping function, and at least one element of the second environment map Associated with hot link data identifying an action to be performed as the user selects at least one element of the corresponding first environment map Lt; RTI ID = 0.0 > a < / RTI > 2. The method of claim 1, wherein each element of the second environment map corresponds to one or more elements of the first environment map. The method of claim 1, wherein the first and second environment maps are cylindrical environment maps, and the elements of the first and second environment maps are divided into a matrix of rows and columns, How to define the area. 4. The method of claim 3, wherein the number of rows of the second environment map is a predetermined fraction of the rows of the first environment map. 4. The method of claim 3, wherein the number of columns of the second environment map is a predetermined fraction of the columns of the first environment map. 2. The method of claim 1, wherein the hotlink data associated with at least one element of the second environment map A color value associated with at least one element of the second environment map; And An entry in a table linking the color value with data identifying the action to be performed as the user selects at least one element of the first environment map; Lt; / RTI > What is claimed is: 1. A program storage device readable by a machine tangibly embodying data used by a machine upon execution of the command program, A first environment map representing a panoramic view, wherein the first environment map comprises a plurality of elements each connected to a color value representing a color of a corresponding element; And A second environment map comprising a plurality of elements, wherein an element of the second environment map corresponds to an element of the first environment map according to a mapping function, and at least one element of the second environment map corresponds to Associated with data identifying an action to be performed as the user selects at least one element of the corresponding first environment map, / RTI > 8. The apparatus of claim 7, wherein each element of the second environment map corresponds to one or more elements of the first environment map. 8. The program storage device of claim 7, wherein the first and second environment maps are cylindrical environment maps and the elements of the first and second environment maps are partitioned into a matrix of rows and columns. 10. The apparatus of claim 9, wherein the number of rows in the second environment map is a predetermined fraction of rows in the first environment map. 10. The program storage device of claim 9, wherein the number of columns in the second environment map is a predetermined fraction of the columns in the first environment map. 8. The method of claim 7, wherein the hotlink data linked to at least one element of the second environment map A color value connected to at least one element of the second environment map; And An entry in the table linking the color value with data identifying the action to be performed as the user selects at least one element of the first environment map And the program storage device. A method for displaying a hot-link region in a panoramic view represented by a first environment map comprising a plurality of elements each connected to a color value representing a color of a corresponding element, A second environment map comprising a plurality of elements, wherein an element of the second environment map corresponds to an element of the first environment map according to a mapping function, and at least one element of the second environment map corresponds to Associated with hot link data identifying an action to be performed as the user selects at least one element of the corresponding first environment map; Identifying at least one element of the second environment map; Modifying a color value of an element of the first environment map corresponding to at least one element of the second environment map to generate a modified first environment map; And Rendering the modified first environment map; / RTI > The method of claim 1, 14. The method of claim 13, wherein the modifying step is reversible. 15. The method of claim 14, wherein the modifying comprises using an MOD function. 15. The method of claim 14, wherein the identifying, modifying, and rendering steps are performed in accordance with a predetermined user input command. 14. The method of claim 13, wherein the identifying comprises analyzing the hotlink data associated with a plurality of elements of the second environment map. 18. The method of claim 17, wherein the hotlink data linked to at least one element of the second environment map comprises a color value associated with an element of the second environment map. 19. The method of claim 18, wherein the hot link data linked to at least one element of the second environment map comprises data identifying the action to be performed as the user selects at least one element of the first environment map, Lt; RTI ID = 0.0 > a < / RTI > A method of displaying a hot link area in a panoramic view represented by a first environment map comprising a plurality of elements each associated with a color value representing a color of a corresponding element, tangibly, and machine readable program storage device, A second environment map comprising a plurality of elements, wherein an element of the second environment map corresponds to an element of the first environment map according to a mapping function, and at least one element of the second environment map corresponds to Associated with hot link data identifying an action to be performed as the user selects at least one element of the corresponding first environment map; Identifying at least one element of the second environment map; Modifying a color value of an element of the first environment map corresponding to at least one element of the second environment map to generate a modified first environment map; And Rendering the modified first environment map And the program storage device. 21. The program storage device of claim 20, wherein the modifying step is reversible. 22. The program storage device according to claim 21, wherein the modifying step uses the MOD function. 21. The program storage device of claim 20, wherein the identifying, modifying and rendering steps are performed according to a predetermined user input command. 22. The program storage device of claim 21, wherein the identifying comprises analyzing the hotlink data associated with a plurality of elements of the second environment map. 25. The program storage device of claim 24, wherein the hotlink data associated with at least one element of the second environment map comprises a color value associated with an element of the second environment map. 26. The method of claim 25, wherein the hot link data associated with at least one element of the second environment map comprises data identifying the action to be performed as the user selects at least one element of the first environment map, Lt; RTI ID = 0.0 > a < / RTI >