US20060077212A1 - Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display - Google Patents
Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display Download PDFInfo
- Publication number
- US20060077212A1 US20060077212A1 US11/236,488 US23648805A US2006077212A1 US 20060077212 A1 US20060077212 A1 US 20060077212A1 US 23648805 A US23648805 A US 23648805A US 2006077212 A1 US2006077212 A1 US 2006077212A1
- Authority
- US
- United States
- Prior art keywords
- widget
- volumetric
- display
- user
- recited
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/50—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
Definitions
- the present invention is directed to providing graphical user interface widgets or interface elements that are viewable from different viewpoints in a volumetric display and, more particularly, to a system where a widget is produced that can be viewed and operated from multiple viewpoints.
- volumetric displays A class of three-dimensional (3D) displays, called volumetric displays, is currently undergoing rapid advancement.
- the types of displays in this class include holographic displays, swept volume displays and static volume displays.
- Volumetric displays allow for 3D graphical scenes to be displayed within a true 3D volume.
- Such displays can take many shapes, globes, domes, cubes, etc. with a dome being a typical shape. Because the technology of these displays is undergoing rapid development those of skill in the art are concentrating on the engineering of the display itself. As a result, the man-machine interface to or the ways in which people interface with these types of displays is receiving scant attention.
- volumetric displays allow a user to view different parts of a true 3D scene
- the act of viewing the different parts typically requires that the user physically move around (or over) the display or that the display be moved or rotated in front of the user.
- graphical user interface elements sometimes called widgets may also move relative to the user. This is a particular problem when the widget is a two dimensional interface, such as a virtual keyboard, or a display/view of a two dimensional document, such as a list or spreadsheet.
- What is needed is a system that will provide user interface elements that are viewable and operable from whatever viewpoint a user takes around a volumetric display.
- a system that provides a volumetric widget that can be viewed and interacted with from any location around a volumetric display.
- a widget can be provided by duplicating the widget for each user, by providing a widget with multiple viewing surfaces or faces, by rotating the widget and by orienting a widget toward a location of the user.
- FIG. 1 depicts a volumetric display.
- FIG. 2 shows a user viewpoint moving with respect to a planar user interface (UI) element (top view).
- UI user interface
- FIG. 3 depicts the hardware of the present invention.
- FIG. 4 shows view ranges of widget faces of a volumetric widget arranged to allow any location to view the widget.
- FIGS. 5A-5D depict omni-directional volumetric widgets.
- FIG. 6 shows a volumetric display with an array of user location detectors.
- FIGS. 7A-7C show a volumetric widget with faces corresponding to and oriented toward user locations.
- FIG. 8 is a flowchart of operations that prevent the faces of a volumetric widget from occluding each other.
- FIGS. 9A-9C depict a sequence of face movements to eliminate facial occlusion.
- FIG. 10 shows clustering viewpoints.
- FIGS. 11A-11C shows back and forth rotation of a volumetric widget.
- FIG. 12 depicts selection operations for a rotating widget.
- FIG. 13 shows a volumetric widget having a rotating part and a stationary control part.
- Volumetric displays allow a user to have a true three-dimensional view of a scene 12 and are typically provided in the form of a dome 14 , as depicted in FIG. 1 .
- the user 16 as can be surmised from FIG. 1 , can move about the dome 14 to view different parts of the scene 12 .
- a planar UI widget 36 within the volumetric display 38 relatively turns such that it is no longer viewable by the user as depicted in the top view of FIG. 2 .
- the solutions include the production and display of a volumetric graphic user interface element or widget or omni-viewable widget.
- a volumetric widget or omni-viewable widget is one that can be viewed and interacted with from any user location or viewpoint around a volumetric display.
- One solution that provides a volumetric widget is to replicate a planar widget several times around the volumetric display so that the user will always have a readable view of the contents of the widget. This solution can result in a cluttered display.
- Another solution is to provide a multifaceted widget where a face of the widget is always readable by the viewer. This can result in a widget that takes up a greater volume of the display.
- a further solution is to provide a widget that rotates to facilitate viewing from any viewpoint.
- a further solution is to track a position of the user and orient the widget to face the user's location. This solution requires tracking technology.
- An additional solution is to combine two or more of the solutions discussed above. Each of these solutions provides a volumetric or omni-viewable widget and will be discussed in more detail below.
- the present invention is typically embodied in a system as depicted in FIG. 3 where physical interface elements 50 , such as a rotary dome position encoder, infrared user position detectors, a keyboard, etc. are coupled to a computer 52 .
- the computer 52 uses a graphical creation process, such as the animation package MAYA available from Silicon Graphics, Inc., to create a three-dimensional (3D) scene including virtual interface elements, such as the volumetric widgets discussed herein, and move them about in the scene automatically or based on some user control input.
- the display output, including the scene and widgets, is provided to a conventional volumetric display apparatus 54 , such as one that will produce a 3D holographic display
- a display 70 can include a volumetric widget that comprises multiple duplicate copies 72 , 74 , 76 , 78 , 80 and 82 of a virtual interface element, such as a graphical slider or icon toolbox.
- a virtual interface element such as a graphical slider or icon toolbox.
- Each of the elements 72 - 82 has a viewing angle range with, for example, element 80 having a range 84 and element 82 having a range 86 .
- the elements are arranged or positioned in such a way that from any point around the display 70 a user is within the acceptable viewing angle range of one of the elements. This can be accomplished by providing a sufficient number of elements or by arranging the elements more or less deeply within the display such that the ranges of the adjacent elements overlap at or near the surface of the display 70 .
- the ranges 84 and 86 overlapping at the surface of the display 70 .
- the ranges of adjacent elements need not overlap at the surface of the display 70 but can overlap at a predetermined distance from the surface responsive to an expected distance of typical user viewpoints from the surface.
- Omni-viewable widgets can be created by forming widgets with multiple faces or multiple surfaces as depicted in FIGS. 5A-5D .
- the faces are typically exact duplicates showing the same information in the same way.
- FIG. 5A depicts a cubical widget 100 with six faces and each face containing a duplicate of the contents to be displayed by the widget.
- FIG. 5B depicts an octagonal solid widget 102 with 8 faces and each face displaying the same contents.
- FIG. 5C depicts a tent type widget 104 with two faces, each facing the opposite direction and each displaying the same contents. This type of widget can also be rotated back and forth, as indicated by the arrows, to allow the viewing range of the two displays to intersect all user viewpoint positions.
- FIG. 5D depicts a globular or ball shaped widget 106 with identical faces arranged one the surface of the globe. Other shapes of multiple face widgets are possible such as pyramidal and cylindrical. Note that each face does not have to be an exact duplicate; a face may be specialized for a particular viewpoint. For example, if a widget is a direction widget (showing the compass directions), each face is not a literal duplicate as in this case, each face shows the directions appropriate to their viewpoint.
- each user can be provided with a position indicator as part of an input device, such as that provided by a conventional 3D input glove.
- Input devices located around the display can also be used by the users to register their locations or viewpoints.
- a camera and an object detection system could also be used.
- Another alternative, as depicted in FIG. 6 is to provide an array of conventional infrared detectors 120 arranged in a circumferential band below or at the bottom of a volumetric display enclosure 122 . In this approach those detectors that are active indicate the presence of a user.
- a conventional interface between the computer 52 see FIG. 3
- the detectors allows the computer to conventionally detect the number and positions of users positioned around the display 122 .
- Another variation is to use audio microphones to detect the position of users based on from where the sound is coming.
- the computer can create a omni-viewable widget that includes an interface element for each user, as depicted in FIGS. 7A-7C .
- FIGS. 7A-7C When the number and positions of users are known, the computer can create a omni-viewable widget that includes an interface element for each user, as depicted in FIGS. 7A-7C .
- the system detects two users A and B on opposite sides of the display enclosure 140 , as depicted in FIG. 7A , two widgets elements 142 and 144 are created and positioned (as shown by the dashed lines) to face the users.
- FIG. 7B shows two users A and B in different positions than in FIG. 7A and widget elements 146 and 148 positioned to face these different positions.
- FIG. 7C shows three users A, B and C and three corresponding user-facing widget elements 150 , 152 and 154 .
- the system may need to prevent the widgets from overlapping each other and thereby obscuring display contents in the overlapped areas. This is discussed
- the system determines 170 (see FIG. 8 ) the number of users and their positions or viewpoints using a position determination system such as previously discussed. For each viewpoint an identical widget element is created and oriented 172 in an orientation that is tangential to the surface of the display enclosure at the position of the corresponding viewpoint around the circumference of the display enclosure and perpendicular to the normal at that point. Next, the centroid of the oriented widget elements is determined 174 . Widget elements that have surfaces that overlap or intersect are incrementally moved 176 away from the centroid radially along the normal until no intersections exist. The sequence of FIGS. 9A-9C show these operations in more detail.
- a widget with three widget elements 190 , 192 and 194 is created in the center of the display 196 for three user viewpoints 198 , 200 and 202 .
- the widgets are moved along their respective normals 206 , 208 and 210 until widget 192 no longer intersects with widget 194 , as shown in FIG. 9B .
- widget 194 stops moving.
- widgets 190 and 192 still intersect.
- widgets 190 and 192 are moved along their respective normals 206 , 208 and 210 until they no longer intersect as shown in FIG. 9C .
- Other placement algorithms may be used to achieve a similar non-overlapping result.
- viewpoints are grouped into viewpoint clusters and create a display for each of the clusters. This is depicted in FIG. 10 where five user viewpoints V 1 -V 5 are shown.
- the system measures the angles between the viewpoints and compares this to the view range of the particular widget element being created. If the angle is less than the range, the viewpoints can be included within the same cluster. For example, the angle between viewpoints VI and V 2 and between viewpoints V 2 and V 5 is greater than the viewing range of the widget element being used. The angle between V 3 and V 4 is also too great.
- the angle between V 2 and V 3 and between V 4 and V 5 is less than the range and these viewpoints can be grouped into two clusters CI and C 2 while VI is allocated to its own cluster C 3 .
- the average of the positions or angles of the viewpoints in each cluster is used to determine the angular positions WI, W 2 and W 3 of the widget elements.
- FIGS. 11A-11C it is also possible to continuously rotate the widgets.
- the rotation can be a revolution through 360 degrees or the rotation can rock back and forth through a fixed number of degrees to favor certain viewpoints.
- the rocking is depicted in FIGS. 11A-11C .
- a widget 220 in the display enclosure 224 is rotated back and forth between the viewpoints of users A and B.
- FIG. 11A the widget 220 is oriented to user A
- FIG. 11B the widget is oriented between users A and B
- FIG. 11C the widget is oriented toward user B.
- This rotation between view points is performed by determining the user view points and redrawing the widget in sequential and incremental angular positions between the view points.
- the rotation in either mode can “jump ahead” resulting in certain viewpoints being ignored or covered at different rates.
- the widget can be rotated along an arbitrary axis or multiple axes.
- a rotating widget When a rotating widget is selected by the user for an operation, such as by the user positioning a pointer pointing at the moving widget, and performing a selection operation, such as pressing a selection button on the pointer, the widget needs to be stopped from rotating so the user can review the widget for a desired period of time or otherwise interact with the widget.
- a selection operation such as pressing a selection button on the pointer
- the rotation of a widget in either a back and forth motion or in a full circular motion includes a display 240 of the widget at a particular rotary position (see FIG. 12 ).
- the system determines 242 whether the widget has been selected. Selection can occur in a number of different ways including the positioning of a 3D cursor on the widget and the activation of a selection button on a device, such as a 3D “mouse”. If the widget has not been selected, the position of the widget is updated 244 and it is displayed 240 in its new rotary position. If the widget has been selected, the widget is flagged 246 as selected so that other users cannot select the widget. The selected widget can also be displayed in a way that indicates it has been selected, such as by highlighting it.
- the widget can then optionally be oriented 248 toward the user using the input from (or input vector of) a selecting device to determine which user has selected the widget and the user location as indicated by the location detectors.
- the correlation between location and selection device can be created by having the users register their location and their input device or by using input devices whose position around the volumetric display is known.
- the system then performs the interactions 250 with the widget as commanded by the user. If the user is only reviewing the contents of the widget then there is no positive interaction.
- the user can use the selecting device to move a cursor to select a control of the widget, thereby positively interacting with the widget. Once the interaction is finished or a time-out period expires, the widget is deselected 252 and the rotation of the widget continues.
- a rotating widget whose contents have controls making it appropriate to orient the widget toward the user when the user desires to interact with the widget. It is also possible to provide a widget that includes a control with which the user can interact while the widget is rotating without having the widget stop rotating and orient toward the user.
- a widget 270 is depicted in FIG. 13 .
- This widget 270 includes a rotating portion 272 that can indicate the function of the widget via a label and a stationary portion 274 that includes the control 276 .
- the control 276 is a slider bead that the user slides up and down to perform some function, such as an object scale slider used to change the scale of a selected object in the display.
- Another example is a push-button implemented by a deformable sphere.
- the rotating widget has been described with respect to rotating into view of the users with the widget remaining at the same position within the display. It is also possible for the widget to rotate in the display by traveling around the circumference of the display or the interior of the display enclosure much like a world rotates on a globe. In general any rotation pivot point or any path can be used to move a widget.
- One method for defining a path within a volumetric display to be used to move a widget along is to define two concentric rings along the base of the volumetric display. Call one ring the inner and the other the outer ring. The widget traverses along the inner ring until it's position plus a fixed delta amount intersects an object. With a collision imminent, the widget transitions to the outer ring until it is able to return to the inner ring—having passed the object. Additional “outer” rings can be defined if traversal along the current ring is not valid (e.g., intersecting an object).
- widget movement is “content-dependent”.
- widget placement may be content-dependent such that a widget or widgets are not only oriented or duplicated but placed in the scene to minimize the occlusion of them by other content in the scene.
- Omni-viewable widgets can also be of value in other virtual environments and display systems. For example, virtual environments that use head-mounted displays could benefit from omni-viewable widgets placed in a virtual world. In general, any application where different viewpoints of a 3D scene omni-viewable widgets can be viewed and operated from multiple viewpoints.
- the present invention can be generalized to 2D displays (e.g., a display where a widget is viewable and operable from the top or bottom of the display). For example, sitting face-to-face at a table with a LCD display in the table surface between the two people. Each widget is replicated to be oriented toward each person. If four people gather around the display four versions of the widget are produced.
- 2D displays e.g., a display where a widget is viewable and operable from the top or bottom of the display.
- the system also includes permanent or removable storage, such as magnetic and optical discs, RAM, ROM, etc. on which the process and data structures of the present invention can be stored and distributed.
- the processes can also be distributed via, for example, downloading over a network such as the Internet.
- the present invention has been described with respect to volumetric widgets that are display widgets that display data contents to the user. It is possible to provide widgets that not only output contents but also widgets that allow input to the graphics system using input data fields, cursor activatable controls, etc.
Abstract
The present invention is a widget display system for a volumetric or true three-dimensional (3D) display that provides a volumetric or omni-viewable widget that can be viewed and interacted with from any location around the volumetric display. The widget can be viewed from any location by duplicating the widget such that all locations around the display are within the viewing range of the widget. A widget can be provided with multiple viewing surfaces or faces making the widget omni-directional. A widget can be continuously rotated to face all of the possible locations of users over a period of time. User locations can be determined and the widget can be oriented to face the users when selected.
Description
- This application is a continuation of U.S. patent application Ser. No. 10/183,968 filed Jun. 28, 2002, now pending, and is related to and claims priority to U.S. provisional application entitled User Interfaces For Volumetric Displays, having Ser. No. 60/350,952 (S&H Docket 1252.1054P), by Kurtenbach et al, filed Jan. 25, 2002; this application is also related to U.S. application entitled Three Dimensional Volumetric Display Input And Output Configurations, having Ser. No. 10/183,970 (S&H Docket 1252.1054), by Kurtenbach et al, filed Jun. 28, 2002; to U.S. application entitled Volume Management System For Volumetric Displays, having Ser. No. 10/183,966 (S&H Docket 1252.1065), by Kurtenbach et al, filed Jun. 28, 2002; to U.S. application entitled Widgets Displayed and operable on a surface of a volumetric display enclosure, having Ser. No. 10/183,945 (S&H Docket 1252.1066), by Fitzmaurice et al, filed Jun. 28, 2008; to U.S. application entitled A System For Physical Rotation of Volumetric Display Enclosures To Facilitate Viewing, having Ser. No. 10/188,765 (S&H Docket 1252.1068), by Balakrishnan et al, filed Jun. 28, 2002; to U.S. application entitled Techniques For Pointing To Locations Within A Volumetric Display, having Ser. No. 10/183,944 (S&H Docket 1252.1069), by Balakrishnan et al, filed Jun. 28, 2002; and all of which are incorporated by reference herein.
- 1. Field of the Invention
- The present invention is directed to providing graphical user interface widgets or interface elements that are viewable from different viewpoints in a volumetric display and, more particularly, to a system where a widget is produced that can be viewed and operated from multiple viewpoints.
- 2. Description of the Related Art
- A class of three-dimensional (3D) displays, called volumetric displays, is currently undergoing rapid advancement. The types of displays in this class include holographic displays, swept volume displays and static volume displays. Volumetric displays allow for 3D graphical scenes to be displayed within a true 3D volume. Such displays can take many shapes, globes, domes, cubes, etc. with a dome being a typical shape. Because the technology of these displays is undergoing rapid development those of skill in the art are concentrating on the engineering of the display itself. As a result, the man-machine interface to or the ways in which people interface with these types of displays is receiving scant attention.
- While the volumetric displays allow a user to view different parts of a true 3D scene, the act of viewing the different parts typically requires that the user physically move around (or over) the display or that the display be moved or rotated in front of the user. As the display moves relative to the user, graphical user interface elements, sometimes called widgets may also move relative to the user. This is a particular problem when the widget is a two dimensional interface, such as a virtual keyboard, or a display/view of a two dimensional document, such as a list or spreadsheet.
- What is needed is a system that will provide user interface elements that are viewable and operable from whatever viewpoint a user takes around a volumetric display.
- It is an aspect of the present invention to provide widgets that can be used in a volumetric display where one or more users can view the display and the widgets from different viewpoints and locations around the display.
- It is another aspect of the present invention to orient the widgets to the users by tracking the location of the users.
- It is also an aspect of the invention to provide omni-directionally viewable widgets.
- It is an additional aspect of the present invention to replicate planar widgets, providing a widget for each user or cluster of users.
- It is a further aspect of the present invention to provide widgets that rotate so that all users can view the widgets.
- The above aspects can be attained by a system that provides a volumetric widget that can be viewed and interacted with from any location around a volumetric display. Such a widget can be provided by duplicating the widget for each user, by providing a widget with multiple viewing surfaces or faces, by rotating the widget and by orienting a widget toward a location of the user.
- These together with other aspects and advantages that will be subsequently apparent reside in the details of construction and operation as more fully hereinafter described and claimed, reference being had to the accompanying drawings forming a part hereof, wherein like numerals refer to like parts throughout.
-
FIG. 1 depicts a volumetric display. -
FIG. 2 shows a user viewpoint moving with respect to a planar user interface (UI) element (top view). -
FIG. 3 depicts the hardware of the present invention. -
FIG. 4 shows view ranges of widget faces of a volumetric widget arranged to allow any location to view the widget. -
FIGS. 5A-5D depict omni-directional volumetric widgets. -
FIG. 6 shows a volumetric display with an array of user location detectors. -
FIGS. 7A-7C show a volumetric widget with faces corresponding to and oriented toward user locations. -
FIG. 8 is a flowchart of operations that prevent the faces of a volumetric widget from occluding each other. -
FIGS. 9A-9C depict a sequence of face movements to eliminate facial occlusion. -
FIG. 10 shows clustering viewpoints. -
FIGS. 11A-11C shows back and forth rotation of a volumetric widget. -
FIG. 12 depicts selection operations for a rotating widget. -
FIG. 13 shows a volumetric widget having a rotating part and a stationary control part. - Volumetric displays allow a user to have a true three-dimensional view of a
scene 12 and are typically provided in the form of adome 14, as depicted inFIG. 1 . Theuser 16, as can be surmised fromFIG. 1 , can move about thedome 14 to view different parts of thescene 12. As theuser 16 moves (seeFIG. 2 ) todifferent viewpoints planar UI widget 36 within thevolumetric display 38 relatively turns such that it is no longer viewable by the user as depicted in the top view ofFIG. 2 . - There are a number of different solutions to this viewability problem. The solutions include the production and display of a volumetric graphic user interface element or widget or omni-viewable widget. A volumetric widget or omni-viewable widget is one that can be viewed and interacted with from any user location or viewpoint around a volumetric display. One solution that provides a volumetric widget is to replicate a planar widget several times around the volumetric display so that the user will always have a readable view of the contents of the widget. This solution can result in a cluttered display. Another solution is to provide a multifaceted widget where a face of the widget is always readable by the viewer. This can result in a widget that takes up a greater volume of the display. A further solution is to provide a widget that rotates to facilitate viewing from any viewpoint. This can result in a widget that is readable only part of the time. A further solution is to track a position of the user and orient the widget to face the user's location. This solution requires tracking technology. An additional solution is to combine two or more of the solutions discussed above. Each of these solutions provides a volumetric or omni-viewable widget and will be discussed in more detail below.
- The present invention is typically embodied in a system as depicted in
FIG. 3 wherephysical interface elements 50, such as a rotary dome position encoder, infrared user position detectors, a keyboard, etc. are coupled to acomputer 52. Thecomputer 52 uses a graphical creation process, such as the animation package MAYA available from Silicon Graphics, Inc., to create a three-dimensional (3D) scene including virtual interface elements, such as the volumetric widgets discussed herein, and move them about in the scene automatically or based on some user control input. The display output, including the scene and widgets, is provided to a conventionalvolumetric display apparatus 54, such as one that will produce a 3D holographic display - As depicted in
FIG. 4 , adisplay 70 can include a volumetric widget that comprises multipleduplicate copies element 80 having arange 84 andelement 82 having arange 86. The elements are arranged or positioned in such a way that from any point around the display 70 a user is within the acceptable viewing angle range of one of the elements. This can be accomplished by providing a sufficient number of elements or by arranging the elements more or less deeply within the display such that the ranges of the adjacent elements overlap at or near the surface of thedisplay 70. This is shown inFIG. 4 with theranges display 70. The ranges of adjacent elements need not overlap at the surface of thedisplay 70 but can overlap at a predetermined distance from the surface responsive to an expected distance of typical user viewpoints from the surface. - Omni-viewable widgets can be created by forming widgets with multiple faces or multiple surfaces as depicted in
FIGS. 5A-5D . The faces are typically exact duplicates showing the same information in the same way.FIG. 5A depicts acubical widget 100 with six faces and each face containing a duplicate of the contents to be displayed by the widget. -
FIG. 5B depicts an octagonalsolid widget 102 with 8 faces and each face displaying the same contents.FIG. 5C depicts atent type widget 104 with two faces, each facing the opposite direction and each displaying the same contents. This type of widget can also be rotated back and forth, as indicated by the arrows, to allow the viewing range of the two displays to intersect all user viewpoint positions.FIG. 5D depicts a globular or ball shapedwidget 106 with identical faces arranged one the surface of the globe. Other shapes of multiple face widgets are possible such as pyramidal and cylindrical. Note that each face does not have to be an exact duplicate; a face may be specialized for a particular viewpoint. For example, if a widget is a direction widget (showing the compass directions), each face is not a literal duplicate as in this case, each face shows the directions appropriate to their viewpoint. - To rotate or move a widget to face a user the position of each user must be determined. The detection or determination of the position of a user or users can be accomplished in a number of different ways. For example, each user can be provided with a position indicator as part of an input device, such as that provided by a conventional 3D input glove. Input devices located around the display can also be used by the users to register their locations or viewpoints. A camera and an object detection system could also be used. Another alternative, as depicted in
FIG. 6 , is to provide an array of conventionalinfrared detectors 120 arranged in a circumferential band below or at the bottom of a volumetric display enclosure 122. In this approach those detectors that are active indicate the presence of a user. A conventional interface between the computer 52 (seeFIG. 3 ) and the detectors allows the computer to conventionally detect the number and positions of users positioned around the display 122. Another variation is to use audio microphones to detect the position of users based on from where the sound is coming. - When the number and positions of users are known, the computer can create a omni-viewable widget that includes an interface element for each user, as depicted in
FIGS. 7A-7C . When the system detects two users A and B on opposite sides of thedisplay enclosure 140, as depicted inFIG. 7A , twowidgets elements FIG. 7B shows two users A and B in different positions than inFIG. 7A andwidget elements FIG. 7C shows three users A, B and C and three corresponding user-facingwidget elements FIG. 7A such as inFIGS. 7B and 7C , the system may need to prevent the widgets from overlapping each other and thereby obscuring display contents in the overlapped areas. This is discussed below with respect toFIG. 8 . - Initially, for an omni-viewable widget with an element for each user, the system determines 170 (see
FIG. 8 ) the number of users and their positions or viewpoints using a position determination system such as previously discussed. For each viewpoint an identical widget element is created and oriented 172 in an orientation that is tangential to the surface of the display enclosure at the position of the corresponding viewpoint around the circumference of the display enclosure and perpendicular to the normal at that point. Next, the centroid of the oriented widget elements is determined 174. Widget elements that have surfaces that overlap or intersect are incrementally moved 176 away from the centroid radially along the normal until no intersections exist. The sequence ofFIGS. 9A-9C show these operations in more detail. - Initially (see top view
FIG. 9A ) a widget with threewidget elements display 196 for threeuser viewpoints respective normals widget 192 no longer intersects withwidget 194, as shown inFIG. 9B . At thispoint widget 194 stops moving. However,widgets widgets respective normals FIG. 9C . Rather than move only those widgets that intersect, it is possible to move all the widgets by the same incremental amount until no intersections exist. Other placement algorithms may be used to achieve a similar non-overlapping result. - Alternatively to moving the widgets radially along their normals to eliminate intersections, it is possible to group viewpoints into viewpoint clusters and create a display for each of the clusters. This is depicted in
FIG. 10 where five user viewpoints V1-V5 are shown. In determining whether a viewpoint can be included in a cluster, the system measures the angles between the viewpoints and compares this to the view range of the particular widget element being created. If the angle is less than the range, the viewpoints can be included within the same cluster. For example, the angle between viewpoints VI and V2 and between viewpoints V2 and V5 is greater than the viewing range of the widget element being used. The angle between V3 and V4 is also too great. However, the angle between V2 and V3 and between V4 and V5 is less than the range and these viewpoints can be grouped into two clusters CI and C2 while VI is allocated to its own cluster C3. Once the clusters are determined the average of the positions or angles of the viewpoints in each cluster is used to determine the angular positions WI, W2 and W3 of the widget elements. - As noted above, it is also possible to continuously rotate the widgets. The rotation can be a revolution through 360 degrees or the rotation can rock back and forth through a fixed number of degrees to favor certain viewpoints. The rocking is depicted in
FIGS. 11A-11C . In this sequence awidget 220 in thedisplay enclosure 224 is rotated back and forth between the viewpoints of users A and B. InFIG. 11A thewidget 220 is oriented to user A, inFIG. 11B the widget is oriented between users A and B, and inFIG. 11C the widget is oriented toward user B. This rotation between view points is performed by determining the user view points and redrawing the widget in sequential and incremental angular positions between the view points. The rotation in either mode can “jump ahead” resulting in certain viewpoints being ignored or covered at different rates. Furthermore, the widget can be rotated along an arbitrary axis or multiple axes. - When a rotating widget is selected by the user for an operation, such as by the user positioning a pointer pointing at the moving widget, and performing a selection operation, such as pressing a selection button on the pointer, the widget needs to be stopped from rotating so the user can review the widget for a desired period of time or otherwise interact with the widget. The operations involved in stopping the rotation of the widget are depicted in
FIG. 12 and discussed below. - The rotation of a widget, in either a back and forth motion or in a full circular motion includes a
display 240 of the widget at a particular rotary position (seeFIG. 12 ). The system then determines 242 whether the widget has been selected. Selection can occur in a number of different ways including the positioning of a 3D cursor on the widget and the activation of a selection button on a device, such as a 3D “mouse”. If the widget has not been selected, the position of the widget is updated 244 and it is displayed 240 in its new rotary position. If the widget has been selected, the widget is flagged 246 as selected so that other users cannot select the widget. The selected widget can also be displayed in a way that indicates it has been selected, such as by highlighting it. The widget can then optionally be oriented 248 toward the user using the input from (or input vector of) a selecting device to determine which user has selected the widget and the user location as indicated by the location detectors. The correlation between location and selection device can be created by having the users register their location and their input device or by using input devices whose position around the volumetric display is known. The system then performs theinteractions 250 with the widget as commanded by the user. If the user is only reviewing the contents of the widget then there is no positive interaction. The user can use the selecting device to move a cursor to select a control of the widget, thereby positively interacting with the widget. Once the interaction is finished or a time-out period expires, the widget is deselected 252 and the rotation of the widget continues. - As discussed above, it is possible to provide a rotating widget whose contents have controls making it appropriate to orient the widget toward the user when the user desires to interact with the widget. It is also possible to provide a widget that includes a control with which the user can interact while the widget is rotating without having the widget stop rotating and orient toward the user. Such a
widget 270 is depicted inFIG. 13 . Thiswidget 270 includes arotating portion 272 that can indicate the function of the widget via a label and astationary portion 274 that includes thecontrol 276. In this case thecontrol 276 is a slider bead that the user slides up and down to perform some function, such as an object scale slider used to change the scale of a selected object in the display. Another example is a push-button implemented by a deformable sphere. - The rotating widget has been described with respect to rotating into view of the users with the widget remaining at the same position within the display. It is also possible for the widget to rotate in the display by traveling around the circumference of the display or the interior of the display enclosure much like a world rotates on a globe. In general any rotation pivot point or any path can be used to move a widget.
- These paths are computed such that they route the widgets around objects that would occlude the widgets being viewed from certain viewpoints. One method for defining a path within a volumetric display to be used to move a widget along is to define two concentric rings along the base of the volumetric display. Call one ring the inner and the other the outer ring. The widget traverses along the inner ring until it's position plus a fixed delta amount intersects an object. With a collision imminent, the widget transitions to the outer ring until it is able to return to the inner ring—having passed the object. Additional “outer” rings can be defined if traversal along the current ring is not valid (e.g., intersecting an object). This same concept can work for other path shapes such as a rectangular path or a spiral path that has a width and height. Using this approach, widget movement is “content-dependent”. In a similar manner, widget placement may be content-dependent such that a widget or widgets are not only oriented or duplicated but placed in the scene to minimize the occlusion of them by other content in the scene.
- Omni-viewable widgets can also be of value in other virtual environments and display systems. For example, virtual environments that use head-mounted displays could benefit from omni-viewable widgets placed in a virtual world. In general, any application where different viewpoints of a 3D scene omni-viewable widgets can be viewed and operated from multiple viewpoints.
- The present invention can be generalized to 2D displays (e.g., a display where a widget is viewable and operable from the top or bottom of the display). For example, sitting face-to-face at a table with a LCD display in the table surface between the two people. Each widget is replicated to be oriented toward each person. If four people gather around the display four versions of the widget are produced.
- The system also includes permanent or removable storage, such as magnetic and optical discs, RAM, ROM, etc. on which the process and data structures of the present invention can be stored and distributed. The processes can also be distributed via, for example, downloading over a network such as the Internet.
- The present invention has been described with respect to volumetric widgets that are display widgets that display data contents to the user. It is possible to provide widgets that not only output contents but also widgets that allow input to the graphics system using input data fields, cursor activatable controls, etc.
- The many features and advantages of the invention are apparent from the detailed specification and, thus, it is intended by the appended claims to cover all such features and advantages of the invention that fall within the true spirit and scope of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation illustrated and described, and accordingly all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.
Claims (9)
1. A method, comprising:
producing and displaying a three-dimensional scene in a volumetric display; and
producing and displaying a volumetric interface element in the volumetric display.
2. A method as recited in claim 1 , wherein the volumetric element comprises an omni-directional element.
3. A method as recited in claim 2 , wherein an omni-directional element comprises a multisided element with contents replicated on each side.
4. A method as recited in claim 3 , wherein the multisided element comprises one of a cube, a globe and a hexagonal solid, the multisided element having faces each with a viewing range and the viewing ranges of the faces covering the viewpoints of users around the volumetric display.
5. A method as recited in claim 1 , wherein the volumetric element comprises a rotating face rotating into view of the users.
6. A method as recited in claim 5 , wherein the rotating face comprises one of a face revolving continuously through 360 degrees and a face rocking back and forth through a predetermined number of degrees.
7. A method as recited in claim 6 , further comprising orienting the rotating face toward a user selecting the volumetric element.
8. A method as recited in claim 6 , wherein the volumetric element further comprises a stationary control associated with the rotating face.
9. A computer readable storage controlling a computer or via producing a three-dimensional scene in a volumetric display, and producing a volumetric interface element in the volumetric display.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/236,488 US20060077212A1 (en) | 2002-01-25 | 2005-09-28 | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US35095202P | 2002-01-25 | 2002-01-25 | |
US10/183,968 US7205991B2 (en) | 2002-01-25 | 2002-06-28 | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display |
US11/236,488 US20060077212A1 (en) | 2002-01-25 | 2005-09-28 | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/183,968 Continuation US7205991B2 (en) | 2002-01-25 | 2002-06-28 | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060077212A1 true US20060077212A1 (en) | 2006-04-13 |
Family
ID=27616291
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/183,968 Expired - Lifetime US7205991B2 (en) | 2002-01-25 | 2002-06-28 | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display |
US11/236,488 Abandoned US20060077212A1 (en) | 2002-01-25 | 2005-09-28 | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/183,968 Expired - Lifetime US7205991B2 (en) | 2002-01-25 | 2002-06-28 | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display |
Country Status (1)
Country | Link |
---|---|
US (2) | US7205991B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050237346A1 (en) * | 2004-04-22 | 2005-10-27 | Nec Viewtechnology, Ltd. | Image display device for rotating an image displayed on a display screen |
US20110096072A1 (en) * | 2009-10-27 | 2011-04-28 | Samsung Electronics Co., Ltd. | Three-dimensional space interface apparatus and method |
CN107831902A (en) * | 2017-11-23 | 2018-03-23 | 腾讯科技(上海)有限公司 | A kind of motion control method and its equipment, storage medium, terminal |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060156249A1 (en) * | 2005-01-12 | 2006-07-13 | Blythe Michael M | Rotate a user interface |
US8636670B2 (en) | 2008-05-13 | 2014-01-28 | The Invention Science Fund I, Llc | Circulatory monitoring systems and methods |
US20090287120A1 (en) | 2007-12-18 | 2009-11-19 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Circulatory monitoring systems and methods |
US9717896B2 (en) | 2007-12-18 | 2017-08-01 | Gearbox, Llc | Treatment indications informed by a priori implant information |
US8446412B2 (en) * | 2008-06-26 | 2013-05-21 | Microsoft Corporation | Static visualization of multiple-dimension data trends |
US8359549B1 (en) | 2008-09-10 | 2013-01-22 | Adobe Systems Incorporated | Multiple-function user interactive tool for manipulating three-dimensional objects in a graphical user interface environment |
US8181120B2 (en) * | 2009-04-02 | 2012-05-15 | Sony Corporation | TV widget animation |
US8051375B2 (en) * | 2009-04-02 | 2011-11-01 | Sony Corporation | TV widget multiview content organization |
US8261210B2 (en) * | 2009-04-02 | 2012-09-04 | Sony Corporation | TV widget animation with audio |
US8601510B2 (en) * | 2009-10-21 | 2013-12-03 | Westinghouse Digital, Llc | User interface for interactive digital television |
JP2013168120A (en) * | 2012-01-19 | 2013-08-29 | Panasonic Corp | Stereoscopic image processing apparatus, stereoscopic image processing method, and program |
EP2696274A2 (en) * | 2012-08-07 | 2014-02-12 | Samsung Electronics Co., Ltd | Portable apparatus with a GUI and method of using the same |
US11579691B2 (en) * | 2021-05-25 | 2023-02-14 | Kyndryl, Inc. | Mid-air volumetric visualization movement compensation |
Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4134104A (en) * | 1976-08-25 | 1979-01-09 | Ernest Karras | Device for displaying data in three dimensions |
US4160973A (en) * | 1977-10-11 | 1979-07-10 | Massachusetts Institute Of Technology | Three-dimensional display |
US5717415A (en) * | 1994-02-01 | 1998-02-10 | Sanyo Electric Co., Ltd. | Display system with 2D/3D image conversion where left and right eye images have a delay and luminance difference base upon a horizontal component of a motion vector |
US5767854A (en) * | 1996-09-27 | 1998-06-16 | Anwar; Mohammed S. | Multidimensional data display and manipulation system and methods for using same |
US5801666A (en) * | 1993-02-10 | 1998-09-01 | Board Of Regents, The University Of Texas System | Three-dimensional monitor |
US5805137A (en) * | 1991-11-26 | 1998-09-08 | Itu Research, Inc. | Touch sensitive input control device |
US5854449A (en) * | 1995-09-11 | 1998-12-29 | Calcomp Inc. | High accuracy digitizer system |
US6008809A (en) * | 1997-09-22 | 1999-12-28 | International Business Machines Corporation | Apparatus and method for viewing multiple windows within a dynamic window |
US6031541A (en) * | 1996-08-05 | 2000-02-29 | International Business Machines Corporation | Method and apparatus for viewing panoramic three dimensional scenes |
US6049317A (en) * | 1989-02-27 | 2000-04-11 | Texas Instruments Incorporated | System for imaging of light-sensitive media |
US6052100A (en) * | 1994-03-16 | 2000-04-18 | The United States Of America Represented By The Secertary Of The Navy | Computer controlled three-dimensional volumetric display |
US6064423A (en) * | 1998-02-12 | 2000-05-16 | Geng; Zheng Jason | Method and apparatus for high resolution three dimensional display |
US6115028A (en) * | 1996-08-22 | 2000-09-05 | Silicon Graphics, Inc. | Three dimensional input system using tilt |
US6208318B1 (en) * | 1993-06-24 | 2001-03-27 | Raytheon Company | System and method for high resolution volume display using a planar array |
US6229542B1 (en) * | 1998-07-10 | 2001-05-08 | Intel Corporation | Method and apparatus for managing windows in three dimensions in a two dimensional windowing system |
US6512498B1 (en) * | 1999-06-21 | 2003-01-28 | Actuality Systems, Inc. | Volumetric stroboscopic display |
US6697034B2 (en) * | 1999-12-30 | 2004-02-24 | Craig Stuart Tashman | Volumetric, stage-type three-dimensional display, capable of producing color images and performing omni-viewpoint simulated hidden line removal |
US6753847B2 (en) * | 2002-01-25 | 2004-06-22 | Silicon Graphics, Inc. | Three dimensional volumetric display input and output configurations |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6628298B1 (en) * | 1998-07-17 | 2003-09-30 | The Regents Of The University Of California | Apparatus and method for rendering synthetic objects into real scenes using measurements of scene illumination |
US6842175B1 (en) * | 1999-04-22 | 2005-01-11 | Fraunhofer Usa, Inc. | Tools for interacting with virtual environments |
JP2001346227A (en) | 2000-06-01 | 2001-12-14 | Minolta Co Ltd | Stereoscopic image display device, stereoscopic image display system and data file for stereoscopic image display |
-
2002
- 2002-06-28 US US10/183,968 patent/US7205991B2/en not_active Expired - Lifetime
-
2005
- 2005-09-28 US US11/236,488 patent/US20060077212A1/en not_active Abandoned
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4134104A (en) * | 1976-08-25 | 1979-01-09 | Ernest Karras | Device for displaying data in three dimensions |
US4160973A (en) * | 1977-10-11 | 1979-07-10 | Massachusetts Institute Of Technology | Three-dimensional display |
US6049317A (en) * | 1989-02-27 | 2000-04-11 | Texas Instruments Incorporated | System for imaging of light-sensitive media |
US5805137A (en) * | 1991-11-26 | 1998-09-08 | Itu Research, Inc. | Touch sensitive input control device |
US5801666A (en) * | 1993-02-10 | 1998-09-01 | Board Of Regents, The University Of Texas System | Three-dimensional monitor |
US6208318B1 (en) * | 1993-06-24 | 2001-03-27 | Raytheon Company | System and method for high resolution volume display using a planar array |
US5717415A (en) * | 1994-02-01 | 1998-02-10 | Sanyo Electric Co., Ltd. | Display system with 2D/3D image conversion where left and right eye images have a delay and luminance difference base upon a horizontal component of a motion vector |
US6052100A (en) * | 1994-03-16 | 2000-04-18 | The United States Of America Represented By The Secertary Of The Navy | Computer controlled three-dimensional volumetric display |
US5854449A (en) * | 1995-09-11 | 1998-12-29 | Calcomp Inc. | High accuracy digitizer system |
US6031541A (en) * | 1996-08-05 | 2000-02-29 | International Business Machines Corporation | Method and apparatus for viewing panoramic three dimensional scenes |
US6115028A (en) * | 1996-08-22 | 2000-09-05 | Silicon Graphics, Inc. | Three dimensional input system using tilt |
US5767854A (en) * | 1996-09-27 | 1998-06-16 | Anwar; Mohammed S. | Multidimensional data display and manipulation system and methods for using same |
US6008809A (en) * | 1997-09-22 | 1999-12-28 | International Business Machines Corporation | Apparatus and method for viewing multiple windows within a dynamic window |
US6064423A (en) * | 1998-02-12 | 2000-05-16 | Geng; Zheng Jason | Method and apparatus for high resolution three dimensional display |
US6229542B1 (en) * | 1998-07-10 | 2001-05-08 | Intel Corporation | Method and apparatus for managing windows in three dimensions in a two dimensional windowing system |
US6512498B1 (en) * | 1999-06-21 | 2003-01-28 | Actuality Systems, Inc. | Volumetric stroboscopic display |
US6697034B2 (en) * | 1999-12-30 | 2004-02-24 | Craig Stuart Tashman | Volumetric, stage-type three-dimensional display, capable of producing color images and performing omni-viewpoint simulated hidden line removal |
US6753847B2 (en) * | 2002-01-25 | 2004-06-22 | Silicon Graphics, Inc. | Three dimensional volumetric display input and output configurations |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050237346A1 (en) * | 2004-04-22 | 2005-10-27 | Nec Viewtechnology, Ltd. | Image display device for rotating an image displayed on a display screen |
US7746365B2 (en) | 2004-04-22 | 2010-06-29 | Nec Viewtechnology, Ltd. | Image display device for rotating an image displayed on a display screen |
US20110096072A1 (en) * | 2009-10-27 | 2011-04-28 | Samsung Electronics Co., Ltd. | Three-dimensional space interface apparatus and method |
US9377858B2 (en) * | 2009-10-27 | 2016-06-28 | Samsung Electronics Co., Ltd. | Three-dimensional space interface apparatus and method |
US9880698B2 (en) | 2009-10-27 | 2018-01-30 | Samsung Electronics Co., Ltd. | Three-dimensional space interface apparatus and method |
CN107831902A (en) * | 2017-11-23 | 2018-03-23 | 腾讯科技(上海)有限公司 | A kind of motion control method and its equipment, storage medium, terminal |
Also Published As
Publication number | Publication date |
---|---|
US20030142092A1 (en) | 2003-07-31 |
US7205991B2 (en) | 2007-04-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060077212A1 (en) | Graphical user interface widgets viewable and readable from multiple viewpoints in a volumetric display | |
US10942618B2 (en) | Panning in a three dimensional environment on a mobile device | |
US6987512B2 (en) | 3D navigation techniques | |
US6014142A (en) | Apparatus and method for three dimensional manipulation of point of view and object | |
US7724251B2 (en) | System for physical rotation of volumetric display enclosures to facilitate viewing | |
CN101925874B (en) | Projection of graphical objects on interactive irregular displays | |
US5835692A (en) | System and method for providing mapping notation in interactive video displays | |
Deering | The HoloSketch VR sketching system | |
US7480873B2 (en) | Method and apparatus for manipulating two-dimensional windows within a three-dimensional display model | |
GB2406768A (en) | Manipulating a window within a three-dimensional display model | |
JP4294093B2 (en) | Computer vision system graphic user interface | |
US8803881B2 (en) | Navigation system for a 3D virtual scene | |
US5557714A (en) | Method and system for rotating a three-dimensional model about two orthogonal axes | |
Jo et al. | Aroundplot: Focus+ context interface for off-screen objects in 3D environments | |
US20140019917A1 (en) | Disambiguation of multitouch gesture recognition for 3d interaction | |
Mine | Working in a virtual world: Interaction techniques used in the chapel hill immersive modeling program | |
JP2007052793A (en) | Method for controlling location of pointer to be displayed by pointing device on display surface | |
US20040001111A1 (en) | Widgets displayed and operable on a surface of a volumetric display enclosure | |
WO2003083822A1 (en) | Three dimensional volumetric display input and output configurations | |
Thomas et al. | Spatial augmented reality—A tool for 3D data visualization | |
Nakashima et al. | A 2D-3D integrated environment for cooperative work | |
CN106462769A (en) | Specular highlights on photos of objects | |
Dech et al. | Rigorous exploration of medical data in collaborative virtual reality applications | |
GB2440197A (en) | 3D Perspective Image of a User Interface for Manipulating Focus and Context | |
Brudy | Interactive menus in augmented reality environments |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AUTODESK, INC.,CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ALIAS SYSTEMS CORPORATION;REEL/FRAME:018375/0466 Effective date: 20060125 Owner name: AUTODESK, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ALIAS SYSTEMS CORPORATION;REEL/FRAME:018375/0466 Effective date: 20060125 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |