US20090083672A1 - Navigation system for a 3d virtual scene - Google Patents

Navigation system for a 3d virtual scene Download PDF

Info

Publication number
US20090083672A1
US20090083672A1 US12/200,373 US20037308A US2009083672A1 US 20090083672 A1 US20090083672 A1 US 20090083672A1 US 20037308 A US20037308 A US 20037308A US 2009083672 A1 US2009083672 A1 US 2009083672A1
Authority
US
United States
Prior art keywords
cursor
tool
view
wheel
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/200,373
Other languages
English (en)
Inventor
George Fitzmaurice
Justin Matejka
Igor Mordatch
Gord Kurtenbach
John Schrag
Azam Khan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Autodesk Inc
Original Assignee
Autodesk Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Autodesk Inc filed Critical Autodesk Inc
Priority to US12/200,373 priority Critical patent/US20090083672A1/en
Priority to US29/309,691 priority patent/USD625327S1/en
Priority to US29/309,693 priority patent/USD624933S1/en
Priority to US29/309,694 priority patent/USD623656S1/en
Priority to US29/309,692 priority patent/USD625328S1/en
Priority to US29/309,688 priority patent/USD626560S1/en
Priority to US29/309,689 priority patent/USD623658S1/en
Priority to US29/309,687 priority patent/USD625324S1/en
Priority to PCT/US2008/077928 priority patent/WO2009094051A1/fr
Priority to US29/309,690 priority patent/USD625732S1/en
Publication of US20090083672A1 publication Critical patent/US20090083672A1/en
Assigned to AUTODESK, INC. reassignment AUTODESK, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MORDATCH, IGOR, FITZMAURICE, GEORGE, KHAN, AZAM, KURTENBACH, GORD, MATEJKA, JUSTIN, SCHRAG, JOHN
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/954—Navigation, e.g. using categorised browsing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G06F3/04895—Guidance during keyboard input operation, e.g. prompting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72466—User interfaces specially adapted for cordless or mobile telephones with selection means, e.g. keys, having functions defined by the mode or the status of the device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons

Definitions

  • the embodiments discussed herein are directed to allowing a user to walk the view along a horizontal plane in the view where a dead zone is provided in which no motion occurs when the cursor is in the zone and motion direction and speed is controlled by the relative position of the cursor with respect to the zone.
  • a navigation system for navigating a three-dimensional (3D) scene that includes a model or object with which a user can interact.
  • the system accommodates and helps both novice and advanced users. To do this, the system allows a user to walk the view along a horizontal plane in the view where a dead zone is provided in which no motion occurs when the cursor is in the zone and motion direction and speed is controlled by the relative position of the cursor with respect to the zone.
  • FIG. 1 illustrates view object, tour and full navigation GUI wheels and the corresponding mini or pie cursor GUIs.
  • FIG. 2 depicts a 2D wheel.
  • FIG. 2 a depicts other mini-wheels.
  • FIGS. 3 a and 3 b depict the hit zones of the wheels.
  • FIG. 4 shows cursor motion and wedge tool focus.
  • FIGS. 4 a and 4 b shows switching between big and mini wheels.
  • FIG. 5 including 5 a - 5 c, shows pie cursor operation.
  • FIG. 6 shows enlarged hit zones for the pie cursor.
  • FIG. 7 shows cursors to various tools.
  • FIG. 8 shows cursor wrapping
  • FIG. 9 shows tool tips.
  • FIG. 10 illustrates close too and open tool menu nibs.
  • FIGS. 11 a - 11 d show first contact GUIs.
  • FIG. 12 shows a cursor when used in a model point zoom with the center tool.
  • FIGS. 13-15 show center point section and centering.
  • FIGS. 16-18 show the focus sphere characteristics.
  • FIG. 19 shows locations of a sphere relative to a model.
  • FIG. 20 shows an orientation ring
  • FIGS. 21 and 22 show tool warnings.
  • FIGS. 23 a - 23 c show rewind cursor appearance.
  • FIGS. 24 a - 24 c show rewinding.
  • FIG. 25 shows a forward tool tip
  • FIG. 26 shows a warning for an invalid action.
  • FIGS. 27 a and 27 b show a perspective slider.
  • FIG. 28 shows forward motion
  • FIG. 29 a shows an up/down slider and 29 b shows up down motion.
  • FIGS. 30-32 show a walk.
  • FIG. 33 shows walk cursors.
  • FIG. 34 shows optional cursors for the mini wheel or pie cursor.
  • FIG. 35 shows tap activation operation
  • FIG. 36 shows center operation
  • FIG. 37 shows sphere operation
  • FIG. 38 shows cursor wrapping operation
  • FIG. 39 shows zoom operation.
  • FIGS. 40 and 41 show rewind operation while FIG. 40 a shows the history data structure.
  • FIG. 42 shows forward operation
  • FIG. 43 shows up/down operation.
  • FIG. 44 shows walk operation.
  • FIG. 45 shows pan operation
  • FIG. 46 shows mini-wheel activation operation.
  • FIG. 47 shows parity maintenance between perspective and orthographic projections.
  • FIG. 48 shows system hardware.
  • GUI graphical user interface
  • FIG. 1 includes a set 100 of graphical user interface (GUI) navigation widgets or wheels (or navigation tools) and corresponding miniature or pie menu versions, action tools that can be activated with the widgets and accompanying GUI navigation aids (not shown in this figure).
  • GUI graphical user interface
  • the tools allow the user to perform different operations within the scene, such as panning and zooming.
  • the set of widgets or wheels, as includes a view object wheel 110 would typically be used by a novice or an inexperienced 3D user to navigate around an object in a scene, such as a model of an automobile or a part.
  • the view object wheel 110 includes a center action tool 112 .
  • the center tool 112 is located in the upper wedge of the view object wheel 110 .
  • the center tool is designed to bring (through an automatic pan operation) a clicked point on a model part or other object to the center of the canvas view.
  • a tool 110 secondary purpose is to establish a reference point in 3D space for other tools on the wheel 110 .
  • the orbit tool 114 allows a user to orbit around an object in a scene where the center of the orbit is the center reference point.
  • the zoom tool 116 allows a user to zoom in toward or out away from the center point.
  • the rewind tool 118 allows the user to rewind back through way points that are automatically saved as the user navigates about a scene.
  • a tour wheel 120 would typically be used by a novice to navigate within a building.
  • a full navigation wheel 130 is designed for an experienced user and includes all of the tools of the object 110 and tour 120 wheels.
  • the tour wheel 120 includes the rewind tool discussed above.
  • the tour wheel 120 also includes a forward action tool 122 .
  • This forward tool 122 allows a user to move forward in the scene toward an object or model in the scene. If there is no object beneath the cursor, no motion occurs and the user is informed that no motion will occur via an invalid action or prohibited action message.
  • a look tool 124 allows a user to “look” or change the view toward the left, right, up or down much the way a person turns their head in these directions.
  • An up/down tool 126 allows the user to move vertically up and down within the scene.
  • the full navigation wheel 130 includes all of the tools functionality of the object 110 and tour 120 navigation tools with additional capability.
  • a walk tool 132 allows users to interactively walk about in 3D space, moving forward and backwards and/or turning freely to the left or right.
  • a pan tool 134 allows the user to move up, down, right and left in the scene. The zoom tool moves in and out from the current cursor position instead of the center point.
  • Each of the wheels 110 , 120 and 130 has a corresponding miniature or mini wheel 142 , 144 and 146 , respectively, each of which includes the same action tools arranged in a pie type shape with each action tool occupying a pie wedge that corresponds to the general location of the action tool in the full size version.
  • a 2D navigation wheel 150 can also be provided as depicted in FIG. 2 and includes the zoom 152 , pan 154 and rewind 156 tools.
  • FIG. 2 a depicts enlarged versions of different mini-wheels some of which have places for additional functions.
  • the navigation tools or wheels have some common characteristics.
  • the wheels are all tracking menus.
  • a tracking menu is a cluster of graphical buttons, as with traditional menus, the cursor (sometimes shaped like an arrow) can be moved within the menu to select and interact with items. However, unlike traditional menus, when the cursor hits the edge of the menu, the menu moves to continue tracking the cursor. Thus the menu always stays under the cursor and close at hand.
  • Each wheel is displayed on the “canvas” of the screen display for 2D drawing and 3D model views. As long as the tool is active the wheel's menu surface will track and follow the mouse or input device cursor when it hits the edge of the menu surface. No mouse button down is required to get the menu to follow along. If the mouse cursor leaves the canvas area, the menu still follows the mouse off-canvas, and the navigation tool menu will re-display when the mouse cursor returns to the canvas and moves the menu along with it.
  • Each wheel is “pinned” to the mouse cursor when the left mouse button is held and a child tool is selected. When a child tool is no longer in use, the wheel re-appears under the mouse cursor on the canvas. The cursor is displayed exactly on the tool where it clicked to start the tool usage. So, for example, when the zoom tool is released, the wheel is aligned under the cursor exactly as it was when the mouse button was first pressed, while the cursor was on the zoom tool. This allows users to quickly re-invoke the same tool if needed. If the mouse cursor is off the canvas when the sub-tool is exited, the wheel continues to track the cursor. If the user moves the cursor back towards the canvas area the wheel is moved along until it becomes visible again.
  • Each of the wheels has the most used functions or action tools on an exterior and lesser used functions in the center. In addition, functions can occupy different amounts or space consistent with the importance of that function.
  • the wheels both full and mini, can have different sizes from 256 ⁇ 256 pixels down to 16 ⁇ 16 pixels. At a size of 32 ⁇ 32 the arrow cursor is no longer visible.
  • the wheels appear on top of the canvas and any objects that are in the canvas are still visible since the wheels can be made semi-transparent.
  • the wheel' level of opacity can be set in a range between 25% and 90% (i.e., mostly opaque). No matter what the transparency setting, the navigate tool or wheel is completely hidden (invisible) while one of its child tools is in use. Each child tool will determine any on screen display that may be required for itself. When the child tool is released, the wheel is redisplayed using the current transparency settings.
  • each action tool is highlighted (including wedges in the mini wheels) as the cursor moves over the tool to alert the user that the user is over that tool.
  • the area of each tool corresponds to the activation or hit zones, as depicted in FIGS. 3 a (big wheels) and 3 b (mini wheels), unless the area is enlarged or enhanced, as will be discussed in more detail later.
  • the cursor location is mapped to a corresponding location in representation of the hit zones. If the cursor is in one of the zones, that tool is highlighted. If the left mouse button is clicked down or activated while in a zone the tool corresponding to the zone is activated and the function starts at the point of the cursors.
  • FIGS. 4 and 5 The highlighting and selection for a mini wheel is particularly depicted in FIGS. 4 and 5 .
  • a full size wheel is miniaturized into a cursor-size with a radial layout based on the particular corresponding full size navigation tool selected and in effect becomes a pie menu cursor.
  • the cursor (arrow) is preferably hidden and, in effect, the mini wheel menu itself serves to show cursor location.
  • the mini wheel follows the system cursor.
  • the command in that direction within the pie layout is highlighted as depicted in FIG. 4 .
  • command or tool wedges are color-coded with one wedge active at all times and a small label is shown below the cursor to indicate the tool name as shown in FIG. 4 .
  • a mouse down event activates a highlighted command and the mini wheel cursor is replaced by the appropriate tool cursor.
  • a user can then drag to operate the command (for example, dragging to zoom in/out using the standard zoom tool cursor).
  • Releasing the mouse button brings back the mini wheel cursor as depicted in FIGS. 4 a and 4 b.
  • the selection and operation of any of the commands in a mini wheel cursor is only one button press away and can be performed in-place.
  • the one button press indicates both which command is being activated and the starting point for that command.
  • By strategically planning ahead a user is able to adjust their mouse input “approach path” to select a target object such that the desired command wedge is highlighted when over the target object.
  • the desired command can immediately be activated with a mouse down event. This effectively merges pointing and command selection into a single act.
  • FIG. 5 shows an example usage of pointing, command selection and command operation for the mini wheel cursor.
  • FIG. 5 a shows the cursor motion to highlight a command.
  • FIG. 5 b shows clicking to activate the command (a pan tool).
  • FIG. 5 c shows dragging to operate the pan tool and
  • FIG. 5 d shows the release of the mouse button to deselect the tool and restore the mini wheel cursor.
  • the wedge selection or tool associated with a mini wheel or pie cursor can be enhanced by extending the hit zone of the active wedge as shown in FIG. 6 .
  • the wedge hit zone is expanded (dotted line) to be larger than the visible tool wedge by a small percentage such as 10%. This allows for a subtle form of wedge stickiness and also serves to reduce the instability that can occur if the input point is at the center of the pie cursor.
  • the hotspot for the pie cursor lies within the active wedge and is the true cursor position. Since the wedges are fairly small, and the true cursor position is usually at the outer edge of the wedge, the hotspot becomes very predictable.
  • the pie cursor is not a pop-up menu; rather, like a regular tool, you select it from the toolbar and it becomes your cursor thus changing your input mode.
  • Each wheel exhibits a slide under behavior when the ShowMotion UI and/or the View Cube are displayed on the canvas.
  • the wheel passes under both of these other features' onscreen displays.
  • FIG. 7 depicts cursors that can be used when the look 702 , pan 704 , orbit 706 , zoom 708 , rewind 710 cursors are activated, as well as the prohibited operation/action cursor 712 .
  • Each of the cursors has text associated with it when it is displayed above the canvas that provides the name of the tool, such as the “Orbit Cursor” text shown for the orbit tool cursor 706 .
  • the cursor wraps around as depicted in FIG. 8 .
  • the cursor moves from position 1 to 2 to the left edge of the screen, the cursor reappears on the right side of the screen at the same vertical position and traveling in the same direction as shown by positions 3 and 4 .
  • the cursor exits the top or bottom, the cursor reenters at the same horizontal position.
  • All of the tools of each wheel can have a tool tip or description graphic (HUD—heads-up-display) that is displayed when the cursor hovers over the tool.
  • FIG. 9 depicts a tool tip 902 for the pan tool 904 and a tool tip 906 for the orbit tool 908 .
  • the tool tips are the same size for each function.
  • the HUD may also be shown below the cursor while a tool is in use. This HUD display element can follow the cursor about on the canvas while the tool is active (left mouse down) and is removed when the user exits the tool (left mouse up).
  • each full size wheel 1000 has a close button 1002 that closes the GUI.
  • the system stores and will remember the last tool that was in use when one of the wheels is activated. When a wheel is closed or dismissed, the previously active toolbar tool is restored or made active. If no other tool has been activated in the session, the “Select Tool” menu will be activated by default when closing a wheel via the close button.
  • Each wheel also includes a menu button 1004 . When the menu button 1004 is left mouse clicked, a menu is displayed. Right mouse click anywhere on the wheel surface will also display this menu. As with standard menus, hitting the ESC key will cancel the menu.
  • the menu items for the view and tour wheels can include:
  • the menu items for the full wheel can include:
  • Go Home moves the camera to the document's saved Home View with a quick animation lasting 1 second.
  • Fit to Window adjusts the current camera to frame the 3D content to fit entirely within the view.
  • Level Camera flattens the camera view rotation relative to the XY ground plane.
  • Restore Original Center restores the view object wheel center point to the center of the currently loaded model's bounding box.
  • Increase/Decrease Walk Speed doubles or halves the current walk speed. Help brings up the help window for the wheels.
  • Preferences brings up the Preference window for the wheels. Close Wheel exits from the current wheel navigation tool and returns to the previous tool (or the default tool such as Select).
  • Optional wheel menu arrangements can be provided.
  • FIG. 11 a shows an initial graphic 1100 that includes tabs 1102 for novice and advanced users.
  • the tab for an advanced user is shown as selected includes a graphic 1104 of a full navigation wheel, the mini wheels and a tip 1106 .
  • the tip 1106 provides text on behavior 1108 (tracking and hide/show wheel) and wheel type selections 1110 . The user can see each selection type by positioning the cursor over a type.
  • FIG. 11 b illustrates a display of the full mini wheel type tip where all of the tools and their locations on the mini wheel are shown.
  • FIG. 11 b the full navigation wheel tool tips has been selected for review and the locations and of the actions/names of tools are noted.
  • FIG. 11 c illustrates possible selections within the novice tab and once again text describing behavior and possible selections are shown.
  • FIG. 11 d shows a view object wheel tip having been selected where the operations of the tools for that wheel are described in text. The typical use is show by an image 1112 along side the other tool 1114 .
  • the view object wheel or the full navigation wheel is preferably be displayed in the canvas or display in the lower left corner. While displayed in this manner the wheel is even more transparent than when it is active.
  • the wheel is in an inactive or pinned state, and only responds to mouse cursor rollover. While in this state the pinned wheel does not interact with any other tools or features.
  • the pinned wheel has no other functions.
  • the currently selected wheel is pinned to the same location. (The wheel selection is stored as an option across sessions.) If a mini wheel is the currently selected wheel, then the full navigation wheel is displayed.
  • the tool tips go away and the wheel remains in the pinned state.
  • users first activate it and then close the wheel, or select another tool. Otherwise the wheel remains pinned in the 3D canvas.
  • a main menu pull down menu can also be provided in an application to allow activation of one of the navigation tools, such as:
  • the center tool moves a clicked or designated point on a model part to the center of the view and establishes a 3D space reference point.
  • the cursor will display as the select arrow 1202 , as shown in FIG. 12 .
  • the cursor icon changes to show the prohibited/invalid operation or action cursor/symbol (see FIG. 7 ) as long as there is no model part directly under the cursor.
  • a HUD message will also be displayed with the text “Click or Drag over the model to set the Pivot.”
  • a center sphere which will be discussed in more detail below, is displayed.
  • the center sphere will not move with the cursor as long as the cursor shows the prohibited symbol.
  • the cursor rolls or moves over a model part the sphere jumps to that position and begins to track the cursor, and the icon will change to the normal arrow icon.
  • the HUD message will then also go away. If the cursor is over the center wedge but not over a model surface, the left mouse click will display a momentary HUD message until the mouse-up event occurs that has text as noted above.
  • the system shows the center point sphere at the cursor's location in screen space projected onto the underlying model's surface as depicted in FIG. 13 (circled for ease of identification).
  • the view will be animated/panned to bring the current center point to the center of the canvas or view as shown by the arrow in FIG. 14 where the “ghosting” is used to illustrate this movement.
  • the center point reaches the center of the canvas the automatic view pan operation stops as shown in FIG. 15 and the center point sphere can be hidden.
  • the center point is stored for use with other tools on the view object wheel to use, namely zoom and orbit. While the center tool is active, a graphical tool description is shown below the cursor location on the canvas with the following text: Center Tool.
  • the center point sphere represents a 3D point in model space. As discussed above, this point is set by the center tool and used by the orbit and zoom tools that are found on the view object wheel. If the user has not defined a center point by clicking in the canvas view, then the default center point location in space is preferably defined as the center of the currently loaded Model's bounding box.
  • the sphere is a 3D model that is placed into the current model view. Since the sphere is a geometric object with 3D geometry it may appear larger or smaller depending on how far the target point is from the camera view, and it may be occluded by any model geometry that falls between it and the camera view.
  • the center sphere is a “green ball” pivot indicator 1602 preferably with a text label 1604 .
  • the sphere can have axis rings 1702 around the perimeter as depicted in FIG. 17 .
  • the sphere should always be visible and should be displayed completely solid when there is no intervening geometry, and be displayed as partially see through when there is occluding geometry between the camera and the sphere as depicted in FIG. 18 where the sphere is shown with the label “Pivot” from the orbit tool. Note that as the two planes occlude the sphere the sphere becomes see through and remains visible.
  • FIG. 18 shows a view with a corner of a cube pointing out of the page with the top 1802 of the sphere above the cube and the reminder of the sphere inside the cube.
  • FIG. 19 illustrates a sphere completely outside a model ( 19 a ), completely inside the model ( 19 b ) and embedded in the model ( 19 c ).
  • the sphere is preferably always accompanied by a text label where the label appears in a fixed pixel size on the canvas.
  • the label is preferably always drawn in front of any model geometry in the view.
  • the label text changes depending on which tool is using the center point sphere.
  • the label text when seen with the center tool is: CENTER
  • the view object wheel version of the orbit tool 114 (see FIG. 1 ) or command preferably always gets its pivot point from the center tool center sphere. It is preferably placed on the wheel at the bottom three quadrants. It also maintains a dominant up-axis of the scene or canvas.
  • a left mouse click anywhere in the orbit wedge hit zone invokes the orbit tool.
  • the last defined center point (from the center tool) is used as the orbit operation's pivot point.
  • Horizontal and vertical mouse movement rotates the view about this pivot point in the same way as the standard orbit tool does dragging the cursor on the canvas to the left orbits the camera view around the pivot point along the world Y axis and moves the camera to the left, the model appears to turn to its right. Drag to the right does the opposite.
  • Dragging the cursor upward orbits the camera around the pivot point on the X axis relative to the screen and moves the camera downward. Dragging the cursor down does the opposite. While the mouse is held down and the orbit tool is active the cursor is changed to the orbit cursor 706 (see FIG. 7 ). The cursor is allowed to wrap around the canvas when the Orbit tool is active. When the orbit tool is active the center point sphere is preferably displayed in the canvas and the sphere's text label is shown: CENTER. By default the system maintains the scene upright with respect to the model. If this default is off, the orbit tool behaves in screen space (not model space). When “Keep Scene Upright” is turned off, the orbit algorithm is changed to not force an explicit up direction.
  • a shift key modifier can be enabled that, on mouse-down presents a graphical roll ring 2002 (see FIG. 20 ) HUD centered around the current pivot point, where up/down mouse motion adjusts the roll values for the camera. Note that the label for the green ball pivot point is turned off while the roll ring 2002 is up.
  • the pivot or center point is moved to the center of the bounding box of the current selection. Subsequent orbit operations will use this pivot point unless it is moved again by another selection or other navigation actions (e.g., Pan operation, etc.).
  • the zoom tool 116 (see FIG. 1 ) is invoked by clicking while in the hit zones for the tools on the wheels 110 and 130 .
  • the typical zoom-in and zoom-out operations preferably occur relative to the center point set by the center tool.
  • the zoom for the view object wheel has some constraints placed on it that are not found in the version that is provided for the full navigation wheel.
  • the view version of zoom tool is constrained in the following by the system so that it cannot zoom (dolly) in further than its focus point, it cannot zoom out farther than the minimum size constraint, and it can only zoom directly in to the center of the canvas, as it uses the target point set by the center tool as its focus.
  • the zoom tool is preferably placed in the top of the center two wedges just above the rewind command.
  • the zoom tool has a graphical tooltip that includes the text: Zoom in or out from Center. Whenever the zoom tool is active, the target point is indicated in the HUD by the green center point sphere with a text label: CENTER.
  • the zoom cursor previously discussed is shown along with the zoom custom HUD with the text “Zoom Tool” below the cursor.
  • the zoom tool on the view object wheel preferably always uses as its target point the last point created by the center tool. This means that the view object wheel zoom tool preferably always zooms directly to the center of the canvas. Zoom is typically a camera dolly operation; it typically does not change the camera's field of view (FOV) in any way. Holding the Shift key when clicking the zoom tool inverts the single click zoom, and moves the camera view directly away from the target point.
  • the zoom out distance is preferably defined as 125% of the distance from the current camera view location to the target point location.
  • the zoom tool cannot zoom in forward beyond the target point.
  • the camera view will stop moving once it reaches the Target Point and further mouse drag in that direction will have no effect.
  • the user can always reverse mouse drag direction to zoom back away from the Target Point.
  • an additional message is displayed in the HUD: Change the Center point to zoom further
  • the zoom tool is also constrained when zooming out or away from the target point when using the view object wheel.
  • the camera view cannot be moved further away than a maximum distance, which is determined by the model's bounds. Once the view has backed out to this maximum distance the camera will stop and further mouse drag in that direction will have no effect. User can always reverse their mouse drag direction to zoom back inward.
  • a HUD message is provided as depicted in FIG. 21 with this figure indicating 2102 a maximum zoom-out has been reached. When the user has reached this boundary an additional message can be displayed in the HUD as depicted in FIG. 22 .
  • FIG. 22 shows that the HUD message is readable on a variety of background colors since it is always drawn with white text on a semi-transparent grey box.
  • the zoom tool can have additional modes available.
  • a “+” cursor is shown and the system allows the user to perform a “zoom extents” operation.
  • clicking and dragging define a rectangle which is visually shown to the user, to define a zoomed view.
  • zooms the view using an animation to match the defined rectangle as best as possible.
  • the visual zoom rectangle fades away.
  • a cursor drag up or drag right will zoom the view in.
  • a cursor drag left or drag down mouse will zoom the view out.
  • the directions for zoom-In are cursor drag up and right, but this can be inverted based on the zoom direction options dialog setting.
  • the mouse scroll wheel can also be enabled for the view object wheel. Scrolling the wheel forward causes the view to zoom, and backwards to zoom out. Zooming with the scroll wheel is preferably always towards, or away from, the center of the canvas. While scrolling with the wheel the target point sphere is displayed at the center of the canvas with the label discussed previously.
  • the rewind tool is found in all of the wheel interfaces. Its behavior does not change no matter which wheel it is found on. It is located in a wheel differently depending on the wheel.
  • the tool allows the user to navigate 3D spaces with a level of security as they can always rewind back through their navigation history to a previous view location.
  • the tool presents this rewind history as a set of onscreen thumbnails that show each step the user has so far taken so far.
  • the rewind tool also lets users interactively drag between the waypoint thumbnails to run back and forth through their navigation history animating the camera view as they do so.
  • a tooltip is shown below the wheel in the canvas with the text: Rewind through your movement history.
  • the system uses “waypoints” to facilitate the rewind function or command.
  • Each waypoint is a captured camera view position+orientation, along with a thumbnail of the model as seen from the camera's current view at that location.
  • the tools provided by the wheels e.g., forward, orbit, center
  • the ViewCube available from AutoDesk clicking or dragging
  • every camera and viewport combination has a separate Rewind navigation history queue.
  • a quad view (2 ⁇ 2 viewport) arrangement where there is a Front, Top, Right and Perspective camera/view, 4 separate Rewind queues are maintained.
  • the system stores the current view as a new waypoint and appends it to a history list for that camera/view combination.
  • This new waypoint is set as the “current” waypoint.
  • waypoints are preferably not captured or recorded (but can be) at stages during a tools usage, only at the ending view position when the tool interaction is completed.
  • Some tools, such as the walk tool described below, can generate multiple waypoints (see section below).
  • FIG. 23 a illustrates a cursor positioned over the rewind tool in the view navigation widget, when the user clicks on the tool, the widget fades-out and the waypoint history fades-in as shown in FIGS. 23 b and 23 c.
  • the rewind history list preferably works like an Undo/Redo mechanism, when the user rewinds and subsequently creates a new waypoint the new waypoint becomes the end of the history list and all others after it in time are discarded.
  • the rewind history is stored for the current model only. If a new section or model is loaded then the history is discarded.
  • the rewind history also persists across wheel switching and all of the wheels can make use of it in the same manner. When another tool is selected and the wheels are dismissed, the rewind history continues to be stored. When the user returns to navigation with the wheels by selecting them again, all previous history waypoints are retained and the user can rewind through them normally. A maximum number of history events are saved (by default 100 events).
  • a single mouse click on the rewind wedge in the wheels 110 , 120 and 130 will temporarily activate the rewind tool and display the history waypoint thumbnails as discussed above.
  • the rewind history is backed up to the previous waypoint in the list. That previous waypoint is set as the “current” waypoint.
  • the wheel is redisplayed and an animated camera transition is performed to transition the current view to the older waypoint's location and orientation.
  • the rewind history thumbnail strip is displayed during the rewind animation. If no history has been created yet and the user clicks the rewind tool, the system displays an empty rewind thumbnail and does not change the camera view in any way.
  • the arrow cursor is hidden and the cursor for the rewind tool, called the timeline or rewind cursor and composed of four corner brackets as shown in FIG. 24 a, is displayed while the mouse is held down. While the mouse is clicked or held down the rewind tool graphical tool description element (HUD) is displayed below the cursor on the canvas with the text: Rewind Tool. Note that this HUD element will appear in front of the thumbnails.
  • HUD graphical tool description element
  • FIG. 24 a is displayed.
  • This GUI is a set of thumbnails 2402 arranged in a row horizontally in the canvas over objects of the scene.
  • the most recent or current history waypoint's thumbnail 2404 is shown directly under the rewind cursor 2404 (angle lines around the thumbnail) and centered (vertical and horizontal) on the cursor position.
  • Older waypoint thumbnails are shown to the left and will be clipped by the canvas edge if there are too many to display.
  • Newer waypoints are shown to the right and also may be clipped by the canvas edge. (Clipping simply means these are HUD elements and will not be draw outside the canvas bounds.)
  • thumbnail's border will begin to brighten as shown in FIG. 24 b.
  • the border is brightest when the cursor is dead center horizontally on a given thumbnail.
  • the distance the cursor is currently placed between any two waypoint thumbnails is used to control the transition of the camera view between those two waypoint locations and orientations. So, if the cursor is halfway between two waypoints, the camera view will be smoothly animated to the halfway point between the two waypoint view locations using linear interpolation. The camera view is constantly updated to follow the transitions between these thumbnails and waypoints as the user drags over them using the linear interpolation.
  • This sequence of cursor position changes and corresponding scene changes is shown in FIGS. 24 a - 24 c. Note that additional positional hints (instead or in combination with linear interpolation) may be used to more accurately reproduce the motion history. A noticeable snapping occurs when the cursor is dragged near the center of a thumbnail to allow a user to match exactly the saved waypoint view.
  • the camera When the user releases the mouse the camera will remain at its current position and orientation even if this is part way between two waypoints.
  • the waypoint's information is replaced with the camera's current position+orientation+thumbnail. This last waypoint becomes the current waypoint and any new views will be created after it in the list.
  • the rewind cursor is constrained to move only horizontally and graphical “corner borders” are also displayed surrounding the cursor to frame the current thumbnail.
  • thumbnail strip scrolling To access rewind history beyond what is currently visible in the thumbnail strip on the canvas, an automatic thumbnail strip scrolling has been defined.
  • the rewind cursor remains fixed and the thumbnail strip begins to move in the opposite direction of the mouse movement. This movement is position-based not rate-controlled.
  • waypoints are typically saved at the end of tool operation and at intervals within some tools. However, it is possible to constantly record waypoints in “high resolution” with small separations in time between them.
  • the tour building wheel 120 (see FIG. 1 ) is primarily focused towards moving the camera (user) about in 3D building models or virtual spaces. It allows for forward movement, looking about, and moving between vertical floors. Along with the common close and menu buttons, this wheel provides four tool wedges: forward, up/down, look and rewind. The rewind tool has been discussed above. Normally the middle mouse scroll wheel (hardware) is allowed to zoom the view in or out. While the tour wheel is active the zoom behavior of the middle mouse scroll wheel is disabled to prevent the user from escaping the constraints that are placed on 3D view navigation while using the tour wheel.
  • the forward tool or command is located at the top center of the tour building wheel 122 (see FIG. 1 ) occupying the top three quadrants of the outer ring and is the primary method for moving the camera for the tour wheel.
  • the tool tip text 2502 for this tool is: “Click to set target. Drag to adjust distance to the target.” as shown in FIG. 25
  • the forward tool moves the view towards a clicked focus point location.
  • a focus point is defined by projecting the cursor location on the canvas onto the model surface using ray casting in a “click-through” type manner. If no model part falls under the cursor then camera view will not move forward and a prohibited operation cursor 2602 (see also 710 of FIG. 7 ) is temporarily displayed as shown in FIG. 26 . If a model is found then the focus point is set, and the camera is animated moving (zooming) in towards the target point when the mouse is released. The total distance of this move is preferably half of the distance from the current view plane to the focus point. While animating the view forward, the wheel and the cursor are preferably hidden.
  • the center point sphere is reused as the target point and the sphere remains displayed until the user releases the mouse. For this tool the sphere has no label. Instead an endpoint 2702 of a perspective slider (HUD) 2704 reads: Surface—as depicted in FIG. 27 a. A mark 2706 is shown at the very bottom of the scale indicating the starting camera position. This marker is labeled with text: START. The distance indicator 2708 is displayed during the click to go forward camera transition. A distance marker 2708 moves along automatically with the camera motion. FIG. 27 b shows the wiper or marker 2708 between the start position and the surface. The wiper changes size based on the drag distance (i.e., depth into the scene).
  • HUD perspective slider
  • This element is shown while dragging to set distance (also while the view is animating with the click to go forward behavior above.)
  • This display element is placed into the view just below the cursor on the canvas.
  • the distance indicator HUD is hidden.
  • This graphical display gives feedback on the distance moved from the camera view's starting position towards the focus point.
  • An optional set of dotted lines or pass through markers are shown above and below the target marker, these indicate that the user may go forward beyond the target (surface), or that they may back up past the start.
  • Clicking and dragging on the forward tool wedge also sets the focus point in the same manner as for the click to go forward behavior described previously, but instead of animating the camera towards the target automatically, the user may drag the mouse to move the view forward (and back) to set the distance to the focus point interactively.
  • the user may perform both the forward and backward movement with a single mouse drag action. This is basically a zoom interaction but the zoom amount is capped in both directions. While interactively dragging the view with the forward tool, the tour building wheel is hidden. Dragging the mouse/cursor upward moves the view forward. Dragging the cursor downward does the opposite.
  • the zoom forward distance is capped so that when the user has moved (dragged) forward right up to the focus point position, the tool resists further mouse drag beyond that point in a resistance zone, which is a percentage of the distance to the surface, such as 95%. If the user continues to drag the mouse in the forward direction for a period of time, they will be allowed to “pop-through” the view to beyond the existing focus point position and continue to zoom in/move forward from there. This behavior allows users to push through solid surfaces or walls.
  • the user may also interactively move backwards from their starting position towards an invisible focus point that is behind the camera view.
  • a “sticky point” or range of no movement is defined for the start position of the forward tool. To go backwards, the user must drag some distance downward to move off the sticky point. Similar to the forward movement, a ray is cast behind the camera view plane to try and see how far the user can move without entering a wall or passing through a model surface. If a surface is found, the camera is allowed to only move backwards as far as 1 ⁇ 2 the distance from the start position to the surface found behind the camera.
  • a user places cursor over target and clicks on the forward tool wedge.
  • the distance indicator HUD is shown just below the cursor's last location
  • the current position indicator is placed at the start position on the bottom of the vertical scale
  • the focus point sphere is shown in the model view
  • the arrow cursor goes away (see image 1 of FIG. 28 ).
  • the user has clicked on the wall to the right of the fireplace.
  • the user can now drag the mouse to move forward (image 2 ), while doing so the camera is animated forward (zoom in) and the current position indicator or marker (having a color such as orange) moves up along the scale towards the “Surface” marker.
  • the up/down tool 126 (see FIG. 1 ) is located in the bottom center wedge of the tour wheel and in the bottom right quadrant of the full navigation tool ( 130 ).
  • the up/down tool gives users a way to move their view vertically between floors or levels of a building using an up vector in the model. Note that this is different than what is possible with the pan tool. Panning is dependent on the camera orientation. For example, if you are looking down at your feet (mostly looking at the floor) and then try to pan up to get to the next floor above you, this would take a long time and significantly displace you since you are sliding along the camera plane (screen space) which, when looking down, is at an angle with respect to the floor planes.
  • the up/down tool slides along a Y-up axis of the scene without displacing the user along the horizontal plane of the view.
  • a bounding box of the model (plus a small amount of extra padding 10-15%) is used to determine an absolute high and low Y axis values.
  • the up/down tool is constrained by these values and cannot push the view beyond them in either direction.
  • the following rules apply. If the camera is already above the bounding box high mark when the user first clicks and drags the mouse, then the system uses the current camera position as the high mark. If the camera is already below the bounding box low mark when the user first clicks and drags the mouse, then the system uses the current camera position as the low mark.
  • the display shows a slider or scale 2902 that is similar to that of the forward tool display.
  • This HUD is displayed centered vertically at the cursor's last position on the canvas, and vertically with the current position Indicator aligned the cursor's last location.
  • the top 2904 of the scale is marked to show the highest point that the camera or view can be moved to with this tool.
  • This point on the scale has a label: Top.
  • the bottom 2906 of the scale is marked to show the lowest point that the camera can be moved to with this tool.
  • This point on the scale has a label: Bottom.
  • An indicator marker 2908 (preferably orange in color) shows the current camera view position relative to the High and Low positions. When the user moves the view up or down a slightly dimmer orange marker or shadow indicator 2910 is left in place to show the starting view position on the scale.
  • FIG. 29 b shows an up and down motion.
  • the drag amount of the mouse can vary the up/down camera direction directly or alternatively can move using a rate control design; this allows for small initial incremental camera movements and with more cursor dragging larger camera movements.
  • the look tool on the tour wheel has movement keyboard keys disabled whereas on the full navigation wheel, as discussed below they are enabled.
  • the look tool 124 located in the top half of the middle circle on the tour building wheel 120 (see FIG. 1 ) and on the lower left quadrant of the inner circle of the full navigation tool 130 as will be discussed later herein.
  • the tool tip when the cursor hovers over this tool reads: Look around your current position.
  • a horizontal drag or X-axis mouse movement causes the view to rotate to the left or right.
  • a vertical drag or Y-axis mouse movement causes the view to rotate up or down.
  • the up and down looking is optionally constrained so that the view never flips upside down.
  • the camera or view can be rotated until it looks nearly straight up or down in the tour wheel, but not beyond.
  • the Look tool is active the cursor is changed to the look cursor 702 as shown in FIG. 7 .
  • the cursor is allowed to wrap around the canvas when the look tool is active.
  • the full navigation wheel 130 contains eight tools: walk, up/down, look, center, orbit, zoom, rewind and pan.
  • the walk tool 132 allows users to interactively walk about in 3D space, moving forward and backwards and/or turning freely to the left or right.
  • the walk is preferably along a horizontal axis or plane of the scene.
  • the walk tool also allows shortcut key access to the up/down tool to adjust the view up or down while walking.
  • the walk tool is preferably located in the top right interior wedge on the full navigation wheel.
  • the tool tip text is: Click and drag in the direction you want to walk.
  • the direction of the cursor from the center target or zone 3102 determines the walk direction. Up is forward, down is backwards, left is turn left, right is turn right, and diagonal combines the two closest headings.
  • the distance of the cursor from the center target 3102 determines the speed of walking. The closer to the center is slower, farther away is faster.
  • a default speed is set based on scene space parameters, such as the size of the bounding box, and can be changed by the user. Placing the cursor over the center circle area 3102 will stop camera or view movement. At any time the user may release the mouse button to end walking and redisplay the wheel.
  • While walking the cursor is changed to an arrow (a direction indication cursor) 3202 that indicates the current move direction and rotation.
  • arrow a direction indication cursor
  • the diagonal arrow cursor 3202 indicates that the user is moving forward and turning to the left.
  • cursor 3302 There is a default cursor 3302 for when the camera is not moving and the cursor is hovering inside the center circle or zone as shown on the far left of FIG. 33 .
  • HUD text While the walk tool is active the following text is displayed as a HUD element on the canvas: Hold down Shift key to move up or down. This HUD text does not follow the cursor movement, and is instead fixed to the lower center of the canvas area.
  • the walk tool is suspended while the Shift key is held and the up/down tool is active and operates as previously discussed.
  • Shift is pressed the cursor location (and therefore the walking speed and heading) are temporarily stored.
  • the shift key is released the cursor is placed back to its previous location and the walk operation continues on from where it left off.
  • a walk tool option allows users to adjust the walking movement direction based on their current camera looking direction instead of the default ground plane. Thus, it can be used in combination with the look tool to move around in 3D space.
  • the system defines multiple rewind events during a single mouse drag walk event. Preferably, this is the only tool that allows for multiple rewind events to be defined.
  • a walk rewind event is preferably recorded every 5 seconds. Consequently, a thumbnail is added to the rewind thumbnail strip (history) for each event. If it is not possible to create thumbnails during a walk (due to performance issues or if it is too noticeable during the walk), it may be possible to create the thumbnails on the mouseUp event or, a less favorable solution, to use the same thumbnail for all multiple walk events belonging to a given long walk drag history.
  • To increase walk speed (increase movement rate) the user presses CTRL+Shift+>.
  • To decrease walk speed (decrease movement rate) the user presses CTRL+Shift+ ⁇ .
  • Alternative hotkeys may be used.
  • the look tool 136 on the full navigation wheel 130 allows the user to move the view while looking by pressing the arrow keys on the keyboard.
  • the tool is located on the bottom left interior wedge on the full navigation wheel 130 (see FIG. 1 ).
  • the tool tip text is: “Look around your current position. Press arrow keys to move.”
  • To look left or right an horizontal drag or X-axis mouse movement in the view causes the view to rotate to the left or right and to look up or down, vertical drag or Y-axis mouse movement causes the view to rotate up or down (drag left allows you to look left; drag up to look up; etc.).
  • This up and down looking in the full navigation tool is not constrained so that the view can flip upside down.
  • the camera can be rotated continuously until the view somersaults.
  • the look tool can also have an additional mode.
  • the system performs a “look at” operation. Similar to the Center tool, the green ball is positioned and can be dragged along the model surface. The surface beneath the green ball is highlighted. Once the key is released, the view animates to move the green ball to the center of the view, roughly keeping the zoom factor the same but orients the view to be looking “head-on” to the surface where the green ball resides (e.g., the surface normal is pointing directly at the user/camera).
  • Shortcut key inputs from the keyboard are provided to extend the look tool for users using the full navigation tool who have keyboard access. These keys will cause the camera to move forward or backward, and left or right. These movement commands are available while the look tool is active. (left mouse down).
  • the forward key command causes the camera or view to move forwards (dolly in) based on the camera's current heading. For example, if the user is looking straight up and presses this key they will fly up into the air like superman. If they are looking straight ahead they will fly directly ahead.
  • the camera movement rate for the keys is determined by a walk speed factor that can be set by the user.
  • the move backwards key command causes the camera to move backwards (dolly out) based on the camera's current heading.
  • the move left or sidestep left key command causes the camera to move to the left as if the user was panning horizontally.
  • the move right or sidestep right key command causes the camera view to move to the right as if the user was panning horizontally. No up or down movement key is provided.
  • Both the walk tool and the look tool take into consideration the scales of the model space in which they are operating.
  • the speed to move through an engine block is very different than what will work to move past the Empire State Building.
  • a base movement rate value is automatically calculated, based on the model's bounding box when the model is loaded.
  • Both look and walk use the same base setting. Increase or decrease speed commands can modify this base move rate setting to fit the user's needs, and these ⁇ modifications can be stored for the duration of the session.
  • the cursor When the look tool is active the cursor is changed to the look cursor 702 as depicted in FIG. 7 .
  • the cursor is allowed to wrap around the canvas while the look tool is active. While the mouse is held down the look tool graphical tool description element is displayed below the cursor on the canvas with the text: Look Tool.
  • the orbit tool 114 appears on both the view object wheel 110 and the full navigation wheel 130 .
  • the version on the full wheel uses the same mouse control scheme to orbit the view about a pivot point, but this tool has a more dynamically defined pivot point that is not always directly in the center of the view.
  • the tool is located on the left side wedge of the full wheel 130 (see FIG. 1 ).
  • the pivot point location for the orbit tool is being constantly updated. By default the pivot is set to the center of the screen.
  • the center point sphere 1602 (see FIG. 16 ) is preferably used for the pivot point. The sphere remains displayed until the user releases the mouse.
  • the sphere label text is: PIVOT.
  • the cursor is allowed to wrap around the canvas while the orbit tool is active.
  • the Keep Scene Upright option is on. If it is turned off, then the orbit tool behaves in screen space (not model space).
  • “Keep Scene Upright” is off a Shift key modifier is enabled that, on mouse-down presents a graphical ring HUD (see FIG. 20 previously discussed) centered around the current pivot point, where up/down or left/right mouse motion adjusts the roll values for the camera. The label for the green ball pivot point is turned off while the roll ring is up.
  • Pan operation of the full wheel is preferably a common pan operation except that the clicked point in the view will stay fixed to the cursor and not go flying off too fast or too slow.
  • a single click to zoom in behaves like the single click behavior for the view wheel zoom tool, with the following exceptions.
  • the target point is set based on where the user placed their cursor over the model, not the center of the canvas. The user is allowed to click anywhere on the canvas to set the zoom target point and zoom will zoom into this location. This behavior may be turned off.
  • the single click to zoom out (Shift+left mouse button click and release) zooms out away from the clicked point on the canvas.
  • the target point is set based on where the user placed their cursor over the model, not the center of the canvas. The user is allowed to click on ‘nothing’ and can still zoom.
  • This Zoom tool also supports the invert mouse zoom option setting where the zoom can cause the scene to be inverted.
  • the target point is indicated as a green sphere with a text label and is the same HUD graphic as for the Center tool shown earlier.
  • the mouse scroll wheel will zoom in to the last defined pivot/focus point in the same manner as the CTRL+Zoom shown above.
  • the mini wheels are designed for advanced users and provide even more rapid access to the navigation action tools.
  • Three Mini wheels exist which are task-based: mini view object wheel 142 , mini tour building wheel 144 and mini full navigation wheel 146 .
  • the action tools within each mini wheel behave exactly like the big full wheel.
  • the gestural and spatial location are similar to the big full navigation wheel. For example, orbit is on the outer left wedge in the big full wheel and the mini view object wheel.
  • the mini wheels are preferably small (32 ⁇ 32 pixels) and replace the default “arrow” cursor. In this default small mode, the arrow cursor is turned off.
  • the mini wheels can be made larger than the default 32 ⁇ 32 and in these cases, the arrow cursor is preferably made visible along with the active mini wheel.
  • the mini view object wheel 142 contains the tools: zoom (top wedge), rewind, (right wedge), pan (bottom wedge), and orbit (left wedge).
  • the mini tour building wheel 144 contains the tools: walk (top wedge), rewind (right wedge), up/down (bottom wedge), and look (left wedge).
  • the mini full navigation wheel 146 contains the tools: zoom (top wedge), rewind (right wedge), pan (bottom wedge), orbit (left wedge), center (top-left wedge), walk (top-right wedge), up/down (bottom-right wedge), and look (bottom-left wedge).
  • Showing the standard arrow cursor within a mini wheel or pie cursor can be visually heavy and confusing. Preferably no cursor is shown and the mini wheel visually acts as the cursor. However, there may be times when it is useful to have a visible cursor. In such a situation, a smaller dot cursor (what can be called a flea cursor) can be provided as depicted in FIG. 34 a or a miniaturized arrow cursor within the pie cursor that indicates the precise mouse input and active hotspot can also be provided as depicted in FIG. 34 b. A further alternative is to not show the mini wheel cursor but display a modified arrow cursor as depicted in FIG. 34 c.
  • a velocity based alternative can serve as a means of switching between command selection (high velocity mouse movement) and precision pointing (low velocity mouse movement).
  • the user can hit a modifier key such as the Shift key which will lock-in the currently highlighted tool in the mini-wheel and replace the mini-wheel with an arrow cursor. Holding the Shift key will also retain the current tool for multiple mouse movements/clicks and allows the user to repeat a command multiple times until the Shift key is released and the mini-wheel returns
  • All of the wheels can share a particular key as a shortcut key. Pressing this shortcut can bring up the last used wheel for 3D, or just bring up the 2D wheel for 2D content. Tapping the shortcut key when a wheel is already up will bring the wheel down and activate the last tool (e.g., Select Tool).
  • the CTRL+Shift or another key can be used as a shortcut key or hot key to activate/deactivate the wheels. Activating a wheel should occur “transparently” from the current tool. For example, if the a first tool is active, a user can hit Ctrl+Shift to activate the view object wheel, navigate, hit Ctrl+Shift again to bring down the wheel and be placed back into the first tool to continue working.
  • This shortcut key process 3500 is depicted in FIG. 35 and starts with the user activating (pressing) and the system detecting the trigger key 3502 .
  • the system checks 3504 to determine whether the corresponding tool is active and, if so, when the user releases 3506 the key, the system checks 3508 to see whether the key was held down for at least a threshold amount of time, such as — 1_ seconds. If held down for the threshold time, the tool is kept 3510 active, otherwise it is deactivated 3512 . If the initial check 3504 indicates that the tool is not active, it is activated 3514 . When the user releases 3516 the activation trigger, the system again checks 3518 the hold down time against the threshold, deactivates 3520 the tool when not met and keeps 3522 it active when met.
  • the center tool operation is depicted in FIG. 36 and starts with the user pressing the mouse button which is detected 3602 .
  • the system checks 3604 to see if the cursor is over the model by ray casting the cursor into the scene and determining whether the ray encountered the model. If the cursor is over the model, the intersection point is determined 3606 and it is displayed 3608 on the model, preferably as the green ball. If the cursor is not over the model, the invalid operation message is displayed 3610 .
  • the system determines 3612 whether the mouse button has been released and, if so, again checks 3614 to see if the cursor is over the model. If so, the model is moved or animated 3616 so that the intersection is in the center of the screen.
  • the green ball or center sphere When the green ball or center sphere is used, it can be moved about in the model space. As depicted in FIG. 37 , when the user presses 3702 a mouse button, the system checks 3704 to see if the cursor is over the model. If so, like described above, the intersection point is determined 3706 and the sphere is displayed 3708 at the intersection point of the model. If not, the system checks 3710 as to whether the active tool allows the sphere to be anywhere in the model space. If so, the sphere is displayed 3712 at a specified depth into the model from the current view position, such as the depth position from the last time it was on the model. If the sphere is currently displayed 3714 on the model, the sphere is not moved 3716 and, if not, the sphere is not displayed 3718 . The button status is then checked 3720 and if it is not down, the sphere is not displayed 3722 .
  • this operation starts with the user moving 3802 the input device for moving the cursor and this being detected.
  • the x position is set 3806 to zero.
  • the x position is set 3810 to the window width.
  • the y position is set 3814 to zero.
  • the y position is set to the window height 3818 .
  • the zoom operation starts with the user initiating 3902 the zoom tool as depicted in FIG. 39 .
  • the system checks 3904 to see if the mode is the zoom point mode. If not the existing pivot point (the sphere) is displayed 3906 . If in the point mode, a check 3908 on whether the cursor is over the model is performed. If so, the point is determined 3910 and displayed 3912 . If the cursor is not over the model, the intersection point based on the alternate metric is displayed 3914 , such as setting the point a predetermined distance into the space from the current camera position or view point as previously described.
  • the camera or view is moved 3916 along the vector (in or out depending on the cursor motion) from the cursor to the pivot point. The motion of the camera is adjusted 3918 based on maximum limits and whether the pivot point has been encountered.
  • the mouse button is released 3920 , motion stops.
  • the rewind history is saved and this operation 4002 is shown in FIG. 40 .
  • the system checks 4004 to see if this tool requires intermediate waypoints and, if so, the elapsed time since the last waypoint was saved is checked 4006 against the waypoint interval. If it is time to add a waypoint, the current view state information is added 4008 to the rewind history and a thumbnail is created. When the tool does not require period waypoints, the system waits for the current tool operation to end 4010 and then saves 4012 a new waypoint.
  • FIG. 40 a illustrates a linked list data structure used for the movement history where each entry 4020 includes view location, orientation, etc.
  • FIG. 41 shows the flow of the rewind tool operation.
  • the hold down period of the tool is compared 4104 to a threshold and if it is less than the threshold, the system moves or animates 4106 the view back one step (or back to the place where the last thumbnail was saved).
  • the view is updated or animated 4110 , preferably linearly based on the thumbnails involved in the motion of the rewind cursor as previously discussed. While the mouse button is down 4112 , the motion can continue.
  • the system determines 4204 whether the cursor is over the model as depicted in FIG. 42 and if not the invalid operation cursor and message is displayed 4206 . Otherwise, the intersection point is determined 4208 and displayed 4210 along with the motion scale (see FIG. 27 ), followed by a move 4212 of the view a predetermined distance to the intersection point, such as preferably 50%.
  • the scale is updated to show the amount of movement. If the cursor is moved up 4214 , the movement percentage is increased 4216 . If the cursor is moved down 4218 , the percentage is decreased 4220 . When the mouse button is released 4222 , the movement percentage is used to move both the view and the marker on the perspective scale.
  • the up/down tool flow is activated 4302 and when the user moves 4304 the cursor, the camera view is moved 4306 along the up vector (a vector vertical with respect to the model) based on the current position as shown in FIG. 43 .
  • the camera position is adjusted 4308 based on the minimum and maximum positions.
  • the up/down scale is updated and displayed to show the move. This continues as long as the mouse button is down 4310 .
  • the walk tool when activated 4402 , the system warps 4404 the cursor to the starting position as previously discussed.
  • the speed is set 4408 to zero.
  • the view is moved forward based on a speed that is increased 4412 responsive to the distance the cursor is above the start region.
  • the view is moved based on a speed that is decreased 4416 responsive to the distance the cursor is below the start region.
  • the view is rotated right 440 based on the distance the cursor is to the right of the start region.
  • the view is rotated left 4424 based on the distance the cursor is to the left of the start region.
  • the pan operation when activated 4502 by clicking through the pan tool, determines 4504 whether the cursor is over the model. If so, the intersection point is determined 4506 and a C:D ratio (the rate of movement speed) is set 4508 based on the distance to the intersection point and the scene is panned based on the motion of the cursor using the ratio. If not over the cursor, the C:D ratio is set 4510 based on an alternate metric, such as the dimensions or size of the model space and the scene is panned responsive to cursor motion.
  • a C:D ratio the rate of movement speed
  • the mini-wheel activation when activated 4602 by clicking through the pan tool, determines 4604 whether the cursor is within the wheel boundary. If not, the position of the wheel is updated 4606 . If so, a determination 4608 is made as to whether the cursor is in the highlighted wedge. If not, a determination is made 4610 as to whether it is within the specified distance of the wedge. If not, the wedge is highlighted 4612 .
  • Perspective and orthographic projections differ in that orthographic projection has no sense of depth.
  • a great disparity can emerge between the two after several camera operations have been carried out.
  • FIG. 47 Depicted in FIG. 47 is an approach 4700 to maintaining parity between perspective and orthographic projections, by using a single camera model, from which both orthographic and perspective viewing frustums can be derived.
  • the standard pinhole perspective camera model has been augmented to include the distance to the geometry in the scene. This is updated whenever the camera position changes. That is, the user performs a camera move operation 4702 , the camera parameters are updated 4704 and the distance to the object is updated 4706 .
  • a determination 4708 is made as to whether the mode is projection or perspective. If perspective, the perspective frustum is calculated 4710 . If orthographic, the distance is used to calculate 4712 the frustum. After the frustum is determined, the view is rendered 4714 .
  • This distance value is used when calculating 4712 the orthographic frustum; the parameters of orthographic width and height are calculated from the pinhole camera model as follows:
  • d is the distance to the geometry in the scene
  • f hor and f ver are the horizontal and vertical field-of-views, respectively.
  • the approximate distance to the object can be calculated based on the distance of the perspective camera's eye to the center point. In doing this the position of the center point is updated throughout all camera operations and generally lies on scene geometry. This is an effective and computationally inexpensive way of approximating distance to the geometry in the scene.
  • the magnitude of the view direction vector is transparent to the perspective projection model. However, as this is an approximation, it does not work in all cases.
  • Another approach is to calculate the actual distance to the geometry view for every frame. While this ensures the calculation of the orthographic frustum is accurate, it is computationally expensive. Carrying out such calculations on a graphics processing unit (GPU) helps reduce the load on a central processing unit (CPU) but can result in slower than real-time interaction for complex geometry.
  • GPU graphics processing unit
  • CPU central processing unit
  • the typical hardware 4800 for the system discussed herein, as depicted in FIG. 48 includes a display 4802 that can be a non sensitive display or a sensitive display such as a touch or stylus type display screen as used in tablet or lap top type computers.
  • the display is coupled to a computer 4804 that can have the power of a cell phone, PDA, lap top, desk top or server type computer.
  • a keyboard 4806 is provided for the key based operations.
  • a mouse 4608 or other cursor position control input device is used to control the cursors discussed herein.
  • a digitizing tablet 4810 that uses a stylus 4812 can also be coupled to the computer. Other types on input devices that allow selection and cursor motion can also be used.
  • the computer has associated memory and other types of storage capability (CD, hard disk, DVD, etc.) to allow the programs or processes and data structures discussed herein to be stored.
  • the system can operate over a network as the need arise for more power or speed with the processes, etc. being distributed.
  • the embodiments of the present invention discussed provide a safe 3D navigation environment by clustering and caching tools; creating task and skill-based tool sets; providing orientation awareness; enhancing tool feedback; providing pre-canned navigation; preventing errors; and recovering from errors. Rapid access and use are provided by the tracking menu and click through features.
  • the circular design of the wheels with important action tools on the exterior and less used tools in the interior organizes the tools so they are easy to access in an order that fits the tasks.
  • the tool selection dialogs that allows new and advanced users to select a navigation tool makes the users quickly aware of what is available and what are the navigation tool uses and allows immediate selection.
  • the task grouping of commonly used tools for and limited to types of tasks helps prevent users from becoming confused during navigation.
  • the customization of the action tools for the type of task also prevents confusion and errors during navigation.
  • the sphere provides visual feedback to orient the users and the limitations on placement of the sphere prevent navigation errors.
  • the sliders provide location feedback for dragging operations. Labels and icons reinforce the operations of the tools being used. Constraints on navigation, such as limiting motion to the bounding box or to a rear wall along with cursor control like the cursor screen wrapping, keeps users from getting into visually confusing states. Error recovery using rewind allows users to return to a familiar visual state.
  • the 2D navigation wheel can automatically become the selected tool.
  • the 2D navigation tool is selected tool and the user navigates to a 3D model, the last used 3D Wheel will become the selected tool. If the ‘pinned’ option is enabled, show the 3D wheel pinned to the canvas. If a non-compatible section type is displayed in the canvas the wheel(s) are dismissed and the Select Tool is activated instead.
  • the wheel may be preferable to offer spring-loaded activation of the wheel. That is, only when the hotkey is pressed down, the wheel is visible and a user can interact with it. Once the hotkey is released, the wheel goes away. Again, this is an optional offering depending on the available hotkey and ease of articulation.
  • a 3D navigation tool palette may offer: Forward, Look, Rewind, and Up/Down tools as one set and Center, Zoom, Rewind and Orbit as another set.
  • the shapes of the Tracking Menus may be altered (from circles to other shapes such as ovals or squares) and the tool regions shapes may be reshaped and their proportions changed.
  • the positioning of the tools may also be rearranged (e.g., the Orbit wedge on the left side of the wheel could be moved to the top wedge).
  • green ball may be different colors or shapes (e.g., square or pyramid or cross), orientation demarcations (e.g., tick marks instead of axis belts) and have different transparency dynamics.
  • help text in the HUDs and tooltips change based on the language settings of the computer (e.g., French, Chinese, etc).
  • the Rewind tool can have different visual representations for each waypoint and be presented to the user in different styles (such as a line with beads on it or timestamps, or a stack of thumbnails or a stack of graphical objects) and different orientations (e.g., vertical instead of horizontal or in 3D).
  • the Rewind mechanism can be attached to different input devices such as the mouse scrollwheel. Additional information can be saved in the Rewind queue beyond camera position and orientation such as user settings, background color and styles, environment settings, rendering modes (e.g., line or shaded), camera options such as orthographic or perspective projection, etc.
  • the previous state information is installed.
  • interpolation of application state information can occur between two waypoints. For example, if the user switched between perspective and orthographic projection, these two projection modes would be blended when rewinding between the two waypoint events.
  • thumbnail strip In addition to the thumbnail strip, supplementary information can be presented such as user or system annotations or indicating which tools were active during the navigation history or other system activity.
  • the Rewind thumbnail strip and graphics may be drawn semi-transparently.
  • navigation events may be created by the system (not explicitly by the user). These can be added to the Rewind history.
  • events may be compressed or combined. For example, navigation events that occurred in which the view did not change or in which the view was composed of viewing empty space, are candidates for being dropped from the Rewind history or compressed into a single event.
  • the perspective sliders can be used in other contexts where for example 3D depth information is useful to indicate. Note that an interesting property of the perspective slider is that it can take less visual space than a 2D slider since it is drawn in perspective.
  • the perspective slider does not have to relate to positional information about the 3D scene. For example, it can adjust volume settings. The point is that it is drawn in perspective and the perspective may not even match the current perspective in the 3D scene. Also, it could be used in a 2D canvas or 2D application.
  • the slider can be drawn such that it become more transparent as the slider is deeper in the scene.
  • the “Start” end of the slider would be more opaque and the “Surface” end would be more transparent.
  • the perspective slider can be drawn in many different visual ways using different metaphors such as a measurement ruler, or a road/driveway.
  • Input snapping at interesting points along the slider may also be added for additional user control.
  • the up/down slider may also have additional graphics, annotations and tick marks on it to indicate application specific information or sizing/scale information.
  • tick marks may indicate floors in a building or where important elements are in a building (such as pipes, electrical junctions, etc. Drag snapping can occur at designated points along the slider for precise movement. In some cases, it may be useful to enable the tool without drawing the graphical slider.
  • the slider may also be drawn semi-transparently. The preferred behavior is for the slider to initially appear near the current cursor position but it may be useful to have it come up in other locations such as the center of the 3D canvas.
  • Pre and Post actions may be conducted while using the slider. For example, temporarily leveling the camera such that it is parallel to the ground plane before and after actions are performed while using the Up/Down slider.
  • the mouse movement can be mapped to a non-linear function to move the camera.
  • a non-linear function For example, an exponential function (which we use), has the property that initial mouse movement move the view in small amounts (for precise adjustments) and as the drag motion gets longer, large view movements are generated. This design is handy if the user is viewing a condominium building and wants to either move up/down in small distances (e.g., within a floor) or large distances (multiple floors at a time).
  • the Walk tool may deploy intelligent sensing to automatically determine a constant height above the current “ground plane” or horizontal surface the camera is currently over. Smoothing algorithms would make the transition to different heights more visually pleasing. Additional sensing could be used to avoid objects or walls.
  • application specific or user customized HUD messages and graphic annotations can be triggered and displayed depending on the user's current location, direction and speed of travel.
  • the system may deploy “level of detail” adjustments in the graphics rendering of the scene—drawing fewer polygons and performing less rendering in dense scenes to approximate the visuals to keep the refresh redrawing at a high rate. Hotkeys may be used to increase or decrease the speed factor of the walk movement.
  • left/right action and the up/down action be assigned to different parameters (e.g., navigation directions).
  • left/right may pan the user left/right instead of the default look left/right.
  • up/down mouse direction map in the up/down direction instead of the in/out direction.
  • the method of cursor-wrapping can be activated while the user input is in the tracking state (e.g., moving a mouse device with no buttons pressed) or during a drag state (e.g. moving a mouse device with the left mouse button pressed).
  • the cursor-wrapping is active when a tool is active (such as dragging while orbiting).
  • cursor-wrapping With cursor-wrapping, the concepts are the same for a view displaying a mixture of 2D and 3D or purely 2D content.
  • an audio signal or visual signal can be displayed near the cursor location. For example, a chirp sound may be heard and the cursor could fade out, then fade in on the other side.
  • a small animation could be played showing a puff of smoke near the cursor location.
  • clip the cursor and auxiliary graphics re-format or reposition the auxiliary graphics to remain visible until the cursor completes its wrap; always keep the cursor displayed whole but allow auxiliary graphics to be split.
  • the cursor-wrapping boundary may be dynamically defined to be not the current view boundary but the boundary of the currently selected object or set of objects in the scene.
  • the cursor-wrapping boundary could be dynamically determined to be the bounds of the object it currently is over. Both of these cases are useful in that it keeps the cursor near where the user is working and auxiliary information that is moving with the cursor (such as dimensioning, status info, or state information) can remain nearby.
  • some embodiments will only implement the quick tap toggle to activate/deactivate a tool and not the spring-loaded tap to activate a tool. In the quick tap situation, the trigger will often require that “no mouse buttons are pressed” as this is typically reserved for modifying the current selection.
  • the First Contact pop-up mechanism is anchored to some visual element (e.g., a tool icon button in a toolbar or a widget in the 2D/3D scene). In our case we put a grayed-out 2D graphic on top of the 3D scene.
  • FirstContact One style of FirstContact is that the FirstContact graphics and tool choosing should be seen only until the user activates the tool for the first time. This is to reduce information overload and clutter. The next time the user hovers over the anchor element, the FirstContact will not be presented. This state information is preserved in the user preferences and thus when the application is re-launched, FirstContact exposure is respected.
  • the “green ball” navigation sphere has some important characteristics.
  • the sphere becomes more transparent as the user gets closer during a camera movement operation (such as zoom) until the sphere is completely transparent.
  • the size of the sphere resets after any camera movement operation.
  • the sphere When the sphere is interactively moved within the 3D scene, its size changes depending on the depth location information. By default, the sphere does not cast a 3D shadow but it could if desired. A texture could be added to the sphere to alter its appearance.
  • the sphere could change color when the tool is being used (i.e., mouse down).
  • the sphere could change shape, color or be annotated with graphics or icons to indicate state or mode information.
  • the sphere could indicate if dimensional constraints were active (e.g., only allowing orbit in x dimension).
  • modifier keys can be used for all of the tools to add additional functionality.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Data Mining & Analysis (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
US12/200,373 2007-09-26 2008-08-28 Navigation system for a 3d virtual scene Abandoned US20090083672A1 (en)

Priority Applications (10)

Application Number Priority Date Filing Date Title
US12/200,373 US20090083672A1 (en) 2007-09-26 2008-08-28 Navigation system for a 3d virtual scene
US29/309,691 USD625327S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen
US29/309,693 USD624933S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen
US29/309,694 USD623656S1 (en) 2008-08-28 2008-09-26 Transitional icon for a portion of a display screen
US29/309,692 USD625328S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen
US29/309,688 USD626560S1 (en) 2008-08-28 2008-09-26 Transitional icon for a portion of a display screen
US29/309,689 USD623658S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen
US29/309,687 USD625324S1 (en) 2008-08-28 2008-09-26 Transitional icon for a portion of a display screen
PCT/US2008/077928 WO2009094051A1 (fr) 2007-09-26 2008-09-26 Système de navigation pour scène virtuelle en trois dimensions
US29/309,690 USD625732S1 (en) 2008-08-28 2008-09-26 User interface for a computer screen

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US97536607P 2007-09-26 2007-09-26
US2264008P 2008-01-22 2008-01-22
US12/200,373 US20090083672A1 (en) 2007-09-26 2008-08-28 Navigation system for a 3d virtual scene

Related Child Applications (8)

Application Number Title Priority Date Filing Date
US29/309,693 Continuation-In-Part USD624933S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen
US29/309,694 Continuation-In-Part USD623656S1 (en) 2008-08-28 2008-09-26 Transitional icon for a portion of a display screen
US29/309,692 Continuation-In-Part USD625328S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen
US29/309,687 Continuation-In-Part USD625324S1 (en) 2008-08-28 2008-09-26 Transitional icon for a portion of a display screen
US29/309,688 Continuation-In-Part USD626560S1 (en) 2008-08-28 2008-09-26 Transitional icon for a portion of a display screen
US29/309,691 Continuation-In-Part USD625327S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen
US29/309,690 Continuation-In-Part USD625732S1 (en) 2008-08-28 2008-09-26 User interface for a computer screen
US29/309,689 Continuation-In-Part USD623658S1 (en) 2008-08-28 2008-09-26 Icon for a portion of a display screen

Publications (1)

Publication Number Publication Date
US20090083672A1 true US20090083672A1 (en) 2009-03-26

Family

ID=40471107

Family Applications (16)

Application Number Title Priority Date Filing Date
US12/200,346 Active 2031-04-27 US8803881B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,485 Active 2031-01-14 US8314789B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,475 Active 2032-01-14 US9891783B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,480 Active 2031-07-04 US8686991B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,373 Abandoned US20090083672A1 (en) 2007-09-26 2008-08-28 Navigation system for a 3d virtual scene
US12/200,449 Active 2032-08-11 US10162474B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,440 Active 2031-04-24 US10564798B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,333 Active 2030-03-03 US10025454B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,355 Active 2032-01-19 US8749544B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,327 Active 2031-08-24 US9021400B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,309 Active 2032-03-05 US9122367B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,429 Abandoned US20090083628A1 (en) 2007-09-26 2008-08-28 navigation system for a 3d virtual scene
US12/200,421 Active 2031-04-19 US8665272B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,278 Active 2031-06-16 US9052797B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,340 Active 2031-01-26 US9280257B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,458 Abandoned US20090083669A1 (en) 2007-09-26 2008-08-28 Navigation system for a 3d virtual scene

Family Applications Before (4)

Application Number Title Priority Date Filing Date
US12/200,346 Active 2031-04-27 US8803881B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,485 Active 2031-01-14 US8314789B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,475 Active 2032-01-14 US9891783B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,480 Active 2031-07-04 US8686991B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene

Family Applications After (11)

Application Number Title Priority Date Filing Date
US12/200,449 Active 2032-08-11 US10162474B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,440 Active 2031-04-24 US10564798B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,333 Active 2030-03-03 US10025454B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,355 Active 2032-01-19 US8749544B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,327 Active 2031-08-24 US9021400B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,309 Active 2032-03-05 US9122367B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,429 Abandoned US20090083628A1 (en) 2007-09-26 2008-08-28 navigation system for a 3d virtual scene
US12/200,421 Active 2031-04-19 US8665272B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,278 Active 2031-06-16 US9052797B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,340 Active 2031-01-26 US9280257B2 (en) 2007-09-26 2008-08-28 Navigation system for a 3D virtual scene
US12/200,458 Abandoned US20090083669A1 (en) 2007-09-26 2008-08-28 Navigation system for a 3d virtual scene

Country Status (2)

Country Link
US (16) US8803881B2 (fr)
WO (14) WO2009042893A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110102463A1 (en) * 2009-10-30 2011-05-05 Tekla Corporation Position fine tuning in a computer aided modeling
US20110169949A1 (en) * 2010-01-12 2011-07-14 Topcon Positioning Systems, Inc. System and Method for Orienting an Implement on a Vehicle
US10839602B1 (en) * 2019-09-30 2020-11-17 The Boeing Company Systems and methods for navigating within a visual representation of a three-dimensional environment

Families Citing this family (213)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8225231B2 (en) 2005-08-30 2012-07-17 Microsoft Corporation Aggregation of PC settings
JP2010521859A (ja) * 2007-03-15 2010-06-24 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 画像を編集するための方法及び装置
US9043707B2 (en) * 2007-03-28 2015-05-26 Autodesk, Inc. Configurable viewcube controller
WO2009032151A1 (fr) 2007-09-05 2009-03-12 Wms Gaming Inc. Système de jeu comportant des entrées de joueur dynamiques
WO2009089129A1 (fr) 2008-01-04 2009-07-16 3M Innovative Properties Company Optimisation de trajet de caméra global
US8384718B2 (en) * 2008-01-10 2013-02-26 Sony Corporation System and method for navigating a 3D graphical user interface
KR100973354B1 (ko) * 2008-01-11 2010-07-30 성균관대학교산학협력단 메뉴 유저 인터페이스 제공 장치 및 방법
US20090327969A1 (en) * 2008-06-27 2009-12-31 Microsoft Corporation Semantic zoom in a virtual three-dimensional graphical user interface
WO2010022386A2 (fr) 2008-08-22 2010-02-25 Google Inc. Navigation dans un environnement tridimensionnel sur un dispositif mobile
US9383897B2 (en) * 2009-01-29 2016-07-05 International Business Machines Corporation Spiraling radial menus in computer systems
US9195317B2 (en) * 2009-02-05 2015-11-24 Opentv, Inc. System and method for generating a user interface for text and item selection
JP5369769B2 (ja) * 2009-03-05 2013-12-18 ソニー株式会社 情報処理装置、情報処理方法、プログラムおよび情報処理システム
US8468466B2 (en) * 2009-03-27 2013-06-18 International Business Machines Corporation Radial menu selection with gestures
US8627233B2 (en) * 2009-03-27 2014-01-07 International Business Machines Corporation Radial menu with overshoot, fade away, and undo capabilities
US9015627B2 (en) * 2009-03-30 2015-04-21 Sony Corporation User interface for digital photo frame
EP2239652A1 (fr) * 2009-04-07 2010-10-13 Keywords.de GmbH Fournir une représentation visuelle interactive sur un écran
US9578113B2 (en) 2009-04-15 2017-02-21 Wyse Technology L.L.C. Method and apparatus for transferring remote session data
US9553953B2 (en) 2009-04-15 2017-01-24 Dell Products L.P. Method and apparatus for extending capabilities of a virtualization domain to support features available in a normal desktop application
US8676926B2 (en) 2009-04-15 2014-03-18 Wyse Technology L.L.C. System and method for handling remote drawing commands
US9106696B2 (en) * 2009-04-15 2015-08-11 Wyse Technology L.L.C. Method and apparatus for portability of a remote session
US20100268762A1 (en) * 2009-04-15 2010-10-21 Wyse Technology Inc. System and method for scrolling a remote application
US9448815B2 (en) * 2009-04-15 2016-09-20 Wyse Technology L.L.C. Server-side computing from a remote client device
US9189124B2 (en) * 2009-04-15 2015-11-17 Wyse Technology L.L.C. Custom pointer features for touch-screen on remote client devices
KR20100117008A (ko) * 2009-04-23 2010-11-02 오의진 다방향 확장 커서 및 다방향 확장 커서의 구현방법
KR101070816B1 (ko) * 2009-07-14 2011-10-06 나비스오토모티브시스템즈 주식회사 내비게이션 시스템의 아이콘 표시 방법
US20110035700A1 (en) * 2009-08-05 2011-02-10 Brian Meaney Multi-Operation User Interface Tool
KR20110026066A (ko) * 2009-09-07 2011-03-15 삼성전자주식회사 휴대용 단말기에서 화면 상태를 전환시키기 위한 장치 및 방법
US20110083108A1 (en) * 2009-10-05 2011-04-07 Microsoft Corporation Providing user interface feedback regarding cursor position on a display screen
US9128537B2 (en) * 2010-03-04 2015-09-08 Autodesk, Inc. Bimanual interactions on digital paper using a pen and a spatially-aware mobile projector
US11270066B2 (en) 2010-04-30 2022-03-08 Microsoft Technology Licensing, Llc Temporary formatting and charting of selected data
US9367198B2 (en) 2010-04-30 2016-06-14 Microsoft Technology Licensing, Llc Spin control user interface for selecting options
US8725476B1 (en) * 2010-05-04 2014-05-13 Lucasfilm Entertainment Company Ltd. Applying details in a simulation
CN101833456B (zh) * 2010-05-26 2013-05-08 四川长虹电器股份有限公司 人机界面中焦点元素导航方法
US8966400B2 (en) * 2010-06-07 2015-02-24 Empire Technology Development Llc User movement interpretation in computer generated reality
WO2011154917A2 (fr) * 2010-06-11 2011-12-15 Visual Domains Ltd. Procédé et système d'affichage d'un contenu visuel dans un espace virtuel en trois dimensions
US9864501B2 (en) * 2010-07-30 2018-01-09 Apaar Tuli Displaying information
US9035944B2 (en) * 2010-08-06 2015-05-19 Intergraph Corporation 3-D model view manipulation apparatus
JP5681588B2 (ja) * 2010-09-30 2015-03-11 富士フイルム株式会社 立体画像編集装置および立体画像編集方法
US8896631B2 (en) 2010-10-25 2014-11-25 Hewlett-Packard Development Company, L.P. Hyper parallax transformation matrix based on user eye positions
US20120151397A1 (en) * 2010-12-08 2012-06-14 Tavendo Gmbh Access to an electronic object collection via a plurality of views
US20120159395A1 (en) 2010-12-20 2012-06-21 Microsoft Corporation Application-launching interface for multiple modes
US8689123B2 (en) 2010-12-23 2014-04-01 Microsoft Corporation Application reporting in an application-selectable user interface
US8612874B2 (en) 2010-12-23 2013-12-17 Microsoft Corporation Presenting an application change through a tile
US9423951B2 (en) 2010-12-31 2016-08-23 Microsoft Technology Licensing, Llc Content-based snap point
US8589423B2 (en) * 2011-01-18 2013-11-19 Red 5 Studios, Inc. Systems and methods for generating enhanced screenshots
US8854357B2 (en) * 2011-01-27 2014-10-07 Microsoft Corporation Presenting selectors within three-dimensional graphical environments
EP2490142A1 (fr) * 2011-02-15 2012-08-22 Dassault Systèmes Définition d'une scène de navigation
JP2011134343A (ja) 2011-02-24 2011-07-07 Nintendo Co Ltd 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
JP4989768B2 (ja) * 2011-02-24 2012-08-01 任天堂株式会社 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
JP4967065B2 (ja) 2011-02-24 2012-07-04 任天堂株式会社 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
JP5026604B2 (ja) 2011-02-24 2012-09-12 任天堂株式会社 画像認識プログラム、画像認識装置、画像認識システム、および画像認識方法
JP5178860B2 (ja) 2011-02-24 2013-04-10 任天堂株式会社 画像認識プログラム、画像認識装置、画像認識システム、および画像認識方法
JP5016723B2 (ja) 2011-02-24 2012-09-05 任天堂株式会社 画像認識プログラム、画像認識装置、画像認識システム、および画像認識方法
KR101852428B1 (ko) * 2011-03-09 2018-04-26 엘지전자 주식회사 이동 단말기 및 그의 3ｄ객체 제어방법
US9383917B2 (en) 2011-03-28 2016-07-05 Microsoft Technology Licensing, Llc Predictive tiling
GB2489685B (en) * 2011-03-31 2017-01-25 Geovs Ltd A Display System
US8533595B2 (en) * 2011-04-19 2013-09-10 Autodesk, Inc Hierarchical display and navigation of document revision histories
US8970592B1 (en) 2011-04-19 2015-03-03 Lucasfilm Entertainment Company LLC Simulating an arbitrary number of particles
US20120272144A1 (en) * 2011-04-20 2012-10-25 Microsoft Corporation Compact control menu for touch-enabled command execution
EP2523129B1 (fr) * 2011-05-11 2020-07-01 Dassault Systèmes Sélection d'un manipulateur d'un objet parmi une pluralité de manipulateurs
US8893033B2 (en) 2011-05-27 2014-11-18 Microsoft Corporation Application notifications
US9158445B2 (en) 2011-05-27 2015-10-13 Microsoft Technology Licensing, Llc Managing an immersive interface in a multi-application immersive environment
US9658766B2 (en) 2011-05-27 2017-05-23 Microsoft Technology Licensing, Llc Edge gesture
US9104440B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US9104307B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US9037968B1 (en) * 2011-07-28 2015-05-19 Zynga Inc. System and method to communicate information to a user
US20130057587A1 (en) 2011-09-01 2013-03-07 Microsoft Corporation Arranging tiles
US8793313B2 (en) 2011-09-08 2014-07-29 Red 5 Studios, Inc. Systems, methods and media for distributing peer-to-peer communications
US8922575B2 (en) 2011-09-09 2014-12-30 Microsoft Corporation Tile cache
US10353566B2 (en) 2011-09-09 2019-07-16 Microsoft Technology Licensing, Llc Semantic zoom animations
US20130067420A1 (en) * 2011-09-09 2013-03-14 Theresa B. Pittappilly Semantic Zoom Gestures
US9557909B2 (en) 2011-09-09 2017-01-31 Microsoft Technology Licensing, Llc Semantic zoom linguistic helpers
US9146670B2 (en) 2011-09-10 2015-09-29 Microsoft Technology Licensing, Llc Progressively indicating new content in an application-selectable user interface
US8933952B2 (en) 2011-09-10 2015-01-13 Microsoft Corporation Pre-rendering new content for an application-selectable user interface
US9244802B2 (en) 2011-09-10 2016-01-26 Microsoft Technology Licensing, Llc Resource user interface
US20140218360A1 (en) * 2011-09-21 2014-08-07 Dalux Aps Bim and display of 3d models on client devices
JP5974445B2 (ja) * 2011-10-12 2016-08-23 富士ゼロックス株式会社 情報処理装置及び情報処理プログラム
EP2590062A1 (fr) * 2011-11-03 2013-05-08 Dassault Systèmes Procédé et système pour désigner un ensemble modelé d'au moins un objet dans un système de design assisté par ordinateur
US9007302B1 (en) 2011-11-11 2015-04-14 Benjamin D. Bandt-Horn Device and user interface for visualizing, navigating, and manipulating hierarchically structured information on host electronic devices
US9372593B2 (en) * 2011-11-29 2016-06-21 Apple Inc. Using a three-dimensional model to render a cursor
US9324183B2 (en) 2011-11-29 2016-04-26 Apple Inc. Dynamic graphical interface shadows
US9594487B2 (en) 2012-02-27 2017-03-14 Autodesk, Inc Systems and methods for manipulating a 3D object in a 3D model using a software widget and surface constraints
TWI547861B (zh) * 2012-05-23 2016-09-01 群邁通訊股份有限公司 滑鼠鍵盤共用方法及系統
KR20130133319A (ko) * 2012-05-23 2013-12-09 삼성전자주식회사 ３ｄ그래픽 사용자 인터페이스 제작 장치 및 방법
US8732620B2 (en) 2012-05-23 2014-05-20 Cyberlink Corp. Method and system for a more realistic interaction experience using a stereoscopic cursor
USD732566S1 (en) * 2012-06-01 2015-06-23 Hewlett-Packard Development Company, L.P. Computing device including a computer-generated feature set for providing collaborative resources
US9043722B1 (en) 2012-06-19 2015-05-26 Surfwax, Inc. User interfaces for displaying relationships between cells in a grid
US9786097B2 (en) 2012-06-22 2017-10-10 Matterport, Inc. Multi-modal method for interacting with 3D models
US10127722B2 (en) * 2015-06-30 2018-11-13 Matterport, Inc. Mobile capture visualization incorporating three-dimensional and two-dimensional imagery
US10139985B2 (en) 2012-06-22 2018-11-27 Matterport, Inc. Defining, displaying and interacting with tags in a three-dimensional model
US10163261B2 (en) 2014-03-19 2018-12-25 Matterport, Inc. Selecting two-dimensional imagery data for display within a three-dimensional model
US8957855B2 (en) 2012-06-25 2015-02-17 Cyberlink Corp. Method for displaying a stereoscopic cursor among stereoscopic objects
US8628424B1 (en) 2012-06-28 2014-01-14 Red 5 Studios, Inc. Interactive spectator features for gaming environments
US8632411B1 (en) 2012-06-28 2014-01-21 Red 5 Studios, Inc. Exchanging virtual rewards for computing resources
US8795086B2 (en) 2012-07-20 2014-08-05 Red 5 Studios, Inc. Referee mode within gaming environments
EP2690570A1 (fr) * 2012-07-24 2014-01-29 Dassault Systèmes Opération de conception dans un environnement virtuel immersif
US9110562B1 (en) * 2012-07-26 2015-08-18 Google Inc. Snapping a pointing-indicator to a scene boundary of a video
US8475284B1 (en) 2012-07-31 2013-07-02 Scott Rudi Dynamic views within gaming environments
US20140040832A1 (en) * 2012-08-02 2014-02-06 Stephen Regelous Systems and methods for a modeless 3-d graphics manipulator
US20140047393A1 (en) * 2012-08-07 2014-02-13 Samsung Electronics Co., Ltd. Method and portable apparatus with a gui
US9348512B2 (en) * 2012-08-08 2016-05-24 Nuance Communications, Inc. Methods for facilitating text entry
JP2014038560A (ja) * 2012-08-20 2014-02-27 Canon Inc 情報処理装置、情報処理方法及びプログラム
US9511543B2 (en) 2012-08-29 2016-12-06 Cc3D Llc Method and apparatus for continuous composite three-dimensional printing
US20140062998A1 (en) * 2012-09-04 2014-03-06 Google Inc. User Interface for Orienting a Camera View Toward Surfaces in a 3D Map and Devices Incorporating the User Interface
US20140075370A1 (en) * 2012-09-13 2014-03-13 The Johns Hopkins University Dockable Tool Framework for Interaction with Large Scale Wall Displays
US9163492B2 (en) * 2012-10-23 2015-10-20 Halliburton Energy Services, Inc. Methods and systems using a fluid treatment polar graph
US9158766B2 (en) * 2012-11-29 2015-10-13 Oracle International Corporation Multi-touch interface for visual analytics
USD716819S1 (en) * 2013-02-27 2014-11-04 Microsoft Corporation Display screen with graphical user interface
US9477381B2 (en) 2013-03-12 2016-10-25 Hexagon Technology Center Gmbh User interface for toolbar navigation
US9934488B2 (en) * 2013-03-13 2018-04-03 Autodesk, Inc. User interface navigation elements for navigating datasets
US10931920B2 (en) * 2013-03-14 2021-02-23 Pelco, Inc. Auto-learning smart tours for video surveillance
US9164653B2 (en) * 2013-03-15 2015-10-20 Inspace Technologies Limited Three-dimensional space for navigating objects connected in hierarchy
US20150058792A1 (en) * 2013-03-19 2015-02-26 Bernard KOBOS Methods, systems and apparatuses for providing user interface navigation, display interactivity and multi-browser arrays
USD749125S1 (en) * 2013-03-29 2016-02-09 Deere & Company Display screen with an animated graphical user interface
DE102013006026A1 (de) * 2013-04-08 2014-10-09 Audi Ag Orientierungszoom in Navigationskarten bei Darstellung auf kleinen Bildschirmen
US9465513B2 (en) * 2013-04-11 2016-10-11 General Electric Company Visual representation of map navigation history
EP2800064B1 (fr) * 2013-04-30 2022-04-20 Dassault Systèmes Procédé mis en oeuvre par ordinateur, pour la manipulation d'objets modélisés en trois dimensions d'un ensemble dans une scène tridimensionnelle
JP6167703B2 (ja) 2013-07-08 2017-07-26 株式会社リコー 表示制御装置、プログラム及び記録媒体
US9310987B2 (en) * 2013-08-19 2016-04-12 Google Inc. Projections to fix pose of panoramic photos
USD774543S1 (en) * 2013-09-03 2016-12-20 Samsung Electronics Co., Ltd. Display screen or portion thereof with icon
US9329750B2 (en) 2013-09-10 2016-05-03 Google Inc. Three-dimensional tilt and pan navigation using a single gesture
US9869785B2 (en) * 2013-11-12 2018-01-16 Schlumberger Technology Corporation Systems and methods for speed-adjustable model navigation
US10198148B2 (en) * 2014-01-17 2019-02-05 Microsoft Technology Licensing, Llc Radial menu user interface with entry point maintenance
KR20150101915A (ko) * 2014-02-27 2015-09-04 삼성전자주식회사 3차원 gui 화면의 표시 방법 및 이를 수행하기 위한 디바이스
WO2015142732A1 (fr) * 2014-03-21 2015-09-24 Audience Entertainment, Llc Système adaptatif de commande de mouvement interactif de groupe et procédé pour vidéo 2d et 3d
USD768188S1 (en) * 2014-04-08 2016-10-04 Huawei Device Co., Ltd. Display screen or portion thereof with graphical user interface
USD857035S1 (en) 2014-04-11 2019-08-20 Johnson Controls Technology Company Display screen or portion thereof with graphical user interface
USD886847S1 (en) 2014-04-11 2020-06-09 Johnson Controls Technology Company Display screen or portion thereof with graphical user interface
USD788785S1 (en) * 2014-04-11 2017-06-06 Johnson Controls Technology Company Display having a graphical user interface
USD756377S1 (en) * 2014-04-17 2016-05-17 Google Inc. Portion of a display panel with an animated computer icon
US9996636B2 (en) 2014-05-13 2018-06-12 Atheer, Inc. Method for forming walls to align 3D objects in 2D environment
US9827714B1 (en) 2014-05-16 2017-11-28 Google Llc Method and system for 3-D printing of 3-D object models in interactive content items
USD784360S1 (en) * 2014-05-21 2017-04-18 Dolby International Ab Display screen or portion thereof with a graphical user interface
USD785018S1 (en) * 2014-06-02 2017-04-25 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD828364S1 (en) * 2014-07-03 2018-09-11 Verizon Patent And Licensing Inc. Display panel for a graphical user interface with flip notification
USD816678S1 (en) * 2014-07-03 2018-05-01 Verizon Patent And Licensing Inc. Display panel or screen with graphical user interface
US10120529B2 (en) 2014-07-08 2018-11-06 Verizon Patent And Licensing Inc. Touch-activated and expandable visual navigation of a mobile device via a graphic selection element
USD755798S1 (en) * 2014-08-26 2016-05-10 Tencent Technology (Shenzhen) Company Limited Portion of a display screen with graphical user interface
USD771123S1 (en) 2014-09-01 2016-11-08 Apple Inc. Display screen or portion thereof with multi-state graphical user interface
USD752624S1 (en) 2014-09-01 2016-03-29 Apple Inc. Display screen or portion thereof with graphical user interface
USD762659S1 (en) 2014-09-02 2016-08-02 Apple Inc. Display screen or portion thereof with graphical user interface
USD786269S1 (en) * 2014-11-24 2017-05-09 General Electric Company Display screen or portion thereof with transitional icon
CN104375780B (zh) * 2014-12-02 2017-11-28 厦门飞信网络科技有限公司 一种触摸事件处理方法、设备和移动终端
US10185463B2 (en) * 2015-02-13 2019-01-22 Nokia Technologies Oy Method and apparatus for providing model-centered rotation in a three-dimensional user interface
USD784361S1 (en) * 2015-03-03 2017-04-18 Ricoh Company, Ltd. Portion of display screen with animated graphical user interface
USD772246S1 (en) * 2015-03-18 2016-11-22 Adp, Llc Display screen or portion thereof with animated graphical user interface
USD798320S1 (en) 2015-03-18 2017-09-26 Adp, Llc Display screen with graphical user interface
USD805090S1 (en) 2015-03-18 2017-12-12 Adp, Llc Display screen with graphical user interface
USD765677S1 (en) * 2015-06-02 2016-09-06 Nobotgames, Inc. Display screen or portion thereof with animated graphical user interface
US10176520B2 (en) 2015-07-07 2019-01-08 The Boeing Company Product visualization system
KR101666561B1 (ko) * 2015-07-13 2016-10-24 한국과학기술원 증강 공간 내 부분 공간 획득 시스템 및 방법
CN106371688B (zh) * 2015-07-22 2019-10-01 小米科技有限责任公司 全屏幕单手操作方法及装置
CN107924690B (zh) * 2015-09-02 2021-06-25 交互数字Ce专利控股公司 用于促进扩展场景中的导航的方法、装置和系统
USD769911S1 (en) * 2015-10-14 2016-10-25 Quantcast Corporation Display screen or portion thereof with animated icon
USD801382S1 (en) * 2015-12-24 2017-10-31 Samsung Electronics Co., Ltd. Display screen or portion thereof with transitional icon
US20170185261A1 (en) * 2015-12-28 2017-06-29 Htc Corporation Virtual reality device, method for virtual reality
US10477006B2 (en) 2016-01-22 2019-11-12 Htc Corporation Method, virtual reality system, and computer-readable recording medium for real-world interaction in virtual reality environment
US10824320B2 (en) * 2016-03-07 2020-11-03 Facebook, Inc. Systems and methods for presenting content
US10368037B2 (en) * 2016-03-23 2019-07-30 Purdue Research Foundation Public safety camera monitoring system and method
US10341617B2 (en) * 2016-03-23 2019-07-02 Purdue Research Foundation Public safety camera identification and monitoring system and method
US10506201B2 (en) * 2016-03-23 2019-12-10 Purdue Research Foundation Public safety camera identification and monitoring system and method
WO2017173153A1 (fr) * 2016-03-30 2017-10-05 Ebay, Inc. Optimisation de modèle numérique en réponse à des données de capteur d'orientation
USD781912S1 (en) * 2016-03-31 2017-03-21 Td Ameritrade Ip Company, Inc. Display screen or portion thereof with animated graphical user interface
US20170300214A1 (en) * 2016-04-19 2017-10-19 SAS Automation, LLC Three Dimensional Model Launch Tools And Methods Of Use
USD879795S1 (en) * 2016-06-07 2020-03-31 Amadeus S.A.S. Display screen with graphical user interface
JP6483056B2 (ja) * 2016-06-10 2019-03-13 任天堂株式会社 ゲーム装置、ゲーム制御方法およびゲームプログラム
USD804502S1 (en) 2016-06-11 2017-12-05 Apple Inc. Display screen or portion thereof with graphical user interface
USD847193S1 (en) * 2016-06-15 2019-04-30 Under Armour, Inc. Display screen with graphical user interface
USD800764S1 (en) * 2016-06-20 2017-10-24 Caterpillar Inc. Display screen or portion thereof with set of icons
USD824935S1 (en) * 2016-07-20 2018-08-07 Biolase, Inc. Display screen including a dental laser graphical user interface
USD847836S1 (en) * 2016-08-24 2019-05-07 Caterpillar Inc. Display panel with graphical user interface
USD815111S1 (en) * 2016-10-04 2018-04-10 Salesforce.Com, Inc. Display screen or portion thereof with animated graphical user interface
US10983661B2 (en) 2016-10-24 2021-04-20 Microsoft Technology Licensing, Llc Interface for positioning an object in three-dimensional graphical space
CN107977138A (zh) * 2016-10-24 2018-05-01 北京东软医疗设备有限公司 一种显示方法及装置
USD812093S1 (en) 2016-12-02 2018-03-06 Salesforce.Com, Inc. Display screen or portion thereof with graphical user interface
US11226734B1 (en) * 2016-12-30 2022-01-18 Dassault Systemes Solidworks Corporation Triggering multiple actions from a single gesture
USD815115S1 (en) * 2017-01-04 2018-04-10 Salesforce.Com, Inc. Display screen or portion thereof with graphical user interface
US11782570B2 (en) * 2017-02-23 2023-10-10 Jue-Hsuan Hsiao Integration platform of internet of things and virtual device
CN112328143B (zh) * 2017-04-14 2024-06-21 创新先进技术有限公司 按钮激活方法及装置
US10620779B2 (en) 2017-04-24 2020-04-14 Microsoft Technology Licensing, Llc Navigating a holographic image
US10586377B2 (en) * 2017-05-31 2020-03-10 Verizon Patent And Licensing Inc. Methods and systems for generating virtual reality data that accounts for level of detail
US10347037B2 (en) * 2017-05-31 2019-07-09 Verizon Patent And Licensing Inc. Methods and systems for generating and providing virtual reality data that accounts for level of detail
US10311630B2 (en) 2017-05-31 2019-06-04 Verizon Patent And Licensing Inc. Methods and systems for rendering frames of a virtual scene from different vantage points based on a virtual entity description frame of the virtual scene
US10297090B2 (en) * 2017-06-12 2019-05-21 Nintendo Co., Ltd. Information processing system, apparatus and method for generating an object in a virtual space
USD894916S1 (en) * 2017-07-31 2020-09-01 Omnitracs, Llc Display screen with graphical user interface
US11010014B2 (en) * 2017-08-11 2021-05-18 Autodesk, Inc. Techniques for transitioning from a first navigation scheme to a second navigation scheme
US11474660B2 (en) 2017-08-11 2022-10-18 Autodesk, Inc. Techniques for transitioning from a first navigation scheme to a second navigation scheme
JP6429975B2 (ja) * 2017-10-26 2018-11-28 オリンパス株式会社 電子機器、アイコン表示方法およびアイコン表示用プログラム
USD885430S1 (en) 2017-10-31 2020-05-26 Express Scripts Strategic Development, Inc. Display screen with icon
USD933708S1 (en) * 2017-11-15 2021-10-19 Express Scripts Strategic Development, Inc. Display screen with transitional icons
CN112020719A (zh) * 2018-03-22 2020-12-01 惠普发展公司，有限责任合伙企业 三维环境中的数字标记
WO2020005757A1 (fr) * 2018-06-26 2020-01-02 Magic Leap, Inc. Création de point de cheminement dans une détection de carte
US11159022B2 (en) 2018-08-28 2021-10-26 Johnson Controls Tyco IP Holdings LLP Building energy optimization system with a dynamically trained load prediction model
US11163271B2 (en) 2018-08-28 2021-11-02 Johnson Controls Technology Company Cloud based building energy optimization system with a dynamically trained load prediction model
USD1041511S1 (en) 2018-10-11 2024-09-10 Masimo Corporation Display screen or portion thereof with a graphical user interface
USD998631S1 (en) 2018-10-11 2023-09-12 Masimo Corporation Display screen or portion thereof with a graphical user interface
USD916135S1 (en) 2018-10-11 2021-04-13 Masimo Corporation Display screen or portion thereof with a graphical user interface
USD917564S1 (en) 2018-10-11 2021-04-27 Masimo Corporation Display screen or portion thereof with graphical user interface
USD998630S1 (en) * 2018-10-11 2023-09-12 Masimo Corporation Display screen or portion thereof with a graphical user interface
USD999246S1 (en) 2018-10-11 2023-09-19 Masimo Corporation Display screen or portion thereof with a graphical user interface
US11406286B2 (en) 2018-10-11 2022-08-09 Masimo Corporation Patient monitoring device with improved user interface
USD917550S1 (en) * 2018-10-11 2021-04-27 Masimo Corporation Display screen or portion thereof with a graphical user interface
US11157152B2 (en) * 2018-11-05 2021-10-26 Sap Se Interaction mechanisms for pointer control
USD957456S1 (en) * 2018-12-20 2022-07-12 Samsung Electronics Co., Ltd. Display screen or portion thereof with icon
US10933317B2 (en) 2019-03-15 2021-03-02 Sony Interactive Entertainment LLC. Near real-time augmented reality video gaming system
USD910050S1 (en) 2019-03-22 2021-02-09 Apple Inc. Electronic device with graphical user interface
US10943388B1 (en) 2019-09-06 2021-03-09 Zspace, Inc. Intelligent stylus beam and assisted probabilistic input to element mapping in 2D and 3D graphical user interfaces
US11423624B2 (en) * 2019-11-18 2022-08-23 Magic Leap, Inc. Mapping and localization of a passable world
EP4094119A4 (fr) * 2020-01-24 2024-04-10 Magic Leap, Inc. Déplacement d'un contenu et interaction avec un contenu à l'aide d'un seul dispositif de commande
USD942509S1 (en) 2020-06-19 2022-02-01 Apple Inc. Display screen or portion thereof with graphical user interface
USD951287S1 (en) 2020-06-19 2022-05-10 Apple Inc. Display screen or portion thereof with graphical user interface
EP3926446A1 (fr) * 2020-06-19 2021-12-22 Atos Nederland B.V. Procédé pour déplacer un objet dans un environnement virtuel et dispositif conçu pour mettre en uvre un tel procédé
US11941228B2 (en) * 2021-08-31 2024-03-26 Savant Systems, Inc. Guidance set-up for companion module graphical display

Citations (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4734690A (en) * 1984-07-20 1988-03-29 Tektronix, Inc. Method and apparatus for spherical panning
US5075673A (en) * 1989-06-16 1991-12-24 International Business Machines Corp. Variable speed, image pan method and apparatus
US5293529A (en) * 1991-03-12 1994-03-08 Matsushita Electric Industrial Co., Ltd. Three-dimensional information handling system
US5488392A (en) * 1994-04-28 1996-01-30 Harris; Thomas S. Precision, absolute mapping computer pointing device and versatile accessories
US5511157A (en) * 1993-12-13 1996-04-23 International Business Machines Corporation Connection of sliders to 3D objects to allow easy user manipulation and viewing of objects
US5583977A (en) * 1993-10-21 1996-12-10 Taligent, Inc. Object-oriented curve manipulation system
US5734805A (en) * 1994-06-17 1998-03-31 International Business Machines Corporation Apparatus and method for controlling navigation in 3-D space
US5841440A (en) * 1996-12-17 1998-11-24 Apple Computer, Inc. System and method for using a pointing device to indicate movement through three-dimensional space
US5874956A (en) * 1995-11-13 1999-02-23 Platinum Technology Apparatus and method for three dimensional manipulation of point of view and object
US5929840A (en) * 1994-03-04 1999-07-27 Microsoft Corporation System and method for computer cursor control
US6222557B1 (en) * 1998-06-26 2001-04-24 Visual Insights, Inc. Navigation system and method for viewing a 3D data landscape
US6313849B1 (en) * 1998-07-06 2001-11-06 Alps Electric Co., Ltd. Modal control scrolling of display area
US6331146B1 (en) * 1995-11-22 2001-12-18 Nintendo Co., Ltd. Video game system and method with enhanced three-dimensional character and background control
US20020015024A1 (en) * 1998-01-26 2002-02-07 University Of Delaware Method and apparatus for integrating manual input
US20020033845A1 (en) * 2000-09-19 2002-03-21 Geomcore Ltd. Object positioning and display in virtual environments
US20020063705A1 (en) * 2000-11-28 2002-05-30 Mitsubishi Denki Kabushiki Kaisha Apparatus and method for drawing three dimensional graphics by controlling alpha value based on Z coordinate value
US6400401B1 (en) * 1994-11-29 2002-06-04 Canon Kabushiki Kaisha Camera control method and apparatus, and network system of camera control apparatus
US6426745B1 (en) * 1997-04-28 2002-07-30 Computer Associates Think, Inc. Manipulating graphic objects in 3D scenes
US6480191B1 (en) * 1999-09-28 2002-11-12 Ricoh Co., Ltd. Method and apparatus for recording and playback of multidimensional walkthrough narratives
US6556206B1 (en) * 1999-12-09 2003-04-29 Siemens Corporate Research, Inc. Automated viewpoint selection for 3D scenes
US20030081012A1 (en) * 2001-10-30 2003-05-01 Chang Nelson Liang An User interface and method for interacting with a three-dimensional graphical environment
US6628279B1 (en) * 2000-11-22 2003-09-30 @Last Software, Inc. System and method for three-dimensional modeling
US6640185B2 (en) * 2001-07-21 2003-10-28 Alpine Electronics, Inc. Display method and apparatus for navigation system
US20030206150A1 (en) * 2001-05-02 2003-11-06 Hand Held Products, Inc. Optical reader comprising keyboard
US20040001041A1 (en) * 2002-07-01 2004-01-01 Peterson Chang Scrollbar-less control button and method
US6738065B1 (en) * 1999-08-10 2004-05-18 Oshri Even-Zohar Customizable animation system
US20040135824A1 (en) * 2002-10-18 2004-07-15 Silicon Graphics, Inc. Tracking menus, system and method
US20040189802A1 (en) * 2001-07-27 2004-09-30 Mark Flannery Control system for allowing an operator to proportionally control a work piece
US20040210852A1 (en) * 2000-04-28 2004-10-21 Silicon Graphics, Inc. System for dynamically mapping input device movement as a user's viewpoint changes
US20040233222A1 (en) * 2002-11-29 2004-11-25 Lee Jerome Chan Method and system for scaling control in 3D displays ("zoom slider")
US20040240709A1 (en) * 2003-04-22 2004-12-02 Garth Shoemaker Method and system for controlling detail-in-context lenses through eye and position tracking
US6867790B1 (en) * 1996-08-09 2005-03-15 International Business Machines Corporation Method and apparatus to conditionally constrain pointer movement on a computer display using visual cues, controlled pointer speed and barriers on the display which stop or restrict pointer movement
US20050060667A1 (en) * 2001-03-12 2005-03-17 Microsoft Corporation Visualization of multi-dimensional data having an unbounded dimension
US20050128180A1 (en) * 2003-12-10 2005-06-16 Chong-Min Wang Portable presentation operating device
US20050168488A1 (en) * 2004-02-03 2005-08-04 Montague Roland W. Combination tool that zooms in, zooms out, pans, rotates, draws, or manipulates during a drag
US6928618B2 (en) * 2001-10-23 2005-08-09 Autodesk, Inc. Intelligent drag of assembly components
US20050187832A1 (en) * 1999-10-21 2005-08-25 Morse Stacy J. Electronic property viewing system for providing virtual tours via a public communications network, and a method of exchanging the same
US20050188325A1 (en) * 2004-02-20 2005-08-25 Kolman Robert S. Highlighting panning window interface
US20050210380A1 (en) * 2004-03-03 2005-09-22 Gary Kramer System for delivering and enabling interactivity with images
US20050212756A1 (en) * 2004-03-23 2005-09-29 Marvit David L Gesture based navigation of a handheld user interface
US20060004298A1 (en) * 2004-06-30 2006-01-05 Kennedy Philip R Software controlled electromyogram control systerm
US20060080604A1 (en) * 1997-04-14 2006-04-13 Anderson Thomas G Navigation and viewing in a multidimensional space
US20060090022A1 (en) * 2004-10-22 2006-04-27 Intergraph Hardware Technologies Company Input device for controlling movement in a three-dimensional virtual environment
US20060202973A1 (en) * 2002-07-30 2006-09-14 Canon Kabushiki Kaisha Coordinate input apparatus, control method thereof, and program
US20060253245A1 (en) * 2005-04-18 2006-11-09 Cera Christopher D Data-driven 3D traffic views with the view based on user-selected start and end geographical locations
US20060284839A1 (en) * 1999-12-15 2006-12-21 Automotive Technologies International, Inc. Vehicular Steering Wheel with Input Device
US7190365B2 (en) * 2001-09-06 2007-03-13 Schlumberger Technology Corporation Method for navigating in a multi-scale three-dimensional scene
US20070136690A1 (en) * 2005-12-12 2007-06-14 Microsoft Corporation Wedge menu
US20070162871A1 (en) * 2006-01-12 2007-07-12 Fujitsu Limited Information processing apparatus, control method therefor and control program
US20070179646A1 (en) * 2006-01-31 2007-08-02 Accenture Global Services Gmbh System for storage and navigation of application states and interactions
US20070192739A1 (en) * 2005-12-02 2007-08-16 Hillcrest Laboratories, Inc. Scene transitions in a zoomable user interface using a zoomable markup language
US20070198941A1 (en) * 2001-06-12 2007-08-23 David Baar Graphical user interface with zoom for detail-in-context presentations
US20070206030A1 (en) * 2006-03-06 2007-09-06 The Protomold Company, Inc. Graphical user interface for three-dimensional manipulation of a part
US20070234223A1 (en) * 2000-11-09 2007-10-04 Leavitt Joseph M User definable interface system, method, support tools, and computer program product
US20070229458A1 (en) * 2006-03-31 2007-10-04 Samsung Electronics Co., Ltd. Wheel input device and method for four-way key stroke in portable terminal
US20080180391A1 (en) * 2007-01-11 2008-07-31 Joseph Auciello Configurable electronic interface
US20080192010A1 (en) * 2007-02-09 2008-08-14 Primax Electronics Ltd. Tilt wheel type mouse

Family Cites Families (270)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US673482A (en) * 1900-12-07 1901-05-07 Robert William Shipway Combined cane and camera-support.
US4680572A (en) * 1981-12-14 1987-07-14 Ncr Corporation Chord entry keying of data fields
US4743690A (en) * 1984-05-03 1988-05-10 E. I. Du Pont De Nemours And Company Nitroaryl carbonyl compounds, nitrodihydroaryl carbonyl intermediates thereto, and processes
US5292840A (en) * 1987-03-13 1994-03-08 Minnesota Mining And Manufacturing Company Polymeric supports
US5333247A (en) * 1988-06-10 1994-07-26 International Business Machines Corporation Scrolling tool for text and graphics in a display system
US5047959A (en) * 1988-09-13 1991-09-10 Square D Company Flexible data display
US5115501A (en) * 1988-11-04 1992-05-19 International Business Machines Corporation Procedure for automatically customizing the user interface of application programs
US5233513A (en) 1989-12-28 1993-08-03 Doyle William P Business modeling, software engineering and prototyping method and apparatus
US5295241A (en) * 1990-08-31 1994-03-15 International Business Machines Corporation Method and apparatus for local function key control of scrolling on certain computer workstations
US5327529A (en) * 1990-09-24 1994-07-05 Geoworks Process of designing user's interfaces for application programs
US5535321A (en) * 1991-02-14 1996-07-09 International Business Machines Corporation Method and apparatus for variable complexity user interface in a data processing system
AU657510B2 (en) 1991-05-24 1995-03-16 Apple Inc. Improved image encoding/decoding method and apparatus
US5258748A (en) * 1991-08-28 1993-11-02 Hewlett-Packard Company Accessing and selecting multiple key functions with minimum keystrokes
CA2071455A1 (fr) 1991-10-16 1993-04-17 Cary Lee Bates Barre de defilement a indication chronologique
US5371846A (en) 1991-10-16 1994-12-06 International Business Machines Corporation Non-linear scroll bar
US5532715A (en) * 1991-10-16 1996-07-02 International Business Machines Corporation Visually aging scroll bar
US7006881B1 (en) * 1991-12-23 2006-02-28 Steven Hoffberg Media recording device with remote graphic user interface
US6400996B1 (en) * 1999-02-01 2002-06-04 Steven M. Hoffberg Adaptive pattern recognition based control system and method
US6850252B1 (en) 1999-10-05 2005-02-01 Steven M. Hoffberg Intelligent electronic appliance system and method
US5903454A (en) * 1991-12-23 1999-05-11 Hoffberg; Linda Irene Human-factored interface corporating adaptive pattern recognition based controller apparatus
DE4228281A1 (de) * 1992-08-26 1994-03-03 Koenig & Bauer Ag Verfahren zur Anzeige von Maschinenstörungen
US5945985A (en) * 1992-10-27 1999-08-31 Technology International, Inc. Information system for interactive access to geographic information
US6121966A (en) 1992-11-02 2000-09-19 Apple Computer, Inc. Navigable viewing system
WO1994014115A2 (fr) 1992-12-01 1994-06-23 Microsoft Corporation Procede et systeme d'interaction sur place avec des objets integres
US5550563A (en) * 1992-12-23 1996-08-27 Taligent, Inc. Interaction framework system
US5491781A (en) * 1993-03-12 1996-02-13 Hewlett-Packard Company Method and apparatus for displaying a graphic image
TW237588B (fr) 1993-06-07 1995-01-01 Microsoft Corp
CA2124505C (fr) * 1993-07-21 2000-01-04 William A. S. Buxton Interface homme-machine a deplacement simultane de curseur et d'outils
CA2124624C (fr) * 1993-07-21 1999-07-13 Eric A. Bier Interface utilisateur a outils pouvant etre combines a d'autres
KR0132749B1 (ko) * 1993-08-05 1998-04-24 가나이 쯔또무 아이콘 메뉴 표시장치 및 아이콘 메뉴 표시방법
US5544300A (en) * 1993-11-12 1996-08-06 Intel Corporation User interface for dynamically converting between a single top level window and multiple top level windows
JP3546337B2 (ja) * 1993-12-21 2004-07-28 ゼロックス コーポレイション 計算システム用ユーザ・インタフェース装置及びグラフィック・キーボード使用方法
US5726365A (en) * 1994-01-05 1998-03-10 The Stanley Works Hydrostatic altimeter
US5606655A (en) 1994-03-31 1997-02-25 Siemens Corporate Research, Inc. Method for representing contents of a single video shot using frames
US5521841A (en) * 1994-03-31 1996-05-28 Siemens Corporate Research, Inc. Browsing contents of a given video sequence
US5689628A (en) 1994-04-14 1997-11-18 Xerox Corporation Coupling a display object to a viewpoint in a navigable workspace
KR100229375B1 (ko) * 1994-06-28 1999-11-01 이리마지리 쇼우이치로 게임 장치 및 게임의 리플레이 방법
US5526478A (en) 1994-06-30 1996-06-11 Silicon Graphics, Inc. Three dimensional model with three dimensional pointers and multimedia functions linked to the pointers
US5682469A (en) * 1994-07-08 1997-10-28 Microsoft Corporation Software platform having a real world interface with animated characters
CA2157623C (fr) * 1994-09-20 1999-12-21 Lars Stig Sorensen Methode et appareil de creation dynamique de menus pour les radiocommunications
WO1996009579A1 (fr) * 1994-09-22 1996-03-28 Izak Van Cruyningen Menus surgissant a indications directionnelles
DE19609986A1 (de) * 1995-03-24 1996-09-26 Marquardt Gmbh Verfahren und Schaltungsanordnung zum Betrieb eines Elektromotors
US5754602A (en) * 1995-05-11 1998-05-19 Cidco, Incorporated Multiple key press selection for repertory dialing
US5790820A (en) * 1995-06-07 1998-08-04 Vayda; Mark Radial graphical menuing system
US5798760A (en) * 1995-06-07 1998-08-25 Vayda; Mark Radial graphical menuing system with concentric region menuing
US5745717A (en) * 1995-06-07 1998-04-28 Vayda; Mark Graphical menu providing simultaneous multiple command selection
US5655094A (en) * 1995-09-29 1997-08-05 International Business Machines Corporation Pop up scroll bar
FI101846B (fi) * 1995-10-13 1998-08-31 Nokia Mobile Phones Ltd Näppäimistölukon aktivointi
US6139433A (en) * 1995-11-22 2000-10-31 Nintendo Co., Ltd. Video game system and method with enhanced three-dimensional character and background control due to environmental conditions
US6300936B1 (en) 1997-11-14 2001-10-09 Immersion Corporation Force feedback system including multi-tasking graphical host environment and interface device
US5740037A (en) * 1996-01-22 1998-04-14 Hughes Aircraft Company Graphical user interface system for manportable applications
IL117133A (en) * 1996-02-14 1999-07-14 Olivr Corp Ltd Method and system for providing on-line virtual reality movies
JP2000512039A (ja) * 1996-03-15 2000-09-12 ザパ デジタル アーツ リミテッド プログラム可能なコンピュータグラフィックオブジェクト
US5884213A (en) 1996-03-22 1999-03-16 Johnson Worldwide Asociates, Inc. System for controlling navigation of a fishing boat
US7885912B1 (en) * 1996-03-25 2011-02-08 Stoneman Martin L Humanoid machine systems, methods, and ontologies
US5910799A (en) * 1996-04-09 1999-06-08 International Business Machines Corporation Location motion sensitive user interface
US5861889A (en) 1996-04-19 1999-01-19 3D-Eye, Inc. Three dimensional computer graphics tool facilitating movement of displayed object
US5808613A (en) 1996-05-28 1998-09-15 Silicon Graphics, Inc. Network navigator with enhanced navigational abilities
JPH1042278A (ja) * 1996-07-22 1998-02-13 Canon Inc 映像入力システム及び映像入力制御装置及びその方法
JP3839881B2 (ja) * 1996-07-22 2006-11-01 キヤノン株式会社 撮像制御装置及びその制御方法
US6097393A (en) * 1996-09-03 2000-08-01 The Takshele Corporation Computer-executed, three-dimensional graphical resource management process and system
US6954906B1 (en) * 1996-09-30 2005-10-11 Sony Corporation Image display processing apparatus that automatically changes position of sub-window relative to main window depending on distance at watch sub window is commanded to be displayed
US5875448A (en) * 1996-10-08 1999-02-23 Boys; Donald R. Data stream editing system including a hand-held voice-editing apparatus having a position-finding enunciator
US5982372A (en) * 1996-11-14 1999-11-09 International Business Machines Corp. Visual metaphor for shortcut navigation in a virtual world
US5818446A (en) 1996-11-18 1998-10-06 International Business Machines Corporation System for changing user interfaces based on display data content
US6154723A (en) * 1996-12-06 2000-11-28 The Board Of Trustees Of The University Of Illinois Virtual reality 3D interface system for data creation, viewing and editing
US6654060B1 (en) * 1997-01-07 2003-11-25 Canon Kabushiki Kaisha Video-image control apparatus and method and storage medium
US5850212A (en) 1997-02-19 1998-12-15 Nishibori; Masahiro System for changing modes and cursor appearance by a single button
US6144377A (en) 1997-03-11 2000-11-07 Microsoft Corporation Providing access to user interface elements of legacy application programs
US5787017A (en) * 1997-04-18 1998-07-28 Lmi Corporation Method and apparatus for acquiring data from a measurement transducer
US6973200B1 (en) * 1997-04-22 2005-12-06 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium
US6720949B1 (en) * 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
JPH1185362A (ja) * 1997-09-01 1999-03-30 Nec Corp キーボード制御方法およびキーボード制御装置
JPH11110311A (ja) * 1997-09-30 1999-04-23 Canon Inc 情報処理システム及び装置及び方法及び記憶媒体
US6448956B1 (en) 1997-10-31 2002-09-10 Eastman Kodak Company Systems and methods for direct image manipulation
US5973688A (en) * 1997-10-31 1999-10-26 May; Gregory J Computing system having delayed keyboard shortcut hints
US6011578A (en) * 1997-11-20 2000-01-04 Consumer Dynamics Llc System for collecting audience response data
US6271854B1 (en) * 1997-12-15 2001-08-07 Intel Corporation Method and apparatus for facilitating navigation in three-dimensional graphic scenes
US6215494B1 (en) * 1997-12-18 2001-04-10 Mgi Software Corporation Method and system for centering image objects
US6266614B1 (en) * 1997-12-24 2001-07-24 Wendell Alumbaugh Travel guide
US6222541B1 (en) * 1998-01-20 2001-04-24 International Business Machines Corporation Method and apparatus for fast-path location and selection of links
US6049805A (en) * 1998-02-24 2000-04-11 Microsoft Corporation Dynamic event mechanism for objects with associational relationships
US6121968A (en) * 1998-06-17 2000-09-19 Microsoft Corporation Adaptive menus
US6504535B1 (en) * 1998-06-30 2003-01-07 Lucent Technologies Inc. Display techniques for three-dimensional virtual reality
US6298618B1 (en) 1998-07-02 2001-10-09 Robert Lawson Constructional support
US6322059B1 (en) * 1998-07-23 2001-11-27 Barnes Group Inc. Low contact force spring
US6144375A (en) 1998-08-14 2000-11-07 Praja Inc. Multi-perspective viewer for content-based interactivity
US6731314B1 (en) * 1998-08-17 2004-05-04 Muse Corporation Network-based three-dimensional multiple-user shared environment apparatus and method
US6731309B1 (en) * 1998-08-28 2004-05-04 Corel Corporation Real time preview
US6985178B1 (en) * 1998-09-30 2006-01-10 Canon Kabushiki Kaisha Camera control system, image pick-up server, client, control method and storage medium therefor
JP4545317B2 (ja) * 1998-10-28 2010-09-15 ヤフー！ インコーポレイテッド インターネットブラウザインターフェースの制御方法、及び制御可能なブラウザインターフェイス
US6252594B1 (en) 1998-12-11 2001-06-26 International Business Machines Corporation Method and system for aiding a user in scrolling through a document using animation, voice cues and a dockable scroll bar
US7904187B2 (en) * 1999-02-01 2011-03-08 Hoffberg Steven M Internet appliance system and method
US6590594B2 (en) 1999-03-25 2003-07-08 International Business Machines Corporation Window scroll-bar
US6401096B1 (en) * 1999-03-26 2002-06-04 Paul Zellweger Method and apparatus for generating user profile reports using a content menu
US6346938B1 (en) * 1999-04-27 2002-02-12 Harris Corporation Computer-resident mechanism for manipulating, navigating through and mensurating displayed image of three-dimensional geometric model
JP2000312360A (ja) * 1999-04-27 2000-11-07 Matsushita Electric Ind Co Ltd 情報提供装置
US6346934B1 (en) * 1999-05-17 2002-02-12 Gateway, Inc. Programmable remote device control apparatus and method
US7181438B1 (en) * 1999-07-21 2007-02-20 Alberti Anemometer, Llc Database access system
TW455769B (en) * 1999-08-18 2001-09-21 Jian Huei Jiuan Eye-protection method and apparatus set up for monitor screen
GB9920327D0 (en) * 1999-08-28 1999-11-03 Koninkl Philips Electronics Nv Menu display for a graphical user interface
US7111252B1 (en) * 1999-09-22 2006-09-19 Harris Scott C Enhancing touch and feel on the internet
US6686934B1 (en) * 1999-12-15 2004-02-03 Microsoft Corporation Methods and arrangements for providing a discoverable plural mode system shut down graphical user interface capability
US6828962B1 (en) 1999-12-30 2004-12-07 Intel Corporation Method and system for altering object views in three dimensions
US6597378B1 (en) * 2000-01-18 2003-07-22 Seiko Epson Corporation Display device, portable information processing apparatus, information storage medium, and electronic apparatus
US6781607B1 (en) * 2000-01-27 2004-08-24 International Business Machines Corporation Method and system for dynamically determining the appropriate information and/or user interface for presentation to differing users
WO2001071479A2 (fr) * 2000-03-17 2001-09-27 Xeno Development Inc. Procedes et dispositifs de reconstitution de stimulations visuelles observees au fil du temps a travers des interfaces de navigateur
US20010048448A1 (en) * 2000-04-06 2001-12-06 Raiz Gregory L. Focus state themeing
US6563514B1 (en) * 2000-04-13 2003-05-13 Extensio Software, Inc. System and method for providing contextual and dynamic information retrieval
US6593944B1 (en) * 2000-05-18 2003-07-15 Palm, Inc. Displaying a web page on an electronic display device having a limited display area
US6712615B2 (en) * 2000-05-22 2004-03-30 Rolf John Martin High-precision cognitive performance test battery suitable for internet and non-internet use
US7555528B2 (en) * 2000-09-06 2009-06-30 Xanboo Inc. Systems and methods for virtually representing devices at remote sites
EP1317698B1 (fr) * 2000-09-13 2005-01-26 Siemens Aktiengesellschaft Installation dotee d'un element de realisation de processus pourvu d'un ecran avec un element d'activation pour l'annulation commandee a distance de la fonction d'economiseur d'ecran, et element d'activation pour une telle installation
US6734882B1 (en) * 2000-09-29 2004-05-11 Apple Computer, Inc. Combined menu-list control element in a graphical user interface
US6918091B2 (en) * 2000-11-09 2005-07-12 Change Tools, Inc. User definable interface system, method and computer program product
US20040036718A1 (en) 2002-08-26 2004-02-26 Peter Warren Dynamic data item viewer
US20020099800A1 (en) * 2000-11-27 2002-07-25 Robert Brainard Data mark and recall system and method for a data stream
US7676758B2 (en) * 2000-12-04 2010-03-09 Lehman James A Interactive inventor's menu
US7197720B2 (en) * 2000-12-04 2007-03-27 Lehman James A Interactive inventor's menus within a software computer and video display system
US7191409B2 (en) * 2000-12-08 2007-03-13 Micron Technology, Inc. Method and apparatus for programming hot keys based on user interests
US6717597B2 (en) * 2000-12-15 2004-04-06 Dassault Systemes Contextual and dynamic command navigator for CAD and related systems
US6633317B2 (en) * 2001-01-02 2003-10-14 Microsoft Corporation Image-based walkthrough system and process employing spatial video streaming
US6741250B1 (en) * 2001-02-09 2004-05-25 Be Here Corporation Method and system for generation of multiple viewpoints into a scene viewed by motionless cameras and for presentation of a view path
US7017124B2 (en) * 2001-02-15 2006-03-21 Denny Jaeger Method for controlling electronic devices using digital recall tool
ITMI20010538A1 (it) * 2001-03-14 2002-09-14 Phoenix Tools S R L Sistema per la creazione la visualizzazione e la gestione di oggetti tridimensionali su pagine web e metodo relativo
US7805338B2 (en) * 2001-03-26 2010-09-28 Usa Technologies, Inc. Method of constructing a digital content play list for transmission and presentation on a public access electronic terminal
US6987512B2 (en) * 2001-03-29 2006-01-17 Microsoft Corporation 3D navigation techniques
US20020142273A1 (en) * 2001-03-30 2002-10-03 Dollins James T. Interactive process learning aid
US6839836B2 (en) * 2001-04-13 2005-01-04 Hewlett-Packard Development Company, L.P. Portable computing device with specialized operating system
US20020175918A1 (en) * 2001-04-17 2002-11-28 Barber John S. Method and system for implementing a path network in a computer graphics scene
US6712535B2 (en) * 2001-04-30 2004-03-30 Microsoft Corporation Keyboard with improved lateral region
US7042468B2 (en) * 2001-05-04 2006-05-09 Disney Enterprises, Inc. Text overlay for multi-dimensional construction project models
US7246329B1 (en) * 2001-05-18 2007-07-17 Autodesk, Inc. Multiple menus for use with a graphical user interface
US6688025B1 (en) * 2001-05-31 2004-02-10 James E. Cullinan Menu system
US6832353B2 (en) 2001-06-08 2004-12-14 Nokia Mobile Phones, Ltd. Viewing web pages on small screen devices using a keypad for navigation
US20030005443A1 (en) * 2001-06-27 2003-01-02 Karin Axelsson EPG having PIP window history and sample view functionality
US7127679B2 (en) 2001-06-29 2006-10-24 Softrek, Inc. Method for generating and navigating a plurality of menus using a database and a menu template
US20030012411A1 (en) * 2001-07-13 2003-01-16 Sjostrom Keith Jerome System and method for displaying and collecting ground penetrating radar data
US20050022114A1 (en) * 2001-08-13 2005-01-27 Xerox Corporation Meta-document management system with personality identifiers
US6832176B2 (en) 2001-08-24 2004-12-14 Xi Software Method and system for tracking and reporting time spent on tasks
JP4639559B2 (ja) * 2001-09-07 2011-02-23 ソニー株式会社 情報処理装置及び情報処理方法
JP2003091347A (ja) 2001-09-18 2003-03-28 Sony Corp 情報処理装置、並びに画面表示方法、画面表示プログラム及び画面表示プログラムが記録された記録媒体
US7096428B2 (en) * 2001-09-28 2006-08-22 Fuji Xerox Co., Ltd. Systems and methods for providing a spatially indexed panoramic video
JP2003303406A (ja) * 2002-04-08 2003-10-24 Hitachi Ltd 磁気抵抗効果ヘッド及び磁気ヘッド
US6981242B2 (en) * 2002-01-11 2005-12-27 Hewlett-Packard Development Company, L.P. System and method for developing custom operator-specific software-applications
US7333712B2 (en) 2002-02-14 2008-02-19 Koninklijke Philips Electronics N.V. Visual summary for scanning forwards and backwards in video content
US7012602B2 (en) * 2002-03-14 2006-03-14 Centric Software, Inc. Virtual three-dimensional display for product development
JP3677252B2 (ja) * 2002-03-22 2005-07-27 株式会社東芝 情報機器、記憶媒体、及び初期状態復元方法
US7492355B2 (en) * 2002-04-22 2009-02-17 Thomson Licensing Web browser for use with a television display for preventing screen burn
US7100150B2 (en) 2002-06-11 2006-08-29 Sun Microsystems, Inc. Method and apparatus for testing embedded examples in GUI documentation
US7334190B2 (en) 2002-06-27 2008-02-19 Mjw Corporation Inc. Interactive video tour system editor
US7546548B2 (en) * 2002-06-28 2009-06-09 Microsoft Corporation Method and system for presenting menu commands for selection
JP2004030535A (ja) * 2002-06-28 2004-01-29 Toshiba Corp 情報処理装置および同装置で使用される入力支援方法
GB2391149B (en) 2002-07-19 2005-10-26 Autodesk Canada Inc Processing scene objects
CA2492911A1 (fr) * 2002-07-19 2004-01-29 Memory Pharmaceuticals Corporation Composes de 6-amino-1h-indazole et de 4-aminobenzofurane utilises en tant qu'inhibiteurs de phosphodiesterase 4
US20040021888A1 (en) * 2002-07-30 2004-02-05 Chang Chin Chi Office business device incorporating one-touch operation method
US7549127B2 (en) 2002-08-01 2009-06-16 Realnetworks, Inc. Method and apparatus for resizing video content displayed within a graphical user interface
JP4093823B2 (ja) 2002-08-20 2008-06-04 富士通株式会社 視野移動操作方法
US8255814B2 (en) * 2002-09-06 2012-08-28 Autodesk, Inc. Temporary text and graphic feedback for object manipulators
WO2004027577A2 (fr) * 2002-09-19 2004-04-01 Brian Reynolds Systemes et procedes de creation et de lecture de notation musicale d'interpretation animee et audio synchronisee avec la performance enregistree d'un artiste original
US7589732B2 (en) * 2002-11-05 2009-09-15 Autodesk, Inc. System and method of integrated spatial and temporal navigation
US20040095480A1 (en) * 2002-11-20 2004-05-20 Battles Amy E. System and method for providing help with operating an image capture device
FR2849318B1 (fr) * 2002-12-24 2005-02-18 Radiotelephone Sfr Procede de navigation optimisee dans les menus d'affichage d'un terminal mobile et terminal mobile associe
JP2004242133A (ja) 2003-02-07 2004-08-26 Canon Inc 画像再生装置、画像再生方法、コンピュータプログラム、及びコンピュータ読み取り可能な記録媒体
JP3725134B2 (ja) * 2003-04-14 2005-12-07 株式会社エヌ・ティ・ティ・ドコモ 移動通信システム、移動通信端末、及びプログラム。
US7263661B2 (en) 2003-04-28 2007-08-28 Lexmark International, Inc. Multi-function device having graphical user interface incorporating customizable icons
US6968973B2 (en) * 2003-05-31 2005-11-29 Microsoft Corporation System and process for viewing and navigating through an interactive video tour
KR100835593B1 (ko) 2003-05-31 2008-06-09 삼성전자주식회사 디스플레이장치 및 그 표시상태 제어방법
US20040261031A1 (en) * 2003-06-23 2004-12-23 Nokia Corporation Context dependent auxiliary menu elements
US7814436B2 (en) 2003-07-28 2010-10-12 Autodesk, Inc. 3D scene orientation indicator system with scene orientation change capability
US6935797B2 (en) * 2003-08-12 2005-08-30 Creative Technology Limited Keyboard with built-in microphone
US7998807B2 (en) * 2003-08-22 2011-08-16 The Board Of Trustees Of The University Of Illinois Method for increasing the speed of a light emitting biopolar transistor device
FI20035144A (fi) * 2003-09-05 2005-03-06 Nokia Corp Menetelmä ja laitteisto matkaviestimen kameran käyttöönottamiseksi
US7417626B2 (en) * 2003-09-16 2008-08-26 Microsoft Corporation Method for processing data quantifying force applied to one or more keys of a computer keyboard
US7418670B2 (en) * 2003-10-03 2008-08-26 Microsoft Corporation Hierarchical in-place menus
WO2005050986A1 (fr) * 2003-11-19 2005-06-02 National Institute Of Information And Communications Technology, Independent Administrative Agency Procede et dispositif de presentation de contenu video
US7480863B2 (en) * 2003-11-26 2009-01-20 International Business Machines Corporation Dynamic and intelligent hover assistance
US7526464B2 (en) * 2003-11-28 2009-04-28 Manyworlds, Inc. Adaptive fuzzy network system and method
US7539652B2 (en) * 2003-11-28 2009-05-26 Manyworlds, Inc. Adaptive self-modifying and recombinant systems
KR100526825B1 (ko) * 2003-12-13 2005-11-08 삼성전자주식회사 디스플레이 시스템
US20050149971A1 (en) * 2004-01-06 2005-07-07 Hallberg Bryan S. Interactive television hot key manager
US7139754B2 (en) * 2004-02-09 2006-11-21 Xerox Corporation Method for multi-class, multi-label categorization using probabilistic hierarchical modeling
US20050190971A1 (en) * 2004-02-26 2005-09-01 Brubacher-Cressman Dale K. Handheld electronic device having improved help facility and associated method
US7376912B2 (en) 2004-03-25 2008-05-20 Morgan Stanley Interactive user interface for displaying supply chain information
US20050212823A1 (en) * 2004-03-29 2005-09-29 Uthe Robert T System, method and software for intelligent zooming in a user interface
US20050232610A1 (en) 2004-04-16 2005-10-20 Gateway, Inc. User automated content deletion
US8427538B2 (en) * 2004-04-30 2013-04-23 Oncam Grandeye Multiple view and multiple object processing in wide-angle video camera
US20050246642A1 (en) * 2004-05-03 2005-11-03 Valderas Harold M Application for viewing video slide based presentations
US7123189B2 (en) 2004-05-13 2006-10-17 Bushnell Performance Optics Apparatus and method for allowing user to track path of travel over extended period of time
US20050273778A1 (en) 2004-06-02 2005-12-08 Craig Bixler List-bar interface control apparatus and method
US20070192711A1 (en) * 2006-02-13 2007-08-16 Research In Motion Limited Method and arrangement for providing a primary actions menu on a handheld communication device
US20060009243A1 (en) * 2004-07-07 2006-01-12 At&T Wireless Services, Inc. Always-on mobile instant messaging of a messaging centric wireless device
US7688323B2 (en) * 2004-07-20 2010-03-30 Luxology, Llc Function portions of animation program
KR101323966B1 (ko) * 2004-07-30 2013-10-31 익스트림 리얼리티 엘티디. 이미지 프로세싱을 기반으로 한 3ｄ 공간 차원용 시스템 및 방법
US8255828B2 (en) * 2004-08-16 2012-08-28 Microsoft Corporation Command user interface for displaying selectable software functionality controls
US7155317B1 (en) * 2004-08-20 2006-12-26 Nhan Tran Occupant Counter Control Switch for automatic turning on and off electrical appliances in a room
US7743012B2 (en) 2004-09-08 2010-06-22 Universal Electronics Inc. Configurable controlling device and associated configuration upload and download system and method
JP4546202B2 (ja) * 2004-09-28 2010-09-15 キヤノン株式会社 映像受信装置とその制御方法とプログラム及び記憶媒体
US8276088B2 (en) * 2007-07-11 2012-09-25 Ricoh Co., Ltd. User interface for three-dimensional navigation
US8677274B2 (en) * 2004-11-10 2014-03-18 Apple Inc. Highlighting items for search results
JP4611000B2 (ja) * 2004-11-17 2011-01-12 パナソニック株式会社 携帯端末装置
JP4156584B2 (ja) * 2004-11-30 2008-09-24 株式会社ケンウッド ナビゲーション装置、方法及びプログラム
US20060123041A1 (en) * 2004-12-07 2006-06-08 Nokia Corporation Mode based action invocation through tag scanning
GB0427811D0 (en) * 2004-12-18 2005-01-19 Ibm User interface with scroll bar control
FR2880495A1 (fr) 2005-01-06 2006-07-07 Thomson Licensing Sa Procede de selection d'un element dans une liste par deplacement d'une distinction graphique et appareil mettant en oeuvre le procede
WO2006092647A1 (fr) * 2005-03-04 2006-09-08 Nokia Corporation Presentation d'elements de menu a un utilisateur
WO2006101451A2 (fr) * 2005-03-24 2006-09-28 G Element Pte. Ltd. Systeme et dispositif de visualisation, planification, controle et exploration a l'exterieur et a l'interieur d'un batiment
US20060218493A1 (en) 2005-03-28 2006-09-28 Murray Keith A Method, system and device for controlling a display
US7506268B2 (en) * 2005-04-07 2009-03-17 Microsoft Corporation User interface with visual tracking feature
US20060244723A1 (en) * 2005-04-28 2006-11-02 Ching-Tzu Chen Method of using a mouse to carry out multimedia adjustments
US20060248471A1 (en) * 2005-04-29 2006-11-02 Microsoft Corporation System and method for providing a window management mode
JP4515409B2 (ja) * 2005-05-20 2010-07-28 エルジー エレクトロニクス インコーポレイティド 移動通信端末機の連続クリック装置及びその実行方法
US10198521B2 (en) * 2005-06-27 2019-02-05 Google Llc Processing ambiguous search requests in a geographic information system
GB0519315D0 (en) * 2005-07-21 2005-11-02 Southwing S L Personal communications systems
TWI417543B (zh) * 2005-08-05 2013-12-01 Bayer Healthcare Llc 具有一包含複數個預定使用者特徵位準之多重位準使用者介面之計量器及其使用方法
CA2621488A1 (fr) * 2005-09-13 2007-03-22 Spacetime3D, Inc. Systeme et procede permettant de former une interface graphique utilisateur tridimensionnelle
JP5166874B2 (ja) * 2005-09-28 2013-03-21 株式会社Ａｃｃｅｓｓ 端末装置及びプログラム
US8160400B2 (en) * 2005-11-17 2012-04-17 Microsoft Corporation Navigating images using image based geometric alignment and object based controls
US8175618B2 (en) * 2005-11-28 2012-05-08 Qwest Communications International Inc. Mobile device product locator
CA2569450A1 (fr) * 2005-11-30 2007-05-30 Oculus Info Inc. Systeme et methode de production spatio-temporelle de textes originaux et permettant d'analyser des modeles de textes originaux sous forme de representation visuelle integree sur une interface utilisateur (de textes originaux)
JP2007165990A (ja) * 2005-12-09 2007-06-28 Hitachi Ltd Ｉｐアドレス変換方法及び情報処理装置
EP1804153A1 (fr) * 2005-12-27 2007-07-04 Amadeus s.a.s Liste de contrôle déroulante personnalisable par l'utilisateur pour applications logicielles d'IUG
EP1969870B1 (fr) 2005-12-29 2017-08-30 Ozmiz Pty. Ltd. Procede et systeme d'affichage de donnees sur un terminal mobile
US7603633B2 (en) 2006-01-13 2009-10-13 Microsoft Corporation Position-based multi-stroke marking menus
US20080036771A1 (en) * 2006-02-21 2008-02-14 Seok-Hyung Bae Pen-based drawing system
US9070402B2 (en) * 2006-03-13 2015-06-30 Autodesk, Inc. 3D model presentation system with motion and transitions at each camera view point of interest (POI) with imageless jumps to each POI
US7525542B2 (en) 2006-03-15 2009-04-28 Microsoft Corporation Automatically generating appropriate near and far clipping planes for a 3D scene while guaranteeing minimum of Z-buffer precision
US20070255115A1 (en) * 2006-04-27 2007-11-01 Anglin Richard L Jr Remote diagnostic & treatment system
JP2007310650A (ja) * 2006-05-18 2007-11-29 Toshiba Corp 情報処理装置
US7707516B2 (en) * 2006-05-26 2010-04-27 Google Inc. Embedded navigation interface
WO2007143085A2 (fr) * 2006-06-01 2007-12-13 Simquest Llc ProcÉdÉ et appareil de collecte et d'analyse de donnÉes concernant des lÉsions de surface
US7516406B1 (en) * 2006-06-06 2009-04-07 Adobe Systems Incorporated Partial functionality indicator
US20120036091A1 (en) * 2006-06-12 2012-02-09 Cook Kenneth W System and method for automated, range-based irrigation
US7610564B1 (en) * 2006-06-15 2009-10-27 Sun Microsystems, Inc. Displaying and browsing through a sparse view of content items in a hierarchy
US7552402B2 (en) 2006-06-22 2009-06-23 Microsoft Corporation Interface orientation using shadows
US8493323B2 (en) 2006-08-02 2013-07-23 Research In Motion Limited System and method for adjusting presentation of moving images on an electronic device according to an orientation of the device
US20080072139A1 (en) 2006-08-20 2008-03-20 Robert Salinas Mobilizing Webpages by Selecting, Arranging, Adapting, Substituting and/or Supplementing Content for Mobile and/or other Electronic Devices; and Optimizing Content for Mobile and/or other Electronic Devices; and Enhancing Usability of Mobile Devices
JP2008073184A (ja) * 2006-09-20 2008-04-03 Namco Bandai Games Inc プログラム、情報記憶媒体及びゲーム装置
US8277316B2 (en) * 2006-09-14 2012-10-02 Nintendo Co., Ltd. Method and apparatus for using a common pointing input to control 3D viewpoint and object targeting
US7970436B1 (en) * 2006-09-22 2011-06-28 Sprint Communications Company L.P. Wireless interface extension for mobile devices
US20080088621A1 (en) * 2006-10-11 2008-04-17 Jean-Jacques Grimaud Follower method for three dimensional images
KR20080038630A (ko) * 2006-10-30 2008-05-07 삼성전자주식회사 프로그램 탐색용 북마크 기능을 갖는 영상기기 및 북마크설정방법
US8285732B2 (en) 2006-12-18 2012-10-09 Sap Ag Method and system for providing themes for software applications
US7908588B2 (en) * 2006-12-18 2011-03-15 International Business Machines Corporation Program presentation with reviewer feedback maintenance
US8943410B2 (en) 2006-12-22 2015-01-27 Apple Inc. Modified media presentation during scrubbing
US20080163121A1 (en) * 2006-12-29 2008-07-03 Research In Motion Limited Method and arrangement for designating a menu item on a handheld electronic device
US8689132B2 (en) * 2007-01-07 2014-04-01 Apple Inc. Portable electronic device, method, and graphical user interface for displaying electronic documents and lists
US8295542B2 (en) * 2007-01-12 2012-10-23 International Business Machines Corporation Adjusting a consumer experience based on a 3D captured image stream of a consumer response
US7782319B2 (en) 2007-03-28 2010-08-24 Autodesk, Inc. Three-dimensional orientation indicator and controller
WO2008133950A1 (fr) 2007-04-24 2008-11-06 Topplestone, Llc Procédé et système de conception d'une pâtisserie
US7979805B2 (en) * 2007-05-21 2011-07-12 Microsoft Corporation Button discoverability
US8473859B2 (en) * 2007-06-08 2013-06-25 Apple Inc. Visualization and interaction models
US8316308B2 (en) 2007-06-08 2012-11-20 Google Inc. Adaptive user interface for multi-source systems
US20090008472A1 (en) * 2007-07-02 2009-01-08 Chadwick Loring Wilson Control Devices For Irrigation Systems And Methods For Programming
US20090037813A1 (en) * 2007-07-31 2009-02-05 Palo Alto Research Center Incorporated Space-constrained marking menus for mobile devices
US8478245B2 (en) * 2007-08-01 2013-07-02 Phunware, Inc. Method and system for rendering content on a wireless device
TWI336445B (en) * 2007-08-08 2011-01-21 Wistron Corp Method for differentiating keys and related computer apparatus
US8627218B2 (en) * 2007-08-24 2014-01-07 Creative Technology Ltd Host implemented method for customising a secondary device
AU2008298086A1 (en) 2007-09-14 2009-03-19 Tomtom International B.V. Communications apparatus, system and method of providing a user interface
KR20090032559A (ko) * 2007-09-28 2009-04-01 엘지전자 주식회사 휴대 단말기 및 그 제어방법
US8416198B2 (en) * 2007-12-03 2013-04-09 Apple Inc. Multi-dimensional scroll wheel
US8245143B2 (en) 2008-10-08 2012-08-14 Research In Motion Limited Method and handheld electronic device having a graphical user interface which arranges icons dynamically
US9383897B2 (en) * 2009-01-29 2016-07-05 International Business Machines Corporation Spiraling radial menus in computer systems
US8051375B2 (en) * 2009-04-02 2011-11-01 Sony Corporation TV widget multiview content organization
DE102009018806A1 (de) * 2009-04-24 2010-11-25 Fresenius Medical Care Deutschland Gmbh Rechnersystem und Verfahren zum Erzeugen wenigstens einer maschinenlesbaren Datei für eine medizinische Behandlungsvorrichtung
US8413065B2 (en) * 2009-09-07 2013-04-02 Qualcomm Incorporated User interface methods for ending an application
US9632662B2 (en) * 2009-09-16 2017-04-25 International Business Machines Corporation Placement of items in radial menus
KR101625884B1 (ko) 2009-12-09 2016-05-31 엘지전자 주식회사 휴대 단말기 및 그 동작 제어방법
JP5413357B2 (ja) * 2010-11-30 2014-02-12 カシオ計算機株式会社 サーバ装置、シンクライアントシステムおよびプログラム
US9086794B2 (en) * 2011-07-14 2015-07-21 Microsoft Technology Licensing, Llc Determining gestures on context based menus

Patent Citations (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4734690A (en) * 1984-07-20 1988-03-29 Tektronix, Inc. Method and apparatus for spherical panning
US5075673A (en) * 1989-06-16 1991-12-24 International Business Machines Corp. Variable speed, image pan method and apparatus
US5293529A (en) * 1991-03-12 1994-03-08 Matsushita Electric Industrial Co., Ltd. Three-dimensional information handling system
US5583977A (en) * 1993-10-21 1996-12-10 Taligent, Inc. Object-oriented curve manipulation system
US5511157A (en) * 1993-12-13 1996-04-23 International Business Machines Corporation Connection of sliders to 3D objects to allow easy user manipulation and viewing of objects
US5929840A (en) * 1994-03-04 1999-07-27 Microsoft Corporation System and method for computer cursor control
US5488392A (en) * 1994-04-28 1996-01-30 Harris; Thomas S. Precision, absolute mapping computer pointing device and versatile accessories
US5734805A (en) * 1994-06-17 1998-03-31 International Business Machines Corporation Apparatus and method for controlling navigation in 3-D space
US6400401B1 (en) * 1994-11-29 2002-06-04 Canon Kabushiki Kaisha Camera control method and apparatus, and network system of camera control apparatus
US5874956A (en) * 1995-11-13 1999-02-23 Platinum Technology Apparatus and method for three dimensional manipulation of point of view and object
US6014142A (en) * 1995-11-13 2000-01-11 Platinum Technology Ip, Inc. Apparatus and method for three dimensional manipulation of point of view and object
US6331146B1 (en) * 1995-11-22 2001-12-18 Nintendo Co., Ltd. Video game system and method with enhanced three-dimensional character and background control
US6867790B1 (en) * 1996-08-09 2005-03-15 International Business Machines Corporation Method and apparatus to conditionally constrain pointer movement on a computer display using visual cues, controlled pointer speed and barriers on the display which stop or restrict pointer movement
US5841440A (en) * 1996-12-17 1998-11-24 Apple Computer, Inc. System and method for using a pointing device to indicate movement through three-dimensional space
US20060080604A1 (en) * 1997-04-14 2006-04-13 Anderson Thomas G Navigation and viewing in a multidimensional space
US6426745B1 (en) * 1997-04-28 2002-07-30 Computer Associates Think, Inc. Manipulating graphic objects in 3D scenes
US20020015024A1 (en) * 1998-01-26 2002-02-07 University Of Delaware Method and apparatus for integrating manual input
US6222557B1 (en) * 1998-06-26 2001-04-24 Visual Insights, Inc. Navigation system and method for viewing a 3D data landscape
US6313849B1 (en) * 1998-07-06 2001-11-06 Alps Electric Co., Ltd. Modal control scrolling of display area
US6738065B1 (en) * 1999-08-10 2004-05-18 Oshri Even-Zohar Customizable animation system
US6480191B1 (en) * 1999-09-28 2002-11-12 Ricoh Co., Ltd. Method and apparatus for recording and playback of multidimensional walkthrough narratives
US20050187832A1 (en) * 1999-10-21 2005-08-25 Morse Stacy J. Electronic property viewing system for providing virtual tours via a public communications network, and a method of exchanging the same
US6556206B1 (en) * 1999-12-09 2003-04-29 Siemens Corporate Research, Inc. Automated viewpoint selection for 3D scenes
US20060284839A1 (en) * 1999-12-15 2006-12-21 Automotive Technologies International, Inc. Vehicular Steering Wheel with Input Device
US20040210852A1 (en) * 2000-04-28 2004-10-21 Silicon Graphics, Inc. System for dynamically mapping input device movement as a user's viewpoint changes
US20020033845A1 (en) * 2000-09-19 2002-03-21 Geomcore Ltd. Object positioning and display in virtual environments
US20070234223A1 (en) * 2000-11-09 2007-10-04 Leavitt Joseph M User definable interface system, method, support tools, and computer program product
US6628279B1 (en) * 2000-11-22 2003-09-30 @Last Software, Inc. System and method for three-dimensional modeling
US20020063705A1 (en) * 2000-11-28 2002-05-30 Mitsubishi Denki Kabushiki Kaisha Apparatus and method for drawing three dimensional graphics by controlling alpha value based on Z coordinate value
US20050060667A1 (en) * 2001-03-12 2005-03-17 Microsoft Corporation Visualization of multi-dimensional data having an unbounded dimension
US20030206150A1 (en) * 2001-05-02 2003-11-06 Hand Held Products, Inc. Optical reader comprising keyboard
US20070198941A1 (en) * 2001-06-12 2007-08-23 David Baar Graphical user interface with zoom for detail-in-context presentations
US6640185B2 (en) * 2001-07-21 2003-10-28 Alpine Electronics, Inc. Display method and apparatus for navigation system
US20040189802A1 (en) * 2001-07-27 2004-09-30 Mark Flannery Control system for allowing an operator to proportionally control a work piece
US7190365B2 (en) * 2001-09-06 2007-03-13 Schlumberger Technology Corporation Method for navigating in a multi-scale three-dimensional scene
US6928618B2 (en) * 2001-10-23 2005-08-09 Autodesk, Inc. Intelligent drag of assembly components
US20030081012A1 (en) * 2001-10-30 2003-05-01 Chang Nelson Liang An User interface and method for interacting with a three-dimensional graphical environment
US20040001041A1 (en) * 2002-07-01 2004-01-01 Peterson Chang Scrollbar-less control button and method
US20060202973A1 (en) * 2002-07-30 2006-09-14 Canon Kabushiki Kaisha Coordinate input apparatus, control method thereof, and program
US20040135824A1 (en) * 2002-10-18 2004-07-15 Silicon Graphics, Inc. Tracking menus, system and method
US20040141010A1 (en) * 2002-10-18 2004-07-22 Silicon Graphics, Inc. Pan-zoom tool
US20040233222A1 (en) * 2002-11-29 2004-11-25 Lee Jerome Chan Method and system for scaling control in 3D displays ("zoom slider")
US20040240709A1 (en) * 2003-04-22 2004-12-02 Garth Shoemaker Method and system for controlling detail-in-context lenses through eye and position tracking
US20050128180A1 (en) * 2003-12-10 2005-06-16 Chong-Min Wang Portable presentation operating device
US20050168488A1 (en) * 2004-02-03 2005-08-04 Montague Roland W. Combination tool that zooms in, zooms out, pans, rotates, draws, or manipulates during a drag
US20050188325A1 (en) * 2004-02-20 2005-08-25 Kolman Robert S. Highlighting panning window interface
US20050210380A1 (en) * 2004-03-03 2005-09-22 Gary Kramer System for delivering and enabling interactivity with images
US20050212756A1 (en) * 2004-03-23 2005-09-29 Marvit David L Gesture based navigation of a handheld user interface
US20060004298A1 (en) * 2004-06-30 2006-01-05 Kennedy Philip R Software controlled electromyogram control systerm
US20060090022A1 (en) * 2004-10-22 2006-04-27 Intergraph Hardware Technologies Company Input device for controlling movement in a three-dimensional virtual environment
US20060253245A1 (en) * 2005-04-18 2006-11-09 Cera Christopher D Data-driven 3D traffic views with the view based on user-selected start and end geographical locations
US20070192739A1 (en) * 2005-12-02 2007-08-16 Hillcrest Laboratories, Inc. Scene transitions in a zoomable user interface using a zoomable markup language
US20070136690A1 (en) * 2005-12-12 2007-06-14 Microsoft Corporation Wedge menu
US20070162871A1 (en) * 2006-01-12 2007-07-12 Fujitsu Limited Information processing apparatus, control method therefor and control program
US20070179646A1 (en) * 2006-01-31 2007-08-02 Accenture Global Services Gmbh System for storage and navigation of application states and interactions
US20070206030A1 (en) * 2006-03-06 2007-09-06 The Protomold Company, Inc. Graphical user interface for three-dimensional manipulation of a part
US20070229458A1 (en) * 2006-03-31 2007-10-04 Samsung Electronics Co., Ltd. Wheel input device and method for four-way key stroke in portable terminal
US20080180391A1 (en) * 2007-01-11 2008-07-31 Joseph Auciello Configurable electronic interface
US20080192010A1 (en) * 2007-02-09 2008-08-14 Primax Electronics Ltd. Tilt wheel type mouse

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
William F. Lazarus A Crop Budget Caluclator For Electronic Spreadsheets December 1982 20 pages *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110102463A1 (en) * 2009-10-30 2011-05-05 Tekla Corporation Position fine tuning in a computer aided modeling
US8599220B2 (en) 2009-10-30 2013-12-03 Tekla Corporation Position fine tuning in a computer aided modeling
US20110169949A1 (en) * 2010-01-12 2011-07-14 Topcon Positioning Systems, Inc. System and Method for Orienting an Implement on a Vehicle
US9139977B2 (en) * 2010-01-12 2015-09-22 Topcon Positioning Systems, Inc. System and method for orienting an implement on a vehicle
US10839602B1 (en) * 2019-09-30 2020-11-17 The Boeing Company Systems and methods for navigating within a visual representation of a three-dimensional environment

Also Published As

Publication number Publication date
US20090079731A1 (en) 2009-03-26
WO2009042904A1 (fr) 2009-04-02
US9052797B2 (en) 2015-06-09
US9280257B2 (en) 2016-03-08
US9021400B2 (en) 2015-04-28
US8665272B2 (en) 2014-03-04
US9891783B2 (en) 2018-02-13
US20090083666A1 (en) 2009-03-26
WO2009042909A1 (fr) 2009-04-02
US20090083678A1 (en) 2009-03-26
US10564798B2 (en) 2020-02-18
WO2009042893A1 (fr) 2009-04-02
US8686991B2 (en) 2014-04-01
US10025454B2 (en) 2018-07-17
US20090083669A1 (en) 2009-03-26
WO2009094051A1 (fr) 2009-07-30
US20090083626A1 (en) 2009-03-26
US9122367B2 (en) 2015-09-01
US8314789B2 (en) 2012-11-20
WO2009042918A1 (fr) 2009-04-02
WO2009042929A1 (fr) 2009-04-02
WO2009042902A1 (fr) 2009-04-02
US20090079739A1 (en) 2009-03-26
WO2009042928A1 (fr) 2009-04-02
WO2009042925A1 (fr) 2009-04-02
WO2009042908A1 (fr) 2009-04-02
US8749544B2 (en) 2014-06-10
US20090079732A1 (en) 2009-03-26
WO2009042894A1 (fr) 2009-04-02
US20090079740A1 (en) 2009-03-26
US20090083662A1 (en) 2009-03-26
WO2009042930A1 (fr) 2009-04-02
US20090083674A1 (en) 2009-03-26
US20090083628A1 (en) 2009-03-26
US20090083673A1 (en) 2009-03-26
WO2009042923A1 (fr) 2009-04-02
US20090085911A1 (en) 2009-04-02
US20090083645A1 (en) 2009-03-26
WO2009042924A1 (fr) 2009-04-02
US20090083671A1 (en) 2009-03-26
US8803881B2 (en) 2014-08-12
US10162474B2 (en) 2018-12-25

Similar Documents

Publication Publication Date Title
US10162474B2 (en) Navigation system for a 3D virtual scene
US10504285B2 (en) Navigation system for a 3D virtual scene
JP6952877B2 (ja) 拡張現実環境及び仮想現実環境と相互作用するためのシステム、方法、及びグラフィカルユーザインタフェース
US7119819B1 (en) Method and apparatus for supporting two-dimensional windows in a three-dimensional environment

Legal Events

Date Code Title Description
AS Assignment

Owner name: AUTODESK, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FITZMAURICE, GEORGE;MATEJKA, JUSTIN;MORDATCH, IGOR;AND OTHERS;REEL/FRAME:023275/0955;SIGNING DATES FROM 20090515 TO 20090521

STCB Information on status: application discontinuation

Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION