WO2010123723A2 - Menu configuration system and method for display on an electronic device - Google Patents
Menu configuration system and method for display on an electronic device Download PDFInfo
- Publication number
- WO2010123723A2 WO2010123723A2 PCT/US2010/030964 US2010030964W WO2010123723A2 WO 2010123723 A2 WO2010123723 A2 WO 2010123723A2 US 2010030964 W US2010030964 W US 2010030964W WO 2010123723 A2 WO2010123723 A2 WO 2010123723A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- user actuation
- menu
- targets
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
Definitions
- This invention relates generally to touch sensitive user interfaces for electronic devices, and more particularly to a system and method for presenting user actuation targets on a display.
- Portable electronic devices including mobile telephones, music and multimedia players, gaming devices, personal digital assistants, and the like are becoming increasingly commonplace. People use these devices to stay connected with others, to organize their lives, and to entertain themselves. Advances in technology have made these devices easier to use. For example, while these devices used to have a dedicated display for presenting information and a keypad for receiving input from a user, the advent of "touch- sensitive screens" have combined the display and keypad. Rather than typing on a keypad, a user simply touches the display to enter data. Touch-sensitive displays, in addition to being dynamically configurable, allow for more streamlined devices that are sometimes preferred by consumers.
- One problem associated with traditional touch sensitive displays is that the information presented on the display is often configured as it would be on a personal computer.
- some portable electronic devices have operating systems that mimic computer operating systems in presentation, with some controls in the corner, others, along the edge, and so forth.
- the user may have to navigate through several sub-menus. Further, the user may have to move their fingers all around the display to find and actuate small icons or menus. Not only it such a presentation conducive to the user mistakenly touching the wrong icons, it is especially challenging when the user is operating the device with one hand.
- FIG. 1 illustrates one embodiment of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
- FIG. 2 illustrates one embodiment of sub-steps of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
- FIG. 3 illustrates one embodiment of sub-steps a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
- FIG. 4 illustrates one embodiment of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
- FIG. 5 illustrates one embodiment of sub-steps a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
- FIG. 6 illustrates one embodiment of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
- FIG. 7 illustrates one embodiment of an electronic device having a touch sensitive display in accordance with embodiments of the invention.
- FIG. 8 illustrates one embodiment of a schematic block diagram for an electronic device having a touch sensitive display in accordance with embodiments of the invention.
- FIG. 9 illustrates one configuration of placement locations for user actuation target presentation in accordance with embodiments of the invention.
- FIG. 16 FIG.
- FIG. 10 illustrates one configuration of placement locations for user actuation target presentation in accordance with embodiments of the invention.
- FIG. 11 illustrates user actuation target presentation in accordance with one embodiment of the invention.
- FIG. 12 illustrates user actuation target presentation in accordance with one embodiment of the invention.
- FIG. 13 illustrates a depiction of a user actuation target arrangement in accordance with embodiments of the invention.
- Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present invention.
- embodiments of the invention described herein may be comprised of one or more conventional processors, computer readable media, and unique stored program instructions that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of menu and user actuation target presentation on a touch- sensitive display as described herein.
- these functions may be interpreted as steps of a method to perform the determination of the placement or presentation of menus and user actuation targets on the touch-sensitive display, as well as the presentation of menus, information, and user actuation targets so as to correspond with the placement or motion of the user's finger or stylus.
- Embodiments of the present invention provide methods and apparatuses for presenting user- friendly menus and user actuation targets on a touch-sensitive display.
- an electronic device determines the placement of a user's finger or stylus on the display and presents a menu of options about that location.
- the menu can be presented in a curved configuration about the location, so that each option is equally easy to reach.
- the system presents preferred user actuation targets closer to the location than less-preferred user actuation targets. For example, more recently selected user actuation targets may be placed closer to the user's finger or stylus than less recently selected user actuation targets. In another embodiment, more frequently selected user actuation targets may be placed closer to the user's finger or stylus than less frequently selected user actuation targets.
- context driven icons such as those used with a particular application that is running on the device may be placed closer to the user's finger or stylus than global icons, which may be used with a variety of programs. These global icons would be presented farther from the user's finger or stylus.
- a controller creates a user actuation history by tracking which icons are actuated at which times, how frequently, in which environments, and so forth. The controller can then use this user actuation history to determine a hierarchy of precedence with the various icons or user actuation targets that may be presented.
- user actuation targets having a greater precedence can be presented closer to the user's finger or stylus, while those with a lesser precedence can be presented farther from the user's finger or stylus.
- user actuation targets having a greater precedence can be magnified to appear larger than those having a lesser precedence.
- precedence hierarchies include user history hierarchies, environmental hierarchies, or operational mode hierarchies.
- the controller may determine precedence based upon what user actuation targets a particular user tends to actuate at certain times, certain locations, or in certain situations. Those higher precedence user actuation targets can be presented closer to the user's finger or stylus. Alternatively, these higher precedence user actuation targets can be presented in a magnified form.
- the controller may receive information from outside sources, such as weather information services, traffic information services, and so forth.
- the controller can correlate received information to create an environmental hierarchy of precedence. For instance, when it is raining, the controller may present weather related user actuation targets closer to a user's finger or stylus than non- weather related user actuation targets. Alternatively, these higher precedence user actuation targets can be presented in a magnified form.
- the controller may present aquatic user actuation targets - such as marine supply stores or ultraviolet radiation information - closer to the user's finger or stylus than would be in-land user actuation targets.
- aquatic user actuation targets such as marine supply stores or ultraviolet radiation information - closer to the user's finger or stylus than would be in-land user actuation targets.
- these higher precedence user actuation targets can be presented in a magnified form.
- the controller may use electronic sensors within the device to determine the operating state of the electronic device and may create precedence hierarchies from this information.
- the controller may present an emergency call or emergency contact user actuation target closer to the user's finger or stylus than less used contact actuation targets.
- these higher precedence user actuation targets can be presented in a magnified form.
- submenus triggered by primary menu selections may be presented in a user- friendly format as well.
- the electronic device includes both circuit for determining the location of a user's finger or stylus and the pressure being applied by the finger or stylus, this pressure detection can be used to trigger sub-menus. For example, when the pressure is in a first range, a first menu can be presented. When the pressure is in a second range, a second menu can be presented.
- the second menu is a sub-menu of the first menu. There will be situations, however, where it is difficult to show all the user actuation targets associated with a particular menu on the display with a desired font size.
- the second menu can include the user actuation targets of the first menu in addition to other user actuation targets. In such an embodiment, by increasing the pressure from within the first range to within the second range, additional user actuation targets can be shown while decreasing the font size of each user actuation target. For example, if the finger touches the touch screen with low pressure, only the top menu (of most used icons) may be presented to the user.
- submenus can be presented with different color systems to distinguish its menu hierarchy level relative to the whole menu hierarchy.
- FIG. 1 illustrated therein is one method 100 for presenting menus or user actuation targets to a user on a touch-sensitive display in accordance with embodiments of the invention.
- the method 100 of FIG. 1 is suitable for coding into executable instructions that can be stored within a computer-readable medium, such as a memory, such that the instructions can be executed by one or more processors to execute the method within an electronic device.
- a controller within the device monitors for some time which user actuation targets are actuated, and in which situations these user actuation targets or menus are actuated.
- This information regarding at least some of the user actuation target selections made by the user can be stored in a corresponding memory as a user actuation history.
- the controller may store, for example, the times at which user actuation targets are selected, the frequency of which user actuation targets are selected, applications that are operational on the device when user actuation targets are selected, environmental conditions during which user actuation targets are selected, device operating characteristics with which user actuation targets are selected, or combinations of these characteristics. Embodiments of the present invention are not limited to these characteristics, as other characteristics will be obvious to those of ordinary skill in the art having the benefit of this disclosure.
- the user actuation history will include a hierarchy of precedence.
- Hierarchies have been discussed above, and will not be repeated here for brevity. However, some examples of hierarchies include frequency of use, recentness of use, and so forth. Designers employing embodiments of the invention may tailor the hierarchies to be device, application, or otherwise specific.
- the user actuation history comprises a user selection time that corresponds to the user actuation selections stored therein.
- the controller may determine the time of day that each user actuation target is selected and may correspondingly time stamp the entries of the user actuation history.
- a user provides input to the electronic device by touching the touch sensitive screen.
- the controller receives this input, which calls for the presentation of a menu.
- the term "menu" or "control menu” refers to the presentation of a plurality of user actuation targets.
- the user actuation targets are related, such as those used to edit a file or send an e-mail.
- the user actuation targets are not related.
- the menu can be presented in a conventional tabular form.
- the menu can be presented in a horizontal tabular form.
- the menu can be presented in a curved form, such as about the location of a user's finger or stylus.
- the user actuation targets may be surrounded by a common menu border, while in another embodiment they may be presented as freestanding icons.
- the controller at this step 102 further determines a user actuation time corresponding to the user input request. For example, the controller may detect that a certain menu is requested during a certain time of day. This information can be used in certain embodiments with the next step described below.
- the controller determines a user actuation target arrangement from the user actuation target history.
- the user actuation target arrangement in one embodiment, includes a hierarchy of precedence.
- the hierarchy of precedence can come from the user actuation history.
- the controller may determine its own hierarchy of precedence in response to the user input. For example, if a user actuates a weather information retrieval icon, and the weather is rain (as determined from a weather information service), the controller may create a hierarchy of precedence by placing satellite weather photo user actuation targets closer to the user's finger than temperature user actuation targets, as the user may be more interested in seeing pictures of cloud cover when inquiring about the weather during rain. Conversely, if the weather is sunny, a temperature user actuation target may be placed closer to the user's finger, as people are sometimes not interested in radar images when the weather is sunny.
- the controller at this step 103 determines the user actuation target arrangement from the user selection time corresponding to the input received at step 102 and from the user selection times stored in the user actuation history at step 101. From this information, the controller is able to determine a user actuation target arrangement that corresponds to a particular user's history of device operation. For example, where a user actuates an icon to order lunch each day between noon and one in the afternoon, the controller may construct a user actuation target arrangement with restaurant related icons having a higher precedence than non-restaurant related icons.
- the controller or a display driver presents at least a portion of the user actuation targets on the display.
- the user actuation targets are ordered in accordance with the user actuation target arrangement.
- order can mean a progressive order, such as top to bottom or right to left.
- it can refer to a distance from a predetermined location, such as a distance from a user's finger.
- it can refer to a size, shape, or color of the user actuation targets. For example, user actuation targets of higher precedence can be presented with magnification, or in a different color, than those with a lower precedence.
- this step 104 includes presenting the user actuation targets on the display such that user actuation targets having user selection times closer to the user actuation time are closer to the user's finger or stylus than user actuation targets having user selection times farther from the user actuation time. In another embodiment, this step 104 includes presenting the user actuation targets on the display such that user actuation targets having user selection times closer to the user actuation time are magnified or larger than user actuation targets having user selection times farther from the user actuation time.
- step 104 illustrated therein is one embodiment of step 104 from FIG. 1, which illustrates an example of presenting user actuation targets ordered in accordance with the user actuation target hierarchy.
- the controller or display driver magnifies some user actuation targets such that at least one user actuation target having a higher precedence appears bigger than at least another user actuation target having a lower precedence.
- at least one user actuation target having a lesser precedence can optionally be reduced or retained at a normal size, so as to be smaller than the magnified user actuation target having a higher precedence.
- step 301 that can be included in one embodiment of step 104 from FIG. 1.
- the user actuation targets are presented in a curved configuration on the display. This configuration can be circular, oval, semi-circular, or another curved configuration.
- this optional step 301 includes presenting the user actuation targets in a spiral or flower-petal type configuration that is concentric or otherwise about the user actuation target selected at step 102 of FIG. 1. Such a menu configuration is frequently more efficient for the user in that this placement of user actuation targets requires shorter travel to the desired user actuation target.
- FIG. 4 illustrated therein is one method 400 for presenting menus or user actuation targets to a user on a touch-sensitive display in accordance with embodiments of the invention that employs not only a menu selection, but also a determination of the user's finger or stylus when making that determination.
- a controller within the electronic device monitors - for some period of time - which user actuation targets are actuated.
- the controller can monitor in which situations or with which applications these user actuation targets or menus are actuated as well.
- This information regarding at least some of the user actuation target selections made by the user can be stored in a corresponding memory as a user actuation history.
- the user actuation history will include a hierarchy of precedence.
- Hierarchies have been discussed above, and some examples include frequency of use, recentness of use, and so forth. Designers employing embodiments of the invention may tailor the hierarchies to be device, application, or otherwise specific.
- a user provides input to the electronic device by touching the touch sensitive screen.
- the user may touch a user actuation target, icon, or menu, thereby requesting additional information be presented on the touch sensitive display.
- the controller receives this input.
- the controller determines a location of an object proximately located with the touch sensitive display that is responsible for, or otherwise corresponds to, the user input received at step 402. For example, if the user touches an icon with a finger, the controller can detect the location of the finger at step 403. Similarly, if the user touches an icon with a stylus, the controller can determine the location of the stylus at step 403. As will be described below, determining the location of the object can be accomplished in a variety of ways, including triangulation of three or more infrared sensors or by way of a capacitive layer capable of determining location of contact. Further, other location determining systems and methods will be obvious to those of ordinary skill in the art having the benefit of this disclosure.
- the controller determines a user actuation target arrangement from the user actuation target history.
- the user actuation target arrangement in one embodiment, includes a hierarchy of precedence.
- the hierarchy of precedence can come from the user actuation history.
- the controller may determine its own hierarchy of precedence in response to the user input.
- the controller or a display driver presents at least a portion of the user actuation targets on the display.
- the user actuation targets are ordered in accordance with the user actuation target arrangement.
- the step 405 of presenting the user actuation targets includes presenting the user actuation targets such that user actuation targets having a higher precedence are presented closer to the location of the object, as determined in step 403, than are user actuation targets having a lower precedence. This embodiment of step 405 is shown in detail in FIG. 5.
- FIG. 5 illustrates one embodiment of step 405 from FIG. 4, at step
- user actuation targets having a higher precedence are presented closer to the location.
- user actuation targets having a lower precedence are presented farther from the location. For example, where the location determined is the location that a user's finger touches the touch sensitive display, user actuation targets having a higher precedence may be presented closer to the user's finger than those having a lower precedence.
- magnification is employed. In this step 503, user actuation targets having a higher precedence are presented such that they are larger in presentation than are other user actuation targets having lower precedence.
- a user provides input to the electronic device by touching the touch sensitive screen.
- the user may touch a user actuation target, icon, or menu, thereby requesting additional information be presented on the touch sensitive display.
- the controller receives this input.
- the controller by way of a pressure sensor, determines an amount of pressure being exerted upon the touch sensitive display by the user at step 601. As will be explained below, this can be accomplished in a variety of ways. One way is via a force-sensing resistor. Another way is via a compliance member.
- this information can be used in the presentation of user actuation targets or menus. For example, at decision 603, the controller determines whether the pressure being applied is within a first range or a second range. In one embodiment, the first range is less than the second range. The first range may run from zero to one Newton, while the second range may be any force in excess of one Newton. It will be clear to those of ordinary skill in the art having the benefit of this disclosure that these ranges are illustrative only. Further, embodiments of the invention are not limited to two ranges - three or more ranges may also be used for greater resolution in actuation target presentation.
- the controller or a display driver may present a first menu at step 604 when the amount of pressure is within the first range.
- the controller or display driver may present a second menu at step 605 when the amount of pressure is within the second range.
- the first menu and second menu can be related in a variety of ways.
- the second menu can include the user actuation targets of the first menu in addition to other user actuation targets.
- additional user actuation targets can be shown while decreasing the font size of each user actuation target. For example, if the finger touches the touch screen with low pressure, only the top menu (of most used icons) may be presented to the user.
- submenus can be presented with different color systems to distinguish its menu hierarchy level relative to the whole menu hierarchy.
- the second menu is a subset of the first menu.
- the second menu can be the first menu magnified, with or without the addition of other user actuation targets.
- the second menu can comprise the first menu. It may alternatively comprise a sub-portion of the first menu. Elements of the second menu can be magnified relative to the first menu as well.
- One or both of the first menu or second menu can be presented in a curved configuration about the user input detected at step 601.
- elements of the first menu and second menu can be color-coded in different configurations.
- the first menu may be presented in a first color while the second menu is presented in a second color.
- the first color and second color can be the same. Alternatively, they can be different.
- FIG. 7 illustrated therein is one embodiment of an electronic device 700 suitable for executing methods and for presenting menus and user actuation targets in accordance with embodiments of the invention.
- the electronic device 700 includes a touch sensitive display 701 for presenting information 702 to a user.
- the touch sensitive display 701 is configured to receive touch input 703 from a user. For instance, the user may touch a user actuation target 704 to request a menu or other user actuation targets associated with applications of the electronic device 700.
- the information 702 presented on the touch sensitive display 701 can include menus and other user actuation targets requested by the user.
- FIG. 8 illustrated therein is a schematic block diagram 800 of the inner circuitry of the electronic device 700 of FIG. 7. Note that the schematic block diagram 800 of FIG. 8 is illustrative only, as devices and sensors other than those shown will be capable of presenting information (702) to a user in accordance with embodiments of the invention.
- a touch sensitive display 701 is configured to present information 702 to a user.
- the touch sensitive display 701 includes an infrared detector employing three or more infrared transceivers 801,802,803,804 for determining touch.
- Embodiments of the invention are not so limited, however. It will be obvious to those of ordinary skill in the art having the benefit of this disclosure that other touch- sensitive displays can be used as well.
- commonly assigned US Patent Application Ser. No. 11/679,228, entitled “Adaptable User Interface and Mechanism for a Portable Electronic Device,” filed February 27, 2007, which is incorporated herein by reference describes a touch sensitive display employing a capacitive sensor. Such a capacitive sensor can be used rather than the infrared detector described in the illustrative embodiment of FIG. 8.
- the illustrative touch sensitive display 701 of FIG. 8 includes at least four infrared transceivers 801,802,803,804 that are disposed about the touch sensitive display 701. While at least four transceivers will be used herein as an illustrative embodiment, it will be clear to those of ordinary skill in the art having the benefit of this disclosure that the invention is not so limited. Additional transceivers may be disposed about the touch sensitive display 701 as needed by a particular application. Additionally, while a square or rectangular touch sensitive display 701 is shown herein for discussion purposes, the invention is not so limited. The touch sensitive display 701 could have any number of sides, could be round, or could be a non-uniform shape as well.
- a controller 805 is operable with the infrared transceivers 801 ,802,803,804.
- the controller 805, which may be a microprocessor, programmable logic, application specific integrated circuit device, or other similar device, is capable of executing program instructions - such as those shown in FIGS. 1-6 - which may be stored either in the controller 805 or in a memory 806 or other computer readable medium coupled to the controller 805.
- the controller 805 is configured to detect which of the four infrared transceivers 801,802,803,804 receives a most reflected light signal. As the light emitting elements of each infrared transceiver 801,802,803,804 emit infrared light, that infrared light is reflected off objects such as fingers and stylus devices that are proximately located with the surface of the touch sensitive display 701. Where each light-receiving element of the infrared transceivers 801,802,803,804 receives light having approximately the same signal strength, the controller 805 is configured to correlate this with the object being located relatively within the center of the touch sensitive display 701.
- the controller 805 is configured to correlate this with a finger or other object being located near or atop that particular infrared transceiver.
- the controller 805 determines that a finger or other object is near or atop a particular infrared transceiver, that information can be used to correlate the object's location with a particular mode of operation.
- the touch sensitive display 701 has two infrared transceivers 801,802 disposed along the bottom 807 of the touch sensitive display 701, while two infrared transceivers 803,804 are disposed along the top 808 of the touch sensitive display 701.
- an infrared transceiver 801,802 disposed along the bottom 807 of the touch sensitive display 701 can mean that user is operating the touch sensitive display 701 with their thumbs.
- the infrared transceiver 801,802 receiving the most reflected signal is the infrared transceiver 801 on the lower, left corner of the touch sensitive display 701 , this can indicate a user operating the touch sensitive display 701 with one hand, and more particularly the left hand.
- the infrared transceiver 801,802 receiving the most reflected signal is the infrared transceiver 802 on the lower, right corner of the touch sensitive display 701 , this can indicate a user operating the touch sensitive display 701 with one hand, and more particularly the right hand.
- the controller 805 is configured to determine not only that an object is in contact with the touch sensitive display 701, but, as noted above, the location of the object along the touch sensitive display 701. This is accomplished, in one embodiment, by triangulation between the various infrared transceivers 801,802,803,804. Triangulation to determine an object's location by reflecting transmitted waves off the object is well known in the art. Essentially, in triangulation, the infrared transceivers are able to determine the location of a user's finger, stylus, or other object by measuring angles to that object from known points across the display along a fixed baseline. The user's finger, stylus, or other object can then be used as the third point of a triangle with the other vertices known.
- the controller 805 can be configured to determine the objects location by triangulation using only infrared transceivers other than the one receiving the most reflected signal. In the illustrative embodiment of FIG. 8, wherein infrared transceiver 801 is receiving the most reflected signal, the controller 805 can be configured to determine the corresponding object's location by triangulation using infrared transceivers 802,803,804.
- a display driver 809 is operable with the controller 805 and is configured to present the information 703 on the touch sensitive display 701.
- the controller 805, in one embodiment, is configured to receive user input from the touch sensitive display and to construct a user actuation history 810, which may be stored in the memory 806.
- the controller 805 is configured to store user actuation target selections in the user actuation history 810.
- the controller may store other information, such as time, environment, device operational status, and so forth, as previously described, in the user actuation history 810.
- the controller 805 is configured to determine a user actuation precedence hierarchy from the user actuation history 810 in accordance with the methods described above.
- the user actuation target history comprises a ranking of more recently selected user actuation targets.
- the user actuation target history comprises a ranking of most frequently selected user actuation targets.
- the display driver 809 is then configured to present a plurality of user actuation targets 812 on the display in accordance with the user actuation target precedence hierarchy as described above.
- the display driver 809 is configured to present some user actuation targets with magnification such that at least one user actuation target having a higher precedence is larger in presentation on the touch sensitive display 701 than at least another user actuation target having a lower precedence.
- the display driver is configured to present at least some user actuation targets having higher precedence closer to the location of the user's finger than at least some other user actuation targets having lower precedence.
- the display driver 809 is configured to present the user actuation targets in a curved configuration about the determined location.
- the schematic block diagram 800 includes a pressure detector 813 for determining a force exerted by the user 811 upon the touch sensitive display 701.
- pressure detectors 813 available for this purpose.
- commonly assigned US Patent Application Ser. No. 11/679,228, entitled “Adaptable User Interface and Mechanism for a Portable Electronic Device,” filed February 27, 2007, which is incorporated by reference above teaches the use of a force-sensing resistor.
- An alternate embodiment of a force sensor is described in commonly assigned, copending US Patent Application Ser. No. 12/181,923, entitled “Single Sided Capacitive Force Sensor for Electronic Devices,” filed July 29, 2008, which is incorporated herein by reference. Others will be known to those of ordinary skill in the art having the benefit of this disclosure.
- the pressure detector 813 is operatively coupled with the controller 805.
- the pressure detector 813 is configured to determine a user pressure 814 corresponding to the user's actuation of the touch sensitive display 701.
- the controller 805 can then determine whether this user pressure 814 is within a predetermined range, and the display driver 809 can present information 702 accordingly.
- a predetermined set of pressure ranges can be used.
- the display driver 809 is configured to present at least some user actuation targets.
- the display driver 809 is configured to present at least some other user actuation targets.
- FIG. 9 illustrated therein is one embodiment of a curved menu 900 that shows illustrative user actuation target placement locations that can be presented about the location 901 of a user's finger or stylus.
- user actuation targets having higher precedence 902,903,904 can be presented closer to the location 901 of the user's finger or stylus than user actuation targets having a lower precedence 905,906,907.
- Each of these user actuation targets shown in FIG. 9 is presented in a curved configuration about the location 901 of the finger or stylus.
- FIG. 10 illustrated therein is a rectangular menu 1000 that shows illustrative user actuation target placement locations that can be presented about the location 1001 of a user's finger or stylus.
- user actuation targets having higher precedence 1002,1003,1004 can be presented closer to the location 1001 of the user's finger or stylus than user actuation targets having a lower precedence 1005,1006,1007.
- Each of these user actuation targets shown in FIG. 10 is presented in an orthogonal configuration about the location 1001 of the finger or stylus.
- the illustrative embodiment of FIG. 10 shows the magnification discussed above. Specifically, user actuation targets having higher precedence 1002,1003,1004 are presented with a larger presentation than user actuation targets having a lower precedence 1005,1006,1007.
- the menus 900, 1000 of FIGS. 9 and 10, respectively, can also be used when the pressure detector (813) is employed.
- user actuation targets having a higher precedence 902,903,904 and 1002,1003,1004, respectively, can be presented when the user pressure (814) is within a first range
- user actuation targets having a lower precedence 905,906,907 and 1005,1006,1007, respectively, can be presented when the user pressure (814) is within a second range.
- FIG. 11 illustrated therein is an illustration of user actuation targets
- a menu 1104 including user actuation targets 1101,1102,1103 is presented in a horizontal, tabular configuration.
- user actuation target 1101 has a greater precedence than user actuation target 1102.
- User actuation target 1102 has a higher precedence than user actuation target 1103. Therefore, in this illustrative embodiment, user actuation target 1101 is presented closer to the user's finger 1105 than user actuation target 1102.
- user actuation target 1103 is presented farther from the user's finger 1105 than user actuation target 1102.
- User actuation target 1101 may represent a more frequently selected user actuation target, a more frequently selected user actuation target, or it may meet another criterion giving it elevated precedence.
- FIG. 12 illustrated therein is another illustration of user actuation targets
- the menu 1205, which including user actuation targets 1201,1202,1203,1204 is presented in a free-form configuration with the user actuation targets 1201,1202,1203,1204 being presented as round icons.
- user actuation target 1201 has a greater precedence than user actuation target 1203, but par precedence with user actuation target 1202.
- User actuation target 1202 has a higher priority than user actuation target 1204.
- user actuation target 1204 has par precedence with user actuation target 1203. Therefore, in this illustrative embodiment, user actuation target 1201 is presented closer to the user's finger 1206 than user actuation target 1203. Similarly, user actuation target 1204 is presented farther from the user's finger 1206 than user actuation target 1202.
- user actuation targets 1201,1202 are magnified, so as to appear larger than user actuation targets 1203,1204. Further, the user actuation targets 1201,1202,1203,1204 are presented in a curved configuration about the user's finger 1206.
- FIG. 13 illustrated therein is a graphical representation of a user actuation target arrangement 1300 comprising a hierarchy of precedence 1301. Some of the factors that can be used to determine the hierarchy of precedence 1305 are also shown. As noted above, in various embodiments of the invention, the factors that can be considered include historical factors, environmental factors, or operational mode factors. In the illustrative embodiment depicted in FIG. 13, the factors include most frequently selected user actuation targets 1301, most recently selected user actuation targets 1302, environmental factors 1303, and operational state factors 1304.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A method (100) and electronic device (700) for presenting user actuation targets (1101,1102,1103) on a touch sensitive display (701) includes a controller (805) configured to determine a user actuation target arrangement (1300) having a hierarchy of precedence (1301). A display driver (809) is then configured to present the user actuation targets (1101,1102,1103) on the touch sensitive display (701) in accordance with the user actuation target arrangement (1300). This can include presenting user actuation targets (1201,1202) having a higher precedence closer to a user's finger (1206) than user actuation targets (1203,1204) having a lower precedence, or by magnifying user actuation targets (1201,1202) having a higher precedence. Precedence can be determined by most frequently selected targets, most recently selected targets, or other factors.
Description
Menu Configuration System and Method for Display on an Electronic
Device
CROSS REFERENCE TO RELATED APPLICATIONS
[001] This application is related to US Application. No. 12/428,266 entitled "Touch-Screen and
Method for an Electronic Device," filed 22 April 2009, Attorney Docket No. CS36437, which is incorporated herein by reference.
BACKGROUND TECHNICAL FIELD
[002] This invention relates generally to touch sensitive user interfaces for electronic devices, and more particularly to a system and method for presenting user actuation targets on a display.
BACKGROUND ART
[003] Portable electronic devices, including mobile telephones, music and multimedia players, gaming devices, personal digital assistants, and the like are becoming increasingly commonplace. People use these devices to stay connected with others, to organize their lives, and to entertain themselves. Advances in technology have made these devices easier to use. For example, while these devices used to have a dedicated display for presenting information and a keypad for receiving input from a user, the advent of "touch- sensitive screens" have combined the display and keypad. Rather than typing on a keypad, a user simply touches the display to enter data. Touch-sensitive displays, in addition to being dynamically configurable, allow for more streamlined devices that are sometimes preferred by consumers.
[004] One problem associated with traditional touch sensitive displays is that the information presented on the display is often configured as it would be on a personal computer. For example, some portable electronic devices have operating systems that mimic computer operating systems
in presentation, with some controls in the corner, others, along the edge, and so forth. When a user wishes to activate a program or view a file, the user may have to navigate through several sub-menus. Further, the user may have to move their fingers all around the display to find and actuate small icons or menus. Not only it such a presentation conducive to the user mistakenly touching the wrong icons, it is especially challenging when the user is operating the device with one hand.
[005] There is thus a need for an improved electronic device that has a touch-sensitive screen and information presentation that resolves these issues.
BRIEF DESCRIPTION OF THE DRAWINGS
[006] The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views and which together with the detailed description below are incorporated in and form part of the specification, serve to further illustrate various embodiments and to explain various principles and advantages all in accordance with the present invention.
[007] FIG. 1 illustrates one embodiment of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
[008] FIG. 2 illustrates one embodiment of sub-steps of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
[009] FIG. 3 illustrates one embodiment of sub-steps a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
[010] FIG. 4 illustrates one embodiment of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
[011] FIG. 5 illustrates one embodiment of sub-steps a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention.
[012] FIG. 6 illustrates one embodiment of a method for presenting user actuation targets on a touch sensitive display in accordance with embodiments of the invention. [013] FIG. 7 illustrates one embodiment of an electronic device having a touch sensitive display in accordance with embodiments of the invention. [014] FIG. 8 illustrates one embodiment of a schematic block diagram for an electronic device having a touch sensitive display in accordance with embodiments of the invention. [015] FIG. 9 illustrates one configuration of placement locations for user actuation target presentation in accordance with embodiments of the invention. [016] FIG. 10 illustrates one configuration of placement locations for user actuation target presentation in accordance with embodiments of the invention. [017] FIG. 11 illustrates user actuation target presentation in accordance with one embodiment of the invention. [018] FIG. 12 illustrates user actuation target presentation in accordance with one embodiment of the invention. [019] FIG. 13 illustrates a depiction of a user actuation target arrangement in accordance with embodiments of the invention. [020] Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present invention.
DETAILED DESCRIPTION OF THE INVENTION [021] Before describing in detail embodiments that are in accordance with the present invention, it should be observed that the embodiments reside primarily in combinations of method steps and apparatus components related to presenting menus and user actuation targets on the
touch sensitive display of an electronic device. Accordingly, the apparatus components and method steps have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
[022] It will be appreciated that embodiments of the invention described herein may be comprised of one or more conventional processors, computer readable media, and unique stored program instructions that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of menu and user actuation target presentation on a touch- sensitive display as described herein. As such, these functions may be interpreted as steps of a method to perform the determination of the placement or presentation of menus and user actuation targets on the touch-sensitive display, as well as the presentation of menus, information, and user actuation targets so as to correspond with the placement or motion of the user's finger or stylus. Alternatively, some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits, in which each function or some combinations of certain of the functions are implemented as custom logic. Of course, a combination of the two approaches could be used. Further, it is expected that one of ordinary skill, notwithstanding possibly significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles disclosed herein will be readily capable of generating such software instructions and programs and circuits with minimal experimentation.
[023] Embodiments of the invention are now described in detail. Referring to the drawings, like numbers indicate like parts throughout the views. As used in the description herein and
throughout the claims, the following terms take the meanings explicitly associated herein, unless the context clearly dictates otherwise: the meaning of "a," "an," and "the" includes plural reference, the meaning of "in" includes "in" and "on." Relational terms such as first and second, top and bottom, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, reference designators shown herein in parenthesis indicate components shown in a figure other than the one in discussion. For example, talking about a device (10) while discussing figure A would refer to an element, 10, shown in figure other than figure A.
[024] Embodiments of the present invention provide methods and apparatuses for presenting user- friendly menus and user actuation targets on a touch-sensitive display. In one embodiment, an electronic device determines the placement of a user's finger or stylus on the display and presents a menu of options about that location. The menu can be presented in a curved configuration about the location, so that each option is equally easy to reach.
[025] In one embodiment, the system presents preferred user actuation targets closer to the location than less-preferred user actuation targets. For example, more recently selected user actuation targets may be placed closer to the user's finger or stylus than less recently selected user actuation targets. In another embodiment, more frequently selected user actuation targets may be placed closer to the user's finger or stylus than less frequently selected user actuation targets.
[026] Similarly, in another embodiment, context driven icons, such as those used with a particular application that is running on the device may be placed closer to the user's finger or stylus than global icons, which may be used with a variety of programs. These global icons would be presented farther from the user's finger or stylus.
[027] In another embodiment, a controller creates a user actuation history by tracking which icons are actuated at which times, how frequently, in which environments, and so forth. The controller can then use this user actuation history to determine a hierarchy of precedence with the various icons or user actuation targets that may be presented. In one embodiment, user actuation targets having a greater precedence can be presented closer to the user's finger or stylus, while those with a lesser precedence can be presented farther from the user's finger or stylus. In another embodiment, user actuation targets having a greater precedence can be magnified to appear larger than those having a lesser precedence.
[028] Examples of precedence hierarchies include user history hierarchies, environmental hierarchies, or operational mode hierarchies. In user history hierarchies, the controller may determine precedence based upon what user actuation targets a particular user tends to actuate at certain times, certain locations, or in certain situations. Those higher precedence user actuation targets can be presented closer to the user's finger or stylus. Alternatively, these higher precedence user actuation targets can be presented in a magnified form.
[029] In environmental hierarchies, the controller may receive information from outside sources, such as weather information services, traffic information services, and so forth. The controller can correlate received information to create an environmental hierarchy of precedence. For instance, when it is raining, the controller may present weather related user actuation targets closer to a user's finger or stylus than non- weather related user actuation targets. Alternatively, these higher precedence user actuation targets can be presented in a magnified form. Similarly, if the controller is receiving location information, such as from a Global Positioning System (GPS) source, and the controller determines that the device is near the sea, the controller may present aquatic user actuation targets - such as marine supply stores or ultraviolet radiation information -
closer to the user's finger or stylus than would be in-land user actuation targets. Alternatively, these higher precedence user actuation targets can be presented in a magnified form.
[030] In operational hierarchies, the controller may use electronic sensors within the device to determine the operating state of the electronic device and may create precedence hierarchies from this information. By way of example, if the controller determines that the device's internal battery has a low amount of energy stored therein, in a telephone mode the controller may present an emergency call or emergency contact user actuation target closer to the user's finger or stylus than less used contact actuation targets. Alternatively, these higher precedence user actuation targets can be presented in a magnified form.
[031 ] In another embodiment, in addition to repositioning user actuation targets within a particular display or menu, submenus triggered by primary menu selections may be presented in a user- friendly format as well. Where the electronic device includes both circuit for determining the location of a user's finger or stylus and the pressure being applied by the finger or stylus, this pressure detection can be used to trigger sub-menus. For example, when the pressure is in a first range, a first menu can be presented. When the pressure is in a second range, a second menu can be presented.
[032] This multiple presentation of menus can be used in several ways. In one embodiment, the second menu is a sub-menu of the first menu. There will be situations, however, where it is difficult to show all the user actuation targets associated with a particular menu on the display with a desired font size. In one embodiment, the second menu can include the user actuation targets of the first menu in addition to other user actuation targets. In such an embodiment, by increasing the pressure from within the first range to within the second range, additional user actuation targets can be shown while decreasing the font size of each user actuation target. For example, if the finger touches the touch screen with low pressure, only the top menu (of most
used icons) may be presented to the user. By pressing harder, the user can access the submenu by switching to the submenu presentation or squeezing the submenu content with the main menu content. In another embodiment, submenus can be presented with different color systems to distinguish its menu hierarchy level relative to the whole menu hierarchy.
[033] Turning now to FIG. 1, illustrated therein is one method 100 for presenting menus or user actuation targets to a user on a touch-sensitive display in accordance with embodiments of the invention. The method 100 of FIG. 1 is suitable for coding into executable instructions that can be stored within a computer-readable medium, such as a memory, such that the instructions can be executed by one or more processors to execute the method within an electronic device.
[034] At step 101, a controller within the device monitors for some time which user actuation targets are actuated, and in which situations these user actuation targets or menus are actuated. This information regarding at least some of the user actuation target selections made by the user can be stored in a corresponding memory as a user actuation history. The controller may store, for example, the times at which user actuation targets are selected, the frequency of which user actuation targets are selected, applications that are operational on the device when user actuation targets are selected, environmental conditions during which user actuation targets are selected, device operating characteristics with which user actuation targets are selected, or combinations of these characteristics. Embodiments of the present invention are not limited to these characteristics, as other characteristics will be obvious to those of ordinary skill in the art having the benefit of this disclosure.
[035] In one embodiment, the user actuation history will include a hierarchy of precedence.
Various hierarchies have been discussed above, and will not be repeated here for brevity. However, some examples of hierarchies include frequency of use, recentness of use, and so forth.
Designers employing embodiments of the invention may tailor the hierarchies to be device, application, or otherwise specific.
[036] In one embodiment, the user actuation history comprises a user selection time that corresponds to the user actuation selections stored therein. For example, the controller may determine the time of day that each user actuation target is selected and may correspondingly time stamp the entries of the user actuation history.
[037] At step 102, a user provides input to the electronic device by touching the touch sensitive screen. The controller receives this input, which calls for the presentation of a menu. As used herein, the term "menu" or "control menu" refers to the presentation of a plurality of user actuation targets. In one embodiment, the user actuation targets are related, such as those used to edit a file or send an e-mail. In another embodiment, the user actuation targets are not related. In one embodiment, the menu can be presented in a conventional tabular form. In another embodiment, the menu can be presented in a horizontal tabular form. In yet another embodiment, the menu can be presented in a curved form, such as about the location of a user's finger or stylus. In one embodiment the user actuation targets may be surrounded by a common menu border, while in another embodiment they may be presented as freestanding icons.
[038] In one embodiment, the controller at this step 102 further determines a user actuation time corresponding to the user input request. For example, the controller may detect that a certain menu is requested during a certain time of day. This information can be used in certain embodiments with the next step described below.
[039] At step 103, the controller determines a user actuation target arrangement from the user actuation target history. The user actuation target arrangement, in one embodiment, includes a hierarchy of precedence. The hierarchy of precedence can come from the user actuation history. Alternatively, the controller may determine its own hierarchy of precedence in response to the
user input. For example, if a user actuates a weather information retrieval icon, and the weather is rain (as determined from a weather information service), the controller may create a hierarchy of precedence by placing satellite weather photo user actuation targets closer to the user's finger than temperature user actuation targets, as the user may be more interested in seeing pictures of cloud cover when inquiring about the weather during rain. Conversely, if the weather is sunny, a temperature user actuation target may be placed closer to the user's finger, as people are sometimes not interested in radar images when the weather is sunny.
[040] In one embodiment, the controller at this step 103 determines the user actuation target arrangement from the user selection time corresponding to the input received at step 102 and from the user selection times stored in the user actuation history at step 101. From this information, the controller is able to determine a user actuation target arrangement that corresponds to a particular user's history of device operation. For example, where a user actuates an icon to order lunch each day between noon and one in the afternoon, the controller may construct a user actuation target arrangement with restaurant related icons having a higher precedence than non-restaurant related icons.
[041] At step 104, the controller or a display driver presents at least a portion of the user actuation targets on the display. In one embodiment, the user actuation targets are ordered in accordance with the user actuation target arrangement. Note that the term "order" as used herein can mean a progressive order, such as top to bottom or right to left. Alternatively, it can refer to a distance from a predetermined location, such as a distance from a user's finger. Additionally, it can refer to a size, shape, or color of the user actuation targets. For example, user actuation targets of higher precedence can be presented with magnification, or in a different color, than those with a lower precedence.
[042] In one embodiment, where the controller is configured to determine a user actuation time at step 102 and is further configured to determine the user actuation target arrangement from corresponding user actuation times of the user actuation history at step 103, this step 104 includes presenting the user actuation targets on the display such that user actuation targets having user selection times closer to the user actuation time are closer to the user's finger or stylus than user actuation targets having user selection times farther from the user actuation time. In another embodiment, this step 104 includes presenting the user actuation targets on the display such that user actuation targets having user selection times closer to the user actuation time are magnified or larger than user actuation targets having user selection times farther from the user actuation time.
[043] Turning briefly to FIG. 2, illustrated therein is one embodiment of step 104 from FIG. 1, which illustrates an example of presenting user actuation targets ordered in accordance with the user actuation target hierarchy. Specifically, in this illustrative embodiment, at step 201 , the controller or display driver magnifies some user actuation targets such that at least one user actuation target having a higher precedence appears bigger than at least another user actuation target having a lower precedence. At step 202, at least one user actuation target having a lesser precedence can optionally be reduced or retained at a normal size, so as to be smaller than the magnified user actuation target having a higher precedence.
[044] Turning now to FIG. 3, illustrated therein is an optional step 301 that can be included in one embodiment of step 104 from FIG. 1. Specifically, in optional step 301, the user actuation targets are presented in a curved configuration on the display. This configuration can be circular, oval, semi-circular, or another curved configuration. In one embodiment, this optional step 301 includes presenting the user actuation targets in a spiral or flower-petal type configuration that is concentric or otherwise about the user actuation target selected at step 102 of FIG. 1. Such a
menu configuration is frequently more efficient for the user in that this placement of user actuation targets requires shorter travel to the desired user actuation target.
[045] Turning now to FIG. 4, illustrated therein is one method 400 for presenting menus or user actuation targets to a user on a touch-sensitive display in accordance with embodiments of the invention that employs not only a menu selection, but also a determination of the user's finger or stylus when making that determination. At step 401 , as with step 101 of FIG. 1 , a controller within the electronic device monitors - for some period of time - which user actuation targets are actuated. Optionally, the controller can monitor in which situations or with which applications these user actuation targets or menus are actuated as well. This information regarding at least some of the user actuation target selections made by the user can be stored in a corresponding memory as a user actuation history.
[046] In one embodiment, the user actuation history will include a hierarchy of precedence.
Various hierarchies have been discussed above, and some examples include frequency of use, recentness of use, and so forth. Designers employing embodiments of the invention may tailor the hierarchies to be device, application, or otherwise specific.
[047] At step 402, a user provides input to the electronic device by touching the touch sensitive screen. The user may touch a user actuation target, icon, or menu, thereby requesting additional information be presented on the touch sensitive display. The controller receives this input.
[048] At step 403, the controller determines a location of an object proximately located with the touch sensitive display that is responsible for, or otherwise corresponds to, the user input received at step 402. For example, if the user touches an icon with a finger, the controller can detect the location of the finger at step 403. Similarly, if the user touches an icon with a stylus, the controller can determine the location of the stylus at step 403. As will be described below, determining the location of the object can be accomplished in a variety of ways, including
triangulation of three or more infrared sensors or by way of a capacitive layer capable of determining location of contact. Further, other location determining systems and methods will be obvious to those of ordinary skill in the art having the benefit of this disclosure.
[049] At step 404, the controller determines a user actuation target arrangement from the user actuation target history. The user actuation target arrangement, in one embodiment, includes a hierarchy of precedence. The hierarchy of precedence can come from the user actuation history. Alternatively, the controller may determine its own hierarchy of precedence in response to the user input.
[050] At step 405, the controller or a display driver presents at least a portion of the user actuation targets on the display. In one embodiment, the user actuation targets are ordered in accordance with the user actuation target arrangement. Further, in the illustrative embodiment of FIG. 4, the step 405 of presenting the user actuation targets includes presenting the user actuation targets such that user actuation targets having a higher precedence are presented closer to the location of the object, as determined in step 403, than are user actuation targets having a lower precedence. This embodiment of step 405 is shown in detail in FIG. 5.
[051] Turning now to FIG. 5, which illustrates one embodiment of step 405 from FIG. 4, at step
501 user actuation targets having a higher precedence are presented closer to the location. At step 502, user actuation targets having a lower precedence are presented farther from the location. For example, where the location determined is the location that a user's finger touches the touch sensitive display, user actuation targets having a higher precedence may be presented closer to the user's finger than those having a lower precedence. At optional step 503, magnification is employed. In this step 503, user actuation targets having a higher precedence are presented such that they are larger in presentation than are other user actuation targets having lower precedence.
[052] Turning now to FIG. 6, illustrated therein is one method 600 for presenting menus or user actuation targets to a user on a touch-sensitive display in accordance with embodiments of the invention that employs not only a menu selection, but also a determination of the pressure applied by a user's finger or stylus when making that determination. At step 601, a user provides input to the electronic device by touching the touch sensitive screen. The user may touch a user actuation target, icon, or menu, thereby requesting additional information be presented on the touch sensitive display. The controller receives this input.
[053] At step 602, the controller, by way of a pressure sensor, determines an amount of pressure being exerted upon the touch sensitive display by the user at step 601. As will be explained below, this can be accomplished in a variety of ways. One way is via a force-sensing resistor. Another way is via a compliance member.
[054] Once the amount of pressure is known, this information can be used in the presentation of user actuation targets or menus. For example, at decision 603, the controller determines whether the pressure being applied is within a first range or a second range. In one embodiment, the first range is less than the second range. The first range may run from zero to one Newton, while the second range may be any force in excess of one Newton. It will be clear to those of ordinary skill in the art having the benefit of this disclosure that these ranges are illustrative only. Further, embodiments of the invention are not limited to two ranges - three or more ranges may also be used for greater resolution in actuation target presentation.
[055] Once this decision 603 is made, the controller or a display driver may present a first menu at step 604 when the amount of pressure is within the first range. The controller or display driver may present a second menu at step 605 when the amount of pressure is within the second range. As noted above, the first menu and second menu can be related in a variety of ways. In one embodiment, the second menu can include the user actuation targets of the first menu in addition
to other user actuation targets. In such an embodiment, by increasing the pressure from within the first range to within the second range, additional user actuation targets can be shown while decreasing the font size of each user actuation target. For example, if the finger touches the touch screen with low pressure, only the top menu (of most used icons) may be presented to the user. By pressing harder, the user can access the submenu by switching to the submenu presentation or squeezing the submenu content with the main menu content. In another embodiment, submenus can be presented with different color systems to distinguish its menu hierarchy level relative to the whole menu hierarchy.
[056] In one embodiment, the second menu is a subset of the first menu. In another embodiment, the second menu can be the first menu magnified, with or without the addition of other user actuation targets. Said differently, the second menu can comprise the first menu. It may alternatively comprise a sub-portion of the first menu. Elements of the second menu can be magnified relative to the first menu as well. One or both of the first menu or second menu can be presented in a curved configuration about the user input detected at step 601. Further, elements of the first menu and second menu can be color-coded in different configurations. For example, the first menu may be presented in a first color while the second menu is presented in a second color. The first color and second color can be the same. Alternatively, they can be different.
[057] Now that the methods have been illustrated and described, various apparatuses and devices employing embodiments of the invention will be shown. Turning to FIG. 7, illustrated therein is one embodiment of an electronic device 700 suitable for executing methods and for presenting menus and user actuation targets in accordance with embodiments of the invention.
[058] The electronic device 700 includes a touch sensitive display 701 for presenting information 702 to a user. The touch sensitive display 701 is configured to receive touch input 703 from a user. For instance, the user may touch a user actuation target 704 to request a menu or
other user actuation targets associated with applications of the electronic device 700. The information 702 presented on the touch sensitive display 701 can include menus and other user actuation targets requested by the user.
[059] Turning now to FIG. 8, illustrated therein is a schematic block diagram 800 of the inner circuitry of the electronic device 700 of FIG. 7. Note that the schematic block diagram 800 of FIG. 8 is illustrative only, as devices and sensors other than those shown will be capable of presenting information (702) to a user in accordance with embodiments of the invention.
[060] A touch sensitive display 701 is configured to present information 702 to a user. In the illustrative embodiment of FIG. 7, the touch sensitive display 701 includes an infrared detector employing three or more infrared transceivers 801,802,803,804 for determining touch. Embodiments of the invention are not so limited, however. It will be obvious to those of ordinary skill in the art having the benefit of this disclosure that other touch- sensitive displays can be used as well. For example, commonly assigned US Patent Application Ser. No. 11/679,228, entitled "Adaptable User Interface and Mechanism for a Portable Electronic Device," filed February 27, 2007, which is incorporated herein by reference, describes a touch sensitive display employing a capacitive sensor. Such a capacitive sensor can be used rather than the infrared detector described in the illustrative embodiment of FIG. 8.
[061 ] The illustrative touch sensitive display 701 of FIG. 8 includes at least four infrared transceivers 801,802,803,804 that are disposed about the touch sensitive display 701. While at least four transceivers will be used herein as an illustrative embodiment, it will be clear to those of ordinary skill in the art having the benefit of this disclosure that the invention is not so limited. Additional transceivers may be disposed about the touch sensitive display 701 as needed by a particular application. Additionally, while a square or rectangular touch sensitive display 701 is
shown herein for discussion purposes, the invention is not so limited. The touch sensitive display 701 could have any number of sides, could be round, or could be a non-uniform shape as well.
[062] A controller 805 is operable with the infrared transceivers 801 ,802,803,804. The controller 805, which may be a microprocessor, programmable logic, application specific integrated circuit device, or other similar device, is capable of executing program instructions - such as those shown in FIGS. 1-6 - which may be stored either in the controller 805 or in a memory 806 or other computer readable medium coupled to the controller 805.
[063] In one embodiment, the controller 805 is configured to detect which of the four infrared transceivers 801,802,803,804 receives a most reflected light signal. As the light emitting elements of each infrared transceiver 801,802,803,804 emit infrared light, that infrared light is reflected off objects such as fingers and stylus devices that are proximately located with the surface of the touch sensitive display 701. Where each light-receiving element of the infrared transceivers 801,802,803,804 receives light having approximately the same signal strength, the controller 805 is configured to correlate this with the object being located relatively within the center of the touch sensitive display 701. Where, however, one infrared transceiver 801,802,803,804 receives a highest received signal, or, in an alternate embodiment a received signal above a predetermined threshold, the controller 805 is configured to correlate this with a finger or other object being located near or atop that particular infrared transceiver.
[064] Where the controller 805 determines that a finger or other object is near or atop a particular infrared transceiver, that information can be used to correlate the object's location with a particular mode of operation. For example, in the illustrative embodiment of FIG. 8, the touch sensitive display 701 has two infrared transceivers 801,802 disposed along the bottom 807 of the touch sensitive display 701, while two infrared transceivers 803,804 are disposed along the top 808 of the touch sensitive display 701. Where the electronic device (700) is being held upright by
the user, and an infrared transceiver 801,802 disposed along the bottom 807 of the touch sensitive display 701 is receiving the most reflected signal, it can mean that user is operating the touch sensitive display 701 with their thumbs. Where the infrared transceiver 801,802 receiving the most reflected signal is the infrared transceiver 801 on the lower, left corner of the touch sensitive display 701 , this can indicate a user operating the touch sensitive display 701 with one hand, and more particularly the left hand. Where the infrared transceiver 801,802 receiving the most reflected signal is the infrared transceiver 802 on the lower, right corner of the touch sensitive display 701 , this can indicate a user operating the touch sensitive display 701 with one hand, and more particularly the right hand.
[065] In one embodiment of the invention, the controller 805 is configured to determine not only that an object is in contact with the touch sensitive display 701, but, as noted above, the location of the object along the touch sensitive display 701. This is accomplished, in one embodiment, by triangulation between the various infrared transceivers 801,802,803,804. Triangulation to determine an object's location by reflecting transmitted waves off the object is well known in the art. Essentially, in triangulation, the infrared transceivers are able to determine the location of a user's finger, stylus, or other object by measuring angles to that object from known points across the display along a fixed baseline. The user's finger, stylus, or other object can then be used as the third point of a triangle with the other vertices known.
[066] Where a finger or object is atop a particular infrared transceiver, as indicated by a transceiver having a most received signal or a signal above a predetermined threshold, this transceiver is generally not suitable for triangulation purposes. As such, in accordance with embodiments of the invention, upon determining an infrared transceiver receiving a most reflected light signal, the controller 805 can be configured to determine the objects location by triangulation using only infrared transceivers other than the one receiving the most reflected
signal. In the illustrative embodiment of FIG. 8, wherein infrared transceiver 801 is receiving the most reflected signal, the controller 805 can be configured to determine the corresponding object's location by triangulation using infrared transceivers 802,803,804.
[067] A display driver 809 is operable with the controller 805 and is configured to present the information 703 on the touch sensitive display 701. The controller 805, in one embodiment, is configured to receive user input from the touch sensitive display and to construct a user actuation history 810, which may be stored in the memory 806. In one embodiment, the controller 805 is configured to store user actuation target selections in the user actuation history 810. In addition, the controller may store other information, such as time, environment, device operational status, and so forth, as previously described, in the user actuation history 810.
[068] In response to the user 811 actuating the touch sensitive display 701, such as by touching a user actuation target 704, the controller 805 is configured to determine a user actuation precedence hierarchy from the user actuation history 810 in accordance with the methods described above. For example, in one embodiment the user actuation target history comprises a ranking of more recently selected user actuation targets. In another embodiment, the user actuation target history comprises a ranking of most frequently selected user actuation targets. The display driver 809 is then configured to present a plurality of user actuation targets 812 on the display in accordance with the user actuation target precedence hierarchy as described above.
[069] By way of example, in one embodiment the display driver 809 is configured to present some user actuation targets with magnification such that at least one user actuation target having a higher precedence is larger in presentation on the touch sensitive display 701 than at least another user actuation target having a lower precedence. In another embodiment, when the controller 805 determines the location of the user's finger, such as by triangulation of the infrared transceivers 801,802,803,804, the display driver is configured to present at least some user
actuation targets having higher precedence closer to the location of the user's finger than at least some other user actuation targets having lower precedence. In one embodiment, the display driver 809 is configured to present the user actuation targets in a curved configuration about the determined location.
[070] In one embodiment, the schematic block diagram 800 includes a pressure detector 813 for determining a force exerted by the user 811 upon the touch sensitive display 701. There are a variety of pressure detectors 813 available for this purpose. For example, commonly assigned US Patent Application Ser. No. 11/679,228, entitled "Adaptable User Interface and Mechanism for a Portable Electronic Device," filed February 27, 2007, which is incorporated by reference above teaches the use of a force-sensing resistor. An alternate embodiment of a force sensor is described in commonly assigned, copending US Patent Application Ser. No. 12/181,923, entitled "Single Sided Capacitive Force Sensor for Electronic Devices," filed July 29, 2008, which is incorporated herein by reference. Others will be known to those of ordinary skill in the art having the benefit of this disclosure.
[071] Where a pressure detector 813 is employed, the pressure detector 813 is operatively coupled with the controller 805. The pressure detector 813 is configured to determine a user pressure 814 corresponding to the user's actuation of the touch sensitive display 701. The controller 805 can then determine whether this user pressure 814 is within a predetermined range, and the display driver 809 can present information 702 accordingly. For example, in one embodiment a predetermined set of pressure ranges can be used. In such an embodiment, when the user pressure 814 is in a first range, the display driver 809 is configured to present at least some user actuation targets. When the user pressure 814 is in a second range, the display driver 809 is configured to present at least some other user actuation targets. This will be shown in more detail in the following figures.
[072] Turning now to FIG. 9, illustrated therein is one embodiment of a curved menu 900 that shows illustrative user actuation target placement locations that can be presented about the location 901 of a user's finger or stylus. By way of example, user actuation targets having higher precedence 902,903,904 can be presented closer to the location 901 of the user's finger or stylus than user actuation targets having a lower precedence 905,906,907. Each of these user actuation targets shown in FIG. 9 is presented in a curved configuration about the location 901 of the finger or stylus.
[073] Turning now to FIG. 10, illustrated therein is a rectangular menu 1000 that shows illustrative user actuation target placement locations that can be presented about the location 1001 of a user's finger or stylus. By way of example, user actuation targets having higher precedence 1002,1003,1004 can be presented closer to the location 1001 of the user's finger or stylus than user actuation targets having a lower precedence 1005,1006,1007. Each of these user actuation targets shown in FIG. 10 is presented in an orthogonal configuration about the location 1001 of the finger or stylus. Note also that the illustrative embodiment of FIG. 10 shows the magnification discussed above. Specifically, user actuation targets having higher precedence 1002,1003,1004 are presented with a larger presentation than user actuation targets having a lower precedence 1005,1006,1007.
[074] The menus 900, 1000 of FIGS. 9 and 10, respectively, can also be used when the pressure detector (813) is employed. For example, user actuation targets having a higher precedence 902,903,904 and 1002,1003,1004, respectively, can be presented when the user pressure (814) is within a first range, while user actuation targets having a lower precedence 905,906,907 and 1005,1006,1007, respectively, can be presented when the user pressure (814) is within a second range.
[075] Turning now to FIG. 11, illustrated therein is an illustration of user actuation targets
1101,1102, 1103 being presented on a touch sensitive display 701 in accordance with a user actuation target precedence hierarchy in accordance with embodiments of the invention. In FIG.
11, a menu 1104 including user actuation targets 1101,1102,1103 is presented in a horizontal, tabular configuration. As determined by the controller (805), user actuation target 1101 has a greater precedence than user actuation target 1102. User actuation target 1102 has a higher precedence than user actuation target 1103. Therefore, in this illustrative embodiment, user actuation target 1101 is presented closer to the user's finger 1105 than user actuation target 1102. Similarly, user actuation target 1103 is presented farther from the user's finger 1105 than user actuation target 1102. User actuation target 1101 may represent a more frequently selected user actuation target, a more frequently selected user actuation target, or it may meet another criterion giving it elevated precedence.
[076] Turning now to FIG. 12, illustrated therein is another illustration of user actuation targets
1201,1202,1203,1204 being presented on a touch sensitive display 701 in accordance with a user actuation target precedence hierarchy in accordance with embodiments of the invention. In FIG.
12, the menu 1205, which including user actuation targets 1201,1202,1203,1204 is presented in a free-form configuration with the user actuation targets 1201,1202,1203,1204 being presented as round icons.
[077] As determined by the controller (805), user actuation target 1201 has a greater precedence than user actuation target 1203, but par precedence with user actuation target 1202. User actuation target 1202 has a higher priority than user actuation target 1204. However, user actuation target 1204 has par precedence with user actuation target 1203. Therefore, in this illustrative embodiment, user actuation target 1201 is presented closer to the user's finger 1206 than user actuation target 1203. Similarly, user actuation target 1204 is presented farther from the
user's finger 1206 than user actuation target 1202. At the same time, user actuation targets 1201,1202 are magnified, so as to appear larger than user actuation targets 1203,1204. Further, the user actuation targets 1201,1202,1203,1204 are presented in a curved configuration about the user's finger 1206.
[078] Turning now to FIG. 13, illustrated therein is a graphical representation of a user actuation target arrangement 1300 comprising a hierarchy of precedence 1301. Some of the factors that can be used to determine the hierarchy of precedence 1305 are also shown. As noted above, in various embodiments of the invention, the factors that can be considered include historical factors, environmental factors, or operational mode factors. In the illustrative embodiment depicted in FIG. 13, the factors include most frequently selected user actuation targets 1301, most recently selected user actuation targets 1302, environmental factors 1303, and operational state factors 1304.
[079] In the foregoing specification, specific embodiments of the present invention have been described. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the present invention as set forth in the claims below. Thus, while preferred embodiments of the invention have been illustrated and described, it is clear that the invention is not so limited. Numerous modifications, changes, variations, substitutions, and equivalents will occur to those skilled in the art without departing from the spirit and scope of the present invention as defined by the following claims. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of present invention. The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims.
Claims
1. A computer-readable medium in an electronic device, the electronic device comprising a processor and a display for presenting information to a user, the computer-readable medium including instructions for a method, when executed by the processor, to present one or more menus to the user on the display, the instructions comprising: storing at least some user actuation target selections made by the user as a user actuation history; receiving a user input request for a menu having a plurality of user actuation targets presented therein; determining a user actuation target arrangement from the user actuation history, wherein the user actuation target arrangement comprises a hierarchy of precedence; and presenting at least a portion of the plurality of user actuation targets on the display in the menu ordered in accordance with the user actuation target arrangement.
2. The computer- readable medium of claim 1, further comprising magnifying some user actuation targets such that at least one user actuation target having a higher precedence is larger in presentation on the display that at least another user actuation target having a lower precedence.
3. The computer- readable medium of claim 2, wherein the user actuation history comprises a user selection time corresponding to each of the at least some user actuation target selections, the instructions further comprising: determining a user actuation time corresponding to the user input request; determining the user actuation target arrangement from at least the user selection time corresponding to each of the at least some user actuation target selections; and presenting at least the portion of the user actuation targets on the display such that user actuation targets having user selection times closer to the user actuation time are larger than user actuation targets having user selection times farther from the user actuation time..
4. The computer-readable medium of claim 1, the instructions further comprising: determining a location of an object proximately located with the display corresponding to the user input request; and presenting the at least the portion of the user actuation targets on the display such that user actuation targets having a higher precedence are presented closer to the object that user actuation targets having a lower precedence.
5. The computer-readable medium of claim 4, further comprising magnifying some of the at least the portion of the user actuation targets such that at least one user actuation target having the higher precedence is larger in presentation on the display that at least another user actuation target having the lower precedence
6. The computer-readable medium of claim 4, the instructions further comprising: determining a user actuation time corresponding to the user input request; determining the user actuation target arrangement from at least the user actuation time corresponding to each of the at least some user actuation target selections; and presenting at least the portion of the user actuation targets on the display such that user actuation targets having user selection times closer to the user actuation time are presented nearer the object than user actuation targets having user selection times farther from the user actuation time.
7. The computer-readable medium of claim 1, the instructions further comprising: determining a location of an object proximately located with the display corresponding to the user input request; wherein the presenting at least the portion of the plurality of user actuation targets on the display comprises presenting the at least the portion of the user actuation targets in the menu, wherein the menu is curved about the object.
8. A computer-readable medium in an electronic device, the electronic device comprising a processor and a touch sensitive display for presenting information to a user, the computer-readable medium including instructions for a method, when executed by the processor, to present a menu to the user on the touch sensitive display, the instructions comprising: determining an amount of pressure being exerted upon the touch sensitive display by the user; and presenting the menu on the touch sensitive display in response to the amount of pressure being exerted on the touch sensitive display; wherein when the amount of pressure is within a first pressure range the presenting comprises presenting a first menu on the touch sensitive display; and wherein when the amount of pressure is within a second pressure range, the second pressure range comprising pressures greater than in the first pressure range, the presenting comprises presenting a second menu on the touch sensitive display.
9. The computer-readable medium of claim 8, wherein the second menu is a sub-menu of the first menu.
10. The computer-readable medium of claim 8, wherein the second menu is the first menu magnified.
11. The computer-readable medium of claim 8, wherein the second menu comprises the first menu.
12. The computer-readable medium of claim 11, wherein the second menu further comprises a sub-menu of the first menu.
13. The computer-readable medium of claim 8, wherein at least one of the first menu or the second menu is presented in a curved configuration.
14. The computer-readable medium of claim 8, wherein the first menu is presented in a first color and the second menu is presented in a second color, the second color being different from the first.
15. An electronic device, comprising: a touch sensitive display for presenting information to a user; a controller, operable with the touch sensitive display, and configured to receive user actuation input from the touch sensitive display; a memory operatively coupled to the controller; and a display driver, operable with the controller and configured to present a menu on the touch sensitive display; wherein the controller is configured to construct a user actuation history by storing at least some display user actuation target selections in the memory, and in response to the user actuating the touch sensitive display, to determine a user actuation target precedence hierarchy from the user actuation history; and wherein, in response to the user actuating the touch sensitive display, the display driver is configured to present a plurality of user actuation targets on the touch sensitive display in accordance with the user actuation target precedence hierarchy.
16. The electronic device of claim 15, wherein the display driver is configured to present some user actuation targets with magnification such that at least one user actuation target having a higher precedence is larger in presentation on the display that at least another user actuation target having a lower precedence.
17. The electronic device of claim 15, wherein the controller is further configured to determine a location along the touch sensitive display of an object proximately located with the electronic device, and wherein the display driver is further configured to present at least some user actuation targets having higher precedence closer to the location that at least some other user actuation targets having lower precedence.
18. The electronic device of claim 17, wherein the display driver is configured to present the at least some user actuation targets and the at least some other user actuation targets in a curved configuration about the location.
19. The electronic device of claim 15, further comprising a pressure sensor operatively coupled with the touch sensitive display and the controller, the pressure sensor being configured to determine a user pressure corresponding to the user actuation input, wherein when the user pressure is in a first range, the display driver is configured to present at least some user actuation targets, wherein when the user pressure is in a second range, the display driver is configured to present at least some other user actuation targets.
20. The electronic device of claim 15, wherein the user actuation target precedence hierarchy comprises one of most recently selected precedence and most frequently selected precedence.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/428,187 US20100271312A1 (en) | 2009-04-22 | 2009-04-22 | Menu Configuration System and Method for Display on an Electronic Device |
| US12/428,187 | 2009-04-22 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2010123723A2 true WO2010123723A2 (en) | 2010-10-28 |
| WO2010123723A3 WO2010123723A3 (en) | 2010-12-23 |
Family
ID=42288505
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2010/030964 Ceased WO2010123723A2 (en) | 2009-04-22 | 2010-04-14 | Menu configuration system and method for display on an electronic device |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US20100271312A1 (en) |
| WO (1) | WO2010123723A2 (en) |
Families Citing this family (100)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5325979B2 (en) * | 2009-04-24 | 2013-10-23 | 京セラ株式会社 | Input device |
| US8542186B2 (en) | 2009-05-22 | 2013-09-24 | Motorola Mobility Llc | Mobile device with user interaction capability and method of operating same |
| JP5197521B2 (en) * | 2009-07-29 | 2013-05-15 | 京セラ株式会社 | Input device |
| JP5593655B2 (en) | 2009-08-31 | 2014-09-24 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
| US20110162894A1 (en) * | 2010-01-06 | 2011-07-07 | Apple Inc. | Stylus for touch sensing devices |
| US8922530B2 (en) * | 2010-01-06 | 2014-12-30 | Apple Inc. | Communicating stylus |
| JP2011205562A (en) * | 2010-03-26 | 2011-10-13 | Sony Corp | Image display apparatus, and image display method |
| US8963845B2 (en) | 2010-05-05 | 2015-02-24 | Google Technology Holdings LLC | Mobile device with temperature sensing capability and method of operating same |
| US9103732B2 (en) | 2010-05-25 | 2015-08-11 | Google Technology Holdings LLC | User computer device with temperature sensing capabilities and method of operating same |
| US8751056B2 (en) | 2010-05-25 | 2014-06-10 | Motorola Mobility Llc | User computer device with temperature sensing capabilities and method of operating same |
| US9015610B2 (en) * | 2010-11-16 | 2015-04-21 | General Instrument Corporation | Display of controllable attributes for a controllable item based on context |
| US9639178B2 (en) | 2010-11-19 | 2017-05-02 | Apple Inc. | Optical stylus |
| US9417754B2 (en) | 2011-08-05 | 2016-08-16 | P4tents1, LLC | User interface system, method, and computer program product |
| US9519350B2 (en) * | 2011-09-19 | 2016-12-13 | Samsung Electronics Co., Ltd. | Interface controlling apparatus and method using force |
| US9501098B2 (en) * | 2011-09-19 | 2016-11-22 | Samsung Electronics Co., Ltd. | Interface controlling apparatus and method using force |
| JP2013101465A (en) * | 2011-11-08 | 2013-05-23 | Sony Corp | Information processing device, information processing method, and computer program |
| US9063591B2 (en) | 2011-11-30 | 2015-06-23 | Google Technology Holdings LLC | Active styluses for interacting with a mobile device |
| US8963885B2 (en) | 2011-11-30 | 2015-02-24 | Google Technology Holdings LLC | Mobile device for interacting with an active stylus |
| US8863042B2 (en) * | 2012-01-24 | 2014-10-14 | Charles J. Kulas | Handheld device with touch controls that reconfigure in response to the way a user operates the device |
| WO2013169865A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input |
| WO2013169849A2 (en) | 2012-05-09 | 2013-11-14 | Industries Llc Yknots | Device, method, and graphical user interface for displaying user interface objects corresponding to an application |
| WO2013169875A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for displaying content associated with a corresponding affordance |
| WO2013169845A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for scrolling nested regions |
| WO2013169851A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for facilitating user interaction with controls in a user interface |
| JP6031186B2 (en) | 2012-05-09 | 2016-11-24 | アップル インコーポレイテッド | Device, method and graphical user interface for selecting user interface objects |
| CN104508618B (en) | 2012-05-09 | 2018-01-05 | 苹果公司 | Apparatus, method and graphical user interface for providing tactile feedback for operations performed in the user interface |
| WO2013169846A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for displaying additional information in response to a user contact |
| WO2013169843A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for manipulating framed graphical objects |
| CN104487930A (en) | 2012-05-09 | 2015-04-01 | 苹果公司 | Apparatus, method and graphical user interface for moving and placing user interface objects |
| WO2013169842A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for selecting object within a group of objects |
| EP2847659B1 (en) | 2012-05-09 | 2019-09-04 | Apple Inc. | Device, method, and graphical user interface for transitioning between display states in response to a gesture |
| EP2847662B1 (en) | 2012-05-09 | 2020-02-19 | Apple Inc. | Device, method, and graphical user interface for providing feedback for changing activation states of a user interface object |
| KR20130142301A (en) * | 2012-06-19 | 2013-12-30 | 삼성전자주식회사 | Device and method for setting menu environment in terminal |
| US9690394B2 (en) | 2012-09-14 | 2017-06-27 | Apple Inc. | Input device having extendable nib |
| US9639179B2 (en) | 2012-09-14 | 2017-05-02 | Apple Inc. | Force-sensitive input device |
| CN102981768B (en) * | 2012-12-04 | 2016-12-21 | 中兴通讯股份有限公司 | A kind of method and system realizing floated overall situation button at touch screen terminal interface |
| AU2013368441B2 (en) | 2012-12-29 | 2016-04-14 | Apple Inc. | Device, method, and graphical user interface for forgoing generation of tactile output for a multi-contact gesture |
| AU2013368443B2 (en) | 2012-12-29 | 2016-03-24 | Apple Inc. | Device, method, and graphical user interface for transitioning between touch input to display output relationships |
| CN107831991B (en) | 2012-12-29 | 2020-11-27 | 苹果公司 | Device, method and graphical user interface for determining whether to scroll or select content |
| WO2014105274A1 (en) | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for navigating user interface hierarchies |
| HK1215094A1 (en) | 2012-12-29 | 2016-08-12 | Apple Inc. | Device, method, and graphical user interface for moving a cursor according to a change in an appearance of a control icon with simulated three-dimensional characteristics |
| WO2014105279A1 (en) | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for switching between user interfaces |
| AU2014290148A1 (en) * | 2013-07-16 | 2016-02-11 | Pinterest, Inc. | Object based contextual menu controls |
| US11068128B2 (en) | 2013-09-03 | 2021-07-20 | Apple Inc. | User interface object manipulations in a user interface |
| EP3042271B1 (en) | 2013-09-03 | 2020-03-18 | Apple Inc. | User interface object manipulations in a user interface |
| US12287962B2 (en) | 2013-09-03 | 2025-04-29 | Apple Inc. | User interface for manipulating user interface objects |
| US10503388B2 (en) | 2013-09-03 | 2019-12-10 | Apple Inc. | Crown input for a wearable electronic device |
| US9665206B1 (en) | 2013-09-18 | 2017-05-30 | Apple Inc. | Dynamic user interface adaptable to multiple input tools |
| US9978043B2 (en) | 2014-05-30 | 2018-05-22 | Apple Inc. | Automatic event scheduling |
| EP4036685A1 (en) * | 2014-06-27 | 2022-08-03 | Apple Inc. | Reduced size user interface |
| EP3195098B1 (en) | 2014-07-21 | 2024-10-23 | Apple Inc. | Remote user interface |
| JP6322765B2 (en) | 2014-08-02 | 2018-05-09 | アップル インコーポレイテッド | Context-specific user interface |
| US10656788B1 (en) * | 2014-08-29 | 2020-05-19 | Open Invention Network Llc | Dynamic document updating application interface and corresponding control functions |
| WO2016036510A1 (en) | 2014-09-02 | 2016-03-10 | Apple Inc. | Music user interface |
| EP4668726A3 (en) | 2014-09-02 | 2026-03-25 | Apple Inc. | Phone user interface |
| TW201610758A (en) | 2014-09-02 | 2016-03-16 | 蘋果公司 | Button functionality |
| TWI676127B (en) | 2014-09-02 | 2019-11-01 | 美商蘋果公司 | Method, system, electronic device and computer-readable storage medium regarding electronic mail user interface |
| WO2016036415A1 (en) | 2014-09-02 | 2016-03-10 | Apple Inc. | Electronic message user interface |
| US10073590B2 (en) | 2014-09-02 | 2018-09-11 | Apple Inc. | Reduced size user interface |
| US10055121B2 (en) | 2015-03-07 | 2018-08-21 | Apple Inc. | Activity based thresholds and feedbacks |
| US10048757B2 (en) | 2015-03-08 | 2018-08-14 | Apple Inc. | Devices and methods for controlling media presentation |
| US9645732B2 (en) | 2015-03-08 | 2017-05-09 | Apple Inc. | Devices, methods, and graphical user interfaces for displaying and using menus |
| US10095396B2 (en) | 2015-03-08 | 2018-10-09 | Apple Inc. | Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object |
| US9632664B2 (en) | 2015-03-08 | 2017-04-25 | Apple Inc. | Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback |
| US9990107B2 (en) | 2015-03-08 | 2018-06-05 | Apple Inc. | Devices, methods, and graphical user interfaces for displaying and using menus |
| US9639184B2 (en) | 2015-03-19 | 2017-05-02 | Apple Inc. | Touch input cursor manipulation |
| US9785305B2 (en) | 2015-03-19 | 2017-10-10 | Apple Inc. | Touch input cursor manipulation |
| US10152208B2 (en) | 2015-04-01 | 2018-12-11 | Apple Inc. | Devices and methods for processing touch inputs based on their intensities |
| US20170045981A1 (en) | 2015-08-10 | 2017-02-16 | Apple Inc. | Devices and Methods for Processing Touch Inputs Based on Their Intensities |
| US10200598B2 (en) | 2015-06-07 | 2019-02-05 | Apple Inc. | Devices and methods for capturing and interacting with enhanced digital images |
| US9891811B2 (en) | 2015-06-07 | 2018-02-13 | Apple Inc. | Devices and methods for navigating between user interfaces |
| US9674426B2 (en) | 2015-06-07 | 2017-06-06 | Apple Inc. | Devices and methods for capturing and interacting with enhanced digital images |
| US10346030B2 (en) | 2015-06-07 | 2019-07-09 | Apple Inc. | Devices and methods for navigating between user interfaces |
| US9830048B2 (en) | 2015-06-07 | 2017-11-28 | Apple Inc. | Devices and methods for processing touch inputs with instructions in a web page |
| US9860451B2 (en) | 2015-06-07 | 2018-01-02 | Apple Inc. | Devices and methods for capturing and interacting with enhanced digital images |
| US10235035B2 (en) | 2015-08-10 | 2019-03-19 | Apple Inc. | Devices, methods, and graphical user interfaces for content navigation and manipulation |
| US9880735B2 (en) | 2015-08-10 | 2018-01-30 | Apple Inc. | Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback |
| US10416800B2 (en) | 2015-08-10 | 2019-09-17 | Apple Inc. | Devices, methods, and graphical user interfaces for adjusting user interface objects |
| US10248308B2 (en) | 2015-08-10 | 2019-04-02 | Apple Inc. | Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures |
| US20170068374A1 (en) * | 2015-09-09 | 2017-03-09 | Microsoft Technology Licensing, Llc | Changing an interaction layer on a graphical user interface |
| US20170357411A1 (en) | 2016-06-11 | 2017-12-14 | Apple Inc. | User interface for initiating a telephone call |
| DK201770423A1 (en) | 2016-06-11 | 2018-01-15 | Apple Inc | Activity and workout updates |
| US11216119B2 (en) | 2016-06-12 | 2022-01-04 | Apple Inc. | Displaying a predetermined view of an application |
| KR102584981B1 (en) * | 2016-09-13 | 2023-10-05 | 삼성전자주식회사 | Method for Outputting Screen according to Force Input and the Electronic Device supporting the same |
| CN110139730B (en) | 2016-10-03 | 2022-09-16 | 卡耐基梅隆大学 | Touch sensing system |
| CN108170328A (en) * | 2016-12-07 | 2018-06-15 | 英业达科技有限公司 | The operation interface and operating method of mobile terminal |
| EP3333688B1 (en) * | 2016-12-08 | 2020-09-02 | LG Electronics Inc. | Mobile terminal and method for controlling the same |
| US20180188906A1 (en) * | 2017-01-04 | 2018-07-05 | Google Inc. | Dynamically generating a subset of actions |
| USD916712S1 (en) | 2017-04-21 | 2021-04-20 | Scott Bickford | Display screen with an animated graphical user interface having a transitional flower design icon |
| US11765114B2 (en) | 2017-05-16 | 2023-09-19 | Apple Inc. | Voice communication method |
| US11435830B2 (en) | 2018-09-11 | 2022-09-06 | Apple Inc. | Content-based tactile outputs |
| CN111523523B (en) * | 2020-06-29 | 2020-09-25 | 深圳市汇顶科技股份有限公司 | Method and device for detecting distance between display screen and fingerprint sensor and display screen |
| US11360635B2 (en) * | 2020-10-20 | 2022-06-14 | Rovi Guides, Inc. | Customizing user interface controls around a cursor |
| US11893212B2 (en) | 2021-06-06 | 2024-02-06 | Apple Inc. | User interfaces for managing application widgets |
| US12425511B2 (en) | 2021-08-31 | 2025-09-23 | Apple Inc. | Methods and systems of interfaces for initiating communications using terrestrial and non-terrestrial networks |
| US12204734B2 (en) | 2021-08-31 | 2025-01-21 | Apple Inc. | Methods and interfaces for initiating communications |
| US12543028B2 (en) | 2021-09-13 | 2026-02-03 | Apple Inc. | Low-bandwidth and emergency communication user interfaces |
| US12417596B2 (en) | 2022-09-23 | 2025-09-16 | Apple Inc. | User interfaces for managing live communication sessions |
| US20250238129A1 (en) | 2024-01-18 | 2025-07-24 | Apple Inc. | User interfaces integrating hardware buttons |
| CN119045693B (en) * | 2024-07-31 | 2025-11-14 | 中国建设银行股份有限公司 | Menu display methods, devices, equipment, media and products |
Family Cites Families (109)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US2075683A (en) * | 1933-04-05 | 1937-03-30 | Hazeltine Corp | Image frequency rejection system |
| US4286289A (en) * | 1979-10-31 | 1981-08-25 | The United States Of America As Represented By The Secretary Of The Army | Touch screen target designator |
| US4806709A (en) * | 1987-05-26 | 1989-02-21 | Microtouch Systems, Inc. | Method of and apparatus for sensing the location, such as coordinates, of designated points on an electrically sensitive touch-screen surface |
| US4914624A (en) * | 1988-05-06 | 1990-04-03 | Dunthorn David I | Virtual button for touch screen |
| JPH01314324A (en) * | 1988-06-14 | 1989-12-19 | Sony Corp | Touch panel device |
| US4967083A (en) * | 1989-04-14 | 1990-10-30 | The Stanley Works | Door sensor system |
| US5504316A (en) * | 1990-05-08 | 1996-04-02 | Symbol Technologies, Inc. | Laser scanning system and scanning method for reading 1-D and 2-D barcode symbols |
| US5880411A (en) * | 1992-06-08 | 1999-03-09 | Synaptics, Incorporated | Object position detector with edge motion feature and gesture recognition |
| JP3025121B2 (en) * | 1992-12-24 | 2000-03-27 | キヤノン株式会社 | Information processing method and apparatus |
| ATE188302T1 (en) * | 1993-04-01 | 2000-01-15 | Ibm | DYNAMIC ADJUSTMENT FOR TOUCH DISPLAY BUTTONS |
| US5500935A (en) * | 1993-12-30 | 1996-03-19 | Xerox Corporation | Apparatus and method for translating graphic objects and commands with direct touch input in a touch based input system |
| JP3486459B2 (en) * | 1994-06-21 | 2004-01-13 | キヤノン株式会社 | Electronic information equipment and control method thereof |
| US7738678B2 (en) * | 1995-06-07 | 2010-06-15 | Automotive Technologies International, Inc. | Light modulation techniques for imaging objects in or around a vehicle |
| US6219032B1 (en) * | 1995-12-01 | 2001-04-17 | Immersion Corporation | Method for providing force feedback to a user of an interface device based on interactions of a controlled cursor with graphical elements in a graphical user interface |
| US5945988A (en) * | 1996-06-06 | 1999-08-31 | Intel Corporation | Method and apparatus for automatically determining and dynamically updating user preferences in an entertainment system |
| US6583797B1 (en) * | 1997-01-21 | 2003-06-24 | International Business Machines Corporation | Menu management mechanism that displays menu items based on multiple heuristic factors |
| US6246407B1 (en) * | 1997-06-16 | 2001-06-12 | Ati Technologies, Inc. | Method and apparatus for overlaying a window with a multi-state window |
| JP3542965B2 (en) * | 1997-10-16 | 2004-07-14 | カリフォルニア インスティチュート オブ テクノロジー | Dual-band quantum well infrared sensing array |
| EP0926512B1 (en) * | 1997-12-17 | 2006-03-08 | Inter Company Computer, Engineering, Design Services, in het kort : " Concept Design", naamloze vennootschap | Proximity detecting device |
| JPH11252017A (en) * | 1997-12-24 | 1999-09-17 | Fujitsu Ltd | Wireless portable terminal with infrared communication function and infrared light emission power control method between wireless portable terminal and device with infrared communication function |
| US7840912B2 (en) * | 2006-01-30 | 2010-11-23 | Apple Inc. | Multi-touch gesture dictionary |
| KR100554193B1 (en) * | 1998-05-20 | 2006-02-22 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Signals receiver |
| US6292674B1 (en) * | 1998-08-05 | 2001-09-18 | Ericsson, Inc. | One-handed control for wireless telephone |
| US6246862B1 (en) * | 1999-02-03 | 2001-06-12 | Motorola, Inc. | Sensor controlled user interface for portable communication device |
| US6549219B2 (en) * | 1999-04-09 | 2003-04-15 | International Business Machines Corporation | Pie menu graphical user interface |
| US7164413B2 (en) * | 1999-05-19 | 2007-01-16 | Digimarc Corporation | Enhanced input peripheral |
| US6438752B1 (en) * | 1999-06-22 | 2002-08-20 | Mediaone Group, Inc. | Method and system for selecting television programs based on the past selection history of an identified user |
| US6721954B1 (en) * | 1999-06-23 | 2004-04-13 | Gateway, Inc. | Personal preferred viewing using electronic program guide |
| US6512385B1 (en) * | 1999-07-26 | 2003-01-28 | Paul Pfaff | Method for testing a device under test including the interference of two beams |
| GB2357400A (en) * | 1999-12-17 | 2001-06-20 | Nokia Mobile Phones Ltd | Controlling a terminal of a communication system |
| SI20774A (en) * | 2000-11-20 | 2002-06-30 | Janez Stare | 3D sensitive board |
| US7284256B2 (en) * | 2000-12-04 | 2007-10-16 | Sony Corporation | Method and system to maintain relative statistics for creating automatically a list of favorites |
| US7721310B2 (en) * | 2000-12-05 | 2010-05-18 | Koninklijke Philips Electronics N.V. | Method and apparatus for selective updating of a user profile |
| US6941161B1 (en) * | 2001-09-13 | 2005-09-06 | Plantronics, Inc | Microphone position and speech level sensor |
| US7032188B2 (en) * | 2001-09-28 | 2006-04-18 | Nokia Corporation | Multilevel sorting and displaying of contextual objects |
| US7046230B2 (en) * | 2001-10-22 | 2006-05-16 | Apple Computer, Inc. | Touch pad handheld device |
| US20030080947A1 (en) * | 2001-10-31 | 2003-05-01 | Genest Leonard J. | Personal digital assistant command bar |
| US6703599B1 (en) * | 2002-01-30 | 2004-03-09 | Microsoft Corporation | Proximity sensor with adaptive threshold |
| US7340077B2 (en) * | 2002-02-15 | 2008-03-04 | Canesta, Inc. | Gesture recognition system using depth perceptive sensors |
| US7787908B2 (en) * | 2002-03-19 | 2010-08-31 | Qualcomm Incorporated | Multi-call display management for wireless communication devices |
| ES2272965T3 (en) * | 2002-04-15 | 2007-05-01 | Epos Technologies Limited | METHOD AND SYSTEM FOR OBTAINING POSITION DATA. |
| US7519918B2 (en) * | 2002-05-30 | 2009-04-14 | Intel Corporation | Mobile virtual desktop |
| US11275405B2 (en) * | 2005-03-04 | 2022-03-15 | Apple Inc. | Multi-functional hand-held device |
| JP4616647B2 (en) * | 2002-09-10 | 2011-01-19 | キルタス テクノロジーズ、インコーポレイテッド | Automatic page turning device that supports browsing of document pages |
| US7103852B2 (en) * | 2003-03-10 | 2006-09-05 | International Business Machines Corporation | Dynamic resizing of clickable areas of touch screen applications |
| US20050028453A1 (en) * | 2003-08-06 | 2005-02-10 | Barry Smith | Stone laminated structure and method for its construction |
| US7532196B2 (en) * | 2003-10-30 | 2009-05-12 | Microsoft Corporation | Distributed sensing techniques for mobile devices |
| JP3991030B2 (en) * | 2003-12-24 | 2007-10-17 | キヤノン株式会社 | Image forming apparatus, operation history storage method, and computer program |
| WO2005076117A1 (en) * | 2004-02-10 | 2005-08-18 | Takuya Ogihara | Touch screen-type input device |
| US20060007248A1 (en) * | 2004-06-29 | 2006-01-12 | Damoder Reddy | Feedback control system and method for operating a high-performance stabilized active-matrix emissive display |
| EP1596271A1 (en) * | 2004-05-11 | 2005-11-16 | Hitachi Europe S.r.l. | Method for displaying information and information display system |
| US7519223B2 (en) * | 2004-06-28 | 2009-04-14 | Microsoft Corporation | Recognizing gestures and using gestures for interacting with software applications |
| US7653883B2 (en) * | 2004-07-30 | 2010-01-26 | Apple Inc. | Proximity detector in handheld device |
| US8381135B2 (en) * | 2004-07-30 | 2013-02-19 | Apple Inc. | Proximity detector in handheld device |
| WO2006013518A2 (en) * | 2004-08-02 | 2006-02-09 | Koninklijke Philips Electronics N.V. | Touch screen with pressure-dependent visual feedback |
| JP2006047534A (en) * | 2004-08-03 | 2006-02-16 | Alpine Electronics Inc | Display control system |
| US7715723B2 (en) * | 2004-08-05 | 2010-05-11 | Japan Science And Technology Agency | Information-processing system using free-space optical communication and free-space optical communication system |
| US7728821B2 (en) * | 2004-08-06 | 2010-06-01 | Touchtable, Inc. | Touch detecting interactive display |
| US7724242B2 (en) * | 2004-08-06 | 2010-05-25 | Touchtable, Inc. | Touch driven method and apparatus to integrate and display multiple image layers forming alternate depictions of same subject matter |
| US7561146B1 (en) * | 2004-08-25 | 2009-07-14 | Apple Inc. | Method and apparatus to reject accidental contact on a touchpad |
| JP2006065511A (en) * | 2004-08-25 | 2006-03-09 | Fujitsu Ltd | Browsing history presentation system |
| GB2419433A (en) * | 2004-10-20 | 2006-04-26 | Glasgow School Of Art | Automated Gesture Recognition |
| US7629966B2 (en) * | 2004-12-21 | 2009-12-08 | Microsoft Corporation | Hard tap |
| US8104113B2 (en) * | 2005-03-14 | 2012-01-31 | Masco Corporation Of Indiana | Position-sensing detector arrangement for controlling a faucet |
| US20070000830A1 (en) * | 2005-06-30 | 2007-01-04 | Snider Jason P | Replaceable filter element |
| KR20070006477A (en) * | 2005-07-08 | 2007-01-11 | 삼성전자주식회사 | Variable menu arrangement method and display device using same |
| CA2614793C (en) * | 2005-07-13 | 2014-09-09 | Sca Hygiene Products Ab | Automated dispenser with sensor arrangement |
| US20070035524A1 (en) * | 2005-08-09 | 2007-02-15 | Sony Ericsson Mobile Communications Ab | Methods, electronic devices and computer program products for controlling a touch screen |
| KR100814395B1 (en) * | 2005-08-30 | 2008-03-18 | 삼성전자주식회사 | User Interface Control Device and Method Using Jog Key and Four Direction Key |
| KR20140129173A (en) * | 2005-09-08 | 2014-11-06 | 파워2비, 인크. | Displays and information input devices |
| US7694231B2 (en) * | 2006-01-05 | 2010-04-06 | Apple Inc. | Keyboards for portable electronic devices |
| US7534988B2 (en) * | 2005-11-08 | 2009-05-19 | Microsoft Corporation | Method and system for optical tracking of a pointing object |
| JP4742826B2 (en) * | 2005-11-15 | 2011-08-10 | 日産自動車株式会社 | Infrared detector manufacturing method |
| US8564532B2 (en) * | 2005-12-06 | 2013-10-22 | Naturalpoint, Inc. | System and methods for using a movable object to control a computer |
| US20070137462A1 (en) * | 2005-12-16 | 2007-06-21 | Motorola, Inc. | Wireless communications device with audio-visual effect generator |
| US7509588B2 (en) * | 2005-12-30 | 2009-03-24 | Apple Inc. | Portable electronic device with interface reconfiguration mode |
| US7644372B2 (en) * | 2006-01-27 | 2010-01-05 | Microsoft Corporation | Area frequency radial menus |
| US8578282B2 (en) * | 2006-03-15 | 2013-11-05 | Navisense | Visual toolkit for a virtual user interface |
| TWI322374B (en) * | 2006-04-14 | 2010-03-21 | Ritdisplay Corp | Light transmission touch panel and manufacturing method thereof |
| JP4819560B2 (en) * | 2006-04-20 | 2011-11-24 | 株式会社東芝 | Display control apparatus, image processing apparatus, interface screen, display control method |
| US8086971B2 (en) * | 2006-06-28 | 2011-12-27 | Nokia Corporation | Apparatus, methods and computer program products providing finger-based and hand-based gesture commands for portable electronic device applications |
| JP5006067B2 (en) * | 2006-06-29 | 2012-08-22 | オリンパス株式会社 | Image processing apparatus, image processing program, and image processing method |
| US20080024454A1 (en) * | 2006-07-31 | 2008-01-31 | Paul Everest | Three-dimensional touch pad input device |
| JP4267648B2 (en) * | 2006-08-25 | 2009-05-27 | 株式会社東芝 | Interface device and method thereof |
| US8564544B2 (en) * | 2006-09-06 | 2013-10-22 | Apple Inc. | Touch screen device, method, and graphical user interface for customizing display of content category icons |
| US8006002B2 (en) * | 2006-12-12 | 2011-08-23 | Apple Inc. | Methods and systems for automatic configuration of peripherals |
| US20080161870A1 (en) * | 2007-01-03 | 2008-07-03 | Gunderson Bruce D | Method and apparatus for identifying cardiac and non-cardiac oversensing using intracardiac electrograms |
| US7924271B2 (en) * | 2007-01-05 | 2011-04-12 | Apple Inc. | Detecting gestures on multi-event sensitive devices |
| US7971156B2 (en) * | 2007-01-12 | 2011-06-28 | International Business Machines Corporation | Controlling resource access based on user gesturing in a 3D captured image stream of the user |
| US8391786B2 (en) * | 2007-01-25 | 2013-03-05 | Stephen Hodges | Motion triggered data transfer |
| US8144148B2 (en) * | 2007-02-08 | 2012-03-27 | Edge 3 Technologies Llc | Method and system for vision-based interaction in a virtual environment |
| US20080211771A1 (en) * | 2007-03-02 | 2008-09-04 | Naturalpoint, Inc. | Approach for Merging Scaled Input of Movable Objects to Control Presentation of Aspects of a Shared Virtual Environment |
| US8693877B2 (en) * | 2007-03-09 | 2014-04-08 | Apple Inc. | Integrated infrared receiver and emitter for multiple functionalities |
| JP4560062B2 (en) * | 2007-03-29 | 2010-10-13 | 株式会社東芝 | Handwriting determination apparatus, method, and program |
| JP2008305174A (en) * | 2007-06-07 | 2008-12-18 | Sony Corp | Information processing apparatus, information processing method, and program |
| US9843351B2 (en) * | 2007-07-26 | 2017-12-12 | Nokia Technologies Oy | Gesture activated close-proximity communication |
| KR101456047B1 (en) * | 2007-08-31 | 2014-11-03 | 삼성전자주식회사 | Portable terminal and method for performing order thereof |
| JP5010451B2 (en) * | 2007-09-11 | 2012-08-29 | アルプス電気株式会社 | Input device |
| US7486386B1 (en) * | 2007-09-21 | 2009-02-03 | Silison Laboratories Inc. | Optical reflectance proximity sensor |
| US7912376B2 (en) * | 2007-09-28 | 2011-03-22 | Rockwell Automation Technologies, Inc. | Non-interfering transmitted-beam pairs |
| WO2009072126A2 (en) * | 2007-12-06 | 2009-06-11 | Senplay Technologies Ltd. | Acoustic motion capture |
| US8881049B2 (en) * | 2007-12-14 | 2014-11-04 | Apple Inc. | Scrolling displayed objects using a 3D remote controller in a media system |
| KR101441309B1 (en) * | 2008-01-28 | 2014-09-17 | 삼성디스플레이 주식회사 | Display system |
| US7991896B2 (en) * | 2008-04-21 | 2011-08-02 | Microsoft Corporation | Gesturing to select and configure device communication |
| US8030914B2 (en) * | 2008-12-29 | 2011-10-04 | Motorola Mobility, Inc. | Portable electronic device having self-calibrating proximity sensors |
| US8275412B2 (en) * | 2008-12-31 | 2012-09-25 | Motorola Mobility Llc | Portable electronic device having directional proximity sensors based on device orientation |
| US7995041B2 (en) * | 2009-02-02 | 2011-08-09 | Apple Inc. | Integrated touch screen |
| US20110057885A1 (en) * | 2009-09-08 | 2011-03-10 | Nokia Corporation | Method and apparatus for selecting a menu item |
| US8665227B2 (en) * | 2009-11-19 | 2014-03-04 | Motorola Mobility Llc | Method and apparatus for replicating physical key function with soft keys in an electronic device |
-
2009
- 2009-04-22 US US12/428,187 patent/US20100271312A1/en not_active Abandoned
-
2010
- 2010-04-14 WO PCT/US2010/030964 patent/WO2010123723A2/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| US20100271312A1 (en) | 2010-10-28 |
| WO2010123723A3 (en) | 2010-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20100271312A1 (en) | Menu Configuration System and Method for Display on an Electronic Device | |
| TWI381305B (en) | Method for displaying and operating user interface and electronic device | |
| KR101600642B1 (en) | Accessing a menu utilizing a drag-operation | |
| EP1377902B1 (en) | Multi-functional application launcher with integrated status | |
| EP2178283B1 (en) | Method for configuring an idle screen in a portable terminal | |
| US10078420B2 (en) | Electronic devices, associated apparatus and methods | |
| AU2014201585B9 (en) | Electronic device and method for controlling screen display using temperature and humidity | |
| JP3143462U (en) | Electronic device having switchable user interface and electronic device having convenient touch operation function | |
| EP2502136B1 (en) | Method and apparatus for replicating physical key function with soft keys in an electronic device | |
| KR100900295B1 (en) | User interface method of mobile device and mobile communication system | |
| EP2051161B1 (en) | Mobile terminal and method of displaying menu thereof | |
| US8775966B2 (en) | Electronic device and method with dual mode rear TouchPad | |
| US9569090B2 (en) | Method and apparatus for providing graphic user interface in mobile terminal | |
| US20100088654A1 (en) | Electronic device having a state aware touchscreen | |
| US20090179914A1 (en) | System and method for navigating a 3d graphical user interface | |
| KR102044826B1 (en) | Method for providing function of mouse and terminal implementing the same | |
| US20140013271A1 (en) | Prioritization of multitasking applications in a mobile device interface | |
| JP2004038927A (en) | Display and touch screen | |
| KR20150119135A (en) | Systems and methods for managing displayed content on electronic devices | |
| EP2682850A1 (en) | Prioritization of multitasking applications in a mobile device interface | |
| AU2012214993B2 (en) | Method and apparatus for providing graphic user interface in mobile terminal | |
| WO2015017174A1 (en) | Method and apparatus for generating customized menus for accessing application functionality | |
| WO2015035571A1 (en) | Apparatus for enabling displaced effective input and associated methods | |
| KR20080082761A (en) | Electronic device and item display method using same | |
| EP1810122A1 (en) | Assignment of functions to a softkey |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10717341 Country of ref document: EP Kind code of ref document: A2 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 10717341 Country of ref document: EP Kind code of ref document: A2 |