WO2016028575A1 - Gesture-based access to a mix view - Google Patents
Gesture-based access to a mix view Download PDFInfo
- Publication number
- WO2016028575A1 WO2016028575A1 PCT/US2015/044943 US2015044943W WO2016028575A1 WO 2016028575 A1 WO2016028575 A1 WO 2016028575A1 US 2015044943 W US2015044943 W US 2015044943W WO 2016028575 A1 WO2016028575 A1 WO 2016028575A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- application
- user
- representation
- computing device
- functionality
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
Definitions
- Computing devices may employ a variety of applications to access an ever increasing variety of functionality.
- a computing device may include tens and even hundreds of applications, techniques have been developed to manage user interaction with the applications, such as to select applications for execution by the computing device.
- Some conventional techniques that were utilized to manage this interaction utilized objects, such as icons, to represent the application. Therefore, a user wanting to interact with the application in some manner would select the icon to launch the application, such as from a root level of a file management system of the computing device. The selection then resulted in a modal transfer away from a user interface that included the icons (e.g., the root level) to a user interface of the application itself such that a user may view content related to the application. If the user wished to interact with application features that were several levels down in the application's hierarchy, the user would have to physically navigate through the various application layers to reach the desired functionality.
- objects such as icons
- a user interface is exposed by an operating system of a computing device.
- the user interface includes a concurrent display of a plurality of representations of applications that are selectable by a user to launch respective applications.
- Gesture -based techniques can be used to interact with an application representation to cause one or more visible targets to appear adjacent the representation.
- the individual targets are individually associated with some type of application functionality, e.g., a quick action or a deep link into content associated with the application.
- An individual target can then be selected, e.g., touch-selected, by a user to initiate the associated functionality.
- a computing device includes one or more modules implemented at least partially in hardware.
- the one or more modules are configured to output a user interface for display.
- the user interface includes a concurrent display of a plurality of representations of applications that are selectable by a user to launch respective applications.
- Gesture -based techniques can be used to interact with an application representation to cause one or more visible targets to appear adjacent the representation.
- the individual targets are individually associated with some type of application functionality, e.g., a quick action or a deep link into content associated with the application. An individual target can then be selected, e.g., touch-selected, by a user to initiate the associated functionality.
- a computing device includes a processing system and memory having instructions that are executable by the processing system to include an application having a plurality of entry points that are different, one from another, to access different parts of the application and an operating system that is configured to output a representation of the application that is selectable to launch the application.
- Gesture -based techniques can be used to interact with an application representation to cause one or more visible targets to appear adjacent the representation. Each target is associated with an individual entry point. An individual target can then be selected, e.g., touch-selected, by a user to obtain direct access to an associated entry point.
- FIG. 1 depicts an environment in an example implementation that is configured to perform the embodiments described herein.
- FIG. 2 depicts an example implementation showing a representation of an application of FIG. 1 as having a plurality of user-selectable targets.
- FIG. 3 depicts an example gestural input to access a mix view in accordance with one embodiment.
- FIG. 4 depicts an example application representation having a plurality of user- selectable targets associated with the application representation.
- FIG. 5 depicts an example implementation showing examples of configurations of the representation of FIG. 4 that includes a plurality of user-selectable targets.
- FIG. 6 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 7 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 8 illustrates various components of an example device that can be implemented as any type of computing device as described with reference to FIGS. 1-7 to implement embodiments of the techniques described herein.
- a user interface is exposed by an operating system of a computing device.
- the user interface includes a concurrent display of a plurality of representations of applications that are selectable by a user to launch respective applications.
- Gesture -based techniques can be used to interact with an application representation to cause one or more visible targets to appear adjacent the representation.
- the individual targets are individually associated with some type of application functionality, e.g., a quick action or a deep link into content associated with the application.
- An individual target can then be selected, e.g., touch-selected, by a user to initiate the associated functionality.
- the application representation can include any suitable object including, by way of example and not limitation, an icon, a tile, and so on.
- the representation may be configured as a tile that includes a plurality of targets (e.g., sub-tiles) that are user-selectable.
- the user-selectable targets are configured such that selection by a user causes access to corresponding functionality of the application and in this way may provide a "deep link" to various functionality of the application.
- the tile may include a user-selectable target to navigate to a root level (e.g., welcome screen) of the application, e.g., a start screen of a weather application.
- Other user-selectable targets may be utilized to access other application functionality, such as weather at different geographic locations. In this way, a user may directly access different parts of an application directly from the representation of the application that launches the application.
- a variety of other examples are also contemplated, further discussion of which may be found in relation to the following sections.
- Example procedures are then described which may be performed in the example environment as well as other environments. Consequently, performance of the example procedures is not limited to the example environment and the example environment is not limited to performance of the example procedures.
- FIG. 1 is an illustration of an environment 100 in an example implementation that is operable to employ the techniques described herein.
- the illustrated environment 100 includes an example of a computing device 102, which is illustrated as a mobile computing device (e.g., a tablet or mobile phone) having a housing 104 that is configured to be held by one or more hands 106 of a user.
- a mobile computing device e.g., a tablet or mobile phone
- housing 104 e.g., a mobile computing device having a housing 104 that is configured to be held by one or more hands 106 of a user.
- a variety of other configurations of the computing device 102 are also contemplated.
- the computing device 102 may be configured as a traditional computer (e.g., a desktop personal computer, laptop computer, and so on), a mobile station, an entertainment appliance, a wireless phone, a tablet, a netbook, and so forth as further described in relation to FIG. 8.
- the computing device 102 may range from full resource devices with substantial memory and processor resources (e.g., personal computers, game consoles) to a low-resource device with limited memory and/or processing resources (e.g., traditional set-top boxes, hand-held game consoles).
- the computing device 102 may also relate to software that causes the computing device 102 to perform one or more operations.
- the computing device 102 is also illustrated as including a display device 108, a processing system 110, and an example of computer-readable storage media, which in this instance is memory 112.
- the memory 112 is configured to maintain applications 114 that are executable by the processing system 110 to perform one or more operations.
- the processing system 110 is not limited by the materials from which it is formed or the processing mechanisms employed therein.
- the processing system 110 may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)), such as a system on a chip, processors, central processing units, processing cores, functional blocks, and so on.
- executable instructions may be electronically-executable instructions.
- the mechanisms of or for processing system 110, and thus of or for a computing device may include, but are not limited to, quantum computing, optical computing, mechanical computing (e.g., using nanotechnology), and so forth.
- a single memory 112 is shown, a wide variety of types and combinations of memory may be employed, such as random access memory (RAM), hard disk memory, removable medium memory, and other types of computer-readable media.
- the computing device 102 is further illustrated as including an operating system 116.
- the operating system 116 is configured to abstract underlying functionality of the computing device 102 to applications 114 that are executable on the computing device 102.
- the operating system 116 may abstract the processing system 110, memory 112, network, input/output, and/or display functionality of the display device 108, and so on such that the applications 114 may be written without knowing "how" this underlying functionality is implemented.
- the application 114 may provide data to the operating system 116 to be rendered and displayed by the display device 104 without understanding how this rendering will be performed.
- the operating system 116 may also represent a variety of other functionality, such as to manage a file system and user interface that is navigable by a user of the computing device 102, such as to manage access to applications 114 in a graphical user interface as further described below.
- the operating system 116 may also represent a variety of other functionality, such as to manage a file system and a user interface that is navigable by a user of the computing device 102.
- An example of this is illustrated as a representation module 118 that is representative of functionality to generate and manage representations of applications 114.
- the representation module 118 may generate a variety of representations for the plurality of the applications 114.
- the representations may be configured in a variety of ways, such as icon, tiles, textual descriptions, and so on.
- the representations may also be utilized in a variety of ways, such as at a root level of a hierarchical file structure, e.g., each of the other levels are "beneath" the root level in the hierarchy.
- An example of this is illustrated as an application launcher (e.g., start screen) that is displayed in a user interface on the display device 108 in FIG. 1.
- the representations shown in the illustrated example are selectable to launch a corresponding one of applications 114 for execution by the processing system 110 of the computing device 102.
- inventive techniques described in this document can, however, be implemented in connection with application launchers other than a start screen, e.g., a home screen, a launch screen, and the like.
- the representation module 118 is representative of functionality to manage representations of applications 114 (e.g., tiles, icons, and so on) and content consumable by the applications 114.
- the representations may include notifications that may be displayed as part of the representations without launching the represented applications 114, e.g., as text or graphics within the display of the representation.
- This functionality is illustrated as a notification module 120 that is configured to manage notifications 122 for inclusion as part of the representations.
- a representation 124 of a weather application is illustrated as including a notification that indicates a name and current weather conditions, e.g., "72°" and an illustration of a cloud.
- the notifications 122 may be managed without executing the corresponding applications 114.
- the notification module 120 may receive the notifications 122 from a variety of different sources, such as from software (e.g., other applications executed by the computing device 102), from a web service 126 via a network 128, and so on.
- This may be performed responsive to registration of the applications 114 with the notification module 120 to specify from where and how notifications are to be received.
- the notification module 120 may then manage how the notifications 122 are displayed as part of the representations without executing the applications 114. This may be used to improve battery life and performance of the computing device 102 by not executing each of the applications 114 to output respective notifications 122.
- functionality of the notification module 120 may be implemented in a variety of ways.
- functionality of a notification module 120 may be incorporated by the web service 126 in whole or in part.
- the notification module 130 of the web service 126 may process notifications received from other web services and manage the notifications for distribution to the computing device 102 over the network 128, e.g., through registration of the applications 114 with the notification module 120, 130 such that the notifications 122 may be output as part of the representations without execution the represented applications 114.
- Representations that are generated by the representation module 118 of the operating system 116 on behalf of the applications 114 may be configured in a variety of ways. As illustrated, for instance, the representations 124, 132, 134 may be configured according to a variety of different sizes. The representation 124 may be configured for output of notifications 122 as previously described, a representation 132 may be configured to access specific content (e.g., a particular spreadsheet in this example), and so on.
- specific content e.g., a particular spreadsheet in this example
- the representations can be configured to enable gesture-based access to a mixed view associated with an application representation.
- the mixed view includes a plurality of user-selectable targets that can be selected by the user to access functionality associated with the application, as will be described below in more detail.
- a user interface is exposed by an operating system of a computing device.
- the user interface includes a concurrent display of a plurality of representations of applications that are selectable by a user to launch respective applications, such as the user interface shown in FIG. 1.
- Gesture-based techniques can be used to interact with an application representation to cause one or more visible targets to appear adjacent the representation.
- the individual targets are individually associated with some type of application functionality, e.g., a quick action or a deep link into content associated with the application.
- An individual target can then be selected, e.g., touch-selected, by a user to initiate the associated functionality.
- FIG. 2 depicts an example implementation 200 showing a representation of an application 114 of FIG. 1 as having a plurality of user-selectable targets.
- a representation 202 is illustrated that corresponds to a single application 114, i.e., that represents that application 114 in a file management structure of the computing device 102 of FIG. 1.
- the application representation is also user-selectable so, in that sense, the application representation also constitutes a user-selectable target.
- the representation includes a plurality of user-selectable targets 204, 206, 208, 210, 212, each of which corresponds to a different application functionality 214. In this way, a user may select a desired one of the user-selectable targets 204-212 to gain direct access to a respective functionality.
- the application functionality 214 may be configured in a variety of ways.
- the application functionality 214 may correspond to a plurality of entry points 216 of the application 114.
- the application 114 may include a root level entry point such as a welcome screen as well as different pages, tabs, chapters, and other sections that may also be utilized as entry points 216.
- the user-selectable targets 204-212 may provide direct access to different parts of the application through use of the entry points 216 in a modal manner that causes output of a relevant user interface. .
- the application functionality 214 may be configured as actions 218 (e.g., quick actions) that are associated with the application. These actions are directly accessible via the user-selectable targets 204-212 and thus, can be quickly performed.
- a user may select one of the user-selectable targets 204-212 to gain access to actions 218 that may be performed by the application 114 in a non-modal manner.
- a user may select a user-selectable target of the representation 202 to initiate execution of an action 218 by the application 114 without navigating away from a display of the representation 202, an example of which is provided below.
- application developers may configure actions 218 that may be directly accessed via the application 202 in a non-modal manner.
- FIG. 3 illustrates computing device 102 in accordance with one or more embodiments.
- a user using their right hand, provides gestural input relative to application representation 134.
- Any suitable type of gestural input can be utilized.
- gestural input can comprise any type of touch-based input such as rapid tap combinations, touch and slide, and the like.
- a two- finger pinch-type gesture is used to cause multiple user-selectable targets to be exposed.
- FIG. 4 illustrates computing device 102 in accordance with one or more embodiments.
- a user using their right hand, provides gestural input relative to application representation 134.
- Any suitable type of gestural input can be utilized.
- gestural input can comprise any type of touch-based input such as rapid tap combinations, touch and slide, and the like.
- a two- finger pinch-type gesture is used to cause multiple user-selectable targets to be exposed.
- FIG. 4 illustrates computing device 102 in accordance with one or more embodiments.
- application representation 134 has been enlarged and relocated to the center of the display. In addition multiple user-selectable targets have "flown" out and are located adjacent the application representation 134. [0040] In this example, the representation 134 corresponds to a single application, which is a health and fitness application, although other applications are also contemplated without departing form the spirit and scope thereof.
- the representation 134 (which itself constitutes a user-selectable target) includes a plurality of user-selectable targets 304, 306, 308, and 310. As previously described, each of the user-selectable targets 302-310 is selectable by a user to directly access corresponding application functionality of the represented application.
- representation 134 and user-selectable targets 304 and 306 are user selectable to access different ones of a plurality of entry points 216 (FIG. 2) of the application 114.
- Application representation 134 for instance, is selectable to access an entry point 312 of the application at a root level of the application, e.g., a welcome screen or other user interface level that is arranged at a root level of a hierarchy of a user interface of the application.
- selection of this application representation 134 provides directs access to a root level of the application with which it is associated by launching the application and causing navigation to that access point automatically and without further user intervention.
- User-selectable targets 304 and 306 provide direct access to different entry points 314, 316 of the application other than the root level access point 312 corresponding to application representation 134.
- User-selectable target 304 for instance, is selectable to provide direct access to an entry point 314 of the application 114 relating to fitness.
- user-selectable target 306 is selectable to provide direct access to an entry point 316 of the application 114 relating to nutrition.
- the application representation 134 and user-selectable targets 304, 306 may be selected to launch execution of the application (if not already executed) and navigate to corresponding application functionality.
- the corresponding application functionality in this example, constitute entry points 312, 314 and 316.
- Navigation can be performed in a modal manner that causes navigation away from display of the representation 134 to output of a user interface at those entry points 312, 314, 316, e.g., through use of a window, a full-screen immersive view, and so on.
- Non-modal direct access techniques are also contemplated, further discussion of which may be found in the following and shown in a corresponding figure.
- FIG. 5 depicts an example implementation 500 showing direct access of user- selectable targets of the representation 134. This example is illustrated using first, second, and third stages 502, 504, 506. At the first stage 502, representation 134 is displayed in a user interface that includes user-selectable targets previously described.
- a finger of a user's hand 106 is illustrated as selecting a user-selectable target 310.
- an action 218 (FIG. 2) is initiated that corresponds to the user-selectable target 310, such as initiating tracking of an amount a user runs by the health and fitness application.
- this initiation of application functionality is performed in this instance through non-modal interaction with the user-selectable target 310.
- a user may initiate execution of the representation application and corresponding action through direct access provided by the user-selectable target 310 without navigating away from the representation 134.
- the representation 134 outputs notifications generated as part of the user-selectable portion 310, which in this instance is the distance a user has run.
- step 600 displays one or more application representations. Any suitable type of application representation can be utilized, examples of which are provided above.
- the application representations can be utilized to launch their associated applications as well as to visually access user-selectable targets.
- Step 602 receives gestural input associated with an application representation. Any suitable type of gestural input can be received including, by way of example and not limitation, touch gestures such as multiple taps, touch and slide, two-finger pinch, and the like. Responsive to receiving the gestural input, step 604 presents one or more user- selectable targets in association with the application representation. The user-selectable targets for a respective application are user-selectable by a user to obtain direct access to a respective functionality associated with the application, for example, a quick action or a deep link. [0051] Responsive to an input indicative of user selection of one of the user-selectable targets, direct access is provided to the respective application functionality.
- touch gestures such as multiple taps, touch and slide, two-finger pinch, and the like.
- step 604 presents one or more user- selectable targets in association with the application representation.
- the user-selectable targets for a respective application are user-selectable by a user to obtain direct access to a
- FIG. 7 illustrates another procedure in accordance with one or more embodiments.
- Step 700 displays one or more application representations. Examples of how this can be done are provided above.
- Step 702 receives gestural input associated with an application representation. Any suitable type of gestural input can be received, examples of which are provided above.
- step 704 enlarges the application representation and step 706 relocates application representation to a center of an associated display.
- Step 708 presents one or more selectable targets in association with the application representation. This step can be performed in any suitable way. In at least some embodiments, presentation of the selectable targets can occur through an animation in which the selectable targets "fly out" from behind the enlarged application representation to assume their respective positions adjacent the enlarged application representation.
- FIG. 8 illustrates an example system generally at 800 that includes an example computing device 802 that is representative of one or more computing systems and/or devices that may implement the various techniques described herein, which is illustrated through inclusion of the representation module 118.
- the computing device 802 may be, for example, a server of a service provider, a device associated with a client (e.g., a client device), an on-chip system, and/or any other suitable computing device or computing system.
- the example computing device 802 as illustrated includes a processing system 804, one or more computer-readable media 806, and one or more I/O interface 808 that are communicatively coupled, one to another.
- the computing device 802 may further include a system bus or other data and command transfer system that couples the various components, one to another.
- a system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
- a variety of other examples are also contemplated, such as control and data lines.
- the processing system 804 is representative of functionality to perform one or more operations using hardware. Accordingly, the processing system 804 is illustrated as including hardware element 810 that may be configured as processors, functional blocks, and so forth. This may include implementation in hardware as an application specific integrated circuit or other logic device formed using one or more semiconductors.
- the hardware elements 810 are not limited by the materials from which they are formed or the processing mechanisms employed therein.
- processors may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)).
- processor-executable instructions may be electronically-executable instructions.
- the computer-readable storage media 806 is illustrated as including memory/storage 812.
- the memory/storage 812 represents memory/storage capacity associated with one or more computer-readable media.
- the memory/storage component 812 may include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth).
- the memory/storage component 712 may include fixed media (e.g., RAM, ROM, a fixed hard drive, and so on) as well as removable media (e.g., Flash memory, a removable hard drive, an optical disc, and so forth).
- the computer- readable media 806 may be configured in a variety of other ways as further described below.
- Input/output interface(s) 808 are representative of functionality to allow a user to enter commands and information to computing device 802, and also allow information to be presented to the user and/or other components or devices using various input/output devices.
- input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, touch functionality (e.g., capacitive or other sensors that are configured to detect physical touch), a camera (e.g., which may employ visible or non- visible wavelengths such as infrared frequencies to recognize movement as gestures that do not involve touch), and so forth.
- Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, tactile-response device, and so forth.
- the computing device 802 may be configured in a variety of ways as further described below to support user interaction.
- Various techniques may be described herein in the general context of software, hardware elements, or program modules. Generally, such modules include routines, programs, objects, elements, components, data structures, and so forth that perform particular tasks or implement particular abstract data types.
- the terms "module,” “functionality,” and “component” as used herein generally represent software, firmware, hardware, or a combination thereof.
- the features of the techniques described herein are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
- Computer-readable media may include a variety of media that may be accessed by the computing device 802.
- computer-readable media may include "computer- readable storage media” and "computer-readable signal media.”
- Computer-readable storage media may refer to media and/or devices that enable persistent and/or non-transitory storage of information in contrast to mere signal transmission, carrier waves, or signals per se.
- computer-readable storage media refers to non-signal bearing media.
- the computer-readable storage media includes hardware such as volatile and non-volatile, removable and non-removable media and/or storage devices implemented in a method or technology suitable for storage of information such as computer readable instructions, data structures, program modules, logic elements/circuits, or other data.
- Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, hard disks, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other storage device, tangible media, or article of manufacture suitable to store the desired information and which may be accessed by a computer.
- Computer-readable signal media may refer to a signal-bearing medium that is configured to transmit instructions to the hardware of the computing device 802, such as via a network.
- Signal media typically may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier waves, data signals, or other transport mechanism.
- Signal media also include any information delivery media.
- modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
- communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media.
- hardware elements 810 and computer-readable media 806 are representative of modules, programmable device logic and/or fixed device logic implemented in a hardware form that may be employed in some embodiments to implement at least some aspects of the techniques described herein, such as to perform one or more instructions.
- Hardware may include components of an integrated circuit or on- chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon or other hardware.
- ASIC application-specific integrated circuit
- FPGA field-programmable gate array
- CPLD complex programmable logic device
- hardware may operate as a processing device that performs program tasks defined by instructions and/or logic embodied by the hardware as well as a hardware utilized to store instructions for execution, e.g., the computer-readable storage media described previously.
- software, hardware, or executable modules may be implemented as one or more instructions and/or logic embodied on some form of computer-readable storage media and/or by one or more hardware elements 810.
- the computing device 802 may be configured to implement particular instructions and/or functions corresponding to the software and/or hardware modules. Accordingly, implementation of a module that is executable by the computing device 802 as software may be achieved at least partially in hardware, e.g., through use of computer-readable storage media and/or hardware elements 810 of the processing system 804.
- the instructions and/or functions may be executable/operable by one or more articles of manufacture (for example, one or more computing devices 802 and/or processing systems 804) to implement techniques, modules, and examples described herein.
- the example system 800 and enables ubiquitous environments for a seamless user experience when running applications on a personal computer (PC), a television device, and/or a mobile device. Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on.
- multiple devices are interconnected through a central computing device.
- the central computing device may be local to the multiple devices or may be located remotely from the multiple devices.
- the central computing device may be a cloud of one or more server computers that are connected to the multiple devices through a network, the Internet, or other data communication link.
- this interconnection architecture enables functionality to be delivered across multiple devices to provide a common and seamless experience to a user of the multiple devices.
- Each of the multiple devices may have different physical requirements and capabilities, and the central computing device uses a platform to enable the delivery of an experience to the device that is both tailored to the device and yet common to all devices.
- a class of target devices is created and experiences are tailored to the generic class of devices.
- a class of devices may be defined by physical features, types of usage, or other common characteristics of the devices.
- the computing device 802 may assume a variety of different configurations, such as for computer 814, mobile 816, and television 818 uses. Each of these configurations includes devices that may have generally different constructs and capabilities, and thus the computing device 802 may be configured according to one or more of the different device classes. For instance, the computing device 802 may be implemented as the computer 814 class of a device that includes a personal computer, desktop computer, a multi-screen computer, laptop computer, netbook, and so on.
- the computing device 802 may also be implemented as the mobile 816 class of device that includes mobile devices, such as a mobile phone, portable music player, portable gaming device, a tablet computer, a multi-screen computer, and so on.
- the computing device 802 may also be implemented as the television 818 class of device that includes devices having or connected to generally larger screens in casual viewing environments. These devices include televisions, set-top boxes, gaming consoles, and so on.
- the techniques described herein may be supported by these various configurations of the computing device 802 and are not limited to the specific examples of the techniques described herein. This functionality may also be implemented all or in part through use of a distributed system, such as over a "cloud" 820 via a platform 822 as described below.
- the cloud 820 includes and/or is representative of a platform 822 for resources 824.
- the platform 822 abstracts underlying functionality of hardware (e.g., servers) and software resources of the cloud 820.
- the resources 824 may include applications and/or data that can be utilized while computer processing is executed on servers that are remote from the computing device 802.
- Resources 824 can also include services provided over the Internet and/or through a subscriber network, such as a cellular or Wi-Fi network.
- the platform 822 may abstract resources and functions to connect the computing device 802 with other computing devices.
- the platform 822 may also serve to abstract scaling of resources to provide a corresponding level of scale to encountered demand for the resources 824 that are implemented via the platform 822.
- implementation of functionality described herein may be distributed throughout the system 800.
- the functionality may be implemented in part on the computing device 802 as well as via the platform 822 that abstracts the functionality of the cloud 820.
- a user interface is exposed by an operating system of a computing device.
- the user interface includes a concurrent display of a plurality of representations of applications that are selectable by a user to launch respective applications.
- Gesture -based techniques can be used to interact with an application representation to cause one or more visible targets to appear adjacent the representation.
- the individual targets are individually associated with some type of application functionality, e.g., a quick action or a deep link into content associated with the application.
- An individual target can then be selected, e.g., touch-selected, by a user to initiate the associated functionality.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
Description
Claims
Priority Applications (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020177006898A KR20170042338A (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to a mix view |
BR112017002664A BR112017002664A2 (en) | 2014-08-18 | 2015-08-13 | gesture-based access for a mixed view |
MX2017002135A MX2017002135A (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to a mix view. |
CN201580044287.0A CN106716300A (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to a mix view |
AU2015305852A AU2015305852A1 (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to a mix view |
CA2955364A CA2955364A1 (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to a mix view |
RU2017105070A RU2017105070A (en) | 2014-08-18 | 2015-08-13 | GESTURE-BASED ACCESS TO MIXED DISPLAY |
EP15756732.2A EP3183643A1 (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to a mix view |
JP2017508601A JP2017526068A (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to mixed views |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/462,280 US20160048319A1 (en) | 2014-08-18 | 2014-08-18 | Gesture-based Access to a Mix View |
US14/462,280 | 2014-08-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016028575A1 true WO2016028575A1 (en) | 2016-02-25 |
Family
ID=54012283
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2015/044943 WO2016028575A1 (en) | 2014-08-18 | 2015-08-13 | Gesture-based access to a mix view |
Country Status (11)
Country | Link |
---|---|
US (1) | US20160048319A1 (en) |
EP (1) | EP3183643A1 (en) |
JP (1) | JP2017526068A (en) |
KR (1) | KR20170042338A (en) |
CN (1) | CN106716300A (en) |
AU (1) | AU2015305852A1 (en) |
BR (1) | BR112017002664A2 (en) |
CA (1) | CA2955364A1 (en) |
MX (1) | MX2017002135A (en) |
RU (1) | RU2017105070A (en) |
WO (1) | WO2016028575A1 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10671275B2 (en) * | 2014-09-04 | 2020-06-02 | Apple Inc. | User interfaces for improving single-handed operation of devices |
USD789400S1 (en) | 2016-06-03 | 2017-06-13 | Teleport Med, LLC | Display screen or portion thereof with graphical user interface |
USD789967S1 (en) | 2016-06-03 | 2017-06-20 | Teleport Med, LLC | Display screen or portion thereof with graphical user interface |
USD789966S1 (en) * | 2016-06-03 | 2017-06-20 | Teleport Med, LLC | Display screen or portion thereof with graphical user interface |
USD789965S1 (en) | 2016-06-03 | 2017-06-20 | Teleport Med, LLC | Display screen or portion thereof with graphical user interface |
USD837261S1 (en) | 2016-06-03 | 2019-01-01 | Teleport Med, LLC | Display screen or portion thereof with icon |
US20180039383A1 (en) * | 2016-08-02 | 2018-02-08 | International Business Machines Corporation | Efficient information browsing and management flow |
EP3521990A1 (en) * | 2018-02-05 | 2019-08-07 | Alkymia | Method for interacting with one or more of software applications using a touch sensitive display |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090007017A1 (en) * | 2007-06-29 | 2009-01-01 | Freddy Allen Anzures | Portable multifunction device with animated user interface transitions |
US20110029904A1 (en) * | 2009-07-30 | 2011-02-03 | Adam Miles Smith | Behavior and Appearance of Touch-Optimized User Interface Elements for Controlling Computer Function |
US20120030623A1 (en) * | 2010-07-30 | 2012-02-02 | Hoellwarth Quin C | Device, Method, and Graphical User Interface for Activating an Item in a Folder |
US20130263251A1 (en) * | 2012-03-31 | 2013-10-03 | Apple Inc. | Device, Method, and Graphical User Interface for Integrating Recognition of Handwriting Gestures with a Screen Reader |
US20130335337A1 (en) * | 2012-06-14 | 2013-12-19 | Microsoft Corporation | Touch modes |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7933632B2 (en) * | 2005-09-16 | 2011-04-26 | Microsoft Corporation | Tile space user interface for mobile devices |
CN101356493A (en) * | 2006-09-06 | 2009-01-28 | 苹果公司 | Portable electronic device for photo management |
US8490019B2 (en) * | 2008-01-29 | 2013-07-16 | Microsoft Corporation | Displaying thumbnail copies of each running item from one or more applications |
US8669945B2 (en) * | 2009-05-07 | 2014-03-11 | Microsoft Corporation | Changing of list views on mobile device |
US8942369B2 (en) * | 2012-02-28 | 2015-01-27 | Teletech Holdings, Inc. | Method for providing support services using multi-channel navigator and route sequences |
CN102736856A (en) * | 2012-06-28 | 2012-10-17 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for selecting menu |
US20140026062A1 (en) * | 2012-07-20 | 2014-01-23 | Research In Motion Limited | Method, system and apparatus for collecting data associated with applications |
CN103677611B (en) * | 2012-09-24 | 2017-12-01 | 联想(北京)有限公司 | A kind of information processing method and a kind of electronic equipment |
KR102044460B1 (en) * | 2012-11-12 | 2019-11-13 | 엘지전자 주식회사 | Mobile terminal and method for controlling of the same |
CN103092508A (en) * | 2012-12-07 | 2013-05-08 | 北京傲游天下科技有限公司 | Touch interface implementation method and device |
US20140195918A1 (en) * | 2013-01-07 | 2014-07-10 | Steven Friedlander | Eye tracking user interface |
US9553919B2 (en) * | 2013-02-27 | 2017-01-24 | Quixey, Inc. | Techniques for sharing application states |
CN105074700A (en) * | 2013-03-01 | 2015-11-18 | 奎克西公司 | Generating search results containing state links to applications |
US20140282114A1 (en) * | 2013-03-15 | 2014-09-18 | Facebook, Inc. | Interactive Elements with Labels in a User Interface |
CN103838472B (en) * | 2014-02-28 | 2017-06-20 | 华南理工大学 | The multistage feature navigator menu and its method of work of fan-shaped and concentric circles composition |
US9747365B2 (en) * | 2014-06-30 | 2017-08-29 | Quixey, Inc. | Query understanding pipeline |
US9684729B2 (en) * | 2014-06-30 | 2017-06-20 | Quixey, Inc. | Displaying search results on a user device using a layout file |
US20160048294A1 (en) * | 2014-08-15 | 2016-02-18 | Microsoft Technology Licensing, Llc | Direct Access Application Representations |
-
2014
- 2014-08-18 US US14/462,280 patent/US20160048319A1/en not_active Abandoned
-
2015
- 2015-08-13 AU AU2015305852A patent/AU2015305852A1/en not_active Abandoned
- 2015-08-13 JP JP2017508601A patent/JP2017526068A/en active Pending
- 2015-08-13 BR BR112017002664A patent/BR112017002664A2/en not_active Application Discontinuation
- 2015-08-13 MX MX2017002135A patent/MX2017002135A/en unknown
- 2015-08-13 RU RU2017105070A patent/RU2017105070A/en not_active Application Discontinuation
- 2015-08-13 KR KR1020177006898A patent/KR20170042338A/en unknown
- 2015-08-13 CN CN201580044287.0A patent/CN106716300A/en not_active Withdrawn
- 2015-08-13 WO PCT/US2015/044943 patent/WO2016028575A1/en active Application Filing
- 2015-08-13 CA CA2955364A patent/CA2955364A1/en not_active Abandoned
- 2015-08-13 EP EP15756732.2A patent/EP3183643A1/en not_active Withdrawn
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090007017A1 (en) * | 2007-06-29 | 2009-01-01 | Freddy Allen Anzures | Portable multifunction device with animated user interface transitions |
US20110029904A1 (en) * | 2009-07-30 | 2011-02-03 | Adam Miles Smith | Behavior and Appearance of Touch-Optimized User Interface Elements for Controlling Computer Function |
US20120030623A1 (en) * | 2010-07-30 | 2012-02-02 | Hoellwarth Quin C | Device, Method, and Graphical User Interface for Activating an Item in a Folder |
US20130263251A1 (en) * | 2012-03-31 | 2013-10-03 | Apple Inc. | Device, Method, and Graphical User Interface for Integrating Recognition of Handwriting Gestures with a Screen Reader |
US20130335337A1 (en) * | 2012-06-14 | 2013-12-19 | Microsoft Corporation | Touch modes |
Non-Patent Citations (1)
Title |
---|
See also references of EP3183643A1 * |
Also Published As
Publication number | Publication date |
---|---|
JP2017526068A (en) | 2017-09-07 |
RU2017105070A3 (en) | 2019-03-20 |
CN106716300A (en) | 2017-05-24 |
KR20170042338A (en) | 2017-04-18 |
BR112017002664A2 (en) | 2017-12-12 |
AU2015305852A1 (en) | 2017-02-09 |
EP3183643A1 (en) | 2017-06-28 |
RU2017105070A (en) | 2018-08-16 |
MX2017002135A (en) | 2017-05-04 |
US20160048319A1 (en) | 2016-02-18 |
CA2955364A1 (en) | 2016-02-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20160048319A1 (en) | Gesture-based Access to a Mix View | |
US10216370B2 (en) | Tabs in system task switchers | |
US20160034153A1 (en) | Icon Resizing | |
US20160239163A1 (en) | Control of Item Arrangement in a User Interface | |
US20160182603A1 (en) | Browser Display Casting Techniques | |
US9785310B2 (en) | Control of addition of representations to an application launcher | |
US20160048294A1 (en) | Direct Access Application Representations | |
EP2979174B1 (en) | Visual configuration and activation | |
US20160173563A1 (en) | Rotation Control of an External Display Device | |
US9176573B2 (en) | Cumulative movement animations | |
CN106537337B (en) | Application launcher resizing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15756732 Country of ref document: EP Kind code of ref document: A1 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
REEP | Request for entry into the european phase |
Ref document number: 2015756732 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2955364 Country of ref document: CA |
|
ENP | Entry into the national phase |
Ref document number: 2015305852 Country of ref document: AU Date of ref document: 20150813 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2017508601 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2017105070 Country of ref document: RU Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2017/002135 Country of ref document: MX |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112017002664 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 20177006898 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 112017002664 Country of ref document: BR Kind code of ref document: A2 Effective date: 20170209 |