Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
  • G06F3/04842—Selection of displayed objects or displayed text elements
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
  • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F9/00—Arrangements for program control, e.g. control units
  • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
  • G06F9/44—Arrangements for executing specific programs
  • G06F9/451—Execution arrangements for user interfaces

Definitions

• a user interface element and a visual indicator are displayed to show both a current selected area that tracks a user's touch input and an indication of any items that are considered to be selected (the potential selection).
• the user interface element e.g. a border
• the user interface element is displayed whose size may be adjusted by a user using touch input to select more/fewer items. For example, a user may select a corner of the user interface element and drag it to adjust the currently selected area.
• An item visual indicator is displayed for items that are considered to be a potential selection (e.g. items that would be selected if the touch input were to end at the current time).
• the potential selection of items may be based on a determination that the current selected area encompasses more than some predetermined area of an item.
• the item visual indicator may distinguish all/portion of the items within the potential selection from other non-selected items.
• the item visual indicator is configured to show the user an indication of currently selected items without the border appearing to jump in response to another item being selected/deselected.
• the item visual indicator helps to provide the user with a clear and confident understanding of the selection that will be made helping to avoid the need for a user to re-adjust the selection or get unexpected results.
• FIGURE 1 illustrates an exemplary computing environment
• FIGURE 2 illustrates an exemplary system for selecting items using both a display of a currently selected area and an item visual indicator
• FIGURE 3 shows a display illustrating a window that shows a user selecting cells within a spreadsheet
• FIGURE 4 shows an illustrative processes for selecting items using touch input
• FIGURES 5-7 illustrate exemplary windows showing a user selecting items
• FIGURE 8 illustrates a system architecture used in selecting items.
• FIGURE 1 and the corresponding discussion are intended to provide a brief, general description of a suitable computing environment in which embodiments may be implemented.
• program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types.
• Other computer system configurations may also be used, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like.
• Distributed computing environments may also be used where tasks are performed by remote processing devices that are linked through a communications network.
• program modules may be located in both local and remote memory storage devices.
• FIGURE 1 an illustrative computer environment for a computer 100 utilized in the various embodiments will be described.
• the computer environment shown in FIGURE 1 includes computing devices that each may be configured as a mobile computing device (e.g. phone, tablet, netbook, laptop), server, a desktop, or some other type of computing device and includes a central processing unit 5 ("CPU"), a system memory 7, including a random access memory 9 ("RAM”) and a read-only memory (“ROM”) 10, and a system bus 12 that couples the memory to the central processing unit (“CPU") 5.
• CPU central processing unit
• RAM random access memory 9
• ROM read-only memory
• the computer 100 further includes a mass storage device 14 for storing an operating system 16, application(s) 24 (e.g. productivity application, spreadsheet application, Web Browser, and the like) and selection manager 26 which will be described in greater detail below.
• the mass storage device 14 is connected to the CPU 5 through a mass storage controller (not shown) connected to the bus 12.
• the mass storage device 14 and its associated computer-readable media provide non-volatile storage for the computer 100.
• computer-readable media can be any available media that can be accessed by the computer 100.
• Computer-readable media may comprise computer storage media and communication media.
• Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.
• Computer storage media includes, but is not limited to, RAM, ROM, Erasable Programmable Read Only Memory (“EPROM”), Electrically Erasable Programmable Read Only Memory (“EEPROM”), flash memory or other solid state memory technology, CD-ROM, digital versatile disks (“DVD”), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer 100.
• Computer 100 operates in a networked environment using logical connections to remote computers through a network 18, such as the Internet.
• the computer 100 may connect to the network 18 through a network interface unit 20 connected to the bus 12.
• the network connection may be wireless and/or wired.
• the network interface unit 20 may also be utilized to connect to other types of networks and remote computer systems.
• the computer 100 may also include an input/output controller 22 for receiving and processing input from a number of other devices, including a keyboard, mouse, a touch input device, or electronic stylus (not shown in FIGURE 1). Similarly, an input/output controller 22 may provide input/output to a display screen 23, a printer, or other type of output device.
• a touch input device may utilize any technology that allows single/multi- touch input to be recognized (touching/non-touching).
• the technologies may include, but are not limited to: heat, finger pressure, high capture rate cameras, infrared light, optic capture, tuned electromagnetic induction, ultrasonic receivers, transducer microphones, laser rangefinders, shadow capture, and the like.
• the touch input device may be configured to detect near-touches (i.e. within some distance of the touch input device but not physically touching the touch input device).
• the touch input device may also act as a display.
• the input/output controller 22 may also provide output to one or more display screens 23, a printer, or other type of input/output device.
• a camera and/or some other sensing device may be operative to record one or more users and capture motions and/or gestures made by users of a computing device. Sensing device may be further operative to capture spoken words, such as by a microphone and/or capture other inputs from a user such as by a keyboard and/or mouse (not pictured).
• the sensing device may comprise any motion detection device capable of detecting the movement of a user.
• a camera may comprise a
• MICROSOFT KINECT® motion capture device comprising a plurality of cameras and a plurality of microphones.
• Embodiments of the invention may be practiced via a system-on-a-chip (SOC) where each or many of the components/processes illustrated in the SOC.
• SOC system-on-a-chip
• FIGURES may be integrated onto a single integrated circuit.
• a SOC device may include one or more processing units, graphics units, communications units, system virtualization units and various application functionality all of which are integrated (or “burned") onto the chip substrate as a single integrated circuit.
• processing units graphics units, communications units, system virtualization units and various application functionality all of which are integrated (or "burned") onto the chip substrate as a single integrated circuit.
• a number of program modules and data files may be stored in the mass storage device 14 and RAM 9 of the computer 100, including an operating system 16 suitable for controlling the operation of a computer, such as the WINDOWS PHONE 7®, WINDOWS 7®, or WINDOWS SERVER® operating system from MICROSOFT CORPORATION of Redmond, Washington.
• the mass storage device 14 and RAM 9 may also store one or more program modules.
• the mass storage device 14 and the RAM 9 may store one or more application programs, such as a spreadsheet application, word processing application and/or other applications.
• the MICROSOFT OFFICE suite of applications is included.
• the application(s) may be client based and/or web based.
• a network service 27 may be used, such as: MICROSOFT WINDOWS LIVE, MICROSOFT OFFICE 365 or some other network based service.
• Selection manager 26 is configured to display a user interface element (e.g. UI 28) and a visual indicator to show both a current selected area that tracks a user's touch input and an indication of any items that are considered to be selected as a result of the currently selected area.
• selection manager 26 displays a user interface element (e.g. a border) that may be adjusted such that the size of the currently selected area changes in response to updated touch input (e.g. underneath a finger).
• An item visual indicator is displayed that shows any item(s) that are within the current selected area that are potential selections. For example, when the current selected area as illustrated by the user interface element encompasses more than some predetermined area of an item, the display of the item may be changed (e.g.
• the item visual indicator is configured to show the user an indication of currently selected items without the border appearing to jump in response to another item being
• Selection manager 26 may be located externally from an application, e.g. a spreadsheet application or some other application, as shown or may be a part of an application. Further, all/some of the functionality provided by selection manager 26 may be located internally/externally from an application for which the user interface element is used for editing value(s) in place. More details regarding the selection manager are disclosed below.
• FIGURE 2 illustrates an exemplary system for selecting items using both a display of a currently selected area and an item visual indicator.
• system 200 includes service 210, selection manager 240, store 245, touch screen input device/display 250 (e.g. slate) and smart phone 230.
• service 210 is a cloud based and/or enterprise based service that may be configured to provide productivity services (e.g. MICROSOFT OFFICE 365 or some other cloud based/online service that is used to interact with items (e.g. spreadsheets, documents, charts, and the like).
• productivity services e.g. MICROSOFT OFFICE 365 or some other cloud based/online service that is used to interact with items (e.g. spreadsheets, documents, charts, and the like).
• Functionality of one or more of the services/applications provided by service 210 may also be configured as a client based application.
• a client device may include a spreadsheet application that performs operations relating to selecting items using touch input.
• system 200 shows a productivity service, other services/applications may be configured to select items.
• service 210 is a multi-tenant service that provides resources 215 and services to any number of tenants (e.g. Tenants 1-N).
• multi-tenant service 210 is a cloud based service that provides resources
• System 200 as illustrated comprises a touch screen input device/display 250 (e.g. a slate/tablet device) and smart phone 230 that detects when a touch input has been received (e.g. a finger touching or nearly touching the touch screen).
• a touch input e.g. a finger touching or nearly touching the touch screen.
• Any type of touch screen may be utilized that detects a user's touch input.
• the touch screen may include one or more layers of capacitive material that detects the touch input.
• the touch screen is configured to detect objects that in contact with or above a touchable surface.
• IR Infrared
• the touch screen may be configured to determine locations of where touch input is received (e.g. a starting point, intermediate points and an ending point). Actual contact between the touchable surface and the object may be detected by any suitable means, including, for example, by a vibration sensor or microphone coupled to the touch panel.
• sensors to detect contact includes pressure-based mechanisms, micro-machined accelerometers, piezoelectric devices, capacitive sensors, resistive sensors, inductive sensors, laser vibrometers, and LED vibrometers.
• touch screen input device/display 250 and smart phone 230 shows an exemplary display 252/232 of selectable items. Items and documents may be stored on a device (e.g. smart phone 230, slate 250 and/or at some other location (e.g. network store 245). Smart phone 230 shows a display 232 of a spreadsheet including cells arranged in rows and columns that are selectable. The items, such as the cells within a spreadsheet, may be displayed by a client based application and/or by a server based application (e.g. enterprise, cloud based).
• Selection manager 240 is configured to perform operations relating to interacting with and selecting items. Items may be selected in response to touch input and/or other input. Generally, items that are selectable are discrete items such as cells, tables, pictures, words, and other objects that are individually selectable.
• a user is in the process of selecting two cells using touch input.
• the first cell selected includes the value "Chad Rothschiller” and the second cell that is partially selected includes the value "Chicken.”
• a user selects an item.
• the item may be selected using touch input and/or some other input method (e.g. keyboard, mouse, ).
• user interface element 233 is initially displayed to show the selection.
• a border is placed around the initially selected cell whose size is adjustable using touch input.
• the user has selected user interface element 233 and is dragging the edge of the UI element 233 over the cell containing the value "Chicken.”
• Item visual indicator 234 e.g.
• a hash fill in this example shows the user which cells will be selected based on the current selected area as indicated by UI element 233 (the potential selection).
• the item visual indicator 234 is displayed for any cell that is determined to be a potential selection (e.g. would be selected if the current touch input ended at the currently selected area of UI element 233).
• an item is selected when more than a predetermined percentage of the item is selected (e.g. 0-100%).
• item visual indicator 234 may be displayed for any item that is at least 50% enclosed by the currently selected area as indicated by UI element 233.
• Other item visual indicators and UI elements may be displayed (See exemplary figures and discussion herein).
• UI element 260 is a border that shows the currently selected area and item visual indicator 262 shows a potential selection.
• item visual indicator 262 shows a dimmed border around the remaining portion of the cell including the value "Chicken.”
• FIGURE 3 shows a display illustrating a window that shows a user selecting cells within a spreadsheet.
• window 300 includes a display of a spreadsheet 315 comprising three columns and seven rows. More or fewer areas/items may be included within window 300.
• Window 300 may be a window that is associated with a desktop application, a mobile application and/or a web-based application (e.g. displayed by a browser). For example, a web browser may access a spreadsheet service, an spreadsheet application on a computing device may be configured to select items from one or more different services, and the like.
• a user 330 is in the process of selecting cells A3, A4, B3 and B4 by adjusting a size of UI element 332 using touch input.
• the UI element 332 is sized by user 330 dragging a corner/edge of the UI element.
• Item visual indicator 334 displays the items (in this case cells) that would be selected if the user stopped adjusting the size of UI element 332 and ended the touch input (the potential selection).
• the potential selection in this example includes cells A3, A4, B3 and B4.
• FIGURE 4 shows an illustrative processes for selecting items using touch input.
• routines presented herein it should be appreciated that the logical operations of various embodiments are implemented (1) as a sequence of computer implemented acts or program modules running on a computing system and/or (2) as interconnected machine logic circuits or circuit modules within the computing system. The implementation is a matter of choice dependent on the performance requirements of the computing system implementing the invention.
• process 400 moves to operation 410, where a user interface element (e.g. a selection border) is displayed that shows the currently selected area/item.
• a border may be initially displayed around an item (e.g. a cell, chart, object, word, ...) in response to an initial selection.
• One or more handles may/may not be displayed with the user interface element to adjust a size of the current selected area as shown by the user interface element. For example, a user may want to change the size of the selection to include more/less items.
• touch input is received to adjust a size of the current selected area of the user interface element.
• the touch input may be a user's finger(s), a pen input device, and/or some other device that interacts directly with a display/screen of a computing device.
• the touch input may be a touch input gesture that selects and drags an edge/corner of the displayed user interface element to resize the user interface element.
• the user interface element e.g. the selection border
• the user interface element is updated during the touch event and appears to stay "pinned" under the user's finger such that the user is clearly able to see the currently selected area as defined by the user.
• An item may be a potential selection based on various criteria. For example, an item may be considered a potential selection when a predetermined percentage of the item (e.g. 10%, 20%, >50%> ..) is contained within the currently selected area. According to an embodiment, an item is considered a potential selection as soon as the currently selected area includes any part of an item (e.g. a user adjusts the currently selected area to include a portion of another cell).
• Flowing to decision operation 440 a determination is made as whether any items are potential selections. When one or more items is not a potential selection, the process flows to operation 460. When one or more items is a potential selection, the process flows to operation 450.
• an item visual indicator is displayed that indicates each item that is determined to be a potential selection.
• the item visual indicator may include different types of visual indicators.
• the item visual indicator may include any one or more of the following: changing a shading of an item; showing a different border, changing a formatting of an item, displaying a message showing the potential selection, and the like.
• the item visual indicator provides an indication to the user of any currently selected item(s) without changing the current selection border while a user is adjusting a selection border. In this way, the item visual indicator helps to provide the user with a clear and confident understanding of the selection that will be made helping to avoid the need for a user to re-adjust the selection or get unexpected results.
• FIGURES 5-7 illustrate exemplary windows showing a user selecting items.
• FIGURES 5-7 are for exemplary purpose and are not intended to be limiting.
• FIGURE 5 shows displays for selecting cells within a spreadsheet.
• window 510 and window 550 each display a spreadsheet 512 that shows a name column, a GPA column, and an exam date column in which a user has initially selected cell B3. More or fewer columns/areas may be included within windows 510 and 550.
• a window may be a window that is associated with a desktop application, a mobile application and/or a web-based application (e.g. displayed by a browser). The window may be displayed on a limited display device (e.g. smart phone, tablet) or on a larger screen device.
• selected cell B3 is displayed differently from the other cells of the spreadsheet to indicate to a user that the cell is currently selected. While cell B3 is shown as being highlighted, other display options may be used to indicate the cell is selected (e.g. border around cell, hashing, color changes, font changes and the like).
• UI element 520 In response to receiving an input (e.g. touch input 530) to adjust a size of a currently selected area, UI element 520 is displayed. In the current example, UI element 520 is displayed as a highlighted rectangular region. Other methods of displaying a user interface element to show a currently selected area may be shown (e.g. changing font, placing a border around the item, changing a color of the item, and the like). When the user changes the size of UI element 520, the display of the UI element changes to show the change in size and follows the movement of user's 530 finger. As the user adjusts the size of the currently selected area, one or more items may be determined to be a potential selection.
• an input e.g. touch input 530
• Window 550 shows the user dragging a left edge of UI element 520 such that it encompasses over half of cell A3.
• an item value indicator 522 is displayed to show the potential selection of the cell (in this example, cell A3).
• a portion of the item e.g. cell A3 is displayed using a different fill method as compared to UI element 520.
• the item value indicator 522 may also be shown using different methods (e.g. no alpha blending, different colors, each complete item that is a potential selection is displayed using the same formatting, ).
• FIGURE 6 shows displays for selecting items within a spreadsheet. As illustrated, window 610 and window 650 each include a spreadsheet that currently shows a Grade column, a sex column, and a siblings column.
• Window 610 shows a user adjusting a size of a user interface element 612 selection box.
• the user interface element 612 is displayed as a border around the cell that adjusts in size in response to a user's touch input (e.g. user 530).
• a user's touch input e.g. user 530.
• an item visual selection 614 is displayed that indicates to the user that if the user were to end the current selection, any item that is indicated as a potential selection by the item visual selection 614 would be selected.
• item visual selection 614 is displayed as a different line type as compared to the line type that is used to display the currently selected area.
• Window 650 shows a user changing a size of UI selection element 652 to select items.
• items e.g. cells F5 and F6
• a formatting method 654 to show that the items have already been selected.
• Items that have not been selected yet, but are considered potential selections e.g. cells E4, E5, E6 and F4 are illustrated as potential selection by the display of item visual selection 656 (e.g. corner brackets).
• FIGURE 7 shows displays for selecting different items within a document.
• window 710, window 720, window 730 and window 740 each include a display of a document that includes items that may be individually selected.
• Window 710 shows a user selecting a social security number within the document.
• a social security number within the document.
• the item visual selection 712 shows the potential selection (e.g. the entire social security number).
• Window 720 shows UI element 722 displayed in response to the entire selection of the social security number.
• Window 730 shows a user selecting different words in the document. As the user adjusts the size of user interface element 732, the display is adjusted to show the currently selected area and any items that would be selected if the input were to end using the currently selected area. In the current example, the last portion of "Security" is shown as a potential selection using item visual selection 734.
• Window 740 shows a user selecting the words "My Social Security.”
• FIGURE 8 illustrates a system architecture used in selecting items, as described herein.
• Content used and displayed by the application e.g. application 1020
• the selection manager 26 may be stored at different locations.
• application 1020 may use/store data using directory services 1022, web portals 1024, mailbox services 1026, instant messaging stores 1028 and social networking sites 1030.
• the application 1020 may use any of these types of systems or the like.
• a server 1032 may be used to access sources and to prepare and display electronic items.
• server 1032 may access spreadsheet cells, objects, charts, and the like for application 1020 to display at a client (e.g. a browser or some other window).
• server 1032 may be a web server configured to provide spreadsheet services to one or more users.
• Server 1032 may use the web to interact with clients through a network 1008.
• Server 1032 may also comprise an application program (e.g. a spreadsheet application). Examples of clients that may interact with server 1032 and a spreadsheet application include computing device 1002, which may include any general purpose personal computer, a tablet computing device 1004 and/or mobile computing device 1006 which may include smart phones. Any of these devices may obtain content from the store 1016.
• an application program e.g. a spreadsheet application
• Examples of clients that may interact with server 1032 and a spreadsheet application include computing device 1002, which may include any general purpose personal computer, a tablet computing device 1004 and/or mobile computing device 1006 which may include smart phones. Any of these devices may obtain content from the store 1016.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Software Systems (AREA)
• User Interface Of Digital Computer (AREA)

Priority Applications (4)

Applications Claiming Priority (2)

Publications (1)

Family

ID=48798299

Family Applications (1)

Country Status (6)

Cited By (1)

Families Citing this family (41)

Citations (5)

Family Cites Families (15)

• 2012
  • 2012-01-23 US US13/356,502 patent/US20130191785A1/en not_active Abandoned
• 2013
  • 2013-01-18 WO PCT/US2013/022003 patent/WO2013112354A1/en not_active Ceased
  • 2013-01-18 KR KR1020147020497A patent/KR20140114392A/ko not_active Ceased
  • 2013-01-18 CN CN201380006411.5A patent/CN104067211A/zh active Pending
  • 2013-01-18 JP JP2014554744A patent/JP2015512078A/ja active Pending
  • 2013-01-18 EP EP13741294.6A patent/EP2807543A4/en not_active Withdrawn

Patent Citations (6)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events