KR20150067349A - User interface elements for content selection and extended content selection - Google Patents

Abstract

A single user interface (UI) handle element is displayed in response to the content selection. For example, in response to selecting a portion of content (e.g., a cell, a word, an item, etc.), a single UI handle element may be placed near the selection of content (e.g., Is displayed. The display of a single UI handle element helps to keep the display uncluttered as opposed to initially displaying more user interface elements for content selection. In response to an indication to extend the selection, one or more additional UI handle elements may be displayed (e.g., an additional handle may be displayed near the other corner of the selection) to help the user change the selection of the content have.

Description

USER INTERFACE ELEMENTS FOR CONTENT SELECTION AND EXTENDED CONTENT SELECTION FOR CONTENT SELECTION AND EXTENDED CONTENT SELECTION [

When working on many mobile computing devices (e.g., smart phones, tablets), the actual area of the available screens and input devices are often limited. Thus, it is difficult to perform many common user interactions with documents. For example, selecting content on a limited display device (e.g., selecting cells, words, columns, rows, etc. in a spreadsheet) may be difficult for the user.

This summary is provided to introduce a selection of the concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the subject matter claimed.

A single user interface (UI) handle element is displayed in response to selection of the content. For example, in response to selecting a portion of content (e.g., a cell, a word, an item, etc.), a single UI handle element may be placed near the selection of content (e.g., Is displayed. The display of a single UI handle element helps to keep the display uncluttered as opposed to initially displaying more user interface elements for content selection. In response to an indication to extend the selection, one or more additional UI handle elements may be displayed (e.g., an additional handle is displayed near the other corner of the selection) to help the user change the content selection .

Figure 1 illustrates a system including user interface elements for selecting content.
Figure 2 illustrates selecting content within a spreadsheet.
Figures 3a and 3b show the selection of columns and rows within a spreadsheet.
Figure 4 shows the selection of content within a table.
Figure 5 illustrates selecting different types of content.
Figure 6 shows selection of content and changing this selection to a different operation.
Figure 7 illustrates an illustrative process for displaying a user interface handle element to assist in selection of content.
Figure 8 depicts an exemplary system for selecting content using different devices.
Figures 9-11 and related teachings provide a discussion of various operating environments in which embodiments of the present invention may be practiced.

Referring now to the drawings in which like reference numerals represent like elements, various embodiments will now be described.

Figure 1 illustrates a system including user interface elements for selecting content. As depicted, the system 100 includes an application program 110, a selection manager 26, and a touch screen input device / display 115.

To facilitate communication with the selection manager 26, one or more callback routines may be implemented. According to one embodiment, application program 110 is a business productivity application configured to receive input from touch sensitive input device 115 and / or keyboard input (e.g., physical keyboard and / or SIP). For example, the selection manager 26 may provide information to the application 110 in response to a gesture of the user selecting the content (i.e., finger 230 of the hand) and other touch-based gestures. For example, the gesture may include a swiping operation and / or a dragging operation.

The depicted system 100 includes a touch screen input device / display 115 for detecting a touch input received (e.g., a finger touch or a touch of the touch screen). Any type of touchscreen that detects the user's touch input may be utilized. For example, the touch screen may include one or more layers of a capacitive material that detects the touch input. In addition to or in place of the capacitive material, other sensors may be used. For example, an infrared (IR) sensor may be used. According to one embodiment, the touch screen is configured to detect an object on or in contact with the touchable surface. Although the term "above" is used in this description, it should be understood that the orientation of the touch panel system is irrelevant. The term "above" is intended to be applicable to all such orientations. The touch screen can be configured to determine the locations (e.g., start point, midpoint, and end point) where the touch input is received. The actual contact between the touchable surface and the object can be detected by any suitable means, including, for example, by a vibration sensor or microphone connected to the touch panel. A non-exhaustive list of examples for sensors for detecting contact includes pressure based mechanisms, micromechanical accelerometers, piezoelectric devices, capacitive sensors, resistive sensors, inductive sensors, laser vibrometers, and LEDs And includes a vibration system.

Selection manager 26 is configured to display UI handle elements (e.g., handles 122 and 124) to aid selection of the content. For example, in response to selecting the spreadsheet cell 123 (e.g., by tapping the cell 123), the first UI handle element 122 is displayed near the corner of the selected content do. According to one implementation, a single UI handle element (e.g., element 122) serves as an initial handle that is used to change the size of the selection. Instead of displaying multiple handles as a result of the selection of cell 123, a single UI handle is displayed, the display area remains aligned and is more easily seen by the user. While the UI handle element 122 is displayed as a small circle, other indicators (e.g., small lines, arrows, or some other small indicator) may be displayed to act as a handle.

In the present example, a selected cell is distinguished from other cells by displaying a border around the selected cell. Other methods (e.g., changing the fill color of the cell, changing the fill pattern, changing the display of the values, etc.) can be used to distinguish the selected cell. The user may use the handle element 122 to change the selection of the content. For example, the user may drag handle element 122 across the cells of the spreadsheet to include more cells (as indicated by area 140). In response to determining that the initial selection is changing, an additional UI handle element 124 is displayed. According to one embodiment, the additional UI handle element 124 is a handle that is displayed near the upper left corner of the currently selected area. Instead of showing a second UI handle element (e.g., UI element 124) in response to the initial selection 123, the selection manager 26 determines that the selection of the content is changing using the UI handle element 122 After determination, the UI handle element 124 is displayed.

Figure 2 illustrates selecting content within a spreadsheet. As depicted, FIG. 2 includes two different displays 210 and 220 depicting different choices within a spreadsheet. The displays may include devices having a limited display size (e.g., a mobile phone having a display of approximately 2 x 3 inches, a slate / tablet having a display of approximately 7 to 10 inches, and / or other display sizes (e.g., 5, 6 inches). ≪ / RTI > The display can also be displayed on the touch screen. Non-limiting display sizes can also be exploited.

Display 210 shows the initial selection of cells. According to one embodiment, the user first selects a cell to be used as a starting point for selecting other cells. In the present example, the user has selected cell B3 using one of his fingers. As a result of the selection, the cell B3 is highlighted to indicate selection. In response to the initial selection, a UI handle element 214 is displayed, which acts as a handle that the user can move to adjust the current selection. UI handle element 214 may be moved in any direction (e.g., up, down, left, right, diagonal).

The display 220 shows the user dragging the UI handle element 214 across the display 220 and across the corner of the cell at location C5. The UI handle element 216 is displayed in response to a determination that the current selection is being changed. The user can adjust the size of the currently selected area using the handle element 214 and / or the handle element 216. [

Figures 3a and 3b show the selection of columns and rows within a spreadsheet. As depicted, FIG. 3A includes two different displays 310 and 320 depicting different choices within a spreadsheet.

Display 310 shows an initial selection of columns. According to one embodiment, the user first selects a column to be used as a starting point for selecting other columns. In the current example, the user has selected column B by tapping on column header B. As a result of the selection, column B is displayed to be selected. In the present example, a rim was displayed around column B. In response to the initial selection, a UI handle element 314 is displayed, which acts as a handle that the user can move to adjust the current selection. UI element 314 may be moved to select a different number of columns.

The display 320 shows the user dragging the UI handle element 314 across the display 320 to column A. [ In response to determining that the current column selection is changing, the UI handle element 316 is displayed. The user may adjust the size of the currently selected columns using the handles 314 and / or 316. [ According to one embodiment, additional UI elements (e.g., 322, 323) may be used to change the currently selected region. For example, the user may drag handle element 322 and / or handle element 323 to change the current number of selected columns.

As depicted, FIG. 3A includes two different displays 330 and 340 that depict different choices within the spreadsheet.

Display 330 shows an initial selection of rows. According to one embodiment, the user first selects a row to be used as a starting point for selecting other rows. In the current example, the user has selected row 2 by tapping row indicator "2 ". As a result of selection, row 2 is displayed to be selected. In the present example, the borders were displayed around row 2. In response to the initial selection, a UI handle element 332 is displayed, which acts as a handle that the user can move to adjust the current selection. UI element 332 may be moved to select a different number of rows.

Display 340 shows the user dragging the UI handle element 332 to the end of row 6 below display 340. The UI element 334 is displayed in response to a determination that the current row selection is changing. The user can adjust the size of the currently selected rows using the handle element 332 and / or the handle element 334. [ According to one embodiment, additional UI elements (not shown) may be used to change the currently selected number of rows.

Figure 4 shows the selection of content within a table. As depicted, FIG. 4 includes two different displays 410 and 420 depicting different choices within a table.

Display 410 shows the initial selection of content (e.g., "C") within the table. According to one embodiment, the user first selects the content to be used as a starting point for selection of other content. In the present example, the user selected "C" by tapping. As a result of selection, the content "C" is displayed to be selected. In the present example, a border was displayed.

Display 420 shows the user dragging the UI handle element 414 across the content being displayed in the table. UI element 416 is displayed in response to a determination that the user is changing the selection of content in the table. The user can adjust the size of the currently selected rows in the table using the handle element 414 and / or the handle element 416. [

Figure 5 illustrates the selection of different types of content. As depicted, FIG. 5 includes four different displays 510, 520, 530, and 540 that depict selections of different content.

The displays 510 and 520 depict the selection of different content arranged in a structured standard. For example, the content may correspond to an image, a file, a folder, and the like.

Display 510 shows an initial selection of content (e.g., item "15"). In the present example, the user has selected item 15. As a result of the selection, the UI handle element 514 is displayed near the corners of the selected content. In the present example, the selected content 15 is not shown differently from the unselected content, except for the display of the UI handle element 514.

Display 520 shows the user dragging the UI handle element 514 across the content. UI handle element 516 is displayed in response to a determination that the user is changing the selection of content. The user may adjust the size of the currently selected content in the table using the handle element 514 and / or the handle element 516. [

Displays 530 and 540 depicts selecting text content arranged in lines and / or paragraphs.

Display 530 shows an initial selection of content (e.g., "This"). In the present example, the user has selected the word "This" to be emphasized. As a result of the selection, the UI handle element 524 is displayed near the corner of the selected content.

Display 540 shows the user dragging the UI handle element 524 across the content. UI handle element 526 is displayed in response to a determination that the user is changing the current selection of content. The user can adjust the size of the currently selected content in the table using the handle element 524 and / or the handle element 526. [

Figure 6 shows selection of content and changing this selection to a different operation. As depicted, FIG. 6 includes two different displays 610 and 620.

Display 610 shows an initial selection of content (e.g., "12"). As a result of the selection, the UI handle element 614 is displayed near the corner of the selected content.

Display 620 may be used to change the UI handle element to a different type of UI element (e.g., an autofill element) using a touch gesture (e.g., tapping / tapping on UI handle element 614) . As shown, the graphical icon can be changed from a small circle to a small "+" to indicate a functional change.

Figure 7 illustrates an illustrative process for displaying a user interface handle element to assist in selection of content. When reading the discussion of the procedures provided herein, it is to be understood that the logical operations of the various embodiments are (1) a sequence of acts implemented in a computer or program modules running on a computing system, and / or (2) Connected machine logic circuits or circuit modules. This implementation is an option dependent on the performance requirements of the computing system embodying the present invention. Accordingly, the logical operations depicted and configured in the embodiments described herein are variously referred to as operations, structural devices, acts, or modules. These acts, structural devices, acts, and modules may be implemented in software, in firmware, in special purpose digital logic, and in any combination thereof.

After the start operation, the process moves to operation 710 where the content is displayed. The content to be displayed may be different types of content. For example, the content may be a spreadsheet, a document, a table, images, files, and the like. In general, the content to be displayed may be any type of content (e.g., cells, rows, columns, table data ...) that are displayed in a structured manner.

Proceeding to operation 720, an initial selection of the content is determined. According to one embodiment, a touch input is received that indicates an initial selection of content. For example, the user may select content (e.g., a word, cell, element, or some other content) by tapping at least a portion of the finger on the touch surface. According to one embodiment, (E.g., if the finger is within a predetermined tolerance of the size of the content being displayed), the content is selected. For example, even if the user's finger is detected slightly below the bottom edge of the cell, the cell above the actual selection may be selected. Additionally, in accordance with some embodiments, a user may only have to place his finger (or any other object) near the surface of the touch surface so that the touch input is received and detected.

Going to operation 730, a single UI handle element is displayed near the selected content. According to one embodiment, a small icon representing a "handle " is displayed near the bottom right of the selected content. A graphical indicator can be used to distinguish the current selection from the non-selected content. For example, a border around the selected content may be displayed to display the current selection. Other graphic indicators may also be used. For example, the color / shade of the selected content may be used to distinguish the current selection.

Moving to operation 740, a determination is made that the current selection is being updated. For example, the user may have selected a single UI handle element and dragging the handle across the other corner.

Moving to operation 750, the second UI handle element is additionally displayed in the first UI handle element. According to one embodiment, a second UI handle element is placed near the upper left corner of the current selection. Other additional handle elements (e.g., one or more sides of the graphical bounding box may be used as a handle) may also be displayed.

Operation 760, and the current selection may be changed using any of the displayed handles.

The process then moves to a termination operation and returns to processing other operations.

Figure 8 depicts an exemplary system for selecting content using different devices. As depicted, the system 1000 includes a service 1010, a data store 1045, a touch screen input device / display 1050 (e.g., a slate), and a smart phone 1030.

As depicted, service 1010 may be used to interact with, for example, productive services (e.g., Microsoft Office 365, or items (e.g., messages, spreadsheets, documents, charts, Based services that can be configured to provide services, such as some other cloud-based / on-line services. Services can be interacted using different types of input / output. For example, the user can use touch input, hardware based input, voice input, and the like. The service may provide a voice output that combines pre-recorded voice and synthesized voice. One or more of the services / applications provided by the service 1010 may also be configured as a client / server based application. For example, a client device may include applications generated using platform-neutral components and application-specific components. Although system 1000 depicts services associated with productivity applications, other services / applications may be configured.

As depicted, a service 1010 is a multi-tenant service that provides resources 1015 and services to any number of tenants (e.g., tenants 1 through N). The multi-tenant service 1010 is a cloud-based service that provides resellers / services 1015 to the tenants subscribed to the service and maintains data for each tenant that is separate and protected from other tenant data.

The depicted system 1000 includes a touch screen input device / display 1050 (e.g., a slate / tablet device) and a touch screen input device / display 1050 (e.g., And a smartphone 1030 for detecting a user. The platforms may be the same type of platform and / or different types of platforms. Any type of touchscreen that detects the user's touch input may be utilized. For example, the touch screen may include one or more layers of a capacitive material that detects the touch input. In addition to or in place of the capacitive material, other sensors may be used. For example, an infrared (IR) sensor may be used. According to one embodiment, the touch screen is configured to detect an object on or in contact with the touchable surface. Although the term "above" is used in this description, it should be understood that the orientation of the touch panel system is irrelevant. The term "above" is intended to be applicable to all such orientations. The touch screen can be configured to determine the locations (e.g., start point, midpoint, and end point) where the touch input is received. The actual contact between the touchable surface and the object can be detected by any suitable means including, for example, by a vibration sensor or microphone connected to the touch panel. A non-exhaustive list of examples for sensors for detecting contact includes pressure based mechanisms, micromechanical accelerometers, piezoelectric devices, capacitive sensors, resistive sensors, inductive sensors, laser vibrometers, and LEDs And includes a vibration system.

According to one embodiment, the smartphone 1030 and the touch screen input device / display 1050 may be configured using different applications.

As depicted, touch screen input device / display 1050 and smartphone 1030 illustrate exemplary displays 1052/1031 showing the use of an application in which content is selected. The data may be stored on the device (e.g., smartphone 1030, slate 1050) and / or in some other location (e.g., network data store 1045). Applications used by devices may be client-based applications, server-based applications, cloud-based applications, and / or some combination thereof.

Selection manager 26 is configured to perform operations related to displaying UI handle elements and selecting content. Although the administrator 26 is shown within the service 1010, the functions of the administrator may be included in other locations (e.g., on the smartphone 1030 and / or the slate device 1050).

The embodiments and functions described herein may be implemented in any number of computing environments, including wired and wireless computing systems, mobile computing systems (e.g., mobile phones, tablet or slate type computers, laptop computers, Systems. ≪ / RTI > In addition, the embodiments and functions described herein may operate on distributed systems, where application functions, memory, data storage and retrieval, and various processing functions may be performed on, for example, the Internet Or remotely from each other via a distributed computing network, such as an intranet. Various types of user interfaces and information may be displayed via on-board computing device displays or via remote display units associated with one or more computing devices. For example, user interfaces and various types of information may be displayed and interacted on a wall surface on which user interfaces and various types of information are projected. The interaction with a plurality of computing systems in which embodiments of the present invention may be implemented includes keystroke input, touch screen input, voice or other audio input, gesture input, (E.g., camera) functionality for capturing and interpreting user gestures to control the functioning of the computing device, and the like.

Figures 9-11 and related teachings provide a discussion of various operating environments in which embodiments of the present invention may be practiced. However, the devices and systems depicted and discussed with respect to FIGS. 9 through 11 are intended to be illustrative and illustrative, and restrict the vast number of computing device configurations that may be utilized to implement the embodiments of the invention described herein I never do that.

9 is a block diagram depicting exemplary physical components of a computing device 1100 on which embodiments of the invention may be practiced. The computing device components described below may be appropriate for the computing devices described above. In the basic configuration, computing device 1100 may include at least one processing unit 1102 and system memory 1104. Depending on the configuration and type of computing device, the system memory 1104 may be volatile (e.g., random access memory (RAM)), nonvolatile (e.g., read-only memory ), Flash memory, or any combination of these, but are not limited to these. The system memory 1104 may include an operating system 1105, one or more programming modules 1106, and may include a web browser application 1120. The operating system 1105 may be appropriate, for example, to control the operation of the computing device 1100. In one embodiment, the programming modules 1106 may include a selection manager 26, as described above, installed on the computing device 1100. Furthermore, embodiments of the present invention may be implemented with a graphics library, other operating systems, or any other application program, but are not limited to any particular application or system. This basic configuration is depicted in FIG. 9 by the components in dotted line 1108.

The computing device 1100 may have additional features or functions. For example, computing device 1100 may also include additional data storage devices (removable and / or non-removable), such as, for example, magnetic disks, optical disks, or tape. This additional storage device is depicted by a removable storage device 1109 and a non-removable storage device 1110.

As noted above, a number of program modules and data files may be stored in the system memory 1104, including the operating system 1105. While executing on the processing unit 1102, programming modules 1106, such as, for example, a manager, may perform processes including, for example, operations related to the method 900 as described above. The above-mentioned process is one example, and the processing unit 1102 can perform other processes. Other programming modules that may be used in accordance with embodiments of the present invention include electronic mail and contact applications, word processing applications, spreadsheet applications, database applications, slide presentation applications, drawing or computer- And the like.

Generally, consistent with embodiments of the present invention, program modules may include routines, programs, components, data structures, and other types of structures capable of performing particular tasks or implementing particular abstract data types . Embodiments of the invention may also be practiced using other computer system configurations, including handheld devices, microprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, have. Embodiments of the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Furthermore, embodiments of the present invention may be implemented in discrete electronic elements, in packaged or integrated electronic chips including logic gates, or in circuits utilizing microprocessors, or in electronic components or microprocessors Chip on a single chip. For example, embodiments of the present invention may be implemented on a system-on-a-chip (SOC), in which each or a plurality of the components depicted in Figure 9 may be integrated onto a single integrated circuit. have. Such SOC devices may include one or more processing units, graphics units, communication units, system virtualization units, and various application functions, all of which are integrated onto a chip substrate as a single integrated circuit Burned "). When operating through the SOC, the functions described herein for the manager 26 may be performed through application specific logic circuitry integrated with other components of the computing device / system 1100 on a single integrated circuit (chip) . Embodiments of the present invention may be practiced using other techniques capable of performing logical operations, such as AND, OR, and NOT, including but not limited to mechanical, optical, fluid, and quantum technologies And can also be executed. Furthermore, embodiments of the present invention may be implemented within a general purpose computer or within any other circuitry or systems.

Embodiments of the present invention may be embodied as an article of manufacture, for example, as a computer process (method), a computer system, or as an article of manufacture, such as, for example, a computer program product or a computer readable medium. The computer program product may be a computer storage medium readable by a computer system and encoding a computer program comprising instructions for executing a computer process.

The term computer-readable medium, as used herein, may include computer storage media. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data. The system memory 1104, the removable storage 1109, and the non-removable storage 1110 are all computer storage media examples (i.e., memory storage devices). The computer storage media includes RAM, ROM, electrically erasable read- But are not limited to, electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassette, magnetic tape, Other magnetic storage devices, or any other medium that can be used to store information and that can be accessed by computing device 1100. [ Any such computer storage media may be part of the device 1100. The computing device 1100 may also include input device (s) 1112, such as a keyboard, a mouse, a pen, a voice input device, a touch input device, and the like. Output device (s) 1114, such as a display, speakers, printer, etc., may also be included. The above-mentioned devices are examples, and other devices can be used.

The camera and / or some other sensing device may record one or more users and may be operable to capture movements and / or gestures performed by users of the computing device. A sensing device, such as a microphone, may also be operative to capture spoken words and / or to capture other inputs from the user, such as by a keyboard and / or mouse (not shown). The sensing device may include any motion detection device capable of detecting the motion of the user. For example, a camera may include a Microsoft Kinect® motion capturing device that includes a plurality of cameras and a plurality of microphones.

The term computer-readable medium, as used herein, may also include a communication medium. Communication media may be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term "modulated data signal" may have one or more sets of signal characteristics, or describe a signal that can be changed, such as how to encode information in the signal. By way of example and not limitation, communication media may include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), infrared, and other wireless media.

10A and 10B depict suitable mobile computing environments, such as, for example, mobile phones, smart phones, tablet personal computers, laptop computers, etc., in which embodiments of the invention may be practiced. Referring to FIG. 10A, an exemplary mobile computing device 1200 for implementing embodiments is depicted. In the basic configuration, mobile computing device 1200 is a handheld computer with both input and output elements. The input elements may include input buttons 1215 and a touch screen display 1205 that allow a user to enter information into the mobile computing device 1200. The mobile computing device 1200 may also incorporate optional side input elements 1215 to enable additional user input. The optional side input element 1215 may be a rotary switch, a button, or any other type of manual input element. In alternative embodiments, the mobile computing device 1200 may include more or fewer input elements. For example, display 1205 may not be a touch screen in some embodiments. In another alternative embodiment, the mobile computing device is a cellular telephone system, such as, for example, a cellular phone with a display 1205 and input buttons 1215. [ The mobile computing device 1200 may also include an optional keyboard 1235. The optional keyboard 1215 may be a physical keyboard or "soft" keyboard created on a touch screen display.

Mobile computing device 1200 includes output elements, such as, for example, display 1205, that can display a graphical user interface (GUI). Other output elements include speaker 1225 and LED light 1220. In addition, the mobile computing device 1200 may include a vibration module (not shown) that causes the mobile device 1200 to vibrate to notify the user of an event. In yet another embodiment, the mobile computing device 1200 may include a headphone jack (not shown) for providing other means of providing output signals.

Although described herein in combination with a mobile computing device, in an alternate embodiment, the invention may be practiced with other computing devices, such as, for example, a desktop environment, a laptop or notebook computer system, a multiprocessor system, Such as a personal computer, a personal computer, a mini computer, a mainframe computer, and the like. Embodiments of the invention may also be practiced in distributed computing environments where tasks in a distributed computing environment are performed by remote processing devices that are connected via a communications network and programs may be executed in both local and remote memory storage devices As shown in FIG. In summary, any computer system having a plurality of environmental sensors, a plurality of output elements for providing notifications to a user, and a plurality of notification event types may comprise embodiments of the present invention.

10B is a block diagram depicting the components of a mobile computing device used in one embodiment, such as the computing device shown in FIG. 10A. That is, the mobile computing device 1200 may include a system 1202 for implementing some embodiments. For example, the system 1202 may be a "smart phone " that can execute one or more applications similar to desktop or notebook computer applications, such as a browser, email, scheduling, instant messaging, "Can be used. In some embodiments, the system 1202 may be integrated as a computing device, such as an integrated personal digital assistant (PDA) and a wireless phoneme.

One or more application programs 1266 may be loaded into the memory 1262 and executed on or in association with the operating system 1264. [ Examples of application programs include phoneme dialer programs, personal information management (PIM) programs, word processing programs, spreadsheet programs, Internet browser programs, messaging programs, and the like. System 1202 also includes non-volatile storage 1268 in memory 1262. Non-volatile storage 1268 may be used to store persistence information that should not be lost if the system 1202 is powered down. Applications 1266 may use information such as e-mail, or other messages used by an e-mail application, and store this information in non-volatile storage 1268. The synchronization application (not shown) may also reside on the system 1202 and may include a corresponding synchronization application residing on the host computer to keep the information stored in the non-volatile store 1268 synchronized with the corresponding information stored on the host computer Are programmed to interact. Other applications, including the selection manager 26 described above, may be loaded into the memory 1262 and executed on the device 1200, as should be appreciated.

The system 1202 has a power supply 1270, which may be implemented as one or more batteries. The power supply 1270 may also include an external power source such as an AC adapter or a powered docking cradle to supplement or charge the batteries.

The system 1202 may also include a wireless communication device 1272 that performs the function of sending and receiving radio frequency communications. The wireless communication device 1272 facilitates wireless connectivity between the system 1202 and the "outside world" through a communication carrier or service provider. Transfers to and from the wireless communication device 1272 are performed under the control of the OS 1264. In other words, communication signals received by the wireless communication device 1272 may be propagated to the application programs 1266 via the OS 1264, or vice versa.

The wireless communication device 1272 enables the system 1202 to communicate with other computer devices, such as through a network. The wireless communication device 1272 is one example of a communication medium. Communication media typically embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and may include any information delivery media . The term "modulated data signal" means a signal having one or more sets of signal characteristics, or may be modified, for example, in a manner that encodes information in the signal. By way of illustration and not limitation, communication media includes wired networks, wired media such as direct wired connections, and wireless media such as acoustic, RF, infrared and other wireless media. The term computer-readable medium as used herein includes both storage media and communication media.

This embodiment of system 1202 includes two types of notification output devices: an LED 1220 that can be used to provide visual notifications; an audio interface (not shown) that can be used with the speaker 1225 to provide audio notification 1274, respectively. These devices may be directly connected to the power supply 1270 such that when activated, the processor 1260 and other components may be shut down to conserve battery power, On " period. LED 1220 may be programmed to remain infinite until the user takes action to indicate the powered-on status of the device being powered. Audio interface 1274 is used to provide audible signals to the user and receive audible signals from the user. For example, in addition to being connected to the speaker 1225, the audio interface 1274 may also be coupled to the microphone 1220 to receive audible input, such as to facilitate telephone conversation. In accordance with an embodiment of the present invention, microphone 1220, as described below. It can also function as an audio sensor for facilitating control of the notification. The system 1202 may also include a video interface 1276 that enables operation of the onboard camera 1230 to record still images, video streams, and the like.

A mobile computing device implementing the system 1202 may have additional features or functions. For example, the device may also include additional data storage devices (removable and / or non-removable), such as magnetic disks, optical disks, or tape. This additional storage is depicted in FIG. 10B by the storage 1268. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data.

Data / information generated or obtained by the device 1200 and stored via the system 1202 may be stored locally on the device 1200 as described above, or the data may be stored on the device 1200, For example, via a wired connection between a discrete computing device associated with the device 1200, such as a server computer within a distributed computing network, such as the Internet, or via a wireless communication device 1272 Lt; / RTI > can be stored on any number of storage mediums. As should be appreciated, such data / information may be accessed through device 1200, via wireless communication device 1272, or through a distributed computing network. Similarly, such data / information may be easily communicated between computing devices for storage and use in accordance with known data / information delivery and storage means, including e-mail and a common data / information sharing system.

Figure 11 depicts a system architecture for an application that uses handle elements to select content.

The components managed through the selection manager 26 may be stored in different communication channels or other storage types. For example, components - such as information - the components from which this information is developed - can be used by directory services 1322, web portals 1324, mailbox services 1326, instant messaging stores 1328, May be stored using networking sites 1330. The systems / applications 26,1320 may use any of these types of systems to enable management and storage of components within the repository 1316. [ Server 1332 can provide communications and services associated with creating applications using shared code across different platforms. The server 1332 may provide the service and content to the client over the web via the network 1308. Examples of clients that may utilize the server 1332 include any computing device 1302 that may include a mobile computing device 1306 that may include any general purpose personal computer, tablet computing device 1304, and / ). Any of these devices may acquire the display component management communication signal and content from the storage 1316.

Embodiments of the present invention are described above with reference to block diagrams and / or operational descriptions of methods, systems, and computer program products in accordance with embodiments of the present invention. The functions / operations indicated in blocks may occur out of the order shown in any of the flowcharts. For example, two consecutive blocks may in fact be executed substantially concurrently, or the blocks may sometimes be executed in reverse order, depending on the functionality / operations involved.

The above specification, examples, and data provide a complete description of the manufacture and use of combinations of the present invention. Since many embodiments of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the appended claims.

Claims (10)

A method for selecting content,
Displaying a single user interface (UI) handle element used to adjust the size of the selection of the content near the corner of the selection of the content within the graphic display;
Receiving an update on the size of the selection of the content using the single UI handle element; And
Responsive to receiving an update for the selection of the content, displaying a second UI handle element that may be used to adjust the size of the selection of the content
The method comprising the steps of: 2. The method of claim 1, further comprising displaying a selectable border around the selected content that can be used to expand the size of the selection of the content. The method of claim 1, wherein receiving the update of the size of the selection of content using the single UI handle element comprises receiving a touch-based gesture that moves the single UI handle element across other content ≪ / RTI > 2. The method of claim 1, further comprising displaying a border around the selected column in response to a selection of a column header, and displaying the single UI handle element at an edge of the selected column header. / RTI > The method of claim 1, further comprising, in response to selecting a row header, displaying a border around the selected row and the single UI handle element at an edge of the selected row, Way. 2. The method of claim 1, further comprising receiving a touch gesture on the single UI handle element that alters the single UI handle element to an auto fill UI element. A computer-readable medium storing computer-executable instructions for selecting content,
The computer-
Instructions for displaying content within a graphic display;
Instructions for determining when the content is initially selected;
Instructions for displaying a single user interface (UI) handle element used to adjust the size of the selection of the content near a corner of the selection of the content in response to determining that the content was initially selected;
Instructions for receiving an update on the size of the selection using the single UI handle element; And
And responsive to receiving an update for the size, displaying a second UI handle element that may be used to adjust the size of the selection near the selection. A system for selecting content, comprising:
A display configured to receive a touch input and to display selectable content;
A processor and a memory;
An operating environment executed using the processor; And
Select manager
Including,
The selection manager,
Determining when content is initially selected;
Displaying a single user interface (UI) handle element used to adjust the size of the selection of the content near the corner of the selection of the content;
Receiving an update on the size of the selection using the single UI handle element; And
And responsive to receiving an update for the size, displaying a second UI handle element that can be used to adjust the size of the selection near the selection. For the system. 9. The system of claim 8, wherein the operations further comprise displaying a border around the selection and using at least one of the edges of the border as an additional handle element. 9. The method of claim 8, wherein the operations further comprise displaying a border around the selected column in response to the selection of a column header in the spreadsheet, and displaying the single UI handle element at an edge of the selected column header A system for selecting content.

Images