KR20140132731A - Web page application controls - Google Patents

Abstract

To enable a user to perform actions on a portion of web page content, such as to customize, edit, share, analyze, export, and / or annotate web page content, web page behavior control (WPBC ) Menu is provided on the rendered web page. The user can automatically activate the menu by performing a unique gesture on the rendered web page and / or by selecting a portion of the web page content. The WPBC menu may provide a list of applications that may be selected to modify and manage some of the selected web page content. The application can provide rich functionality for managing web page content directly in the individual user interface and / or on the rendered web page. Moreover, manipulation of data presentations on rendered web pages, such as spreadsheet table properties, can be enabled through natural gestures.

Description

WEB PAGE APPLICATION CONTROLS [0002]

Web applications provide users with a variety of services and data over networks. Data is collected, processed, and stored in different locations. Web applications retrieve such data, format it for presentation, and provide it to browsing applications on client devices for rendering of web pages. Some web pages are static, and data does not interact. Other web pages may provide certain interactions, such as additional information, via links or through the activation of web-based modules. However, in general, web pages provide data in the format and amount determined by the web page author.

Data in conventional web pages generally have limited interaction defined by the web page author to limit his usefulness to users. Even if the page author explicitly provides the export or "data feed" function for the content, the user must perform several relatively complex operations to access and change the data, for example, an external application And manage the data provided on the rendered web page using traditional input methods. In addition, it is difficult to provide one presentation of the data on the web page itself and allow the user to interact with the data provided in the richer presentation. Moreover, although gestures and touch-based interactions are becoming more and more common, natural gesture-based interactions with web pages are typically limited to the selection of web page controls and settings.

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter nor is it intended to be used to determine the scope of the claimed subject matter.

Embodiments provide for users to perform actions on portions of web page content, such as customizing, editing, sharing, analyzing, exporting and / or annotating web page content via gestures and / To provide a Web page behavior control (WPBC) menu on the rendered web page. The WPBC menu can be activated automatically by detecting a unique gesture on the rendered web page and / or by selection of a portion of the web page content. The WPBC menu may provide a list of applications that may be selected to modify and manage some of the selected web page content. The application can provide rich functionality for managing web page content directly in the individual user interface and / or on the rendered web page. Moreover, manipulation of data presentations on rendered web pages, such as spreadsheet table properties, can be enabled through natural gestures.

These and other features and advantages will become apparent from reading the following detailed description and reviewing the associated drawings. Both the foregoing general description and the following detailed description are exemplary, and are not intended to limit the scope of the embodiments as claimed.

Figure 1 shows the activation and presentation of a Web page behavior control menu of exemplary available actions.
2 shows an exemplary activation of a web page behavior control menu of available items based on the selected content.
3 shows an example of activation of a web page behavior control menu using a gesture action.
Figure 4 shows an example of selection of multiple content portions of a web page on a multi-touch capable device.
5 illustrates an exemplary gesture action for changing and moving selected content of a web page.
Figure 6 illustrates an exemplary gesture action for merging selected content of a web page in a multi-touch capable device.
Figure 7 illustrates an exemplary zooming gesture performed on a web page.
Figure 8 is a networking environment in which a system according to embodiments may be implemented.
9 is a block diagram of an exemplary computing operating environment in which embodiments may be implemented.
10 shows a logic flow diagram for a process for providing a web page behavior enhancement control menu, in accordance with embodiments.

As described briefly above, it may be desirable to provide a web page content management system that enables to perform actions on a portion of web page content, such as customizing, editing, sharing, analyzing, exporting / A page behavior control (WPBC) menu is provided on the rendered web page. The WPBC menu may provide a list of applications that may be selected to modify and manage some of the selected web page content. The application can provide rich functionality for managing web page content directly in the individual user interface and / or on the rendered web page. In the following detailed description, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific embodiments or examples. These aspects may be combined, and other aspects may be utilized, and structural changes may be made without departing from the spirit or scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims and their equivalents.

Although the embodiments are described in the general context of program modules that run in conjunction with application programs running on an operating system on a personal computer, those skilled in the art will recognize that aspects may be implemented in conjunction with other program modules.

Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that embodiments may be practiced using handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and computing devices comparable thereto It can be. Embodiments may also be implemented in distributed computing environments where remote processing devices linked through a communications network perform tasks. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Embodiments may be implemented as computer-implemented processes (methods), computing systems, or products such as computer program products or computer-readable media. The computer program product may be a computer storage medium readable by a computer system and encoding a computer program comprising instructions for causing a computer or a computing system to perform the exemplary process (es). Computer-readable storage media may be implemented, for example, via one or more of volatile computer memory, non-volatile memory, hard drives, flash drives, floppy disks or compact disks, and storage media comparable thereto.

Throughout this specification, the term "platform" may be a combination of software and hardware components for data presentation through web pages and web pages. Examples of platforms include, but are not limited to, hosted services running on a plurality of servers, applications running on a single server, and systems comparable thereto. The term "server" generally refers to a computing device that executes one or more software programs in a networking environment. However, the server may be implemented as a virtual server (software programs) running on one or more computing devices considered as servers on the network. Further details of these techniques and exemplary operations are provided below.

According to embodiments, a touchable and gestureable input device and a display screen can be used to receive input from a user via a user interface. The touch input device and the display screen may utilize any technique that enables the user to recognize touch or gesture input. For example, some techniques may include but are not limited to heat, finger pressure, cameras with high capture rates, infrared light, optical capture, tuned electromagnetic induction, ultrasound receivers, transducer microphones, laser rangefinders, Do not. The user interface of the touchable or gestureable device may display web page content, applications for managing web page content, and a menu of actions for interacting with the web page content. A user can manage web page content by interacting with the user interface using gestures. User gestures can be captured, for example, via a video capture device, either through physical interaction (touch) with the device or through optical or similar capture of the user, without touching the user's direct device. An example of such an input device is Kinect (R) by Microsoft Corporation of Redmond, Washington. The menu of actions for interacting with the web page content may be used for applications for managing and editing web page content such as documents, tables, spreadsheets, charts, lists and any content (e.g., audio, video, Can be used to provide access. A touchable or gestureable input device may utilize features unique to a touch or gestureable computing device, but may also operate with a conventional mouse and keyboard. A touch input and / or gesture, such as a tap or swipe action, as used herein, may be used by the user as a predefined keyboard input combination or voice command, as well as via a finger, pen, ≪ / RTI >

Figure 1 illustrates the activation and presentation of an exemplary web page behavior control menu of available actions according to embodiments. Exemplary web page 100 includes standard web page elements such as menu items 102, graphical controls 104 and two exemplary content portions 110, Interaction with the data provided on the web page 100 is generally limited to the extent set by the author of the web page (or web application providing the web page). For example, content portion 110 provides a list of cars, their year of manufacture, prices, and so on. A web page can provide additional information through links to some (or all) of the data, but the user viewing the page is limited to the format and configuration of the list. Furthermore, the user can not see further analyzes of the data in the form of results, other tables or charts unless the function is provided by the author of the web page, or to change / sort / filter / format individual items on the list You can not, or you can not annotate the data.

A web page according to embodiments may include one or more web page behavior enhancement (WPBE) control elements 106, 108, 114 that allow a user to provide data and other data (e.g., Related data that is available to or from the web application, but not displayed, or stored in other locations). The WPBE control element 106 is an exemplary control element associated with an entire web page. Accordingly, the actions provided through the WPBE control element 106 may be applied to the entire web page. WPBE control elements 108, 114 are associated with content portions 110, 116, respectively. Thus, these elements provide actions that can be applied to their respective content portions. The actions provided by the WPBE control elements may be unique to each content portion, but may be the same.

Web page 100 typically includes any computing device, such as a personal computer, a tablet computer, a laptop, a mobile device such as a smart phone, a server, a vehicle-mounted computing device, and other devices connected to a web server via a network Lt; RTI ID = 0.0 > client < / RTI > Exemplary computing devices may be touch or gestureable devices such that a user may interact with a web page 100 rendered on the client device's browsing application via touch actions and / or optically (or otherwise) captured gestures, ≪ / RTI > Exemplary touch actions and gestures may also be provided by the user through predefined keyboard input combinations or voice commands, as well as through a finger, pen, mouse, touch sensitive interface, optical capture or similar device.

A second exemplary web page 118 illustrates the activation of the WPBE control element 106 for a list of actions available to the user. The user may activate the WPBE control element 106 using a touch or gesture action 112. [ For example, a user may activate a WPBE control element 106 by performing a tapping, sweeping, or similar gesture on the WPBE control element 106. [ Other actions may also be used to select the WPBE element, and the action may be provided using a finger, pen, mouse, or similar gesture capture device, as described above. Upon activation of the WPBE control element 106 by the user, a Web page behavior control (WPBC) menu of available actions (text, graphics or a combination thereof) 120 may be provided to the user. For example, the WPBC menu 120 of available actions may include icons for various applications that can display, edit, customize, analyze, etc. the content. Examples of such applications may include a word processing application 122, a spreadsheet application 124, and a presentation application 126. Other examples of applications may include drawing applications, browsing applications, content collection applications, and similar applications. These applications can be local, web-based, or embedded.

The user may select one of the applications provided on the WPBC menu 120 to manage and edit the web page content portion 110 associated with the WPBE control element 106. [ Upon selection of one of the applications 122, 124, 126, a richer / more interactive representation of the content may be provided to the user in place on the rendered web page 100 or on a separate user interface . For example, a hypertext markup language (HTML) table can be replaced with a spreadsheet table, which allows the user to specifically sort, filter, format, analyze and chart the displayed data. In another example, upon selection of one of the applications from the WPBC menu 120, the selected application may be launched within an individual user interface to allow the user to interact with the content and data using the rich functionality of the selected application . The user may edit the content within the individual application user interface and then save the changed content and return the modified content to the displayable web page 118.

In some embodiments, an appropriate application for performing the display, editing, customizing, analyzing, etc. of the content may be performed through actions (touch, gesture, etc.) on the WPBE control element 108, Can be activated directly without requiring the display of the WPBC menu 120 at the time of selection. For example, in response to a selection of a portion of a table and / or a gesture (or an intrinsic gesture) on a WPBE control element, a spreadsheet application 124 containing a selected portion of the table as content may be activated. The user can then use the rich functionality of the spreadsheet application 124 to perform tasks on selected content. Of course, other types of content and applications, such as word processing application 122, spreadsheet application 124, presentation application 126, drawing application, browsing application, content collection application may also be used.

Figure 2 illustrates an exemplary activation of a web page behavior control menu of available items based on selected content in accordance with embodiments. The exemplary web page 200 represents a dynamic approach to providing the user with the available actions. As described above, exemplary web page 200 includes standard web page elements such as menu items, graphical controls, and exemplary web page content 210. The user may select a portion 208 of the web page content 210 that the user may wish to change and manage. Upon detection of selection of a portion 208 of the web page content 210, a Web page behavior control (WPBC) menu of available actions (text, graphics, or a combination thereof) is automatically provided to the user via the user interface , Which may be a web page that contains the provided data and other data (e.g., associated data stored by the web application providing the web page or from there, It may be possible to perform various actions on the selected portion 208 of the content 210.

The provided WPBC menu 220 is an exemplary menu associated with the selected portion 208 of the web page content 210. Accordingly, the actions provided through the WPBC menu 220 may be applied to the selected portion 208 of the web page content 210. The WPBC menu 220 of available actions may include various applications, such as a word processing application 222, a spreadsheet application 224, a presentation application 226, which may display, edit, customize, And icons for other content collection applications. These applications can be local, web-based, or embedded.

The user may select one of the applications provided on the WPBC menu 220 to manage and edit the selected portion 208 of the web page content 210. [ Upon selection of one of the applications 222, 224, 226, the content may be provided to the user in a more or less rich / more interactive representation of the content on the rendered web page 100 or on the individual user interface May be provided within the user interface associated with the selected application.

The second exemplary web page 250 represents another approach to providing the user with the available actions for interacting with the selected portion 208 of the web page content 210. In this scenario, a drop-down or hover-on menu 230 of available actions may be provided in response to detecting the selection of a portion 208 of the web page content. The drop-down or hover-on menu 230 of available actions may be responsive to the activation of the WPBE control element 206, which may be associated with a portion of the content displayed on the web page or web page, . One or more additional levels of menus (e.g., menu 232) may be displayed in response to selection of one of the items on the main menu. Other types of presentations, such as audio, may also be used to provide available actions to the user. The items on the secondary menus (or user interfaces) as well as the actions provided on the main menu of FIG. 2 may also include the ability of the web application to provide web pages, the capabilities of the user's local browser application or system, and / / History of use.

3 shows an example of activation of a web page behavior control menu using gesture actions. A WPBC menu 320 for managing and editing web page content 310 allows the user to view web page content 310 and web page content 310 as shown on an exemplary web page 300 that displays web page content 310. [ And may be provided to enable interaction. In one embodiment, the WPBC menu 320 may be activated by a user-initiated gesture 308 or touch action on the user interface of the web page display. The native gesture 308 may be any gesture that may be used to activate the WPBC menu 220 and may not be confused with other gestures for interaction with a web page. The inherent gesture 308 may be further configured to be any unique gesture action, particularly to activate the WPBC menu.

The user may select a portion 312 of the web page content 310 displayed on the web page 300 and after the selection of the portion 312 the user may select a portion 312 of the web page content 310 312 may perform an inherent gesture 308 at any location on the user interface display to activate the WPBC menu 320 associated with the user. The WPBC menu 320 may include icons 322, 324, and 326 representing, for example, a word processing application, a spreadsheet application, and a presentation application. In addition, the user may perform an intrinsic gesture 308 on or near the web page content 310 that the user wishes to change and manage, and the intrinsic gesture 308 may perform the intrinsic gesture 308, And activates the WPBC menu 320 associated with the WPBC 310. As described above, the WPBC menu 320 may provide a list of applications and / or actions that a user may select to perform various actions on the web page content 310.

4 illustrates an example of selection of multiple content portions of a web page on a multi-touch or multiple gestureable device, according to embodiments. The exemplary web page 400 is similar to the web pages 200 or 300 and the web page is rendered by the browsing application on the gestureable client device so that the user can interact with the web page 100 via touch actions and gestures, Lt; RTI ID = 0.0 > content. The exemplary gestureable client device may be a multiple gestureable device so that a user may use two or more input methods, such as two hands, to select, collect, and interact with web page content 410 have. Exemplary touch actions and gestures may include tabs, swipes, and retention actions that may be provided by a user via a finger, pen, mouse, or similar gesture capture device, as well as through predefined keyboard input combinations or voice commands .

In a system according to embodiments, a user may select and collect a plurality of portions of content to be transmitted to an application for managing web page content 410. The multiple gestureable device may include a plurality of portions 422 of the web page content 410 that the user desires to interact with using a first input method or action to select and maintain a portion of the web page content 410 , 414) and to select a desired application and / or action from the WPBC menu 420 of available actions using a second input method or action.

In one embodiment, a user may use a first selection 416 to select a first portion 414 of web page content 410 and a second portion 416 of web page content 410 that the user desires to change and / (412). The user has selected one or more portions of the web page content 410 using the first selection 416 for selection and maintenance of the selected portions 412 and 414, As shown in FIG. The user may be able to select from the actions provided on the WPBC menu 420 using the second selection 408 using the user's other hand (or other input method). As described above, upon detection of selection of an application and / or action from the WPBC menu 420, the selected application may be launched within a separate user interface that displays the selected content in a richer / more interactive representation , A richer / more interactive representation of the selected content may alternatively be displayed on the rendered web page in place. The WPBC menu 420 may include, for example, icons 422, 424, and 426 representing a word processing application, a spreadsheet application, and a presentation application.

5 illustrates an exemplary gesture action for changing and moving selected content of a web page, according to embodiments. As discussed above, exemplary web page 500 includes standard web page elements and one or more content portions. Interaction with the data provided on the web page 500 is generally limited to the extent set by the author of the web page (or web application providing the web page). For example, content portion 510 provides a list of cars, their year of manufacture, prices, and so on. Web pages can provide additional information through links to some (or all) of the data, but users viewing the page are limited to the format and configuration of the list, and the user can use the rich functionality of the associated application to create tables or content May not edit, change, or interact with it. Furthermore, the user can not see further analyzes of the data in the form of results, other tables or charts unless the function is provided by the author of the web page, or to change / sort / filter / format individual items on the list You can not, or you can not annotate the data.

In a system according to embodiments, the web page 500 may transform the rendered content portion 510, so that the web page may include a web page content that includes a table, a chart, a document, graphics, And may have the abundant functionality of the associated application to enable interaction. Enabling rich application functionality for the content portion 510 may enable a user to perform various actions on the provided content and other data directly on the web page without navigating to an external application.

Web page 500 represents one example that enables rich application functionality for web page content in accordance with some embodiments. In the depicted scenario, a selected content portion 510 of a table of lists of cars may be transformed into a spreadsheet 512 containing the same data as on the web page. The content portion 510 may include a WPBC menu 520, which may be automatically displayed in response to the unique gesture on the web page and / or in response to activation of the WPBE control element as described above, ). ≪ / RTI > The user can select the relevant application from the provided WPBC menu, and the web page content can be automatically converted in response to the selection.

In the exemplary scenario, the user can select a portion of the web page content and from the automatically displayed WPBC menu, the user can select a spreadsheet application 524 for editing a table within the web page content, May automatically convert the content portion 510 into a spreadsheet 512. Converting the content portion 510 to the spreadsheet 512 may enable a user to perform spreadsheet actions directly on the web page content as if the web page content were opened within the spreadsheet application. For example, a user may select, edit (532), format, sort, analyze, and perform other spreadsheet functions and actions in the content portion 510. The transformed spreadsheet 512 may be displayed as a separate user interface through the web page content, or alternatively the web page content itself may be transformed so that the transformed spreadsheet can take the place of the content portion 510 of which it was first rendered .

In a further embodiment, when the web page content is transformed to enable rich application functionality, the user may perform actions such as selection, movement, merging, filtering, and similar actions on the data as if the content were open in a spreadsheet application It can be possible. For example, in the depicted scenario, the user may select rows of the table in the spreadsheet 512 (e.g., 534) using, for example, tap and hold gestures, drag the selected rows to a new location 536 A new table 530 can be formed. The new table 530 may be rendered there for the first time by replacing the selected web page content. Similar actions such as selecting, editing, and moving items may be performed on text and graphic items, and combinations of items contained within a web page.

6 illustrates an exemplary gesture action for merging selected content of a web page, according to embodiments. As described above, the web page according to the embodiments can convert the rendered web page content, so that the web page allows the user to interact directly with the web page content including tables, charts, documents, graphics and other content The application may have the abundant functionality of the associated application to make it possible to do so. Web page 600 represents an exemplary scenario that enables rich application functionality for web page content 610, in accordance with some embodiments. When the web page content is transformed to enable rich application functionality, the user may be able to directly select, move, merge, filter, and perform other similar application actions on the web page.

In the scenario shown, the user may select more than one portion 604, 610 of the web page content, which may be a web table containing a list of cars and related information. In response to the selection, the WPBC menu 620 of available actions for the selected web page content may be automatically displayed. Selected portions 604 and 610 of the web page content include the same data as on the web page at the time of the selection of the content and the selection 612 of the action from the WPBC menu 606 such as the spreadsheet application 624 Can be automatically converted to a spreadsheet with rich spreadsheet functionality. Once converted to a spreadsheet that enables rich spreadsheet functionality, a user may be able to manipulate and manipulate selected web page content directly on a web page, using touch inputs or gestures.

In addition, the web page content can be rendered on multiple gestureable devices, so that a user can select, collect, and interact with web page content using more than one input method, such as two hands. In the depicted scenario, the user may select and maintain a first portion of the transformed web page content using one hand or first action 608, and using the other hand or second action 614, Lt; RTI ID = 0.0 > web page content. ≪ / RTI > The user can maintain and drag two selected portions 604 and 610 of the web page content together to form a new table 618 by merging the two selected portions. A new table 618 with merged content portions can be rendered there for the first time by replacing the web page content. Similar actions such as selection, movement, and merging of items may also be performed for text and graphic items and combinations of items. Any other gestures, as well as the first and second actions 608 and 614, may be captured via the touch-based interface or through the optical or other indirect capture mechanism without the user physically touching the computing device.

7 illustrates an exemplary zooming gesture performed on a web page, in accordance with embodiments. As described above, the web page according to the embodiments can convert the rendered web page content, so that the web page allows the user to directly interact with the web page content including tables, charts, documents, graphics and other content May have the abundant functionality of the associated application to enable it to function. Enabling rich application functionality for web page content may enable a user to perform a variety of actions on the provided content and other data directly on the web page without navigating to an external application. Some exemplary actions may include selecting, editing, formatting, sorting, analyzing, moving, merging, filtering, zooming, and performing other similar actions.

In one embodiment, as shown in diagram 700, web page 702 may provide one or more portions 710, 712, 716 of web page content. The web page content can be transformed to enable rich application functionality directly on the web page so that the user can interact with the data using touch inputs and gestures to change and manipulate the web page content. Some exemplary gestures for interacting with a spreadsheet application include, for example, a swipe gesture, a cut / paste gesture, an insert gesture, a swirl gesture, a grip gesture, a chart gesture, a trend line gesture, a comment gesture, a zoom gesture, Undo / redo gestures, and the like.

In the depicted scenario, web page 702 displays transformed web page content 710, 712, 716 before zooming, and web page 720 performs a zoom gesture 706 operation, Display. According to one embodiment, a zoom in operation may be detected when a user opens two of his fingers as indicated by the zoom gesture 706. [ A zoom-out gesture can be detected when the user narrows the spacing of two of his fingers. In an exemplary illustration, when a user performs a zoom gesture 706 on a portion 710 of a web page content, the zoomed in view web page 720 expands the view so that the user interface can display the zoomed- Portion 724, and the remainder of the web page content is located outside the viewing window. The user may also perform a zoom-out gesture on the zoomed view web page 720 to return to the original web page 702 before zooming.

The exemplary user interface elements and interactions illustrated in FIGS. 1-7 are exemplary only, and do not limit the embodiments. Web page behavior control menus for managing content on a rendered web page may be implemented using other user interfaces, interface elements, presentations and configurations utilizing the principles described herein.

Figure 8 is an exemplary networking environment in which embodiments may be implemented. A platform that provides web page behavior control menus and related actions may be implemented via software, e.g., hosted services, running on one or more servers 824 or a single server (e.g., web server 826). The platform may communicate with client applications on separate computing devices, such as a smart phone 823, a laptop computer 822, or a desktop computer 821 ("client devices") via the network (s) .

As described above, one or more WPBE control elements may be inserted on the web pages by the author or by a local browser on the client devices 821-823. Upon activation, the WPBC menu may provide the user with a list of available actions and applications, and upon user selection of the application and / or action from the menu, the user may use the rich functionality of the selected application to render the rendered web It is possible to customize, edit, analyze, store, and so on the page. The user can change and manage web page content using touch inputs and gestures, and the web page content is rendered directly on the web page and in a separate user interface.

Although local versions of the modified web page content may be stored on any of the client devices 821-823, the content may also be stored remotely (e.g., in the data storage depots 829) And may be updated as the original web page content changes. The platform providing the web page can be stored in the data stores 829 and can be retrieved directly therefrom or via database server 828 data (e.g., published, implied or related content) associated with the website have.

Network (s) 820 may include any topology of servers, clients, Internet service providers, and communication media. The system according to embodiments may have a static or dynamic topology. The network (s) 820 may include secure networks such as corporate networks, non-secure networks such as wireless public networks, or the Internet. The network (s) 820 may also coordinate communications through other networks, such as the public switched telephone network (PSTN) or cellular networks. Furthermore, the network (s) 820 may comprise short range wireless networks such as Bluetooth or the like. The network (s) 820 provide for communication between the nodes described herein. By way of example, and not limitation, network (s) 820 may include wireless media such as acoustic, RF, infrared and other wireless media.

Many different configurations of computing devices, applications, data sources, and data distribution systems may be utilized to implement web page behavior control menus and web page behavior enhancement controls. Moreover, the networking environments illustrated in FIG. 8 are exemplary only. The embodiments are not limited to the exemplary applications, modules or processes.

9 and related discussion are intended to provide a brief general description of a suitable computing environment in which the embodiments may be implemented. Referring now to FIG. 9, a block diagram of an exemplary computing operating environment, for example, a computing device 900, is shown for an application in accordance with embodiments. In the basic configuration, computing device 900 may be a server running a web application and may include at least one processing unit 902 and system memory 904. [ The computing device 900 may include a plurality of processing units that cooperate when executing programs. Depending on the exact configuration and type of computing device, system memory 904 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. The system memory 904 typically includes an operating system 905 suitable for controlling the operation of the platform, such as WINDOWS operating systems from Microsoft Corporation of Redmond, Washington. The system memory 904 may also include one or more software applications such as program modules 906, a web application 922, a gesture engine 924, and a content management engine 926. [

The web application 922 may be any application or service that provides text, graphics, audio, video, and other data to users as their web pages through their client browsing applications. The web application 922 includes a WPBE control element that is embedded within a web page and a WPBC menu that enables users to select portions of the content on the web page and manage and modify web content using the rich functionality of the associated application. . The user may change web page content using touch inputs and gestures to select, move, edit, filter, merge, and perform other similar actions via web gesture engine 924 as described above And manage. In addition, the content management engine 926 can transform the rendered web page content so that the web page enables the user to interact with the web page content including tables, charts, documents, graphics and other content And may have a rich functionality of the associated application to do so. This basic configuration is illustrated by the components in dotted line 908 in FIG.

The computing device 900 may have additional features or functionality. For example, the computing device 900 may also include additional data storage devices (removable and / or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage devices are illustrated in FIG. 9 by removable storage 909 and non-removable storage 910. Computer readable storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data . Both the system memory 904, the removable storage 909, and the non-removable storage 910 are examples of computer readable storage media. The computer-readable storage medium may be embodied in a variety of forms, including RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassette, magnetic tape, Or any other medium which can be used to store the desired information and which can be accessed by the computing device 900. [ Any such computer-readable storage medium may be part of the computing device 900. The computing device 900 may also have input device (s) 912, such as a keyboard, a mouse, a pen, a voice input device, a touch input device, a gesture capture device, and input devices comparable thereto. Output device (s) 914, such as a display, a speaker, a printer, and other types of output devices, may also be included. Such devices are known in the art and need not be described in detail here.

The computing device 900 may be configured to communicate with other devices 918 that enable the device to communicate with other devices 918 through, for example, wireless networks, satellite links, cellular links within the distributed computing environment, ). ≪ / RTI > Other devices 918 may include web services, analysis services, data storage services, and computer device (s) executing services that are comparable thereto. The communication connection (s) 916 is an example of a communication medium. The communication medium may include computer readable instructions, data structures, program modules or other data therein in a modulated data signal such as a carrier wave or other transmission mechanism, and includes any information delivery media. The term "modulated data signal" means a signal in which one or more of the characteristics of the signals are set or changed in such a way as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.

Embodiments also include methods. These methods may be implemented in any number of ways including those described herein. One such approach is by machine operations of devices of the type described herein.

Another option is for one or more of the individual actions of the methods performed in conjunction with one or more person operators performing some actions. These people do not have to be in the same place, and each has a machine that runs a part of the program.

FIG. 10 shows a logic flow diagram for a process 1000 for providing web page behavior enhancement controls, in accordance with embodiments. The process 1000 may be implemented by a web application, a gesture engine, and a content management engine running on a web server or client device.

Process 1000 begins at operation 1010, wherein a web page with a WPBE control element is provided. At operation 1020, activation of the WPBEC may be detected. A WPBEC can be activated by a user action on the WPBEC, such as tap or swipe. In some embodiments, the WPBE control element is not provided, and activation of the WPBEC may be automatically implied upon detection of user selection of a portion of the content displayed on the web page. Upon detection of activation of the WPBE control element, a web page behavior control menu may be provided at operation 1030. The WPBC may provide a list of available actions and applications for interacting with the selected web page content. The WPBC menu may also provide a list of available actions upon activation of the WPBE control element based on the capabilities of the browser rendering the web page, the capabilities of the web application, user preferences and / or usage pattern (s) .

At operation 1040, a user may select an associated action and / or application to interact with the selected content using a touch or gesture action. At operation 1050, touch or gesture-based data manipulation may be enabled so that a user may modify and manage selected portions of web page content by performing actions using touch inputs and gestures. Exemplary actions may be selection, editing, filtering, moving, merging, zooming, and other similar management actions of the content.

At operation 1060, a selected portion of the web page content that is enabled for gesture-based manipulation may be provided on the original rendered web page or as a separate user interface. When a user changes web page content in an individual user interface, the modified web page content may be saved and the stored web page content may be updated as the content associated with the first rendered web page is changed. At optional operation 1070, the web page content can be transformed to enable the web page content to be manipulated through the gesture input directly on the web page. Conversion of web page content enables rich application functionality for web page content, enabling a user to perform a variety of actions on content directly provided on a web page without navigation to an external application.

The operations included in process 1000 are for illustrative purposes. The web page behavior control menu for managing content on a rendered web page, in accordance with embodiments, may be implemented by similar processes with fewer or additional steps, but of course implemented in different orders of operations using the principles described herein .

The above specification, examples and data provide a complete description of the manufacture and use of the configuration of the embodiments. While the subject matter has been described in language specific to structural functions and / or methodical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as exemplary forms of implementing the claims and embodiments.

Claims (10)

A method that is at least partially implemented in a computing device to provide gesture-based manipulation of provided content on a rendered web page,
Providing a web page behavior enhancement (WPBE) control element on a rendered web page,
When activation of the WPBE control element via a gesture is detected,
Activating an appropriate application for managing the provided content;
Providing a web page behavior control (WPBC) menu to display one or more appropriate applications for manipulating the provided content on the rendered web page;
Detecting a selection of an application from the WPBC menu;
Activating the selected application to manage the provided content
One of the steps,
Displaying the provided content in a separate user interface associated with one of the appropriate application and the selected application to enable manipulation through the gesture
≪ / RTI > The method according to claim 1,
Wherein the provided content comprises at least one from a set of text data, spreadsheet data, graphics data and video data
Way.
3. The method of claim 2,
Detecting a selection of a portion of the provided content on the rendered web page;
Automatically providing the web page behavior control (WPBC) menu in response to the selection of the portion of the provided content, the WPBC menu indicating an application available for managing the selected portion of the provided content,
≪ / RTI >
3. The method of claim 2,
The provided content is manipulated through one or more of customizing, analyzing, editing, selecting, moving, zooming, filtering, sorting, merging and formatting of the provided content on the rendered web page
Way.
The method according to claim 1,
Enabling manipulation of the provided content via gesture input on the individual user interface when the provided content is displayed in an individual user interface associated with the selected application;
Storing a change to the provided content upon completion of the operation;
Displaying the changed content on the rendered web page
≪ / RTI >
A server for providing gesture-based manipulation of provided content on a web page rendered via a client application,
A memory,
A processor coupled to the memory
Lt; / RTI >
The processor executing a web application that provides a web page having a Web page behavior enhancement (WPBE) control element to be rendered by the client application in association with an instruction stored in the memory,
The web application
Enable a user to interact with a user interface associated with the web page via gesture input,
Providing a web page behavior control (WPBC) menu that, when detecting one of activation of the WPBE control element and selection of a portion of the provided content, displays one or more applications for manipulating the provided content,
Detecting a selection of an application from the WPBC menu via a gesture input,
Activating the selected application to manage the provided content,
And configured to display the provided content in an individual user interface associated with the selected application to enable operation
server.
The method according to claim 6,
Wherein the WPBE control element is associated with the entire web page and one or more portions of the provided content displayed on the web page
server.
The method according to claim 6,
The web application
Provided from a data store associated with the rendered web page via one or more of a word processing application, a spreadsheet application, a drawing application, a presentation application, a content acquisition application and a browsing application provided by the WPBC menu, , Further configured to enable manipulation of at least one content from the set of related content and the implicit content that is available but not displayed on the web page
server.
The method according to claim 6,
The web application
Enable simultaneous selection of two or more portions of the provided content,
Automatically providing the WPBC menu displaying one or more applications for managing the selected portion of the provided content upon detection of the selection of the two or more portions of the provided content,
Detecting a selection of an application from the WPBC menu,
And to activate the selected application to manipulate the at least two selected portions of the provided content
server.
A computer-readable storage medium having stored thereon instructions for providing gesture-based manipulation of provided spreadsheet content on a rendered web page,
The command
Detecting one of an inherent gesture associated with the rendered web page via gesture input, activating an embedded web page behavior enhancement (WPBE) control element, selecting a portion of the provided spreadsheet content displayed on the rendered web page, Automatically providing a web page behavior control (WPBC) menu that displays one or more applications for managing the provided spreadsheet content displayed on the rendered web page,
Detecting a selection of an application from the WPBC menu;
Enabling manipulation of the provided spreadsheet content via a gesture input on one of the rendered web page and an individual user interface of the application selected from the WPBC menu
≪ / RTI >

Images