DE102010061104A1 - Computer-implemented method for non-modal displacing window on e.g. LCD of smartphone, involves receiving non-displace-input on content outside active region, and performing interaction with display content as reaction of non-displace-input - Google Patents

Abstract

The method involves displaying a part of content in a window on a display (110). Displace-handle-control elements overlapping the content in the window are presented. A displace-initiation-input is received in an active region of the elements. Receiving of a displace-control-input in the active region is initiated following the displace-initiation-input. The window is displaced as a reaction of the displace-control-input. A non-displace-input is received on the displayed content outside the region. Interaction with the display content is performed as a reaction of the non-displace-input. Independent claims are also included for the following: (1) a computing device for performing a method for non-modal displacing (2) a computer program product comprising instructions for performing a method for non-modal displacing.

Description

Field of the invention

The present invention relates to graphical user interfaces for computers. In particular, the present invention relates to moving a viewport using sliding handle controls.

Any discussion of prior art examples within the scope of this specification should in no way be taken as an admission that these examples are well known or are part of the general knowledge in this field of technology.

Moving viewports to content is an essential part of user interaction in content-visualized computer systems, which now includes a wide variety of computer systems with a variety of hardware requirements. Because it is a very common interaction, even small gains in time due to improvements in the human-computer interface in everyday use result in significant time gains.

Content that is to be displayed on a screen or part of it, such as in a window, often has a size that allows only the representation of a portion of the content. Various methods are used to control the move.

A group of methods that include scrolling wheels on computer mice, scrolling regions on touchpads, or cursor keys is based on specific hardware controls and can only be used on computer systems that have such hardware controls.

On-screen scroll bars on the edge of a viewport, which are the standard method on all modern desktop graphical user interfaces, reduce the viewport's usable display area, which is a major drawback especially on computer systems with small displays. In addition, the control of scrolling with increasing size of the content relative to the size of the viewport, made possible by it, becomes steadily more inaccurate, since a small displacement on the scroll bar has to be translated to a larger displacement of the viewport, making it difficult, especially on smaller displays can handle.

However, moving directly, such as using the Adobe Reader tool in Adobe Reader, allows precise control over the movement regardless of the size of the content, but requires a time-consuming mode change between the move and the non-move interaction with the content interferes with the workflow.

Summary

Devices, methods, and other implementations for move-handle controls that allow non-modal shifting of a viewport are described below.

A viewport displays a portion of content that is larger than the viewport. Within this viewport, move handle controls are displayed. The move handle controls are active areas in the viewport that can respond to user input and have a graphical representation. They are presented in positions relative to the content as represented in the viewport, and in some embodiments, in a predetermined, regular pattern that is independent of the content displayed. The viewport is shifted in response to a move input being accepted on the move handle controls. The shift input may be dragging a sliding handle control. The move handle controls maintain their positions relative to the content as represented in the viewport. Non-scrolling inputs are received on the displayed content outside the move handle controls.

Accordingly, it is an object of the present invention to provide a method, a system and a computer program product which allow control of moving a viewport to content that is independent of the presence of hardware control elements beyond a pointer control device used to display content minimizes impact on the usable area of the viewport, allowing a quick, non-modal shift between control of move and non-move interaction with the content displayed in a viewport.

This object is achieved by a computer-implemented method according to claim 1, a computing device according to claim 17 and a computer program product according to claim 18. Preferred embodiments of the invention are the subject of the dependent claims.

In one aspect, there is provided a method comprising displaying a portion of a content in a viewport on the display, wherein the content is greater than the viewport; Presenting two or more move-grip controls overlying the content in the viewport, the move-grip controls having predetermined positions relative to the content as displayed in the viewport, and each shift-handle control active areas which are receptive to user input and have a graphical representation; Accepting a move initiation input into active area of a first move handle control; Receiving a move control input beginning in the active area of the first or a second move handle control, subsequent to the move initiation input; Shifting the viewport in response to the received shift control input; Receiving a non-shift input on the displayed content outside the active areas of the move grip controls; and interacting with the displayed content in response to the non-shift input.

The control of moving by means of shift-grip controls has the advantage over conventional methods in that the implementation does not depend on the presence of specific hardware control elements beyond that for controlling the positioning of a pointer, modern graphic user interfaces without such a pointer control device are not usable in principle. It can be implemented on a larger number of devices than is possible with traditional hardware-based methods that provide additional hardware control elements.

It also has the advantage that the shift-grip controls do not reduce the size of the viewport area that can be used to display content in their dimensions. According to the invention necessary for the control of moving controls within the view window are displayed as overlays of the content. It can also be used on computers with small ads or with small viewports.

It also has the advantage that its use does not require a time-consuming mode change between a shift mode and a non-shift mode, and thus less disturbs the user's flow of operations. In particular, it does not require a long pointer path between a current pointer position and a mode change control, as well as no mode change after the completion of the move. This represents an improvement of the human-computer interface, which leads to an accelerated operation of the computer and thus to time gains for the user.

Preferably, the computing device further comprises a shift initiation input that includes a pointer attachment in the active area of the first shift grip control.

Further preferably, the shift control input includes pulling the first or second shift handle control.

Further preferably, the shift control input is received on the first shift handle control.

Further preferably, the move control input includes dragging the first move handle control without an intervening pointer event after the move initiation input.

Further preferably, the non-scrolling interaction with the displayed content is at least one of writing with digital ink, text input, creating a graphic object, adding a hyperlink, adding media, other additions to the displayed content, highlighting a portion of the content displayed content, tagging a portion of the displayed content, selecting an object from the displayed content, cropping and copying the displayed content, inserting an object into the displayed content, deleting or moving an item of the displayed content, the appearance of a displayed content Modify elements of the displayed content, interact with an active element in the content displayed, interact with media objects, interact with graphical objects, and rotate or scale the displayed content.

Further preferably, the method comprises presenting the shift-grip controls in a predetermined regular pattern that is independent of the displayed content.

Still preferably, the method includes suppressing the display of the shift grip controls during the non-shifting interaction with the displayed content.

Still preferably, the method includes suppressing the display of the two or more move-grip controls for a predetermined period of time after the end of the non-shift interaction with the displayed content.

Further preferably, the method comprises initiating a shift, which includes kinetic shift is when it is determined that a shift control input ends with a snapshot; receiving one or more additional flaps at any location in the viewport during kinetic translation, which one or more additional flippers affect the direction and / or speed of the kinetic translation; and terminating the kinetic move in response to a pointer being not part of another snippet is anywhere in the viewport.

Further preferably, the method comprises suppressing the display of the shift grip controls during a shift, except for the indication of a shift grip control on which a shift control input is received.

Still preferably, the method includes altering the graphical representation of the move-grip controls to provide the user with a visual indication of at least one of a direction in which the viewport may be shifted, the size of the content relative to the size of the viewport, a current one Operating mode for non-shifting interaction with the displayed content, and to give a program status.

Further preferably, the display and the pointer control device are combined in a touch-sensitive screen.

Further preferably, the view window extends over the entire area of the display.

Further preferably, the method comprises receiving a user input that is neither a move initiation input nor a move control input in the active area of a move handle control; and interacting with the displayed content as a non-shift input in response to said user input.

It is further preferred that the method comprises receiving a shift-grip-operator-suspension-input in the active area of a shift-handle control; and interpreting at least one subsequent user input in an active area of this move handle control as a non-displacement input that interacts with the displayed content.

Still preferably, the method includes suppressing display of the shift grip controls subsequent to the shift grip control suspension input.

According to a further aspect, a computing device is provided adaptier to perform a method according to the invention or a preferred embodiment thereof.

Another aspect of the present invention relates to a computer program product, particularly stored or signalized on a computer readable medium, which when loaded into the memory of a computer and executed by a computer, causes the computer to perform a method of the invention or a preferred embodiment thereof ,

Preferred embodiments will now be described by way of example with reference to the accompanying drawings. It is noted that even though embodiments are described separately, individual features thereof may be combined into additional embodiments.

Short descriptions of the drawings

1 shows an example of a computing device suitable for an implementation of at least one embodiment of shift grip controls.

2 FIG. 12 shows an example system architecture suitable for implementation of at least one embodiment of shift handle controls.

3 shows a rectangular viewport on the display of a computing device.

4 shows a rectangular viewport on a content.

5 shows a translated rectangular viewport on a content

6 shows a rotated rectangular viewport on a content.

7 shows a scaled rectangular viewport on a content.

8th shows a rectangular viewport on content with move handle controls.

9 shows a translated rectangular viewport on content with move handle controls.

11 shows a rotated rectangular viewport on content with move handle controls.

12 shows a scaled rectangular viewport on content with move handle controls.

13 shows a geometry for a pattern for shift-grip controls.

14 shows a geometry for a pattern for shift-grip controls.

15 shows an arrangement of shift handle controls.

16 shows a determination of the positions for shift grip controls.

17 shows a determination of the positions for shift grip controls.

18 shows the active area and the graphical representation of a move handle control.

19 shows the active area and the graphical representation of a move handle control.

20 shows the active area and the graphical representation of a move handle control.

21 shows the active area and the graphical representation of a move handle control.

22 shows the active area and the graphical representation of a move handle control.

23 shows the active areas and the graphical representations of a move handle control.

24 shows the active area and the graphical representation of a move handle control.

25 shows the operation of an embodiment of sliding handle controls.

26 shows the operation of an embodiment of sliding handle controls.

27 shows the operation of an embodiment of sliding handle controls.

28 shows a resting of a pointer.

29 shows a rectangular viewport with a superimposed user interface element.

30 shows non-moving interaction with the displayed content.

31 shows non-moving interaction with the displayed content.

32 shows non-moving interaction with the displayed content.

33 shows non-moving interaction with the displayed content.

34 shows non-moving interaction with the displayed content.

35 FIG. 12 is a block diagram of a system architecture suitable for at least one embodiment.

36 shows a viewport on a content.

37 is a flow of an embodiment.

38 is a flow of an embodiment.

39 is a flow of an embodiment.

Detailed description

The following describes computing devices and methods for implementing various embodiments of shift-handle controls. In the course of this description, reference is made to the accompanying drawings which form a part of this specification. Here, the same numbering refers to the same elements in the drawings.

While specific configurations, elements, and arrangements will be described in more detail and illustrated in the drawings, this is illustrative only. It will be apparent to those skilled in the art that other embodiments of the invention are possible without the use of some of the steps or elements described below, and that other configurations, elements, and arrangements may be used without departing from the scope of the invention.

Certain well-known details relating to computer and software technology are not mentioned in the following disclosure. In some cases, well-known structures and devices are shown as block diagrams to facilitate a description of these elements.

In addition, the embodiments described herein may be implemented as methods or devices by using well-known programming and manufacturing techniques for the manufacture of software, firmware, hardware, and combinations thereof to control a computer such that the disclosed ones Embodiments are implemented.

When referring to a mobile computing device, it is understood that other computing devices having the necessary components may be used to implement the invention.

computing device

1 shows a computing device that is suitable for implementing one or more embodiments of shift-grip controls. It is here as a mobile computing device 100 shown using a wireless data network 150 over a wireless connection 140 connected is. Other network connections, such as wired Ethernet networks, are also possible, and it should be appreciated that the principles of the invention may be used on devices that are not connected to a computer network.

The mobile computing device 100 includes an ad 110 , In the illustrated form, the display is a touch screen for pen operation 120 so that the display also acts as a pointer control device. Other pointer control devices, such as dedicated keys, control keys, computer mice, digitizing tablets, resistive or capacitive touch-sensitive screens for finger or pen operation, and analog control sticks may also be used. A mass storage may be internally connected through a removable storage form, such as one or more flash memory cards 160 , be provided to the computing device externally, such as via a data network, be connected. The device can continue a keyboard 120 and further input options. In addition to, or instead of the ad 110 in the form of a touch-sensitive screen and the keyboard 120 , other input devices such as dedicated buttons, control keys, computer mice, digitizing tablets, resistive or capacitive touch-sensitive screens for finger or pen operation, and analog control sticks may also be used. The mobile computing device 100 is in operation under the control of an operating system and executes various application programs and system processes. In a device connected to a data network, the operating system, application programs, or some of their sub-processes, including components of move-grip controls, may also reside on a server or other computer 180 which is connected via the network, wherein the connection to the network, inter alia, via a wireless connection 170 can be done. At the computer display 110 it can be any type of display, such as a liquid crystal display (LCD) or an organic light-emitting diode (OLED).

Examples of computing devices that are suitable for embodiments of shift-grip controls include mobile internet devices (MIDs) such as the Nokia N800, N810, smartphones such as the Nokia N97 and HTC Desire, tablet computers and the Lenovo Thinkpad X60t, X201t , Hewlett-Packard EliteBook 2740p, notebook computers such as the Lenovo Thinkpad LOT400, Hewlett-Packard ProBook 5310m, and desktop systems such as the Dell Studio One 19.

Suitable system architecture

2 FIG. 12 is a block diagram of a system architecture suitable for one embodiment of move-handle controls. FIG 200 (eg a hardware architecture). This architecture includes a computer 201 that is common with one or more remote computers 211 via a network interface 207 and a network 210 connected is. This network 201 can any type of network such. As a WLAN, Ethernet network, GSM network or UMTS network. The computer 201 includes at least one microprocessor 202 , Random access memory 203 , at least one input device 206 which is a pointer control device, and possibly other input devices such. As keyboards, cameras, microphones, game controllers, and one or more output devices 208 such as B. Displays and devices for audible or perceptible feedback. The user interacts with the computer via the input and output devices 206 . 208 , User inputs relevant to the present invention are provided by a shift component 205 which translates the translation of the user input into a moving viewport. The computer further includes a local memory 209 which can be a computer readable medium.

35 Figure 12 is a block diagram of a system architecture suitable for at least one embodiment of shift-handle controls 3500 (eg a software architecture). One Pointer control device driver 3510 is with a move initiation input recognizer 3520 connected, the pointer input passes. The Move Initiation Input Recognizer 3520 is with a Move Hold Control Manager 3570 a shift control input processor 3530 and a content interaction component 3560 connected. It passes inputs that can relate to content interactions to the content interaction component 3560 Next, and upon detecting a move interaction initiate input, it gives subsequent inputs to the move control input processor 3530 further. Both the shift initiate input recognizer 3520 as well as the move control input processor 3530 interact with the Move Grip Control Manager 3570 which integrates its inputs regarding the shift-grip controls and provides feedback on the state of the shift-grip controls.

The Move Handle Control Manager 3570 is next with both a move handle controls renderer 3540 as well as a content renderer 3550 to which it passes on the shift-grip controls respectively content-related information. The content renderer 3550 returns the rendered content to the viewport widget 3580 further. The viewport widget 3580 manages both the rendered move handle controls and the rendered content, and passes them to an associated display driver 3590 to display.

Viewport and content

3 shows a calculator 100 with a screen 110 and a viewport 310 , The viewport 310 is an area on the screen 110 and may only cover part of the area of the screen 110 taking.

While the viewport is shown here as a rectangle with a greater horizontal than vertical extent, other proportions and shapes are possible for a viewport.

4 shows a content 400 with a rectangular viewport 310 and its center 420 , The viewport displays a portion of the content, hereafter referred to as 'displayed content', where the content as a whole is larger than the viewport.

More suitable content can, for. Documents (eg, spreadsheets, word processing documents, HTML pages, digital ink notes) or media files (eg, drawings, photos, pictures, slides, and videos). The content may be element such. As hyperlinks, form elements such. Drop-down text selection boxes, embedded media objects, embedded media object rendering controls, graphic objects, manipulation of graphic objects or other objects, dynamically updated displays of information, or other active elements. Such elements may form part of the content as such or may be added by the program. Such addition may be for all content or limited to currently displayed content.

In 5 is the rectangular viewport 310 with its center 420 has been translated to a new position, top right from its original position in 4 ,

6 shows the rectangular viewport 310 , counterclockwise around its center 420 has been rotated.

7 shows the rectangular viewport 310 that's relative to its center 420 has been scaled. The content displayed appears opposite to the one in 4 increased.

Sliding-grip controls

8th shows a content 400 of which a part is in a rectangular viewport 310 is shown. It also shows sliding handle controls like 810 . 820 , The move handle controls are active areas in the viewport that are susceptible to pointer input and may have a graphical representation. The positions of the move handle controls are determined relative to the content as represented in the viewport. The positions of the move handle controls may be determined for all content, including the content outside the viewport, regardless of whether it has already been displayed, or these positions may be determined only for the content currently displayed. Accordingly, a particular shift-handle control can be graphically displayed only if its position is within the displayed content, such as shift-handle control 820 or, in implementations where the entirety of the content is rendered into memory, such graphics may be rendered for all content.

In 9 is the rectangular viewport 310 translated to a new position relative to the content, to the top right of its position in 8th , The process of translation can be handled by system libraries for graphical user interfaces or windowing, by cross-application frameworks, or by the application program itself. An example of a cross-application framework is Trolltech's Qt ^TM library. Another part of the content 400 is displayed. The sliding handle controls whose positions currently fall within the viewport, such as the sliding handle control 810 , are represented graphically. Move-handle controls, such as 820 that had a position within the viewport before translation of the viewport relative to the content but whose position now falls outside the viewport are no longer graphed. The sliding handle controls like 810 and 820 have maintained their position relative to the content.

10 shows a viewport 310 on a content 1050 with sliding handle controls like 1020 . 1030 and 1040 , Between the first and second views, the viewport has been translated to the lower left. The move handle controls keep their position in a coordinate system 1010 , its origin in one point 1000 which has a part of the content 1050 as displayed in the viewport. These positions are here by the vectors 1061 . 1062 and 1063 clarified. He should be clear that point 1000 has been chosen arbitrarily, and that the shift-grip controls maintain their positions relative to any other point of the content during and after translation.

In 11 became the right angle viewport 310 around a center 1100 rotates. The sliding handle controls like 810 and 820 have kept their position relative to the viewport. The positions of the slide handle controls relative to the contents have changed.

12 shows a scaled rectangular viewport 310 , The viewport became relative to a center 420 scaled so that the displayed content appears to be magnified. The sliding handle controls like 810 and 820 have kept their position and size relative to the viewport. The positions of the slide handle controls relative to the content 400 have changed. The positions of the additional sliding handle controls, as well 1200 . 1210 , relative to the content were determined.

It should be appreciated, however, that while in the embodiments of sliding handle controls described herein, while the sliding handle controls maintain their position and size relative to this viewport during rotation and scaling of a viewport, other implementations are possible. For example, the sliding handle controls may maintain their position relative to the content during rotation. The move handle controls can maintain their position relative to the content during scaling. During scaling, the move handle controls may maintain their size relative to the content. When zooming in, additional sliding-grip controls can be added between the positions of existing sliding-handle controls, and sliding-handle controls can be removed when zoomed out.

Geometric arrangement of sliding handle controls

13 shows a geometric arrangement of sliding handle controls in one embodiment of sliding handle controls. Here are the sliding handle controls, such as 1360 . 1362 , at alternating intersections of a grid, that of vertical lines like 1370 . 1372 . 1374 and horizontal line like 1380 . 1382 . 1384 is formed, arranged.

The grid has a vertical distance 1350 and a horizontal distance 1340 , Adjacent sliding handle controls, as well 1360 and 1362 in the horizontal direction, and 1360 and 1366 in the vertical direction, have in each direction a distance which is twice the distance of the lines, 1330 vertically and 1320 horizontal, corresponds. In this case, the distances were in terms of vertical 1300 as well as horizontal 1310 Selects dimensions of the rectangular view window, so that always lie at least two sliding handle controls in the horizontal and a sliding handle control in the vertical within the rectangular view window.

14 shows a geometric arrangement of sliding handle controls in another embodiment of sliding handle controls. The grid of the horizontal lines, as well 1460 . 1462 , and the vertical lines, as well 1450 . 1452 , has distances 1430 . 1440 that are the same in both directions. The sliding handle controls as well 1420 . 1421 and 1422 are placed on all crossing points of the lines. As already shown, the distance between the lines may be a function of the size of the rectangular viewport 310 to get voted. Here, the distance is less than half the smaller of the two dimensions ( 1400 . 1410 ) of the viewport, ie less than half the height 1400 of the rectangular viewport 310 ,

However, it should be clear that both the horizontal and the vertical distance are a function of the width and height, respectively View window can be. The spacing of the move handle controls can dynamically adjust for changes in the size of the viewport. This results in a change in the size of the viewport, e.g. For example, when a user resizes a window in a system environment using windows, thereby changing the size of the viewport, recalculating grid spacing. The positions of the move handle controls are then recalculated using the chosen method for calculating their positions and the grid spacing. This adjustment may be limited to a certain range of values for the distances of the shift-grip controls to z. For example, to ensure that the placement of sliding-handle controls remains operable in a particular implementation and device. If the distances are adjusted only in relation to the size of the viewport, then with enlarged viewports, the distance between shift-grip controls may increase to such an extent that the necessary hand movements to operate the shift-grip controls may slow down this operation while downsizing of the viewport may cause the move handle controls to be very close together so that a substantial portion of the content is obscured and little room remains for non-shifting interaction with the displayed content. In this case, the values for the distances can be limited so that the distance between two shift-grip controls does not exceed a maximum distance and does not fall below a minimum distance.

It should be further understood that arrangements of shift handle controls that are not based on a regular grid can also be implemented. In such patterns, the sliding handle controls z. In a diamond pattern, at the vertices of a hexagon, or in any pattern based on geometric patterns or otherwise regular. As regular here are all arrangements to understand in which repeats the arrangement of the positions of the shift-handle controls.

It should also be understood that the placement of the sliding handle controls may be dependent on or influenced by the displayed content. Thus, move handle controls can be placed so that certain parts or elements of the content are not superimposed by them.

15 shows a placement of move handle elements that is affected by the displayed content. 15 shows a content 310 with a viewport 310 and move-handle controls like 1510 and 1550 , The basic pattern for the move handle controls here is a grid with four columns and eight rows. Actual placements do not follow this pattern, but are affected by the content displayed. The sliding handle 1510 is placed so that it does not overlay any of the surrounding words. Where such a placement is not possible, as with sliding handle 1520 , a placement takes place which minimizes overlapping. In cases where a certain overlay threshold is exceeded, a shift handle may be omitted as between 1520 and 1530 the case is where a move handle is missing in the line. If the shift to fit the content is relatively large, as in the case of shift grip 1540 , then adjacent sliding handles, such as sliding handles 1550 and 1560 are also shifted, but this shift is not based on the content under their positions. This can be done to improve the number of move handles available in a viewport.

Placing the Move Handle controls that control scrolling within the viewport does not shrink the viewport, as is the case with scroll bars.

Placement of sliding handle controls

Various methods for determining the initial position of move handle controls for a displayed content may find use.

16 Figure 3 shows an initial determination of the positions for shift grip controls relative to content 400 , A point within the content is considered the origin of a coordinate system 1600 in which the positions of the sliding handle controls are initially determined. The content as it is displayed here has already been mapped to the coordinate system of the viewport, and these mapped coordinates are used for the initial determination of the positions of the move-grip controls. Here is the point of origin 1610 the upper left corner of the content 400 , However, it should be understood that any other point within the content could be chosen. The position of a first sliding handle control 1620 is determined in this coordinate system and is set here to the values 10.10. However, it should be clear that every other point within the Content could be selected. The positions of the other sliding handle controls become relative to the position of this first sliding handle control 1620 determined and determined using a selected pattern or arrangement for the placement of the shift-grip controls. In the present case, a pattern which corresponds to the in 13 is similar to that used. However, it should be understood that any other pattern or arrangement could be used.

17 Figure 3 shows an initial determination of the positions for shift grip controls relative to a viewport. A point in the viewport becomes the origin of a coordinate system 1700 in which the positions of the sliding handle controls are initially determined. Here is this point 1710 the upper left corner of the viewport 310 , However, it should be understood that any other point within the content could be chosen. The position of a first sliding handle control 1720 is determined in this coordinate system and is set here to the values 8.8. However, it should be understood that any other point within the content could be chosen. The positions of the other sliding handle controls become relative to the position of this first sliding handle control 1720 determined and determined using a selected pattern or arrangement for the placement of the shift-grip controls. In the present case, a pattern which corresponds to the in 13 is similar to that used. However, it should be understood that any other pattern or arrangement could be used.

While the move-grip controls retain their positions relative to the content after translation (i.e., translation), resizing of their positions may occur after scaling or rotation of the viewport.

By appropriate positioning of the shift-grip controls, which ensures even distribution in the viewport, the pointer paths required to initiate the shift can be minimized, thus minimizing the interruption of the workflow when shifting. This leads to an improvement of the human-computer interface and to a time saving for the user.

Active area and graphical representation

The move handle controls are active areas in the viewport that are susceptible to pointer input and may have a graphical representation. A move input on a move handle controls otherwise initiates, controls or otherwise affects a move. Such a shift input may be a shift initiate input or a shift control input. The active areas may be of any shape, size or position. The choice of these aspects may depend on the framework of an implementation, e.g. The pointer display method (s) used, the size of the display and / or the viewport, or the size and shape of the graphical representation of the move handle controls. So it may be z. For example, it may be advantageous to have larger active areas in an implementation in which pointer inputs are made via a finger-touched touch screen, as opposed to an implementation where the pointer inputs are made by a touch-sensitive screen operated by the stylus. The size of the active areas can remain constant over a wide range of display sizes. For implementations on small-screen devices, a trade-off between the ideal size for the active areas for e.g. For example, fingertip operation and sufficient space for non-shifting interaction with the displayed content will result in a reduction of the active areas. The size and positioning of the graphical representations may coincide with that of the active areas, as they may serve to make the active areas recognizable to the user, but they may e.g. For example, it may be larger than the graphical representation to allow for ease of use while minimizing the size of the graphical representation so as to obscure as little content as possible.

The graphical representation of the sliding handle controls may also be of any shape, size and position. In one embodiment, the shape, size, and position of the graphical representation of the shift-grip controls may be substantially identical to those of the active areas.

Considerations relating to the graphic design of the graphical representation of the shift-grip controls may, for. For example, to keep the graphical representation visually distinguishable from the displayed content, obscure as much as possible of the displayed content, insert into the overall design of the program, and / or follow the guidelines for the user interface of an operating system in the move handle mode. Controls are implemented. The graphical design of the graphical representation can be dynamic, e.g. For example, it may be the coloring or other aspects of the displayed content, or a current context or condition in the use of a program of which shift-handle controls are a part.

In one embodiment, the color or colors of the graphical representation of shift-grip controls may be selected or adjusted to ensure a chosen contrast to the displayed content. An adaptation of the color or colors of the graphical representation of shift-grip controls may be global, i. H. for each sliding handle controls, or for each sliding handle control individually, z. For example, the graphical representation of a shift grip control that overlays a lighter portion of displayed content may be overlaid with darker colors, while a shift grip control overlaying a darker portion is lighter in color. In one embodiment, the transparency of the graphical representation of individual shift grip controls may depend on the underlying displayed content, e.g. For example, the graphical representation of a move-grip control that overlays a portion of the displayed content that consists only of a background color can be displayed as fully opaque, while the text below it selects a higher transparency so that the text is visible.

In a watermarking effect that may be used in one embodiment, the graphical representations of shift-grip controls are displayed by changes in the color of portions of the displayed content. Thus, in a monochrome region of displayed content, the graphical representation may consist of one or more shades of that one color, while in a multicolor region of displayed content, a darker shade of those respective colors is used for the graphical representation of the shift-grip controls.

The ability to place the sliding handle controls, taking into account the content as well as the graphical representation as a watermark, allows the viewport to be used to the maximum extent for displaying content.

12 - 24 show several possible embodiments for the graphical representation and the active areas of shift-grip controls.

18 showed a sliding handle control with a graphical representation in the shape of a circle 1810 , The active area 1815 has the shape of a circle in radius and center with circle 1810 matches.

In 19 the graphical representation is a continuous, round graphic element, with the underlying content being visible through alpha blending of the element's background. In alpha blending, a translucent foreground color is combined with the colors of the overlaid content, resulting in blended colors. In 19 the foreground color can be set to full transparency, or to high transparency. The active area 1915 is like the graphic representation 1910 circular, but has a smaller radius.

In 20 the graphical representation is a continuous graphic element in the shape of a hexagon. The active area 2015 has a similar shape, but is larger than the graphical representation 2010 ,

21 shows an example in which the shape of the active area 2115 not following the graphic representation. The graphic representation 2110 here consists of two intersecting lines that end in arrowheads. The active area 2115 is circular with a diameter almost equal to the length of the lines that make up the graph, and that has its center at the intersection of these lines.

22 shows a graphic representation 2210 and an active area 2215 both are circular and of equal size, but the active area 2215 opposite to the graphic representation 2210 is offset to the top right. Such an offset may be useful, e.g. For example, if a specific implementation results in users attempting to touch objects in an offset position as perceived by them, e.g. For example, in a kiosk system with a large distance between the display and the touch-sensitive layer, the display is viewed obliquely.

In 23 is the graphical representation of the sliding handle controls of four parts, 2310 . 3220 . 2330 and 2340 , On display are four active areas, 2315 . 2325 . 2335 and 2340 which are of the same shape as the parts of the graphic representation and are sized and positioned so that they project slightly beyond them in any direction.

In 24 The graphical representation of a sliding handle control has six parts, as well 2410 that have an active area 2415 surround. There is no overlap between the active area and the graphical representations of the move handle control.

The graphical representations may be used to provide the user with additional information, such as: B. Information about a currently selected tool for non-shifting interaction with the content displayed, the directions currently possible, and the distance for moving the viewport, a current usage context, and a current program state.

A currently selected tool for non-scrolling interaction with the displayed content may be one for each of the non-scrolling interactions with the displayed content that allows for one embodiment, such as the one shown in FIG. A pen tool for freehand drawing, a text tool for adding text to the displayed content, a lasso selection tool to select parts of the displayed content, an eraser tool to delete content added to the displayed content, and a highlighter tool to mark parts of the displayed content. A program state can z. These may include, for example, the currently displayed document being stored, the availability of a network connection, and a low battery level.

An indication of these program states can be made by changes in the graphic design of the graphical representation of the shift-handle controls, such. By changing the size of the entire graphic representation or parts thereof, color changes, changes in the transparency of the graphic representation, the display of the graphic representation as an overlay or watermark, and the display of additional elements as well as symbols. The graphical representation can z. Blink, d. H. switch or fade between two or more different colors or color schemes to indicate that changes to the current document are being saved, that a network connection is being established or is active, or that a selected change in content is being processed. Flashing can be used to indicate different program states and actions in different colors or color schemes. The graphical representation of move-handle controls may be more transparent and less transparent in a context of use in a context of use where non-shifting interactions with the displayed content that is overlaid by a move-handle control may be easily performed in the move is easier to execute. Symbols can be added to the graphic design, as part of the design, or as an overlay, for For example, display the current saving of a document with a flashing display of a floppy disk, or a currently selected eraser tool by an animated illustration of an eraser erasing a drawn line.

In 24 an icon representing a pen overlaying an active area is displayed. This displays the currently selected tool for non-shifting interaction with the displayed content.

In 22 The graphical representation of a move handle control indicates how far a viewport can be moved in each of the four directions. This indication is made by changing the size of the four triangles 2220 . 2225 . 2230 and 2235 , and it is a relative indicator. The graphic representation 2210 indicates that the viewport can be moved much further up than down as the triangle 2235 much smaller than the triangle 2225 is, and that the viewport can be moved a little further to the right than to the left because the triangle 2230 only slightly larger than the triangle 2220 ,

Move using sliding handle controls

Shifting using shift grip controls may be initiated by a shift initiate input and controlled by a shift control input. 25 Fig. 12 shows the initiation of shifting using a shift grip control within a rectangular viewport 310 on a content 400 , The user input 2500 here's a pointer piecing that by means of a stylus on a touch-sensitive screen, at one point 2540 which is within the active range of a shift grip control is executed. The active area of the move handle control 2530 is at the same position and the same size as the graphical representation of the sliding handle control element.

The user input 2500 is evaluated as a move initiate input. In one embodiment of shift grip controls, the shift initiate input is a pointer settling within the active area of a shift grip control. It should be understood, however, that in other embodiments, additional aspects or actions may be used as part of the user input to evaluate a user input as a move initiation input. Such aspects or actions may e.g. Example: a resting of the pointer for a preset period of time, such. 0.5 seconds after the initial pointer setting, pointer setting and subsequent pointer setting within the active area within a preset period of time after an initial pointer, a double tap within the active area of the shift grip control or a pin apply pressure and / or angle within a certain range of values in systems equipped to receive such data.

In 26 is the rectangular viewport 310 translated to a new position relative to the content, to the top right of its position in 25 , The user input 2600 Holding a pointer-pulling on the sliding handle control 2530 , from one point 2540 to a point 2620 along a path 2601 , is, and following a move initiation input has been evaluated as a move control input. In the embodiment just described, a pointer pull evaluated as a move control input follows the move initiate input with no further pointer events such as pointer offset or pointer pending therebetween, except for a possible pause of the pointer. Pointer placement within the active area of a move handle control evaluated as shift initiate input and subsequent dragging of the move handle control constitute a single, uninterrupted action by the user. It should be understood that, in other embodiments, intermediate pointer events may be possible, such as: B. a pointer attaching and subsequent pointers. In some embodiments, the move control input may be received on a different move handle control element than the one that received the move initiate input. So the shift initiation input could be in 25 with a pointer offset, and the move control input may drag on another move handle control as well 2550 be.

Neither the move initiation input nor the move control input requires hardware controls beyond a pointer control device. This allows the implementation of move-grip controls on any computing device implementing modern graphical user interfaces that in any case require a pointer control device.

In one embodiment, the pointer movement, which is evaluated as a shift control input, is translated into a shift distance and direction equal to the distance and direction of the pointer movement. This will keep both the sliding handle control 2530 as well as the content 400 their positions relative to the pointer position. Move handle controls like 2560 now have a position within the viewport, but are not currently displayed graphically, because in this embodiment, all move-grip controls other than the one on which the move control input is received are not displayed during the move, including such as 2630 that were displayed before the initiation of the move.

While the displacement distance may be equal to that of the pointer movement, other conversion factors may be used so that pointer movement may result in a greater or lesser displacement distance. These different conversion factors may be used due to a user selection of a 'slow move' or a 'fast move', or programmatically. The user selection of a conversion factor can be determined by means such as. For example, the use of a separate menu in the menu structure of the program, by a button shown on the display, a hardware button on the device on which an embodiment is implemented, and a move control input prefixed gesture done. In particular, in one embodiment, the selection of a conversion factor may be by a superimposed menu that includes a slider that is invoked by a particular input on a move handle control and that allows control of the shift rate over a particular range of values , For example, for a conversion factor of 0.5, the distance of the shift is half that of a shift control input, while for a conversion factor of 2.0 it is twice the distance of a shift control input. In these cases, the move handle controls maintain their positions relative to the content as displayed in the viewport, and the position of the move handle control on which the move control input was initiated diverges during the Dragging from the pointer position.

27 shows the viewport and content after the move ends. The user input, and with it the move, ended with a pointer offset 2620 , The viewport is in the same position relative to the content it's in 25 held. The sliding handle controls like 2530 and 2560 are displayed and ready to accept user input.

When talking about a resting of the pointer, it does not necessarily mean that there is absolutely no pointer movement. Depending on the pointer controller used, the system on which move-handle controls are implemented, as well as other implementation details, a user attempting not to move the pointer may still generate some pointer movement. Such pointer movements may be evaluated as part of a resting of the pointer become. 28 shows an example of this. An initial pointer setting is done at point 2810 within the active area 2840 a sliding handle operating element 2800 , Subsequently, pointer events occur along a path 2820 , These can be z. B. may be the result of pressure changes on a fingertip that rests on a resistive touch-sensitive screen and leads to the registration of various touch points, or be a small movement of a pen on a touch-sensitive screen with an active digitizer layer. These pointer events are evaluated as part of a resting of the pointer as long as their distance from the punk 2810 the initial pointer attachment as reference point the radius 2830 does not exceed. A radius that is capable of reliably distinguishing between intended pointer movements and pointer events that are not the result of such intended pointer movement depends on the details of an implementation, particularly the device used for the pointer inputs. It should be understood that while here the reference point is determined by an initial pointer set, it may also be the pointer position at which the end of a previous pointer pointer or other pointer movement was determined.

While the determination of a pointer event as part of resting the pointer based on the distance to an initial pointer set is shown here, other mechanisms may be used, such as setting a pointer movement speed that must be exceeded, so that slow drift of the pointer is still processed as part of a resting of the pointer.

Kinetic shifting

In one embodiment, kinetic shifting is implemented.

Kinetic shifting can be initiated by a shift control input that ends in a clipper. A snip here is a pointer input that is essentially in a straight line and that ends in a pointer offset, further being characterized by being executed by the user in a very short amount of time and without interruption.

For kinetic shifting, the move continues after the end of the move control input. The direction and initial speed of the ongoing shift may be equal to the direction and speed of the shift at the end of the shift control input, i. H. at the end of the schnipers, his. The speed of movement decreases with time. The overall impression that this creates for the user is that he has given the content kinetic energy that keeps it moving, and that energy is consumed by friction. Implementations of kinetic shifting can be found on many modern operating system platforms, e.g. IPhone OS, Android or some implementations of Symbian S60 5th Edition.

During kinetic movement, the entire viewport can accept additional user input in the form of snips that control the direction and speed of the move. The direction and speed of the chopper are added to the 'momentum vector' of the kinetic shift. Thus, z. For example, a flipper in the present direction of kinetic motion will slow the speed of translation while a flipper at an angle of 180 degrees to the current direction of kinetic motion will reduce or even reverse the speed of translation is equal to or exceeds the current speed.

The kinetic translation ends as soon as the displacement speed has decreased to zero or has fallen below a certain minimum value, or due to a pointer attachment that is not part of a snippet and can take place anywhere in the viewport.

In one embodiment, the display of the shift-grip controls is suppressed during the kinetic shift.

Suppressing the display of a move handle control further results in its active area or areas not responding to user input. User input within an active area is evaluated as a non-shifting interaction with the displayed content.

Overlay elements

29 shows a viewport 310 on a content 2900 and overlay it with sliding handle controls like 2910 . 2920 , In addition, a user interface element 2930 shown as an overlay, which consists of the graphical representation of a pie menu. In the first view directs a user input 2940 that starts on a move handle control, a move. In the second view, the viewport is moved. The sliding handle controls have their positions relative to content as it is displayed in the viewport. The move control input has only moved the viewport to the displayed content. Overlayed elements, such as the user interface element 2930 but also other elements such as system messages or system or program dialog boxes are not part of the displayed content and are therefore not affected by the move. The location of the superimposed user interface element 2903 has not changed.

implementation forms

Shift-handle controls can be implemented as part of an application program. Implementations as part of an application program can use system services and system libraries, as well as cross-application frameworks (as well as Trolltech Qt ^TM ) for move, graphical overlay, and other aspects of move-handle controls.

In one embodiment, move-grip controls may be implemented as a service of an operating system such as Windows 7, or as part of an inter-application framework such as Trolltech Qt ^™ , which then provide them for use by application programs. This may allow the background of a viewport to be defined in the same way as the Shift-Handle-Controls layer as it is set to a particular color. In this case, a background with shift grip controls in the form of watermarks visible through the displayed content is provided by the operating system or the cross-application framework. Inputs to the move handle controls are processed by the operating system or by the cross-application framework, while inputs outside the move handle controls are processed by the application program. Move control inputs that are received on the move handle controls are passed to the application program in the form of move events or messages, which correspond to those for movement with other pointer control devices. In this case, there is no need for special adaptation of the application program for the use of sliding handle controls. The function of the move handle controls layer may be limited to drag shift grip controls as a move control input without secondary functions being accessible through the move handle controls and without the possibility of non-displacement Interactions with the displayed content at locations where move-grip controls are placed.

Non-shifting interaction with the displayed content

30 indicates non-shifting interaction by the user with the displayed content at positions outside the move grip controls. The first view shows the beginning of the user input 3010 putting a pointer to the position 3000 outside of shift handle controls as well 3020 is.

In the second view of 30 is this user input 3010 along a path 3030 , in the form of a wavy line which is currently in point 3040 ends, has been continued. In this case, since the currently selected tool for non-scrolling interaction with the displayed content is a freehand drawing tool, this wavy line is displayed as part of the displayed content. The sliding handle controls as well 3020 are not displayed for the duration of this non-moving interaction with the displayed content.

The ability to non-shift interaction with the content displayed outside the move handle controls allows for non-modal control of movement and rapid switching between the non-move interaction with the displayed content and moving the viewport, resulting in An improvement of the human-computer interface and a time saving for the user leads.

A currently selected tool for non-scrolling interaction with the displayed content may be one for each of the non-scrolling interactions with the displayed content that allows for one embodiment, such as the one shown in FIG. A pen tool for freehand drawing, a text tool for adding text to the displayed content, a lasso selection tool to select parts of the displayed content, an eraser tool to delete added content to the displayed content, and a highlighter tool to mark parts of the displayed content.

The selection of tools can be done by mechanisms suitable for the respective implementation, such. B. hierarchical menus based on a central menu bar, toolbars, keyboard shortcuts, pointer gestures and pop-up menus.

The choice of a tool can affect the operation of the sliding handle controls. For example, while a Drawing tool is selected, a pointer setting within the active area of a move-handle control element and a subsequent pointer movement are evaluated as non-shifting interaction with the displayed content, ie as drawing in the displayed content, while the move initiation input additional elements so as a resting of the pointer after pointer preparation requires. While a selection tool is selected, pointer settling within the active area of a move handle control and subsequent pointer movement may be evaluated as a move initiation input and a move control input while the non-move interaction with the displayed content which is superimposed by a shift-grip control, ie, the initiation of selection on a shift-grip control, requires additional elements such as a rest of the pointer after the pointer is released. This difference in the operation of the shift grip controls in response to a selected tool may be indicated to the user by changes in the graphical representation of the move grip controls.

In one embodiment, the shift-grip controls are activated during a predetermined period of time, e.g. One second, after the end of the non-scrolling interaction with the displayed content is not displayed. This allows for continuous user interaction with the displayed content, e.g. For example, the user places a stylus at the end of a word being written and subsequently restarts to write the next word without worrying about initiating a move when that pointer attaches to the active areas of a move handle control falls.

While a freehand drawing tool is shown herein, it should be understood that non-shifting interaction with the displayed content is by no means limited to such. The specific non-shifting interactions that are possible may be determined by the type of content displayed, the program displaying the content, a current program mode relating to non-scrolling interaction with the displayed content, the exact nature of the user input, and other factors , Non-shifting interactions that can be implemented are e.g. Writing digital ink, typing text, creating a graphic object, adding a hyperlink, adding media or other additions to the displayed content, highlighting a portion of the displayed content, tagging a portion of the displayed content, selecting one Objects from the displayed content, cutting and copying the displayed content, inserting an object into the displayed content, deleting or moving an item of the displayed content, changing the appearance of an item of displayed content, e.g. For example, the fuzziness of a text passage that interacts with an active item in the displayed content, such as Hyperlinks, media objects and graphical objects, and the rotation or scaling of the displayed content.

While the viewport outside the move handle controls is generally susceptible to non-shifting interaction by the user with the displayed content, such non-shifting interaction with the displayed content may also be the result of user input occurring on a scrolling user interface. Handle control were received.

In 31 is the user input 3110 within a rectangular viewport 310 that's here at one point 3100 has begun, and is made by means of a pin, a line in the first view in the direction of the sliding handle control element 3120 is drawn.

In the second view has the user input 3110 the sliding handle control 3120 crosses and continues to a point 3130 , Point 3140 is the first to the active area of the sliding handle control 3120 belonging point of the user input 3110 is touched. Both this original pointer event within the active area and the subsequent pointer events within the active area of a move handle control 3120 as part of the user input 3110 , are not evaluated as a move input. The traversal does not result in a move. The pointer events within the active area of the move handle control 3120 will as part of the total user input 3110 which is a non-shifting interaction with the displayed content. In 31 becomes the user input 3110 shown as a freehand drawing, which is displayed as a line in the displayed content, but it may also be any other non-shifting interaction with the displayed content.

32 FIG. 12 shows another case in which a user input within the active area of a move grip control is evaluated as a non-move input resulting in no-move interaction with the displayed content. Here, the shift grip control has an active area 1935 and a graphic representation 1930 , There is currently a pen tool selected for non-scrolling interaction with the displayed content. The user has a number of items the displayed content as well 3120 and 3220 was added, which is done by a quick succession of tappers, that is, a pointer-in which immediately follows a pointer-off, and those at positions like 3120 and 3220 were made. The user input 3200 that is a tipper at the point 3230 is immediately following the previous tipper, ie, without any other intermediate pointer events and within a short period of time. While here, unlike in the 31 case shown, the user input 3200 Nevertheless, it is still determined by similarities in the timing, position and nature of the input itself that the input is connected to these previous inputs by a pointer offset. The user input 3200 is evaluated as a non-shifting interaction with the displayed content, and a point is positioned 3230 added.

At the in 31 and 32 As shown, the feature of the input lies on a move handle control that is evaluated as a non-shift interaction with the displayed content, in its connection with an input outside the move handle control, or more generally in the larger context of the input ,

In one embodiment, an input on a move handle control may be evaluated based on purely inherent features of the input as a non-shift input. Such aspects or actions may e.g. Example: a resting of the pointer for a preset period of time, such. One second, after the initial pointer, pointer settling and subsequent pointer placement within the active area within a preset period of time following an initial pointer, a double tap within the active area of the shift grip control or a pin apply pressure, and / or or angle of attack within a certain range of values for systems equipped to receive such data.

Which of these features are used to determine whether an input is a move input or a non-move input may depend on whether the move is the primary form of interaction with respect to the viewport and the content being displayed Frame of a particular implementation of move-handle controls or in a particular usage situation.

If moving is the primary form of interaction, e.g. For example, if a document is flipped through and a few annotations are made, then it is preferable if the user can make scrolling input quickly and easily. So here z. For example, the shift initiation input may be a simple pointer setup within the active area of a move handle control. In this case, then the non-shift input may require more elements, e.g. B. an additional resting of the pointer, which follows the pointer attachment.

Conversely, in cases where the move is a secondary form of interaction, the shift input may be e.g. For example, when a document is being edited, more elements may be required, while the non-shift input may be more easily structured.

33 shows two different evaluations of a user input 3300 , The user input 3300 starts at the top in one position 3310 within a sliding handle control 3320 ,

In the lower left view was the user input 3300 evaluated as a move input and dragging the pointer from point 3310 after point 3350 has a move of the viewport 310 causes.

In the lower right view was the user input 3300 not evaluated as a shift input. The sliding handle control 3320 is not displayed and the user input 3300 interacts with the displayed content. The user input 3300 showing a pointer movement of 3310 to 3350 includes, since a freehand drawing tool is currently selected for non-scrolling interaction with the displayed content, for adding and displaying a line along the path of dragging the pointer as part of the displayed content.

While in 33 Drawing is shown as interacting with the displayed content, it should be understood that this interaction may be any type of non-shifting interaction with the displayed content.

34 shows another example in which a user input on a shift handle control element is not evaluated as a shift input. The user input 3400 begins with a pointer approach at the point 3420 within the active area 1935 a sliding handle operating element. It immediately travels with a pointer-drag along a path 3410 continued. In one embodiment or status of an embodiment in which scrolling is the primary interaction form, this normally results in moving the viewport along the path 3410 , Due to the characteristics of the path 3410 was determined that the user input 3400 is not a move input and the user input was evaluated as a non-shifting interaction with the displayed content. Since a drawing tool is currently selected for the non-moving interaction with the displayed content, the path is 3410 inserted as a line in the displayed content.

In the user input 3400 the properties used to determine that the input is not a shift input are the frequent changes of direction of the path 3410 after a very short movement of the pointer in each of the directions. This would be highly uncharacteristic for a shift input. It should be understood that other properties of a pointer input that do not match those of ordinary shift inputs can be used for this determination. This can z. Example: a movement of the pointer which would result in no or only a very small total displacement, z. For example, when the movement of the pointer is circular, or a pointer input that has an application pressure or attachment angle that exceeds the normal value range. The parameters for this last determination may depend on the properties of previous user inputs.

In the in 31 . 32 and 34 As shown in an example, an input designated as a non-shift input is evaluated in its entirety as a non-shift input interacting with the displayed content, that is, as if the entire input was made on the displayed content without being Sliding handle control was present.

Another mechanism that can be implemented to enable non-shifting interaction with the displayed content overlaid by a move-grip control is to have a move-handle-controls-suspend input.

In 33 can the user input 3300 in the first view as a move-handle-operator-suspension-input. In one embodiment or status of an embodiment in which the move is the primary interaction form, this may be e.g. As a pointer setting within the active area of a shift-handle control element 3320 followed by a resting of the pointer.

After it has been determined that a user input 3300 is a shift grip control suspension input, the shift grip control on which the input was received is no longer displayed. Subsequent user input within the active area of the suspended move handle control will then act as a non-shifting interaction with the displayed content 3340 evaluated. At a current for the non-moving interaction with the displayed content 3340 The selected freehand drawing tool will drag the pointer from point 3310 after point 3350 to the representation of a line between the two points, which becomes part of the displayed content.

The end of the suspension of the single sliding handle control 3320 which has received the move handle suspensions input may then depend on the same conditions as the end of suppression of the display of move handle controls during non-displacement interaction with the displayed content outside the move handle controls , z. For example, it may end after a preset amount of time has elapsed after the end of the interaction.

A mechanism in which certain inputs on a move-handle operator that have been determined to be no move input are evaluated in their entirety as non-move inputs that interact with the displayed content, and a mechanism for one Suspension of the shift grip controls, in which inputs that are subsequently accepted for suspension as non-shift input that interacts with the displayed content, may be implemented in the same embodiment by shift grip controls.

The mechanisms used to determine whether an input to a move handle control is a move input or a non-move input that interacts with the displayed content may also be used to provide additional types of input to distinguish other functions and modes.

This can be z. For example, if you move the viewport so that the move handle control on which the input is received is centered in the viewport, change to a different zoom level of the viewport, invoking an on-screen control resizes the viewport controlled, and switching the conversion factor for the move.

Sequence of a preferred embodiment

36 shows a viewport 310 on a content 3600 , Both the viewport and the content have coordinate systems. The Coordinate system of the viewport has its origin point at point 3620 while the coordinate system of the content points its origin point 3610 Has. Point 3620 also has a position in the coordinate system of the content, as it applies to all points within the viewport in this representation.

The viewport has a height 3630 and a width 3650 , the content is a height 3640 and a width 3660 , Both the height and the width of the viewport can be expressed in coordinates of the coordinate system of the viewport (VP_H, VP_W) as well as in coordinates of the coordinate system of the content (VP_CH, VP_CW). The same applies to the height and width of the content. The relation between these two expressions, z. B. between VP_CH and VP_H gives a conversion factor A (A = VP_CH / VP_H) ,

37 shows the flow of an embodiment of sliding handle controls. The process begins 3700 with the setting 3710 of the origin point of the viewport on the coordinates (0,0).

Then, a distance G is calculated 3720 by dividing the lower of the height and the width of the view window by 3.

Then the conversion factor A is calculated 3725 ,

Subsequently, the positions of the shift-grip controls on a regular grid are determined with a distance G within the content 3730 ,

All the move handle controls visible at their default positions in the current viewport are displayed 3745 ,

The process is waiting 3750 then a pointer within the viewport.

After a pointer preparation is determined 3760 whether the pointer position is within the active area of a move handle control. If this is not the case then the flow goes with non-shifting interaction (see the description of 38 ) and then returns to displaying the portion of the content within the viewport at the current point of origin of the viewport 3740 ,

If it is determined 3760 in that the pointer position is within the active area of a move handle control, then the move continues to shift interaction (see the description of FIG 39 ) and then returns to displaying the portion of the content within the viewport at the current point of origin of the viewport 3740 ,

39 shows the flow of the non-shifting interaction part of the in 37 shown process. The display of all sliding-handle controls is suppressed 3910 ,

The process then continues to wait for a pointer movement or a pointer offset 3920 ,

When a pointer offset is determined 3930 , then the no-move interaction part ends and the process returns to displaying the portion of the content within the viewport at the current viewport's origin 3740 (please refer 37 ).

If it is determined 3930 in that there is no pointer offset, then digital ink is drawn based on the path of the pointer 3940 ,

The process then returns to waiting for a pointer movement or a pointer offset 3920 ,

It should be understood that, while the drawing of digital ink is described herein as a non-shifting interaction with the displayed content, this is for illustrative purposes only, and other types of non-shifting interaction may also be used.

38 shows the flow for the move interaction part of the in 37 shown process. The shift grip control element PG hit by the pointer is determined 3810 ,

Then, the display of all the shift grip controls other than the shift grip operation element PG1 is suppressed 3815 ,

The current source coordinates of the viewport are stored in VP1 3820 ,

The current pointer position in the coordinate system of the viewport is stored in P1 3825 ,

The process is waiting 3830 then a pointer movement or a pointer offset.

When a pointer offset is determined 3840 , then the move-interact part ends and the process returns to displaying the portion of the content within the viewport at the current origin of the viewport 3740 (please refer 37 ).

If no pointer offset is determined 3840 , then the shift vector DV is calculated between the current pointer position in the coordinate system of the view window and P1 3850 ,

The origin point of the viewport is then set to VP1-A · DV.

The portion of the content that falls into the viewport at its custom viewport origin will then be displayed 3870 ,

All the move handle controls visible at their default positions in the current viewport are displayed 3880 ,

The process then returns to waiting for a pointer or pointer movement 3830 ,

Although the embodiments of systems, methods and other implementations related to shift-grip controls have been described herein with terms specific to structural components and / or methodeological steps, the embodiments defined by the following claims are are not necessarily limited to the specific components or steps of this description. This description is only to give examples of implementations for move-handle controls.

Claims (18)

A computer-implemented non-modal moving method comprising: Displaying part of a content in a viewport on the display, the content being larger than the viewport; Presenting two or more move-grip controls that overlay content in the viewport wherein the move handle controls have predetermined positions relative to the content as displayed in the viewport, and wherein each move handle control has active areas that are responsive to user input and have a graphical representation; Accepting a move initiation input into active area of a first move handle control; Receiving a move control input beginning in the active area of the first or a second move handle control, subsequent to the move initiation input; Shifting the viewport in response to the received shift control input; Receiving a non-shift input on the displayed content outside the active areas of the move grip controls; and Interact with the displayed content in response to the non-shift input. The method of claim 1, wherein the move initiation input includes a pointer attachment in the active area of the first move handle control. The method of claim 1 or 2, wherein the move control input includes pulling the first or second move handle control. The method of one or more of the preceding claims, wherein the shift control input is received on the first shift handle control. The method of claim 4, wherein the move control input includes dragging the first move handle control without an intervening pointer event after the move initiate input. The method of one or more of the preceding claims, wherein the non-shifting interaction with the displayed content includes at least one of writing with digital ink, text input, creating a graphic object, adding a hyperlink, adding media, other additions to the displayed content, highlighting a portion of the displayed content, tagging a portion of the displayed content, selecting an object from the displayed content, cutting and copying the displayed content, inserting an object into the displayed content, deleting or moving one Elements of the displayed content, changing the appearance of an item of displayed content, interacting with an active item in the displayed content, interacting with media objects, interacting with graphical objects, and rotating or scaling the displayed content. The method of one or more of the preceding claims, further comprising presenting the move-grip controls in a predetermined regular pattern that is independent of the displayed content. The method of one or more of the preceding claims, further comprising suppressing the display of the shift-grip controls during a non-shifting interaction with the displayed content. The method of claim 8, further comprising suppressing the display of the two or more move handle controls for a predetermined period of time after the end of a non-shift interaction with the displayed content. The method of one or more of the preceding claims, further comprising Initiating a move that is a kinetic move if it is determined that a move control input ends with a snippet; Receiving one or more additional chips at any position in the viewport during kinetic translation, which one or more additional chips affect the direction and / or speed of the kinetic translation; and Ending the kinetic move in response to a pointer that is not part of another snippet is anywhere in the viewport. The method of one or more of the preceding claims, further comprising suppressing the display of the move grip controls during the move, except for the display of a move grip control on which a move control input is received. The method of one or more of the preceding claims, further comprising altering the graphical representation of the move-grip controls to allow the user to visually indicate at least one of a direction in which the viewport is to be moved, the size of the content relative to to give the size of the viewport, a current operating mode for non-scrolling interaction with the displayed content, and a program status. The method of one or more of the preceding claims, wherein the display and the pointer control device are combined in a touch-sensitive screen. The method of one or more of the preceding claims, further comprising receiving a user input that is neither a move initiate input nor a move control input in the active area of a move handle control; and interacting with the displayed content as a non-shifting input in response to that user input. The method of one or more of the preceding claims, further comprising accepting a shift grip control panel suspension input in the active area of a shift grip control; and interpreting at least one subsequent user input in an active area of this move handle control as a non-displacement input that interacts with the displayed content. The method of claim 15, further comprising suppressing display of the shift grip controls subsequent to the shift grip controls suspension input. A computing device adapted to perform a method according to one or more of claims 1 to 16. A computer program product, in particular stored or signalized on a computer readable medium, which, when loaded into the memory of a computer and executed on a computer, causes the computer to perform a method according to one or more of claims 1 to 16.

Images