DE102004021954A1 - A method for controlling a display content of a display area of a display device or control device therefor - Google Patents

Abstract

The invention relates to a method for controlling a display content of a display area (P) of a display device (D), wherein the display device (D) and / or the display area (P) are movable relative to a base (U) in which a sensor movement (see below) a sensor (S) relative to the base (U) is detected, a cursor (C) is displayed as part of the display content in the display area (P) and an image content (X, Y, Z, V) of an image as a component of the display content in the display area (P), the cursor (C) being displaced by a cursor offset (ct) within the display area (P) depending on the sensor movement (see below).

Description

The The invention relates to a method for controlling a display content a display area of a display device with the upper conceptual Features of claim 1 and to a control device with the preamble features of claim 10.

Out EP 907 278 A2 is a pen-shaped mobile phone known. This mobile telephone has a display device with a display area for displaying an image with an image content, wherein the display area is moved as part of the display device relative to a base, ie, a ground, when the mobile phone is moved as such. In addition, the mobile phone has a sensor for detecting sensor movement relative to the base. The sensor consists of a mechanical or optical element for detecting the movement of the sensor relative to the base, for example a tabletop. This allows not only the entry of data via a keyboard but also the input of data by a movement of the mobile phone via a table top.

Also known is a virtual user interface for mobile phones. This consists of a display device in the manner of a projector, which is mounted on the mobile phone. The display area to display the image is from the display device to a Base, for example, a tabletop projected. As a virtual Control means, d. H. a screen marker or an input pointer, a cursor is mapped centrally in the display area and the superimposed on other image content. The image content is for example a road map or another small section of a larger picture. at a movement of the sensor over the base becomes the image content displayed in the display area moved the sensor movement. The cursor is thus used for marking or activating one below this centrally in the display area Object of the image content. This mobile device thus forms a control device with a sensor for detecting a sensor movement, a display device with a display area, wherein the display area and the display device moved relative to the base, a cursor fixed in the center is displayed in the display area, and a calculator for calculating the respective image content of the display area.

Generally are known as well portable computer with a display device for displaying a Image in a display area and with an input device for controlling a cursor, corresponding to the input within of the display area can be adjusted. Also known are Applications where a road map as a detail of a larger picture is displayed in the display area. Will the cursor to the edge of the display area, the image starts relative to the display area to wander at a constant speed to one in the direction the cursor located and not shown image content in the Display area.

nowadays is a cursor control on mobile terminals without one Mouse, without touchscreen pen, Touchpad or similar Input devices only very difficult possible. A substitute Interaction over a joystick is very tedious and time consuming, very unergonomic.

Out Play as well as the control device described above Sensor display device and a centric cursor in the display area An approach is known in which the cursor control and manipulation user objects or image content on a projected and / or relative to the display device shifted user interface with achieved a centric static positioning of the cursor becomes. A disadvantage of such a procedure is the difficult Handling in case of missing pre-training. A manipulation like on the computer with a mouse is similar, but so different that the user is reluctant to get used to it. Another disadvantage is the fixed centric position of the cursor, since only objects of the image content can be manipulated which are moved to the centric position. A use of Objects in the border area of the display area are therefore impossible.

The The object of the invention is to provide a control device a sensor, a display device and a cursor located in the display area is displayed, the display area and / or the display device are moved relative to the base, with a view to improve the handling of the input. Corresponding is intended a method for controlling a display content of a display area a display device, wherein the display device and / or the display area are moved relative to a base and in the Display area a cursor appears to be improved.

These The object is achieved by a method having the features of the patent claim 1 or by a control device with the features of the claim 10 solved.

Accordingly, a method for controlling a display content of a display area of a display device, wherein the display device and / or the display area relative to a Ba In the method, a sensor movement of a sensor relative to the base is detected, a cursor is displayed as part of the display content in the display area and an image content of an image is displayed as part of the display content in the display area, the cursor depending on the sensor movement to offset a cursor offset within the display area.

Advantageous is accordingly a control device with a sensor for detecting a sensor movement relative to a Basis, a display device with a display area for display a picture with a picture content, wherein the display area and / or the display device is moved relative to the base, a cursor which is displayed in the display area and a computing device to calculate the display of the image content and the cursor in the Display area, wherein the computing device is designed, the cursor depending on the sensor movement around a cursor offset within the display area to move.

Of the Term base is to be understood broadly. A base can be, for example a sheet of paper on a tabletop, a tabletop itself or in the case of an optical pickup device as a sensor with connected Image processing also be a camera image. Also to be understood is the term image content or image. It can be any graphic actable content, so for example, a text, a road map or a photo.

While at The prior art in such mobile devices, the cursor in the presentation is arranged centrally and fixed in the display area, wherein the image content relative to a movement of the entire arrangement moves to the display area, according to the most preferred embodiment a movement of the cursor within the representation of the display area instead of. Surprisingly showed up according to first Attempts that thereby the handling of such a system is not to user confusion, but even positive for its support acts. Naturally can be in addition to a cursor movement and the image content of the underlying Image relative to the movement of the overall arrangement and relative to the movement of the display area with the overall arrangement in this change. The latter is particularly advantageous when the cursor in a border area is driven.

advantageous Embodiments are the subject of dependent claims.

Advantageous is in particular a method in which the image content is a section a larger picture trains and depends changed by the sensor movement becomes.

Advantageous is in particular a method in which depends on the cursor offset or a cursor position relatively within the display area of Image content changed, in particular is postponed.

Advantageous is in particular a method in which the image content depends on the sensor movement and / or dependent from the cursor offset relative to the cursor offset and relative to Display area changed, in particular is postponed.

Advantageous is in particular a method in which the image content relative to Cursor and relative to the display area continuously changed, in particular is scrolling continuously when the cursor is in a border area of the display area is arranged or adjacent.

Advantageous is in particular a method in which the cursor offset and / or the image content relative to the display area depending on the sensor movement changed in particular, and in which the speed of the Change depending on a speed or acceleration of the sensor movement and / or dependent from the position of the cursor in the display area.

Advantageous is in particular a method in which the cursor is after a reset command is moved to a basic position.

Advantageous is in particular a method in which as the sensor movement Offset amount, offset speed, and / or offset acceleration of the sensor is detected.

Advantageous is in particular a method in which the cursor offset and / or the offset of the image content within the display area or relative to one factor over the sensor movement performed become.

Advantageous is in particular a control device which is formed as a computer mouse with integrated sensor and integrated display device, as a pickup of a data pin with integrated sensor and integrated display device or as a mobile device with integrated display device and an integrated camera as the sensor and the computing device is designed to perform of such a procedure.

Particularly advantageous are a method and / or a control device, wherein the sensor and the display device with the control device for at least the operating state are firmly connected.

This is possible thus by such a procedure or by such a control device an analogous shift of a cursor by an optical or other similar Sensor on a mobile device without accepting the disadvantages of centric manipulation have to. additionally for non-centric manipulation, the process can also for simultaneous continuous displacement, d. H. scroll, relative to the image content be used for the display area of the display device. there scrolling can also be controlled at a variable speed become. The method is both in projecting systems as well on all other mobile devices with a sensor, possibly also in the form of a camera applicable. In the latter case, the control device in kind, for example a mobile device with camera just held in the air to make a movement relative to the corresponding recorded images as a sensor movement to capture and for moving the cursor and / or moving the image content exploit. Advantageously, the cursor moves within of the display area in the same direction as the entire controller relative to a ground, but with one increased Speed of the cursor to the shifted background of the picture content is advantageous implemented.

One embodiment will be explained in more detail with reference to the drawing. Show it:

1 a base via the pen-like object as a control device with a sensor for detecting a sensor movement relative to the base and with a display device for projecting a display area on a substrate as well as this arrangement relative thereto;

2 a corresponding example with altered image content of the display area compared to 1 ;

3 a mobile device with a sensor for detecting a sensor movement as an exemplary control device;

4 a computer mouse with a display device and a sensor as another exemplary control device;

5 a mobile device with a camera or an optical sensor as a sensor for detecting a sensor movement; and

6 and 7 schematic representations of the displacement of a cursor in the display area according to various embodiments.

1 shows in direct comparison an arrangement at two different times. In the upper or lower illustration, therefore, like reference numerals designate the same objects at an early and at a later time.

shown is a background, for example a tabletop with a leaf Paper as a base U. On this base U, a pen B is put on and manually offset, especially shifted. The pin B forms a Control device B and includes a sensor S for detecting a sensor movement relative to the base U and a display device D with a display area P for displaying an image with a Image content. The display device is offset laterally fixed the controller B attached and projected the image content on a the pin or the control device B adjacent area Base U. Alternative Embodiments can also one in the actual body the control device B have integrated display device D, which a picture over a mirror or the like projected onto the adjacent ground. Even a direct projection is possible, but with a view to an obstruction of the beam path by a finger of the controller holding and leading Hand not particularly preferred.

optional For example, the controller B may also include an antenna A as an example Interface for one Communication with another data processing device or the like.

The Display D projects an image content into the display area P with, for example, individual objects X, Y within the illustrated and pictured display area P. For example, it may be to act a map of a road map, which sideways the display area P further such objects V, Z has.

Besides that is displayed in the display area P, a cursor C as a control. In the illustrated starting position, the cursor C is advantageously centrally in the center of the display area P.

In order to be able to approach a specific object in the displayed image content of the display area with the cursor C, the control device B is displaced over the base U, in particular shifted. The corresponding sensor movement su relative to the base U is detected by the sensor and supplied to a computing device K, which is part of the control device B itself or an external data processing device. Due to the detected sensor movement, a corresponding cursor offset cp of the cursor C within the display area P is calculated by the computing device K. The display device D is then transmitted a respective current position of the cursor C within the display area P. As in the lower part of 1 1, after a movement of the control means B by the offset amount su of the sensor movement su from the central position within the display area P to a position offset by the cursor offset cp in the display area P, the cursor C is shown offset. Relative to the base U, the control device B and, together with this, the display region P have been offset by the offset amount of the sensor movement su and pu, respectively. On the other hand, the cursor C has not been offset by only the same offset amount relative to the base U but by an increased offset amount cu.

Next such a displacement of the cursor C within the display area P dependent on the sensor movement is preferably also the image content of the Display area P adjusted. In the case of the example of a road map becomes a section correspondingly offset in the picture or the overall map displayed. For example, a first object X is shown, which is the first as well as the second time shown is arranged within the picture content of the display area P. A second object Y, which is located near the edge area of the display area P, which was facing the control device B, is after the shift of the controller no longer in the image content contained in the display area P. There is one for that third object Z in the display area P as a new part of the Picture content added. Shown in this embodiment a shift of the image content X, Y, Z in the display area P corresponding to the lateral displacement of the controller over the base U.

2 shows a corresponding arrangement, which is why with respect to the individual components, objects and method steps 1 and the associated description is referenced.

As seen in the picture below 2 As can be seen, the image content, ie, for example, the section of the road map, which is displayed in the display area P, additionally shifted. That is, the displayed image content is not like at 1 shifted by a 1: 1 offset amount relative to the sensor movement su in the display area P, but shifted by a larger amount. A small sensor movement, see below, thereby causes a relatively larger displacement v of the image content X, Y, Z, V against the movement device of the control device B.

In for themselves known manner may alternatively or additionally also a continuous Offset the display in the display area P depending on a sensor movement below, depending from a cursor offset cp and / or depending on a cursor position of the cursor C are performed within the display area P. For example, the positioning of the cursor C may be close to an edge portion or directly on the edge of the display area P as a control signal for a uniformly continuous Move the other picture content opposite to the cursor position and relative to the center of the display area P.

Especially a control is preferred in addition to the type of sensor movement in the implementation in corresponding to be displayed image content and a corresponding to be displayed cursor position in the display area P is considered. Thus, a rapid movement of the control device B with the sensor S in a fast movement of the cursor and / or the image content to be implemented while a slow sensor movement su in a slow apparent Movement of the cursor C and / or the image content within the display area P is implemented. Furthermore may be an acceleration movement of the sensor S as a sensor movement accordingly in an acceleration and thus higher speed of change the display content in the display area P are implemented.

In addition to the formation of such a control device B as a data pin according to 1 is an embodiment in the manner of a mobile device according to 3 particularly preferred. Such a control device B * is designed for example in the form of a conventional mobile radio device with a fixed display device P and a keyboard for entering numbers, letters and characters. In a conventional manner, a microphone M and a loudspeaker L for acoustic communication are also formed on the control device B *. As interfaces for an external communication in addition to a conventional antenna A and a sensor S on or in the housing of the control device B * is arranged. Movements of the control device B * are detected via a base U and converted into the display area P in accordance with the above explanations for displaying an image content and / or a cursor C with the sensor, for example a ball that detects mechanical movements or a sensor that absorbs optical movements. As with the described principle, the position of the cursor C within the display area P is offset depending on the sensor movement of the sensor S on the base U.

4 provides as a further embodiment of a controller B °° a computer mouse with egg The sensor can be designed in the usual way as a mechanical, electro-mechanical or optical sensor. In addition to the sensor and common input keys, this computer mouse has a display D mounted thereon for projecting an image within a display area P onto the surface of the base U over which the computer mouse is slid.

A further application possibility the illustrated principle of the cursor offset cp within the Display area P dependent from the sensor movement su is also advantageous in the case of a mobile device as Control device B ° with a camera as sensor S implemented. With such a camera will an image of, for example, a distant wall or objects captured in the environment. A pivoting u of this mobile device causes continuously taking other frames from the camera become. With the help of a corresponding data processing of the individual image sections If an offset is determined from frame to frame, so that in turn data is detected, which as a sensor movement according to the above embodiments for the controller a cursor in the display area P of the display device of this Control device B ° used can be.

at the described embodiments and further implementable embodiments Such controllers include a built-in display or projection display device. This includes in particular all mobile telephones, PDAs and other mobile devices with display, but also those with a built-in projection screen an image an image content in a display area of the display device can generate next to the controller. In addition, the control devices include in each case a sensor which a displacement of the control device relative to a base, d. H. a background or a background, can capture. Besides the possibility of the use for known sensors, such as those known from computer mice, are also Cameras with preferably variable optics can be used, so with Moving the device on a pad as well a panning opposite a distant background can be detected. Over a detected sensor movement of such a sensor is by means of a Calculating means a picture content relative to the display area of Display device moved. In addition, a cursor becomes dependent on the sensor movement within the display area is displayed and moved.

The Sensor movement or detected by the sensor motion information is to the operating system or the computing device of the control device passed on to it a relative movement of the base to the display device to calculate. The movement of the actual adjustment or displacement is calculated opposite, so that the displayed image content a larger picture, only a small portion of which is shown in the display area is, when moving the controller relative to the ground apparently as stuck on the ground appears, as is the displayed image content by the countermovement, although relative to the display area of the display device, but not relative to Subsoil moves.

Opposite this Implementation of a detected sensor movement in the displacement of Image content is added or constantly the cursor in the display area depends on the sensor movement adjusted. When starting the system, the cursor is advantageously centrically positioned. Such a centric positioning can also by a reset be achieved, for example by pressing a function key at the control device or by lifting off a substrate and a new touchdown on the ground. Expressed mathematically the cursor moves a distance fx dx in X counter and f dy in Y opposite direction, if dx and dy are the spatial coordinates the movement of the entire control device or the sensor relative to the base. The factor f is expediently greater than 1, since in the case of equality to 1 the hitherto known case of centric manipulation is present. First empirical investigations have shown that a factor of f = 4 gives good results. Such a Factor causes a faster movement of the cursor than the Control device relative to the base in the direction in which the Control device is moved. This will cause the cursor can reach the edge of the display area and optionally arranged edge-shaped controls can be used and activated with the help of the cursor. Becomes moved back the controller, the cursor moves in the opposite direction and u. a. reached the other edges become.

According to the most preferred embodiment, the displacement of the cursor within the display area is at different speeds relative to the position within the display area. When the cursor C reaches the edge of the display area P, three processing options are particularly preferred. According to the first possibility, there is an instantaneous change in the relative velocity between the cursor C and an object. The cursor remains within the display area P and the image content changes its speed relative to the image Cursor so that the image content does not change their speed relative to the base or the ground over which the controller is pushed. That is, the objects move at the same speed relative to the controller, whereas the cursor object speed slows down when reaching the edge.

According to the second preferred method variant finds no change in the relative cursor object speed with abrupt changes relative cursor display area speed. This remains the cursor within the display area of the display device, At the same time, it slows down and reaches the edge instantaneously at the edge change the image content their speed relative to the controller and thus relatively to the display area so that the speed of the cursor is relative to the objects of the image content is preserved, causing the objects or the image content jerkily accelerates relative to the display area become.

According to the third preferred method variant finds no change in the relative cursor object speed instead, the relative cursor display speed gently changed becomes. Here, the cursor slows its speed the closer it gets to Edge of the display area comes relative to this. At the same time the objects of the image content or the image content inversely proportional accelerates the deceleration of the cursor relative to the display area. The relative speed of the cursor remains with the image content or to the objects in it constant. This deceleration or acceleration can be performed linearly and / or non-linearly. especially the the last two variants of the method can be used that the functions are applied only at the edge of the display area. Then Can a condition of peripheral controls with simultaneous effective scrolling of the image content through the display area or be connected relative to it.

feasible is such a control device or such a procedure in many ways. Each can be designed accordingly on the base or a pad movable mobile device with a Display device or projection display device. used Any mobile device with an integrated camera can also be used as a sensor.

specially for a Game, which is known as "Mozzies", allows the Procedure for a more effective control of the target cursor in a low tilt, wherein the sensor is preferably formed by a camera is and the control device is held in the room and recorded Images of the camera evaluated for an offset between these become. In this case, there will be an instantaneous change in the relative cursor object speed preferred in which the cursor is within the display area moved and the user interface or base their speed relative to the controller not relatively moved, so that the objects are relative at the same speed move to the controller and the cursor object speed for Edge slowed down jerkily. When using the other process variants would the flies pictured in the game as objects in the image content suddenly with modified Move speed relative to the filmed camera image.

feasible is the procedure on control devices with arbitrarily designed Sensors and display devices. In particular, the shape of the display device can be chosen arbitrarily, for example, with a right-angled or circular outer circumference.

The Application of the method is with constant and / or constantly increased relative Cursor display setup speed can be implemented up to the edge of the display device or the display area. Furthermore is the application of the method with variable or variably increased relative Cursor display area speed to the edge of the display area implemented.

6 shows an example of possible movements of the cursor C within a display area P with a variable higher cursor speed depending on the distance to the center of the display area. Illustrated is the accelerated movement of the image content relative to the cursor and / or the display area.

7 By way of example, in the case of a circular display area P, it illustrates the radial dependence on the speed ratio between the cursor and an object of the image content.

The distance of the cursor between the points A ° and P ° is the planned distance, which results arithmetically from the speed of the cursor v _Cursor for the distance P '- A'. The distance S _{obj of} the exemplary object (A ° - B °) is calculated analogously from the speed v _obj (A '- B') of the object with the relative maximum speed v _max = v _cursor + v _obj . If the point P ° outside the display range is not reached, the cursor must stop at the corresponding edge point N ° and the relative movement of the object to the cursor will be from the distance A ° - B ° by the distance B ° - C ° (= P ° - N °) extended to (A ° - C °). Therefore, the relative movement of the cursor to the objects over the distance N ° - C ° is as large as the planned over P ° - B °.

In the upper section of 7 the speed ratio in the movement of the cursor C is shown in the direction of the edge of the display area P. As the distance from the center of the display area increases, the speed of the cursor decreases from a maximum speed v _max to a minimum speed v _min . An instantaneous velocity v is thus determinable relative to the minimum velocity in the ratio of the distance of the cursor from the edge. The instantaneous velocity thus follows from v = (V _{max -v min} ) * (r-d) / r + v _min . The object velocity v _obj corresponds to the maximum velocity minus the instantaneous velocity of the cursor, ie (A ° - B °) v _obj = v _max - v. The relative speed corresponds to the maximum speed, ie v + v _obj .

Claims (12)

Method for controlling a display content of a display area (P) of a display device (D), wherein the display device (D) and / or the display area (P) are movable relative to a base (U), in which - a sensor movement (see below) of a sensor (S) relative to the base (U) is detected, - a cursor (C) is displayed as part of the display content in the display area (P) and - an image content (X, Y, Z, V) of an image as part of the display content in Display area (P) is displayed, characterized in that - the cursor (C) depending on the sensor movement (see below) is offset by a cursor offset (cp) within the display area (P). The method of claim 1, wherein the image content (X, Y, Z, V) forms a section of a larger image and dependent changed by the sensor movement (see below) becomes. Method according to claim 1 or 2, wherein depending on the cursor offset (cp) or a cursor position relatively within the display area (P) of the image content (X, Y, Z, V) changed, in particular shifted becomes. Method according to any preceding claim, in which the image content (X, Y, Z, V) depends on the sensor movement (see below) and / or depending on the cursor offset (cp) relative to the cursor offset (cp) and relative to the display area (P) changed, in particular is postponed. Method according to one of claims 2-4, wherein the image content (X, Y, Z, V) relative to the cursor (C) and relative to the display area (P) continuously changed, is in particular continuously moved when the cursor (C) a Edge region of the display area (P) is approximated or arranged adjacent is. Method according to one of claims 2-5, wherein the cursor offset (cp) and / or the image content (X, Y, Z, V) relative to the display area (P) depending on the sensor movement (see below) changed, in particular, and in which the speed of the change dependent from a speed or acceleration of the sensor movement and / or dependent from the position of the cursor (C) in the display area (P). Method according to any preceding claim, in which the cursor (C) after a reset command is moved to a basic position. Method according to any preceding claim, in which as the sensor movement (see below) an offset amount, an offset speed and / or an offset acceleration of the sensor (S) is detected. Method according to any preceding claim, in which the cursor offset (cp) and / or the offset of the image content (X, Y, Z, V) within the display area (P) or relative thereto a factor opposite the sensor movement (see below) are performed. Control device (B; B *; B '; B °) With - one Sensor (S) for detecting a sensor movement (see below) relative to a Base (U), - one Display device (D) with a display area (P) for display an image with a picture content (X, Y, Z, V), the display area (P) and / or the display device (D) relative to the base (U) moves becomes, - one Cursor (C) displayed in the display area (P) and - one Calculating means (K) for calculating the display of the image content and the cursor (C) in the display area (P), characterized, that - the Computing (K) is designed, the cursor (C) depending on the sensor movement (see below) by a cursor offset (cp) within the Display area (P). Control device according to claim 10, which is formed is as a computer mouse (B °°) with integrated Sensor (S) and integrated display (D), as a pickup a data pin (B) with integrated sensor (S) and integrated Display device (D) or as a mobile device (B °) with integrated display device (D) and an integrated camera as the sensor (S) and at the the computing device (K) is designed to perform a method according to one of the claims 1-9. Method according to one of claims 1-9 and / or control device according to claim 10 or 11, wherein the sensor (S) and the display device (D) with the control device (B) for at least the operating state are firmly connected.