DE19920162C2 - Method for controlling devices using a remote control - Google Patents

Description

The invention relates to a method for controlling devices by means of a Remote control.

Remote controls for controlling devices, especially of Audiovisual equipment from remote locations has found a wide range for years Application. In the known remote controls to trigger the desired functions knowledge of the arrangement of the buttons on the Remote control required and a constant exchange of views between the controlling device and the remote control is common. They are too Remote controls have been introduced, in which the each Touch point corresponding functionality is displayed on the screen becomes. Such a remote control is for example in US 005327160 A. described. There is a remote control system for a TV set presented, in which the remote control has a touch-sensitive surface that has individual points of contact. The data that the on this Surface arranged individual touch points correspond transmitted to the external device, creating a visible on the screen Menu system is controlled. The operation is such that the touch-sensitive surface with a translatory movement is scanned and when the desired point of contact is reached Touch is ended, causing the touch point corresponding function is performed. After a preset time, in The menu will not touch the touch-sensitive surface hidden.  

However, the handling of this remote control requires unusual ones motor skills from the user, so to activate a Menu item of the thumb on the touch-sensitive surface corresponding point, touching the surface. A direct one Activation of functions via an easy-to-feel button is not direct possible.

DE 37 00 913 A1 describes an arrangement in which on a Display unit shows the function keys located on a keyboard with the touched keys highlighted.

For the exact determination of the duration of a triggered by pressing a button A transmission method is described in CH 682 022, after which "repeat signals" clocked during a long key press are sent and releasing the button triggers a separate one Changeover signal off.

The task is to operate devices using a Allow remote control even in dark surroundings without Previous knowledge of the arrangement and the assigned functions of the Controls on the remote control must have and can be operated ergonomically.

This object is achieved by the features of Claim 1 solved.

In the method according to claim 1 when touching a Control element activated a transmitter unit of the remote control, the clocked Touch signals sends. These touch signals are from a Receiver unit, which is part of a computer system to be controlled Device is received. The computer system turns the transmitted data taking into account the respective operating status  of the device to be controlled, which from the stored status data of the controlling device is determined, the corresponding control commands derived and transmitted to the device to be controlled and on a display shown. Here, when touching a control element up to A defined time interval expires a menu for that of the touched Control corresponding function shown on the display and / or output as an acoustic signal. This menu is in the further description referred to as a simple display. At a Subsequent presses of this control element will assign the Function carried out. Until the end of a defined time interval that Touched control element is not released, the full remote control including all controls and their associated functions are shown, the touched control element is highlighted and / or an acoustic signal for the associated function is output. This menu is in the further Description referred to as an expanded ad. If during the no control element is touched after the defined time interval, takes place after expiry a deactivation of the remote control after a preset time delay and the menu shown on the display disappears.

Advantageous refinements and variants of the method can be found in subclaims 2 to 7.

When you touch a control element on the remote control, in one Computer system in a memory allocated for this control element a counting list is created and the current value is set from 0 to 1. This The value is increased by the value 1 at defined time intervals. At When touching the control element, the current value becomes 0 set. The computer system generates an impulse to provide a corresponding one Signal change of state when there is a change in the value of the Counting list from 0 to 1 or to 0 takes place or when a defined one is reached Worth. If a control element is pressed, the remote control switches on  clocked push signal sent. By this pressure signal in Computer system set the counting list to the value 1; it becomes an impulse generated to signal a corresponding change in state. The Computer system developed taking into account the respective state the device to be controlled and the generated impulses Control commands that are transmitted to the device to be controlled and that The menu corresponding to the respective status is shown on the display and / or output acoustically. With each change of the counting list in the Computer system, a timer is started, which is based on a predefined Signal repetition time is set, the count list in the memory of the corresponding control element is increased by the value 1 if a touch signal from within the set signal repetition time same control element arrives. The count list is set to 0 if no touch signal from within the set signal repetition time same control element arrives.

If the computer system changes the state by changing the current value in the counting list from 0 to 1, this causes this Show the menu in the simple display on the display.

If the computer system changes the state by changing the current value in the counting list is sent to 0, after a predetermined time delay the hiding of the menu on the display if the values in all counting lists have the value 0 or no change in state during the specified time delay Change of the current value in a counting list from 0 to 1 by the Computer system is signaled.

If a specified value is reached in the counting list, this corresponds to one Change of state and the computer system will show the full remote control, in the expanded display, on the display causes.  

All possible for controlling the device are available in the computer system Operating procedures saved; those corresponding to the changes in state Impulses and the current operating state of the device to be controlled, based on the stored status information, determined to get from it derive the graphical user interface for the display and the To develop control commands that are transmitted to the device to be controlled become.

Through the computer system, the video stream of the device to be controlled and the data stream for the graphical user interface is superimposed such that in addition to the current representation (e.g. video image) on the display Menu of the respective operating procedure is displayed.

Because the remote control has discrete controls that on the display including the arrangement of the controls on the Remote control and its function in the respective context as well as the or the "touched" controls and their functions in particular highlighted (e.g. highlighted in color, enlarged or lightened) this remote control is particularly user-friendly. Through this The user receives information about the position of the thumb on display the remote control without looking at the remote control. Changes in position of the thumb on the remote control are indicated by the special representation of the touched control element displayed. To this The desired menu can be displayed on the display Controls can be felt without looking at the remote control. At the same time, the context-sensitive can be in any state of the overall system Function of the controls are displayed.

Since two different menu displays are used, namely the simple display and the expanded display, will be an optimal and universal use of the remote control possible. In the simple display only the function of the control element just touched is displayed. This display is suitable for knowledgeable users, since only a part of the Screen is covered by the display and quick operation  is made possible. In the case of the expanded display, the unskilled User additional information regarding the touched control element displayed. Unused control elements can also be shown as such become. Certain actions can also be triggered when touched be, e.g. B. an acoustic feedback on the function of the touched Control element.

The invention will be explained in more detail below using an exemplary embodiment become. The associated drawings show:

Fig. 1 representation of the remote control and the display in the expanded display;

Fig. 2 screen display in simple display (1st step);

Fig. 3 screen display in simple display (2nd step);

Fig. 4 screen display in expanded display (1st step);

Fig. 5 screen display in expanded display (2nd step);

Fig. 6 Prinzpdarstellung a device for realizing the method;

In this exemplary embodiment, the invention for controlling a device 5 is described, the method being illustrated on the basis of the operation of a TV receiver.

The example is based on the principle representation of a device for implementing the method according to Fig. 6 explains. If an operating element 6 is touched on the remote control 1 , a clocked touch signal 2.1 is sent. If, on the other hand, an operating element 6 is pressed on the remote control 1 , a clocked pressure signal 2.2 is sent. The touch or the pressed signals are evaluated by the computer 3 and pulses are generated as a function of predetermined conditions. The pulses are generated when the touch of an operating element 6 begins, when it is ended, when the duration of the touch exceeds a certain period of time or when an operating element 6 is pressed. For this purpose, a count list is created in the computer 3 in a memory assigned to this control element 6, which lists the number of touch signals 2.1 arriving one after the other for each control element 6 . In the untouched state, the counter value for this control element 6 in the count list is equal to 0. When a touch signal 2.1 arrives, the state changes to "touched". A timer is started (T = 0) and the counter value in the count list is increased by 1 to the value 1. When the next touch signal 2.1 arrives from the same control element within the signal repetition period, which is, for example, 100 ms, the counter is again increased by 1 to the value 2 and the timer is started again (T = 0). If the counter reaches a predetermined value, for example 20, a corresponding pulse is sent. If the timer exceeds the selected signal repetition time of 100 ms, the status changes to "not touched" and the counter in the counting list is set to 0. If a pressed signal arrives in the "touched" state, the counter in the counting list is set to 1 and the timer is started again.

The values in the counting list indicate how long an operating element 6 is touched continuously. If a control element is pressed, resetting the counter to the value 1 indicates that the control element is still being touched (counter not equal to 0), but the exclusive touching of the control element was interrupted by pressing it. To ensure that only one control element 6 is detected as "touched" by the computer system 3 , when a second control element 6 is touched, the current value in the count list for this control element is set to the value 1 and the current value in the count list for Control element 6 touched first is set to 0. The pulses generated depending on the change in the values in the counting list are converted into corresponding control commands. The computer 3 evaluates the count list each time one of its values changes as follows:

• a) a counter changes from 0 to 1, ie an operating element 6 is touched,
• b) a counter changes to 0, ie an operating element 6 is released,
• c) a counter becomes larger than a certain value, e.g. B. 20, ie an operating element 6 is continuously touched for at least 2 s without being pressed,
• d) a counter changes from <1 to 1, ie an operating element 6 is pressed.

In case a), a pulse for the start of touching an operating element 6 is generated and converted into a corresponding control command, which identifies the corresponding operating element 6 on the display 4 as being touched.

In case b) a pulse is generated by the computer 3 , which means the end of the touch and is converted into a corresponding control command, which identifies the corresponding control element 6 on the display 4 as not touched.

In case c), the user touches an operating element 6 for a defined period of time (for example 2 s) without pressing it, a corresponding pulse is generated.

In case d) that the control element 6 is pressed, it is still marked as touched, therefore the corresponding counter is set to 1, that is to say not equal to 0, and a corresponding pulse is generated.

All possible operating procedures for controlling the device 5 are stored in the computer 3 . An operating procedure begins when a control element 6 is touched and ends when the last menu shown is hidden from the display 4 , irrespective of the operating actions or control commands carried out in between. The computer 3 detects the current state of the device 5 to be controlled by evaluating the state information 13 transmitted and stored by the device 5 , it detects the generated pulses and generates the graphical user interface in accordance with the overall state of the system and sends the corresponding control commands 14 to the device 5 . In the computer 3 , the data stream for the graphical user interface is also superimposed on the video stream 15 of the device 5 and transmitted as the resulting video stream 16 to the device 5 to be controlled. The computer 3 also manages two different menu displays, namely the simple display 11.1 , 11.2 and the expanded display 8.1 , 8.2 . The simple display on the display 4 merely shows the graphic description of the function corresponding to the touched control element 6. In the expanded display, on the other hand, the complete remote control including all control elements as well as the graphic description of the associated functions are shown on the display, the touched control element in each case 6 including the graphic description of the associated function is highlighted. When a control element 6 is touched, the generation of the corresponding pulse causes the simple display to be shown on the display 4 . If this control element 6 is touched beyond the defined period of time, a corresponding pulse is generated and the corresponding control command switches to the extended display. This display remains until the operating procedure is finished. By pressing an operating element 6 , the corresponding control command 14 for executing the function associated with the operating element 6 is transmitted to the device 5 to be controlled by generating the corresponding pulse.

The method for controlling a device 5 by means of the remote control 1 is presented using the example of an operating procedure for the image adjustment of the TV set. It is to be shown how the information regarding the touched control element 6 on the remote control 1 is processed by the device in order to support the user. This is described for both variants of the menu display, the simple display and the extended display. It shows the call of the corresponding menu for the TV receiver and especially for the setting of the image parameter brightness.

First, the operating procedure is described in the simple Display because this is also shown first.

A knowledgeable user who knows the assignment of the remote control 1 and thus the specific position of the control element 6 for the image settings on the remote control 1 and immediately touches this control element 6 is first shown on the display 4 the simple display 11.1 according to FIG. 2. This enables him to check that he has touched the correct control element. Is now before the end of the specified period, z. B. 2 s this control element 6 , a next display 11.2 is gem. Fig. 3 shown on the display 4 . If the user touches the control element 6 with the "number 3 ", which is assigned the function "increase in brightness" in this menu, to increase the brightness, the corresponding control element 9 of the brightness controller is shown on the graphic surface in a particularly emphasized manner. Pressing this control element 6 causes a pulse to be generated which triggers a corresponding control command to increase the brightness. The brightness is increased as long as the control element 6 is pressed. The time period during which the brightness is increased corresponds to the number of pressure signals 2.2 sent . After releasing this control element 6 , t, which, for. B. 3 s, the simple display 11.2 is hidden, unless another control element 6 is already touched or is touched during the time delay t.

By touching one or more control elements 6 , the display of the remote control 1 appears together with a description of the functions of the control elements 6 in the expanded display 8.1 according to FIG. Fig. 4. In Fig. 4, the graphical user interface is shown when the "Image Settings" control element is touched, which is particularly emphasized as such. The control elements 10 which are not assigned are shown as such, with a dotted border. The functions of the assigned control elements are clearly indicated by text on the display 4 . If the user moves his thumb over the control elements 6 , the highlighting moves with the control elements 9 that are touched. As a result, the user sees the position of his thumb on the remote control 1 on the screen 4 , a close look at the remote control 1 is not necessary and the navigation of the thumb via the remote control 1 is made possible, the view on the screen 4 remaining constant Changing the view between remote control 1 and screen 4 is not necessary.

Pressing the "Image Settings" control element leads to a new graphical user interface in the expanded display 8.2 acc. Fig. 5. In the expanded display 8.2 , in addition to the image parameters and their setting, the remote control 1 with the functions of the control elements 6 is displayed on the screen 4 , the control element 9 “digit 3 ” just touched being particularly emphasized. The corresponding graphic display "+" of the brightness control is also highlighted. Pressing the control element 6 "number 3 " just touched increases the brightness in accordance with the duration of pressing this control element 6 "number 3 ". After the setting has been ended, that is to say after this control element 6 has been released, the display 8.2 is hidden with a specific time delay τ, for example 3 s. Only a TV picture is again shown on the screen 4 .

An advantageous embodiment can consist in that the remote control 1 is only partially or transparently shown on the display 4 , or only the occupied control elements 6 are displayed.

If an exclusively acoustic representation of the touched or pressed control elements 6 is selected, pure audio devices such as e.g. B. radio, CD player, etc. can be controlled with this remote control 1 . Touching an operating element 6 on the remote control 1 causes an acoustic signal which informs the user of the function of the corresponding operating element 6 .

This remote control 1 can also be used for devices 5 with fixed operating elements, for. B. in a washing machine. If a key is touched, e.g. B. the button for the economy cycle, an acoustic signal - spoken word "economy cycle" - informs about the selected function.

Of course, all industrial processes can also be done with the inventive methods using the described Control facility where the technical parameters are on display are shown and their influence via corresponding Controls are carried out.

Claims (7)

1. Method for controlling devices by means of a remote control with touch-sensitive control elements, wherein when a control element is touched, a transmitter unit of the remote control is activated and touch signals are sent which are received by the reception unit of a computer system of the device to be controlled, which results from this taking into account the respective operating state derives the corresponding control commands, transmits them to the device to be controlled and shows them on a display, the remote control being deactivated and the menu display being hidden on the display after a predetermined time interval in which no control element is actuated, characterized in that
when a control element ( 6 ) is touched until a defined time interval has elapsed, a menu ( 11.1 , 11.2 ) for the function assigned to the touched control element ( 9 ) is shown on the display ( 4 ) (simple display) and / or is output as an acoustic signal ,
after expiration of the defined time interval on the display (4) the full remote control (1) including the operating elements (6) and the associated functions (8.1, 8.2) is presented on the display, wherein the respective touched operating element (9) is highlighted ( extended display) and / or an acoustic signal for the assigned function is output for the touched control element ( 9 ),
When a control element ( 6 ) is subsequently pressed by the remote control ( 1 ), a clocked pressure signal is sent and the assigned function is triggered by the computer system ( 3 ). 2. The method according to claim 1, characterized in that
when a control element ( 6 ) of the remote control ( 1 ) is touched in the computer system, a count list is created in a memory associated with this control element ( 6 ) and the current value is set from 0 to 1 and is increased by the value 1 at defined time intervals,
when touching the control element ( 6 ) the current value is set to 0,
when the value of the counting list changes from 0 to 1 or to 0 or when a predetermined value is reached, the computer system ( 3 ) generates a pulse as a signal for a change in state, which causes the menu display to be updated or hidden,
when a control element ( 6 ) is pressed by the pressed signal ( 2.2 ) from the computer system ( 3 ), the counting list is set to the value 1 and a pulse is generated as a signal for a change of state, which causes the menu display to be updated. 3. The method according to claim 2, characterized in that the current value in the counting list for the first touched control element ( 6 ) is set to 0 by the computer system when touching a second control element ( 6 ). 4. The method according to any one of claims 1 to 3, characterized in that with each change in the counting list in the computer system ( 3 ) a timer is started, which is set to a predetermined signal repetition time, the counting list in the memory of the corresponding control element ( 6 ) the value 1 is increased if a touch signal ( 2.1 ) arrives from the same control element ( 6 ) within the set signal repeat duration and the value is set to 0 if no touch signal ( 2.1 ) arrives from the same control element within the set signal repeat duration. 5. The method according to any one of claims 2 to 4, characterized in that
when the current value in the counting list is changed from 0 to 1 by the computer system ( 3 ) the menu is shown in the simple display ( 11.1 , 11.2 ) on the display ( 4 ),
when the computer system ( 3 ) reaches a defined value in the counting list, the complete remote control is shown in the expanded display ( 8.1 , 8.2 ) on the display ( 4 ),
the computer system ( 3 ), taking into account the respective operating state of the device ( 5 ) to be controlled and the pulse generation effected by means of the remote control in the computer system ( 3 ), as a signal for a change in state, the corresponding control commands ( 14 ) are worked out to the device to be controlled ( 5 ) is transmitted and the menu representation ( 8.1 , 8.2 , 11.1 , 11.2 ) corresponding to the respective operating state is shown on the display ( 4 ), the function assigned to the touched or pressed key also being able to be output acoustically via a loudspeaker ( 12 ),
in the event of a change in state by changing the current value in the counting list to 0 by the computer system ( 3 ), the currently displayed menu display ( 8.1 , 8.2 , 11.1 , 11.2 ) is hidden on the display ( 4 ) after an adjustable time delay τ has elapsed, if the count list has the value 0 or no change in the current value in the count list to 1 is signaled during the duration of the time delay τ. 6. A method according to any one of claims 1 to 5, characterized in that the computer system (3) all (5) possible operating procedures are stored for the control of the device and (3) pulses, as well as by the computer system produced the current operating state based on the saved Status information ( 13 ) of the device to be controlled ( 5 ) are recorded in order to derive therefrom the graphical user interface for the display ( 4 ) and to develop the control commands ( 14 ) and to transmit them to the device ( 5 ) to be controlled. 7. The method according to any one of claims 1 to 6, characterized in that the computer system ( 3 ) of the video stream ( 15 ) of the device to be controlled ( 5 ) and the data stream for the graphic surface are superimposed in such a way to a superimposed video stream ( 16 ) that in addition to the current display of the video signal on the display ( 4 ), the corresponding menu display ( 8.1 , 8.2 , 11.1 , 11.2 ) is shown.