TW201324248A - Remote control with first and second sensors - Google Patents

Abstract

An apparatus (1) converts control information comprising a combination of first and second sensor information from a remote control (10) into a control instruction for a device (20). The remote control (10) comprises a first sensor (11) for converting image information into the first sensor information and a second sensor (12) for converting geometrical information into the second sensor information. The apparatus (1) may form part of the remote control (10) or the device (20) or may be located in between. At least two different sensors (11, 12) used in combination in the remote control (10) are a great advantage. The apparatus (1) may make the combination by using the second sensor information for checking, completing, correcting and/or overruling the first sensor information. The first sensor (11) may comprise a camera, the second sensor may comprise a detector for detecting an acceleration, a motion, a movement, an angle, a tilt, an orientation and/or a rotation.

Description

Remote control with first and second sensors

The present invention relates to an apparatus for converting control information from a remote control into a control command of a device.

The invention further relates to a remote control comprising the device, a device comprising the device, a method for converting control information from a remote control into a control command of a device, and a method for performing the method The computer program product of the steps and a medium for storing and including the computer program product.

Examples of such a device are devices with displays and other devices that are remotely controlled.

WO 2004/047011 and US 2010/0157033 disclose an indicator device with a camera.

It is an object of the present invention to provide an improved apparatus. It is a further object of the present invention to provide a remote control including the improved device, a device including the improved device, an improved method, a computer program product, and a medium.

According to a first aspect, there is provided an apparatus for converting control information from a remote control into a control command of a device, the remote control including converting the image information into one of the first sensor information a sensor and a second sensor for converting geometric information into second sensor information, the control information including the first sensor information and the second sensor One of the combinations.

The device may form part of the remote control, or may form part of the device or may be located between the remote control and the device. By providing remote control with at least two different sensors and by causing the device to convert control information from the remote control into a device control command (the control information includes the first from two different sensors) An improved device is created in combination with the second sensor information. This improved device offers more possibilities due to the fact that different sensors are used in combination.

One embodiment of the device is defined by a device configured to effect a combination by using second sensor information to inspect, complete, correct, and/or revoke the first sensor information.

According to a first possibility, the control information includes the first sensor information that has been checked by using the second sensor information. According to a second possibility, the control information includes the first sensor information that has been completed by using the second sensor information. According to a third possibility, the control information includes the first sensor information that has been corrected by using the second sensor information. According to a fourth possibility, the control information includes second sensor information that has cancelled the first sensor information.

An embodiment of the device is defined by: a first sensor comprising a camera; image information comprising a single beacon, two or more beacons, a beacon and a non-beacon And/or an image of the device or a portion of the device; and first sensor information including the single beacon, the two or more beacons, the beacon and the non-beacon, and/or the device Or one of the parts of the device is detected. Can be controlled by a remotely controlled camera A beacon (which may be assisted by a non-beacon (such as a noise source or a reflection) or two or more beacons positioned near the device determines the position of the remote control relative to the device. Alternatively, the position of the remote control relative to the device can be determined by identifying the device or a portion of the device via a remotely controlled camera.

An embodiment of the device is defined by the following: a second sensor comprising an acceleration detector, a motion detector, a motion detector, an angle detector, a tilt detector, and a certain a detector and/or a rotation detector; geometric information comprising acceleration in one of at least one direction, movement in one of the at least one direction, movement in one of the at least one direction, and an angle relative to the at least one direction Inclining with respect to one of at least one direction, oriented with respect to one of the at least one direction, and/or with respect to one of the at least one direction; and second sensor information including the acceleration along the at least one direction, along The movement in the at least one direction, the movement in the at least one direction, the angle relative to the at least one direction, the inclination relative to the at least one direction, the orientation relative to the at least one direction, and/or relative One of the rotations in the at least one direction is detected. It has proven advantageous to combine one of the first sensors in one camera form with one of the second sensors in one of the forms of the detectors defined above.

One embodiment of the device is defined by: a control command comprising one of the index locations on the device, a distance between the remote control and the device, a remote control relative to one of the devices, and a remote control along at least one One of the directions of acceleration, the distal control moves in one of the at least one direction, the distal control moves in one of the at least one direction, the distal control is at an angle relative to the at least one direction, The distal control is tilted relative to one of the at least one direction, the distal control is oriented relative to one of the at least one direction, and/or the distal control is rotated relative to at least one of the directions. This device, together with the remote control and the device, forms a schematic motion control system.

An embodiment of a device is defined by means for providing a motion detection. Since the control information includes a combination of the first and second sensor information, an improved gesture detection has become possible.

One embodiment of the device is defined by a device that provides tilt compensation. Since the control information includes one of the first and second sensor information combinations, an improved tilt compensation has become possible.

According to a second aspect, a remote control comprising a device as defined above is provided.

According to a third aspect, a device comprising the device as defined above is provided.

According to a fourth aspect, there is provided a method of converting control information from a remote control into a control command of a device, the remote control including converting the image information into one of the first sensor information a sensor and including a second sensor for converting geometric information into second sensor information, the method comprising combining one of the first sensor information and the second sensor information The control information is converted into one of the steps of the control command.

One embodiment of the method is defined by: the method further comprising the step of combining one by using the second sensor information to inspect, complete, correct, and/or revoke the first sensor information.

According to a fifth aspect, a method for performing the method as defined above is provided The computer program product of the steps.

According to a sixth aspect, a medium for storing and including a computer program product as defined above is provided.

It can be appreciated that a first sensor can provide only first sensor information, a basic idea being that one of the first and second sensors can provide a combination of the first and second sensor information.

The present invention has solved the problem of providing an improved device. Another advantage is that more choices become possible.

These and other aspects of the present invention will be apparent from the description of the embodiments of the invention.

A trajectory including remote control of one of the first sensors in the form of a camera is shown in FIG. The device, for example, includes a single beacon to be detected by the camera, or the entire device will be detected by the camera as a single spot or spot. Obviously, the remote control does not detect the rapid left and right movements generated by a user as being completely horizontally left and right. A first reason may be that the left and right movements produced by the user are not completely horizontal. A second reason may be that the user does not generate left and right movements but rotates the remote control (eg, around a axis when a handheld device is held relatively straight in front of the device (eg, a line between the handheld device and the device) Rotating the remote control (such as the handheld device) or circumferentially moving around the distal control (e.g., around a plane that is relatively parallel to the front side of one of the devices). The remote control including only the first sensor in the form of the camera cannot distinguish between the two reasons. Similarly, only The distal control including the first sensor in the form of the camera cannot distinguish between a rotational movement and a circumferential movement.

A track comprising one of the remote controls of one of the second sensors in the form of an acceleration detector is shown in FIG. The remote control does not detect the rapid left and right movement generated by a user at all levels as a full horizontal left and right movement. The faster the horizontal movement, the greater the deviation from one of the horizontal movements from the data from the acceleration detector (such as an accelerometer). But for relatively slow movements, the acceleration detector will not show a straight line.

A remote control 10 and a device 20 including a device 1 are shown in FIG. The remote control 10 includes a first sensor 11 and includes a second sensor 12. The first sensor 11 converts the image information into the first sensor information provided to the device 1, and the second sensor 12 converts the geometric information into the second sensor information provided to the device 1. The device 1 converts control information including the combination of the first sensor information and the second sensor information into a control command and supplies the control command to a transmitter 13. The transmitter 13 transmits the control command to one of the receivers 23 in the device 20. The receiver 23 supplies the control command to a device controller 24. Alternatively, one or more controllers may be present between the device 1 and one or more of the sensors 11-12. Further alternatively, the one or more controllers may be located in the sensors 11 to 12 or the device 1, or the device 1 may form part of this (etc.) controller.

A remote control 10 and a device 20 including a device 1 are shown in FIG. The remote control 10 includes a first sensor 11 and includes a second sensor 12. The first sensor 11 can convert the image information into the first sensor information provided to the transmitter 13 via a controller 14 , and the second sensor 12 can be controlled The controller 14 converts the geometric information into second sensor information that is provided to the transmitter 13. Transmitter 13 transmits the first and second sensor information to one of receivers 23 in device 20. The receiver 23 supplies the first and second sensor information to the device 1. The device 1 converts control information including the combination of the first sensor information and the second sensor information into a control command and supplies the control command to a device controller 24. Alternatively, portions of the controller 14 may be located in the sensors 11 to 12. Further alternatively, device controller 24 may be located in device 1 or device 1 may form part of device controller 24.

Preferably, the device 1 combines the first and second sensor information by using the second sensor information to check, complete, correct and/or cancel the first sensor information. In view of the inspection, the information from Figure 2 can be used to check the information from Figure 1. In view of the completion, if the portion of the data from Figure 1 is lost at a certain location or some instant instant, the information from Figure 2 can be used to complete the information from Figure 1. In view of the correction, if the portion of the data from Figure 1 is partially erroneous at a certain location or some instant instant, the information from Figure 2 can be used to correct the information from Figure 1. In view of the revocation, if the information from Figure 1 is completely wrong at a certain location or some instant instants, the information from Figure 2 can be used to revoke the information from Figure 1.

Preferably, the first sensor 11 comprises a camera, and the image information comprises a single beacon, two or more beacons, a beacon and a non-beacon and/or a part of the device 20 or the device 20. An image, and the first sensor information includes the single beacon, the two or more beacons, the beacon and the non-beacon and/or one of the portions of the device 20 or device 20 detected. It should be noted here that there are two or more beacons or one beacon and one non-beacon One of the combinations or one of the parts of the device or the device is more accurately detected, although only the remote control 10 including the first sensor 11 in the form of the camera distinguishes between pure left and right movements with a certain rotation The left and right movements and a pure rotation and a circular movement, but the combination of two different sensors 11 and 12 will also improve the situation.

Preferably, the second sensor 12 includes an acceleration detector, a motion detector, a motion detector, an angle detector, a tilt detector, a direction detector, and/or a a rotation detector, the geometric information comprising an acceleration in at least one direction, movement in one of the at least one direction, movement in one of the at least one direction, an angle with respect to the at least one direction, tilting with respect to at least one of the directions, Oriented relative to one of the at least one direction and/or rotated relative to one of the at least one direction, and the second sensor information includes the acceleration along the at least one direction, the motion along the at least one direction, along the at least one The movement of the direction, the angle relative to the at least one direction, the tilt relative to the at least one direction, the orientation relative to the at least one direction, and/or one of the rotations relative to the at least one direction . It should be noted here that in the case where the first sensor 11 is "unreachable", the second sensor 12 can compensate for this situation.

Preferably, the control command includes an index position on device 20, a distance between remote control 10 and device 20, a position of remote control 10 relative to device 20, an acceleration of distal control 10 in at least one direction, The distal control 10 moves in one of the at least one direction, the distal control 10 moves in one of the at least one direction, the distal control 10 is angled relative to the at least one direction, the distal control 10 is tilted relative to the at least one direction, Remote control 10 relative to at least one One of the orientation and/or distal control 10 is rotated relative to at least one of the directions.

For example, the remote control 10 including the first sensor 11 in the form of a camera translates a spot or spot from a beacon or a more accurate device detection into, for example, one of the devices 20 on the display. One of the cursor positions. A gesture generated by a user holding one of the remote controls 10 causes a sequence of spot samples or spot samples or devices detected on the camera sensor. A gesture can be detected by processing the sequences. However, it is difficult to properly distinguish various gestures when only camera data is used, since the camera cannot have an ideal reference for spatially one of its orientations. In remote control based on one of the cameras, when a single reference point (a single beacon) is used, there is no information related to the orientation of the remote control to make it difficult to detect the difference between the rotation and the circumferential movement. point. However, in remote control based on one of the cameras, when several reference points (several beacons) or more precise device detection are used, problems occur to make it difficult to detect different gestures.

The motion detection based solely on geometric data (such as, for example, acceleration data) is relatively unreliable due to the combination of gravity and external force (the probability of false positives and false negatives is relatively high). The detection of one of the accelerations based on simple horizontal movement is more difficult and results in a detection delay. Typically, delays are introduced by filtering sensor information. This filtration is applied to suppress the influence of one of the noises caused by the external force.

Geometric data (such as, for example, acceleration data) and optical data are combined by combining two different sensors 11-12. More accurate optical trajectory information from the camera can be fully utilized, whereby the acceleration data is used to derive a certain direction. This increases the correct detection rate for the gesture, where the acceleration data facilitates optical detection and vice versa. The combination of optical-based detection and acceleration-based detection also results in a group that is more versatile than the "optical only" and "acceleration only" scenarios. Improvements are also achieved if tilt correction is implemented. Since two or more different sensors 11 to 12 are combined, more different gestures can be detected more accurately.

In summary, a device 1 converts control information from a remote control 10 comprising one of the first and second sensor information into a control command of a device 20. The remote control 10 includes a first sensor 11 for converting image information into the first sensor information and a second sensor 12 for converting geometric information into the second sensor information. . Device 1 may form part of remote control 10 or device 20 or between remote control 10 and device 20. It is very advantageous to use at least two different sensors 11, 12 in combination with the remote control 10. The device 1 can implement the combination by using the second sensor information to inspect, complete, correct, and/or cancel the first sensor information. The first sensor 11 includes a camera, and the second sensor can include a detector to detect an acceleration, a motion, a movement, an angle, a tilt, a direction, and/or a rotation.

The present invention has been illustrated and described in detail herein by reference to the drawings Other variations to the disclosed embodiments can be understood and effected by those skilled in the <RTIgt; In the scope of patent application, the term "include" does not exclude other elements or steps, and the indefinite article "One" does not exclude plural. The mere fact that certain measures are recited in mutually different sub-claims does not indicate that a combination of the Any symbol of a component in the scope of the patent application should not be construed as a limitation.

1‧‧‧ device

10‧‧‧Remote control

11‧‧‧First sensor

12‧‧‧Second sensor

13‧‧‧transmitter

14‧‧‧ Controller

20‧‧‧Devices

23‧‧‧ Receiver

24‧‧‧Device Controller

1 shows a trajectory including a remote control of one of the first sensors in the form of a camera; FIG. 2 shows a trajectory of the remote control including one of the second sensors in the form of an acceleration detector. 3 shows a remote control including one of the devices and shows a device; and FIG. 4 shows a remote control and shows a device including one device.

1‧‧‧ device

10‧‧‧Remote control

11‧‧‧First sensor

12‧‧‧Second sensor

13‧‧‧transmitter

20‧‧‧Devices

23‧‧‧ Receiver

24‧‧‧Device Controller

Claims (13)

A device (1) for converting control information from a remote control (10) into a control command of a device (20), the remote control (10) comprising means for converting image information into a first sense One of the first information detectors (11) and includes a second sensor (12) for converting geometric information into second sensor information, the control information including the first sensor information Combined with one of the second sensor information. The device (1) of claim 1, the device (1) being configured to implement the combination by using the second sensor information to inspect, complete, correct, and/or cancel the first sensor information. The device (1) of claim 1, the first sensor (11) comprising a camera, the image information comprising displaying a single beacon, two or more beacons, a beacon and a non-beacon And/or an image of the device (20) or a portion of the device (20), and the first sensor information includes the single beacon, the two or more beacons, the beacon and the non-trust Marked and/or detected by one of the device (20) or the device (20). The device (1) of claim 1, the second sensor (12) includes an acceleration detector, a motion detector, a motion detector, an angle detector, and a tilt detector. An orientation detector and/or a rotation detector, the geometric information comprising an acceleration in at least one direction, movement in one of the at least one direction, movement in one of the at least one direction, and an angle relative to the at least one direction Inclining with respect to one of at least one direction, oriented with respect to one of the at least one direction, and/or with respect to one of the at least one direction, and the second sensor information includes the acceleration along the at least one direction, along the The movement in at least one direction, the movement in the at least one direction, the angle relative to the at least one direction, the inclination relative to the at least one direction, the orientation relative to the at least one direction, and/or relative to One of the rotations of the at least one direction is detected. The device (1) of claim 1, the control command comprising an indicator position on the device (20), a distance between the remote control (10) and the device (20), and the remote control (10) Relative to the position of the device (20), the distal control (10) is accelerated in at least one direction, the distal control (10) is moved in one of the at least one direction, and the distal control (10) is along at least One of the directions moves, the distal control (10) is at an angle relative to at least one direction, the distal control (10) is tilted relative to at least one direction, and the distal control (10) is relative to at least one direction One of the orientations and/or the distal control (10) rotates relative to one of the at least one direction. The device (1) provides a gesture detection as claimed in claim 1 (1). The device (1) provides tilt compensation as claimed in claim 1 (1). A remote control (10) comprising a device (1) as claimed in claim 1. A device (20) comprising the device (1) of claim 1. A method for converting control information from a remote control (10) into a control command of a device (20), the remote control (10) including for converting image information into first sensor information a first sensor (11) and including a second sensor (12) for converting geometric information into second sensor information, the method comprising including the first sensor information and the The control information combined with one of the second sensor information is converted into one of the steps of the control command. The method of claim 10, the method further comprising the step of implementing the combination by using the second sensor information to check, complete, correct, and/or cancel the first sensor information. A computer program product for performing the steps of the method of claim 10. A medium for storing and including a computer program product as claimed in claim 12.