TWI587174B - Remote controller and associated control method - Google Patents

Description

Remote control device and control method applied thereto

The present invention is a remote control device and a control method applied thereto, particularly a remote control device that determines an operation mode based on a position (orientation) information and a control method applied thereto.

In order to make the user more convenient to operate, many electronic devices provide remote control using the remote control. However, various remote controllers provided in response to different controlled devices, once the number of remote controllers increases, are detrimental to the user, and in order to improve such problems, the conventional technology provides a combination of different remote control functions. Practice.

For example, the conventional technology provides a remote control with aerial mouse function, which integrates the air mouse and infrared remote control function. However, this is only to combine the functions of the two into the same remote control, that is, the two independent functions can be provided by the same remote control body, but the two functions are independent of each other and are not integrated. That is to say, the remote controller with the air mouse function seems to be integrated in the appearance of the architecture, but in operation, the mouse function and the remote control function are independent of each other and are not related.

Therefore, when the user operates the aerial mouse function, the remote control with the air mouse function is only used as an air mouse. The user can simply manipulate the cursor on the screen by the mouse operation mode. The function of the device is almost impossible to play.

On the contrary, when the user performs the function of the remote controller, the remote controller with the air mouse function can be used only for the selection and sound adjustment of the video device like the general infrared remote controller. Even if the TV screen provides the function of cursor operation, the remote controller still cannot control the movement of the cursor.

According to the above description, it can be found that although the conventional technology has developed a remote controller including the function of the air mouse, the control method has not been integrated and needs to be improved.

One aspect of the present invention is a remote control device for controlling a controlled device. The remote control device includes: a remote control body; a sensing module disposed on one side of the remote control body, which is sensed a position (orientation) information of the remote control body; a control module electrically connected to the sensing module, determining an operation mode corresponding to the controlled device according to the position (orientation) information; and a communication interface, electricity Connected to the control module and signally connected to the controlled device, which transmits a control signal corresponding to the operating mode to the controlled device.

According to the above concept, the remote control device of the present invention, wherein the operation mode can be a two-hand operation mode or a one-hand operation mode.

According to the above concept, the remote control device of the present invention, wherein the sensing module senses one of a deflection state, a pitch state, and a roll state of the remote control body according to the position (orientation) information.

According to the above concept, the remote control device of the present invention, wherein the control module adjusts a sensing sensitivity according to the position (orientation) information obtained by the sensing module.

According to the above concept, the remote control device of the present invention, wherein the sensing sensitivity corresponds to an aerial mouse application or a motion sensing remote control application.

Another aspect of the present invention is a control method applied to a remote control device for controlling a controlled device, the control method comprising the steps of: sensing a position (orientation) information and determining an operation mode according thereto And transmitting a control signal corresponding to the operating mode to the controlled device.

According to the above concept, the control method of the present invention, wherein the operation mode can be a two-hand operation mode or a one-hand operation mode.

According to the above concept, the control method of the present invention further includes the step of sensing a deflection state, a pitch state, and a roll state of the remote control device based on the position (orientation) information.

According to the above concept, the control method of the present invention further includes the step of: adjusting a sensing sensitivity according to the position (orientation) information.

According to the above concept, the control method of the present invention, wherein the sensing sensitivity corresponds to an aerial mouse application or a motion sensing remote control application.

The above and other objects, features and advantages of the present invention will become more <RTIgt;

According to the concept of the present invention, the remote controller (remote control device) provided by the following preferred embodiments can simultaneously provide the air mouse function and the motion sensing remote controller function. Even if the user temporarily assumes that it is desired to change the channel selection operation to the cursor movement operation, the remote control device can provide different functional operations in an immediate and rapid manner in response to the user's needs.

Referring to the first figure, which is a preferred embodiment of the present invention, it is a schematic diagram of a remote control device having both an air mouse function and a motion-sensing remote controller. The present invention allows the remote control device 1 to simultaneously have the operational functions of an airborne mouse and a motion-sensing remote control.

In the first figure, the remote control device 1 can be similar in appearance to a general remote control device, i.e., has a remote control body 10 that provides various buttons. These buttons may include: power button, number button used for channel selection, direction button for controlling direction, volume control button, left and right buttons for mouse function when used as an air mouse.

In the preferred embodiment, the remote control device 1 first senses the position (orientation) information (representing position or orientation information) of the remote control body 10, and determines the operation mode that the user desires to use based on the position (orientation) information. Thereafter, the remote control device 1 can transmit a remote control signal corresponding to the operation mode to a controlled device such as a television in response to a different operation mode desired by the user.

The remote control device 1 implemented according to the concept of the present invention can perform the automatic automatic switching or the switching mode to switch between the mouse function mode and the remote control function mode. In order to further explain the concept of the present invention, in the following drawings, the internal function block diagram of the remote control device of the present invention will be first described, and then the method for determining the position (orientation) information of the remote control device 10 by the remote control device 1 will be described.

Please refer to the second figure, which is a functional block diagram of a remote control device according to the present invention. The remote control device here controls the controlled device according to the needs of the user. The remote control device 1 and the controlled device 20 can be used as signal connections by using various types of wireless transmission methods.

In the second figure, in addition to the remote control body 10, the remote control device further includes: a sensing module 102, a control module 101 and a communication interface 104 electrically connected to each other. Generally, the remote control body 10 is a housing having a plurality of buttons, and the sensing module 102, the control module 101, and the communication interface 104 are disposed on the inner side thereof. However, the relative positions of these elements need not be limited.

The purpose of the sensing module 102 is to sense the position (orientation) information of the remote control body 10; after obtaining the position (orientation) information, the control module 101 determines the controlled according to the position (orientation) information of the remote control body 10 The operation mode corresponding to the device 20 is a two-hand operation mode or a one-hand operation mode; and the communication interface 104 is connected to the controlled device 20 by a signal, so its function is to transmit a control signal corresponding to the operation mode to the controlled device 20.

It should be noted that when the function block of the second figure is implemented, the method can be adjusted according to the needs of the application.

For example, the sensing module 102 can include different types of sensors such as an accelerometer, a gyroscope, and an e-Compass.

The control module 101 can be implemented by using a microcontroller (MCU), in which algorithms and operation procedures are set to interpret the motion and posture sensed by the accelerometer, the gyroscope and the electronic compass. Corresponds to the functions of the buttons such as the numeric buttons (#1, #2, #3, ..., etc.) on the remote control panel.

In addition, the communication interface 104 can utilize a radio frequency (Radio Frequency, RF for short), Bluetooth, WiFi, or ZigBee transmission module. The controlled device 20 connected to the communication interface 104 can be a personal computer, a set-top box, a television or other audiovisual facility.

Through the use of the sensing module 102, the remote control device 1 can sense that the user's posture of holding the remote control body 10 is one-handed or two-handed. This is because when the user holds the remote control body 10, the position (orientation) and angle of the remote control body 10 in the user's hand are changed, and corresponding position (orientation) information is generated correspondingly. Accordingly, the control module 101 can determine the operation mode that the user desires to perform on the controlled device 20 according to the position (orientation) information corresponding to the remote control body 10, for example, the user desires to perform the two-hand operation mode or the single Hand operation mode.

When the user chooses to operate the remote control body 10 with one hand or both hands, the manner of the two gripping operations has different motion sensing sensitivities. The reason is that when the user holds the remote control body 10 in the one-hand operation mode, the user mainly controls the wrist joint movement; on the other hand, if the user holds the remote control body 10 in the two-hand operation mode, the user It is based on the coordinated movement of the arm joint with the wrist joint.

For the average user, when the user holds the remote control body 10 in the one-hand operation mode, it is easier to operate than in the two-hand operation mode. Therefore, if the sensing module 102 determines that the user desires to perform the one-hand operation mode according to the position (orientation) information of the remote control body 10, it is necessary to provide a more accurate motion sensing sensitivity than the two-hand operation mode.

Referring to the third diagram (a), which is a schematic diagram of a one-hand grip operation in a remote control device in accordance with a preferred embodiment of the present invention. In this mode of operation, the thumb of the user is pressed against the a1 area of the remote control body 10, and the remaining four fingers are supported by the a2 area of the back of the remote control body 10.

Referring to FIG. 3(b), a schematic diagram of a two-hand grip operation is provided in the remote control device in accordance with a preferred embodiment of the present invention. In this mode of operation, the user's thumb is pressed against the b1 area of the remote control body 10, and the remaining fingers of the hands are supported by the b2 area of the back of the remote control body 10.

That is to say, after the user rotates the remote control body 10 in the third figure (a) by 90 degrees in the clockwise direction, the thumb is respectively placed at the lower left and the lower right corner of the front surface of the remote control body 10, and the user The remaining fingers are located at the upper left and upper right corners of the back of the remote control body 10.

In this mode of operation, the sensing module 102 can be used to sense the state of operation of the button of the remote control body 10. The control signal is generated by the control module 101 corresponding to the operation states of the buttons, and then the control signal corresponding to the button is transmitted to the controlled device 20 through the communication interface 104.

In addition to determining that the remote control body 10 is held by the user with both hands or one hand, according to the concept of the present invention, the sensing module 102 can further determine that the state of the gripping state is the yaw state and the tilt state ( Pitch) or roll state.

When the remote control body 10 is held by the user in the hand, its position (orientation) information may be different depending on whether the user is controlled by the user in a deflected state, a tilted state, or a rolled state. The yaw state, the pitch state, and the tumbling state are all dominated by the hand limb joints at different positions, and the hand limb joints at different positions have different degrees of flexibility. For example, the sensitivity of the arm movement, the closer the tip is more sensitive, such as the finger is more flexible than the palm, the palm is more flexible than the arm.

Further exploration of these three modes of motion reveals that the yaw movement is mainly the coordinated movement of the wrist with the arm joint, and the operational sensitivity is low; the pitching motion is coordinated movement of the arm muscles with the wrist joints, and the operational sensitivity is centered; In other words, when the user's limb performs the tumbling motion, the wrist joint is mainly used for coordinated movement, and the operation sensitivity at this time is high.

As described above, when the user selects to operate the remote control device 1 with two hands or one hand, the remote control body 10 will correspondingly generate different position (orientation) information, and the control module 101 can be based on the position (orientation) of the remote control body 10. The information is used to determine which of the two-hand operation mode or the one-hand operation mode the user employs. Thereafter, different sensing sensitivities are provided depending on the mode of operation, and changes in control signals corresponding to changes in function buttons or position (azimuth) movements on the remote control body 10 are provided.

In other words, when the user operates the remote control device 1, the built-in sensing module 102 can adjust and provide corresponding sensing sensitivity according to the movement operation of the remote control body 10 by various users. In short, the sensing sensitivity is adjusted according to the position (orientation) information of the remote control body 10. According to the operation mode, the corresponding sensing sensitivity configuration is adopted, thereby determining whether the user's limb gymnastics is a one-hand operation mode or a two-hand operation mode, and if the one-hand operation mode is used, further determining that the user wishes to perform is Aerial mouse application or motion sensing remote control application.

For example, when the operation mode is the one-hand operation mode, the sensing module 102 needs to be used to sense the deflection state, the tilt state, the roll state, and the like of the remote control body 10, and use this as a judgment that the user desires to perform cursor control or It is the motion track control. However, if the operation mode is the two-hand operation mode, it is not suitable to use an excessively precise sensing sensitivity, or the position (orientation) information of the remote control body 10 may be incorrect.

Furthermore, such a sensitivity sensing configuration mode will enable the user to provide sensing sensitivity or flexibility of the remote control device with a uniform sense of balance under various motion operations. In order to more clearly illustrate the operation of the remote control device according to the present invention, the following description will be made using the fourth figure.

Please refer to the fourth figure, which is a flow chart of control mode switching according to the position (orientation) information of the remote control body in accordance with a preferred embodiment of the present invention. The following is an example of judging the two-hand operation mode and the one-hand operation mode for the aerial mouse operation or the motion sensing type remote operation. Of course, if the sensing capability of the sensing module 102 is better, and the judgment capability of the control module 101 is improved, other types of operations performed by the user on the remote control body 10 also become a part of the application.

First, the sensing module 102 in the remote control body 10 dynamically senses the current position (orientation) information of the remote control body 10 (step S11), and determines the current operating behavior of the user based on the sensed position (orientation) information. Whether it is a two-hand operation (step S12). When the result of the judgment is the two-hand operation, the operation flow of the operation mode of the two-handed grip is entered (step S13).

On the other hand, if the result of the determination in step S12 is that the one-hand operation mode is entered, the user starts to operate the deflection state, the tilt state, and the roll state of the remote control body 10 according to the position (orientation) information of the remote control body 10 (steps). S14), and determining whether the user performs the aerial mouse operation using the remote control device 1 (step S15).

For one-handed operation, the user may perform the aerial mouse operation or the motion sensing operation function with the remote control device 1. The sensing sensitivity of the two is also different.

When the remote control device 1 is used as an aerial mouse, its purpose is to control the movement of the cursor in the screen, so that the operator's operation feels smooth, and the operator's perceived movement flexibility and stability of the cursor must be consistent.

On the other hand, the motion-sensing remote control function replaces certain specific button functions on the remote control body 10 by gesture gestures or motions. At this time, the gestures or movements have clearer contexts and tracks can follow. Therefore, it is relatively easy to judge the user's movements.

For example, when the motion-sensing remote control function is provided, the one-handed remote control body 10 is swung to the right instead of the right-key (→) function, or the tick-in motion is substituted for the enter key. Features.

As mentioned above, the sensing sensitivity suitable for the operation function of the air mouse is not the same as the flexibility required for the motion sensing remote control function. Therefore, step S15 can determine, according to the position (orientation) change information of the remote control body 10, that the operation that the user desires to use the remote control device 1 is an air mouse or a motion-sensing remote controller. Regardless of the aerial mouse operation function or the motion-sensing remote control operation function, the cursor movement on the screen can be manipulated according to the user's movement of the remote control body 10 (change of position or orientation information) or hand gesture.

If the result of the determination in step S15 is that the air mouse operation is confirmed, the sensing sensitivity of the sensing module 102 is set to the corresponding air mouse operation mode (step S16). If the result of the determination in step S15 is that the user desires to perform the motion-sensing remote control operation, the sensing sensitivity of the sensing module 102 is set to the operation mode of the motion-sensing remote controller (step S20), and then the motion is performed. The related control flow of the inductive remote controller (step S21).

Furthermore, if the user desires to perform an aerial mouse operation, it is further determined whether an immediate operation is required (step S17). If so, the instant cursor sensing is started in response to the setting of the immediate operation (step S18), otherwise the cursor sensing is performed in a dynamic manner (step S19).

According to step S17, the preferred embodiment of the present invention divides the cursor operation mode on the screen into a real time mode and a full time mode. The switching between the immediate mode and the full-time mode can be changed according to the system application or defined by the user. For example, a specific button can be provided on the remote control body 10 and switched according to the user's operation of the particular button.

Therefore, in the immediate mode, the cursor is only controlled by motion or posture when the specific button is pressed. After the specific button is released, the cursor does not move with the movement of the operator, but is positioned on the screen. on.

In addition, in full-time mode, the screen cursor will move at any time following the operator's hand movement or posture changes. The full-time mode can be set by continuously pressing and releasing the specific button twice, and then there is no need to press this specific button.

Of course, the above-mentioned buttons for switching between the instant mode and the full-time mode, and the manner of controlling the buttons are not limited, but can be adjusted according to the needs or operating habits of the user.

As mentioned above, the sensitivity of the sensing function suitable for the airborne mouse function is not the same as the flexibility required for the motion sensing function. Therefore, the remote control device 1 proposed by the present invention can set different sensing sensitivities according to the needs of the application, and then judge various different operating modes and requirements accordingly.

In addition to switching the air mouse operation function and the motion sensing operation function in an automatic sensing manner, the function of the air mouse or the motion sensor type remote controller can also be switched by pressing a specific button. That is, the remote control device 1 of the present invention is dynamically switched by the button to be the mixed operation state of the air mouse and the remote controller, the operation state of the air mouse and the operation state of the motion sensor type remote controller. Certainly, the method of switching the operation states by using the buttons does not need to be limited, and may be sequentially switched by a single button, or may be switched by using a combination of buttons, and details are not described herein again.

Furthermore, the preferred embodiment of the present invention further provides a manner in which the operator can assign various operational gestures to the operational functions. In this definition mode, the specific motion trajectory or the change amount of the position (orientation) information generated by the remote control body 10 in response to the user's operation or the combination thereof may be corresponding to the existing button on the remote control body 10. Features.

For example, first press the motion gesture corresponding function key, such as the OK button or the preset function button, then press the → button (the right button), then press the gesture sensor button (Gesture), and then hold the remote control. The body 10 is swung to the right, and then the OK button is pressed, so that the corresponding settings of the button and the motion posture are completed.

Thereafter, if the sensing module 102 senses that the user is holding the remote control body 10 to the right in the same manner, the control module 101 will correspond to the → key (rightward button). Of course, in order to improve the accuracy of the judgment, the setting process may be repeated several times, that is, when the user presses the posture sensing key, the operation of waving to the right is repeated several times, and the input data of the motion posture is increased as induction. The success of the actual operation after the profit.

In addition, the foregoing setting operation can be combined with a related function software (Application Software, referred to as AP), and is matched with a graphical user interface (Graphic User Interface, referred to as GUI) on the screen, that is, using a set of operations corresponding learning. The software senses the user's operation mode and uses it as a subsequent judgment.

According to another preferred embodiment of the present invention, a keyboard cover is provided on the remote control body 10. When the keyboard cover is opened, the sensing module 102 can determine that the user desires to use the remote control device. The motion-sensing remote control function of 1; when the keyboard cover is closed, the sensing module 102 can determine the user's desire to use the aerial mouse function of the remote control device 1 according to this. That is, the control module 101 will select to perform different modes of operation in response to the opening or closing of the keyboard cover.

Referring to the fifth drawing, which is a schematic diagram of switching the operation mode of the remote control device using the keyboard cover in accordance with a preferred embodiment of the present invention. According to the concept of the present invention, a switch switch (not shown) is provided on the keyboard cover 10b, so that the control module 101 can decide to activate the air mouse function or the motion sensing type according to whether the keyboard cover 10b is turned on or not. Remote control function.

When the keyboard cover 10b is opened, the control module 101 turns off the function of the air mouse to avoid accidental touch during subsequent operations.

When the remote control device 1 is used as a motion-sensing remote controller, the cursor can be automatically positioned at the center of the screen and flashed at the beginning. At this time, the remote control device 1 is in a standby state for moving the cursor by motion control; when the cursor is moved, the cursor can continue to flash display, or change another color and continue to blink, or no longer blink, the function user can Set it yourself.

In a state where the function of the keyboard 10a is activated, the cursor can be converted from the operation cursor on the graphic interface to the character symbol input area into a character symbol input cursor that can be operated by the keyboard 10a, and the operator can perform an input operation such as a character symbol.

According to the concept of the present invention, the functions of the aerial mouse and the remote controller can be integrated, and the remote control device can automatically sense the type of operation performed by the user. Therefore, when the user performs various situations such as one-handed cursor manipulation, one-handed motion sensing operation, and two-hand remote control key operation, the switching between these application functions can be smoother and more intuitive.

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

The components included in the diagram of this case are listed as follows:

1. . . Remote control device

10. . . Remote control body

102. . . Sensing module

101. . . Control module

104. . . Communication interface

20. . . Controlled device

10a. . . keyboard

10b. . . Keyboard cover

A1, a2, b1, b2. . . region

S11~S21. . . step

This case can be obtained through a more in-depth understanding of the following diagrams and descriptions:

The first figure, which is a preferred embodiment of the present invention, is a schematic diagram of the function of the air mouse function and the motion sensor type remote controller at the same time.

The second figure is a functional block diagram of a remote control device proposed in accordance with the teachings of the present invention.

The third diagram (a) is a schematic diagram of a one-hand grip operation in a remote control device in accordance with a preferred embodiment of the present invention.

Figure 3(b) is a schematic illustration of a two-handed grip operation in a remote control device in accordance with a preferred embodiment of the present invention.

The fourth figure is a flow chart for controlling mode switching according to the position (orientation) information of the remote control body in accordance with a preferred embodiment of the present invention.

Figure 5 is a schematic illustration of switching the mode of operation of the remote control device using a keyboard cover in accordance with a preferred embodiment of the present invention.

S11~S21. . . step

Claims (6)

A remote control device for controlling a controlled device, the remote control device comprising: a remote control body; a sensing module comprising an accelerometer, a gyroscope or an electronic compass disposed on one side of the remote control body Sensing a position or orientation information of the remote control body; a control module electrically connected to the sensing module, and determining a one-handed corresponding to the controlled device according to the position or orientation information Or a two-hand operation mode, and then adjusting a sensing sensitivity according to the operation mode; and a communication interface electrically connected to the control module and connected to the controlled device, the system transmitting the single hand or the pair The hand operation mode corresponds to one of the control signals to the controlled device. The remote control device of claim 1, wherein the sensing module senses a deflection state, a pitch state, and a roll state of the remote control body according to the position or orientation information. The remote control device of claim 1, wherein the sensing sensitivity corresponds to an aerial mouse application or a motion sensing remote control application. A control method is applied to a remote control device for controlling a controlled device, the control method comprising the steps of: sensing a position or orientation information by including an accelerometer, a gyroscope or an electronic compass Therefore, a two-hand operation mode or a one-hand operation mode is determined and a sensing sensitivity is adjusted; and a control signal corresponding to the one-hand operation mode or the two-hand operation mode is transmitted to the controlled device. The control method of claim 4, further comprising the step of: sensing a deflection state, a pitch state, and a roll state of the remote control device according to the position or orientation information. The control method of claim 4, wherein the sensing sensitivity corresponds to an aerial mouse application or a motion sensing remote control application.