TWI432016B - Intelligent input system and method - Google Patents

Description

Intelligent input system and method

This case relates to an input system and method, and more particularly to a smart input system and method.

In a PC environment, users can easily enter characters and numbers using the keyboard and mouse. However, in a television environment, it is quite difficult for a user to use a normal keyboard or remote to enter options or enter characters and numbers. Especially for some smart TV platforms and digital media players, such as Google TV developed by Google or Apple iTV developed by Apple, there will still be a human-machine interface design. Many inconveniences have been severely criticized by many users.

Taking a conventional television set and its remote control as an example, a remote controller currently on the market usually provides a set of numeric keypads for the user to input numbers, and a set of navigation/direction keyboards. A navigation/direction keypad that includes up/down/left/right buttons for the user to browse and select. As is generally known, when the user makes a selection or input, the user must hold the remote control and switch the content of the option one by one with a numeric button or a navigation/direction button. However, this mode of operation often requires more than dozens of presses. The above buttons can complete the desired setting change or input, which is quite time consuming and inconvenient.

On the other hand, it is not difficult to imagine, because the traditional TV remote control will not A standard QWERTY keyboard is provided. In the future, when using the Internet function provided by a smart TV or a digital media player, if only the up and down keys of the conventional TV remote controller or the navigation/direction keys are used to jump the selection and input. Text can be entered one by one, which will cause a short period of text to take a while to complete the input, not only too time consuming, but also may be completely inoperable for slightly older or younger users. .

Another new type of remote control has a built-in 3D g-sensor, which can detect the movement of the remote control in a three-dimensional space. The operation principle and mode of the remote control are similar to the existing ones. Air mouse. When the user wants to browse the webpage on the smart TV or the digital multimedia player, the remote controller with the built-in three-dimensional gravity sensor can be used to control the cursor displayed on the display screen to input characters and numbers, or Select to display any image or link on the display. However, such a remote controller with a built-in three-dimensional gravity sensor requires the user to accurately move the cursor to the characters, numbers or images that are desired to be input on the display screen, so that the correct input can be made for the unfamiliar computer. There are still many inconveniences for users of related product operations.

Therefore, in order to facilitate the user to input options or text, it is no longer necessary to switch the waiting options one by one with the remote controller, and it is convenient for a large number of users regardless of age and operation experience to easily operate the novel smart television platform and Digital media players, or even browsing the web, it is necessary to develop innovative smart input systems and methods to quickly catch up with the advancement of display technology.

The purpose of the present invention is to provide a smart input system and method for allowing a user to input, select, or even browse a web page or operate any randomly distributed optional object on a display of an electronic device such as a smart television platform or a digital multimedia player. When the graphical user interface is used, the target object can be selected in a smart, fast, and flexible manner to perform input to perform various actions.

In order to achieve the above object, a broader aspect of the present invention provides a smart input system comprising: an electronic device having a display, the display displaying a menu comprising a plurality of objects; and an input device Connected to the electronic device and having an input interface; wherein the input device is directed to a target block covering a target object in the menu, and the target block is dynamically formed due to the direction and position of the input device. The target block includes a central object and a plurality of surrounding objects located around the central object, the target object is one of the central object and the plurality of surrounding objects, and the input interface has a central portion corresponding to the central object And a control area, wherein an input action is performed on the control area of the input interface relative to the central control area according to the position of the target object relative to the central object to select the target object.

In order to achieve the above object, another broad aspect of the present invention provides a smart input method for selecting a target object from a menu displayed on a display of an electronic device. The smart input method includes the following steps. : using an input device to point to a target block covering the target object in the menu, wherein the target block is dynamically formed according to a direction and a position pointed by the input device, and the target block includes a central object and a plurality of surrounding objects located around the central object, and the target object is one of the central object and the plurality of surrounding objects; and setting a central control area on a touch surface of the input device Corresponding to the central object in the target block, and performing an input action on a control area of the touch surface relative to the corresponding position of the central control area according to the position of the target object relative to the central object, Select the target object.

In order to achieve the above object, another broad aspect of the present invention provides a smart input method for selecting a target object from a menu displayed on a display of an electronic device. The smart input method includes the following steps. Using one of the input devices to point the device to the target block covering the target object in the menu, wherein the target block is dynamically formed due to the direction and position pointed by the device; and according to the target object The distribution position in the target block performs an input action on a corresponding control area in one of the touch surfaces of the input device to select the target object.

Some exemplary embodiments embodying the features and advantages of the present invention are described in detail in the following description. It is to be understood that the present invention is capable of various modifications in the various aspects of the present invention, and the description and drawings are intended to be illustrative and not limiting.

In order to allow users to enter, select, and even browse the web on the display of electronic devices such as smart TV platforms or digital media players. Or the operation of any graphical user interface including random distribution object options, the object can be selected in a smart, fast and flexible manner to perform input to perform various actions, and the present invention provides a smart input system and method, wherein The smart input system includes an input device and an electronic device, and the input device can control the screen displayed on the display of the electronic device, and select a target object from the menu of the screen. The input method mainly uses an input device to dynamically point to a target block covering the target object in a menu displayed by the display, and displays the target block in a highlight area, wherein the target block includes a central object and a plurality of surrounding objects located around the central object, the target object being one of the central object and the plurality of surrounding objects, and the input device has a central control area corresponding to the central object; The position of the target object relative to the central object performs an input action at a corresponding position of the input device relative to the central control region to select the target object.

The electronic device can be a smart TV, a digital media player, a computer, a satellite navigator, etc., and each of the electronic devices has a display for displaying a menu containing a plurality of objects.

The input device communicates with the electronic device via a wireless signal. The input device can be a remote controller with a physical button or an input device with a touch surface, such as a smart phone or tablet with a touch screen, wherein the physical button or the touch surface is used as an input device. The interface can be composed of a capacitive touch panel, an optical touch panel or a resistive touch panel. Of course, the touch surface can also be a touch panel without a display screen, such as a touch panel on a notebook computer.

On the other hand, the input device may be a body sensor that senses a human body motion and a gesture, or a sound device that receives a voice command, and inputs the voice sensor or voice control.

The electronic device can receive the pointing signal transmitted by the input device to dynamically form a target block in the menu displayed on the display of the electronic device according to the direction and position pointed by the pointing signal, and highlight the target block. Displaying, and presenting the central object in the target block in a visual manner different from other objects in the target block for the user to refer to as the input location. The electronic device can also receive the selected signal transmitted by the input device to select the target object, wherein the selected signal is generated according to an input action performed on the input device, for example, pressing a physical button at the corresponding position, or touching Click on the control area on the corresponding position on the surface.

The aforementioned "object" can be a virtual button or soft key on the display, a selectable graphical user interface (GUI), an image (icon), a function tab, a photo ( Photo), video, or various links on the web, including hyperlinks.

In addition, the term "pointing" refers to moving a hidden cursor or indicator controlled by an input device dynamically and continuously, and the movement of the pointing position is random, non-preset, selectable, and non-directional, so the hidden cursor is The central object defined by the location of the indicator can be any object on the menu. In other words, the target block is dynamically formed because it should point to the position and direction pointed by the device, and according to the configuration of the central object and surrounding objects. Different target blocks are formed, and therefore, the combination of object options in the target block is not fixed, so it is more flexible. Also, in the case described in the case The term "central" and "surroundings" are relative terms in geometric distribution, and do not limit the "central" to the central position within the block.

Please refer to FIG. 1 , which is a schematic diagram of a smart input system of the present invention. The smart input system includes an input device and an electronic device, wherein the electronic device and the input device are respectively represented by a digital multimedia player and a remote controller. To explain. As shown in FIG. 1, the remote controller 12 is provided with a power switch key 120a; a navigation/direction keyboard group includes an upper button 122a, a lower button 122b, a left button 122c, a right button 122d, and a center button 122e; An enter button 124; a return button 126; and a numeric keypad 128 containing 1, 2, 3, 4, 5, 6, 7, 8, 9, 0, well Buttons such as the word key (#) and the asterisk key (*) can be used as the input of the remote control to control the keyboard group. The remote control 12 is in communication with the digital multimedia player 10 via wireless signals. Digital media player 10 has a display 102 on which a virtual keyboard 102a is displayed. The remote controller 12 has a built-in pointing device (not shown) such as a gyroscope, a G-sensor or accelerometer, a track ball, a joystick, and a touch. Track pad or track screen. The following embodiments will be used in conjunction with the drawings to illustrate the smart input system and method of the present invention, which mainly uses a remote controller with physical buttons for character/digital input.

Please refer to FIG. 1 and FIG. 2A-2G. FIG. 2A-2G is a schematic diagram showing a smart input system and method according to an embodiment of the present invention, which represents a virtual keyboard 102a and a numeric keypad of the remote controller 12 displayed on the display screen. Group 128 control relationship. In the embodiment shown in the 2A-2G diagram, virtual The keyboard 102a is a standard QWERTY keyboard, wherein the target block 20 is framed to select a button corresponding to the numeric keypad group 128 of the remote controller 12, and hidden cursors or indicators on the display screen (not shown in the figure for simplicity of explanation) The button system is set to a central button 201, and the button selected by the target block 20 is highlighted to help the user recognize which of the standard QWERTY keyboards correspond to the numeric keypad of the remote controller. The buttons on group 128, and central button 201 are preferably presented in a more conspicuous visual manner, such as in a different color than the adjacent buttons around central button 201. Of course, the central button 201 can also be presented in the same visual manner as the surrounding adjacent buttons.

In the embodiment shown in FIG. 2A, the letter button "G" is the center button 201 in the target block 20, which corresponds to the "5" button on the numeric keypad group 128 of the remote controller 12, which is also located at the center position (ie, The central control button), so when the user wants to input the letter "G", it is only necessary to press the "5" button on the numeric keypad group 128 of the remote controller 12 to complete the input. In addition, when other keys in the target block 20 are to be input, the relative position of the target button and the central button 201 seen on the display 102 can be intuitively compared to the numeric keypad group 128 of the remote controller 12. The input of the target letter can be completed by performing an input action on the button at the corresponding position of the central "5" button (ie, the surrounding control button).

For example, if the user wants to input the letter "R", he only needs to press the "1" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "T", he only needs to press the remote controller 12 The "2" button on the numeric keypad group 128; if the user wants to input the letter "Y", he only needs to press the "3" button on the numeric keypad group 128 of the remote controller 12; if the user wants Enter the letter "F", just press the "4" button on the numeric keypad group 128 of the remote control 12; if the user wants to enter the letter "H", it is only necessary to press the numeric keypad group 128 of the remote control 12 "6" button; if the user wants to input the letter "C", he only needs to press the "7" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "V", he only needs to press The "8" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "B", the user only needs to press the "9" button on the numeric keypad group 128 of the remote controller 12; if the user wants To enter a space, simply press the "0" button on the numeric keypad group 128 of the remote control.

Additionally, the user can rock the remote control 12 to the left or to the left to move the target block 20 to the left or right of the standard QWERTY keyboard. For example, the user can use a pointing device (not shown) of the remote controller 12, such as a gyroscope, a G-sensor or accelerometer, a track ball, a rocker. (joystick), track pad or track screen, etc., to move the target block 20 to the left and right so that the target block 20 contains the target object, and then press the position of the corresponding target object. The corresponding keys are selected by the numeric keypad group 12 or the corresponding buttons of the navigation/direction keyboard groups 122a-122e.

For example, the user can shake the remote control 12 to the left so that the target block 20 moves to the left of the standard QWERTY keyboard, thereby changing the center button 201 from "G" to "S" as shown in FIG. 2B. In this embodiment, if the user wants to input the letter "Q", he only needs to press the "1" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "W", he only needs to press Press "2" on the numeric keypad group 128 of the lower remote control 12 If the user wants to input the letter "E", he only needs to press the "3" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "A", he only needs to press the remote controller 12 The "4" button on the numeric keypad group 128; if the user wants to input the letter "S", he only needs to press the "5" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter " D", only need to press the "6" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "Z", it is only necessary to press the "8" on the numeric keypad group 128 of the remote controller 12. If the user wants to input the letter "X", he only needs to press the "9" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the control character "↑", he only needs to press the remote control. The "7" button on the numeric keypad group 128 of the device 12; if the user wants to input the control character ".? 123", it is only necessary to press the "0" button on the numeric keypad group 128 of the remote controller 12.

Of course, the user can also shake the remote control 12 to the right, causing the target block 20 to move to the right of the standard QWERTY keyboard, thereby turning the central button 201 into "S" as shown in FIG. 2C. In this embodiment, if the user wants to input the letter "O", he only needs to press the "1" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "P", only the button is required. The "2" button on the numeric keypad group 128 of the remote controller 12; if the user wants to input the letter "K", the user only needs to press the "4" button on the numeric keypad group 128 of the remote controller 12; if the user wants To enter the letter "L", simply press the "5" button on the numeric keypad set 128 of the remote control 12; if the user wants to enter the letter "M", it is only necessary to press the numeric keypad set 128 of the remote control 12 "7" button; if the user wants to input the control character "<x", he only needs to press the "8" button on the numeric keypad group 128 of the remote controller 12. Key; if the user wants to press the enter enter button "return", he only needs to press the "0" button on the numeric keypad group 128 of the remote controller 12.

An advantage of this embodiment is that if the target character that the user wants to input is within the range selected by the target block 20, the user can easily input the target characters without moving the cursor to highlighting everywhere. Press the button to enter individual characters. For example, please refer to FIG. 2B. If the user wants to input the string “DEAD”, the user only needs to continuously press the “6” button, “3” button, “4” on the numeric keypad group 128 of the remote controller 12 continuously. Press the button and the “6” button to complete the input.

Another advantage of this embodiment is that the user has more than one way to enter the same character, and each mode is equally convenient for the user. For example, please refer to FIG. 2A, FIG. 2D and FIG. 2E, wherein the central button 201 of the target block 20 shown in FIG. 2A is “G”, and the central portion of the target block 20 shown in FIG. 2D is shown. The button 201 is "H", and the center button 201 of the target block 20 shown in Fig. 2E is "F". If the user wants to input the letter "T", he can press the "1" button on the numeric keypad group 128 of the remote controller 12 in the configuration of the 2D map; or press the remote control in the setting of FIG. 2A. The "2" button on the numeric keypad set 128 of the device 12; or in the setting of Figure 2E, presses the "3" button on the numeric keypad set 128 of the remote control 12. Therefore, the above three ways can complete the input of the letter "T". As long as the user shakes the remote controller so that the target block 20 contains the letter "T", the corresponding button on the numeric keypad group 128 of the remote controller 12 can be used to input the letter " T".

Therefore, whenever the user wants to input the target character into the target block 20, the user can stop shaking the remote controller 12 and press A button corresponding to the character to be input is placed on the remote controller 12 to input a character. Therefore, the smart input method provided by the present invention can quickly and flexibly complete the input of the target character by dynamically selecting the target block 20 and performing an input action on the corresponding button position on the remote controller 12.

Additionally, the numeric "0" button in the numeric keypad set 128 can be set to not correspond to a virtual standard QWERTY keyboard. Therefore, the highlighted button framed by the target block 20 does not include a button corresponding to the position of the numeric "0" button in the numeric keypad group 128. For example, the button corresponding to the position of the number "0" button in the numeric keypad group 128 within the highlighted button range selected by the target block 20 of FIG. 2A, that is, the blank button, can be set to not be highlighted. Displayed as shown in Figure 2F.

On the other hand, the virtual standard QWERTY keyboard can also be set to correspond to the navigation/direction keyboard groups 122a-122e, and the highlighted button range selected by the target block 20 will include the center button and its up/down/left/ Right adjacent button. For example, as shown in FIG. 2G, if the hidden cursor or the button on the display screen (the central button 201) is the letter “G”, the highlighted button range selected by the target block 20 will contain the letter “G”. "Key, letter "T" key, letter "F" key, letter "H" key and letter "V" key. Therefore, when the letter "G" button, "T" button, "F" button, "H" button or "V" button is to be input, the buttons 122e, 122a, 122c, 122d on the remote controller 12 can be pressed correspondingly or Use the 122b key to enter.

If the user wants to enter characters using the remote control with the air mouse function, the user must move the remote control to move the cursor displayed on the display screen (which can be a point on the screen) to move the cursor Go to the target character you want to enter and press the input button on the remote control. by The accuracy of the user's hand movements is different, and the sensitivity of the remote control with the air mouse function is different. Sometimes it is difficult for the user to accurately move the cursor to the target character that the user wants to input. With the present invention, the user moves the remote control to move the highlighted target block 20 (where the highlighted color can be, but is not limited to, green or red) instead of moving the cursor point. Therefore, the input method of the present invention can greatly reduce the sensitivity of the remote controller and the accuracy of shaking the remote controller.

The foregoing embodiment exemplifies the input method of the character, and the following embodiment will explain the input of the numeral by the smart input method of the present invention.

Please refer to FIG. 1 and FIG. 3A-3L. FIG. 3A-3L is a schematic diagram showing a smart input system and method according to an embodiment of the present invention, which represents a navigation of the virtual keyboard 102a and the remote controller 12 displayed on the display screen. / Alignment of the keyboard groups 122a-122e. In the embodiment shown in FIG. 3A-3L, the virtual keyboard 102a is a numeric keypad, wherein the key system where the hidden cursor or index is located is set as a central button 201, and the target block is highlighted. 20 will select the center button 201 and its up/down/left/right buttons to correspond to the navigation/direction keyboard groups 122a-122e of the remote control 12.

In the embodiment shown in FIG. 3A, the numeric button "1" is the central button 201 in the target block 20, which corresponds to the central button 122e on the navigation/direction keyboard group of the remote controller 12, so when the user wants To enter the number "1", simply press the center button 122e on the navigation/direction keypad of the remote control 12 to complete the input. In addition, if the user wants to input the number "2", he only needs to press the right button 122d of the remote controller 12; if the user wants to lose Entering the number "4", it is only necessary to press the down button 122b of the remote controller 12.

Similarly, the user can shake the remote control 12 to the left or to the left to move the target block 20 to the left or right of the numeric keypad group. As shown in FIG. 3B, the user shakes the remote controller 12 to the right, so that the digital button "2" becomes the center button 201 in the target block 20. If the user wants to input the number "2", only the remote control needs to be pressed. The central button 122e of the device 12; if the user wants to input the number "1", only the left button 122c of the remote controller 12 is required to be pressed; if the user wants to input the number "5", the user only needs to press the lower button of the remote controller 12. The button 122b; if the user wants to input the number "3", it is only necessary to press the right button 122d of the remote controller 12.

As shown in FIG. 3C, the user shakes the remote controller 12 to the right, so that the digital button "3" becomes the center button 201 in the target block 20. If the user wants to input the number "3", only the remote control needs to be pressed. The central button 122e of the device 12; if the user wants to input the number "2", only the left button 122c of the remote controller 12 needs to be pressed; if the user wants to input the number "6", the user only needs to press the lower button of the remote controller 12. Button 122b.

As shown in FIG. 3D, the user shakes the remote controller 12 to the left and below, so that the numeric button "4" becomes the center button 201 in the target block 20. If the user wants to input the number "3", only the user needs to input the number "3". Press the center button 122e of the remote controller 12; if the user wants to input the number "1", the user only needs to press the upper button 122a of the remote controller 12; if the user wants to input the number "5", only the remote controller needs to be pressed. The right button 122d of 12; if the user wants to input the number "7", it is only necessary to press the down button 122b of the remote controller 12.

As shown in FIG. 3E, the user shakes the remote controller 12 to the right so that the numeric button "5" becomes the center button 201 in the target block 20, the user If you want to enter the number "5", you only need to press the center button 122e of the remote control 12; if the user wants to input the number "2", only the upper button 122a of the remote controller 12 needs to be pressed; if the user wants to input For the number "4", only the left button 122c of the remote controller 12 needs to be pressed; if the user wants to input the number "6", the user only needs to press the right button 122d of the remote controller 12; if the user wants to input the number "8" It is only necessary to press the down button 122b of the remote controller 12.

As shown in FIG. 3F, the user shakes the remote controller 12 to the right, so that the number button "6" becomes the center button 201 in the target block 20. If the user wants to input the number "6", only the remote button needs to be pressed. The central button 122e of the device 12; if the user wants to input the number "3", the user only needs to press the upper button 122a of the remote controller 12; if the user wants to input the number "5", he only needs to press the left button of the remote controller 12. The button 122c; if the user wants to input the number "9", it is only necessary to press the down button 122b of the remote controller 12.

As shown in FIG. 3G, the user shakes the remote controller 12 to the left and below, so that the numeric button "7" becomes the center button 201 in the target block 20. If the user wants to input the number "7", only the user needs to input the number "7". Press the center button 122e of the remote controller 12; if the user wants to input the number "4", the user only needs to press the upper button 122a of the remote controller 12; if the user wants to input the number "8", only the remote controller needs to be pressed. The right button 122d of 12; if the user wants to input the special character "+*#", it is only necessary to press the down button 122b of the remote controller 12.

As shown in FIG. 3H, the user shakes the remote controller 12 to the right, so that the digital button "8" becomes the center button 201 in the target block 20. If the user wants to input the number "8", only the remote control needs to be pressed. The central button 122e of the device 12; if the user wants to input the number "5", only the upper button 122a of the remote controller 12 needs to be pressed; if the user wants to input the number "7", only the user needs to input the number "7" Press the left button 122c of the remote controller 12; if the user wants to input the number "9", only the right button 122d of the remote controller 12 is required; if the user wants to input the number "0", only the remote controller needs to be pressed. The lower button 122b of 12.

As shown in FIG. 3I, the user shakes the remote controller 12 to the right, so that the numeric button "9" becomes the center button 201 in the target block 20. If the user wants to input the number "9", only the remote control needs to be pressed. The central button 122e of the device 12; if the user wants to input the number "6", only the upper button 122a of the remote controller 12 is required to be pressed; if the user wants to input the number "8", the user only needs to press the left button of the remote controller 12. The button 122c; if the user wants to input the special character "<x", only the lower button 122b of the remote controller needs to be pressed.

As shown in FIG. 3J, the user shakes the remote controller 12 to the left and below, so that the numeric button “0” becomes the central button 201 in the target block 20. If the user wants to input the number “0”, only the user needs to input the number “0”. Press the center button 122e of the remote controller 12; if the user wants to input the number "8", the user only needs to press the upper button 122a of the remote controller; if the user wants to input the special character "+*#", it only needs to press The left button 122c of the lower remote controller 12; if the user wants to input the special character "<x", it is only necessary to press the right button 122d of the remote controller.

As shown in FIG. 3K, the user shakes the remote controller 12 to the left, so that the special character button "+*#" becomes the center button 201 in the target block 20, and the user wants to input the special character "+" *#", only need to press the center button 122e of the remote controller 12; if the user wants to input the number "7", the user only needs to press the upper button 122a of the remote controller 12; if the user wants to input the number "0", It is only necessary to press the right button 122d of the remote controller 12.

As shown in FIG. 3L, the user shakes the remote controller 12 to the right, so that The special character button "<x" becomes the central button 201 in the target block 20. If the user wants to input the special character "<x", the user only needs to press the center button 122e of the remote controller 12; if the user wants To enter the number "0", it is only necessary to press the left button 122c of the remote controller 12; if the user wants to input the number "9", it is only necessary to press the upper button 122a of the remote controller 12.

Therefore, the user can conveniently select the numeric keypad group on the display screen by using the navigation/direction keyboard group 122a-122e of the remote controller 12 under the condition that the sensitivity of the remote controller and the accuracy of the shaking remote controller are reduced. type in data.

Referring to FIG. 1 and FIG. 4A-4D, FIG. 4A-4D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention, which represents a virtual keyboard 102a displayed on the display screen and the remote controller 12 of the present invention. The horizontal relationship is arranged in a contrast relationship of the combination of the three buttons of the straight line. In the present embodiment, the virtual keyboard 102a is not a standard QWERTY keyboard as shown in FIG. 2A-2G, but a virtual keyboard having a different structure and applied to a smart phone or tablet. As shown, in the present embodiment, the key combinations in the remote controller 12 for controlling the keyboard input of the virtual keyboard 102a are three buttons horizontally arranged in a line in the remote controller 12, such as a navigation/direction keyboard group. 122a-122e is a combination of three buttons arranged horizontally in a straight line, for example, a combination of a left button 122c, a center button 122e, and a right button 122d. In the virtual keyboard 102a displayed on the screen of the display 102, the button of the hidden cursor or the index cursor is set as a central button 201, and the highlighted target block 20 will select the center button 201 and its left/right. button. For simplicity of explanation, this embodiment will be guided/direction The combination of the three buttons horizontally arranged in a line in the keyboard groups 122a-122e, that is, the combination of the left button 122c, the center button 122e and the right button 122d is illustrated as an example.

As shown in Fig. 4A, the numeric button "2" is the center button 201 in the target block 20, so that the user can input the number "2" by pressing the center button 122e of the remote controller. In addition, adjacent buttons on the same level as the button "2", that is, the button "1" and the button "3" are highlighted, so the user can press the left button 122c of the remote controller to input The number "1", and pressing the right button 122d of the remote control, can input the number "3".

As shown in Fig. 4B, the semicolon punctuation ";" is the center button 201 in the target block 20, so that the user can input the semicolon punctuation ";" by pressing the center button 122e of the remote controller. In addition, the adjacent keys on the same level as the semicolon punctuation ";", that is, the colon punctuation ":" and the bracket punctuation "(" are highlighted, so the user simply presses the remote control. The left button 122c of the device can input the colon punctuation mark ":", and pressing the right button 122d of the remote controller can input the parenthesis punctuation mark "(".

As shown in Fig. 4C, the blank key "space" is the central button 201 in the target block 20, so that the user can input a space by pressing the center button 122e of the remote controller. In addition, the adjacent keys on the same level as the blank key "space", that is, the keyboard mode switching key "ABC" and the return key "return" are highlighted, so the user simply presses the remote control The left button 122c can input the keyboard mode switching key "ABC", and pressing the right button 122d of the remote controller can input the enter key "return".

As shown in Fig. 4D, the apostrophe punctuation "'" is in the target block 20. The central button 201 allows the user to enter the apostrophe punctuation "'" by pressing the center button 122e of the remote control. In addition, the adjacent keys on the same level as the apostrophe punctuation "'", that is, the exclamation mark punctuation mark "!" and the control symbol "<x" are highlighted, so the user simply presses the remote control. The left button 122c of the device can input the exclamation mark punctuation mark "!", and the control button "<x" can be input by pressing the right button 122d of the remote controller.

Referring to FIG. 1 and FIG. 5A-5D, FIG. 5A-5D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention, which represents a virtual keyboard 102a displayed on the display screen and the remote controller 12 of the present invention. The contrast relationship of the key combinations consisting of three buttons arranged vertically in a straight line. In the present embodiment, the virtual keyboard 102a is not a standard QWERTY keyboard as shown in FIG. 2A-2G, but a virtual keyboard having a different structure and applied to a smart phone or tablet. As shown, in the present embodiment, the keys in the remote controller 12 for controlling the keyboard input of the virtual keyboard 102a are combined into three buttons vertically arranged in a line in the remote controller 12, such as a navigation/direction keyboard group. 122a-122e is a combination of three buttons vertically arranged in a straight line, for example, a combination of a button 122a, a center button 122e, and a button 122b. In the virtual keyboard 102a displayed on the screen of the display 102, the button of the hidden cursor or the index cursor is set as a central button 201, and the highlighted target block 20 selects the central button 201 and its up/down. button. For simplification of the description, the present embodiment will be arranged in a navigation/direction keyboard group 122a-122e with three buttons arranged vertically in a straight line, that is, a button composed of an upper button 122a, a center button 122e, and a lower button 122b. The combination is illustrated as an example.

As shown in Fig. 5A, the hyphen punctuation mark "-" is the center button 201 in the target block 20, so that the user can input the hyphen punctuation mark "-" by pressing the center button 122e of the remote controller. In addition, the adjacent keys on the same vertical plane as the hyphen punctuation "-", that is, the bracket punctuation marks "[" and the keyboard mode switching key "123" are highlighted, so the user simply presses The upper button 122a of the remote controller can input the parenthesis punctuation mark "[", and the lower keyboard button 122b of the remote controller can be pressed to input the keyboard mode switching key "123".

As shown in Fig. 5B, the comma punctuation mark "," is the center button 201 in the target block 20, so that the user can input the comma punctuation mark "," by pressing the center button 122e of the remote controller. In addition, adjacent keys on the same vertical plane as the comma punctuation ",", that is, the tilde punctuation mark "-" and the blank key "space" are highlighted, so the user simply presses the remote control The upper button 122a can input the tilde punctuation mark "-", and the lower button 122b of the remote controller can be pressed to input a space.

As shown in Fig. 5C, the euro currency symbol "€" is the central button 201 in the target block 20, so the user can input the euro currency symbol "€" by pressing the center button 122e of the remote controller. In addition, the adjacent keys on the same vertical plane as the Euro currency symbol "€", that is, the off-character key "^" and the exclamation point punctuation mark "!" are highlighted, so the user simply presses the remote control. The upper button 122a of the device can input the character "^", and the lower button 122b of the remote controller can be pressed to input the exclamation mark "!".

As shown in FIG. 5D, the special character "<x" is the central button 201 in the target block 20, so the user simply presses the center button of the remote controller. 122e can input the special character "<x". In addition, the adjacent keys on the same vertical plane as the special character "<x", that is, the interval punctuation mark "‧" and the enter key "return" are highlighted, so the user simply presses The upper button 122a of the remote controller can input the interval number punctuation mark "‧", and the lower button 122b of the remote controller can be pressed to input the enter key "return".

Referring to FIG. 1 and FIG. 6A-6D, FIG. 6A-6D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention, which represents a virtual keyboard 102a displayed on the display screen and the remote controller 12 of the present invention. The navigation/direction keyboard group 122a-122e has a correspondence relationship between the left button 122c, the center button 122e, and the right button 122d. In this embodiment, the virtual keyboard 102a is a digital keyboard, and the left button 122c, the center button 122e, and the right button 122d are horizontally arranged in a horizontal direction of the navigation/direction keyboard groups 122a-122e of the remote controller 12. The keyboard input of the virtual keyboard 102a is controlled. In the virtual keyboard 102a displayed on the screen of the display 102, the button of the hidden cursor or the index cursor is set as a central button 201, and the highlighted target block 20 will select the central button 201 and its left/right buttons. .

As shown in FIG. 6A, when the target block 20 selects the first row of the digital keyboard, the user can press the center button 122e of the remote controller to input the number "2", and press the left button 122c of the remote controller. The number "1" can be entered, and the number "3" can be entered by pressing the right button 122d of the remote control. As shown in FIG. 6B, when the target block 20 selects the second row of the numeric keypad, the user can press the center button 122e of the remote controller to input the number "5" and press the left button 122c of the remote controller. The number "4" can be entered, and the number "6" can be entered by pressing the right button 122d of the remote control. Such as As shown in FIG. 6C, when the target block 20 selects the third row of the digital keypad, the user can press the center button 122e of the remote controller to input the number "8", and press the left button 122c of the remote controller. The number "7" can be entered, and the number "9" can be entered by pressing the right button 122d of the remote control. As shown in FIG. 6D, when the target block 20 selects the fourth row of the numeric keypad, the user can press the center button 122e of the remote controller to input the number “0” and press the left button 122c of the remote controller. You can enter the special character "+*#" and press the right button 122d of the remote control to enter the special character "<x".

In combination with the embodiments shown in the above FIGS. 1-6D, the present invention provides a smart input system including an electronic device having a virtual keyboard displayed thereon, and an input device such as a remote controller having physical buttons. The system is operatively coupled to the electronic device and has an input control keyboard set for generating a hidden cursor or indicator on the display screen of the display to control the input of the virtual keyboard in response to the user's operation. The key of the hidden cursor or indicator on the virtual keyboard is set as a central button, which is set to be compared with a button located at the center of the input control keyboard group, and according to the input control keyboard group configuration, the central button and The button that is compared with the button of the input control keyboard group is set as a target block that is highlighted, and when the remote controller is shaken, the target block also moves in the direction in which the remote controller moves, thereby allowing The user uses the input control keyboard group of the remote controller to type a button in the target block to input characters and/or numbers. Therefore, the present invention allows the user to input characters and/or numbers under the condition that the sensitivity of the remote controller and the accuracy of shaking the remote controller are low.

The foregoing embodiments are primarily illustrative of the use of physical keys on an input device to input characters or numbers to a virtual keyboard on a display. The following embodiments illustrate another aspect of the smart input system and method of the present invention. As shown in FIG. 7, the remote control 12 having physical buttons is used to display the multimedia content 102b displayed on the display 102. For example, a drop-down menu, a desktop user interface or a graphical user interface (GUI), an image (icon), a function tab, a photo, or a video (video) displayed in the editing software. Make selections and inputs.

Please refer to FIG. 7 and FIG. 8A-8C. FIG. 8A-8C is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In the present embodiment, the multimedia content 102b displayed on the display 10 is a pull-down menu, and the option to hide the cursor or indicator (not shown in the figure for simplicity of explanation) is set to a central option 201. And the option selected by the target block 20 is highlighted to help the user identify which option corresponds to the five-way navigation/direction keyboard group 122a-122e or the numeric keypad group 128 of the remote control. Which of the 3's number keys are pressed.

Similarly, in the present embodiment, the user can also use the pointing device of the remote controller 12 to horizontally move the target block 20 to the left and right, and then press the navigation/direction keyboard group 122a of the five directions- 122e to select an option. As shown in Figure 8A, the option to hide the cursor or indicator, ie the central option 201, is the option "Resources". In this case, if the user wants to select the option "Tutorials", just press the left button 122c; if the user wants to select the option "Resources", just press The central button 122e; if the user wants to select the option "About Us", it is only necessary to press the right button 122d.

When the menu is pulled down, the user can use the pointing device of the remote control 128 to vertically move the target block 20 up and down, and then press the five-way navigation/direction keyboard set 122a-122e to select an option. As shown in Figure 8B, the option to hide the cursor or indicator, ie the central option 201, is the option "Sub Nav Link 3". In this case, if the user wants to select the option "Sub Nav Link 2", he only needs to press the upper button 122a; if the user wants to select the option "Sub Nav Link 3", he only needs to press the center button 122e; Select the option "Sub Nav Link 4" and simply press the down button 122b.

The above configuration can also be applied to multi-level pull-down menus. As shown in Fig. 8C, if the user wants to select the option "A really long label..." of the multi-level pull-down menu, just press the upper button 122a; if the user wants to select the option "Swimming" of the multi-level pull-down menu, The central button 122e is pressed; if the user wants to select the option "Tennis" of the multi-level pull-down menu, simply press the down button 122b.

In other embodiments, the five-way navigation/direction keyboard set 122a-122e of the remote control 12 can be implemented on a 3 x 3 numeric keypad, which is comprised of the numeric keypad set 128. 1, 2, 3, 4, 5, 6, 7, 8, 9 and other numeric buttons, and the digital buttons 1, 2, 3 are located at the top of the 3 × 3 numeric keypad; the digital buttons 4, 5, 6 are located The middle row of the 3×3 numeric keypad; the numeric buttons 7, 8, and 9 are located at the bottom of the 3×3 numeric keypad. Therefore, the numeric keypad 2 of the 3×3 numeric keypad is mapped to the upper button 122a of the navigation/direction keyboard group 122a-122e of the five directions; The numeric keypad 4 of the 3x3 numeric keypad is mapped to the left button 122c of the navigation/direction keyboard group 122a-122e of the five directions; the numeric keypad 5 of the numeric keypad of the 3x3 is mapped to the navigation/direction of the five directions The central button 122e of the keyboard group 122a-122e; the numeric button 6 of the 3x3 numeric keypad is mapped to the right button 122d of the navigation/directional keyboard group 122a-122e of the five directions; the numeric button 8 of the numeric keypad of the 3x3 The lower button 122b of the navigation/direction keyboard group 122a-122e is mapped to the five directions.

An advantage of this embodiment is that the graphical user interface of each layer can be easily navigated even for people who do not understand the technology. In addition, when the user moves the remote controller 12, the target block 20 containing a plurality of object options (where the highlighted color may be, but not limited to, green or red) is moved instead of moving the cursor point. Therefore, the navigation method of the present invention can greatly reduce the accuracy of the sensitivity of the remote controller.

Please refer to FIG. 7 and FIG. 9A-9E. FIG. 9A-9E is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the multimedia content 102b displayed on the display 10 is a desktop arrangement, and the image system in which the hidden cursor or index is located is set as a central image 201, and the image selected by the target block 20 is Highlighting to help the user identify which image would correspond to which of the five-way navigation/direction keyboard sets 122a-122e of the remote control 12 or the 3x3 number keys in the numeric keypad set 128. As shown in Fig. 9A, the image in which the cursor or index is hidden, that is, the central image 201, is the image "MLB.TV". In this case, if the user wants to select the image "MLB.TV", he only needs to press the center button 122e; if the user wants to select the image "TV Shows", he only needs to press the button 122a; if the user wants to select Image "YouTube", just press and press The key 122b; if the user wants to select the image "NETFLIX", just press the left button 122c; if the user wants to select the image "NBA Game Time", just press the right button 122d.

Another example is the graphical user interface of Apple's iPad. The apparatus for guiding multimedia content using the remote controller of this embodiment can be applied to the desktop layout of the iPad. Figure 9B shows the desktop layout of the iPad, and the image in which the hidden cursor or indicator is located is set to a central image 201. In addition, the image framed by the target block 20 is highlighted to help the user identify which image corresponds to which of the 3 x 3 digital keyboard sets (number keys 1-9) of the remote control. As shown in Fig. 9B, the image in which the cursor or index is hidden, that is, the central image 201, is an image of the "Twitterrific" application. The images mapped to the numeric buttons 1, 2, and 3 are the images of the "News Pro" application, the images of the "NOVA" application, and the images of the "Photogene" application; mapped to the numeric buttons 4, 5 , 6 images, images of the "Sketch Book" application, images of the "Twitterrific" application, images of the "Zillow.com" application; images mapped to the numeric buttons 7, 8, 9 Images for the "Photos" app, images for the "iPod" app, and images for the "Settings" app. In this example, the images of the "News Pro", "NOVA", "Photogene", "Sketch Book", "Twitterrific", "Zillow.com" applications belong to the same functional group (ie the application on the iPad desktop) The images of the "Photos", "iPod", and "Settings" applications belong to another function group (the application on the iPad dock). Thus, in this example, images of different functional groups (application collections) can be highlighted at the same time for navigation and selection.

In addition, when the iPad is operated by touch, in order to rotate or scroll the page of the iPad to the left or right, the user can slide to the left or right on the touch screen with a single finger. When the iPad is operated in a remote control mode in this embodiment, the user only needs to move the target block 20 upward, downward, left or right to rotate the page. That is, moving the target block 20 to the function key combination or the edge of the display frame will scroll the page toward the edge. For example, in the present embodiment, when the target block 20 is moved to the right, the position of the center image 201 is shifted right from the image of the "Twitterrific" application to the image of the "Zillow.com" application. At this time, when the target block 20 continues to move to the right, it will scroll to the right to the next page.

See Figure 9C, which shows the desktop layout of Apple's eBook reading software iBooks. The apparatus for guiding multimedia content using the remote controller in this embodiment can also be applied to the desktop layout of the e-book reading software iBooks. In Fig. 9C, the image in which the hidden cursor or index is located is set as a central image 201. In addition, the image framed by the target block 20 is highlighted to help the user identify which image corresponds to which of the 3 x 3 digital keyboard sets (number keys 1-9) of the remote control. As shown in FIG. 9C, the images mapped to the numeric buttons 1, 2, and 3 are respectively the image 202a, the image 202b, and the image 202c; and the images mapped to the numeric buttons 4, 5, and 6 are respectively shown. Image 202d, image 201, image 202e; images mapped to numeric buttons 7, 8, 9 are image 202f, image 202g, and image 202h, respectively.

See Figure 9D for a desktop layout of a Linux-based Ubuntu operating system. The apparatus for guiding multimedia content using the remote controller of the embodiment can also be applied to a table of a Linux-based operating system. The layout is on. In the 9Dth diagram, the image in which the hidden cursor or index is located is set as a central image 201. In addition, the image framed by the target block 20 is highlighted to help the user identify which image corresponds to which of the 3 x 3 digital keyboard sets (number keys 1-9) of the remote control. As shown in FIG. 9D, the images mapped to the numeric buttons 1, 2, and 3 are respectively the image 202a, the image 202b, and the image 202c; and the images mapped to the numeric buttons 4, 5, and 6 are respectively shown. The image 202d, the image 201, and the image 202e; and the images mapped to the numeric buttons 7, 8 are the image 202f and the image 202g, respectively. In the 9D picture, no image is mapped to the digital button 9. Even so, the user can still recognize the correspondence between the image and the button by highlighting.

See Figure 9E, which shows the desktop layout of a Linux-based Ubuntu operating system. The apparatus for guiding multimedia content using the remote controller in this embodiment can also be applied to the desktop layout of a Linux-based operating system. In Fig. 9E, the image in which the hidden cursor or index is located is set as a central image 201. In addition, the image framed by the target block 20 is highlighted to help the user identify which image corresponds to which of the 3 x 3 digital keyboard sets (number keys 1-9) of the remote control. As shown in FIG. 9E, the image mapped to the numeric keypad 2 is the image 202a; the images mapped to the numeric keys 4, 5 are the image 202b and the image 201, respectively; and the image mapped to the numeric keypad 8 , is image 202c. In Figure 9E, no image is mapped to the numeric buttons 1, 3, 6, 7, 9. Even so, the user can still recognize the correspondence between the image and the button by highlighting.

It is worth noting that if the arrangement of desktop images is too scattered, the desktop The images can be first aligned and then navigated using the navigation techniques of the present invention. In an embodiment, when the images are not completely aligned but only slightly uneven or misaligned, the corresponding relationship between the images and the keys can still be prompted by highlighting.

Please refer to FIG. 7 and FIG. 10A-10D. FIG. 10A-10D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the multimedia content 102b displayed on the display 10 is a photo editing software, and the object in which the hidden cursor or index is located is set as a central object 201 (for example, an album folder, a photo or a photo thumbnail). And the image framed by the target block 20 is highlighted to help the user identify which image corresponds to the five-way navigation/direction keyboard group 122a-122e of the remote controller or 3× of the numeric keypad group 128. Which of the 3 numeric keys are pressed.

Please refer to FIG. 10A, which shows a schematic diagram of Apple's photo management software iPhoto. The management interface of the left display frame of the photo management software iPhoto is operated by the navigation/direction keyboard group 122a-122e of the remote controller 12. As shown in FIG. 10A, the album folder in which the cursor or indicator is hidden, that is, the central album folder 201, is one of the album folders in the management interface of the left display frame of the photo management software iPhoto. In this case, if the user wants to select the album folder 202a in the management interface of the left display frame of the photo management software iPhoto, only the button 122a needs to be pressed; if the user wants to select the left display box of the photo management software iPhoto The photo album folder 201 in the management interface only needs to press the central button 122e; if the user wants to select the album folder 202b in the management interface of the left display frame of the photo management software iPhoto, only press and press the button Key 122b.

Please refer to FIG. 10B, which shows a schematic diagram of the photo management software iPhoto developed by Apple. The photo album of the right side display frame of the photo management software iPhoto uses the 3×3 number keys in the numeric keypad group 128 of the remote controller 12. To operate. As shown in FIG. 10B, the photo of the hidden cursor or indicator, that is, the central photo 201, is one of the photos of the album of the right side of the photo management software iPhoto. In this case, if the user wants to select the photo 202a in the photo album of the right side of the photo management software iPhoto, only the numeric button 1 needs to be pressed; if the user wants to select the photo album of the right side of the photo management software iPhoto In the photo 202b, only the numeric button 2 needs to be pressed; if the user wants to select the photo 202c in the photo album of the right display frame of the photo management software iPhoto, only the numeric button 3 is required; if the user wants to select the photo management software iPhoto The photo 202d in the photo album of the right side of the display box only needs to press the numeric button 4; if the user wants to select the photo 201 in the photo album of the right side of the photo management software iPhoto, only the numeric button 5 needs to be pressed; Selecting the photo 202e in the album of the right side of the photo management software iPhoto, only need to press the number button 6; if the user wants to select the photo 202f in the album of the right side of the photo management software iPhoto, only need to press the number button 7; If the user wants to select the photo 202g in the album of the right side of the photo management software iPhoto, only need to press the number button 8; To the right of the wearer to select a photo management software iPhoto photo album display frame of 202h, only needs to press the keypad 9.

Please refer to Figure 10C, which shows a schematic diagram of iPhoto, a photo management software developed by Apple, in which the photo management software iPhoto is displayed on the right side. The photo thumbnail of the frame is operated using the 3 x 3 number keys in the numeric keypad set 128 of the remote control 12. As shown in FIG. 10B, the photo thumbnail of the hidden cursor or indicator, that is, the central photo thumbnail 201, is one of the photo thumbnails of the photo album of the right side of the photo management software iPhoto. In this case, if the user wants to select the photo thumbnail 202a of the right display frame of the photo management software iPhoto, only the numeric button 1 needs to be pressed; if the user wants to select the photo thumbnail 202b of the right display frame of the photo management software iPhoto , only need to press the number button 2; if the user wants to select the photo thumbnail 202c of the right display frame of the photo management software iPhoto, only need to press the number button 3; if the user wants to select the photo management software iPhoto, the photo of the right side of the display frame is small Figure 202d, only need to press the number button 4; if the user wants to select the photo thumbnail 201 of the right display frame of the photo management software iPhoto, only need to press the number button 5; if the user wants to select the right side of the photo management software iPhoto display box In the photo thumbnail 202e, only the numeric button 6 needs to be pressed; if the user wants to select the photo thumbnail 202f of the right display frame of the photo management software iPhoto, only the numeric button 7 needs to be pressed; if the user wants to select the right side of the photo management software iPhoto The photo thumbnail 202g of the box only needs to press the number button 8; if the user wants to select the right of the photo management software iPhoto The photo display frame panel 202h, only needs to press the keypad 9.

In other embodiments, the photo management software iPhoto can switch to a 3x3 display mode in which a 3x3 photo or photo thumbnail is displayed, as shown in FIG. 10D. In this mode, the image may not be highlighted. This is because the user can clearly know which image corresponds to which of the 3 x 3 number keys in the numeric keypad group 128. In addition, the user can use the pointing device of the remote controller 12 to scroll the display page.

Please refer to FIG. 7 and FIG. 11A-11E. FIG. 11A-11E is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the multimedia content 102b displayed on the display 10 is a movie editing software, and the opened image in which the hidden cursor or index is located is set as a central image 201 (for example, a movie image or a function key map). The image framed by the target block 20 is highlighted to help the user identify which image corresponds to which of the 3 x 3 number keys in the numeric keypad 128 of the remote control 12.

Please refer to FIG. 11A, which shows a schematic diagram of Apple's movie editing software iMovie, in which the management interface of the right side display box of the movie editing software iMovie is operated by the number of the remote controller 12 by the 3×3 number keys in the keyboard 128. . As shown in FIG. 11A, the image in which the cursor or index is hidden, that is, the central image 201, is one of the movie images in the management interface of the right display frame of the movie editing software iMovie. In this case, if the user wants to select the movie image 202a in the management interface of the right display frame of the movie editing software iMovie, only the numeric key 1 needs to be pressed; if the user wants to select the right display frame of the movie editing software iMovie To control the movie image 202b in the interface, only need to press the number key 2; if the user wants to select the movie image 202c in the management interface of the right display frame of the movie editing software iMovie, only need to press the number key 3; Selecting the movie image 202d in the management interface of the right display frame of the movie editing software iMovie, only need to press the number key 4; if the user wants to select the movie image 201 in the management interface of the right display frame of the movie editing software iMovie, only Need to press the number key 5; if the user wants to select the movie image 202e in the management interface of the right display frame of the movie editing software iMovie, only need to press Number key 6; if the user wants to select the movie image 202f in the management interface of the right display frame of the movie editing software iMovie, only need to press the number key 7; if the user wants to select the management interface of the right display frame of the movie editing software iMovie In the movie image 202g, only the numeric key 8 needs to be pressed; if the user wants to select the movie image 202h in the management interface of the right display frame of the movie editing software iMovie, only the numeric key 9 needs to be pressed.

Please refer to FIG. 11B, which shows a schematic diagram of the movie editing software iMovie, wherein the movie image of the lower display frame of the movie editing software iMovie uses the numeric keys of the 3×3 numeric keys in the numeric keypad group 128 of the remote controller 12. 4, 5, 6 to operate. As shown in FIG. 11B, the image in which the cursor or index is hidden, that is, the central image 201, is one of the movie images of the album of the lower display frame of the movie editing software iMovie. In this case, if the user wants to select the movie image 202a of the lower display frame of the movie editing software iMovie, only the numeric button 4 needs to be pressed; if the user wants to select the movie image 201 of the lower display frame of the movie editing software iMovie It is only necessary to press the numeric button 5; if the user wants to select the movie image 202b of the lower display frame of the movie editing software iMovie, only the numeric button 6 needs to be pressed.

Please refer to FIG. 11C, which shows a schematic diagram of the movie editing software iMovie, wherein the basic function key image of the middle display frame of the movie editing software iMovie is in the 3×3 number key in the numeric keyboard group 128 of the remote controller 12. The numeric keys 4, 5, 6 operate. As shown in FIG. 11C, the image in which the cursor or index is hidden, that is, the central image 201, is one of the basic function key images of the basic function key image set of the middle display frame of the movie editing software iMovie. In this case, if the user wants to select the base of the basic function key image set of the middle display frame of the movie editing software iMovie The function key image 202a only needs to press the numeric button 4; if the user wants to select the basic function key image 201 of the basic function key image collection of the middle display frame of the movie editing software iMovie, only the numeric button 5 needs to be pressed; The user wants to select the basic function key image 202b of the basic function key image collection of the middle display frame of the movie editing software iMovie, and only needs to press the numeric key 6.

Please refer to FIG. 11D, which shows a schematic diagram of the movie editing software iMovie, wherein the playback function key image of the middle display frame of the movie editing software iMovie is in the 3×3 number key in the numeric keypad group 128 of the remote controller 12. The numeric keys 4, 5, 6 operate. As shown in FIG. 11D, the image in which the cursor or index is hidden, that is, the central image 201, is one of the play function key images of the play function key image set of the middle display frame of the movie editing software iMovie. In this case, if the user wants to select the play function key image 202a (spin key) of the play function key image set of the middle display frame of the movie editing software iMovie, only the digital key 4 needs to be pressed; if the user wants to select The playback function key image 201 (play or pause button) of the playback function key image collection of the middle display box of the movie editing software iMovie only needs to press the numeric button 5; if the user wants to select the middle display box of the movie editing software iMovie The play function key image 202b (fast turn key) of the function key image set is played, and only the digital key 6 needs to be pressed.

Please refer to FIG. 11E, which shows a schematic diagram of the movie editing software iMovie, wherein the volume control function key image of the middle display frame of the movie editing software iMovie is in the 3×3 number key in the numeric keyboard group 128 of the remote controller 12. The number keys 4, 6 operate. As shown in Figure 11E, if the user wants to select the volume of the middle display box of the movie editing software iMovie Controlling the volume control function key image 202a of the function key image collection, only need to press the numeric key 4; if the user wants to select the volume control function key image of the middle display frame of the movie editing software iMovie, the volume control function key image of the image collection 202b, only need to press the number button 6. In another embodiment, since the volume control is a continuous control mode, it can also be designed to press one of the control keys and control with the shaking of the pointing device. For example, when the user wants to adjust the volume, the digital button 5 can be pressed and shaken to the right to adjust the volume to become larger, or the digital button 5 can be pressed and shaken to the left to adjust the volume to become smaller.

As can be seen from the foregoing embodiment shown in FIG. 11A-11E, when the highlighted target block 20 is moved from the right display frame to the intermediate display frame or the lower display frame, the highlighted target block 20 is based on Hide the image or function key configuration of the cursor or indicator location to automatically adapt and adjust to select the appropriate image or function key.

In addition, in the 11A-11E diagram, the right display frame can use the scroll up or down scrolling to move the combination of the movie images in the display frame, and the pull-up and pull-down actions will be combined with the right display frame. The up/down crossing over between the middle display frame and the lower display frame conflicts. Therefore, the programmable design of the present invention causes the right display frame to move the combination of the movie images framed by the target block 20 in a left/right scrolling manner, and the right display frame, the middle display frame, and The upper and lower spanning movements between the lower display frames move the target block 20 by the up/down scrolling mode. In general, in order to avoid conflicts between scrolling and crossing over, the graphical user interface (GUI) must be designed to make the volume The control direction of scrolling is different from the control direction of crossing.

In an embodiment, the remote control application can be designed to move between the display frame or the function key combination when a specific action is performed on the remote control before or during the movement of the target block. Area moves. For example, the remote control application is designed such that when the numeric key 5 in the 3×3 numeric key is not continuously pressed, only the scrolling action can be performed, and when the numeric key 5 in the 3×3 numeric key is When continuously pressed, only the cross-region action can be performed. Of course, the foregoing examples can be operated in the opposite manner.

Basically, the 3×3 number keys can be used as a full-featured control keyboard group, because the configuration of the 3×3 number keys (or the nine-square grid configuration) also includes a navigation/direction keyboard group (or five-way control board). The up, down, left and right keys, the horizontally arranged three-key group (3-H), and the vertically arranged three-key group (3-V). Therefore, the 3×3 number key can be used as a nine-square grid control key in the first display frame or function key combination, or as a five-direction navigation/direction keyboard group in the second display frame or function key combination, or in the third display. As a horizontally arranged three-key group in a frame or function key combination, or as a vertically arranged three-key group in a fourth display frame or function key combination, or using some of the 3×3 number keys in any other display Control in a box or combination of function keys. By displaying the central object (which can be various options, buttons, images, photos, movies, function keys, etc.) in the target block in a visually distinguishable manner, the user can use the objects in the target block. The configuration is corresponding to the button on the remote controller, and it can be easily known that pressing the button can perform the input action of the target object. Therefore, with the auto-adapt feature of the present invention, even a user unfamiliar with the operation of a computer-related product can easily perform input manipulation.

In combination with the embodiments shown in the above FIGS. 7-11E, the present invention provides a smart input system including an electronic device that plays a multimedia content using a display, and an input device operatively coupled to the The electronic device also has a navigation control keyboard group for generating a hidden cursor or indicator on the display screen of the display to facilitate navigation of the multimedia content in response to the user's operation. The navigation control keyboard group can be a navigation/direction keyboard group or a 3×3 keyboard group in a numeric keypad group. The remote control includes a built-in gravity sensor or an aerial mouse function that allows the user to shake the remote to move hidden cursors or indicators. Alternatively, the remote control includes a pointing device such as a trackball that allows the user to manipulate the pointing device to move hidden cursors or indicators. The image of the multimedia content in which the hidden cursor or indicator is located on the screen of the display is set to a central image, which is set to be compared with a button located at the center of the navigation control keyboard group, and the keyboard is controlled according to the navigation. The configuration of the group, the central image and the image collated with the button of the navigation control keyboard group are set as a target block highlighted, and when the hidden cursor or indicator moves, the target block It also moves as the direction of the hidden cursor or indicator moves, thereby allowing the user to navigate the multimedia content using the navigation control keyboard set of the remote control.

In addition to the physical buttons on the input device to select and input the virtual keyboard or the multimedia content on the display, the smart method input system and method of the present invention may also utilize no physical buttons. The input device is used for input, for example, using a touch screen or a touch pad. The following examples illustrate another aspect of the smart method input system and method of the present invention. law.

In the embodiment of the present invention, the input device is preferably a smart phone with a touch screen, but not limited thereto, and other portable electronic devices with a touch surface, such as a tablet computer. Of course, the touch surface can also be a touch panel without a display screen, such as a touch panel on a notebook computer.

The input device distinguishes between different input actions performed by the finger on the touch surface. For example, when sliding with a finger, the finger moves on the touch surface without leaving the touch surface, instead of only touching the touch surface at a certain point, and the contact time is long, for example, lasting More than 0.5 seconds or more; while tapping with a finger, the finger is in contact with the touch surface at a certain point and the contact time is very short.

Of course, a stylus or other contact element can also perform an input action on the touch surface instead of the finger.

The input device is in communication with the electronic device, and enables the display of the electronic device to simultaneously display the candidate group in the target block, which includes the central object and a plurality of adjacent surrounding objects, wherein the central object can be associated with the user By operating the input device and arbitrarily changing, the group to be selected is also changed according to the change of the central object, so that the user can quickly select one of the waiting options through the input interface of the input device, thereby greatly improving the learning. The menus of the options to be selected in the technology need to be switched one by one, thus causing the lack of input time. The technical content of the present application will be further described below in various embodiments.

Please refer to FIG. 12, which is a schematic diagram of a smart input system and method according to an embodiment of the present invention. As shown, the smart input system includes an input device 30 and an electronic device 40, wherein the input device 30 and the electronic device The 40 series uses smart phones and smart TVs as examples to illustrate. A plurality of image objects are displayed on the display of the electronic device 40. When the user wants to select a target object, the finger may first touch any starting point A on the touch surface of the input device 30, and does not leave the touch. In the surface state, the surface of the electronic device 40 slides on the touch surface, and a highlighted area is displayed on the display of the electronic device 40, and the highlighted area moves along with the hidden cursor or index position controlled by the input device 30. When the target object is included in the highlighted area, the user's finger can stop sliding. The end of the slip is indicated by point B, and when the user's finger leaves the touch surface, the highlighted area is fixed at the current position. Position and form a box to select the target block 20 of the candidate group.

The target block 20 displayed on the display of the electronic device 40 includes a central object 201 and a plurality of surrounding objects 202a-202d that are centered about the central object 201 and adjacent to the central object. 201. The aforementioned point B is used as the control center point of the input device 30, and the central control area 301 is formed centering on the position of the point B, and is displayed by a center circle corresponding to the central object 201 in the target block 20, and is centrally A plurality of surrounding control areas 302a-302d are formed around the control area 301, corresponding to a plurality of surrounding objects 202a-202d in the target block 20, respectively. To facilitate identification of the user's input commands on the input device 30, the plurality of surrounding control regions 302a-302d are arranged in a fan shape around the central control region 301, and the fan angles of all of the surrounding control regions 302a-302d are made. The sum is 360 degrees. Wherein, the surrounding control areas 302a-302d divide the periphery of the central control area 301 into four areas of upper, lower, left and right, and form a similar five-way with the central control area 301. The control panel is configured to correspond to the input central object 201 and surrounding objects 202a-202d.

For example, when the user clicks on the central control area 301 on the input device 30, the input device 30 immediately recognizes that the candidate corresponding to the click position is the central object 201, and when the user is in the plurality of surrounding control areas 302a-302d When one of the clicks is made, the input device 30 recognizes the position according to the click, and displays the result of the selection of the corresponding surrounding objects 202a-202d. For example, if the user clicks on the surrounding control area 302a of the input device 30, the surrounding object 202a that the user wants to select to represent the cable television image can be identified. Similarly, if the user clicks on the surrounding control area 302d of the input device 30, the surrounding object 202d that the user wants to select to represent the YouTube image can be identified.

In addition to the aforementioned five-way control panel mode, the technical concept of this case can also be applied to the control mode of the nine-square grid (3x3), that is, the control mode similar to the 3×3 number keys. Please refer to FIG. 13 , which is a schematic diagram of a smart input system and method according to an embodiment of the present invention. As shown in the figure, the smart input system includes an input device 30 and an electronic device 40. The input device 30 and the electronic device 40 are respectively exemplified by a smart phone and a satellite navigator. The display of the electronic device 40 displays an operation screen of the virtual navigation keyboard on the satellite navigator. When the user wants to input the character, the user can use the finger to slide on the touch screen of the input device 30 to move the target block. 20 causes target block 20 to include a target object, wherein target block 20 includes a central object 201 and a plurality of surrounding objects 202a-202h. Taking Figure 13 as an example, the central object 201 represents the English letter F, and the plurality of surrounding objects 202a-202h represent the English letters E, R, T, D, G, X, C, respectively. V.

On the input device 30, the B point position forms a central control area 301 and is displayed in a center circle corresponding to the central object 201 in the target block 20, and eight surrounding areas are formed around the central control area 301. Control zones 302a-302h, each zone encompassing a range of 45 degree angles, and corresponding to a plurality of surrounding objects 202a-202h in target block 20, respectively. Therefore, the central control area 301 corresponds to the digital key 5 corresponding to the 3×3 numeric keypad, and the eight surrounding control areas 302a-302h correspond to the digital keys 1, 2, 3, 4, and 6 corresponding to the 3×3 numeric keypad. 7, 8, and 9.

When an input is to be made, an input action can be performed in the surrounding control zones 302a-302h at the corresponding locations of the input device 30 relative to the central control zone 301 based on the position of the target object relative to the central object 201. For example, when the letter E is to be input, a click can be performed in the surrounding control area 302a to complete the input action; when the letter G is to be input, a click can be performed in the surrounding control area 302e to complete the input action; when the letter C is to be input, The input action can be completed by clicking on the surrounding control area 302g.

In an embodiment, when the user performs a click input, the input device 30 can determine the target object to be input by calculating the distance and angle of the click position relative to the center point (point B) of the central control area 301. .

On the other hand, the manner in which the highlight area is moved is not limited to being achieved by slipping the finger on the touch surface. For example, the input device 30 can have a built-in gravity sensor, gyroscope or aerial mouse function, so that the highlight area can be moved by shaking or shaking the input device to point to the target block containing the target object. . In other words, the technique of the present invention can be input by means of a swing & tap. In this mode, the input device The 30 series is designed to determine the rest of the finger on the touch surface. For example, when the finger touches a certain point on the touch surface for more than a predetermined time, it can be determined as a stop motion.

In one embodiment, when the user shakes the input device 30, the user's thumb also stays at any suitable position on the touch surface of the input device 30, and stops shaking when the highlighted region contains the target object. The position where the thumb rests is taken as the center point (point B) of the central control area 301 of the input device 30, and can then be at the corresponding position of the input device 30 relative to the central control area 301 according to the position of the target object relative to the central object 201. A click is made within the surrounding control zones 302a-302h to perform an input action.

In an embodiment, the input device 30 can be designed to initiate a shaking control mode when the thumb rests at any suitable position on the touch surface of the input device 30, and when no finger is detected to remain in the input device 30 When the touch surface is on, the rocking control mode is turned off. This ensures that the control mode of the shaking is turned off after the thumb leaves the touch surface and during the subsequent click action, so that the position of the target block 20 can be frozen to avoid the target block caused by accidentally shaking to the input device 30. 20 changes.

When the input device 30 has a touch screen, a separation line between the central control area 301 and the surrounding control areas 302a-302h can be displayed on the touch screen for the user to recognize the respective area positions. On the other hand, the display of the separation line is not necessary, and the user only needs to know the position of the center point of the central control area 301, and can also perform click input at the corresponding position without visual inspection.

Therefore, the conventional five is controlled by the partition control mode of the aforementioned touch surface. Control mode to the control panel or the nine-square grid (3×3) can also be implemented without physical buttons. In other words, the present invention can flexibly provide a floating input area on the input device 30 corresponding to the object configuration in the target block 20 highlighted on the display of the electronic device 40, and since the input area is automatically adapted and adjusted In order to meet the object configuration in the target block 20, the user only needs to perform the position of the target object relative to the central object 201 in the surrounding control areas 302a-302h of the input device 30 relative to the central control area 301. Click to complete the input action.

In addition, the input method of this case can realize multi-touch technology. In this embodiment, the input device 30 is designed to recognize different contact commands on the touch surface, for example, to recognize a single finger slide, single tap, double tap (double tap) ), rest, swipe, and multiple finger slides, taps, double taps, rests, swipes, or A gesture in which a plurality of fingers slide inward at the same time, a gesture in which a plurality of fingers slide outward at the same time, and a rotation gesture of a plurality of fingers, and the like.

For example, in the multi-touch mode, the input device 30 can be designed to receive the first type of touch command to move the target block 20 highlighted on the display of the electronic device 40, and then receive the second type of touch. The command is to select the target object in the target block 20, then receive the third type of touch command to reset the center point position of the input device 30, and then receive the fourth type of touch command to transform the configuration of the target block 20.

Of course, different combinations and transformations can also be implemented. For example, the input device 30 is designed to control the target block 20 with the slip of two fingers. Moving, and using the contact point of the left finger and the touch surface as a preset center point, then selecting a target object by a single click action of one finger, and then resetting the input device 30 by a single click action of two fingers Center point location.

In another embodiment, the configuration of the combination of options to be selected in the target block 20 can be further adjusted. For example, when the user slides inward on the touch surface with two fingers, the option configuration in the target block 20 can be simplified from a nine-square (3x3) configuration to a five-way configuration (5-D), vertical. Three-grid configuration (3-V) or three-dimensional configuration in the horizontal direction (3-H); when the user slides simultaneously on the touch surface with two fingers, the options in the target block 20 can be made. The configuration is changed from a simple vertical three-grid configuration (3-V), a horizontal three-grid configuration (3-H) or a five-way configuration (5-D) to a more complex nine-square (3x3) configuration; When the user rotates and slides on the touch surface with two fingers, the option configuration in the target block 20 can be changed from the three-dimensional configuration (3-V) in the vertical direction to the three-dimensional configuration in the horizontal direction (3). -H), or to cause the option configuration in the target block 20 to be converted from a three-dimensional configuration (3-H) in the horizontal direction to a three-grid configuration (3-V) in the vertical direction.

Moreover, in another more complicated embodiment, as shown in FIG. 14, the target block 20 displayed on the display of the electronic device 40 includes a central object 201, a plurality of first layer surrounding objects 202a-202h, and a plurality of The second layer surrounding objects 203a-203h, and the instructions receivable by the input device 30 include: controlling the movement of the target block 20 by the slip of one finger, selecting the central object 201 and the single object by a single click action of a finger A layer of surrounding objects 202a-202h, with a single click of two fingers to select the second layer of the week The object 203a-203h resets the contact point of the left finger and the touch surface with the single click operation of the two fingers as the center point position of the input device 30, and simultaneously slides the two fingers on the touch surface to make the target The option configuration in block 20 is simplified from a two-layer nine-square grid (3x3) configuration to a single-layer nine-square grid (3x3) configuration, and simultaneous sliding of two fingers on the touch surface to enable option configuration within the target block 20. From the single-layer nine-square grid (3x3) configuration to a two-layer nine-square grid (3x3) configuration.

Of course, in addition to the nine-square grid (3x3) configuration, the five-way board configuration (5-D), the vertical three-grid configuration (3-V), or the horizontal three-grid configuration (3-H) can also have multiple layers. The way, and through different touch commands to perform the input of different layer options.

In one embodiment, as shown in FIG. 15, the objects in the target block 20 displayed on the display of the electronic device 40 are neatly arranged in the horizontal direction, and include the central object 201, the first layer surrounding objects 202a-202b. And the second layer surrounding objects 203a-203b, so that the single object 201 and the first layer surrounding objects 202a-202b can be selected by a single click action of one finger, and the single click action of the two fingers is used to perform the first Selection of two layers of surrounding objects 203a-203b.

In one embodiment, as shown in FIG. 16, the objects in the target block 20 displayed on the display of the electronic device 40 are neatly arranged in the vertical direction, and include the central object 201, the first layer surrounding objects 202a-202b. And the second layer surrounding objects 203a-203b, so that the single object 201 and the first layer surrounding objects 202a-202b can be selected by a single click action of one finger, and the single click action of the two fingers is used to perform the first Selection of two layers of surrounding objects 203a-203b.

In one embodiment, as shown in FIG. 17, the object in the target block 20 displayed on the display of the electronic device 40 presents a two-layer five-way plate configuration including the central object 201 and the first layer surrounding object 202a- 202d and the second layer surrounding objects 203a-203c, so that the single object 201 and the first layer surrounding objects 202a-202d can be selected by a single click action of one finger, and the single-click action of the two fingers is used. Selection of objects 203a-203c around the second layer.

In summary, the basic principle of the embodiment is that the central object is highlighted in a first visual representation, and the objects surrounding the first layer are highlighted in a second visual representation, and the objects surrounding the second layer are The three visual presentations are highlighted, and the objects surrounding the outer layer are highlighted in other different visual presentations, and the first touch command (eg, a single click) is received to select the central object and the objects surrounding the first layer, and receive The second touch command (for example, double click) selects the object around the second layer, receives the third touch command (for example, three clicks) to select the object around the third layer, etc., in other words, the embodiment adopts different touch commands. To select the target objects located in different configuration layers.

In the multi-touch mode, when the touch command needs to be executed with two fingers, the user will have difficulty holding the input device and performing the touch command with one hand at a time. Therefore, the user may have to hold the input device with the left hand. And execute the touch command with the right hand. Alternatively, the input device can be placed on the user's lap or on the sofa.

In an embodiment, the input device 30 can be preset to receive a touch command of a nine-square (3x3) configuration, and in the nine-square (3x3) control mode, the touch surface of the input device 30 can also be used for a five-way configuration (5) -D), three in the vertical direction Object configuration (3-V) or horizontal three-grid configuration (3-H) object selection and input, so whether the target block 20 moves across different zones or function key combinations during the automatic adjustment process The touch area of the input device 30 can conform to the object configuration in the target block 20, thereby completing the input.

Of course, the user can also switch the input mode as needed. When the user selects the control mode of the five-way board configuration (5-D), the touch surface of the input device 30 can also be used for the three-dimensional configuration in the vertical direction (3-V) or the three-dimensional configuration in the horizontal direction (3-H). Object selection and input. Since in the control mode of the five-way board configuration (5-D), each surrounding control area covers a range of 90 degrees, compared to the nine-square (3x3) control mode that covers only 45 degrees, the user is in the five-way In the control mode of the board configuration (5-D), there is no problem that the touch position is wrong.

In an embodiment, a two-way communication pipeline can be established between the input device 30 and the electronic device 40. When the target block 20 is automatically reduced or enlarged by spanning in a display frame or a combination of function keys, the electronic device 40 A signal is sent to the input device 30 such that the input device 30 can adjust the configuration of the touch region corresponding to the object configuration within the target block 20.

In an embodiment, when the user executes the touch command, the input device will mark the coordinates of the current center point and the finger touch point, or the coordinates of the finger touch point with respect to the current center point, or the finger touch point. The information about the angle and distance of the current center point or any position and direction of the finger touch point and the current center point is transmitted to the host of the electronic device, so that it can calculate and judge the object selected by the user.

In an embodiment, as shown in Fig. 18, the grid-like arrangement in a rectangular arrangement can achieve the same purpose. The size of the input area can be used according to the use Customs and finger size are customized, and the separation line between the input areas can be slightly offset, distorted or skewed depending on whether the user is a right-hand idiom or a left-hand idiom.

According to the embodiment shown in the above 12-18, the present invention can perform the selection input of the target object by using an input device having a touch surface, which is performed by sliding the finger on the touch surface or shaking the input device. The method is to move the highlighted area to point to the target block containing the target object, and according to the object configuration manner in the target block, the touch surface of the input device is divided into different ways of configuring the objects in the corresponding target block. The touch area is used to select the target object. It is not difficult to understand that the input method design of this case not only allows the user to have many waiting options at the same time, but also can clearly understand the contents of the options at a glance, and can easily select the candidate to be selected through the input device, so that the user can Quickly selecting objects or entering characters/numbers in the group to be selected greatly increases the user's convenience in selecting input and improving the time-consuming design that the customary options have to be pressed one by one to press the keys of the remote control one by one.

In addition, the above embodiment mainly uses a smart phone as an input device, and uses the contact of the finger with the touch surface to input. However, the concept of the present invention can be applied to other different input modes.

Please refer to FIG. 19A-19B, which is a schematic diagram of a smart input system and method according to an embodiment of the present invention. In this embodiment, the display of the electronic device 40 also has a target block 20 highlighted, which includes a central object 201 and a plurality of surrounding objects 202a-202d. The input device is a one-piece sensor that senses the user's limb movements. For example, when the user swings the head to the right, the target block 20 swings with the head. The degree moves to the right, so that the candidate group in the target block 20 can be switched according to the user's needs, and when the body sensor senses a certain body motion performed by the user's body When the right hand is raised, for example, the body sensor can recognize that the object to be selected by the user is the surrounding object 202c located on the right side of the central object 201.

It is not difficult to imagine that the somatosensory input methods can have different implementations. For example, in an embodiment, a photographic lens can be mounted on the display of the electronic device to detect a gesture of the user. When the user faces the photographic lens and the device with the palm and shakes, the highlighted area can be moved; when the user faces the ground with the palm and the finger faces the photographic lens and the display, the highlighted area is fixed; when the user makes a fist, That is to say, the central object is selected; when the user points a finger to the right, it means that the right object is selected; when the user points a finger to the upper side, it means that the upper object is selected. Of course, the gestures mentioned herein are for illustrative purposes only and are not intended to limit the case. Other actions or gestures may also be applied to the input method of the present case.

In another embodiment, the display of the electronic device can be equipped with a photographic lens for detecting the gesture of the user, and a radio device for receiving the voice command. When the user touches the camera lens and the display with the palm of the hand and shakes, the highlighted area can be moved; when the user makes a fist, the highlighted area is fixed; when the user says "middle", the central object is selected; when used When "right" is spoken, it means that the object on the right is selected; when the user says "lower left", it means that the object on the lower left is selected. Of course, the gestures or voice commands mentioned herein are for illustrative purposes only and are not intended to limit the case. Other gestures or voice commands or different input modes may be mixed and applied to the input method of the present case.

In addition, different input methods can also be mixed and matched. For example, in the pointing phase of the moving target area and the selection stage of selecting the target object, the input control action or the reverse operation may be performed by using the somatosensory control and the touch mode respectively, that is, the touch mode and the body sense control are respectively used. To perform an input action. However, whether it is a somatosensory control, a voice control or a touch control method, it can be mixed and applied to the input method of the present invention, and is not limited to the embodiment mentioned in the present invention.

On the other hand, the smart input system and method of the present invention can also be applied to browsing a web page or operating any graphical user interface containing randomly distributed object options. For convenience of description, the following embodiments will use a smart phone as an example of an input device, and such an embodiment will be described with a smart TV as an example of an electronic device.

Please refer to FIG. 20, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. The display of the electronic device 40 shows YAHOO! When the user wants to select a target object, the user can first touch the finger to any starting point A on the touch surface of the input device 30, and slide on the touch surface without leaving the touch surface. At this time, a highlighted area is displayed on the display of the electronic device 40, and the highlighted area moves with the hidden cursor or indicator position controlled by the input device 30, and is used when the highlighted object includes the target object. The finger can stop slipping, and the end of the slip is indicated by point B. When the user's finger leaves the touch surface, the highlighted area is fixed at the current position, and a target block 20 is formed.

The target block 20 includes a central object 201 and a plurality of surrounding objects 202a, 202b, 202c, 203a, 203b positioned around the central object. The target object is one of the central object 201 and a plurality of surrounding objects 202a, 202b, 202c, 203a, 203b. Taking Figure 20 as an example, the connection in the target block 20 is similar to the configuration of the five-way control board, that is, including the central and upper, lower, left and right connection options, wherein the "big group purchase" link is the central object. 201, that is, the indication of the hidden cursor controlled by the input device 30, and the links "ATM", "Discount +" and "Knowledge +" are surrounding objects 202a, 202b located in the first layer around the central object 201. The connection of 202c, "shopping center" and "friends" is the surrounding objects 203a, 203b located in the second layer around the central object 201.

The input device 30 forms a central control area 21 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and is displayed in a center circle, and four central control areas are formed on the periphery of the central control area 301. 301 is a radially outwardly extending peripheral control zone 302a, 302b, 302c, 302d, which divides the periphery of the central control zone 301 into upper, lower, left, and right zones to correspond to the central object 201, respectively. The surrounding objects in the left and right positions. For example, when a "big group purchase" link is to be selected, a single click can be performed in the central control area 301 to complete the input action; when an "ATM" link is to be selected, the surrounding control area 302a can be above the central control area 301. The input action can be completed with a single click; when the "Discount +" link is selected, the input action can be completed by a single click in the surrounding control area 302b below the central control area 301; when the "Knowledge+" link is to be selected, The input operation can be completed by a single click in the surrounding control area 302c on the left of the central control area 301; when the "shopping center" link is to be selected, since it is located in the surrounding area of the second layer around the central object 201, Can be designed to perform input actions in a two-click manner, ie The surrounding control area 302a above the central control area 301 performs double click to complete the input action; similarly, when the "friends" link is to be selected, the surrounding control area 302b below the central control area 301 can perform double click to complete the input. action.

Of course, the input device 30 can distinguish different input actions performed by the finger on the touch surface. For example, when sliding with a finger, the finger moves on the touch surface without leaving the touch surface, instead of only touching the touch surface at a certain point, and the contact time is longer, for example, lasts for more than 0.5 seconds. Above; while clicking with a finger, the finger is in contact with the touch surface at a certain point and the contact time is very short.

Moreover, the manner in which the highlight area is moved is not limited to being achieved by slipping the finger on the touch surface. For example, the input device 30 can have a built-in gravity sensor, gyroscope or aerial mouse function, so that the highlight area can be moved by shaking or shaking the input device to point to the target block containing the target object. .

Please refer to FIG. 21, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. The target block of this embodiment is different from that shown in Fig. 1. The following description will be made with respect to the difference from Fig. 20, and the same portions will not be described again. As shown in Fig. 21, the connection in the target block 20 is neatly arranged in the vertical direction, wherein the "oil-free fryer specials" is linked to the central object 201, and the "Japanese goddess small dress" and "slim cut cotton" The links such as "Mashan" are the surrounding objects 202a, 202b located in the first layer around the central object 201, and the links such as "Korean Dress 188" and "Wanfenpu Women's Clearance" are located in the second floor around the central object 201. The surrounding objects 203a, 203b.

The input device 30 forms a central control area 301 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and is displayed in a center circle, and two peripheral control areas 302a are formed on the periphery of the central control area 301. 302b, which divides the periphery of the central control area 301 into upper and lower areas to respectively correspond to surrounding objects located on the upper and lower positions of the central object 201. For example, when you want to select the "Oil Free Fryer Specials" link, you can complete the input action with a single click in the central control area 301; when you want to select the "Daily Goddess Small Dress" link, you can use the central control area. The surrounding control area 302a above the 301 performs a single click to complete the input action; when the "slim cut cotton" link is selected, the input can be completed by a single click in the surrounding control area 302b below the central control area 301. When the "Korean Dress 188" link is to be selected, since it is located in the surrounding area of the second layer around the central object 201, it can be designed to perform an input action in a double click manner, that is, above the central control area 301. The surrounding control area 302a performs double-click to complete the input action; similarly, when the "Five-Way Women's Clearance" link is to be selected, the double-click can be performed in the surrounding control area 302b below the central control area 301 to complete the input action. .

Please refer to FIG. 22, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. The target block of this embodiment is different from that shown in Fig. 1. The following description will be made with respect to the difference from Fig. 20, and the same portions will not be described again. As shown in FIG. 22, the links in the target block 20 are arranged in a horizontal direction, wherein "Blog" is connected as the central object 201, and "Video" and "Life+" are connected around the central object 201. The surrounding objects 202a, 202b in the first layer range, the "picture" and the "shopping" link are the weeks in the second layer around the central object 201. Peripheral objects 203a, 203b.

The input device 30 forms a central control area 301 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and is displayed in a center circle, and two peripheral control areas 302a are formed on the periphery of the central control area 301. 302b, which divides the periphery of the central control area 301 into left and right areas to respectively correspond to surrounding objects located at the left and right positions of the central object 201. For example, when a "Blog" link is to be selected, a single click can be performed in the central control area 301 to complete the input action; when a "Video" link is to be selected, the surrounding control area can be left on the left of the central control area 301. 302a can complete the input action with a single click; when the "Life+" link is selected, the input action can be completed by a single click in the surrounding control area 302b on the right of the central control area; when the "picture" link is to be selected, Since it is located in a surrounding object in the second layer around the central object 201, it can be designed to perform an input action in a double click manner, that is, a double click on the left surrounding control area 302a of the central control area 301 to complete the input. Similarly, when the "shopping" link is to be selected, the input operation can be completed by double clicking on the surrounding control area 302b on the right of the central control area 301.

Please refer to FIG. 23, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. The target block of this embodiment is different from that shown in Fig. 1. The following description will be made with respect to the difference from Fig. 20, and the same portions will not be described again. As shown in FIG. 23, the links in the target block 20 are arranged in a horizontal direction, wherein the "auction" link is the central object 201, and the "super mall" and the "activity special report" are connected around the central object 201. The surrounding objects 202a, 202b in the first layer range, the "shopping center" is connected as a week in the second layer around the central object 201. The enclosure member 203a.

The input device 30 forms a central control area 301 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and is displayed in a center circle, and two peripheral control areas 302a are formed on the periphery of the central control area 301. 302b, which divides the periphery of the central control area 301 into left and right areas to respectively correspond to surrounding objects located at the left and right positions of the central object 201. For example, when an "Auction" link is to be selected, a single click can be performed in the central control area 301 to complete the input action; when the "Super Mall" link is to be selected, the surrounding control area can be left on the left of the central control area 301. 302a can complete the input action with a single click; when the "activity special report" link is selected, the input action can be completed by a single click in the surrounding control area 302b on the right of the central control area; when the "shopping center" link is selected Since it is located in a surrounding object in the second layer around the central object 201, it can be designed to perform an input action in a double click manner, that is, double clicking on the surrounding control area 302a to the left of the central control area 301. Enter the action.

Please refer to FIG. 24, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. The target block of this embodiment is different from that shown in Fig. 1. The following description will be made with respect to the difference from Fig. 20, and the same portions will not be described again. As shown in Fig. 24, the links in the target block 20 are arranged in a horizontal direction, wherein the "Knowledge+" link is the central object 201, and the links such as "Mailbox" and "Auction" are located around the central object 201. Peripheral objects 202a, 202b in a range.

The input device 30 forms a central control area 301 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and serves as a center. Circles are displayed, and two peripheral control areas 302a, 302b are formed on the periphery of the central control area 301, which divides the periphery of the central control area 301 into left and right areas to correspond to the left and right positions of the central object 201, respectively. Around objects. For example, when a "Knowledge+" link is to be selected, a single click can be performed in the central control area 301 to complete the input action; when a "mailbox" link is to be selected, the surrounding control area can be left on the left of the central control area 301. 302a can complete the input action with a single click; when the "Auction" link is to be selected, the input action can be completed by a single click on the surrounding control area 302b on the right of the central control area.

Due to the wide variety of connections and the variety of arrangement on the webpage, in order to avoid the complexity and confusion of the object options in the target block, the highlighted area is designed to select the same type or same level link as the central object. To simplify and clarify the combination of options within the target block. For example, in the above embodiment, the link selected by the target block in FIG. 20 is the same as the central object, and the link selected by the target block in FIG. 21 is the central link. The object is the same as the item link option under the "Auction" level. The link selected in the target block of Figure 22 is the link option with the central object as the search category, and the link selected by the target block in Figure 23 The link option is the same as the central object for online shopping. The link selected in the target block of Figure 24 is the link option with the member-specific function as the central object.

In the above embodiment, the link options selected by the target block are text link options displayed by text. However, in addition to the link options displayed by the text, the web page includes many links displayed by pictures or videos. Option, and the input method of the present invention can also be switched to the highlighted area and only selected The mode of the image link, or switch to the highlighted area to select only the mode of the video link, or switch to the highlighted area to select only the image link and the mode of the video link. The following description will be made by way of examples.

Please refer to FIG. 25, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the input method is switched to the highlighted area to select only the mode of the picture connection, so when the user's finger slides on the touch surface of the input device 30, the highlighted area only selects the picture link. , while skipping adjacent text or other forms of links. As shown in Fig. 25, the picture link in the target block 20 is arranged in a similar manner to the five-way control board, that is, including the central object 201, located in the first layer around the central object 201 and on the central object 201. The surrounding objects 202a, 202b, 202c, 202d at the lower, left, and right positions, and the surrounding objects 203a located within the second layer around the central object 201 and at the right side of the central object 201.

The input device 30 forms a central control area 301 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and is displayed in a center circle, and four central control areas are formed on the periphery of the central control area 301. 301 is a radially outwardly extending peripheral control zone 302a, 302b, 302c, 302d, which divides the periphery of the central control zone 301 into upper, lower, left, and right zones to correspond to the central object 201, respectively. The surrounding objects in the left and right positions. When the target object is selected, the method is similar to the above embodiment, that is, according to the position of the target object relative to the central object 201, the surrounding control areas 302a, 302b at the corresponding positions of the input device 30 with respect to the central control area 301, An input action is performed in 302c, 302d, for example, an object in the first layer around the central object 201 can The single object is input in a single click mode, and the object in the second layer around the central object 201 is input in a double click manner to select the target object.

Please refer to FIG. 26, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the input method is switched to the highlighted area to select only the picture link and the mode of the video link, so when the user's finger slides on the touch surface of the input device 30, the highlighted area only frames. Select image links and video links, and skip adjacent text or other forms of links. As shown in FIG. 26, the picture link and the video link in the target block 20 are arranged in a similar five-way control key, that is, including the central object 201, and located in the first layer around the central object 201 and in the The surrounding objects 202a, 202b, 202c at the upper, lower, and left positions of the central object 201.

The input device 30 forms a central control area 301 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and is displayed in a center circle, and four central control areas are formed on the periphery of the central control area 301. 301 is a radially outwardly extending peripheral control zone 302a, 302b, 302c, 302d, which divides the periphery of the central control zone 301 into upper, lower, left, and right zones to correspond to the central object 201, respectively. The surrounding objects in the left and right positions. When the target object is selected, the method is similar to the above embodiment, that is, according to the position of the target object relative to the central object 201, the surrounding control areas 302a, 302b at the corresponding positions of the input device 30 with respect to the central control area 301, An input action is performed in 302c, 302d. For example, an object in the first layer around the central object 201 can be input in a single click manner to select the target object.

Please refer to FIG. 27, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the YouTube homepage is displayed on the display of the electronic device 40, and the input method is switched to the highlighted area to select only the mode of the movie connection, so that the user's finger slides on the touch surface of the input device 30. When moving, the highlighted area will only select the video link and skip the adjacent text or other forms of links. As shown in Fig. 27, the film links in the target block 20 are neatly arranged in the vertical direction, and include the central object 201, located in the first layer around the central object 201, and on the lower and lower sides of the central object 201. The surrounding objects 202a, 202b, and surrounding objects 203a, 203b located in the second layer around the central object 201 and on the lower and upper sides of the central object 201.

The input device 30 forms a central control area 301 at the point B, which corresponds to the central object 201 on the display of the electronic device 40, and is displayed in a center circle, and two peripheral control areas 302a are formed on the periphery of the central control area 301. 302b, which divides the periphery of the central control area 301 into upper and lower areas to respectively correspond to surrounding objects located on the upper and lower positions of the central object 201. When the target object is selected, the method is similar to the above embodiment, that is, according to the position of the target object relative to the central object 201, the surrounding control areas 302a, 302b at the corresponding positions of the input device 30 with respect to the central control area 301, An input action is performed, for example, the object in the first layer around the central object 201 can be input in a single click manner to select the target object, and the object in the second layer around the central object 201 is double clicked. Enter to select the target object.

In the above embodiment, the objects are arranged in a regular lattice shape, so that the surrounding objects are neatly arranged on the upper, lower, left and right sides of the central object. Therefore, the input action can be easily performed in the surrounding control area of the input device relative to the corresponding position of the central control area according to the position of the target object relative to the central object. However, in some web pages, for example, the vocabulary links included in the captions presented in the article paragraphs generally exhibit a decentralized, random and irregular arrangement, while the following embodiments illustrate the input method of the present invention for such irregular arrangements. The application of the object.

Please refer to FIG. 28, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the display page of WIKIPEDIA on Steve Jobs is displayed on the display of the electronic device 40, and the target block 20 selected by the highlighted area frame also includes the central object 201. And surrounding objects 202a, 202b, 202c positioned in an irregular manner around the central object 201.

According to the information of the distribution, configuration, position or direction of the four objects 311, 202a, 202b, and 202c, the touch surface of the input device 30 can be divided into four similar, corresponding, or consistent distributions, configurations, and positions of the four objects. Or the input area of the direction, including the central control area 301 of the central object 201 on the display of the corresponding electronic device 40, and three surrounding control areas 302a, 302b, 302c corresponding to the surrounding objects 202a, 202b, 202c, respectively.

When the "Steve Wozniak" link is to be selected, the input action can be completed by clicking in the central control area 301; when the "The Walt Disney Company" link is to be selected, the user only needs to see it on the display of the electronic device 40. The relative position of the central object can be intuitively clicked on the input device 30 corresponding to the upper control area 302a at the upper right of the central control area 301; when the "Xerox PARC's mouse" link is selected, Intuitively right in the central control area 301 The lower surrounding control area 302b can be clicked to complete the input action; similarly, when the "graphical user interface" link is to be selected, it can be completed by clicking on the left side of the central control area 301 and slightly below the surrounding control area 302c. Enter the action.

In addition, the number of surrounding objects selected by the highlighted area can also be adjusted and set according to user needs. For example, with the multi-touch technology, when the user slides inward on the touch surface with two fingers, the number of surrounding objects selected by the highlighted area can be reduced; when the user uses two fingers When sliding on the touch surface at the same time in the opposite direction, the number of surrounding objects selected by the highlighted area can be increased; and when the user uses two fingers to rotate and slide on the touch surface, the highlighted area can be highlighted. The selected first set of surrounding object combinations are transformed into a second set of surrounding object combinations centered on the same central object.

For users who are not familiar with the operation of computer-related products, the number of surrounding objects is preferably three to five, because too many surrounding objects will make selection difficult, especially if the objects are random and irregular. The way the way is arranged. Of course, for users who are quite familiar with the operation of computer-related products, the number of surrounding objects is limited only by the flexibility of the user's fingers.

Please refer to FIG. 29, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the same web page as in FIG. 28 is displayed on the display of the electronic device 40, but the highlighted area frame selects different target blocks 20. In the target block 20 shown in FIG. 10, a central object 201 and four surrounding objects 202a, 202b, 203a, 203b are included, wherein the surrounding objects 202a and 203a are also arranged in the central object. Above the 201, the surrounding objects 202b and 203b are also arranged below the central object 201. This arrangement is similar to the two-layer configuration shown in Fig. 21, in which the surrounding objects 202a, 202b are located within the first layer around the central object 201, while the surrounding objects 203a, 203b are located around the central object 201. Within the scope.

According to the information of the distribution, configuration, position or direction of the five objects 201, 202a, 202b, 203a, 203b, the touch surface of the input device 30 can be divided into five similar, corresponding or consistent distributions and configurations of five objects. The input area of the position or direction is divided into five input areas by two concentric circles and lines extending outward from the center of the concentric circle and dividing the touch surface into upper and lower sides, wherein the inner circle The inner area is the central control area 301 corresponding to the central object 201, and the upper area 302a and the lower area 302b between the inner circle and the outer circle respectively correspond to the first layer around the central object 201 and above and below the central object 201. The surrounding objects 202a and 202b in the side position, and the upper area 303a and the lower area 303b outside the outer circle respectively correspond to the surrounding objects 203a in the second layer around the central object 201 and on the upper and lower positions of the central object 201. And 203b.

Therefore, when the "consumer electronics" link is to be selected, the input operation can be completed by clicking in the central control area 301; when the "Apple Inc." link is to be selected, the upper area 303a outside the outer circle can be clicked. The input action can be completed; when the "personal computer revolution" link is to be selected, the input can be completed by clicking on the upper area 302a between the inner circle and the outer circle; when the "Pixar Animation Studios" link is to be selected, Inner circle and outer circle When the lower area 302b is clicked, the input operation is completed; when the "The Walt Disney Company" link is to be selected, the input operation can be completed by clicking on the lower area 303b outside the outer circle.

Moreover, the arrangement of concentric circles can be adjusted and set according to user needs, and the number of concentric circles or the number of layers of surrounding objects can be adjusted and set according to user needs. For example, with the multi-touch technology, when the user slides inward on the touch surface with two fingers, the number of layers of surrounding objects selected by the highlighted area can be reduced; When two fingers slide in opposite directions on the touch surface at the same time, the number of layers of surrounding objects selected by the highlighted area can be increased; when the user uses two fingers to rotate and slide on the touch surface, The combination of the first group of surrounding objects in the first layer of the central object is selected into a second group of surrounding object combinations centered on the same central object; when the user uses three fingers on the touch surface When rotating and sliding, the highlight area frame is selected to be transformed into a second set of surrounding object combinations centered on the same central object, in a second set of surrounding objects in the second layer around the central object.

For users who are not familiar with the operation of computer-related products, the number of layers of surrounding objects should be within the controllable range, and for users who are familiar with the operation of computer-related products, the configuration of surrounding objects The number of layers is only limited by the flexibility of the user's fingers.

Please refer to FIG. 30, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the same web page as in FIG. 28 is displayed on the display of the electronic device 40, but the highlighted area frame selects different target blocks 20. In the target block 20 shown in FIG. 30, A central object 201 and five surrounding objects 202a, 202b, 202c, 202d, 203a are included, wherein the surrounding objects 202a and 203a are also arranged to the right of the central object 201, so that a double layer configuration is present in this direction.

According to the distribution, arrangement, position or direction of the six objects 201, 202a, 202b, 202c, 202d, 203a, the touch surface of the input device 30 can be divided into six similar, corresponding or consistent distributions of six objects. Input area of configuration, position or direction, wherein the central control area 301 is displayed with a central circle, and the periphery of the central control area 301 is roughly divided into four surrounding control areas 302a, 302b, 302c, 302d, and the right surrounding control The region 302a is further divided into an inner layer region 302a1 and an outer layer region 302a2 by an arc.

Therefore, when the "Pixar" link is to be selected, the input operation can be completed by clicking in the central control area 301; when the "11" link is to be selected, the inner layer area 302a1 between the center circle and the arc can be clicked. The input action can be completed; when the "Toy Story" link is selected, the input action can be completed by clicking on the outer layer 302a2 on the right side of the arc; when the "CEO" link is to be selected, the surrounding control area can be slightly to the right below. 302b can be clicked to complete the input action; when the "Lucusfilm" link is to be selected, the input operation can be completed by clicking on the left surrounding control area 302c; and when the "computer platform" link is to be selected, the upper side can be selected The left surrounding control area 302d is clicked to complete the input action.

In this embodiment and all the above embodiments, the user does not actually need to know how the input area is distinguished on the touch surface of the input device, and the ruled line of the area can be hidden or not displayed, and the user does not need to view the line. Moved from the display of the electronic device to the input device, the user only needs to look straight The surrounding objects selected by the bright area can be intuitively clicked on the touch surface of the input device relative to the corresponding position of the central control area according to the relative position of the surrounding object displayed on the display and the central object. Complete the input action and select the target object you want to select.

In other words, in the embodiment of the present invention, the user only has to perform the following steps: sliding the finger on the touch surface of the input device to move the highlighted area until the highlighted area contains the target object, and then observing the object in the highlighted area. The configuration determines the position and direction of the target object relative to the central object, and then clicks on the touch surface of the input device relative to the corresponding touch point of the finger to complete the input action and select the target object to be selected. . The input method of the present invention allows the user to operate the input device in a manner that does not require viewing of the input device, thereby allowing attention to be concentrated on the display screen.

Please refer to FIG. 31, which is a schematic diagram showing a smart input system and method according to an embodiment of the present invention. In this embodiment, the display of the electronic device 40 displays the home page of Wikipedia (WIKIPEDIA), which surrounds a circle of various language-linked objects around the central spherical image. Therefore, in this particular example, the object itself They are arranged in a substantially symmetrical manner, so even if the central object is not selected in the highlighted area frame, the judgment of the arrangement of the surrounding objects is not affected.

In the target block 20 shown in FIG. 31, a total of ten surrounding objects 202a-202j are included, and the touch of the input device 30 is distinguished according to information such as the distribution, configuration, position or direction of the ten surrounding objects 202a-202j. An input area on the surface, wherein the central control area 301 corresponds to the finger slip end point B, and the central control area 301 corresponds to ten surrounding objects respectively 202a-202j is divided into ten surrounding control areas 302a-302j, so when any target object is to be selected, the corresponding surrounding control area can be clicked according to the relative position of the surrounding objects displayed on the display of the electronic device 40. Complete the input action.

On the other hand, in an embodiment, when the object included in the target block presents a symmetrical and simple configuration, such as a nine-square (3x3) configuration, since the relative positions of the surrounding objects and the central object are very clear, here In this case, only the central object can be displayed in the highlighted area without displaying the surrounding objects in the highlighted area, and when selecting any surrounding object, it can still be easily input according to its relative position with the central object. The input operation is completed by clicking in the corresponding input areas of the upper, lower, left, right, upper right, lower right, upper left or lower left of the central control area on the device.

In an embodiment, when the text link contains too many characters, it may be difficult to define the position or direction of the link. In this case, the input method of the case may be designed to only the first one of the characters or The first few letters are displayed in highlighted areas. On the other hand, the input method of the present case can also be designed to mark a dot, a bullet point, or other symbols or graphics in front of or around the text link, so that the position and orientation of the link can be easily judged without confusion. . Of course, the method of displaying the highlighted area is not limited to those mentioned in all of the above embodiments, and other highlighting methods such as changing colors, additional graphics or guiding images, dynamic effects, 3D effects, etc., as long as the user can visually The method of determining the position and orientation of the highlighted area can be applied to the input method of the present invention.

In an embodiment, the input method of the present invention automatically determines the appropriate number of linked objects framed in the highlighted area according to the congestion degree of the connected object. Head. In other words, when the highlighted area moves on different parts of the webpage, the number of connected objects that are framed will increase or decrease, so that the user can easily determine the position and orientation of the connected object by visual inspection.

In an embodiment, a two-way communication is established between the input device and the host of the electronic device. When the number of connected objects framed in the highlighted area changes, the host of the display device sends a message to notify the input device, so that the input device can The division of the input area on the touch surface is automatically changed to conform to the configuration of the currently selected linked object.

In an embodiment, as shown in FIG. 32, the touch surface is divided into two concentric circles and 36 grid lines radiated outward from the center center by the position of the B point, and the adjacent grid lines are The interlayers are separated by a 10 degree angle, that is, the input area on the touch surface is a two-layer configuration, and each layer is subdivided into 36 zones. In this way, all of the different input area configurations in the foregoing embodiments can be covered by combining successive zones into appropriately sized input areas in conjunction with the position of the corresponding joined objects.

In one embodiment, as shown in Figure 33, the combination of zones may also reflect the position and orientation of the joined articles and be presented in a variety of different forms. When the grid lines are less dense and the separated zones are larger, the number of input zones that can be combined between the zones will be limited. Conversely, when the grids are dense, the zones separated by the grids are smaller. The number of input areas that can be combined between the zones will be greatly increased, that is, the number of connected objects that can be framed by the highlighted areas will also increase. In the case where such grid lines are relatively densely distributed, any randomly distributed linked object can define the most suitable range of input regions by the combination of zones.

In an embodiment, as shown in FIG. 34, the lattice is arranged in a rectangular shape. Configuration can also achieve the same purpose.

In an embodiment, when the user performs a click input, the input device compares the coordinates of the current center point and the finger touch point, or the finger touch point with respect to the coordinates of the current center point or the finger touch point. The angle and distance at the current center point, or any information about the position and direction of the finger touch point and the current center point, is transmitted to the host of the electronic device, so that it can calculate and judge the surrounding objects selected by the user. In this embodiment, all of the grid lines and the combined input areas are not actually displayed on the touch surface of the input device, but only in the form of a software control code for determining the position of the finger touch point.

The input method of the present case can be implemented as an application executed concurrently with an existing browser, or as a browser plug-in or as a stand-alone browser. Of course, the input method of this case can also be applied to other applications or any graphical user interface containing randomly distributed images.

Of course, the foregoing embodiment can also be applied to a notebook computer, that is, the touch panel of the notebook computer is used as an input device of the smart input system, and the smart input method of the present invention is used on the display screen of the notebook computer. The menu displayed shows the selection of the target object. Since its implementation is similar to the previous embodiment, it will not be described again.

According to an embodiment of the present invention, the present invention provides a smart input method for selecting a target object from a menu displayed on a display of an electronic device. As shown in FIG. 35, the smart input method includes the following steps: using an input device to point to a target block covering the target object in the menu (S10), wherein the target block is in accordance with the direction and bit pointed by the input device. Dynamically formed, the target block includes a central object and a plurality of surrounding objects located around the central object, and the target object is one of a central object and a plurality of surrounding objects; and an input interface of the input device (eg, an input control keyboard) The central button or the central control area corresponds to the central object in the target block, and the corresponding position of the target object relative to the central button or the central control area in the input interface according to the position of the target object relative to the central object The upper control key or control area performs an input action to select the target object (S12).

According to another embodiment of the present invention, the present invention provides a smart input method. As shown in FIG. 36, the smart input method includes the following steps: receiving a touch input through an input interface of the input device (S20); The touch position of the touch input on the input interface is a reference point, and a plurality of control areas are dynamically formed on the input interface, and the plurality of control areas respectively correspond to a plurality of input functions of the input device (S22).

According to still another embodiment of the present invention, the present invention provides a smart input method. As shown in FIG. 37, the smart input method includes the following steps: displaying a plurality of objects in a graphical user interface (S30); receiving a pointing a signal, the pointing signal simultaneously points to a group of objects consisting of at least two objects of the plurality of objects (S32); and receiving the selected signal to select one of the target objects of the group of objects pointed to by the signal (S34).

According to still another embodiment of the present invention, the present invention provides a smart input method. As shown in FIG. 38, the smart input method includes the steps of: setting a display of an electronic device to display a plurality of optional objects, the plurality of The selection object is distributed on the display screen of the display (S40); the setting input device forms a plurality of selection units, and the plurality of selection units are distributed on the input device Input interface (S42); setting a pointing function of the input device to the electronic device, the pointing function enabling the input device to selectively point to at least two of the plurality of optional objects displayed on the display screen at the same time Selecting an object (S44); setting at least two optional objects on the display screen to correspond to at least two of the plurality of selection units on the input interface, so that the corresponding selection unit on the input interface is selected The selected object on the screen is displayed (S46). Wherein, the selected optional object and the corresponding selection unit may form a one-to-one correspondence relationship, so an input action may be performed in a selection unit to select an optional object; or, the selected optional object corresponds to the corresponding object. The selection unit can form a many-to-one correspondence, so different input actions can be performed in a selection unit to select different optional objects.

In summary, the present invention mainly provides a smart input system and method, which uses an input device to point to a target block covering the target object in a menu displayed on a display of the electronic device, and highlights the target block. The area display, wherein the target block is dynamically formed due to the direction and position pointed by the input device, the target block includes a central object and surrounding objects, and the input device has a central control area corresponding to the central object, and the user The object to be taken out can be selected by performing an input action on the input device relative to the corresponding position of the central control area intuitively according to the relative position of the target object and the central object seen on the display. Therefore, the smart input system and method of the present invention allows a user to input, select, or even browse a web page or operate any graphic user including randomly distributed optional objects on a display of an electronic device such as a smart television platform or a digital multimedia player. In the interface, the target object can be selected in a smart, fast and flexible manner to perform input to perform various actions. Yes, this case The technology is of great industrial value and conforms to various patent requirements.

This case has been modified by people who are familiar with the technology, but it is not intended to be protected by the scope of the patent application.

10‧‧‧Digital Media Player

102‧‧‧ display

102a‧‧‧virtual keyboard

102b‧‧‧Multimedia content

12‧‧‧Remote control

120a‧‧‧Power switch key

122a-122e‧‧‧Up/Down/Left/Right/Center button

124‧‧‧ input button

126‧‧‧Enter button

128‧‧‧Digital keyboard set

20‧‧‧ Target block

201‧‧‧Central button, central option, central image, central photo album folder, central photo, central photo thumbnail, central object

202a-202j‧‧‧Image, photo album folder, photo, photo thumbnail, movie image, function key image, object

203a-203c‧‧‧ surrounding objects

30‧‧‧ Input device

301‧‧‧Central Control Area

302a-302j‧‧‧ surrounding control area

303a-303b‧‧‧ surrounding control area

40‧‧‧Electronic equipment

A‧‧‧ starting point

B‧‧‧ End

S10-S46‧‧‧Step S10-Step S46

Fig. 1 is a schematic view showing a smart input system according to an embodiment of the present invention.

2A-2G is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

3A-3L is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

4A-4D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

5A-5D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

6A-6D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

Figure 7 is a schematic diagram showing the smart input system of an embodiment of the present invention.

8A-8C is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

9A-9E is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

10A-10D is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

11A-11E is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

Fig. 12 is a schematic view showing a smart input system and method according to an embodiment of the present invention.

Figure 13 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 14 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 15 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 16 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 17 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 18 is a schematic view showing the configuration of an input area on a touch surface of an input device according to an embodiment of the present invention.

19A-19B is a schematic diagram showing a smart input system and method according to an embodiment of the present invention.

Figure 20 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 21 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 22 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 23 is a smart input system and method for displaying an embodiment of the present invention schematic diagram.

Figure 24 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 25 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 26 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 27 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 28 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 29 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 30 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 31 is a schematic diagram showing a smart input system and method in an embodiment of the present invention.

Figure 32 is a schematic view showing the configuration of an input area on a touch surface of an input device according to an embodiment of the present invention.

Figure 33 is a schematic view showing the configuration of an input area on a touch surface of an input device according to an embodiment of the present invention.

Figure 34 is a schematic view showing the configuration of an input area on a touch surface of an input device according to an embodiment of the present invention.

Figure 35 is a schematic diagram showing the smart input method of an embodiment of the present invention.

Figure 36 is a schematic diagram showing the smart input method of an embodiment of the present invention.

Figure 37 is a schematic diagram showing the smart input method of an embodiment of the present invention.

Figure 38 is a schematic diagram showing the smart input method of an embodiment of the present invention.

20‧‧‧ Target block

201‧‧‧Central objects

202a-202d‧‧‧ surrounding objects

30‧‧‧ Input device

301‧‧‧Central Control Area

302a-302d‧‧‧ surrounding control area

40‧‧‧Electronic equipment

A‧‧‧ starting point

B‧‧‧ End

Claims (36)

A smart input system comprising: an electronic device having a display, the display displaying a menu comprising a plurality of objects; and an input device coupled to the electronic device and having an input interface; wherein the input The device points to a target block covering a target object in the menu, and the object combination of the target block is dynamically formed according to the direction and position pointed by the input device, the target block includes a central object and is located in the target block. a plurality of surrounding objects around the central object, the target object being one of the central object and the plurality of surrounding objects, and the input interface has a central control area corresponding to the central object, whereby the target object is relative to the central portion The position of the object performs an input action on the control area of the input interface relative to the corresponding position of the central control area to select the target object. The smart input system of claim 1, wherein the object is a virtual button, a graphical user interface, an image, a function button, a folder, a photo, a movie or a link. . The smart input system according to claim 1, wherein the object of the hidden cursor or the position of the indicator controlled by the input device is set as the central object. The smart input system of claim 1, wherein the target block is displayed in a highlighted area. The smart input system of claim 1, wherein the central object of the target block is different from the other of the target block The visual representation of the object. The smart input system of claim 1, wherein the central control area periphery of the input device can be divided into a plurality of surrounding control areas according to the configuration of the plurality of surrounding objects relative to the central object. The input device of claim 6, wherein the plurality of surrounding control zones surround the central control zone in a fan-shaped manner, and the fan-shaped angles of the plurality of surrounding control zones are 360 degrees. The smart input system of claim 6, wherein a separation line between the central control area and the plurality of surrounding control areas is displayed on the input interface for the user to recognize the location of each area. The smart input system of claim 1, wherein the central object and the plurality of surrounding objects are arranged in an irregular manner. The smart input system of claim 1, wherein the input device comprises a pointing device selected from the group consisting of a gyroscope, a gravity sensor, a trackball, a joystick, a touchpad or a touch screen. Used to control the movement of the target block. The smart input system of claim 1, wherein the movement of the target block is achieved by shaking the input device. The smart input system of claim 1, wherein the input interface is a touch surface. The smart input system of claim 12, wherein the movement of the target block is achieved by a user sliding on the touch surface. The smart input system of claim 13, wherein the user forms the central control at the sliding end point on the touch surface. Zone. The smart input system of claim 12, wherein the input action refers to a user clicking on the touch surface. The smart input system of claim 12, wherein when the user slides inwardly on the touch surface with at least two touch points, the plurality of surrounding objects included in the target block The number will decrease. The smart input system of claim 12, wherein when the user simultaneously slides outward on the touch surface with at least two touch points, the plurality of surrounding objects included in the target block The number will increase. The smart input system of claim 12, wherein when the user performs rotational sliding on the touch surface with at least two touch points, the object configuration in the target block can be configured from a vertical direction. Convert to a horizontal configuration or a horizontal configuration to a vertical configuration. The smart input system of claim 12, wherein when the user performs rotational sliding on the touch surface with at least two touch points, a first group of surrounding objects included in the target block The combination is transformed into a second set of surrounding object combinations that are also centered on the central object. The smart input system of claim 12, wherein the plurality of surrounding objects are distributed in a multi-layer arrangement around the central object, and the surrounding objects disposed in different layers are controlled by different touch commands. To enter. For example, the intelligent input system described in claim 20, wherein The plurality of surrounding objects include an object surrounding the first layer and an object surrounding the second layer. The objects surrounding the first layer are input in a single click manner, and the objects surrounding the second layer are input in a double click manner. The smart input system of claim 1, wherein the central object of the target block and the plurality of surrounding objects are objects having the same attribute. The smart input system of claim 1, wherein when the input action is performed, the input device transmits information about the position and direction in which the input action is performed to the electronic device. A smart input method for selecting a target object from a menu displayed on a display of an electronic device, the smart input method comprising the steps of: using an input device to point to one of the target objects in the menu a target block, wherein the object combination of the target block is dynamically formed according to a direction and a position pointed by the input device, the target block includes a central object and a plurality of surrounding objects located around the central object, and The target object is one of the central object and the plurality of surrounding objects; and setting a central control area on the touch surface of the input device to correspond to the central object in the target block, and according to the target object At the position of the central object, an input action is performed on a control area of the touch surface relative to a corresponding position of the central control area to select the target object. The smart input method of claim 24, wherein the target block is displayed in a highlighted area. The smart input method of claim 24, wherein the central object of the target block is presented in a visual manner different from other objects in the target block. The smart input method of claim 24, wherein the peripheral portion of the central control region of the input device is distinguishable into a plurality of surrounding control regions according to the configuration of the plurality of surrounding objects relative to the central object. The smart input method of claim 24, wherein the central object and the plurality of surrounding objects are arranged in an irregular manner. The smart input method of claim 24, wherein the moving of the target block is achieved by shaking the input device. The smart input method of claim 24, wherein the movement of the target block is achieved by a user sliding on the touch surface. The smart input method of claim 30, wherein the central control area is formed at a slip end point on the touch surface. A smart input method for selecting a target object from a menu displayed on a display of an electronic device, the smart input method comprising the steps of: pointing to the device in the menu by using one of the input devices a target block of the target object, wherein the object combination of the target block is dynamically formed due to the direction and position pointed by the device; and according to the distribution position of the target object in the target block, the input device A corresponding control area of one of the touch surfaces performs an input action to select the target object. The smart input method of claim 32, wherein the control area configuration of the touch surface corresponds to an object configuration in the target block. The smart input method according to claim 32, wherein the target block is displayed in a highlighted area. The smart input method of claim 32, wherein the moving of the target block is achieved by shaking the input device. The smart input method of claim 32, wherein the movement of the target block is achieved by a user sliding on the touch surface.