WO2013131410A1

WO2013131410A1 - Remotely-controlled digital menu and method of man-machine interaction thereof

Info

Publication number: WO2013131410A1
Application number: PCT/CN2013/000239
Authority: WO
Inventors: 朱曼平
Original assignee: Zhu Manping
Priority date: 2012-03-09
Filing date: 2013-03-07
Publication date: 2013-09-12
Also published as: CN103310391A

Abstract

Provided is a remotely-controlled digital menu and method of man-machine interaction thereof, an acceleration sensor and a touch pad being disposed on a remote control device. By means of mixed use of gestural control and touch control, the remote control device is easy to use, operable with one hand, and not prone to false triggering.

Description

Instruction manual

Remote control digital recipe and its human-computer interaction method

The invention belongs to an information technology product for a restaurant, in particular to a remote control digital recipe and a human-computer interaction method thereof.

Background technique

With the advent of the digital age, various digital information technology products for restaurants, such as wireless ordering devices, touch screen a la carte, electronic recipes, service pagers, private VOD (video on demand) systems, etc., have emerged. Wait.

The author puts forward a large size (usually 15) in the invention application "a table partner" (patent number 200820178106.0, hereinafter referred to as "invention A") for the various problems of the existing touch screen a la carte. -30" flat panel display, fully remote control, supported by a movable floor stand. This product is used to satisfy the ordering needs of restaurant customers when they eat, so it is called "remote control a la carte" (the name used in the application was not reasonable at the time of application). Customers can use the remote control to easily complete a variety of a la carte activities.

Invention A solves various shortcomings of the touch screen by replacing the touch operation mode with a remote controller: It is fragile, easy to lose, and cannot be used by many people. However, at the same time, Invention A has a disadvantage relative to the touch screen: The interface is not as friendly as the touch screen, and the restaurant customer does not have a touch screen when using it. The main reasons for this shortcoming are as follows:

(1) Even if the number of buttons on the remote controller is minimized, at least 10 buttons are generally required, such as up, down, left, right, left page turn, right page turn, and ok as mentioned in Invention A. Buttons such as cancel, operation, recipe/table switch, etc., otherwise it is difficult to complete all operations of the ordering cart with the remote control. However, the 10 buttons are also difficult for restaurant customers who have not used the remote control cart. When using it, the next step is to press which button often needs to be considered before continuing.

(2) It is more difficult to do not look at the remote control when operating the food cart. Since there are many buttons on the remote control, You must look at the remote control from time to time to know where to go.

(3), often press the wrong button, resulting in misuse.

(4) Generally, it is necessary to operate with both hands, otherwise it is difficult for one hand to quickly reach all the buttons at the same time. This makes it impossible for customers to order tea while drinking tea.

The present invention addresses the shortcoming of Invention A, and proposes a hybrid interaction method of a combination of a somatosensory operation and a touchpad operation, and allows the touchpad and the keyboard to share the same set of physical hardware, thereby solving the problem that the invention A is not easy to use. After adopting the solution of the present invention, the one-hand operation can be finally realized, and the remote control is not required to be read except for the input information, and there is almost no misoperation, and the operation can be operated without thinking, thereby solving the problem that the customer of the invention A is difficult to use and inconvenient to use. problem.

In addition, in addition to Invention A, the author is also in the patent application "A la carte remote control" (application number 2010202253878, hereinafter referred to as invention B), "a remote control a la cart" (application number 2011100544416, hereinafter referred to as Invention C), "A la carte remote control" (application number, 2011203937696, hereinafter referred to as invention D) and "remote control digital remote recipe for remote control readable card" (application number 2012201472735, referred to as invention E) Various improvements of the remote control of Invention A. The present application is directed to another improvement of the invention A. In fact, the presently best implementation method is to combine the contents of the present application and all the above-mentioned applications, and therefore the invention B is also mentioned or used in the invention. , Invention D and the technique in Invention E.

In addition, the invention also proposes a television-based ordering method (referred to as a "television recipe"). The human-computer interaction method described in the present invention is mainly directed to an interaction method between a remote controller and a host, and is obviously applicable not only to Dish cart, also TV recipes. The à la carte and TV recipes are collectively referred to as "remote control digital recipes."

Summary of the invention

"Host" as used herein and in the claims refers to portions other than the remote controller of Invention A. For the à la carte, it refers to the bracket and the components installed on it. For TV recipes, it refers to the ordering set-top box and TV. In this article, "recipe" is used instead of "recipe interface" in many places, "table" is replaced by "table", and "swaying" is replaced by "shaking". The invention provides a remote control order cart and a human-computer interaction method thereof, which are characterized in that:

The remote control digital recipe consists of a host and a remote control;

The display interface includes a recipe interface and a table interface; the recipe interface displays a plurality of dishes in the recipe, and the table interface displays a plurality of dishes in the menu; the screen displays a cursor, and the cursor stays on an operable object on the screen. ;

The remote control has an acceleration sensor and a touchpad;

The cursor moves by a straight line of the finger on the touchpad, and each time the line slides, the cursor moves in the direction of the straight line to the next next operable object;

When the cursor is stopped on a menu in the recipe or table interface and double-clicked on the touchpad, the menu of the cursor is enlarged;

After the menu is enlarged, when the remote control is tilted left or right or clicked on the touchpad, the menu is reduced; in the recipe interface, when the menu is enlarged, when the remote controller is tilted up and down, ask if you want to add the dish to the table;

When the cursor stops on a menu in the recipe interface and shakes the remote control up and down, ask if you want to add the food to the table;

When the cursor stops on a dish in the table interface and shakes the remote control up and down, ask if you want to delete the dish from the table;

When the cursor is stopped on an option in the multi-select dialog box, double-click the touchpad to select or cancel the item;

In the recipe or table interface, after the menu is enlarged, when the slide panel is slid up and down, the detailed introduction information of the menu is scrolled up and down; when sliding on the touch panel left and right, other pictures of the dish are displayed;

When any dialog box or context menu pops up, the remote control moves up and down to confirm, and the remote control moves left and right to cancel; When the remote controller is stable in the left tilt state, switch between the recipe and the table interface;

When the remote controller is stable in the right tilt state, a context menu pops up;

When the recipe interface is on and the remote controller is stable in the flip state, the menu menu is popped up; in the text input state, when sliding on the touchpad to the left, the last input character is deleted; when the cursor stays in the recipe interface On the leftmost (right) side of the object, if you slide straight to the left (right) on the touchpad, the recipe is turned to the right (left);

When the cursor is over the object on the top (bottom) side of the table interface, if it slides up and down on the touchpad, the table scrolls down (up);

When in the recipe interface and the finger rotates counterclockwise (following the pointer) on the touchpad, the recipe is turned left (right) by one page; when continuously rotated, the recipe is continuously turned;

The remote control has a keyboard; the keyboard has numeric and alphanumeric keys; the keyboard is implemented by one of three methods: a separate keyboard, a shared keyboard, or a virtual keyboard;

In the case of a separate keyboard, the keyboard keys are implemented by mechanical buttons or touch buttons; for the shared keyboard, the keyboard is a touch keyboard, and the touchpad is implemented by the same touch circuit, and the touchpad is printed with touch. Control button pattern, which can alternately slide, rotate, click, double-click and press on the touchpad;

In the case of a virtual keyboard, there is no keyboard on the remote control. When you need to input numeric or alphabetic information, the virtual keyboard is displayed on the screen; you can move the cursor to a virtual button by sliding it in a straight line, then click the touchpad to enter the key. The corresponding character, while the cursor automatically returns to the center of the virtual keyboard for the next input.

It is also characterized by: A Bluetooth transceiver is provided on the main unit, and the touch panel mobile phone with an acceleration sensor and a special software can be used to control the host, and the operation mode is the same as that of the remote controller.

The contents of the invention are specifically described below.

The feature of the operation interface of Invention A is that there is a cursor on the screen, and the cursor generally uses an animated icon (such as a GIF or FLASH animation) or an animation wireframe (the wire frame frames the currently operable object, and its size corresponds to the size of the framed object. And change) to achieve, so that it can attract customers' attention, through remote control The up, down, left and right buttons on the device move the cursor. When the cursor is over an item, you can perform various operations on the item. For example, if the item is a dish, you can use the OK button to enlarge the dish or add the dish to the table, or press the operation button (referred to as the "Menu button" in the description of Invention A) to pop up a context menu for the dish, and then Choose more actions.

The interface of Invention A includes a recipe interface and a table interface. The menu in the recipe interface lists the dishes in the recipe. Because there are many dishes, it is usually displayed in pagination. In the table interface, the dishes that the customer has ordered are listed. If there are too many dishes, only some of them are displayed and then scrolled to view other ordered dishes.

These are the contents of Invention A. For details, please refer to the specification of Invention A. The main content of the present invention is to replace the key operation in Invention A with a mixture of a series of somatosensory operations and touchpad operations.

The remote control is a flat cube. Here is a description of the six faces of the remote control in this article. As shown in Fig. 1, Fig. 2, Fig. 3 and Fig. 4, the side of the remote control (1) having the touch panel is referred to as the front side (6), and the other side of the remote control is referred to as the reverse side (8). Seen from the front (6), the head (2), tail (3), left (4) and right (5) of the remote control.

As described in Invention C, the remote control (1) can have a host interface (7) that allows the remote to conveniently establish a wireless connection with the host and also allows the wireless remote to be used as a wired remote. The host interface generally uses a USB interface mechanically (electrically generally uses RS232 signal lines). The host interface (7) in Figures 1 and 3 is implemented by a USB A-type male, so that the remote control can be like a U. The disc is inserted into the USB Type A female port on the main unit without cables. In addition, as described in the invention D, the host interface (7) can use the USB3.0 A type male head, and has the USB2.0 signal line and the RS232 signal line at the same time, thereby realizing the dual interface, and conveniently carrying out the recipe data through the remote controller. Update and transfer of a la carte results.

The remote control is used with one hand, and Figures 3 and 4 are typical implementations in which the human hand (9) is also drawn. With one-hand operation, the head of the remote control points to the display screen (actually, it can be seen from the following, without pointing to the display screen, the so-called pointing display screen is only convenient for explaining FIG. 5 to FIG. 12). This is only a typical implementation form, and it can be completely other forms when implemented. The touchpad (60) is also depicted in FIG. 4, and the touchpad (60) is generally implemented by 12 touch buttons (61) so that it can be used as both a touchpad and a touchbutton. In order to achieve somatosensory operation, the remote control should have an internal acceleration sensor, which should generally be a three-axis acceleration sensor. A two-axis accelerometer can also be used with special design. It is already a prior art to analyze the current tilt angle of the remote controller and the gesture action from the output of the acceleration sensor. The above-mentioned swaying and left and right swaying are all prior art, so this article will not elaborate on this. The acceleration of an axis is greater than a certain threshold in a short period of time (for example, within 0.1 seconds), and the tilt is calculated by the inductance of the three axes when the acceleration vector is stable. The various remote control somatosensory gestures in this document are described below.

The display screen (20) is shown in Figs. 5 to 12, and a part of the figure also indicates the display surface (21) of the display screen for clear direction.

Fig. 5, Fig. 6, Fig. 7 and Fig. 8 are schematic diagrams showing the positional relationship between the remote controller (1) and the display screen (20) in the order of upward tilting, downward tilting, left tilting and right tilting. Figure 5 and Figure 6 are side views in which the left portion of the remote control is seen. Figure 7 and Figure 8 are front views, i.e., views facing the display, where the tail of the remote control is seen.

Figure 9 and Figure 10 are schematic views of the lower jaw and upper jaw of the remote control. The angles of the two figures are identical to those of Figure 5, where the left side of the remote control is seen. Two remote controls are drawn in each picture, the position of the remote control at the beginning and end of the action, and the arrows indicate the direction of the sway.

Figure 11 and Figure 12 are schematic views of the left and right sides of the remote control. The two figures are top views, where the front of the remote is seen.

Figure 14, Figure 15, Figure 16, and Figure 17 respectively slide the finger up and down on the touchpad, slide left and right, rotate to the right (ie, slide clockwise), and slide to the left (ie, counterclockwise) Schematic diagram of sliding). The arrow in the figure is the sliding direction. The touch panel of the present invention generally refers to a capacitive touch technology under the current technical conditions, that is, a plastic circuit housing of the remote controller is internally provided with a touch circuit board having a capacitive touch sensor and a control chip. When the human hand touches the sensing area on the remote controller, the control chip can acquire the sensing value of each current sensor, so that the sensing value can analyze which button is currently pressed, or the position information of the finger on the touch panel. For specific implementations, see the description of Invention B and any touchpad technology that is currently available. The touchpad can use a technology similar to the high-precision touchpad used in notebooks (which is also costly and bulky). It can also be implemented with touch button technology with only a few channels. The invention generally uses touch button technology to implement the touchpad, and its accuracy is very limited, but it has fully met the requirements of use, that is, detecting the sliding motion instead of the precise sliding coordinates. As a high-end implementation, you can also use the high-precision touchpad on your notebook, which not only improves detection accuracy, but also enables advanced functions such as handwriting entry.

How to detect the linear sliding and rotating sliding actions on the touch panel are all prior art, as described in the general application manual of the capacitive touch control chip manufacturer. The method is generally: when the finger touches the touchpad, the touchpad detects and records the sliding track of the finger position, and then the sliding mode can be obtained according to the sliding track. The starting position of the sliding track is the position where the finger just touches the touchpad during the sliding process, and the ending position is the position where the finger is lifted up.

The invention realizes the operations of "determining", "yes", "joining the table", "delete from the table" by the up and down movement of the remote controller, and realizing "cancellation", "no", etc. by using the right and left movement of the remote controller operating. Since the up and down movements and the left and right movements are very similar to the "nodding" and "shaking the head" respectively, they are also very vivid, and the user is very easy to adapt, and the correct operation can be performed by feeling.

Specifically, when the cursor is stopped on a menu, when the remote controller moves up and down, a dialog box pops up asking if you want to add the dish to the table. If you move left or right in the dialog box, cancel it, and then move up and down. Will be sure to add this dish to the table.

When the cursor stops at a certain dish on the table, when the remote control moves up and down, a dialog box pops up asking if you want to delete the dish from the table. If you move left or right in the dialog box, cancel it, and move up and down to confirm and delete the dish from the table. It should be noted here that the way to delete the dishes by shaking up and down in the table interface is easy to cause confusion for the user, because the up and down movement is similar to the nodding, and should not be a delete operation. Therefore, you can also switch to the remote control pop-up dialog box in the table to ask if you want to delete the dishes.

In addition, in any dialog box (the so-called dialog box refers to the pop-up window, when the dialog box is displayed, the input focus of the system is on the dialog box instead of the interface behind the dialog box. The context menu is actually a kind of dialogue. In the box), the meaning of the left and right movements is to cancel and exit the dialog box. The meaning of the up and down movement is to confirm and exit the dialog box, so it has a unified meaning in the whole system, making the operator easy to adapt. As for the meaning of cancellation and determination, the various dialog boxes are different. For example, for a single-select or multi-select dialog, the meaning of the determination is to finally select the item you just selected. For the context menu, OK The meaning is to perform the selected operation. For the information prompt dialog, the determination has no meaning, just the exit dialog.

The invention realizes the movement of the cursor on the screen by linear sliding of the finger on the touch panel. When the finger slides in either direction on the trackpad, the cursor on the screen moves in that direction to the next next object. It should be noted here that the objects on the screen are not necessarily regularly distributed. As shown in FIG. 13, the screen (70) displays (71) ~ (75) a total of 5 objects (for example, 5 dishes). . The shape and position of each object is arbitrary. Assume that the current cursor stays on the object (73). At this time, when the finger slides obliquely in the upper right direction on the touch panel (60), if it slides along the track (77), the cursor moves to the object (74). Since the sliding trajectory (77) points in a direction closer to the object (74), similarly, if slid along the trajectory (76), the cursor moves to the object (72). In short, the cursor moves to the closest object in the direction of the finger's swipe. As for how to judge the closest object, it is completely determined by the algorithm used in the implementation. This does not need to be very strict, because the direction of the sliding of the customer's finger is inherently inaccurate. If the cursor does not move to the target object that the customer needs, the customer will slide again to move the cursor again until the cursor moves over the target object. A simpler algorithm is that each object has an anchor point (the choice of anchor point varies according to the specific algorithm, for example, you can select the center of the smallest rectangle that can frame the object as an anchor point), that is, analysis When moving a target object, treat each object as a point, ignoring the specific size and shape of the object. Then, find the object formed by the anchor point of all the objects and the anchor point of the object where the current cursor is located, and the object with the smallest angle of the current sliding direction. This object is the moving target object of this time. A more complex algorithm also considers the distance of the target object from the current cursor object. The distance can also be measured by the anchor distance. A weighted average can be taken with the angle and distance. The object with the smallest average is the target moving object.

In addition, as can be seen from Figure 13, the sliding of the customer's finger on the touchpad of the remote control corresponds to the sliding on the display screen, i.e., the tracks (76) and (77). The data sent by the remote controller to the host is not the sliding track itself, but only the inclination of the sliding, that is, the remote controller analyzes the inclination according to the detected trajectory and transmits the inclination to the host. In Fig. 13, an xy coordinate system is drawn for each of the lower left corners of the remote controller (1) and the screen (70). The two coordinate systems are moved along with the remote control and the screen, for example, on the remote control, the X axis is always along the tail of the remote control, and the y axis is always along the left side of the remote control. The x-axis on the display is always along the bottom edge of the screen, and the y-axis is always along the left side of the screen. When the customer slides on the touchpad of the remote control, the software on the remote controller analyzes the tilt of the current slide relative to the xy coordinates on the remote control, such as the tilt angle relative to the X axis, and then the remote controller sends the tilt angle To the host, after the host receives the tilt angle, the obtained sliding track is obtained with respect to the X-axis of the xy coordinate on the screen and the received tilt angle.

In addition, it is also possible to move across a plurality of objects according to the length of the sliding straight line. For example, in Fig. 13, when the customer slides along the trajectory (77), if the sliding distance is relatively short, the cursor moves to the object (74), and if the sliding distance is long, the cursor skips the object (74). Move directly to the object (75). However, this method of moving quickly across objects is not recommended because it is more likely to cause false movements, such as the object that the customer would like to move to the right, but the result moves to the right object on the right. It is still preferred to move only to adjacent objects each time, so that the customer does not have to go through the brain and slide directly in all directions with the big thumb. If you want to support this leaping movement, when the line slides, the remote control not only sends the inclination of the sliding track of the host, but also sends a step parameter (such as 1 or 2). Then, after receiving the two parameters, the host first calculates a distance (in pixels) according to the step size. This distance is related to the currently used screen resolution. The higher the resolution, the higher the distance corresponding to the single step. Big. Then you can directly calculate the pixel coordinates of the moving target point, and then find the object whose anchor point is closest to the target point.

In addition, the remote controller can also determine the button message to be triggered according to the inclination angle, for example, up and down, and send the button message to the host instead of sending the tilt angle to the host. In fact, if you do not use a high-precision touchpad, you can't detect the exact tilt angle at all. At this time, you can only determine the up, down, left, and right directions and support the movement of the cursor in these four directions. In this case, the tilt angle is sent to the host. It doesn't make sense, just send the key message from the analysis.

It can be seen that the linear sliding operation of the touchpad can achieve the following objectives: The movement of the cursor does not interfere with the somatosensory operation. When performing the somatosensory operation, it is necessary to forcefully move. Therefore, as shown in Fig. 3, the thumb must be pressed on the remote controller. On the other hand, for the convenience of use, the touchpad must also be in the position of the thumb, so that the somatosensory operation and the cursor movement operation can be quickly alternated without using the remote controller when using. Since it is necessary to slide to generate an action, while the thumb is touching the touchpad while performing the somatosensory operation, there is no obvious sliding operation, and thus the movement of the cursor is not accidentally triggered. It can be seen that when using the present invention, the above operation can be easily realized with one hand, neither Need to think more, do not need to find the button on the remote control, and will not press the wrong button.

There are many places in the present invention that need to move the cursor: dishes in the recipe; dishes in the table; items in context menus (such as ContextMenu in Android); items in the single-selection dialog (actually the context menu can also be considered A radio dialog box; multi-select items in the dialog box. In short, if there are multiple objects and you can move the cursor, you can use a straight line to move the cursor. Whether it's a context menu, a single-select dialog, and a multi-select dialog, it's essentially a dialog that lets the operator select one or more items. The dialog box lists a number of optional items, which can be one per line (for example, ListView in Android) or multiple rows and columns (for example, GridView in Android). In fact, multiple rows and columns are better than one per row, because this allows you to move to any target object as quickly as possible. For example, if there are a total of 9 optional items, if there is one line per line and the current cursor stays at the 5th item, if you want to move to the 1st or 9th item, you need to move 4 times. If you use 3 rows and 3 columns, you can move to any project with up to two moves. If it is one per line, you only need to use the up and down slide to move the cursor. If it is more than one row and multiple columns, the sliding in all four directions is all needed.

When you are in the state of entering text (for example, in the search dialog or the dialog box for entering a password), when you swipe left on the trackpad, the last character entered is deleted. That is to say, sliding to the left plays the role of backspace, which eliminates the need for a special backspace key on the keyboard. The invention realizes zooming in and out of a picture by clicking and double-clicking on the touch panel, and selecting multiple options.

When the cursor is over a recipe or a dish on the table, if you double-click the trackpad, the menu where the cursor is located is enlarged. After the menu is enlarged, click on the touchpad to zoom out. The so-called enlargement here refers to pop-up (generally an animation pop-up, such as 3D rotation fly-out, so called "magnification"). A dialog box that almost fills the entire display. This dialog box displays a large picture and detailed information of the menu ( Such as taste, cultural background, etc.). Before zooming in, the thumbnail of each menu is displayed along with the name and price of the menu, so that more dishes can be displayed on the screen. For example, 6~10 dishes can be displayed per page. "Zoom out" refers to the process of exiting the dialog box animation. Obviously, you can also zoom in by clicking, but it is easy to misuse, because the finger is usually close to the touchpad, and a slight click may cause a click event.

Obviously, when the picture of the dish is enlarged, the left and right sides of the remote control can also zoom out, because a dialog box is displayed when zoomed in, and as described above, when in any dialog box, shake left and right. The meaning is canceled. When the picture is enlarged and shaken up and down, you can also ask if you want to add this dish to the table, that is, you can either shake it up and down directly into the table, or double-click to enlarge and then shake it up and down to join the table. Automatically exit the enlarged dialog box and then join the table).

In the multi-selection dialog, in addition to using a linear swipe to move the cursor to each of the options, double-click to select or remove the option. When you double-click on any of the options, the selection state of the option will be reversed (generally by checking the item on the item or removing the check to give feedback to the operator). Similarly, you can also change the double click to click here, at the cost of possible misuse. In addition, where there is no cursor, a linear slide on the touchpad can be used to scroll the content. For example, when in the dialog box for zooming in on the menu, sliding up and down can be used to scroll through the introductory information next to the image (obviously the premise is that there is enough information to appear scroll bars), while sliding left and right to view other images of the dish (eg Close-up of other angles, etc.). The invention also realizes page turning of the recipe by the sliding sliding of the finger on the touch panel. Turn one page per revolution, turn to the left to page to the left, and rotate to the right to page to the right. Continuous rotation turns pages continuously. The term "continuous page turning" as used herein means that the specific implementation of the present invention generally takes the form of a 3D page turning, that is, a page that seems to be a printed recipe has been turned over, and when the page is continuously turned, if the page is turned over, Just turned up but not completely turned over. If you have rotated it on the remote for a week, the next page will start flipping, which means that there will be multiple pages at the same time being flipped at the same time, just for each page. The "phase" is different, and it seems to be the feeling that the book is blown by the wind and multiple pages are picked up in turn.

In addition, it is also possible to rotate a half turn to turn a page, or the first turn is a turn to turn a page, and if it continues to rotate, it is a half turn to turn a page, thereby preventing false triggering (rotation of a half turn is easily confused with linear slide).

Since the action of tilting the remote control left and right in the recipe is not currently used for other operations, it can also be used for page flipping, that is, the left turn to the left and the right to the right. If the cursor is already on the leftmost menu of the screen, if you slide it to the left on the touchpad, it means to move the cursor to the left, but it is already on the far left, so it should be automatically turned to the front. One page, "Right Page" (turn right to go to the previous page). There is a similar treatment for the case where the cursor has stayed at the far right of the screen. In addition, there is a similar treatment in the dining table, that is, if the cursor has After reaching the edge of the screen, if you continue to move the cursor, it will automatically scroll one line. The difference between the recipe and the table here is that the recipe is presented in the form of a page, usually with a 3D page turning effect, just like browsing a printed recipe. If there are too many dishes in the table, it is usually implemented in the form of scrolling. Therefore, in the recipe, the page is automatically turned to the side, and in the table is automatically scrolled to the side. In this way, the operator does not need to rotate the page to turn the page during the browsing process, because the page can be turned by sliding the left and right lines on the touch panel one to two times. Rotating and sliding is actually more for continuous page turning. At this time, if you use a straight line to slide, it is very slow, and the rotary sliding can perfectly achieve a quick page turning: one page for each slide, and a fast turn It's also fast, it can be fast and slow, for example, flipping to the target can slow down the rotation speed. After turning the page, you can automatically place the cursor on the menu in the center of the screen, so that you can reach the fastest one regardless of which menu you want to move the cursor to.

The present invention uses the tilt of the remote control to effect switching operations between different interfaces. For example, when the remote is tilted to the left (for example, when the tilt angle is between 50 and 90 degrees), switch between the recipe/table (or switch to the table if the recipe is currently, and vice versa). In order to prevent confusion between tilt and tilt, the tilt should be checked to ensure that the remote control is in steady state, that is, the acceleration vector is small enough in a certain period of time (for example, 0.5 seconds) (ie, x, y, z three axes) The range of acceleration values is less than a certain threshold, such as 0.1 g, where g is the gravitational acceleration, and the modulus of the acceleration vector is close to g. Obviously, when staying in the tilt state for a long time, the interface should not be switched continuously, but the interface must be restored from the tilted state to the non-tilted state and then the tilted state again to switch the interface again.

In addition, it is also possible to pop up an interface for selecting a target interface after tilting, and then enter the target interface after selection.

In addition, as a weakening implementation, interface switching can also be done with buttons, which is similar to Invention A, but the problem is that it is easy to trigger by mistake (because the hand often clicks or double clicks on the touchpad, it is easy to press the button ), and you must look at the remote control when you press it. The present invention also implements a pop-up context menu with the tilt of the remote control. When the cursor stays at some actionable On the object, if the remote control is stabilized to the right (for example, the inclination of 50 degrees to 90 degrees) for a long enough time, the context menu for the object where the cursor is located is popped up.

Bringing up the context menu can also be done with a long press on the trackpad similar to a typical tablet. However, because it is different from a tablet computer, the operator may press the remote controller for a long time with a slight carelessness, which is very easy to trigger by mistake, so this method is not recommended. In addition, it is also possible to use the special button to call up the context menu, but there is still a false triggering problem, and the remote controller must be looked at to do this.

After the context menu is called up, it is the same as described in this article. Select the operation item to be performed by sliding up and down on the touchpad, then shake it up and down to confirm execution, and then shake it left and right to cancel. In order to quickly move the cursor to the desired item, the context menu can also take the form of multiple rows and columns instead of the traditional menu form.

In addition, if the action of tilting the remote control left and right in the recipe and the table is not used for other operations (such as flipping pages, deleting the table menu), the left and right panning can also be used to call up the context menu, but the disadvantage is that it may False triggering, so you can switch to the left and right continuously to shake the context menu twice. It is also possible to pop up different context menus with different tilt angles. For example, the left tilt is the interface switch, the right tilt is the pop-up basic context menu, and the flip (ie, the tilt angle is about 180 degrees) the remote control pops up the recipe list menu, and the operator can jump directly to a menu through the recipe menu. It can be seen that the interface operation is implemented in a tilted manner, which is not only easy to use, but also can be operated without looking at the remote controller. In fact, the switching between the general recipe and the dining table is realized by rotating the 3D horizontally by 180 degrees, that is, like a piece of paper, the front side is the recipe interface, and the back is the table interface. The rotation of the recipe and the table is realized every time the rotation is 180 degrees. . In other words, as long as the wrist is rotated 90 degrees to the left, the interface on the screen is rotated by 180 degrees, which is similar to the movement of the hand, so it is easy to adapt. Most of the operation of the present invention can be realized by the body feeling and the touchpad, and the remaining operations are inputting information such as the number of input dishes, the operation password, the search, etc., which must be implemented by a keyboard.

The first implementation is the on-screen keyboard. In order to adapt to the form of the present invention, the present invention proposes the following solutions: First, the buttons on the screen keyboard should be as small as possible, thereby ensuring that the cursor can be quickly moved to the desired virtual button. Generally, a 12-key similar to a mobile phone is recommended. Keyboard, not full keyboard. First Second, the cursor stays in the center of the keyboard by default, so that the cursor can be moved to any of the screen buttons by a cursor movement operation (the method of moving the cursor is as described above). Third, when you have moved the cursor over the screen button you want to enter, click on the trackpad and you will finally enter the character corresponding to the key, such as a number or letter. After input, the cursor will automatically return to the center screen button again, waiting for the next move cursor operation. In addition, you can also press the same button multiple times to input English characters, similar to the phone keyboard, such as the button "labc", click the first time is 1, immediately press the second time is a, immediately press the third time is b. There should also be a delete button in the virtual keyboard to delete the last character that has been entered (for example, when entering an error).

A more preferred implementation is still to have a real keyboard directly on the remote. However, if there is a touchpad and a separate keyboard, the cost is higher, the size of the remote controller needs to be larger, and it is very troublesome to switch back and forth between the touchpad and the keyboard. The present invention proposes a special design that allows the keyboard and touchpad to be implemented based on a common set of touchpad hardware, and can also work simultaneously. As shown in Figure 4, the remote control (1) has 12 touch buttons (61), thus forming a standard mobile phone keyboard, namely 1, 2abc, 3def, 4ghi, 5jkl, 6mno, 7pqrs, 8tuv, 9wxyz and 0, the remaining two keys can be used as other functions, such as entering a decimal point and backspace (as mentioned earlier, the better way to backspace is to slide straight to the left). This keyboard can be used to quickly enter numbers, letters, and passwords, much more convenient than the on-screen keyboard. At the same time, the 12 buttons form an array that can be used to implement a touchpad (60). Although this touchpad has much lower precision than the touchpad on the notebook due to its small number of sensing channels, it has been enough to recognize linear sliding and rotational sliding. The essence of the touchpad is to get the position of the finger on the touchpad. As the finger touches a touch button (61), the touch sensor's touch sensitivity value is stronger (for the principle of capacitive touch button, please refer to the documentation of any capacitive touch control chip), so obviously through 12 touches The sensitivity of the button is strong (the sensing value here and later is a relative sensing value, because the physical location of each key will cause the maximum sensing value of the finger on each key is not the same, relative sensing The value is the current absolute sensing value divided by the maximum sensing value of the key), and the approximate position of the current finger on the remote control can be estimated. The simplest solution is to detect the coordinates of the button as the current track coordinates when it is detected that the finger is on a button (expressed that the button has a much larger sensor value than the other button). A more complicated way is to consider that if the sensing values of the two touch buttons are close to each other and far greater than the sensing values of the other buttons, the position of the finger in the center of the two touch buttons can be determined, if the sensing values of the four touch buttons are Close At the same time, it is larger than the sensing value of other buttons, and the position of the finger in the center of the four touch buttons can be determined, thereby doubling the position accuracy. By acquiring the position of the finger, the sliding trajectory of the finger can also be obtained, so that the various functions described above can be realized. It should be noted here that the premise of using the touch keyboard as the touchpad is that the distribution of the keys is dense, so that the sensing value of one or more keys can be made large enough regardless of the position of the thumb on the keyboard. When the thumb slides to a place where there is no button, it is misjudged that the finger has left the keyboard, and the sliding track cannot be effectively detected. With this design, the keyboard and the touchpad are the same part and can work at the same time, that is, if the remote control detects that the finger is touched (the touch value of any touch button is greater than a threshold, it is determined that the hand touches the touchpad) After the control board is directly lifted up (all touch buttons are less than the threshold value), it is considered to be a button operation or a click operation (the touch point is a button operation if it is a button, and if it is a button gap, it is clicked ), will send a button to the host or click on the event message. If the finger touches the touchpad and does not lift it but moves it long enough, it is considered to have started a sliding operation, and then it will send a message to the host sliding event (for linear sliding, after the hand is finally lifted up) Sending, for rotary sliding, it will be sent continuously during the rotation, for example, one message is sent one rotation, and it is obvious that if one touch process detects the rotation slip, it will not detect any linear sliding). It can be seen that during the usual operation, the customer often inadvertently triggers the button operation and the click operation (for example, the thumb occasionally touches the touchpad), but this does not affect the normal use at all, because there is no need in the recipe, the table, etc. Where the character is entered, even if the customer inadvertently touches the touchpad, then the remote control sends a key event message to the host, which has no effect, because the button message does not work at all. That is to say, the remote controller does not need to care about the state of the host. As long as the customer presses the button, the corresponding button event message is sent to the host. As long as the customer's finger slides, the sliding message is sent, but whether the message works or not is determined by the host. : Only the current interface is in the place where the information is entered (for example, in the search dialog), and the button message sent to the host will take effect. It can be seen that this design seamlessly integrates the keyboard and the touchpad, and the user can easily use it without any brain movement, and always only needs a thumb to operate.

In addition, in some places, the keyboard and touchpad can be used simultaneously. In the present invention, there is a search for a live frame (for example, searching for a dish, a table or a request), which is characterized by a text box (such as Android's EditText), a search keyword can be input in the text box, and a list box is shown below. (such as Android's ListView), display search results. When entering text in a text box, search in the list box The result will change. In this search dialog, you can alternate between the keyboard and the trackpad. For example, first enter the character a and the character b. At this time, the search result that matches "ab" is displayed in the list box. For example, there are 5 results. At this time, you can move the cursor to the desired search result by sliding up and down on the touchpad. Go up the project. After moving the cursor, I suddenly found that this is not the desired result. I want to change the search condition to "ac". In this case, you can slide directly to the left on the touchpad (thus deleting the last character) and then enter c. The search condition is changed to "ac", and the contents of the list box have changed. You can move the cursor to the desired target by swiping up and down again. Finally, scroll up and down to confirm the selection or left and right to cancel. It can be seen that in the search dialog box, the key operation will always be input into the text box, and the moving operation of sliding up and down is always used to operate the cursor position in the list box, and sliding to the left is used to delete the last of the text box. One character. The two operations can be performed simultaneously and alternately without interfering with each other.

The implementation of the above-mentioned button and touchpad sharing the same set of physical hardware is based on a 12-channel touch button, which has the lowest cost and volume, and is fully satisfactory, and is therefore a preferred solution. However, it is obvious that this function can also be realized with a high-precision touch panel (which is essentially a detection channel), that is, the remote control has a built-in notebook high-precision touch panel, as long as 12 touch panel sensing areas are drawn on the remote control housing. Just press the button. The difference between the touch button and the method is that the touch panel is used as the keyboard at the same time, and the former uses the touch keyboard to simultaneously serve as the touch panel. Either way, the sensing area can be viewed as either a trackpad or a touchpad. After adopting the solution of the present invention, as long as the remote controller is held by hand, sliding, clicking and double-clicking on the touchpad by tilting, tilting and thumbing can complete all operations of the remote digital recipe, and most of the operations are performed. It is similar to people's habits and feelings, because it is very easy to get started. In addition, you can see that if you only browse the recipe (this is the most important operation in the ordering process), the operator only needs to move the thumb to complete all the operations of moving the cursor, turning the page, and zooming in. The operator can order tea while drinking tea in the most comfortable posture. In addition, if a Bluetooth transceiver is added to the host, the existing touch screen smartphone with an acceleration sensor can also function as a remote controller. The mobile phone is connected to the host via Bluetooth. Since the mobile phone has an acceleration sensor and a touch screen, the mobile phone can also be considered as an embodiment of the present invention. The touch screen of the mobile phone is a touch panel, and a virtual button similar to that of FIG. 4 is displayed on the touch screen. Obviously you need to install one on your phone. A special software that detects the touch and accelerates the state of the sensor and sends the test result to the host in the manner described above, so that the phone and the remote control are identical for the user. Moreover, the touch screen on the mobile phone is equivalent to a high-precision touch panel, and can also implement advanced functions such as handwriting or full keyboard. In addition, if the "remote control wireless transceiver circuit" in the "Cluster Module" of Invention A is implemented by Bluetooth, there is no need to add a separate Bluetooth transceiver device. In this case, the mobile phone can be connected to the remote controller through Bluetooth at the same time. The host is gone. Finally, it can be seen that the present invention can be used in virtually any place where a remote controller is required, such as a smart TV set, a set top box, etc., which can achieve very easy operation with a compact remote controller.

DRAWINGS

Figure 1 is a front elevational view of an embodiment of a remote control.

Figure 2 is a side view of an embodiment of a remote control.

Figure 3 is a schematic illustration of the manner in which the remote control is held.

4 is a schematic diagram of a touch panel simultaneously using a touch keyboard on a remote controller.

Figure 5, Figure 6, Figure 7, and Figure 8 are schematic views of the tilt of the remote control.

Figures 9 and 10 are schematic views of the remote control being tilted up and down.

Figure 11 and Figure 12 are schematic views of the left and right tilt of the remote control.

Figure 13 is a schematic illustration of moving a cursor on a screen by linear sliding of the trackpad.

Figure 14, Figure 15, Figure 16, and Figure 17 are schematic views of the sliding manner of the touch panel.

detailed description

Figure 4 shows a preferred embodiment of the invention, the specific design of which is also described in detail above. In addition, please refer to the descriptions of Invention B, Invention C, Invention D, and Invention E. In general, the contents of these inventions are also added. The invention makes it possible to brush the waiter card and the table card on the remote controller, thereby eliminating the need to input the waiter management password and the table number, further improving the ease of operation, and enabling the member to swipe the card.

The MCU on the remote control will send various kinds of wireless to the host according to the customer's operation of the remote controller. Messages, such as button messages, line slide messages, rotate slide messages, click messages, double-click messages, tilt messages, up and down messages, left-hand messages, right-hand messages, etc., the host updates the display based on these messages The interface content thus ultimately achieves human-computer interaction. Obviously, if the clicked position is a touch button, a button message is issued; if the click position is at a non-key position, for example, a gap between two buttons, a click message is issued. Therefore, for places that need to be manipulated with a click (for example, the zoom-out operation after zooming in on the menu), the click and all button messages should be detected, since obviously the button message itself is also a click.

In order to implement the functions described herein, the interface must have a special design. For example, if the operating system used is Android, the corresponding event sliding to the left is KeyEvent.KEYCODE-DPAD_LEFT. For Android text box control EditText, the default KEYCODE_DPAD_LEFT behavior is to move the cursor to the left, so this default behavior must be modified, that is, when KEYCODE_DPAD_LEFT is received, instead of moving the cursor to the left, the last character is deleted. Further, sliding to the left does not necessarily have to correspond to KeyEvent.KEYCODE_DPAD_LEFT, and any other key event can also be used, for example, KeyEvent.KEYCODE_A. However, the application software on the host must respond accordingly to the corresponding message. For example, if the event generated by sliding to the left is KeyEvent.KEYCODE_A, the response of EditText to KeyEvent.KEYCODE_A should be changed to delete the last character instead of input. Letter A. The system is an embedded system, and the software is generally closed and fully customized. Therefore, as long as the software and the remote controller on the host are matched, as to what kind of message mapping method and how the message is transmitted to the host software, It can be flexibly designed. In fact, as described in Invention A, there is a remote control wireless transceiver circuit corresponding to the remote controller in the host, and the circuit is generally connected to an application processor (generally an ARM architecture) in the host through an I2C or SPI interface, and the operation on the host. There will be a corresponding keyboard driver on the system, that is, for the application software on the host, the remote controller is just a keyboard. When any touchpad and somatosensory operation is performed on the remote controller, the final host application software will receive it. Keyboard messages, as long as the host application software, drivers, and microcontroller software on the remote control are compatible, the correct functionality described in this article can be achieved.

Claims

Claim

1. Remote control digital recipe and its human-computer interaction method, which are characterized by:

The remote control digital recipe consists of a host computer and a remote controller; the display interface includes a recipe interface and a table interface; the recipe interface displays the thousands of dishes in the recipe, and the table interface displays several dishes in the menu; a cursor is displayed on the screen, the cursor Stay on an actionable object on the screen;

The remote control has an acceleration sensor and a touchpad; the cursor moves on a straight line of the finger on the touchpad, and each time the line slides, the cursor moves in the direction of the straight line to the next next operable object. When the cursor is stopped on a menu in the recipe or table interface and double-clicked on the touchpad, the menu of the cursor is enlarged;

When the cursor is stopped on an option in the multi-select dialog box, double-click the touchpad to select or cancel the item; in the recipe or table interface, after the menu is enlarged, when sliding up and down on the touchpad, the menu Detailed information scrolling up and down; When sliding on the touchpad left and right, other pictures of this menu are displayed; When any dialog box or context menu pops up, the remote control moves up and down to confirm, and the remote control moves left and right to cancel; When the remote controller is stable in the left tilt state, switch between the recipe and the table interface;

When the cursor stays on the top (bottom) side of the table interface, if you slide up and down on the trackpad, the table scrolls down (up); when in the recipe interface and the finger is in touch On the board counterclockwise (following the pointer), the recipe is turned left (right) every one rotation; when continuously rotated, the recipe is continuously turned; the remote control has a keyboard; the keyboard has numbers and letters; the keyboard passes One of three ways of independent keyboard, shared keyboard or virtual keyboard;

2. The remote-controlled digitized recipe and the human-computer interaction method thereof according to claim 1, wherein: the host has a Bluetooth transceiver device, and the host can be controlled by a touch screen mobile phone with an acceleration sensor and a specific software. The operation mode is the same as that of the remote control.