WO2011140752A1

WO2011140752A1 - Electronic device and method for obtaining user operation

Info

Publication number: WO2011140752A1
Application number: PCT/CN2010/075915
Authority: WO
Inventors: 刘雪芹
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-05-12
Filing date: 2010-08-11
Publication date: 2011-11-17
Also published as: CN101833421A

Abstract

An electronic device and a method for obtaining the user operation are provided in the present invention, the electronic device includes: a display module, for displaying virtual track ball on the screen of the electronic device; a receiving module, for receiving the touch operation of a user on the virtual track ball; an instruction generation module, for generating a motion instruction according to the touch operation; a response module, for performing treatment responding to the motion instruction. The present invention can not only provide track ball operation function to users, but also reduce the cost of electronic device as most as possible.

Description

TECHNICAL FIELD The present invention relates to the field of communications, and in particular to an electronic device and a method for acquiring user operations. BACKGROUND OF THE INVENTION In an increasingly competitive electronic market, in order to improve user risk, manufacturers have configured physical trackballs on more and more electronic devices to provide users with a mouse-like mouse on an electronic device. Features. It turns out that the physical trackball is consistently sought after by users and is considered a high-priority configuration option for high-end electronic consumption. In the open source Android OS system supported by the OHA Alliance, it can provide better support for the trackball. The OHA Alliance's compatibility requirements also recommend supporting the operation of the trackball as much as possible. A schematic diagram of an electronic device with a physical trackball (specifically, an Android OS wireless terminal) is shown in FIG. 1, which includes: a touch screen 1, a physical trackball 2, and a physical button 3, and the illustrated physical button 3 includes a MENU. (Menu;), HOME (Home) and BACK (Return) Three Android system essential function keys. However, the cost of such a physical trackball is high, which inevitably increases the cost of electronic equipment, resulting in a decline in the competitiveness of the product. SUMMARY OF THE INVENTION A primary object of the present invention is to provide an electronic device and a method of acquiring user operations to at least solve the above problems. An aspect of the present invention provides an electronic device, including: a display module, configured to display a virtual trackball on a screen of the electronic device; a receiving module, configured to receive a touch operation of the virtual trackball by the user; and an instruction generating module, configured to: Generating an action instruction according to the touch operation; and a response module, configured to perform processing in response to the action instruction. Further, the electronic device further includes: a determining module, configured to determine whether an area in which the user performs the touch operation is within a range of the area where the virtual trackball is displayed; and the receiving block module is configured to: when the determining result of the determining module is yes, Receive user's touch operation. Further, the response module includes: an update module, configured to update the display of the virtual trackball according to the action instruction. Further, the response module includes: a first determining module, configured to determine a linear trajectory generated when the action command acts on the virtual trackball; and a second determining module, configured to determine an end point of the corresponding trajectory of the linear trajectory on the screen; Used to determine the target point selected by the user as the end point. Further, the response module includes: a third determining module, configured to determine an operation direction corresponding to the motion instruction; and a focusing module, configured to control a focus of the control on the interface according to the operation direction. Further, the response module includes: a fourth determining module, configured to determine an operation direction corresponding to the motion instruction; and a cursor control module, configured to control a position of the cursor in the editing interface according to the operation direction. Further, the electronic device further includes: a setting module, configured to accept a setting of the user, wherein the setting includes at least one of the following: setting the opening or closing of the virtual trackball, setting the sensitivity of the virtual trackball, and corresponding to the action The settings of the processing, the setting of the size of the virtual trackball, and the visual effect of the virtual trackball. Further, the setting module is further configured to display an interface for receiving the setting of the user if the action instruction is consistent with the preset action instruction. Another aspect of the present invention provides a method for obtaining a user operation, comprising the steps of: causing a screen of an electronic device to display a virtual trackball; receiving a user's touch operation on the virtual trackball; generating an action instruction according to the touch operation; The instructions are processed. Further, the foregoing processing includes: updating the display of the virtual trackball by the action instruction. Through the invention, the display module of the electronic device causes the screen to display the virtual trackball, the receiving module receives the user's operation on the virtual trackball, the command generation module generates an action instruction for the operation, and the response module responds to the action command to process the process, and receives the user The operation on the virtual trackball displayed on the display screen, and executing the corresponding instruction of the operation, solves the problem of high cost of the electronic device in the related art, can provide the trackball operation function for the user, and minimize the cost of the electronic device. . BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are set to illustrate,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, In the drawing: 1 is a schematic structural diagram of an electronic device with a physical trackball in the related art; FIG. 2 is a structural block diagram of an electronic device according to an embodiment of the present invention; FIG. 3 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention; 4 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention; FIG. 5 is a block diagram 3 of a preferred structure of an electronic device according to an embodiment of the present invention; FIG. 6 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention. 7 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention; FIG. 8 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention; FIG. 9 is a schematic diagram of a method for acquiring a user operation according to an embodiment of the present invention; 10 is a schematic diagram of an electronic device according to Embodiment 1 of the present invention; FIG. 11 is a flowchart of a process for receiving an operation of an electronic device according to Embodiment 2 of the present invention; FIG. 12 is a flowchart of Embodiment 4 according to Embodiment 4 of the present invention; Flow chart of virtual trackball processing under each scene. BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. The electronic device can provide various application functions for the user, and generally includes: an output module (including a screen, a sound output module, etc.), an input module (including a keyboard, a physical trackball, etc.) and a processing module, and the following embodiments are The electronic device ^ has been improved. 2 is a structural block diagram of an electronic device according to an embodiment of the present invention, including: a display module 22, configured to display a virtual trackball on a screen of the electronic device; and a receiving module 24 coupled to the display module 22, configured to receive a user-to-virtual track The touch operation of the ball; the command generating module 26 is coupled to the receiving module 24 for generating an action command according to the touch operation; the response module 28 is coupled to the command generating module 26 for processing in response to the action command. In the related art, the electronic device is equipped with a physical trackball for simulating the operation of the mouse. However, since the physical trackball includes a mechanical structure, and the operation of the mechanical structure is also converted into an electrical signal, the cost is high, resulting in an electronic device. The cost is high. An embodiment of the present invention provides an improved electronic device that causes a screen to display a virtual trackball through the display module 22. The receiving module 24 receives an operation of the virtual trackball by the user, and the command generation module 26 generates an action instruction for the operation, and the response module 28 In response to the action command, the virtual trackball with the same function as the physical trackball is realized by the touch screen, which can achieve the same effect as the physical trackball and reduce the cost of the electronic device. 3 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention. As shown in FIG. 3, the device may further include: a determining module 32 coupled to the display module 22 for determining that the user performs a touch operation. Whether the area is within the range of the area in which the virtual trackball is displayed; the receiving block module 24 is configured to receive the touch operation of the user if the determination result of the determination module 32 is YES. By judging the judgment process performed by the module 32, the user's operation of the virtual trackball can be distinguished from the user's operation of other areas of the touch screen to prevent confusion. 4 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention. As shown in FIG. 4, the response module 28 may include: an update module 42 coupled to the command generation module 26 for Update the display of the virtual trackball. Updating the display of the virtual trackball by the update module 42, for example, updating the display of the rotation state of the virtual trackball, can simulate the real rotation effect, so that the user obtains a better visual experience, and reduces the virtual trackball and the physical trackball. The difference in experience between the two. 5 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention. As shown in FIG. 5, the response module 28 may include: a first determining module 52 coupled to the command generating module 26 for determining an action command. The second determining module 54 is coupled to the first determining module 52 for determining the end point of the corresponding track of the linear track on the screen; the positioning module 56 is coupled to the second determining module 54. , used to determine that the target point selected by the user is the determined end point. Through the cooperation of the first determining module 52, the second determining module 54, and the positioning module 56, the user-specified target position can be quickly obtained according to the linear operation of the user, and the "mouse" operation function of the physical trackball is simulated. FIG. 6 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention. As shown in FIG. 4, the response module 28 may include: a third determining module 62 coupled to the command generating module 26 for determining an action command. Corresponding operation direction; the focusing module 64 is coupled to the third determining module 62 for controlling the focus of the control on the interface according to the determined operation direction. Through the cooperation of the above third determining module 62 and the focusing module 64, the focus control can be quickly performed according to the linear operation of the user. Users are not required to perform continuous operations to prevent users from operating incorrectly. FIG. 7 is a block diagram 5 of a preferred structure of an electronic device according to an embodiment of the present invention. As shown in FIG. 5, the response module 28 may include: a fourth determining module 72 coupled to the command generating module 26 for determining an action command. Corresponding operation direction; the cursor control module 74 is coupled to the fourth determining module 72 for positioning the cursor in the operation direction control editing interface. Through the cooperation of the fourth determining module 72 and the cursor control module 74, the position of the cursor on the editing interface can be quickly adjusted by the user's linear operation, and the user can perform smooth operation without the need for continuous operation, thereby preventing the user from misoperation. FIG. 8 is a block diagram of a preferred structure of an electronic device according to an embodiment of the present invention. As shown in FIG. 8, the electronic device may further include: a setting module 82 coupled to the display module 22 and the response module 28 for receiving The setting of the user, wherein the setting includes at least one of the following: setting of turning on or off the virtual trackball, setting sensitivity to the virtual trackball, setting of processing corresponding to the action, setting of the size of the virtual trackball, The setting of the visual effect of the virtual trackball. By setting the setting of the module 82, the user can control the flexibility of the virtual trackball, provide a personalized functional experience, and improve user satisfaction. Preferably, the setting module 82 is further configured to display an interface for receiving a setting of the user if the action instruction is consistent with the preset action command. Through the above settings, the setting interface can be quickly accessed to improve the efficiency of the operation. FIG. 9 is a flowchart of a method for obtaining a user operation according to an embodiment of the present invention. The method includes the following steps: Step S902: displaying a virtual trackball on a screen of the electronic device; Step S904, receiving a touch of the user on the virtual trackball Step S906, generating an action instruction according to the touch operation; Step S908, in response to the action instruction, the process is performed. In the related art, the cost of the electronic device is high. The method provided by the embodiment of the invention causes the screen to display the virtual trackball, and receives the operation of the virtual trackball by the user, and then generates an action instruction for the operation, and then responds to the action instruction to cause corresponding processing, and the touch screen is used to implement The virtual trackball with the same function of the physical trackball can achieve the same effect as the physical trackball and reduce the cost of the electronic device. Preferably, the above processing comprises: updating the display of the virtual trackball by the action instruction. This method can simulate the real rotation effect, so that the user can get a better visual experience. Preferably, the data structure information required to implement the virtual trackball may include at least one of the following: a touch sensitivity of the virtual trackball, a position report information of the virtual trackball, an operation interval judgment and interval data, and an area operation gesture of the virtual trackball. Processing information, the position of the virtual trackball in the interface, the current animation initial ^1 state, the virtual trackball display size, the virtual trackball other information. The embodiment 1-3 described below combines the technical solutions of the above-described plurality of preferred embodiments. Embodiment 1 This embodiment describes a preferred display interface design supporting a virtual trackball, including: (1) designing a virtual trackball in a touchscreen display area, and designing a virtual track as much as possible in a touch area convenient for the user to operate. ball.

(2) The interface design can be a 2D animation interface. Preferably, in order to achieve a good display effect, the interface design can be a 3D dynamic trackball animation interface.

(3) The animation design can reflect the visual effect of the user's current simulated trackball. (4) FIG. 10 is a schematic diagram of an electronic device according to Embodiment 1 of the present invention. As shown in FIG. 10, the interface design of the virtual trackball 4 can be maintained in the user operation display interface, or is a floating interface design, or embedded. The interface design is designed to allow the user to operate the virtual trackball while the screen is lit. Embodiment 2 FIG. 11 is a flowchart of a process for an electronic device to receive a user operation according to Embodiment 2 of the present invention. The process includes the following steps: Step 1: The electronic device is powered on and started, and the touch screen device is initialized and completed; Step 2, Virtual The data structure information required by the trackball is initialized and completed; Step 3, the electronic device is in a standby state, ready to receive the touch screen trigger; Step 4, determining whether the touch screen trigger area belongs to the area to which the virtual trackball belongs; Step 5: If the touch screen trigger area belongs to the area to which the virtual trackball belongs, start the virtual trackball processing flow; if the touch screen trigger area does not belong to the area of the virtual trackball, start the normal processing of the touch screen; Step 6, the electronic device responds to the user shutdown operation, shuts down Power off. Embodiment 3 The virtual trackball processing flow described in Embodiment 2 includes the following parsing and triggering actions: Step 1, the touch operation software parses, parses the user's operation into an operation behavior specific to the actual physical trackball, and The application layer software is applied to the application layer software; as a specific example, the touch operation software analysis of the virtual trackball (ie, the correspondence between the touch operation and the action instruction) includes the following definitions according to different needs of the user:

(1) Long press the virtual trackball touch area for more than 5 seconds, and parse it as a virtual trackball setting operation;

(2) Short press the virtual trackball touch area, and resolve to the physical trackball click processing;

(3) Double-click the touch area of the virtual trackball to resolve to double-click the physical trackball and report the interval value at the same time;

(4) The linear gesture operates the virtual trackball touch area and resolves to the physical trackball scrolling operation. 4艮 scrolling operation in 3D coordinates. If swiping left, it is resolved to move the physical trackball to the left. Among them, the method of converting two-dimensional operations into three-dimensional coordinates in the 3D technology such as Open Graphics Library (OpenGL) has already mature technology, and can control 3D virtual trackball through 2D operation. An exemplary conversion approach is to simulate three coordinate sensing points of a physical trackball that update the data changes of the three virtual sensing contacts in real time as the virtual trackball is controlled to rotate. If the trackball is rotated 90 degrees in parallel in an operation, and R is the virtual trackball radius parameter value, then the coordinates of X, Y, and 可能 may be up to 4艮: 4 (0, 0, R) to (0) , R, 0);

(5) The curve gesture operates the virtual trackball touch area, and the analysis action is first calculated and converted into the operation feedback of the simulated physical trackball according to the curve operation of the gesture, and then the feedback result is reported to the application layer, and the supply layer is collected and processed. This operation is mainly used when special scenes such as game operations are required to perform fine operation of the virtual trackball. More parsing implementations can be continually set and modified in subsequent user experiences. Moreover, in a specific practice, a correspondence relationship between other touch operations and motion instructions may also be set, and the embodiment is not limited to the relationship definitions exemplified above. Step 2, the corresponding operation behavior is parsed, the virtual trackball interface is displayed in real time, and the touch feedback is given when necessary, such as vibration; Step 3: If the user triggers the operation of setting the trackball sensitivity, the user may be Operation habits, custom selection of the sensitivity, size and visual effect of the virtual trackball, the user can also choose to close the virtual trackball device. Embodiment 4 In order to improve the user's body-risk, in the specific implementation process, the virtual trackball can be correspondingly processed according to the scene currently interacting with the user, so as to improve the user's operating body-risk. Several scenarios in which a virtual trackball can be applied include, but are not limited to: Scene 1: An application scenario that requires fine manipulation of the direction. The operation of this scenario, similar to the manipulation of a mouse in a PC, can best achieve the purpose of fine control. The virtual trackball is required to judge the sliding of the user's finger, and the algorithm continuously calculates the performance and effect of the continuous scrolling of the physical trackball to achieve the purpose of quickly positioning the specific orientation in the display screen. For example, if the trackball is rotated 90 degrees in parallel in an operation and R is the virtual trackball radius parameter value, then the possible 4艮 changes in the coordinates of X, Y, and 是 are: (0, 0, R) to (0) , R, 0). Taking R as the radius of the trackball as an example, the fine calculation of the corresponding trackball control is that the mouse corresponding cursor moves by R*n pixels on the screen, where n can adjust the parameter value according to the physical screen. Scene 2: Control layout interface for each main menu and submenu. The focus of the controls in the interface can be controlled by the virtual trackball, and the selection of the focus can be selected from the simple up, down, left and right directions. This operation is similar to the up, down, left, and right direction keyboards in conventional terminals. Traditional arrow keys need to be moved one by one during short presses to test user patience. When you press and hold it, it will produce a fast moving effect, but you cannot control the speed of the focus movement between the controls, which may lead to misoperation. The advantage of using the virtual trackball is that it does not require continuous operation, and smooth and continuous operation between the controls can be realized. As the mobile phone slides on the virtual trackball, the control gathers and moves with the speed of the hand. Scene 3: Enter in each edit box. The direction of the cursor in the interface can be controlled by the virtual trackball to achieve an implementation such as an input method that requires fine operations. This operation is also similar to the up, down, left, and right direction keyboards in traditional terminals, but the traditional arrow keys need to be moved one by one during short presses to test the user's Patience; It will produce a fast moving effect when pressed for a long time, but it cannot control the moving speed and is easy to operate incorrectly. The advantage of using the virtual trackball is that it does not require continuous operation, and the smooth and continuous operation of the cursor can be realized. As the mobile phone slides on the virtual trackball, the cursor moves with the hand stroke speed, which is convenient for controlling the speed. FIG. 12 is a flowchart of virtual trackball processing in each scene according to Embodiment 4 of the present invention, including the following steps: Step 1201: The user starts up, and enters standby to operate the virtual trackball; Step 1202, User The interface operation can be triggered by the linear operation of the touch area of the virtual trackball. The virtual trackball is suspended in the lower right of the interface, and the interface of the 10MM dynamic 3D ball is fed back to the user for operation display; Step 1203, according to the user operation. The different scenarios are processed separately. Specifically, in scenario 1, that is, an application scenario that requires a fine control direction, the following steps are included:

(1) and Ma District move forward # communication;

(2) obtaining data of user operations and parsing the data;

(3) starting a fine algorithm module to calculate data, and obtaining a corresponding trajectory of the user operation on the screen;

(4) Output the calculation result and refresh the interface to display the processing result. Through the above steps, you can achieve rapid positioning. For example, in the game, first select a specific character, and then manipulate the trackball to specify the character to reach any position on the screen. In this scenario, the fineness of the trackball needs to meet the need for rapid positioning of 2D coordinates. The user needs continuous operation, such as continuous swipe, to achieve the purpose of quickly specifying the position. Accordingly, the software needs to continuously convert the position that the user needs to specify. In scenario 2, where the control layout interface such as the main menu and submenu is focused, the following steps are included:

(1) and the horse area move forward # communication; (2) according to the control focus point for preprocessing;

(3) obtaining data, and obtaining a direction corresponding to the user operation according to the data; (4) Output the acquired direction and refresh the interface to display the focus result. Through the above steps, you can control the focus of the controls in the interface. The focus selection can be selected from the simple up, down, left, and right directions. The main points of the function are: To achieve the user's focus selection for a specific control, and with the MENU button, the user can enter the MENU option for the control. This operation is different from the click, double click and long press operation for the control. In the Android OS system, these four operations are defined as corresponding to different interaction meanings. Clicking is to activate the control, double-clicking for the specific operation of the control, and triggering the respective functions according to different definitions of each control. Long press to pop up the Option menu option for the user to do the Option part. In this scenario, the processing of the virtual trackball only needs to resolve the selection of the up, down, left, and right directions and the user's click, double click, long press, and cooperate to determine whether the current control is in the focus mode. In scenario 3, where the input is made in the edit box, the following steps are included:

(1) communicating with the driver;

(2) pre-processing at the cursor position;

(3) Acquiring data, and obtaining the direction corresponding to the user operation according to the data; (4) outputting the acquired direction, and refreshing the interface to display the motion result of the cursor. Through the above steps, the direction of the cursor in the interface can be controlled to achieve an implementation such as an input method that requires fine operations. For example, after the user enters the three letters of ABC, the user needs to modify B to D. He needs to move the cursor one bit later, and then select the delete function. Since the letter spacing is too small, the finger cannot locate the cursor very quickly. At this time, the software can set the virtual track. The ball is positioned to control the direction of the cursor, and achieves the effect of finely controlling the cursor through the virtual trackball. In this scenario, the virtual trackball needs to be sensitive to various up, down, left, and right directions to achieve the effect of quickly positioning the cursor. The solution provided by the embodiment of the present invention can simulate the user-use risk of the physical trackball, and achieve the convenience of the user to finely select and operate the interface through the effect of the software design, and at the same time achieve the effect of saving the device cost. Yes, the steps shown in the flowchart of the figures may be performed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, may be different The steps shown or described are performed in the order herein. Obviously, those skilled in the art should It should be understood that the various modules or steps of the present invention described above may be Implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of computing devices, optionally, they may be implemented by program code executable by the computing device, such that They may be stored in a storage device by a computing device, or they may be fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof may be implemented as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software. The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the scope of the present invention are intended to be included within the scope of the present invention.

Claims

Claims An electronic device characterized by comprising:

a display module, configured to display a virtual trackball on the screen of the electronic device;

a receiving module, configured to receive a touch operation of the virtual trackball by a user;

An instruction generating module, configured to generate an action instruction according to the touch operation;

The response module is configured to process the response in response to the action instruction. The electronic device according to claim 1, further comprising: a determining module, configured to determine whether an area in which the user performs a touch operation is within a range of an area in which the virtual trackball is displayed;

The receiving block module is configured to receive a touch operation of the user if the determination result of the determining module is yes. The electronic device according to claim 1, wherein the response module comprises: an update module, configured to update the display of the virtual trackball by the action instruction. The electronic device according to claim 1, wherein the response module comprises: a first determining module, configured to determine a linear trajectory generated when the action command acts on the virtual trackball;

a second determining module, configured to determine an end point of the corresponding track of the linear track on the screen;

And a positioning module, configured to determine that the target point selected by the user is the end point. The electronic device according to claim 1, wherein the response module comprises: a third determining module, configured to determine an operation direction corresponding to the action instruction;

A focusing module is configured to control the focus of the control on the interface according to the operating direction. The electronic device according to claim 1, wherein the response module comprises: a fourth determining module, configured to determine an operation direction corresponding to the action instruction;

a cursor control module, configured to control a position of a cursor in the editing interface according to the operation direction.

The electronic device according to claim 1, further comprising: a setting module, configured to accept a setting of the user, wherein the setting includes at least one of: turning on or off the virtual trackball The setting, the setting of the sensitivity of the virtual trackball, the setting of the process corresponding to the action, the setting of the size of the virtual trackball, and the setting of the visual effect of the virtual trackball.

The electronic device according to claim 7, wherein the setting module is further configured to display a setting for receiving the user if the action instruction is consistent with a preset action command Interface.

9. A method of obtaining user operations, characterized in that it comprises the following steps:

Making the screen of the electronic device display a virtual trackball;

Receiving a touch operation of the virtual trackball by the user;

Generating an action instruction according to the touch operation;

Processing is performed in response to the action instruction.

10. The method of claim 9, wherein the processing comprises: updating display of the virtual trackball in accordance with the motion instruction.