CN103914260B

CN103914260B - Control method and device for operation object based on touch screen

Info

Publication number: CN103914260B
Application number: CN201410127128.4A
Authority: CN
Inventors: 梁江; 汪光胜; 官松彬; 李长春; 陆翔
Original assignee: Suzhou Gstarsoft Co ltd
Current assignee: Suzhou Gstarsoft Co ltd
Priority date: 2014-03-31
Filing date: 2014-03-31
Publication date: 2021-03-23
Anticipated expiration: 2034-03-31
Also published as: CN103914260A

Abstract

The invention discloses an operation method and device of an operation object based on a touch screen. Wherein, the method comprises the following steps: a virtual touch pad established on a touch screen receives an operation instruction input by a user; sending the operation instruction to a virtual cursor established on the touch screen; acquiring an operation object corresponding to a virtual cursor on a page; and the virtual cursor executes corresponding operation control on the operation object according to the received operation instruction. According to the invention, the accuracy of object selection operation when a user uses the touch screen can be improved, and the operation is simple and convenient.

Description

Control method and device for operation object based on touch screen

Technical Field

The invention relates to the field of computers, in particular to a control method and device of an operation object based on a touch screen.

Background

With the continuous development of science and technology, mobile devices have more and more powerful functions, and almost replace devices such as PCs and the like. Due to the introduction of the touch screen technology, the mobile device can develop greater potential, and more brand new experiences can be brought to users by adopting the touch screen on the existing mobile platform (such as a smart phone and a tablet personal computer) device. However, in order to consider the factors of convenience for users to carry about while going out, the screen of the mobile device is generally much smaller than the display of the PC. Thus, the more menu content that is displayed in the mobile device, the less accurate the selection operation on the screen by means of the finger. And the finger belly of the finger is larger than the screen of the mobile device, so that the finger inevitably influences the user to observe the display content on the screen during operation, and the operation is more inconvenient.

In view of the above problems, the existing solution is to enlarge the operation area. The method comprises the steps of amplifying a certain area to be operated of a double-click screen or amplifying the area to be operated by double fingers on the screen supporting multi-point touch, and then performing other operations. Although this method can solve the problem of accuracy, the step of double-clicking the screen to enlarge the area gives the user excessive operations intangibly. If an application program on the mobile device has a large amount of operation contents and high density, the method inevitably wastes time of a user, and the work efficiency is reduced. Or the operation is executed by simulating the mouse through an external device, but the defect of high cost exists.

At present, no effective solution is provided for the problems of poor accuracy of selecting an operation object and inconvenient operation in the process of using a touch screen to perform computer operation in the related art.

The technical problem to be solved by the invention is to provide a virtual mouse method and device based on a touch screen, which can improve the accuracy and the operation convenience of a user for selecting a point on mobile equipment and solve the problem that a finger blocks the user to observe the display content on the screen. And an external device is not needed, so that the production cost is saved.

Disclosure of Invention

In order to solve the problems of poor accuracy of selecting an operation object and inconvenience in operation in the process of using a touch screen to perform computer operation in the related art, an effective solution has not been proposed at present.

In order to achieve the above object, according to an aspect of the present invention, there is provided a method for controlling an operation object based on a touch screen, the method including: a virtual touch pad established on a touch screen receives an operation instruction input by a user; sending the operation instruction to a virtual cursor established on the touch screen; acquiring an operation object corresponding to a virtual cursor on a page; and the virtual cursor executes corresponding operation control on the operation object according to the received operation instruction.

In order to achieve the above object, according to another aspect of the present invention, there is provided a control apparatus for an operation object based on a touch screen, the apparatus including: the receiving module is used for receiving an operation instruction input by a user through a virtual touch pad established on the touch screen; the sending module is used for sending the operation instruction to the virtual cursor established on the touch screen; the acquisition module is used for acquiring an operation object corresponding to the virtual cursor on the page; and the processing module is used for executing corresponding operation control on the operation object by the virtual cursor according to the received operation instruction.

According to the invention, the virtual touch pad established on the touch screen is adopted to receive the operation instruction input by the user; sending the operation instruction to a virtual cursor established on the touch screen; acquiring an operation object corresponding to a virtual cursor on a page; the virtual cursor executes corresponding operation control on the operation object according to the received operation instruction, so that the problems of poor accuracy and inconvenient operation of selecting the operation object in the process of using the touch screen to perform computer operation in the related art are solved, and the effects of accuracy in selecting the operation object and simplicity and convenience in operation when a user uses the touch screen are further improved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

fig. 1 is a flowchart of a control method of an operation object based on a touch screen according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an alternative virtual touchpad configuration to that shown in FIG. 1 in accordance with the present invention;

FIG. 3 is a detailed flow diagram of an alternative touchscreen-based virtual touchpad emulation mouse in accordance with the present invention;

FIG. 4 is a schematic diagram of an alternative application scenario of an operation object based on a touch screen according to an embodiment of the present invention;

FIGS. 5-6 are schematic diagrams of alternative application scenarios of touch screen based operands according to embodiments of the present invention;

FIG. 7 is a velocity ratio model curve diagram according to an embodiment of the invention;

FIGS. 8-9 are schematic diagrams of still another alternative application scenario of a touch screen-based operand according to an embodiment of the present invention; and

fig. 10 is a schematic structural diagram of an operation device based on an operation object of a touch screen according to an embodiment of the present invention.

Detailed Description

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

There is also provided, in accordance with an embodiment of the present invention, an embodiment of a method that may be used to implement an embodiment of the apparatus of the present invention, it being noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer-executable instructions and that, although a logical ordering is shown in the flowchart, in some cases, the steps illustrated or described may be performed in an order different than here.

Fig. 1 is a flowchart of a method for controlling an operation object based on a touch screen according to an embodiment of the present invention, the method including the steps of:

in step S10, the virtual touchpad created on the touch screen receives an operation instruction input by the user.

In step S30, the operation instruction is sent to the virtual cursor created on the touch screen.

Step S50, an operation object corresponding to the virtual cursor on the page is obtained.

In step S70, the virtual cursor performs corresponding operation control on the operation object according to the received operation command.

In the above embodiments of the present application, a virtual touchpad area is created on a touch display screen, where the virtual touchpad is configured to receive an operation instruction of a user, send the operation instruction to a corresponding virtual cursor, and perform a corresponding operation on an operation object through the virtual cursor to obtain a control result of the operation instruction. Because the user can accomplish the operation control to the operation object through the virtual touch pad on the touch display screen, thereby not only having solved the finger tripe of finger and having sheltered from the display screen content, influenced the problem that the user observed the page, and what be crucial has solved the in-process that uses the touch-sensitive screen to carry out computer operation of correlation technique moreover, select the problem that the operation object degree of accuracy is poor and operate inconveniently, and then realize improving the accurate and simple operation convenient effect of selecting the operation object when the user uses the touch-sensitive screen.

Specifically, the embodiment of the application realizes that a virtual touchpad is created on the touch screen, and the mouse can be simulated through the virtual touchpad, namely the virtual mouse is also a virtual mouse. Specifically, a mouse touchpad area is drawn at a proper position of a touch screen through a drawing interface provided by the touch screen, so that a virtual touchpad for simulating a mouse is created, after the virtual touchpad obtains an operation instruction of a user, the operation instruction is sent to a virtual cursor in the touch screen or an operation object (such as a page control) at the position of the virtual cursor, and a corresponding operation instruction is executed on the operation object.

Therefore, the operation of the mouse is simulated through the virtual touch pad, for example, a user can control the cursor to move on the screen by dragging the touch pad through the virtual touch pad, so that the accuracy and the operation convenience of the user for selecting a point on the mobile device can be improved, and the problem that the user observes the display content on the screen due to the fact that fingers block the screen is solved. Therefore, the scheme provided by the embodiment can realize the operation of the computer without providing support by virtually displaying the mouse operation on the touch screen and providing support for external equipment, namely, without providing the external equipment for the computer, and further achieves the purpose of saving the production cost.

It should be noted here that the shape of the touch panel in the present embodiment is not limited, and may be any shape. The position of the virtual touchpad can be at a certain specific position of the display screen so as to prevent the operation of a user from being influenced; the touch handle can be placed at any position, and is formed to be dragged by a user at will.

Preferably, the virtual touchpad in the above embodiment of the present application may include an operation area, where the operation area is an independent area without a sub-operation area, and the operation area generates a corresponding key instruction according to various combined operation instructions input by a user, so as to control a virtual cursor to perform corresponding operation control on an operation object.

Therefore, the virtual touch pad in the above embodiment of the present application may be an area (e.g., a circular area that can be manually dragged) that can be displayed in any shape on the display screen, and the user may input different operation instructions in the area to generate a corresponding key instruction, so that the area may determine the key manner by detecting the received touch instruction.

Specifically, the above scheme may provide various combined operation instructions (each group of operation instructions simulates a button instruction of a mouse button), that is, a touch operation instruction is input on the virtual touch screen to determine which button instruction is input by the user, for example, the number of touch points of a finger may be used to determine, and if the number of touch points is 2, the same button instruction as the left button of the mouse is input; the judgment can also be carried out by dividing the boundary, and if a finger already obtains a point on the touch screen, the point is taken as an origin, a straight line which passes through the origin and is perpendicular to the horizontal line of the device is taken as an axis, the left side of the axis is judged to be a left click key, the right side of the axis is judged to be a right click key, and the like. Since there are many ways to determine the key on the touch device, they are not listed here.

Preferably, in the above embodiment of the present application, before the step S10 is executed to enable the virtual touchpad created on the touch screen to receive an operation instruction input by a user, the above method embodiment may further include the following steps: creating a virtual touchpad and a virtual cursor at a preset position of a touch screen; the step of creating the virtual touchpad and the virtual cursor at the predetermined position of the touch screen may include the following embodiments:

step S101, acquiring the screen size of the touch screen.

And S102, calculating the size and the display position of the virtual touch panel according to the screen size of the touch screen.

And step S103, determining the initial display position of the virtual cursor according to the display position of the virtual touchpad.

The steps realize that the virtual touch pad is created on the touch screen, the size of the virtual touch screen is calculated by obtaining the screen size of the touch screen, and the size of the virtual touch screen is controlled within a certain range, for example, the size of the virtual touch screen cannot exceed one third of the size of the touch screen, or the size of the current virtual touch screen is limited to be one fifth of the size of the current touch screen, so that the size of the virtual touch screen cannot exceed the size of the touch screen, and meanwhile, the display position of the virtual touch pad can be calculated and determined according to the size of the touch screen, for example, the display position of the virtual touch screen can be set at the lower right corner of the touch screen. And finally, drawing a virtual touch pad on the calculated display position through the drawing interface according to the calculated size.

It should be noted that, the virtual touch pad in the above embodiment of the present application may be an area with any shape, and a user may set, in the background, operation data corresponding to an operation instruction received by the virtual touch pad, for example, the operation data corresponding to the double-click operation received by the virtual touch pad is an open operation object, and the operation data corresponding to the virtual touch pad is a drag operation object.

Preferably, a key area can be added on the virtual touch pad of the application, and is used for simulating buttons such as a left key, a right key and a pulley of a mouse. If it is added, the key operation of the user needs to be judged. The virtual touchpad in the above embodiments may simulate a basic mouse function, and may include at least four operation regions (for example, the virtual touchpad is drawn as four grid regions).

As shown in fig. 2, the virtual touchpad is divided into four regions having independent operation functions: the left key area, the right key area, the pulley area and the moving area are used for respectively simulating a left key operation instruction of a left mouse key, a right key operation instruction of a right mouse key, a pulley operation instruction of a pulley and a moving operation instruction of a mouse moving area, and the size of the grid area can be obtained by calculation when the virtual touch pad is calculated.

Therefore, before the step S30 sends the operation instruction to the virtual cursor created on the touch screen, the above embodiment may further include the following scheme: determining whether the operation instruction input by the user is one of the following instructions: the method comprises the following steps of a left key operation instruction, a right key operation instruction, a pulley operation instruction or a movement operation instruction, wherein when the operation instruction is the left key operation instruction, the step of sending the left key operation instruction to a virtual cursor created on a touch screen is executed: and if the operation instruction is a right key operation instruction, executing the step of sending the right key operation instruction to a virtual cursor created on the touch screen: and if the operation command is a pulley operation command, executing the step of sending the pulley operation command to a virtual cursor created on the touch screen: and in the case that the operation instruction is a moving operation instruction, executing a step of transmitting the moving operation instruction to a virtual cursor created on the touch screen.

Specifically, as shown in fig. 4, the virtual touchpad is shown in fig. 2 as an application operating scenario on a mobile device. After the operation instruction of the user on the virtual touch pad is acquired, the operation instruction to be executed by the user can be judged through the judging module, namely the system performs matching operation on the currently received operation instruction and the stored operation instruction, and if the matching is successful, the operation data corresponding to the corresponding operation instruction is sent to the virtual cursor to execute the corresponding operation function. For example, whether the current operation instruction is clicked in the left key area or not may be determined first, if the current operation instruction is clicked in the left key area, the left key operation instruction is sent to the page control corresponding to the virtual cursor, if the current operation instruction is not clicked in the left key area, whether the current operation instruction is clicked in the right key area or not is continuously determined, if the current operation instruction is clicked in the right key area, the right key operation instruction is sent to the page control corresponding to the virtual cursor, if the current operation instruction is not clicked in the right key area, whether the current operation instruction slides in the pulley area or not is continuously determined, if the current operation instruction slides in the pulley area, the pulley rolling operation instruction is sent to the page control corresponding to the virtual cursor, if the current operation instruction does not slide in the pulley area, whether the current operation instruction slides in the moving area or not is continuously determined, and if the current operation instruction slides in the moving area, a subsequent distance for, and otherwise, returning to obtain the operation instruction of the user on the virtual touch pad again, and continuing to circularly determine the current operation instruction.

It should be noted that the determination sequence in the determination process is an example, and the solution of the present application is not limited to the determination sequence. Further, after determining which area is the function operation, the determining operation needs to further determine the operation content according to the operation instruction acquired by the current operation area, for example, when it is determined that the current operation instruction is clicked in the grid of the left-key area, it needs to further determine whether the operation is a single-click or a double-click operation, if the operation is a single-machine operation, it may be a selecting operation or a determining operation, and if the operation is a double-click, it may be an opening operation. Similarly, the current operation instruction can be clicked in the grid of the right key area, and the right key needs to be further determined to be clicked or double-clicked in the grid; if it is determined that the current operation command is to slide in the lattice of the pulley area, further determining a direction of the slide to determine whether to move upward or downward, etc.; if the current operation instruction is determined to move a certain displacement in the grid of the moving area, the vector direction of the displacement and the moving displacement are further determined.

The virtual touch pad with the four functional areas can be applied to mobile equipment, and the problems that fingers are not distinguished and right click cannot be achieved in touch screen mobile equipment can be solved through left and right keys and the pulley areas on the virtual touch pad.

Preferably, in the above embodiment of the present application, when the operation instruction is a left key operation instruction, a right key operation instruction, or a pulley operation instruction, the step S70 implementing that the virtual cursor performs corresponding operation control on the operation object according to the received operation instruction includes: reading operation data corresponding to a left key operation instruction, a right key operation instruction or a pulley operation instruction, wherein the operation data corresponding to the left key operation instruction comprises any one or more of the following instructions: click and confirm the order, double click and confirm the order, the operational data that the right button operation order corresponds includes: and a menu pop-up instruction, wherein the operation data corresponding to the pulley operation instruction comprises any one or more of the following instructions: an up move instruction, a down move instruction; and the virtual cursor controls the operation object according to the operation data corresponding to the left key operation instruction, the right key operation instruction or the pulley operation instruction to obtain an operation result of the operation object.

Therefore, after the display position of the current virtual cursor and the control information of the page where the virtual cursor is located are obtained, the control instruction obtained by the virtual touchpad can be sent to the virtual cursor to operate the page control where the virtual cursor is located. For example, right and left clicking is performed on the page control, or double clicking a message, scrolling a message in a wheel, and moving an operation object.

Preferably, in the foregoing embodiment of the present application, when the operation instruction is a move operation instruction, the step S70 implementing that the virtual cursor performs corresponding operation control on the operation object according to the received operation instruction may include the following implementation steps:

and step S701, reading sliding operation data corresponding to the moving operation instruction, wherein the sliding operation data is the moving distance MS input on the virtual touch pad by the user.

In step S702, the virtual cursor controls the operation object to slide according to the moving distance MS, so as to obtain the moving distance DS of the operation object.

The step of obtaining the moving distance DS of the operation object in the implementation process of step S702 may be implemented by the following scheme:

step S7021, calculating a moving speed Vf corresponding to the moving distance MS by the following formula: vf = MS/T, where T is the sliding time corresponding to the moving distance MS.

And step S7022, obtaining a sliding proportionality coefficient delta according to the moving speed Vf corresponding to the moving distance MS.

Step S7023, the movement distance DS of the operation object is calculated by the following formula: DS = movement distance MS δ.

The embodiment realizes that if the user drags the touch pad to slide on the screen after judging, the offset distance of the operation object obtained by calculation according to the angle and the movement distance and the speed ratio model is combined, namely, a movement control instruction is sent to the current virtual cursor to operate the page control to move according to the calculated movement.

Specifically, the speed ratio model refers to a comparison model of the moving speed Vm of the virtual cursor on the touch display screen and the moving speed Vf of the virtual touchpad dragged by the user's finger on the touch display screen. When the value of Vf is larger, the proportional coefficient δ of Vm and Vf is larger, the calculated offset distance of the virtual cursor is larger, and the moving distance DS of the operation object is larger; when the value of Vf is small, the smaller the proportionality coefficient δ of Vm and Vf is, the smaller the calculated offset distance of the virtual cursor is, and thus the smaller the moving distance DS of the operation object is; when Vf is in a specific interval, the proportionality coefficient δ of Vm and Vf is 1, then Vm is equal to Vf, and the calculated offset distance of the virtual cursor is equal to the moving distance of the finger in the moving area.

If the user finger does not click on the touch pad, but directly clicks on the area, not the touch pad, of the touch display screen, the position of the cursor can be directly positioned, and the offset distance of the virtual cursor does not need to be calculated in a speed ratio model mode.

Since the touch screen is small on a mobile device such as a mobile phone, using the form as shown in fig. 2 inevitably prevents a user from selecting an operation entity, the following describes the above embodiments of the present application in detail by taking the product form of creating a circular virtual touch pad on the touch screen to simulate various functions of a mouse as an example:

it should be noted here that the application scenario of the virtual touchpad provided by the present invention is applicable to any mobile device having a touch screen. In this configuration of the present device, the virtual touch pad is equivalent to a dragging handle, and the user can long press and drag the virtual touch pad to move on the entire touch screen, which is equivalent to the moving area in the configuration of fig. 2. At this time, the virtual touchpad may be an area of an arbitrary shape or size, and may be a circular virtual touchpad.

As shown in fig. 3, the present application provides an implementation scheme for simulating each function of a mouse by using a touch screen-based virtual touchpad, which includes the following specific implementation steps:

and step 1), acquiring the size of the screen of the touch screen.

And step 2), creating a virtual touchpad and a virtual cursor at a proper position of the touch screen according to the size of the screen of the touch screen S102. Specifically, the system may create a circular virtual touchpad S101 in the lower right corner of the touch screen through the drawing interface, and create a virtual cursor S102 in the upper left corner, that is, the virtual touchpad S101 may be created at a position that does not block the virtual cursor S102, where the virtual touchpad in this step is a circular touch area.

It should be noted that the circular touchpad can be transformed into a virtual touchpad including four operation areas to simulate a mouse, and specifically, the virtual touchpad can include a left and right key area, a scroll wheel area and a movement area.

And step 3), acquiring an operation instruction of the user on the virtual touch pad.

And step 4), sequentially judging whether the operation instruction of the user on the virtual touch pad is any one of the following operations: clicking in a left key area, clicking in a right key area, sliding in a pulley area and sliding in a moving area. For example, if the user's request is to display a right-key menu, the user needs to input a right-key operation instruction on the virtual touch panel.

In step 4), it may be first determined that the operation instruction acquired in step 3) is that the click operation is performed on the right button region, and then the right button operation instruction is sent to the page control corresponding to the virtual cursor, otherwise, the next step 5) is performed, so as to determine whether the acquired operation instruction is that the click operation is performed on the left button region. And if the user does not have any operation in the step, jumping back to the step 3) to acquire the user operation again.

And 5), judging whether the acquired operation instruction is that the click operation is executed on the left key area, and if so, sending the left key instruction to the current page control corresponding to the virtual cursor. The upper device displays a menu on the screen in response to the left key instruction.

Specifically, as shown in fig. 6, the steps 4) and 5) may implement a scheme of executing a popup menu and then selecting a function in the menu on the operation object. For example, clicking on the right key region triggers a right key operation instruction. Therefore, the virtual touchpad S101 created by the virtual touchpad creating device executes right click operation, pops up a display menu on a touch screen, and can send a left click operation instruction to select the cutting entity S103 and execute the cutting entity after controlling the virtual cursor S102 to move to the menu item cutting entity S103.

So far, the group of operation instructions acquired by the invention is executed, and if the user continues to operate on the touch panel, the step 3) is executed again. The following steps continue to execute the sliding operation that the user needs to slide the virtual cursor.

And 6), acquiring the sliding operation of dragging the virtual touch pad by the finger of the user, if the sliding operation is performed, sending a pulley scrolling message to the page control, and otherwise, executing the step 7).

And 7), at this time, whether the user operation slides in the moving area needs to be continuously judged, namely whether the user drags the virtual touch pad to move on the display screen is judged. If yes, entering the next operation step 8); if not, jumping back to the step 3) to obtain the operation instruction again.

And 8), calculating the obtained offset distance DS of the virtual cursor.

And 9) moving the virtual cursor by combining the received offset angle in the moving area.

Step 8) is described in detail herein. As shown in fig. 6, if the user moves a distance MS in the movement region on the virtual touchpad S101 at an angle θ to the horizontal, the offset distance DS can be calculated by the "velocity ratio model".

Specifically, in order to ensure that the virtual cursor can move to each pixel while the user's finger dragging the virtual touch pad on the screen can effectively slide, a ' speed ratio model ' is adopted to calculate the cursor offset distance. This model is only one of the models for implementing the present invention, and other models may be used instead. And calculating the speed Vf of the virtual touch pad dragged by the finger to slide on the touch screen by the finger dragging the touch pad on the screen by the moving distance MS and the time T, namely Vf = MS/T.

Specifically, the relationship between the proportionality coefficient δ of the speed Vf of the virtual touchpad dragged by the finger sliding on the touch screen and the speed Vm of the virtual cursor moving on the screen can be referred to the following table 1. The virtual cursor moved over time T is offset on the touch screen by a distance DS equal to δ multiplied by the movement distance MS of the finger dragging the virtual touchpad on the touch screen. I.e. DS = MS δ.

Table 1:

number of stages	Range of speed Vf	Coefficient of proportionality δ
			First stage	Vf≤V1	δ1
Second stage	V1≤Vf＜V2	δ2
			…	…	…
Nth stage	Vn＜Vf	δn

Thus, the system can combine the angle θ of the offset in the movement region and the movement distance DS of moving the virtual cursor. For example, it may be implemented that the cursor is moved to be within the menu item "cut entity" area. Taking the example shown in fig. 6 as an example, where the user needs to perform an operation of clicking a menu item "cut entity", the user needs to click on the left key region of the virtual touchpad to determine that the user clicks on the left key region, and after moving the virtual cursor to the position of the "cut entity", a left key operation instruction is sent to the menu control, and the menu control should perform cutting in response to the left key click instruction sent by the apparatus.

Specifically, the speed ratio model in the above-described embodiment of the present application is described in detail. The speed ratio model graph shown in fig. 7:

when Vf is less than 0.1, the speed Vm of the cursor moving on the screen is small, and the cursor is shifted on the screen by a small distance DS after the time T. This may occur with a finger sliding 0.1 inches across the touchpad, but the cursor is only offset 0.03 inches across the screen.

When Vf is greater than or equal to 0.1 and less than 0.4, the increase rate of the speed Vm of the cursor moving on the screen is relatively uniform, and the offset distance DS of the cursor on the screen is equal to the moving distance MS after the time T. This may occur with a finger sliding 0.1 inches across the touchpad and the cursor also shifting 0.1 inches across the screen.

When Vf is greater than or equal to 0.4, the speed Vm of the cursor moving on the screen is large, and the offset distance DS of the cursor on the screen is large after the time T. This may occur with a finger sliding 0.1 inches across the touchpad, but the cursor is offset 0.3 inches across the screen.

For further detailed description of the present invention, as shown in fig. 8 and 9, the embodiments provided in the present application are described in detail in the application operation scenario as shown in fig. 8 and 9. In this embodiment, the page text displayed on the touch display screen of the touch device in fig. 8 is too large, so that the information is incomplete. By using the operation method of the operation object based on the touch screen, the information on the left side of the page is displayed in the screen by dragging the virtual touch pad S101. The detailed implementation process is as follows:

first, data information such as a screen size and size is acquired.

Next, a cursor is drawn at an appropriate position S102, and a touchpad is created S101.

Next, an operation of the user on the virtual touchpad is acquired. As shown in fig. 8, where text information on the left side of the page needs to be displayed, the user needs to drag the touch pad to move left first.

Specifically, when the cursor S102 is at the screen boundary and the touch pad is dragged to control the cursor to move toward the boundary, the cursor does not move any more, and the present invention sends a page moving instruction. As shown in fig. 8, when the cursor S102 has reached the left boundary, if the touch pad is dragged to move to the left, the cursor is not moved, and the present invention sends a page moving instruction to move the page in the opposite direction, that is, to move the data information showing the left side of the page to the right. The obtained results are shown in FIG. 9.

From the above description, it can be seen that the present invention achieves the following technical effects: the invention improves the accuracy and the operation convenience of the point selection of the user on the mobile equipment and solves the problem that the user observes the display content on the screen when the finger blocks the display content. And an external device is not needed, so that the production cost is saved.

It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.

FIG. 10 shows a schematic diagram of an example computer apparatus architecture that may be used for these devices. For descriptive purposes, the architecture portrayed is only one example of a suitable environment and is not intended to suggest any limitation as to the scope of use or functionality of the application. Neither should the computing system be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in FIG. 10.

The principles of the present application may be implemented using other general purpose or special purpose computing or communication environments or configurations. Examples of well known computing systems, environments, and configurations that may be suitable for use with the application include, but are not limited to, personal computers, servers, multiprocessor systems, microprocessor-based systems, minicomputers, mainframe computers, and distributed computing environments that include any of the above systems or devices.

In its most basic configuration, fig. 10 is a schematic structural diagram of an operation device based on an operation object of a touch screen according to an embodiment of the present invention.

As shown in fig. 10, the operation device for a touch screen-based operation object may include: a receiving module 102, a sending module 104, an obtaining module 106 and a processing module 108.

The receiving module 102 is configured to receive an operation instruction input by a user through a virtual touchpad created on a touch screen; a sending module 104, configured to send the operation instruction to a virtual cursor created on the touch screen; an obtaining module 106, configured to obtain an operation object corresponding to a virtual cursor on a page; and the processing module 108 is configured to execute corresponding operation control on the operation object by the virtual cursor according to the received operation instruction.

In the foregoing embodiment of the present application, as shown in fig. 10, before executing the operation instruction that the virtual touchpad created on the touch screen implemented by the receiving module 102 receives an input by a user, the apparatus may further execute the following modules: a creating module 101, wherein the creating module 101 is used for creating a virtual touchpad and a virtual cursor at a preset position of the touch screen; the creating module 101 may include: a sub-acquiring module 1011, a calculating module 1012 and a display position determining module 1013.

The sub-acquisition module 1011 is configured to acquire a screen size of the touch screen; a calculating module 1012, configured to calculate, according to a screen size of the touch screen, a size and a display position of the virtual touch panel; and a display position determining module 1013 configured to determine an initial display position of the virtual cursor according to the display position of the virtual touch pad.

The virtual touch pad in the above embodiment of the present application may include four operation regions, which are used to respectively simulate a left key operation instruction, a right key operation instruction, a wheel operation instruction, and a move operation instruction of the mouse, where before the virtual cursor created on the touch screen is sent with the operation instruction implemented by the sending module 104, the apparatus may further execute the following modules: the determining module is used for determining whether the operation instruction input by the user is one of the following instructions: a left key operation instruction, a right key operation instruction, a pulley operation instruction or a movement operation instruction.

According to the scheme, the virtual touch pad is created on the touch screen, the size of the virtual touch screen is calculated by obtaining the screen size of the touch screen, the size of the virtual touch screen is controlled within a certain range, for example, the size of the virtual touch screen cannot exceed one third of the size of the touch screen, or the size of the current virtual touch screen is limited to be one fifth of the size of the current touch screen, so that the size of the virtual touch screen cannot exceed the size of the touch screen, meanwhile, the display position of the virtual touch pad can be calculated and determined according to the size of the touch screen, and for example, the display position of the virtual touch screen can be set at the lower right corner of the touch screen. And finally, drawing a virtual touch pad on the calculated display position through the drawing interface according to the calculated size.

Preferably, the virtual touchpad in the above embodiments may simulate a basic mouse function, and at least may include four operation regions (for example, the virtual touchpad is drawn as four grid regions), that is, the virtual touchpad is divided into four regions with independent operation functions: the left key area, the right key area, the pulley area and the moving area are used for respectively simulating a left key operation instruction of a left mouse key, a right key operation instruction of a right mouse key, a pulley operation instruction of a pulley and a moving operation instruction of a mouse moving area, and the size of the grid area can be obtained by calculation when the virtual touch pad is calculated.

Preferably, the determining module may include: the first sub-determination module is used for sending the left key operation instruction to a virtual cursor created on the touch screen under the condition that the operation instruction is the left key operation instruction: the second sub-determination module is used for sending the right key operation instruction to a virtual cursor created on the touch screen under the condition that the operation instruction is the right key operation instruction: a third sub-determination module, configured to send the pulley operation instruction to a virtual cursor created on the touch screen if the operation instruction is the pulley operation instruction: and the fourth sub-determination module is used for sending the movement operation instruction to the virtual cursor created on the touch screen under the condition that the operation instruction is the movement operation instruction.

Specifically, after the operation instruction of the user on the virtual touch pad is acquired, the operation instruction to be executed by the user can be judged through the judgment module, that is, the system performs matching operation on the currently received operation instruction and the stored operation instruction, and if the matching is successful, the operation data corresponding to the corresponding operation instruction is sent to the virtual cursor to execute the corresponding operation function. For example, whether the current operation instruction is clicked in the left key area or not may be determined first, if the current operation instruction is clicked in the left key area, the left key operation instruction is sent to the page control corresponding to the virtual cursor, if the current operation instruction is not clicked in the left key area, whether the current operation instruction is clicked in the right key area or not is continuously determined, if the current operation instruction is clicked in the right key area, the right key operation instruction is sent to the page control corresponding to the virtual cursor, if the current operation instruction is not clicked in the right key area, whether the current operation instruction slides in the pulley area or not is continuously determined, if the current operation instruction slides in the pulley area, the pulley rolling operation instruction is sent to the page control corresponding to the virtual cursor, if the current operation instruction does not slide in the pulley area, whether the current operation instruction slides in the moving area or not is continuously determined, and if the current operation instruction slides in the moving area, a subsequent distance for, and otherwise, returning to obtain the operation instruction of the user on the virtual touch pad again, and continuing to circularly determine the current operation instruction.

In an optional embodiment provided by the foregoing embodiment of the present application, when the operation instruction is a move operation instruction, the processing module 108 may include: the first reading module is used for reading sliding operation data corresponding to the moving operation instruction, wherein the sliding operation data is a moving distance MS input by a user on the virtual touch pad; and the first generation module is used for controlling the sliding of the operation object by the virtual cursor according to the moving distance MS to obtain the moving distance DS of the operation object.

Wherein, the generating module may include: the first sub-calculation module is used for calculating and obtaining the moving speed Vf corresponding to the moving distance MS through the following formula: vf = MS/T, where T is a sliding time corresponding to the moving distance MS; the query module is used for querying according to the moving speed Vf corresponding to the moving distance MS to obtain a sliding proportionality coefficient delta; the second sub-calculation module is used for calculating the movement distance DS of the operation object through the following formula: DS = movement distance MS δ.

If the user finger does not click on the touch pad, but directly clicks on the area, not the touch pad, of the touch display screen, the position of the cursor can be directly positioned, and the offset distance of the virtual cursor does not need to be calculated in a speed ratio model mode. This velocity ratio model is only one of the models for implementing the present invention, and other models may be used instead. And calculating the speed Vf of the virtual touch pad dragged by the finger to slide on the touch screen by the finger dragging the touch pad on the screen by the moving distance MS and the time T, namely Vf = MS/T.

Specifically, the relationship between the proportionality coefficient δ of the speed Vf of the virtual touchpad dragged by the finger sliding on the touch screen and the speed Vm of the virtual cursor moving on the screen can be referred to the following table 2. The virtual cursor moved over time T is offset on the touch screen by a distance DS equal to δ multiplied by the movement distance MS of the finger dragging the virtual touchpad on the touch screen. I.e. DS = MS δ.

TABLE 2

In another optional embodiment provided in the foregoing embodiment of the present application, when the operation instruction is a left key operation instruction, a right key operation instruction, or a pulley operation instruction, the processing module 108 may include: the second reading module is used for reading operation data corresponding to a left key operation instruction, a right key operation instruction or a pulley operation instruction, wherein the operation data corresponding to the left key operation instruction comprises any one or more of the following instructions: click and confirm the order, double click and confirm the order, the operational data that the right button operation order corresponds includes: and a menu pop-up instruction, wherein the operation data corresponding to the pulley operation instruction comprises any one or more of the following instructions: an up move instruction, a down move instruction; and the second generation module is used for controlling the operation object by the virtual cursor according to the operation data corresponding to the left key operation instruction, the right key operation instruction or the pulley operation instruction to obtain the operation result of the operation object.

From the above description, it can be seen that the present invention achieves the following technical effects: the problem that the finger belly of a finger shields the content on a display screen to influence a user to observe a page is solved, the problems that the accuracy of an operation object is poor and the operation is inconvenient in the process of using a touch screen to perform computer operation in the related art are solved, and the effects that the operation object is accurately selected when the user uses the touch screen and the operation is simple and convenient are further improved. According to the invention, the mouse operation is simulated on the touch screen, and the support provided by external equipment is not needed, so that the aim of saving the production cost is achieved.

From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The application is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.

It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and they may alternatively be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, or fabricated separately as individual integrated circuit modules, or fabricated as a single integrated circuit module from multiple modules or steps. Thus, the present invention is not limited to any specific combination of hardware and software.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An operation method of an operation object based on a touch screen is characterized by comprising the following steps:

the method comprises the steps that an arbitrarily draggable virtual touchpad created on a touch screen receives an operation instruction input by a user, the virtual touchpad moves in at least one moving area, and the at least one moving area can comprise the touch screen; the size of the virtual touch panel is smaller than that of the touch screen;

sending the operation instruction to a virtual cursor created at a position on the touch screen which is not shielded by the virtual touchpad;

acquiring an operation object corresponding to the virtual cursor on a page;

the virtual cursor executes corresponding operation control on the operation object according to the received operation instruction, and controls the movement of the virtual cursor in the at least one moving area by dragging and moving the virtual touchpad in the at least one moving area;

the virtual touchpad comprises an operation area, the operation area is not divided into sub-operation areas, and corresponding key instructions are generated according to various combined operation instructions input by the user so as to control the virtual cursor to execute corresponding operation control on the operation object.

2. The method according to claim 1, wherein before the virtual touchpad created on the touch screen receives an operation instruction input by a user, the method further comprises:

creating the virtual touchpad and the virtual cursor at a predetermined position of the touch screen;

wherein the step of creating the virtual touchpad and the virtual cursor at a predetermined location of the touch screen comprises:

acquiring the screen size of the touch screen;

calculating to obtain the size and the display position of the virtual touch plate according to the screen size of the touch screen;

and determining the initial display position of the virtual cursor according to the display position of the virtual touchpad.

3. The method according to any one of claims 1 or 2, wherein, when the operation instruction is a move operation instruction, the step of the virtual cursor performing corresponding operation control on the operation object according to the received operation instruction comprises:

reading sliding operation data corresponding to the moving operation instruction, wherein the sliding operation data is a moving distance MS input by the user on the virtual touch pad;

the virtual cursor controls the operation object to slide according to the moving distance MS to obtain the moving distance DS of the operation object;

wherein the step of obtaining the moving distance DS of the operation object includes:

calculating the moving speed Vf corresponding to the moving distance MS by the following formula: vf = MS/T, where T is a sliding time corresponding to the moving distance MS;

inquiring to obtain a sliding proportionality coefficient delta according to the moving speed Vf corresponding to the moving distance MS;

the moving distance DS of the operation object is calculated by the following formula: DS = movement distance MS δ.

4. The method according to any one of claims 1 or 2, wherein when the operation instruction is a left key operation instruction, a right key operation instruction, or a pulley operation instruction, the step of the virtual cursor performing corresponding operation control on the operation object according to the received operation instruction comprises:

reading operation data corresponding to the left key operation instruction, the right key operation instruction or the pulley operation instruction, wherein the operation data corresponding to the left key operation instruction comprises any one or more of the following instructions: click and confirm the order, double click and confirm the order, the operational data that the said right key operation order corresponds includes: and a menu pop-up instruction, wherein the operation data corresponding to the pulley operation instruction comprises any one or more of the following instructions: an up move instruction, a down move instruction;

and the virtual cursor controls the operation object according to the operation data corresponding to the left key operation instruction, the right key operation instruction or the pulley operation instruction to obtain an operation result of the operation object.

5. An operation device of an operation object based on a touch panel, comprising:

the touch screen comprises a receiving module, a processing module and a control module, wherein the receiving module is used for receiving an operation instruction input by a user through a virtual touch pad which can be dragged at will and is created on the touch screen, the virtual touch pad moves in at least one moving area, and the at least one moving area can comprise the touch screen; the size of the virtual touch panel is smaller than that of the touch screen;

the sending module is used for sending the operation instruction to a virtual cursor which is created at a position on the touch screen and not shielded by the virtual touchpad;

the acquisition module is used for acquiring an operation object corresponding to the virtual cursor on a page;

the processing module is used for the virtual cursor to execute corresponding operation control on the operation object according to the received operation instruction and control the movement of the virtual cursor in the at least one moving area according to the movement data of the virtual touchpad in the at least one moving area on the touch screen;

the virtual touch pad comprises an operation area, wherein the operation area is not divided into sub-operation areas and is used for generating corresponding key instructions according to various combined operation instructions input by a user so as to control the virtual cursor to execute corresponding operation control on the operation object.

6. The apparatus of claim 5, further comprising:

the creating module is used for creating the virtual touchpad and the virtual cursor at a preset position of the touch screen;

wherein the creation module comprises:

the sub-acquisition module is used for acquiring the screen size of the touch screen;

the calculating module is used for calculating the size and the display position of the virtual touch plate according to the screen size of the touch screen;

and the display position determining module is used for determining the initial display position of the virtual cursor according to the display position of the virtual touchpad.

7. The apparatus according to any one of claims 5 or 6, wherein when the operation instruction is a move operation instruction, the processing module comprises:

a first reading module, configured to read sliding operation data corresponding to the movement operation instruction, where the sliding operation data is a movement distance MS input by the user on the virtual touch pad;

the first generation module is used for controlling the operation object to slide by the virtual cursor according to the moving distance MS to obtain the moving distance DS of the operation object;

wherein the generating module comprises:

the first sub-calculation module is configured to calculate a moving speed Vf corresponding to the moving distance MS by using the following formula: vf = MS/T, where T is a sliding time corresponding to the moving distance MS;

the query module is used for querying according to the moving speed Vf corresponding to the moving distance MS to obtain a sliding proportionality coefficient delta;

a second sub-calculation module, configured to calculate the moving distance DS of the operation object according to the following formula: DS = movement distance MS δ.

8. The apparatus according to any one of claims 5 or 6, wherein when the operation command is a left key operation command, a right key operation command or a pulley operation command, the processing module comprises:

a second reading module, configured to read operation data corresponding to the left key operation instruction, the right key operation instruction, or the pulley operation instruction, where the operation data corresponding to the left key operation instruction includes any one or more of the following instructions: click and confirm the order, double click and confirm the order, the operational data that the said right key operation order corresponds includes: and a menu pop-up instruction, wherein the operation data corresponding to the pulley operation instruction comprises any one or more of the following instructions: an up move instruction, a down move instruction;

and the second generation module is used for controlling the operation object by the virtual cursor according to the operation data corresponding to the left key operation instruction, the right key operation instruction or the pulley operation instruction to obtain an operation result of the operation object.