CN106446643B - Terminal control method and device - Google Patents
Terminal control method and device Download PDFInfo
- Publication number
- CN106446643B CN106446643B CN201510494093.2A CN201510494093A CN106446643B CN 106446643 B CN106446643 B CN 106446643B CN 201510494093 A CN201510494093 A CN 201510494093A CN 106446643 B CN106446643 B CN 106446643B
- Authority
- CN
- China
- Prior art keywords
- image
- terminal
- angle
- display screen
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
Abstract
The invention provides a terminal control method and a terminal control device, wherein the method comprises the following steps: acquiring a first image and a second image which are sequentially contacted with a terminal by a user on a display screen of the terminal; when the second image is matched with the first image, an angle between a first straight line in the first image and a second straight line in the second image is acquired, and an operation for controlling the terminal corresponding to the angle is performed. The invention solves the problem that the terminal operation can be realized only according to the click or the line drawing of a single finger in the related technology.
Description
Technical Field
The invention relates to the field of terminal application, in particular to a terminal control method and device.
Background
The screen zooming technology adopts more than two fingers to pinch or release to zoom the image, which is a common scheme of the smart phone, and adopts a gesture mode to realize, for example, a circle is continuously drawn clockwise or counterclockwise, the adjustment of the screen brightness and the sound size can be realized by sliding the screen up and down or sliding the screen left and right, and the screen unlocking mode also has a plurality of modes: such as slide unlocking, press unlocking, image unlocking, fingerprint unlocking, etc. However, in the related art, the most common method is implemented according to physical keys on the terminal.
The capacitive touch screen becomes an essential component of the intelligent terminal and is an important carrier of human-computer interaction. With the popularization of the capacitive screen, a lot of new technologies appear for the operation mode of the capacitive screen, and especially, the research on gestures is particularly intensive, for example, the zooming of an image is realized by kneading and releasing two fingers, the screen is unlocked by using the gestures, and the like, so that the usability of people for operating the intelligent terminal is improved.
The current research is that clicking and sliding of a single finger realize specific operation, or the cooperation of double fingers and multiple fingers realizes specific operation. These related techniques only investigate the actions that a finger can achieve in making a click and slide as a point. Meanwhile, fingerprint recognition can be realized on the whole screen, which is not realized by the previous two-point or multi-point operation.
In the related art, an effective solution is not yet thought of for the problem that the terminal operation can only be realized according to the click or the line drawing of a single finger.
Disclosure of Invention
The invention provides a terminal control method and a terminal control device, which at least solve the problem that terminal operation can only be realized according to clicking or scribing of a single finger in the related technology.
According to an aspect of the present invention, there is provided a control method of a terminal, including: acquiring a first image and a second image which are sequentially contacted with a terminal by a user on a display screen of the terminal; and when the second image is matched with the first image, acquiring an angle between a first straight line in the first image and a second straight line in the second image, and executing an operation corresponding to the angle and used for controlling the terminal.
Further, controlling the operation of the terminal includes at least one of: zooming the image size displayed by the display screen, zooming the page size displayed by the display screen, adjusting the volume of the terminal, adjusting the brightness of the display screen, and unlocking and locking the display screen.
Further, the sequentially acquiring a first image and a second image of a user on a display screen of the terminal, which are in contact with the terminal, comprises: obtaining coordinates of edge points of an area closed shape contacted by the user and the display screen, calculating the area of the area closed shape according to the coordinates, and/or obtaining fingerprint information in the area closed shape; determining the area of the region closure shape and/or the fingerprint information as the first image and determining the area of the region closure shape and/or the fingerprint information as the second image.
Further, the acquiring the angle from the second image to the first image comprises: acquiring a first circle center position of the smallest circle of the area closed shape containing the first image and a second circle center position of the smallest circle of the area closed shape containing the second image; respectively connecting the second circle center position and the first circle center position with a preset reference point to form a second straight line and a first straight line; and calculating an included angle between the second straight line and the first straight line, and taking the included angle as the angle.
Further, the sequentially acquiring a first image and a second image of a user on a display screen of the terminal, which are in contact with the terminal, comprises: acquiring the first image, and recording the acquisition time of the first image as first time; acquiring a designated image after the first time, and judging whether the time difference between a second time and the first time exceeds a preset threshold value, wherein the second time is the acquisition time of the designated image; when the judgment result is negative, determining the designated image as the second image; and when the judgment result is yes, updating the first image by using the specified image.
Further, the method further comprises: when the first image does not match the second image, updating the first image with the second image or deleting the first image and the second image.
Further, the performing of the operation for controlling the terminal corresponding to the angle includes: obtaining an angle value of a rotation direction of the angle, wherein the rotation direction includes: clockwise and counterclockwise; performing an operation for controlling the terminal according to a rotation direction of the angle and/or an angle value of the angle.
According to another aspect of the present invention, there is provided a control apparatus of a terminal, including: the terminal comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first image and a second image which are sequentially contacted with the terminal by a user on a display screen of the terminal; and the first execution module is used for acquiring an angle between a first straight line in the first image and a second straight line in the second image when the second image is matched with the first image, and executing an operation corresponding to the angle and used for controlling the terminal.
Further, the controlling the operation of the terminal includes at least one of: zooming the image size displayed by the display screen, zooming the page size displayed by the display screen, adjusting the volume of the terminal, adjusting the brightness of the display screen, and unlocking and locking the display screen.
Further, the obtaining module further comprises: the first acquisition unit is used for acquiring coordinates of edge points of an area closed shape contacted with the display screen by the user, calculating the area of the area closed shape according to the coordinates and/or acquiring fingerprint information in the area closed shape; a first determining unit configured to determine the area of the region closed shape and/or the fingerprint information as the first image and the second image, and determine the area of the region closed shape and/or the fingerprint information as the second image.
Further, the first execution module further comprises: a second obtaining unit configured to obtain a first center position of a smallest circle of the area closed shape including the first image, and a second center position of the smallest circle of the area closed shape including the second image; the first processing unit is used for respectively connecting the second circle center position, the first circle center position and a preset reference point into a second straight line and a first straight line; and the calculation unit is used for calculating an included angle between the second straight line and the first straight line and taking the included angle as the angle.
Further, the obtaining module further comprises: the third acquisition unit is used for acquiring the first image and recording the acquisition time of the first image as first time; the second processing unit is used for acquiring the designated image after the first time and judging whether the time difference between the second time and the first time exceeds a preset threshold value, wherein the second time is the acquisition time of the designated image; a second determining unit, configured to determine that the designated image is the second image when the determination result is negative; or, when the judgment result is yes, the first image is updated by the appointed image.
Further, the apparatus further comprises: a second execution module to update the first image with the second image or delete the first image and the second image when the first image does not match the second image.
Further, the first execution module further comprises: a fourth obtaining unit, configured to obtain an angle value of a rotation direction of the angle, where the rotation direction includes: clockwise and counterclockwise; and the execution unit is used for executing the operation for controlling the terminal according to the rotation direction of the angle and/or the angle value of the angle.
According to the method and the device, the first image and the second image which are contacted with the terminal by a user on the display screen of the terminal are sequentially acquired, when the first image is matched with the second image, the angle between the first straight line in the first image and the second straight line in the second image is acquired, and the mode corresponding to the angle and used for controlling the operation of the terminal is executed, so that the problem that the terminal operation can be realized only according to the clicking or scribing of a single finger in the related technology is solved, the method for operating the terminal by the single hand is realized, and the effect of operating the terminal by the rotation of the finger is further achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flowchart of a control method of a terminal according to an embodiment of the present invention;
fig. 2 is a block diagram of a configuration of a control apparatus of a terminal according to an embodiment of the present invention;
fig. 3 is a block diagram one of an alternative configuration of an operating device of a terminal according to an embodiment of the present invention;
fig. 4 is a block diagram of an alternative configuration of an operating device of a terminal according to an embodiment of the present invention;
fig. 5 is a block diagram of an alternative configuration of an operating device of a terminal according to an embodiment of the present invention;
fig. 6 is a block diagram of an alternative configuration of an operating device of the terminal according to an embodiment of the present invention;
fig. 7 is a block diagram of an alternative configuration of an operating device of the terminal according to an embodiment of the present invention;
FIG. 8 is a graphical illustration of finger-to-touch screen surface contact according to an alternate embodiment of the present invention;
FIG. 9 is a flow chart of image scaling according to finger area according to an alternative embodiment of the present invention;
FIG. 10 is a flowchart of page image scaling according to finger fingerprint image rotation, according to an alternative embodiment of the present invention;
FIG. 11 is a flowchart of screen unlocking based on finger print image rotation, according to an alternative embodiment of the present invention;
FIG. 12 is a flow diagram for screen unlocking based on finger area rotation in accordance with an alternative embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
In this embodiment, a control method of a terminal is provided, and fig. 1 is a flowchart of a control method of a terminal according to an embodiment of the present invention, as shown in fig. 1, the flowchart includes the following steps:
step S102, acquiring a first image and a second image which are sequentially contacted with a terminal by a user on a display screen of the terminal;
alternatively, the first image and the second image may be, but are not limited to: the contact area and the fingerprint information can also be information of contact between a user such as eye pattern information and the terminal directly or indirectly, in the implementation, the contact area between the user and the display screen which is frequently used and convenient to collect and the fingerprint information with high identifiability are used for illustration, and the terminal display screen in the embodiment can identify the fingerprint information of the user. Optionally, the first image is acquired first, and then the second image is acquired according to the first image and the second image generated by the user operating the terminal in sequence.
And step S104, when the second image is matched with the first image, acquiring an angle between a first straight line in the first image and a second straight line in the second image, and executing an operation corresponding to the angle and used for controlling the terminal.
Optionally, for the manner of determining whether the second image and the first image are matched, the first image and the second image in this embodiment relate to: when the contact area and the fingerprint information are in use, judging whether the difference value between the contact areas in the first image and the second image is smaller than a preset threshold value or not, or whether the fingerprint information in the first image is matched with the fingerprint information in the second image or not; in the embodiment of the present invention, a threshold may be preset to be 2 square centimeters, and in the acquired image, if the contact area of the first image is 5 square centimeters, and when the difference between the contact area of the second image information and 5 square centimeters is smaller than 2 square centimeters, if the contact area of the second image is 6 square centimeters and the difference is 1 square centimeter, it is determined that the first image and the second image are matched, optionally, the threshold may also be set according to the size of the terminal display screen and the size of the contact area between the user and the display screen. And when the image is fingerprint information, matching is directly carried out according to the fingerprint information in the first image information and the second image information.
When the difference value of the contact areas of the first image and the second image is judged to be smaller than the threshold value, the contact area from the contact area in the second image to the contact area in the first image is calculated, or the fingerprint information from the second image to the fingerprint information in the first image is calculated.
Through this embodiment, adopt and acquire first image and the second image of user and terminal contact on the terminal display screen in proper order, wherein, first image and second image include: the method comprises the steps of obtaining contact area and/or fingerprint information, judging whether a difference value between the contact areas in a first image and a second image is smaller than a preset threshold value or not, or whether the fingerprint information is matched or not, calculating an angle from the second image to the first image when the judgment result is yes, and executing operation corresponding to the angle and used for controlling the terminal.
In an alternative implementation according to this embodiment, the operation of the control terminal may be, but is not limited to: the method comprises the steps of zooming the image size displayed by a display screen, zooming the page size displayed by the display screen, adjusting the volume of a terminal, adjusting the brightness of the display screen, unlocking and locking the display screen, optionally setting the current operation according to the specific application scene of the terminal and the current operation condition of a terminal system, and setting the operation to adjust the volume of the terminal if a screen playing interface is looked.
In an optional implementation manner of this embodiment, the manner of sequentially acquiring the first image and the second image that are in contact with the terminal by the user on the display screen of the terminal referred to in this embodiment may be implemented by:
s11, obtaining the coordinates of the edge points of the area closed shape contacted by the user and the display screen, and calculating the area of the area closed shape according to the coordinates and/or obtaining the fingerprint information in the area closed shape;
in this embodiment, according to a region where a finger contacts a display screen, coordinates of a closed edge point of the region are acquired, an area enclosed by all the coordinates is used as a contact area, and the contact area is used as an image, or collected fingerprint information is directly used as an image, optionally, the contact area and the fingerprint information may be used as an image as a whole.
S12, determining the area of the region closed shape and/or the fingerprint information as the first image, and determining the area of the region closed shape and/or the fingerprint information as the second image.
In another optional implementation manner of this embodiment, the manner of calculating the angle from the second image to the first image according to this embodiment may be implemented as follows:
s21, acquiring a first circle center position of the smallest circle of the area closed shape containing the first image and a second circle center position of the smallest circle of the area closed shape containing the second image;
in this embodiment, the contact area in the image or the fingerprint information in the image is the user biometric information of the user contacting the display screen, the contact portion forms a circle-like shape, and the center position of the smallest circle including the circle-like shape is taken as the center position.
S22, respectively connecting the second circle center position and the first circle center position with a preset reference point to form a second straight line and a first straight line;
optionally, the preset reference point may be coordinates of four corners on the terminal display screen, or a center point of the terminal display screen, and when the contact position of the user coincides with the preset reference point, another alternative preset reference point may also be selected. In the present embodiment, a center point of a terminal display screen is taken as an example for explanation.
And S23, calculating an included angle between the second straight line and the first straight line, and taking the included angle as an angle.
In this embodiment, the angle between the second line and the first line may be a positive amount and a negative amount, and may be used to indicate a pair of related operations, for example, when the volume of the terminal is adjusted, the positive amount indicates a turning-up, the negative amount indicates a turning-down, and the adjustment magnitude is determined according to an absolute value of the angle formed between the second line and the first line, and in this embodiment, the range of the angle is 0 to 180 degrees.
In yet another optional implementation manner of this embodiment, the manner of sequentially acquiring the first image and the second image that are touched by the user on the display screen of the terminal as referred to in this embodiment may be implemented by:
s31, acquiring a first image, and recording the acquisition time of the first image as first time;
s32, acquiring the designated image after the first time, and judging whether the time difference between the second time and the first time exceeds a preset threshold value, wherein the second time is the acquisition time of the designated image;
in an optional implementation manner of this embodiment, the designated image is any one image after the first time, and if more designated images are acquired, the designated images may be sorted according to time priority, and one image acquired first after the first time is taken as the designated image.
S33, when the judgment result is negative, determining the designated image as a second image; or, when the judgment result is yes, the first image is updated by the appointed image.
Optionally, after the threshold is determined to be exceeded, the specified image may be updated to be the first image, and then the second image is continuously acquired, or the specified image may be directly abandoned, and the first image and the second image are continuously and sequentially acquired.
In order to prevent the first image and the second image from being acquired for too long time, a threshold is set between the two image acquisition operations, and whether the currently acquired image is used is determined by judging the threshold, so that the problem that the image is lost and the waiting time is too long when the terminal executes the corresponding operation is prevented, and the trouble that the user mistakenly touches a mobile phone to generate an operation instruction without reason to operate the terminal is eliminated.
In an alternative embodiment of this embodiment, the first image is updated with the second image or the first and second images are deleted when there is no match between the first and second images. In a specific application process according to this embodiment, a user may cause an improper operation or other reasons, and the first image and the second image generated by the operation terminal may not match, and at this time, the newly acquired second image may be updated to be set as the first image, or the first image and the second image may be directly deleted, and then the other images may be acquired, and the matching may be continued.
In an optional implementation of this embodiment, the performing the operation for controlling the terminal corresponding to the angle includes:
s41, obtaining the rotation direction and the angle value of the angle, wherein the rotation direction comprises: clockwise and counterclockwise;
s42, performing an operation for controlling the terminal according to the rotation direction of the angle and/or the angle value of the angle.
In an alternative embodiment of this embodiment, the execution of a pair of related opposite operations may be instructed according to the angles being clockwise and counterclockwise, for example, when the volume of the terminal is adjusted, clockwise indicates turning up, and counterclockwise indicates turning down, and the adjustment magnitude is determined according to the absolute value of the angle, which is in the range between 0 and 180 degrees in this embodiment.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, a control device of a terminal is further provided, where the control device is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated for what has been described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 2 is a block diagram of a control apparatus of a terminal according to an embodiment of the present invention, as shown in fig. 2, the apparatus including: an obtaining module 20, a first executing module 24, wherein,
the acquisition module 20 is configured to acquire a first image and a second image of a terminal display screen, where a user sequentially contacts the terminal;
alternatively, the first image and the second image may be, but are not limited to: the contact area and the fingerprint information can also be information of contact between a user such as eye pattern information and the terminal directly or indirectly, in the implementation, the contact area between the user and the display screen which is frequently used and convenient to collect and the fingerprint information with high identifiability are used for illustration, and the terminal display screen in the embodiment can identify the fingerprint information of the user. In this embodiment, the obtaining module 20 obtains the first image and then obtains the second image according to the first image and the second image generated by the user operating the terminal in sequence.
And a first executing module 24, configured to, when the second image matches the first image, acquire an angle between a first straight line in the first image and a second straight line in the second image, and execute an operation corresponding to the angle for controlling the terminal.
Optionally, the manner of determining whether the second image and the first image are matched may be implemented by a determining module, where the first image and the second image in this embodiment relate to: when the contact area and the fingerprint information exist, the judging module is used for judging whether the difference value between the contact areas in the first image and the second image is smaller than a preset threshold value or not, or whether the fingerprint information in the first image is matched with the fingerprint information in the second image or not; in the embodiment of the present invention, a threshold may be preset to be 2 square centimeters, and in the acquired image, if the contact area of the first image is 5 square centimeters, and when the difference between the contact area of the second image information and 5 square centimeters is smaller than 2 square centimeters, if the contact area of the second image is 6 square centimeters and the difference is 1 square centimeter, it is determined that the first image and the second image are matched, optionally, the threshold may also be set according to the size of the terminal display screen and the size of the contact area between the user and the display screen. And when the image is fingerprint information, matching is directly carried out according to the fingerprint information in the first image information and the second image information.
When the difference value of the contact areas of the first image and the second image is judged to be smaller than the threshold value, the contact area from the contact area in the second image to the contact area in the first image is calculated, or the fingerprint information from the second image to the fingerprint information in the first image is calculated.
In an alternative implementation according to this embodiment, the operation of the control terminal may be, but is not limited to: the method comprises the steps of zooming the image size displayed by a display screen, zooming the page size displayed by the display screen, adjusting the volume of a terminal, adjusting the brightness of the display screen, unlocking and locking the display screen, optionally setting the current operation according to the specific application scene of the terminal and the running condition of a terminal system, and setting the operation to adjust the volume of the terminal if a screen playing interface is looked.
Fig. 3 is a block diagram showing an alternative structure of an operating apparatus of a terminal according to an embodiment of the present invention, and as shown in fig. 3, the apparatus includes, in addition to all the modules shown in fig. 2, an acquiring module 20 further including: a first acquisition unit 30, a first determination unit 32, wherein,
the first acquisition unit 30 is used for acquiring coordinates of edge points of an area closed shape contacted with the display screen by a user, calculating the area of the area closed shape according to the coordinates, and/or acquiring fingerprint information in the area closed shape;
in this embodiment, according to a region where a finger contacts a display screen, coordinates of a closed edge point of the region are acquired, an area enclosed by all the coordinates is used as a contact area, and the contact area is used as an image, or collected fingerprint information is directly used as an image, optionally, the contact area and the fingerprint information may be used as an image as a whole.
A first determining unit 32, coupled to the first acquiring unit 30, for determining the area of the area closed shape and/or the fingerprint information as the first image and the second image, and determining the area of the area closed shape and/or the fingerprint information as the second image.
Fig. 4 is a block diagram of an alternative structure of an operating apparatus of a terminal according to an embodiment of the present invention, as shown in fig. 4, the apparatus includes, in addition to all modules shown in fig. 2, a first executing module 24 further including: a second acquisition unit 40, a first processing unit 42, a calculation unit 44, wherein,
a second obtaining unit 40, configured to obtain a first circle center position of a smallest circle of the area closed shape including the first image, and a second circle center position of the smallest circle of the area closed shape including the second image;
in this embodiment, the contact area in the image or the fingerprint information in the image is the user biometric information of the user contacting the display screen, the contact portion forms a circle-like shape, and the second obtaining unit 40 takes the center position of the smallest circle including the circle-like shape as the center position.
The first processing unit 42 is coupled to the second obtaining unit 40, and is configured to connect the second circle center position and the first circle center position with a preset reference point to form a second straight line and a first straight line, respectively;
optionally, the preset reference point may be coordinates of four corners on the terminal display screen, or a center point of the terminal display screen, and when the contact position of the user coincides with the preset reference point, another alternative preset reference point may also be selected. In the present embodiment, a center point of a terminal display screen is taken as an example for explanation.
And the calculating unit 44 is coupled to the first processing unit 42 and is configured to calculate an included angle between the second straight line and the first straight line, and take the included angle as an angle.
In this embodiment, the angle between the second line and the first line may be a positive amount and a negative amount, and may be used to indicate a pair of related opposite operations, for example, when the volume of the terminal is adjusted, the positive amount indicates an increase, the negative amount indicates a decrease, and the adjustment magnitude is determined according to an absolute value of the angle formed between the second line and the first line, and in this embodiment, the range of the angle is 0 to 180 degrees.
Fig. 5 is a block diagram of an alternative structure of an operating apparatus of a terminal according to an embodiment of the present invention, and as shown in fig. 5, the apparatus includes, in addition to all modules shown in fig. 2, an obtaining module 20 further including: a third acquisition unit 50, a second processing unit 52, a second determination unit 54, wherein,
a third acquiring unit 50, configured to acquire the first image and record an acquisition time of the first image as a first time;
the second processing unit 52 is coupled to the third acquiring unit 50, and configured to record a specified image after the first time, and determine whether a time difference between the second time and the first time exceeds a preset threshold, where the second time is an acquiring time of the specified image;
in an optional implementation manner of this embodiment, the designated image is any one image after the first time, and if more designated images are acquired, the designated images may be sorted according to time priority, and one image acquired first after the first time is taken as the designated image.
A second determining unit 54, coupled to the second processing unit 52, for determining the designated image as the second image if the determination result is negative; or, when the judgment result is yes, the first image is updated by the appointed image.
Optionally, after the threshold is determined to be exceeded, the specified image may be updated to be the first image, and then the second image is continuously acquired, or the specified image may be directly abandoned, and the first image and the second image are continuously and sequentially acquired.
In order to prevent the first image and the second image from being acquired for too long time, a threshold is set between the two image acquisition operations, and whether the currently acquired image is used is determined by judging the threshold, so that the problem that the image is lost and the waiting time is too long when the terminal executes the corresponding operation is prevented, and the trouble that the terminal is operated by generating an instruction without reason due to the fact that a user touches a mobile phone by mistake is eliminated.
Fig. 6 is a block diagram of an alternative structure of an operating apparatus of a terminal according to an embodiment of the present invention, as shown in fig. 6, the apparatus includes, in addition to all modules shown in fig. 2: and a second executing module 60, configured to update the first image with the second image or delete the first image and the second image when it is determined that the first image does not match the second image.
In a specific application process according to this embodiment, a user may cause an improper operation or other reasons, and the first image and the second image generated by the operation terminal may not match, and at this time, the newly acquired second image may be updated to be set as the first image, or the first image and the second image may be directly deleted, and then the other images may be acquired, and the matching may be continued.
Fig. 7 is a block diagram of an alternative structure of an operating apparatus of a terminal according to an embodiment of the present invention, as shown in fig. 7, the apparatus includes, in addition to all the modules shown in fig. 2, a first executing module 24 further including: a fourth obtaining unit 70, configured to obtain a rotation direction of the angle and the angle value, where the rotation direction includes: clockwise and counterclockwise; and an executing unit 72, coupled to the fourth obtaining unit 70, for executing an operation for controlling the terminal according to the rotation direction of the angle and/or the angle value of the angle.
In an alternative embodiment of this embodiment, the execution of a pair of related opposite operations may be instructed according to the angles being clockwise and counterclockwise, for example, when the volume of the terminal is adjusted, clockwise indicates turning up, and counterclockwise indicates turning down, and the adjustment magnitude is determined according to the absolute value of the angle, which is in the range between 0 and 180 degrees in this embodiment.
The following describes the present solution in detail according to a specific reference scenario of the terminal actual operation, in conjunction with an alternative embodiment according to the present invention.
Fig. 8 is a schematic diagram of a contact pattern between a finger and a surface of a touch screen according to an alternative embodiment of the present invention, as shown in fig. 8, the finger is in contact with the surface of the capacitive touch screen, the X-axis and Y-axis electrodes of the contact region acquire changes of signals, the contact region between the finger and the surface of the capacitive touch screen forms a closed region, and the edge of the closed region has an irregular shape.
FIG. 9 is a flowchart of image scaling according to finger area according to an alternative embodiment of the present invention, as shown in FIG. 9, including:
step 901, obtaining the area and edge shape of the contact area between the finger and the surface of the capacitive touch screen;
optionally, the area and the edge shape of the contact area between the finger and the surface of the capacitive touch screen are obtained by using a plurality of channel signals acquired by a touch chip of the capacitive touch screen; the coordinates of the edge points of the area are connected into a closed shape, and the area in the closed shape is calculated according to the coordinates of each point on the closed shape; and calculating the position of the center of the minimum circle of the image.
Step S902, calculating the angle of graph rotation when the next irregular geometric shape is matched with the previous irregular geometric shape to obtain the rotation angle;
extracting the edge of the closed image, wherein the edge of the extracted closed image forms an irregular geometric shape because the extracted image is not a complete centrosymmetric figure such as a circle; matching the next irregular geometric shape acquired by the capacitive screen touch chip with the previous irregular geometric shape by a processing chip of the mobile terminal, wherein the similarity is considered to be the same when the similarity exceeds a set threshold; calculating the angle of the figure rotation when the next irregular geometric shape is matched with the previous irregular geometric shape to obtain the rotation angle;
and step S903, extracting the rotation angle of the irregular geometric shape, comparing the rotation angle with a preset picture magnification, obtaining the magnification of the picture image and executing the magnification.
The preset rotation angle corresponds to the magnification and reduction factor of the displayed picture image, for example, it is set that the rotation to the right is magnification and the rotation to the left is reduction, and the image page is magnified or reduced by 0.1 times for every 10 degrees of rotation. Extracting the rotation angle of the irregular geometric shape mentioned in the method to obtain the zooming times of the image of the picture; similarly, volume adjustment and screen brightness adjustment can be realized according to the rotation of the contact area between the finger and the screen.
FIG. 10 is a flowchart of page image scaling according to finger fingerprint image rotation, according to an alternative embodiment of the present invention, as shown in FIG. 10, including:
step S1000, a touch screen collects a finger fingerprint image;
step S1002, calculating the angle of figure rotation when the next fingerprint image is matched with the previous fingerprint image, and obtaining the angle;
and step S1004, extracting the rotation angle of the fingerprint image, comparing the rotation angle with a preset picture magnification factor, obtaining the picture image zooming factor and executing the picture image zooming factor.
The preset rotation angle corresponds to the magnification and reduction times of the displayed picture image, for example, it is set that the right rotation is magnification and the left rotation is reduction, and the image page is magnified or reduced by 0.1 time every time the rotation angle rotates by 10 degrees, and the rotation angle of the fingerprint image is extracted in the above method to obtain the magnification of the picture image scaling.
Fig. 11 is a flow of screen unlocking according to finger fingerprint image rotation according to an alternative embodiment of the present invention, as shown in fig. 11, including:
step S1100, collecting a finger fingerprint image;
step S1102, calculating the angle of graph rotation when the next fingerprint image is matched with the previous fingerprint image to obtain the angle;
and step S1104, extracting the rotation angle of the fingerprint image, comparing the rotation angle with a preset screen unlocking angle, and if the rotation angle exceeds the preset screen unlocking angle, successfully unlocking.
According to the embodiment, the preset rotation angle can realize unlocking, for example, the right rotation is realized, the threshold value is 30 degrees, the rotation angle of the fingerprint image mentioned in the above method is extracted, and when the rotation angle exceeds the preset angle value, the screen unlocking is realized.
FIG. 12 is a flowchart of screen unlocking according to finger area rotation, according to an alternative embodiment of the present invention, as shown in FIG. 12, including:
step S1200, obtaining the area and the edge shape of the contact area of the finger and the surface of the capacitive touch screen;
step S1202, calculating the angle of graph rotation when the next irregular geometric shape is matched with the previous irregular geometric shape to obtain the angle;
step S1204, extracting the rotation angle of the irregular geometric shape, comparing the rotation angle with a preset screen unlocking angle, and if the rotation angle exceeds the preset screen unlocking angle, unlocking successfully.
The preset rotation angle can realize unlocking, for example, right rotation, and the threshold value is 30 degrees; and extracting the angle of the irregular geometric shape rotation mentioned in the method, and realizing screen unlocking when the angle exceeds a preset angle value.
According to the method for realizing zooming of an image or a display page, volume and screen brightness adjustment by using fingerprint identification of a single-finger touch area or a touch screen area, the area shape of the area of the touch screen surface contacted by a single finger is collected by using the touch screen, the rotating direction and the size of the area shape are judged, or the image of the fingerprint is collected, and according to the rotating direction and the size of the fingerprint image, the zooming-in and zooming-out of the terminal display image, the volume increasing or decreasing, the screen brightness increasing or decreasing, and some specific operations, such as screen unlocking and the like, are executed.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in a plurality of processors.
The embodiment of the invention also provides a storage medium. Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
s1, acquiring a first image and a second image which are sequentially contacted with the terminal by a user on a display screen of the terminal;
s2, when the first image matches with the second image, acquiring an angle between a first straight line in the first image and a second straight line in the second image, and performing an operation for controlling the terminal corresponding to the angle.
Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (14)
1. A control method of a terminal, comprising:
acquiring a first image and a second image which are sequentially contacted with a terminal by a user on a display screen of the terminal;
when the second image is matched with the first image, acquiring an angle between a first straight line in the first image and a second straight line in the second image, and executing an operation corresponding to the angle and used for controlling the terminal;
wherein, the matching mode of the second image and the first image comprises at least one of the following modes: determining whether the difference between the contact areas of the second image and the first image is less than a preset threshold value, and determining whether the fingerprint information in the second image and the first image is matched.
2. The method of claim 1, wherein controlling the operation of the terminal comprises at least one of: zooming the image size displayed by the display screen, zooming the page size displayed by the display screen, adjusting the volume of the terminal, adjusting the brightness of the display screen, and unlocking and locking the display screen.
3. The method of claim 1, wherein sequentially acquiring the first image and the second image of the user's contact with the terminal on the display screen of the terminal comprises:
obtaining coordinates of edge points of an area closed shape contacted by the user and the display screen, calculating the area of the area closed shape according to the coordinates, and/or obtaining fingerprint information in the area closed shape;
determining the area of the region closure shape and/or the fingerprint information as the first image and determining the area of the region closure shape and/or the fingerprint information as the second image.
4. The method of claim 3, wherein the obtaining the angle of the second image to the first image comprises:
acquiring a first circle center position of the smallest circle of the area closed shape containing the first image and a second circle center position of the smallest circle of the area closed shape containing the second image;
respectively connecting the second circle center position and the first circle center position with a preset reference point to form a second straight line and a first straight line;
and calculating an included angle between the second straight line and the first straight line, and taking the included angle as the angle.
5. The method of claim 1, wherein sequentially acquiring the first image and the second image of the user's contact with the terminal on the display screen of the terminal comprises:
acquiring the first image, and recording the acquisition time of the first image as first time;
acquiring a designated image after the first time, and judging whether the time difference between a second time and the first time exceeds a preset threshold value, wherein the second time is the acquisition time of the designated image;
when the judgment result is negative, determining the designated image as the second image;
and when the judgment result is yes, updating the first image by using the specified image.
6. The method of claim 1, further comprising:
when the first image does not match the second image, updating the first image with the second image or deleting the first image and the second image.
7. The method according to claim 4, wherein the performing the operation corresponding to the angle for controlling the terminal comprises:
obtaining a rotation direction and an angle value of the angle, wherein the rotation direction comprises: clockwise and counterclockwise;
performing an operation for controlling the terminal according to a rotation direction of the angle and/or an angle value of the angle.
8. A control apparatus of a terminal, comprising:
the terminal comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first image and a second image which are sequentially contacted with the terminal by a user on a display screen of the terminal;
a first executing module, configured to, when the second image is matched with the first image, acquire an angle between a first straight line in the first image and a second straight line in the second image, and execute an operation corresponding to the angle and used for controlling the terminal, where a matching manner of the second image and the first image includes at least one of: determining whether the difference between the contact areas of the second image and the first image is less than a preset threshold value, and determining whether the fingerprint information in the second image and the first image is matched.
9. The apparatus of claim 8, wherein the controlling the operation of the terminal comprises at least one of: zooming the image size displayed by the display screen, zooming the page size displayed by the display screen, adjusting the volume of the terminal, adjusting the brightness of the display screen, and unlocking and locking the display screen.
10. The apparatus of claim 8, wherein the obtaining module further comprises:
the first acquisition unit is used for acquiring coordinates of edge points of an area closed shape contacted with the display screen by the user, calculating the area of the area closed shape according to the coordinates and/or acquiring fingerprint information in the area closed shape;
a first determining unit configured to determine the area of the region closed shape and/or the fingerprint information as the first image and the second image, and determine the area of the region closed shape and/or the fingerprint information as the second image.
11. The apparatus of claim 10, wherein the first execution module further comprises:
a second obtaining unit configured to obtain a first center position of a smallest circle of the area closed shape including the first image, and a second center position of the smallest circle of the area closed shape including the second image;
the first processing unit is used for respectively connecting the second circle center position, the first circle center position and a preset reference point into a second straight line and a first straight line;
and the calculation unit is used for calculating an included angle between the second straight line and the first straight line and taking the included angle as the angle.
12. The apparatus of claim 8, wherein the obtaining module further comprises:
the third acquisition unit is used for acquiring the first image and recording the acquisition time of the first image as first time;
the second processing unit is used for acquiring the designated image after the first time and judging whether the time difference between the second time and the first time exceeds a preset threshold value, wherein the second time is the acquisition time of the designated image;
a second determining unit, configured to determine that the designated image is the second image when the determination result is negative; or, when the judgment result is yes, the first image is updated by the appointed image.
13. The apparatus of claim 8, further comprising:
a second execution module to update the first image with the second image or delete the first image and the second image when the first image does not match the second image.
14. The apparatus of claim 11, wherein the first execution module further comprises:
a fourth obtaining unit, configured to obtain an angle value of a rotation direction of the angle, where the rotation direction includes: clockwise and counterclockwise;
and the execution unit is used for executing the operation for controlling the terminal according to the rotation direction of the angle and/or the angle value of the angle.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510494093.2A CN106446643B (en) | 2015-08-12 | 2015-08-12 | Terminal control method and device |
| PCT/CN2015/091480 WO2016145827A1 (en) | 2015-08-12 | 2015-10-08 | Terminal control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510494093.2A CN106446643B (en) | 2015-08-12 | 2015-08-12 | Terminal control method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106446643A CN106446643A (en) | 2017-02-22 |
| CN106446643B true CN106446643B (en) | 2022-01-28 |
Family
ID=56919596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510494093.2A Active CN106446643B (en) | 2015-08-12 | 2015-08-12 | Terminal control method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106446643B (en) |
| WO (1) | WO2016145827A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109284051A (en) * | 2017-07-21 | 2019-01-29 | 西安中兴新软件有限责任公司 | A kind of method and terminal realized using interaction |
| US11281886B2 (en) * | 2018-02-12 | 2022-03-22 | Huawei Technologies Co., Ltd. | Fingerprint enrollment method and terminal |
| CN109359572A (en) * | 2018-09-30 | 2019-02-19 | 联想(北京)有限公司 | Information processing method, device and electronic equipment |
| CN109542376B (en) * | 2018-11-06 | 2022-03-22 | 西安易朴通讯技术有限公司 | Screen display adjustment method, device and medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101478605A (en) * | 2009-01-13 | 2009-07-08 | 深圳市同洲电子股份有限公司 | Method, system and mobile communication terminal for controlling tridimensional menu display |
| CN101794197A (en) * | 2010-04-06 | 2010-08-04 | 华为终端有限公司 | Triggering method of touch screen, touch device and handheld device |
| CN101833651A (en) * | 2009-03-10 | 2010-09-15 | Lg电子株式会社 | The method of portable terminal and control portable terminal |
| CN102027439A (en) * | 2008-05-12 | 2011-04-20 | 夏普株式会社 | Display device and control method |
| CN102375689A (en) * | 2011-09-23 | 2012-03-14 | 上海量明科技发展有限公司 | Method and system for operating touch screen |
| CN102622174A (en) * | 2012-02-23 | 2012-08-01 | 中兴通讯股份有限公司 | Screen unlocking system and method |
| CN103593119A (en) * | 2012-08-14 | 2014-02-19 | 国基电子（上海）有限公司 | Portable electronic device and method for amplifying display content of device |
| CN104267879A (en) * | 2014-10-24 | 2015-01-07 | 福建星网视易信息系统有限公司 | Interface interaction method and device |
| CN104331191A (en) * | 2013-07-22 | 2015-02-04 | 深圳富泰宏精密工业有限公司 | System and method for realizing touch on basis of image recognition |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4636131B2 (en) * | 2008-07-04 | 2011-02-23 | ソニー株式会社 | Information providing apparatus, information providing method, and program |
| WO2010040670A2 (en) * | 2008-10-06 | 2010-04-15 | Tat The Astonishing Tribe Ab | Method for application launch and system function invocation |
| JP2013210868A (en) * | 2012-03-30 | 2013-10-10 | Sony Corp | Information processing apparatus, information processing method and computer program |
| CN103699331A (en) * | 2014-01-07 | 2014-04-02 | 东华大学 | Gesture method for controlling screen zooming |
-
2015
- 2015-08-12 CN CN201510494093.2A patent/CN106446643B/en active Active
- 2015-10-08 WO PCT/CN2015/091480 patent/WO2016145827A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102027439A (en) * | 2008-05-12 | 2011-04-20 | 夏普株式会社 | Display device and control method |
| CN101478605A (en) * | 2009-01-13 | 2009-07-08 | 深圳市同洲电子股份有限公司 | Method, system and mobile communication terminal for controlling tridimensional menu display |
| CN101833651A (en) * | 2009-03-10 | 2010-09-15 | Lg电子株式会社 | The method of portable terminal and control portable terminal |
| CN101794197A (en) * | 2010-04-06 | 2010-08-04 | 华为终端有限公司 | Triggering method of touch screen, touch device and handheld device |
| CN102375689A (en) * | 2011-09-23 | 2012-03-14 | 上海量明科技发展有限公司 | Method and system for operating touch screen |
| CN102622174A (en) * | 2012-02-23 | 2012-08-01 | 中兴通讯股份有限公司 | Screen unlocking system and method |
| CN103593119A (en) * | 2012-08-14 | 2014-02-19 | 国基电子（上海）有限公司 | Portable electronic device and method for amplifying display content of device |
| CN104331191A (en) * | 2013-07-22 | 2015-02-04 | 深圳富泰宏精密工业有限公司 | System and method for realizing touch on basis of image recognition |
| CN104267879A (en) * | 2014-10-24 | 2015-01-07 | 福建星网视易信息系统有限公司 | Interface interaction method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106446643A (en) | 2017-02-22 |
| WO2016145827A1 (en) | 2016-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE102014117345B4 (en) | Contact signature control of a device | |
| US11386717B2 (en) | Fingerprint inputting method and related device | |
| CN106598455B (en) | Touch behavior response method and device for handheld touch equipment and corresponding equipment | |
| CN106446643B (en) | Terminal control method and device | |
| EP3171294B1 (en) | Information processing apparatus, biometric authentication method, and biometric authentication program | |
| CN105159446A (en) | One-hand operation method and apparatus for terminal | |
| CN105760102B (en) | Terminal interaction control method and device and application program interaction control method | |
| CN103309439A (en) | Gesture recognition apparatus, electronic device, and gesture recognition method | |
| EP2804083A1 (en) | Screen unlocking system and method | |
| US9189152B2 (en) | Touch device and method for dynamically setting touch inactive area, and non-transitory recording medium | |
| US9025878B2 (en) | Electronic apparatus and handwritten document processing method | |
| KR102266196B1 (en) | Apparatus and method for displaying images | |
| CN105487784A (en) | Control method and device of electronic terminal, terminal and system | |
| CN109710066B (en) | Interaction method and device based on gesture recognition, storage medium and electronic equipment | |
| CN108874234B (en) | Touch identification method and device and touch display device | |
| CN104731496A (en) | Unlocking method and electronic device | |
| US20190079663A1 (en) | Screenshot method and screenshot apparatus for an electronic terminal | |
| CN104376241A (en) | Information processing method and electronic device | |
| CN107450717B (en) | Information processing method and wearable device | |
| CN105302459B (en) | Single-hand control method and device for terminal | |
| CN107037951B (en) | Automatic operation mode identification method and terminal | |
| CN106022070A (en) | Operation method, device and terminal based on fingerprint recognition | |
| WO2019201223A1 (en) | Screen display switch method and apparatus, and storage medium | |
| TWI505173B (en) | System and method for improving recognition of a touch keyboard in an electronic device | |
| CN110069126B (en) | Virtual object control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |