CN113204305A - Holding mode detection method and device of mobile terminal, medium and mobile terminal - Google Patents

Holding mode detection method and device of mobile terminal, medium and mobile terminal Download PDF

Info

Publication number
CN113204305A
CN113204305A CN202110489502.5A CN202110489502A CN113204305A CN 113204305 A CN113204305 A CN 113204305A CN 202110489502 A CN202110489502 A CN 202110489502A CN 113204305 A CN113204305 A CN 113204305A
Authority
CN
China
Prior art keywords
mobile terminal
holding mode
touch
determining
track
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110489502.5A
Other languages
Chinese (zh)
Other versions
CN113204305B (en
Inventor
潘威
李君斌
徐琳
牛魁元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN202110489502.5A priority Critical patent/CN113204305B/en
Publication of CN113204305A publication Critical patent/CN113204305A/en
Application granted granted Critical
Publication of CN113204305B publication Critical patent/CN113204305B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/20—Drawing from basic elements, e.g. lines or circles
    • G06T11/203—Drawing of straight lines or curves

Abstract

The embodiment of the disclosure relates to a holding mode detection method of a mobile terminal, a holding mode detection device of the mobile terminal, a computer readable storage medium and the mobile terminal, and relates to the technical field of human-computer interaction. The mobile terminal displays a graphical user interface, the method comprising: responding to touch operation acting on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration of the touch operation and position coordinates of a series of touch points generated in the duration corresponding to the touch operation in the graphical user interface; fitting an operation track of touch operation according to the touch event information, and determining an operation type of the touch operation according to the operation track; determining a holding mode of a user holding the mobile terminal for a preset time based on the operation type, wherein the holding mode comprises a left-hand holding mode and a right-hand holding mode. The present disclosure improves convenience of detecting a grip mode of a mobile terminal, and reduces production and manufacturing costs.

Description

Holding mode detection method and device of mobile terminal, medium and mobile terminal
Technical Field
The embodiment of the disclosure relates to the technical field of human-computer interaction, and more particularly, to a holding mode detection method of a mobile terminal, a holding mode detection device of a mobile terminal, a computer-readable storage medium and a mobile terminal.
Background
This section is intended to provide a background or context to the embodiments of the disclosure recited in the claims and the description herein is not admitted to be prior art by inclusion in this section.
With the continuous development of computer technology, the screen size of the mobile terminal is larger and larger, and meanwhile, a user often needs to operate the mobile terminal with one hand. However, due to differences in personal habits and the like, some people are used to operate with the left hand, some people are used to operate with the right hand, and the display mode of most current mobile terminals is the right-hand mode by default. The method can meet the requirement that a user uses the right hand to perform one-handed operation, but is difficult to complete when the user needs to perform one-handed operation by using the left hand, for example, when the user needs to perform touch operations such as right edge sliding, right-to-left sliding unlocking and the like, the right edge cannot be triggered by the left hand.
In order to determine a holding mode of a user for a mobile terminal, an existing mobile terminal may be configured with a sensor, for example, an edge of the mobile terminal may be configured with a plurality of capacitive sensors, and when a finger of the user approaches the mobile terminal, a distance between the user and each edge of the mobile terminal is determined according to a change of a sensing capacitance, so as to determine the holding mode according to a holding position of the user.
Disclosure of Invention
However, since there is a difference in the position, angle, etc. at which each user holds the mobile terminal, and the left and right directions of the mobile terminal are not consistent in the landscape screen state and the portrait screen state of the mobile terminal, it is difficult to determine the screen display direction by a uniform determination standard, and when the mobile terminal has a protective case, the detection effect of the sensor is greatly affected. In addition, the configuration of the sensor in the mobile terminal increases the volume and power consumption of the mobile terminal, and does not meet the production requirements well.
Therefore, a holding mode detection method for a mobile terminal is highly needed to improve the accuracy and applicability of the method for detecting the holding of the mobile terminal by the user and reduce the hardware cost of the mobile terminal.
In this context, embodiments of the present invention desirably provide a holding mode detection method of a mobile terminal, a holding mode detection apparatus of a mobile terminal, a computer-readable storage medium, and a mobile terminal.
According to a first aspect of embodiments of the present invention, there is provided a holding mode detection method for a mobile terminal, the mobile terminal displaying a graphical user interface, the method including: responding to touch operation acting on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration of the touch operation and position coordinates of a series of touch points generated in the duration corresponding to the touch operation in the graphical user interface; fitting an operation track of the touch operation according to the touch event information, and determining an operation type of the touch operation according to the operation track; determining a holding mode of a user holding the mobile terminal within a preset time based on the operation type, wherein the holding mode comprises a left-hand holding mode and a right-hand holding mode.
In an optional implementation manner, the fitting an operation trajectory of the touch operation according to the touch event information includes: determining the position coordinate of each touch point in a series of touch points corresponding to the touch operation according to the touch event information and the time corresponding to the position coordinate of each touch point, and generating time series data of the series of touch points; and sequentially connecting each touch point according to the time sequence of the position coordinate of each touch point based on the time sequence data so as to fit the operation track.
In an optional implementation manner, the determining, based on the operation type, a holding mode of a user holding the mobile terminal for a preset time includes: for the click operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface; and for the sliding operation, determining the holding mode of the user of the mobile terminal according to the track curve of the operation track.
In an optional implementation manner, the determining, according to the operation trajectory, an operation type of the touch operation includes: determining an operation distance of the touch operation according to the operation track; when the operation distance is larger than a preset threshold value, determining that the operation type of the touch operation is the sliding operation; and when the operation distance is not larger than the preset threshold value, determining that the operation type of the touch operation is the click operation.
In an optional implementation manner, the determining a holding mode of a user of the mobile terminal according to a distribution area of the operation positions in the graphical user interface includes: determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size of the mobile terminal and the screen display direction, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction; in the graphical user interface, when the operation position is in a left area of a preset axis, determining that the holding mode is a left-hand holding mode; when the operation position is in a right area of the preset axis, determining the holding mode to be a right-hand holding mode.
In an optional implementation manner, the determining, for the sliding operation, a holding mode of a user of the mobile terminal according to a trajectory curve of the operation trajectory includes: taking a reference line of the track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve; and calculating the distribution quantity of the reference points on the two sides of the reference line, and determining the area where the side with the maximum distribution quantity is located so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
In an optional implementation manner, the determining, for the sliding operation, a holding mode of a user of the mobile terminal according to a trajectory curve of the operation trajectory includes: generating a track image of the touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image; acquiring a historical track image associated with a user of the mobile terminal, and matching the track characteristics of the track image with the track characteristics of the historical track image to obtain the matching degree of the track image and the historical track image; and when the matching degree is greater than a matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
In an optional implementation manner, when determining a holding mode of a user holding the mobile terminal within the preset time, the method further includes: determining the times that the holding mode of a user holding the mobile terminal is continuously the same holding mode; and when the times are greater than a first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
In an optional implementation manner, after determining the holding mode of the user holding the mobile terminal within the preset time, the method further includes: when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acting on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation; determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is continuously the same holding mode, and determining that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
In an optional implementation manner, after obtaining the touch event information of the touch operation, the method further includes: determining whether the coordinate values of the position coordinates corresponding to the series of touch points are monotonically increased or monotonically decreased along with the time sequence according to the time sequence data; and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to be monotonically increasing or monotonically decreasing along the time sequence, determining the touch operation as an effective operation.
In an optional embodiment, the determining, according to the time-series data, whether the coordinate values of the position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease with a time sequence includes: establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time sequence data as a coordinate point in the two-dimensional coordinate system; and sequentially connecting the coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve is monotonically increased or monotonically decreased along the time direction.
In an optional implementation manner, after determining the holding mode of the user holding the mobile terminal within the preset time, the method further includes: adjusting a display layout of the graphical user interface based on the holding mode.
In an alternative embodiment, the adjusting the display layout of the graphical user interface based on the holding mode includes: if the holding mode is a left-hand holding mode, adjusting the display layout of the graphical user interface according to a left-hand layout strategy; wherein the left-hand layout strategy comprises any one of the following: adjusting the display position of an interface element in the graphical user interface to a left area of the graphical user interface according to the direction of the interface element relative to a user of the mobile terminal, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the left area of the graphical user interface.
In an alternative embodiment, the adjusting the display layout of the graphical user interface based on the holding mode includes: if the holding mode is a right-hand holding mode, adjusting the display layout of the graphical user interface according to a right-hand layout strategy; wherein the right-hand layout strategy comprises any one of: adjusting the display direction of an interface element in the graphical user interface to a right area of the graphical user interface according to the direction of the interface element relative to a user of the mobile terminal, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the right area of the graphical user interface.
In an optional implementation manner, a transparent floating layer is disposed in the graphical user interface, the transparent floating layer includes a touch operation detector, and when touch event information of the touch operation is acquired, the method includes: and acquiring touch event information of the touch operation through the touch operation detector.
According to a second aspect of embodiments of the present invention, there is provided a holding mode detection apparatus for a mobile terminal displaying a graphical user interface, the apparatus comprising: the acquisition module is used for responding to touch operation acting on the graphical user interface and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points generated in the duration time corresponding to the touch operation in the graphical user interface; the fitting module is used for fitting an operation track of the touch operation according to the touch event information and determining the operation type of the touch operation according to the operation track; a determining module, configured to determine, based on the operation type, a holding mode of a user holding the mobile terminal within a preset time, where the holding mode includes a left-hand holding mode and a right-hand holding mode.
In an alternative embodiment, the fitting module is configured to: determining the position coordinate of each touch point in a series of touch points corresponding to the touch operation according to the touch event information and the time corresponding to the position coordinate of each touch point, and generating time sequence data of the series of touch points; and sequentially connecting each touch point according to the time sequence of the position coordinate of each touch point based on the time sequence data so as to fit the operation track.
In an optional implementation manner, the operation type includes a click operation and/or a slide operation, and the determining module is configured to: for the click operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface; and for the sliding operation, determining the holding mode of the user of the mobile terminal according to the track curve of the operation track.
In an alternative embodiment, the determining module is configured to: determining an operation distance of the touch operation according to the operation track; when the operation distance is larger than a preset threshold value, determining that the operation type of the touch operation is the sliding operation; and when the operation distance is not larger than the preset threshold value, determining that the operation type of the touch operation is the click operation.
In an alternative embodiment, the determining module is configured to: determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size of the mobile terminal and the screen display direction, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction; in the graphical user interface, when the operation position is in a left area of a preset axis, determining that the holding mode is a left-hand holding mode; when the operation position is in a right area of the preset axis, determining the holding mode to be a right-hand holding mode.
In an alternative embodiment, the determining module is configured to: taking a reference line of the track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve; and calculating the distribution quantity of the reference points on the two sides of the reference line, and determining the area where the side with the maximum distribution quantity is located so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
In an alternative embodiment, the determining module is configured to: generating a track image of the touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image; acquiring a historical track image associated with a user of the mobile terminal, and matching the track characteristics of the track image with the track characteristics of the historical track image to obtain the matching degree of the track image and the historical track image; and when the matching degree is greater than a matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
In an optional implementation manner, when determining the holding mode of the user holding the mobile terminal within the preset time, the determining module is configured to: determining the times that the holding mode of a user holding the mobile terminal is continuously the same holding mode; and when the times are greater than a first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
In an optional implementation manner, after determining the holding mode of the user holding the mobile terminal within the preset time, the determining module is configured to: when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acting on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation; determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is continuously the same holding mode, and determining that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
In an optional implementation manner, after obtaining the touch event information of the touch operation, the fitting module is configured to: determining whether the coordinate values of the position coordinates corresponding to the series of touch points are monotonically increased or monotonically decreased along with the time sequence according to the time sequence data; and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to be monotonically increasing or monotonically decreasing along the time sequence, determining the touch operation as an effective operation.
In an optional embodiment, the fitting module is further configured to: establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time sequence data as a coordinate point in the two-dimensional coordinate system; and sequentially connecting the coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve is monotonically increased or monotonically decreased along the time direction.
In an optional implementation manner, after determining the holding mode of the user holding the mobile terminal within the preset time, the determining module is further configured to: adjusting a display layout of the graphical user interface based on the holding mode.
In an alternative embodiment, the determining module is configured to: if the holding mode is a left-hand holding mode, adjusting the display layout of the graphical user interface according to a left-hand layout strategy; wherein the left-hand layout strategy comprises any one of the following: adjusting the display position of an interface element in the graphical user interface to a left area of the graphical user interface according to the direction of the interface element relative to a user of the mobile terminal, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the left area of the graphical user interface.
In an alternative embodiment, the determining module is configured to: if the holding mode is a right-hand holding mode, adjusting the display layout of the graphical user interface according to a right-hand layout strategy; wherein the right-hand layout strategy comprises any one of: adjusting the display direction of an interface element in the graphical user interface to a right area of the graphical user interface according to the direction of the interface element relative to a user of the mobile terminal, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the right area of the graphical user interface.
In an optional implementation manner, a transparent floating layer is disposed in the graphical user interface, the transparent floating layer includes a touch operation detector, and when acquiring touch event information of the touch operation, the acquiring module is configured to: and acquiring touch event information of the touch operation through the touch operation detector.
According to a third aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements any one of the above-described grip mode detection methods of a mobile terminal.
According to a fourth aspect of embodiments of the present invention, there is provided a mobile terminal comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute any one of the above-mentioned holding mode detection methods of the mobile terminal via execution of the executable instructions.
According to the holding mode detection method of the mobile terminal, the holding mode detection device of the mobile terminal, the computer readable storage medium and the mobile terminal, touch operation applied to the graphical user interface can be responded, touch event information of the touch operation is obtained, an operation track of the touch operation is fitted according to the touch event information, the operation type of the touch operation is determined, and then whether the holding mode of a user holding the mobile terminal in a preset time is a left-hand holding mode or a right-hand holding mode is determined based on the operation type. On one hand, by the method, the touch event information can be analyzed to determine the holding mode of the user of the mobile terminal, and the distance between the hand of the user and the edge of the mobile terminal is not required to be detected by a capacitive sensor and the like, so that the convenience of determining the holding mode of the user is improved, the occupation of too many sensors on the volume and the like of the mobile terminal is reduced, and the production and manufacturing cost is reduced; on the other hand, by determining the operation type of the touch operation and determining the holding mode of the user of the mobile terminal based on the operation type, the influence of irrelevant operation on the judgment of the holding mode of the user can be eliminated according to the operation type of the touch operation, and the accuracy and the efficiency of determining the holding mode of the user are improved.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
fig. 1 illustrates a flowchart of a grip mode detection method of a mobile terminal according to an embodiment of the present disclosure;
FIG. 2 illustrates a flow chart for determining a grip pattern according to an embodiment of the present disclosure;
FIGS. 3A and 3B show schematic diagrams of a landscape display interface, according to embodiments of the present disclosure;
FIGS. 4A and 4B respectively illustrate a schematic diagram of determining a grip pattern according to an embodiment of the present disclosure;
FIG. 5 illustrates a sub-flowchart of a grip pattern detection method according to an embodiment of the present disclosure;
FIGS. 6A and 6B respectively illustrate a trajectory image of an embodiment of the present disclosure;
FIG. 7 illustrates an interface diagram for a left-hand mode according to an embodiment of the present disclosure;
FIG. 8 illustrates an interface diagram for another left-hand mode according to an embodiment of the present disclosure;
FIG. 9 illustrates a schematic interface diagram for a right-hand mode according to an embodiment of the present disclosure;
FIG. 10 shows an interface schematic for another right-hand mode according to an embodiment of the present disclosure;
fig. 11 illustrates a flowchart of another grip mode detection method of a mobile terminal according to an embodiment of the present disclosure;
fig. 12 is a block diagram illustrating a grip mode detection apparatus of a mobile terminal according to an embodiment of the present disclosure; and
fig. 13 illustrates a block diagram of a mobile terminal according to an embodiment of the present disclosure.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
The principles and spirit of the present disclosure will be described with reference to a number of exemplary embodiments. It is understood that these embodiments are given solely for the purpose of enabling those skilled in the art to better understand and to practice the present disclosure, and are not intended to limit the scope of the present disclosure in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As will be appreciated by one skilled in the art, embodiments of the present disclosure may be embodied as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
According to an embodiment of the present disclosure, a holding mode detection method of a mobile terminal, a holding mode detection apparatus of a mobile terminal, a computer-readable storage medium, and a mobile terminal are provided.
In this document, any number of elements in the drawings is by way of example and not by way of limitation, and any nomenclature is used solely for differentiation and not by way of limitation.
The principles and spirit of the present disclosure are explained in detail below with reference to several representative embodiments of the present disclosure.
Summary of The Invention
The disclosed person discovers that the position, the angle and the like of each user holding the mobile terminal are different, the left side and the right side of the mobile terminal are inconsistent in the horizontal screen state and the vertical screen state of the mobile terminal, the screen display direction is difficult to adjust through a unified judgment standard, and when the mobile terminal is provided with a protective shell, the detection effect of a sensor can be greatly influenced. In addition, the configuration of the sensor in the mobile terminal increases the volume and power consumption of the mobile terminal, and does not meet the production requirements well.
In view of the above, the basic idea of the present disclosure is: the method can respond to touch operation acting on a graphical user interface, acquire touch event information of the touch operation, fit an operation track of the touch operation according to the touch event information, determine an operation type of the touch operation, and further determine whether a holding mode of a user holding the mobile terminal in a preset time is a left-hand holding mode or a right-hand holding mode based on the operation type. On one hand, by the method, the touch event information can be analyzed to determine the holding mode of the user of the mobile terminal, and the distance between the hand of the user and the edge of the mobile terminal is not required to be detected by a capacitive sensor and the like, so that the convenience of determining the holding mode of the user is improved, the occupation of too many sensors on the volume and the like of the mobile terminal is reduced, and the production and manufacturing cost is reduced; on the other hand, by determining the operation type of the touch operation and determining the holding mode of the user of the mobile terminal based on the operation type, the influence of irrelevant operation on the judgment of the holding mode of the user can be eliminated according to the operation type of the touch operation, and the accuracy and the efficiency of determining the holding mode of the user are improved.
Having described the general principles of the present disclosure, various non-limiting embodiments of the present disclosure are described in detail below.
Application scene overview
It should be noted that the following application scenarios are merely illustrated to facilitate understanding of the spirit and principles of the present disclosure, and embodiments of the present disclosure are not limited in this respect. Rather, embodiments of the present disclosure may be applied to any scenario where applicable.
When a user triggers a touch operation on a system or an application program and the like on the mobile terminal, touch event information of the touch operation can be acquired, and a holding mode of the user, namely a left-hand holding mode or a right-hand holding mode, is determined according to an operation track fitted by the touch event information. Therefore, the screen display mode of the mobile terminal can be adjusted according to the holding mode of the user, and the requirement of the user for one-hand operation can be better met.
Exemplary method
An exemplary embodiment of the present disclosure first provides a grip mode detection method of a mobile terminal. The method can be applied to mobile terminals such as smart phones, tablet computers and portable computers. A graphical user interface may be displayed on a display screen of the mobile terminal, and when a user performs a touch operation on the graphical user interface, the mobile terminal may determine a mode in which the user holds the mobile terminal at the current time, such as a left-hand holding mode or a right-hand holding mode.
Fig. 1 shows an exemplary flow of a holding mode detection method of a mobile terminal in the present exemplary embodiment, which may include:
step S110, responding to a touch operation acting on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration of the touch operation and position coordinates of a series of touch points generated in the duration corresponding to the touch operation in the graphical user interface;
step S120, fitting an operation track of touch operation according to the touch event information, and determining the operation type of the touch operation according to the operation track;
in step S130, a holding mode of a user holding the mobile terminal for a preset time is determined based on the operation type, and the holding mode includes a left-hand holding mode and a right-hand holding mode.
Each step in fig. 1 will be described in detail below.
In step S110, a touch operation performed on the graphical user interface is responded to, and touch event information of the touch operation is acquired.
The touch event information may include a duration of the touch operation and position coordinates in the graphical user interface corresponding to a series of touch points generated by the touch operation during the duration. The duration may be a time interval from the falling to the lifting of the finger of the user in one touch operation. In some cases, when the user continuously performs the touch operation and a time interval between two adjacent operations is smaller than a preset time threshold, such as 0.2 second, 0.5 second, and the like, the duration may be determined as the time interval corresponding to the user continuous operation.
When receiving a touch operation of a user on the graphical user interface, the mobile terminal may obtain touch event information generated by the touch operation. Generally, a touch event generated by a touch operation of a user may generally include the following processes: triggering a finger Down (Action _ Down) event when a user's finger touches a display screen; when a user finger clicks or slides on a display screen, a movement event (Action _ Move) is generated, and the movement event can be generally triggered for multiple times along with the operation times of the user finger; when the user's finger is removed from the display screen, a removal event (Action _ Up) is triggered. The mobile terminal can respond to the touch operation of the user, and position coordinates of each touch point triggering the touch operation at the corresponding moment are obtained.
In an alternative embodiment, the touch event information obtained in response to the previous touch operation may be cleared whenever a new touch operation is received. Therefore, the recording of the life cycle of the touch operation can be restarted, and the touch event information of the new touch operation can be acquired. By the method, occupation of computer resources and the like by redundant information of historical touch operation can be reduced, and efficiency of processing touch event information is improved.
In order to obtain the touch event information of the mobile terminal in various operating states, in an optional implementation manner, a transparent floating layer may be disposed in the graphical user interface, and the transparent floating layer may include a touch operation detector, so that when obtaining the touch event information of the touch operation, the touch event information of the touch operation may be obtained by the touch operation detector.
The touch event information may include position coordinates of each touch point corresponding to the touch operation, and information such as a direction and a speed of each touch point. In this exemplary embodiment, a plurality of applications may be installed in the mobile terminal, and the transparent floating layer may be a system program of the mobile terminal and may be executed by default, that is, the touch operation detector disposed in the transparent floating layer may receive touch event information of the touch operation regardless of whether the mobile terminal currently runs the application and which application is running. In some cases, the transparent floating layer may also be a program within a particular application program, and may be used to receive touch event information generated within the particular application program. After acquiring the touch event information, the transparent floating layer may transfer the touch event information to a method of processing a touch event or a registered event handler. In addition, the transparent floating layer can be only used for receiving and transmitting touch event information of touch operation without any blocking processing, so that the use of a system or an application program of the mobile terminal is not influenced, and a user does not sense the whole process.
Through the method, the transparent floating layer can be set as a system program, and can also be set as a program in a specific application program, so that various touch operations acting on the graphical user interface, whether the touch operations are operations on the system function of the mobile terminal or operations in various application programs running on the mobile terminal, can be detected and received through the corresponding transparent floating layer. Therefore, the flexibility and applicability of acquiring touch event information can be improved.
Further, after obtaining the touch event information of the touch operation, the following method may be further performed:
determining whether the coordinate values of the position coordinates corresponding to the series of touch points are monotonically increased or monotonically decreased along the time sequence according to the time sequence data;
and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to be monotonically increasing or monotonically decreasing along the time sequence, determining the touch operation as an effective operation.
For example, the time series data may be sorted in time series, and it may be sequentially determined whether the coordinate value of the position coordinate at each time in the time series data is single-point increasing or monotonically decreasing, and when it is determined that the coordinate value of the position coordinate at each time is single-point increasing or monotonically decreasing, the touch operation is determined to be an effective operation, and otherwise, the touch operation is determined to be an ineffective operation. The invalid operation may be an irregular sliding operation performed by the user on the display screen, or a touch operation generated by the user through other parts than the fingers, such as a palm face. For example, when the user slides a finger back and forth in the display screen, the coordinate value of the position coordinate of each touch point in the time-series data shows a cyclic change of increasing first and decreasing second, and at this time, the touch operation may be determined as an invalid operation.
In an alternative embodiment, whether the coordinate values of the position coordinates corresponding to a series of touch points monotonically increase or decrease with time sequence may be determined by:
establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time sequence data as a coordinate point in the two-dimensional coordinate system;
and sequentially connecting the coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve is monotonically increased or monotonically decreased along the time direction.
Specifically, the change in the coordinate value of the abscissa and the ordinate can be determined by plotting each data point in the two-dimensional coordinate system based on the time value and the position coordinate in the time-series data and connecting the plotted coordinate points. Taking the abscissa as the time and the ordinate as the position as an example, along the increasing direction of each coordinate axis, if the value of each coordinate point on the position curve is in an increasing or decreasing trend in the direction of the ordinate axis, it can be determined that the position curve monotonically increases or monotonically decreases along the time direction.
By the method, whether the coordinate value of the position coordinate of each touch point shows monotonicity change can be judged, irregular operation in touch operation is identified to be determined as invalid operation, influence of the invalid operation on determination of the holding mode of the mobile terminal is avoided, and efficiency and accuracy of determination of the holding mode of the mobile terminal are improved.
In step S120, an operation trajectory of the touch operation is fitted according to the touch event information, and an operation type of the touch operation is determined according to the operation trajectory.
In the exemplary embodiment, the operation trajectory may be curve data formed by connecting lines between position coordinates of a series of touch points corresponding to the touch operation when the user performs the touch operation; according to the operation mode of the touch operation, the operation type of the touch operation may include multiple types, for example, a click operation, a slide operation, and the like.
After the touch event information is obtained, an operation track of the touch operation can be fitted according to the position coordinates of a series of touch points generated by the touch operation in the touch event information within the duration, and then the operation type of the touch operation can be determined according to the operation track. For example, in an alternative embodiment, the operation type of the touch operation may be determined by:
determining an operation distance of touch operation according to the operation track;
when the operation distance is larger than a preset threshold value, determining that the operation type of the touch operation is a sliding operation;
and when the operation distance is not greater than the preset threshold value, determining that the operation type of the touch operation is a click operation.
The operation distance of the touch operation may be an actual distance traveled by a series of touch points corresponding to the touch operation, or may be a linear distance between a start point and an end point corresponding to the touch operation.
Further, within the duration of the touch operation, the position coordinates of each touch point corresponding to the touch operation may be sequentially arranged according to a time sequence, and based on this, in an optional implementation, the operation trajectory of the touch operation may be obtained by fitting through the following method:
determining the position coordinate of each touch point in a series of touch points corresponding to the touch operation according to the touch event information and the time corresponding to the position coordinate of each touch point, and generating time sequence data of the series of touch points;
and sequentially connecting each touch point according to the time sequence of the position coordinate of each touch point based on the time sequence data so as to fit an operation track.
Specifically, the position coordinate of each touch point and the time when the position coordinate is generated may be determined according to the touch event information to generate the time series data, for example, the time series data may be expressed as: { t1 (x1, y 1); t2 (x2, y 2); t3 (x3, y3) … … }, where t represents time, x represents the abscissa, and y represents the ordinate. After generating the time-series data regarding the position coordinates of the touch points, the position coordinates of each touch point may be sequentially connected in time order to obtain an operation trajectory of the touch operation.
In an alternative embodiment, when the number of detected touch points is large, in order to improve the efficiency of fitting the operation trajectory, the time series data may be sampled, for example, one data point may be selected as a sample point every N data points from the first data point, so as to obtain the sampled time series data. And N is a positive integer less than the number of touch points.
By the method, the operation track of the touch operation can be fitted according to the touch event information, and the operation type of the touch operation can be determined according to the operation track, so that the influence of some irrelevant operations on the judgment of the holding mode of the user can be eliminated, and the efficiency of determining the holding mode is improved.
In step S130, a holding mode of a user holding the mobile terminal within a predetermined time is determined based on the operation type.
The holding mode can comprise a left-hand holding mode and a right-hand holding mode; the preset time may be a period of time after the user triggers the touch operation, and may be generally set according to actual requirements, for example, 3 seconds, 5 seconds, and the like after the touch operation is triggered.
After the operation type of the touch operation is determined, a user holding the mobile terminal within a preset time, that is, a holding mode of the user of the mobile terminal, may be determined according to the operation type. For example, in an alternative embodiment, referring to fig. 2, the holding mode of the user of the mobile terminal may be determined through the following steps S210 to S220:
in step S210, for the click operation, an operation position of the touch operation is determined according to the operation trajectory, and a holding mode of a user of the mobile terminal is determined according to a distribution area of the operation position in the graphical user interface.
Specifically, for the click operation, the operation position of the touch operation may be determined according to the operation track, and it is determined whether the distribution area of the operation position in the gui is the left area or the right area of the gui, so as to determine the holding mode of the user of the mobile terminal as the left-hand holding mode corresponding to the left area, or determine the holding mode of the user of the mobile terminal as the right-hand holding mode corresponding to the right area.
In practical applications, the division of the left and right side areas of the mobile terminal may vary with the screen display direction of the mobile terminal, for example, referring to fig. 3, in the landscape state, the screen display direction of the mobile terminal may include two directions shown in fig. 3A and 3B, and in the two display directions, the left side area of the mobile terminal may be located at one side of the bottom area and the top area of the mobile terminal in the portrait direction, respectively. Therefore, in order to determine the left and right side areas of the graphical user interface, in an alternative embodiment, step S210 may also be implemented by:
determining the screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size and the screen display direction of the mobile terminal;
in the graphical user interface, when the operation position is in a left area of a preset axis, determining that the holding mode is a left-hand holding mode;
when the operation position is in the right area of the preset axis, determining the holding mode as a right-hand holding mode;
the screen display direction comprises a transverse screen direction and a vertical screen direction; the preset axis may be determined according to a screen size and a screen display direction of the mobile terminal, for example, a central axis of the display screen may be determined as the preset axis. In some cases, the preset axis may also be set as a middle axis of the touch area when the user operates with the left hand and the right hand according to the usage habit of the user, and the middle axis may be different from the middle axis of the display screen.
In the exemplary embodiment, the gravity sensor may detect a gravity change of the mobile terminal, convert the gravity change into an electrical signal, determine whether a screen display direction of the mobile terminal is a horizontal screen or a vertical screen according to the electrical signal, determine a preset axis according to a screen size and the screen display direction, further determine a position relationship between the operation position and the preset axis, determine a holding mode when the operation position is in a left area of the preset axis as a left-hand holding mode, and determine a holding mode when the operation position is in a right area of the preset axis as a right-hand holding mode.
By the method, the holding mode of the user of the mobile terminal when the touch operation is the click operation can be determined.
In step S220, for the sliding operation, the holding mode of the user of the mobile terminal is determined according to the trajectory curve of the operation trajectory.
When the touch operation is a sliding operation, the distance of the operation track of the touch operation is long, so that the holding mode of the mobile terminal can be judged according to the track curve of the operation track.
Specifically, in an optional implementation manner, the holding mode of the mobile terminal when the touch operation is the sliding operation may be determined by the following method:
taking a reference line of the track curve as a reference, sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve;
and calculating the distribution quantity of the reference points on the two sides of the reference line, and determining the area where the side with the maximum distribution quantity is located so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
Taking a straight line between a starting point and an end point of the track curve as a reference line, sampling the track curve at equal intervals according to the reference line, for example, sampling the reference line at equal intervals, determining a plurality of points on the reference line, making a straight line along a direction perpendicular to the reference line at each point, determining an intersection point of the straight line and the track curve to obtain a plurality of reference points, then determining a side corresponding to the maximum number of the distribution numbers of the reference points at two sides of the reference line, and determining a holding mode corresponding to the side as a holding mode of the mobile terminal. For example, referring to fig. 4A, the reference points are all located on the right side of the reference line, and then the grip pattern may be determined to be a left-handed grip pattern. For another example, referring to fig. 4B, when the reference points are all located in the left area of the reference line, the holding mode may be determined to be a right-hand holding mode.
In an alternative embodiment, a number threshold may be set, so that when the number of the reference points on one side of the reference line is greater than the number threshold, the holding mode corresponding to the side greater than the number threshold is determined as the holding mode of the mobile terminal. Particularly, when the number of the reference points on the two sides of the reference line is not more than the number threshold, the number of the reference points is less, and the trace curve can be sampled at equal intervals according to the reference line again.
Further, since the trajectory curve has the characteristics of position, shape, and the like, in an alternative embodiment, as shown in fig. 5, the holding mode of the user of the mobile terminal may also be determined by the following method:
in step S510, a track image of the touch operation is generated according to the operation track, and track features of the track image are extracted.
In the present exemplary embodiment, the trajectory feature includes a trajectory position feature and a trajectory shape feature of the trajectory image. The operation trajectory may be converted into a trajectory image having the same size as the size of the graphical user interface according to the size of the graphical user interface, for example, referring to fig. 6A and 6B, a trajectory image generated in a left-hand mode and a trajectory image generated in a right-hand mode are shown, respectively. The track features, such as track position features and track shape features, of the track image are extracted through a feature extraction algorithm, for example, the track image can be divided into a plurality of image areas, pixel distribution in each image area is analyzed, and the track position features and the track shape features of the track image are determined. The track position feature can be used for representing the position of a point in the track curve in the track image, such as the position of a key point such as a starting point, an inflection point, an end point and the like in the track curve; the trajectory shape feature may be used to represent the shape, distance, etc. of each segment of the trajectory in the operation trajectory.
In step S520, a historical track image associated with a user of the mobile terminal is obtained, and track features of the track image are matched with track features of the historical track image, so as to obtain a matching degree between the track image and the historical track image.
The historical track image may be a track image generated by a user performing a sliding operation with a single hand over a past period of time. In general, the historical track images may include track images of a plurality of users in a single-handed, i.e., left-handed and right-handed operation. The matching degree can be used for representing the similarity of the two track images, the higher the similarity is, the more similar the track positions and the shapes of the two track images are, and conversely, the greater the difference between the track positions and the shapes of the two track images is.
For example, the pixel distribution of each image region in the track image may be matched with the pixel distribution of the corresponding image region in the historical track image to obtain the matching degree between each image region, and then the matching degree between the track image and the historical track image may be determined.
In step S530, when the matching degree is greater than the matching degree threshold, the holding mode of the user of the mobile terminal is determined as the holding mode corresponding to the history track image. The matching degree threshold value can also be customized according to requirements, such as being set to 0.8, 0.9, and the like.
The historical track image and the track image are subjected to feature matching, the matching degree of the track image and the historical track image is determined, so that the holding mode when the matching degree is greater than the threshold value of the matching degree is determined as the holding mode of the mobile terminal, and the accuracy of determining the holding mode can be improved. In addition, as the operation times of the user are continuously increased, the historical track images are gradually enriched, the analysis of various track images can be realized through the method, and correspondingly, the sensitivity and the accuracy of detecting the holding mode of the user on the mobile terminal can also be improved.
Further, in order to improve the accuracy of determining the holding mode, when determining the holding mode of the user holding the mobile terminal within the preset time, the following method may be further performed:
determining the times that the holding mode of a user holding the mobile terminal is continuously the same holding mode;
and when the times are greater than a first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
The method comprises the steps that a user can continuously trigger multiple touch operations within preset time, at the moment, the mobile terminal can detect the holding mode of the mobile terminal during each touch operation, and therefore when the fact that the holding mode of the mobile terminal is continuously the same holding mode is detected to be greater than a first preset number, the same holding mode is determined as the holding mode of the user of the mobile terminal. The first preset number may be set to 3 times, 5 times, etc., or may be set to other values according to actual requirements.
Further, in an alternative embodiment, the following method may also be performed:
when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving next touch operation acting on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation;
and determining the times that the holding mode of the user of the mobile terminal triggering the next touch operation is continuously the same holding mode, and determining that the same holding mode is the holding mode of the user of the mobile terminal when the times are larger than a second preset number.
The second preset number of times may be a value smaller than the first preset number of times. When the holding modes of the mobile terminal detected twice continuously are different, the holding mode of the mobile terminal can be temporarily stopped to be determined, and then the holding mode of the mobile terminal corresponding to the next touch operation is judged. And when the number of times that the holding mode of the mobile terminal corresponding to the next touch operation is continuously the same mode is larger than a second preset threshold value, determining that the same holding mode is the holding mode of the user of the mobile terminal.
By the method, when the holding modes of the mobile terminal detected twice continuously are different, the final holding mode can be determined according to the number of times that the holding mode corresponding to the touch operation triggered subsequently is the same holding mode, so that the possibility of determining the holding mode according to the accidental operation of the user is avoided, and the accuracy of determining the holding mode can be improved.
In addition, after the holding mode of the mobile terminal is determined, in order to facilitate user operation, in an optional embodiment, after the holding mode of a user holding the mobile terminal within a preset time is determined, the display layout of the graphical user interface may be further adjusted based on the holding mode.
Specifically, in an alternative embodiment, the display layout of the graphical user interface may be adjusted by:
and if the holding mode is a left-hand holding mode, adjusting the display layout of the graphical user interface according to a left-hand layout strategy.
Wherein, the left-hand layout strategy may include any one of the following:
(1) and adjusting the display position of the interface element to the left area of the graphical user interface according to the direction of the interface element in the graphical user interface relative to the user of the mobile terminal.
The interface elements in the graphical user interface can comprise any one or more of texts, images and operation controls in the graphical user interface, and the operation controls can comprise floating controls or fixed controls. For example, as shown in fig. 7, in the left-hand mode, the left-hand region may be adjusted to display by text, operation controls, and the like in the graphical user interface, where the operation controls may include a floating control and a fixed control, as shown in the figure, the floating control is a circular floating icon displayed on the left edge, and the fixed control may include text operation controls that are fixedly displayed, such as "about mobile phone", "software update", "system navigation mode", and the like.
(2) And adjusting the area of the display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the left area of the graphical user interface. For example, referring to FIG. 8, a zoom interface 810 having a display scale smaller than the graphical user interface may be displayed in the lower left corner region of the graphical user interface.
Correspondingly, in an alternative embodiment, in the right-hand grip mode, the display layout of the graphical user interface may be adjusted by:
if the holding mode is a right-hand holding mode, adjusting the display layout of the graphical user interface according to a right-hand layout strategy;
wherein, the right-hand layout strategy comprises any one of the following strategies:
(1) and adjusting the display direction of the interface element to the right area of the graphical user interface according to the direction of the interface element in the graphical user interface relative to the user of the mobile terminal.
The interface elements in the graphical user interface can comprise any one or more of texts, images and operation controls in the graphical user interface, and the operation controls can comprise floating controls or fixed controls. For example, as shown in fig. 9, in the right-hand mode, the characters and operation controls in the graphical user interface may be adjusted to be displayed in the right-hand area, and accordingly, the operation controls may include a floating control and a fixed control, as shown in the figure, the floating control is a circular floating icon displayed at the right-hand edge, and the fixed control may include character operation controls that are fixedly displayed, such as "about mobile phone", "software update", "system navigation mode", and the like.
(2) And adjusting the area of the display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the right area of the graphical user interface. For example, referring to FIG. 10, a zoom interface 1010 having a display scale smaller than the graphical user interface may be displayed in the lower right corner region of the graphical user interface.
By the method, the display content in the graphical user interface can be adjusted to the display layout suitable for one-hand operation of the user, for example, the display direction of the interface element in the graphical user can be dynamically adjusted, for example, the display direction of the floating control displayed on the left side and the right side of the mobile terminal can be automatically adjusted, great convenience is provided for the one-hand operation of the mobile terminal by the user, and the normal operation of the user is not influenced.
Fig. 11 shows a flowchart of determining a holding mode in the present exemplary embodiment, which may include the following steps as shown in the figure:
in step S1110, a touch operation performed on the graphical user interface is responded to, and touch event information of the touch operation is acquired.
The touch event information may include a duration of the touch operation and position coordinates of a series of touch points in the graphical user interface, which are generated within the duration corresponding to the touch operation.
In step S1120, the operation distance of the touch operation is determined according to the touch event information.
Specifically, the operation distance of the touch operation may be determined according to a distance that a series of touch points pass through in the touch event information, or may be determined according to a linear distance between the touch points corresponding to the start point and the end point in the touch event information.
In step S1130, it is determined whether the operation distance of the touch operation is greater than a preset threshold. When the operation distance of the touch operation is greater than the preset threshold, executing step S1140; when the operation distance of the touch operation is not greater than the preset threshold, step S1140 is executed, otherwise, step S1150 is executed.
When the operation distance of the touch operation is greater than the preset threshold value and the operation track of the touch operation is longer, it may be determined that the operation type of the touch operation is a sliding operation, and step S1140 is executed; when the operation distance of the touch operation is not greater than the preset threshold, which indicates that the operation trajectory of the touch operation is short, it may be determined that the operation type of the touch operation is a click operation, and step S1150 is performed.
In step S1140, an operation trajectory of the touch operation is fitted according to the touch event information, and a feature analysis is performed on the operation trajectory.
Specifically, the curve characteristics of the operation trajectory may be analyzed, for example, the trajectory curve may be sampled at equal intervals by using a reference line between a start point and an end point of the trajectory curve as a reference, so as to obtain a plurality of reference points, and then determine the number of the reference points located on both sides of the reference line. Or the position feature and the shape feature of the trajectory image of the operation trajectory may be analyzed.
In step S1150, an operation position of the touch operation is determined.
When the touch operation is a click operation, the operation position of the touch operation may be determined according to the operation trajectory, for example, the operation position may be determined according to a middle point between a start point and an end point of the operation trajectory, or a point in the operation trajectory may be subjected to cluster analysis, and a position of a point corresponding to a cluster center is determined as the operation position.
In step S1160, a preset axis is determined according to the screen display direction and the screen size. The display screen of the mobile terminal is divided into a left area and a right area by a preset axis.
In step S1170, a display area where the operation position of the touch operation is located is determined. That is, it is determined on which side of the left and right areas of the display screen the operation position is located.
In step S1180, a holding mode of the user of the mobile terminal is determined. That is, it is determined whether a grip mode of a user of the mobile terminal is a left-hand grip mode or a right-hand grip mode. Specifically, for the slide operation, the holding pattern corresponding to the side having the larger number of reference points may be determined as the holding pattern of the user of the mobile terminal, or the matching degree between the trajectory image of the operation trajectory and the history trajectory image may be calculated, and the holding pattern corresponding to the history trajectory image having the matching degree larger than the threshold value of the matching degree may be determined as the holding pattern of the user of the mobile terminal.
Corresponding to the click operation, the holding mode of the user of the mobile terminal device can be determined as the left-hand holding mode or the right-hand holding mode directly according to the operation position located in the left area or the right area of the display screen.
In step S1190, the display layout of the graphical user interface is adjusted based on the holding mode.
The display layout of the graphical user interface can be automatically adjusted according to the holding mode of the user of the terminal equipment, so that the user of the terminal equipment can operate with one hand.
In summary, according to the holding mode detection method of the mobile terminal in the embodiment of the present disclosure, the touch operation applied to the graphical user interface may be responded to, the touch event information of the touch operation may be obtained, the operation trajectory of the touch operation may be fitted according to the touch event information, the operation type of the touch operation may be determined, and then, based on the operation type, whether the holding mode of the user holding the mobile terminal within the preset time is the left-hand holding mode or the right-hand holding mode may be determined. On one hand, by the method, the touch event information can be analyzed to determine the holding mode of the user of the mobile terminal, and the distance between the hand of the user and the edge of the mobile terminal is not required to be detected by a capacitive sensor and the like, so that the convenience of determining the holding mode of the user is improved, the occupation of too many sensors on the volume and the like of the mobile terminal is reduced, and the production and manufacturing cost is reduced; on the other hand, by determining the operation type of the touch operation and determining the holding mode of the user of the mobile terminal based on the operation type, the influence of irrelevant operation on the judgment of the holding mode of the user can be eliminated according to the operation type of the touch operation, and the accuracy and the efficiency of determining the holding mode of the user are improved.
Exemplary devices
The exemplary embodiments of the present disclosure also provide a holding mode detection apparatus of a mobile terminal. Referring to fig. 12, the holding mode detecting apparatus 1200 of the mobile terminal may include:
an obtaining module 1210, configured to obtain, in response to a touch operation performed on a graphical user interface, touch event information of the touch operation, where the touch event information includes a duration of the touch operation and position coordinates of a series of touch points in the graphical user interface, where the series of touch points are generated within the duration corresponding to the touch operation;
the fitting module 1220 is configured to fit an operation trajectory of the touch operation according to the touch event information, and determine an operation type of the touch operation according to the operation trajectory;
the determining module 1230 may be configured to determine a holding mode of a user holding the mobile terminal for a preset time based on the operation type, where the holding mode includes a left-hand holding mode and a right-hand holding mode.
In an alternative embodiment, the fitting module 1220 is configured to:
determining the position coordinate of each touch point in a series of touch points corresponding to the touch operation and the time corresponding to the position coordinate of each touch point according to the touch event information, and generating time sequence data of the series of touch points;
and sequentially connecting each touch point according to the time sequence of the position coordinate of each touch point based on the time sequence data so as to fit the operation track.
In an alternative embodiment, the operation type includes a click operation and/or a slide operation, and the determining module is configured to:
for the click operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface;
for the sliding operation, the holding mode of the user of the mobile terminal is determined according to the track curve of the operation track.
In an alternative embodiment, the determining module 1230 is configured to:
determining an operation distance of touch operation according to the operation track;
when the operation distance is larger than a preset threshold value, determining that the operation type of the touch operation is a sliding operation; and
and when the operation distance is not greater than the preset threshold value, determining that the operation type of the touch operation is a click operation.
In an alternative embodiment, the determining module 1230 is configured to:
determining the screen display direction of the mobile terminal through a gravity sensor arranged in the mobile terminal, and determining a preset axis according to the screen size and the screen display direction of the mobile terminal, wherein the screen display direction comprises a transverse screen direction and a vertical screen direction;
in the graphical user interface, when the operation position is in a left area of a preset axis, determining that the holding mode is a left-hand holding mode;
when the operation position is in the right area of the preset axis, the holding mode is determined to be a right-hand holding mode.
In an alternative embodiment, the determining module 1230 is configured to:
taking a reference line of the track curve as a reference, sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve;
and calculating the distribution quantity of the reference points on the two sides of the reference line, and determining the area where the side with the maximum distribution quantity is located so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
In an alternative embodiment, the determining module 1230 is configured to:
generating a track image of touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image;
acquiring a historical track image associated with a user of the mobile terminal, and matching the track characteristics of the track image with the track characteristics of the historical track image to obtain the matching degree of the track image and the historical track image;
and when the matching degree is greater than the threshold value of the matching degree, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
In an alternative embodiment, in determining the holding mode of the user holding the mobile terminal within the preset time, the determining module 1230 is configured to:
determining the times that the holding mode of a user holding the mobile terminal is continuously the same holding mode;
and when the times are more than the first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
In an alternative embodiment, after determining the holding mode of the user holding the mobile terminal within the preset time, the determining module 1230 is configured to:
when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving next touch operation acting on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation;
and determining the times that the holding mode of the user of the mobile terminal triggering the next touch operation is continuously the same holding mode, and determining that the same holding mode is the holding mode of the user of the mobile terminal when the times are larger than a second preset number.
In an alternative embodiment, after obtaining the touch event information of the touch operation, the fitting module 1220 is configured to:
determining whether the coordinate values of the position coordinates corresponding to the series of touch points are monotonically increased or monotonically decreased along the time sequence according to the time sequence data;
and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to be monotonically increasing or monotonically decreasing along the time sequence, determining the touch operation as an effective operation.
In an alternative embodiment, the fitting module 1220 is further configured to:
establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time sequence data as a coordinate point in the two-dimensional coordinate system;
and sequentially connecting the coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve is monotonically increased or monotonically decreased along the time direction.
In an alternative embodiment, after determining the holding mode of the user holding the mobile terminal within the preset time, the determining module 1230 is further configured to:
the display layout of the graphical user interface is adjusted based on the holding pattern.
In an alternative embodiment, the determining module 1230 is configured to:
if the holding mode is a left-hand holding mode, adjusting the display layout of the graphical user interface according to a left-hand layout strategy;
wherein, the left-hand layout strategy comprises any one of the following strategies:
adjusting the display position of an interface element to a left area of a graphical user interface according to the direction of the interface element in the graphical user interface relative to a user of the mobile terminal, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
and adjusting the area of the display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the left area of the graphical user interface.
In an alternative embodiment, the determining module 1230 is configured to:
if the holding mode is a right-hand holding mode, adjusting the display layout of the graphical user interface according to a right-hand layout strategy;
wherein, the right-hand layout strategy comprises any one of the following strategies:
adjusting the display direction of an interface element to a right area of the graphical user interface according to the direction of the interface element in the graphical user interface relative to a user of the mobile terminal, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
and adjusting the area of the display interface in the graphical user interface to generate a zooming interface of the display interface, and displaying the zooming interface in the right area of the graphical user interface.
In an optional embodiment, a transparent floating layer is disposed in the graphical user interface, the transparent floating layer includes a touch operation detector, and when acquiring touch event information of a touch operation, the acquiring module 1210 is configured to:
and acquiring touch event information of the touch operation through the touch operation detector.
In addition, other specific details of the embodiments of the present disclosure have been described in detail in the embodiments of the invention of the above method, and are not described herein again.
Exemplary storage Medium
The storage medium of the exemplary embodiment of the present disclosure is explained below.
In the present exemplary embodiment, the above-described method may be implemented by a program product, such as a portable compact disc read only memory (CD-ROM) and including program code, and may be executed on a device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RE, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Exemplary electronic device
An electronic device of an exemplary embodiment of the present disclosure is explained with reference to fig. 13. The electronic device may be the mobile terminal described above.
The electronic device 1300 shown in fig. 13 is only an example and should not bring any limitations to the function and scope of use of the embodiments of the present disclosure.
As shown in fig. 13, the electronic device 1300 is in the form of a general purpose computing device. The components of the electronic device 1300 may include, but are not limited to: at least one processing unit 1310, at least one memory unit 1320, a bus 1330 connecting different system components including the memory unit 1320 and the processing unit 1310, a display unit 1340.
Where the memory unit stores program code, the program code may be executed by the processing unit 1310 to cause the processing unit 1310 to perform the steps according to various exemplary embodiments of the present disclosure described in the above section "exemplary methods" of this specification. For example, the processing unit 1310 may perform the method steps shown in fig. 1, 2, 5, and 11, and so on.
The memory unit 1320 may include volatile memory units, such as a random access memory unit (RAM)1321 and/or a cache memory unit 1322, and may further include a read only memory unit (ROM) 1323.
Storage 1320 may also include a program/utility 1324 having a set (at least one) of program modules 1325, such program modules 1325 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 1330 may include a data bus, an address bus, and a control bus.
The electronic device 1300 may also communicate with one or more external devices 1400 (e.g., keyboard, pointing device, bluetooth device, etc.) via an input/output (I/O) interface 1350. The electronic device 1300 also includes a display unit 1340 connected to the input/output (I/O) interface 1350 for display. Moreover, the mobile terminal 1300 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the internet) via the network adapter 1360. As shown, the network adapter 1360 communicates with other modules of the electronic device 1300 via the bus 1330. It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with the electronic device 1300, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
It should be noted that although in the above detailed description several modules or sub-modules of the apparatus are mentioned, such division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the units/modules described above may be embodied in one unit/module, in accordance with embodiments of the present disclosure. Conversely, the features and functions of one unit/module described above may be further divided into embodiments by a plurality of units/modules.
Further, while the operations of the disclosed methods are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
While the spirit and principles of the present disclosure have been described with reference to several particular embodiments, it is to be understood that the present disclosure is not limited to the particular embodiments disclosed, nor is the division of aspects, which is for convenience only as the features in such aspects may not be combined to benefit. The disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (10)

1. A holding mode detection method of a mobile terminal, the mobile terminal displaying a graphical user interface, the method comprising:
responding to touch operation acting on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration of the touch operation and position coordinates of a series of touch points generated in the duration corresponding to the touch operation in the graphical user interface;
fitting an operation track of the touch operation according to the touch event information, and determining an operation type of the touch operation according to the operation track;
determining a holding mode of a user holding the mobile terminal within a preset time based on the operation type, wherein the holding mode comprises a left-hand holding mode and a right-hand holding mode.
2. The method according to claim 1, wherein the fitting the operation trajectory of the touch operation according to the touch event information includes:
determining the position coordinate of each touch point in a series of touch points corresponding to the touch operation according to the touch event information and the time corresponding to the position coordinate of each touch point, and generating time series data of the series of touch points;
and sequentially connecting each touch point according to the time sequence of the position coordinate of each touch point based on the time sequence data so as to fit the operation track.
3. The method according to claim 1, wherein the operation type includes a click operation and/or a slide operation, and the determining a holding mode of a user holding the mobile terminal for a preset time based on the operation type includes:
for the click operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface;
and for the sliding operation, determining the holding mode of the user of the mobile terminal according to the track curve of the operation track.
4. The method according to claim 3, wherein the determining the operation type of the touch operation according to the operation track comprises:
determining an operation distance of the touch operation according to the operation track;
when the operation distance is larger than a preset threshold value, determining that the operation type of the touch operation is the sliding operation; and
and when the operation distance is not greater than the preset threshold value, determining that the operation type of the touch operation is the click operation.
5. The method according to claim 3, wherein the determining the holding mode of the user of the mobile terminal according to the distribution area of the operation positions in the graphical user interface comprises:
determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size of the mobile terminal and the screen display direction, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction;
in the graphical user interface, when the operation position is in a left area of a preset axis, determining that the holding mode is a left-hand holding mode;
when the operation position is in a right area of the preset axis, determining the holding mode to be a right-hand holding mode.
6. The method according to claim 3, wherein for the sliding operation, determining the holding mode of the user of the mobile terminal according to the trajectory curve of the operation trajectory comprises:
taking a reference line of the track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve;
and calculating the distribution quantity of the reference points on the two sides of the reference line, and determining the area where the side with the maximum distribution quantity is located so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
7. The method according to claim 3, wherein for the sliding operation, determining the holding mode of the user of the mobile terminal according to the trajectory curve of the operation trajectory comprises:
generating a track image of the touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image;
acquiring a historical track image associated with a user of the mobile terminal, and matching the track characteristics of the track image with the track characteristics of the historical track image to obtain the matching degree of the track image and the historical track image;
and when the matching degree is greater than a matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
8. An apparatus for detecting a holding mode of a mobile terminal, the mobile terminal displaying a graphical user interface, the apparatus comprising:
the acquisition module is used for responding to touch operation acting on the graphical user interface and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points generated in the duration time corresponding to the touch operation in the graphical user interface;
the fitting module is used for fitting an operation track of the touch operation according to the touch event information and determining the operation type of the touch operation according to the operation track;
a determining module, configured to determine, based on the operation type, a holding mode of a user holding the mobile terminal within a preset time, where the holding mode includes a left-hand holding mode and a right-hand holding mode.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 7.
10. A mobile terminal, comprising:
a processor;
a display screen for displaying a graphical user interface; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1-7 via execution of the executable instructions.
CN202110489502.5A 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal Active CN113204305B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110489502.5A CN113204305B (en) 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110489502.5A CN113204305B (en) 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal

Publications (2)

Publication Number Publication Date
CN113204305A true CN113204305A (en) 2021-08-03
CN113204305B CN113204305B (en) 2023-06-09

Family

ID=77028496

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110489502.5A Active CN113204305B (en) 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal

Country Status (1)

Country Link
CN (1) CN113204305B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114936002A (en) * 2022-06-10 2022-08-23 斑马网络技术有限公司 Interface display method and device and vehicle

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103870199A (en) * 2014-03-31 2014-06-18 华为技术有限公司 Method for recognizing user operation mode on handheld device and handheld device
CN104571882A (en) * 2013-10-25 2015-04-29 中兴通讯股份有限公司 User operating mode judging method and device based on terminal and terminal
CN104598123A (en) * 2014-12-22 2015-05-06 深圳市万普拉斯科技有限公司 Method and device for displaying screen display picture of mobile terminal
CN105260121A (en) * 2015-10-23 2016-01-20 东莞酷派软件技术有限公司 Terminal control method, terminal control device and terminal
CN106371758A (en) * 2016-09-22 2017-02-01 维沃移动通信有限公司 Mobile terminal holding mode detection method and mobile terminal
US20170153813A1 (en) * 2015-12-01 2017-06-01 Xiaomi Inc. Touch control method and apparatus for function key, and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104571882A (en) * 2013-10-25 2015-04-29 中兴通讯股份有限公司 User operating mode judging method and device based on terminal and terminal
CN103870199A (en) * 2014-03-31 2014-06-18 华为技术有限公司 Method for recognizing user operation mode on handheld device and handheld device
CN104598123A (en) * 2014-12-22 2015-05-06 深圳市万普拉斯科技有限公司 Method and device for displaying screen display picture of mobile terminal
CN105260121A (en) * 2015-10-23 2016-01-20 东莞酷派软件技术有限公司 Terminal control method, terminal control device and terminal
US20170153813A1 (en) * 2015-12-01 2017-06-01 Xiaomi Inc. Touch control method and apparatus for function key, and storage medium
CN106371758A (en) * 2016-09-22 2017-02-01 维沃移动通信有限公司 Mobile terminal holding mode detection method and mobile terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114936002A (en) * 2022-06-10 2022-08-23 斑马网络技术有限公司 Interface display method and device and vehicle

Also Published As

Publication number Publication date
CN113204305B (en) 2023-06-09

Similar Documents

Publication Publication Date Title
KR101502659B1 (en) Gesture recognition method and touch system incorporating the same
US9261995B2 (en) Apparatus, method, and computer readable recording medium for selecting object by using multi-touch with related reference point
US9354804B2 (en) Touch event anticipation in a computing device
US9665217B2 (en) Touch panel scan control
US8502785B2 (en) Generating gestures tailored to a hand resting on a surface
CN107608615B (en) Fingerprint identification function starting method and device, terminal and storage medium
US20140160054A1 (en) Anchor-drag touch symbol recognition
US9280284B2 (en) Method, apparatus and computer readable medium for polygon gesture detection and interaction
CN107390923B (en) Screen false touch prevention method and device, storage medium and terminal
US9182908B2 (en) Method and electronic device for processing handwritten object
WO2013180687A1 (en) Translation of touch input into local input based on a translation profile for an application
US20140079317A1 (en) Electronic apparatus and handwritten document processing method
JP2015529912A (en) Capacitive and electromagnetic induction dual mode touch screen touch control method and handheld electronic device
KR20150027885A (en) Operating Method for Electronic Handwriting and Electronic Device supporting the same
CN107368205B (en) Handwriting input method and mobile terminal
US20170177144A1 (en) Touch display device and touch display method
CN110262713B (en) Icon display method and terminal equipment
CN113204305B (en) Method and device for detecting holding mode of mobile terminal, medium and mobile terminal
US20140348334A1 (en) Portable terminal and method for detecting earphone connection
WO2012059595A1 (en) Touch detection
WO2017067165A1 (en) Method and apparatus for recognising multi-finger sliding gesture and terminal device
CN107291367B (en) Use method and device of eraser
CN106886351B (en) Display method and device of terminal time information and computer equipment
CN112770003A (en) Method, device, terminal and storage medium for controlling electronic equipment
CN109640314B (en) Method and device for processing attribution data and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant