CN113204305B - Method and device for detecting holding mode of mobile terminal, medium and mobile terminal - Google Patents

Method and device for detecting holding mode of mobile terminal, medium and mobile terminal Download PDF

Info

Publication number
CN113204305B
CN113204305B CN202110489502.5A CN202110489502A CN113204305B CN 113204305 B CN113204305 B CN 113204305B CN 202110489502 A CN202110489502 A CN 202110489502A CN 113204305 B CN113204305 B CN 113204305B
Authority
CN
China
Prior art keywords
mobile terminal
determining
touch
holding mode
track
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110489502.5A
Other languages
Chinese (zh)
Other versions
CN113204305A (en
Inventor
潘威
李君斌
徐琳
牛魁元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN202110489502.5A priority Critical patent/CN113204305B/en
Publication of CN113204305A publication Critical patent/CN113204305A/en
Application granted granted Critical
Publication of CN113204305B publication Critical patent/CN113204305B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/20—Drawing from basic elements, e.g. lines or circles
    • G06T11/203—Drawing of straight lines or curves

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

The embodiment of the disclosure relates to a holding mode detection method of a mobile terminal, a holding mode detection device of the mobile terminal, a computer readable storage medium and the mobile terminal, and relates to the technical field of man-machine interaction. The mobile terminal displays a graphical user interface, the method comprising: responding to touch operation acted on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points in the graphical user interface, which are generated within the duration time and correspond to the touch operation; fitting an operation track of touch operation according to the touch event information, and determining the operation type of the touch operation according to the operation track; a grip pattern of a user gripping the mobile terminal for a preset time is determined based on the operation type, and the grip pattern includes a left hand grip pattern and a right hand grip pattern. The method and the device improve the convenience of detecting the holding mode of the mobile terminal and reduce the production and manufacturing cost.

Description

Method and device for detecting holding mode of mobile terminal, medium and mobile terminal
Technical Field
Embodiments of the present disclosure relate to the field of man-machine interaction technologies, and more particularly, to a method for detecting a grip pattern of a mobile terminal, a device for detecting a grip pattern of a mobile terminal, a computer-readable storage medium, and a mobile terminal.
Background
This section is intended to provide a background or context for the embodiments of the disclosure recited in the claims, which description herein is not admitted to be prior art by inclusion in this section.
With the continuous development of computer technology, the screen size of the mobile terminal is increasing, and at the same time, a user often needs to operate the mobile terminal with one hand. However, due to differences in personal habits, some people are used to left-handed operation, some people are used to right-handed operation, and most of the current display modes of mobile terminals are default to right-handed mode. The method can meet the requirement of a user for performing one-hand operation by using the right hand, but when the user needs to perform one-hand operation by using the left hand, the operation is difficult to complete, for example, when the user needs to perform touch operation such as sliding of the right edge, sliding unlocking from right to left, and the like, correct operation cannot be triggered because the left hand cannot reach the right edge.
In order to determine the holding mode of the mobile terminal by the user, the existing mobile terminal is provided with a sensor, for example, a plurality of capacitance sensors can be arranged at the edge of the mobile terminal, and when the finger of the user approaches the mobile terminal, the distance between the user and each edge of the mobile terminal is determined according to the change of the sensing capacitance, so that the holding mode is determined according to the holding position of the user.
Disclosure of Invention
However, since there are differences in the position, angle, etc. at which each user holds the mobile terminal, and the left and right directions of the mobile terminal are not identical in the horizontal and vertical screen states of the mobile terminal, it is difficult to determine the screen display direction by a uniform judgment standard, and the detection effect of the sensor may be greatly affected when the mobile terminal is provided with the protective case. In addition, configuring the sensor in the mobile terminal increases the volume and power consumption of the mobile terminal, and cannot well meet the production requirements.
Therefore, a method for detecting a grip pattern of a mobile terminal is highly required to improve accuracy and applicability of detecting a manner in which a user grips the mobile terminal, and reduce hardware cost of the mobile terminal.
In this context, it is desirable for embodiments of the present invention to provide a grip pattern detection method of a mobile terminal, a grip pattern detection apparatus of a mobile terminal, a computer-readable storage medium, and a mobile terminal.
According to a first aspect of embodiments of the present invention, there is provided a method for detecting a grip mode of a mobile terminal, the mobile terminal displaying a graphical user interface, the method comprising: responding to touch operation acted on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points generated in the duration time corresponding to the touch operation in the graphical user interface; fitting an operation track of the touch operation according to the touch event information, and determining an operation type of the touch operation according to the operation track; and determining a holding mode of a user holding the mobile terminal in a preset time based on the operation type, wherein the holding mode comprises a left hand holding mode and a right hand holding mode.
In an optional implementation manner, the fitting the operation track of the touch operation according to the touch event information includes: determining the position coordinates of each touch point in a series of touch points corresponding to the touch operation and the time corresponding to the position coordinates of each touch point according to the touch event information, and generating time sequence data of the series of touch points; and connecting each touch point in turn according to the time sequence of the position coordinates of each touch point based on the time sequence data so as to fit the operation track.
In an alternative embodiment, the operation type includes a click operation and/or a slide operation, and the determining a holding mode of a user holding the mobile terminal for a preset time based on the operation type includes: for the clicking operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface; and for the sliding operation, determining the holding mode of the user of the mobile terminal according to the track curve of the operation track.
In an optional implementation manner, the determining the operation type of the touch operation according to the operation track includes: determining the operation distance of the touch operation according to the operation track; when the operation distance is larger than a preset threshold value, determining the operation type of the touch operation as the sliding operation; and determining the operation type of the touch operation as the click operation when the operation distance is not greater than the preset threshold value.
In an alternative embodiment, the determining the holding mode of the user of the mobile terminal according to the distribution area of the operation position in the graphical user interface includes: determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size of the mobile terminal and the screen display direction, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction; determining, in the graphical user interface, that the grip mode is a left hand grip mode when the operational position is in a left region of a preset axis; and determining that the holding mode is a right hand holding mode when the operation position is in a right side area of the preset axis.
In an alternative embodiment, for the sliding operation, determining a holding mode of the user of the mobile terminal according to a track curve of the operation track includes: taking a reference line of the track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve; and calculating the distribution quantity of the plurality of reference points on two sides of the reference line, and determining the area where the side with the largest distribution quantity is located, so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
In an alternative embodiment, for the sliding operation, determining a holding mode of the user of the mobile terminal according to a track curve of the operation track includes: generating a track image of the touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image; acquiring a historical track image associated with a user of the mobile terminal, and matching track characteristics of the track image with track characteristics of the historical track image to obtain matching degree of the track image and the historical track image; and when the matching degree is larger than a matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
In an alternative embodiment, when determining the holding mode of the user holding the mobile terminal for the preset time, the method further includes: determining the number of times that the holding mode of a user holding the mobile terminal is continuously the same holding mode; and when the times are larger than a first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
In an alternative embodiment, after determining the holding mode of the user holding the mobile terminal for the preset time, the method further includes: when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acted on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation; and determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is the same holding mode continuously, so as to determine that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
In an optional implementation manner, after obtaining the touch event information of the touch operation, the method further includes: according to the time sequence data, determining whether coordinate values of position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease along with the time sequence; and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to monotonically increase or monotonically decrease along the time sequence, determining the touch operation as an effective operation.
In an optional embodiment, the determining, according to the time series data, whether the coordinate values of the position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease with time sequence includes: establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time series data into a coordinate point in the two-dimensional coordinate system; and sequentially connecting coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve monotonically increases or monotonically decreases along the time direction.
In an alternative embodiment, after determining the holding mode of the user holding the mobile terminal for the preset time, the method further includes: and adjusting a display layout of the graphical user interface based on the grip pattern.
In an alternative embodiment, the adjusting the display layout of the graphical user interface based on the grip pattern includes: if the holding mode is a left hand holding mode, adjusting the display layout of the graphical user interface according to a left hand layout strategy; wherein the left-hand layout strategy comprises any one of the following: according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display position of the interface element to the left side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in the left area of the graphical user interface.
In an alternative embodiment, the adjusting the display layout of the graphical user interface based on the grip pattern includes: if the holding mode is a right hand holding mode, adjusting the display layout of the graphical user interface according to a right hand layout strategy; wherein the right-hand layout strategy comprises any one of the following: according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display direction of the interface element to a right side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in a right area of the graphical user interface.
In an alternative embodiment, a transparent floating layer is disposed in the graphical user interface, the transparent floating layer includes a touch operation detector, and when touch event information of the touch operation is acquired, the method includes: and acquiring touch event information of the touch operation through the touch operation detector.
According to a second aspect of embodiments of the present invention, there is provided a grip pattern detection apparatus of a mobile terminal displaying a graphical user interface, the apparatus comprising: the acquisition module is used for responding to the touch operation acted on the graphical user interface and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points in the graphical user interface, which are generated in the duration time corresponding to the touch operation; the fitting module is used for fitting out an operation track of the touch operation according to the touch event information and determining the operation type of the touch operation according to the operation track; and the determining module is used for determining a holding mode of a user holding the mobile terminal in a preset time based on the operation type, wherein the holding mode comprises a left hand holding mode and a right hand holding mode.
In an alternative embodiment, the fitting module is configured to: determining the position coordinates of each touch point in a series of touch points corresponding to the touch operation and the time corresponding to the position coordinates of each touch point according to the touch event information, and generating time sequence data of the series of touch points; and connecting each touch point in turn according to the time sequence of the position coordinates of each touch point based on the time sequence data so as to fit the operation track.
In an alternative embodiment, the operation type includes a click operation and/or a slide operation, and the determining module is configured to: for the clicking operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface; and for the sliding operation, determining the holding mode of the user of the mobile terminal according to the track curve of the operation track.
In an alternative embodiment, the determining module is configured to: determining the operation distance of the touch operation according to the operation track; when the operation distance is larger than a preset threshold value, determining the operation type of the touch operation as the sliding operation; and determining the operation type of the touch operation as the click operation when the operation distance is not greater than the preset threshold value.
In an alternative embodiment, the determining module is configured to: determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size of the mobile terminal and the screen display direction, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction; determining, in the graphical user interface, that the grip mode is a left hand grip mode when the operational position is in a left region of a preset axis; and determining that the holding mode is a right hand holding mode when the operation position is in a right side area of the preset axis.
In an alternative embodiment, the determining module is configured to: taking a reference line of the track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve; and calculating the distribution quantity of the plurality of reference points on two sides of the reference line, and determining the area where the side with the largest distribution quantity is located, so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
In an alternative embodiment, the determining module is configured to: generating a track image of the touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image; acquiring a historical track image associated with a user of the mobile terminal, and matching track characteristics of the track image with track characteristics of the historical track image to obtain matching degree of the track image and the historical track image; and when the matching degree is larger than a matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
In an alternative embodiment, when determining the holding mode of the user holding the mobile terminal for the preset time, the determining module is configured to: determining the number of times that the holding mode of a user holding the mobile terminal is continuously the same holding mode; and when the times are larger than a first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
In an alternative embodiment, after determining the holding mode of the user holding the mobile terminal for the preset time, the determining module is configured to: when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acted on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation; and determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is the same holding mode continuously, so as to determine that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
In an alternative embodiment, after acquiring the touch event information of the touch operation, the fitting module is configured to: according to the time sequence data, determining whether coordinate values of position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease along with the time sequence; and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to monotonically increase or monotonically decrease along the time sequence, determining the touch operation as an effective operation.
In an alternative embodiment, the fitting module is further configured to: establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time series data into a coordinate point in the two-dimensional coordinate system; and sequentially connecting coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve monotonically increases or monotonically decreases along the time direction.
In an alternative embodiment, after determining the holding mode of the user holding the mobile terminal for the preset time, the determining module is further configured to: and adjusting a display layout of the graphical user interface based on the grip pattern.
In an alternative embodiment, the determining module is configured to: if the holding mode is a left hand holding mode, adjusting the display layout of the graphical user interface according to a left hand layout strategy; wherein the left-hand layout strategy comprises any one of the following: according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display position of the interface element to the left side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in the left area of the graphical user interface.
In an alternative embodiment, the determining module is configured to: if the holding mode is a right hand holding mode, adjusting the display layout of the graphical user interface according to a right hand layout strategy; wherein the right-hand layout strategy comprises any one of the following: according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display direction of the interface element to a right side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control; and adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in a right area of the graphical user interface.
In an optional implementation manner, a transparent floating layer is disposed in the graphical user interface, the transparent floating layer includes a touch operation detector, and when touch event information of the touch operation is acquired, the acquiring module is configured to: and acquiring touch event information of the touch operation through the touch operation detector.
According to a third aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a grip pattern detection method of any one of the above-described mobile terminals.
According to a fourth aspect of the embodiment of the present invention, there is provided a mobile terminal including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform any one of the above-described grip pattern detection methods of the mobile terminal via execution of the executable instructions.
According to the method for detecting the holding mode of the mobile terminal, the device for detecting the holding mode of the mobile terminal, the computer readable storage medium and the mobile terminal, touch event information of the touch operation can be obtained in response to the touch operation acting on the graphical user interface, an operation track of the touch operation is fitted according to the touch event information, the operation type of the touch operation is determined, and whether the holding mode of a user holding the mobile terminal in a preset time is a left hand holding mode or a right hand holding mode is determined based on the operation type. On the one hand, through the method, the touch event information can be analyzed to determine the holding mode of the user of the mobile terminal, the distance between the hand of the user and the edge of the mobile terminal is not required to be detected through a capacitive sensor and the like, the convenience of determining the holding mode of the user is improved, the occupation of the excessive sensors on the volume and the like of the mobile terminal is reduced, and the production and manufacturing cost is reduced; on the other hand, by determining the operation type of the touch operation and determining the holding mode of the user of the mobile terminal based on the operation type, the influence of the irrelevant operation on the judgment of the holding mode of the user can be eliminated according to the operation type of the touch operation, and the accuracy and the efficiency of determining the holding mode of the user are improved.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings, in which:
fig. 1 illustrates a flowchart of a grip pattern detection method of a mobile terminal according to an embodiment of the present disclosure;
FIG. 2 illustrates a flow chart of determining a grip pattern according to an embodiment of the present disclosure;
FIGS. 3A and 3B illustrate schematic diagrams of a cross-screen display interface according to an embodiment of the present disclosure;
FIGS. 4A and 4B respectively illustrate a schematic diagram of one determination of a grip pattern according to an embodiment of the present disclosure;
FIG. 5 illustrates a sub-flowchart of a grip pattern detection method according to an embodiment of the present disclosure;
FIGS. 6A and 6B illustrate a track image of an embodiment of the present disclosure, respectively;
FIG. 7 illustrates an interface schematic of a left-hand mode according to an embodiment of the present disclosure;
FIG. 8 illustrates an interface schematic of another left-hand mode according to an embodiment of the present disclosure;
FIG. 9 illustrates an interface schematic diagram of a right-hand mode according to an embodiment of the present disclosure;
FIG. 10 illustrates an interface schematic of another right-hand mode according to an embodiment of the present disclosure;
fig. 11 illustrates a flowchart of another grip pattern detection method of a mobile terminal according to an embodiment of the present disclosure;
fig. 12 is a block diagram showing a grip pattern detection apparatus of a mobile terminal according to an embodiment of the present disclosure; and
fig. 13 shows a block diagram of a mobile terminal according to an embodiment of the present disclosure.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
The principles and spirit of the present disclosure will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are presented merely to enable one skilled in the art to better understand and practice the present disclosure and are not intended to limit the scope of the present disclosure in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Those skilled in the art will appreciate that embodiments of the present disclosure may be implemented as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the following forms, namely: complete hardware, complete software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
According to an embodiment of the present disclosure, a grip pattern detection method of a mobile terminal, a grip pattern detection apparatus of a mobile terminal, a computer-readable storage medium, and a mobile terminal are provided.
Any number of elements in the figures are for illustration and not limitation, and any naming is used for distinction only, and not for any limiting sense.
The principles and spirit of the present disclosure are described in detail below with reference to several representative embodiments thereof.
Summary of The Invention
The present disclosure finds that there are differences in the position, angle, etc. at which each user holds the mobile terminal, and in the horizontal screen state and the vertical screen state of the mobile terminal, the left side and the right side directions of the mobile terminal are inconsistent, it is difficult to adjust the screen display direction by a unified judgment standard, and when the mobile terminal has a protective case, the detection effect of the sensor can be greatly affected. In addition, configuring the sensor in the mobile terminal increases the volume and power consumption of the mobile terminal, and cannot well meet the production requirements.
In view of the above, the basic idea of the present disclosure is that: the method for detecting the holding mode of the mobile terminal, the device for detecting the holding mode of the mobile terminal, the computer readable storage medium and the mobile terminal can respond to touch operation acted on a graphical user interface, acquire touch event information of the touch operation, fit an operation track of the touch operation according to the touch event information, determine the operation type of the touch operation, and further determine whether the holding mode of a user holding the mobile terminal in a preset time is a left hand holding mode or a right hand holding mode based on the operation type. On the one hand, through the method, the touch event information can be analyzed to determine the holding mode of the user of the mobile terminal, the distance between the hand of the user and the edge of the mobile terminal is not required to be detected through a capacitive sensor and the like, the convenience of determining the holding mode of the user is improved, the occupation of the excessive sensors on the volume and the like of the mobile terminal is reduced, and the production and manufacturing cost is reduced; on the other hand, by determining the operation type of the touch operation and determining the holding mode of the user of the mobile terminal based on the operation type, the influence of the irrelevant operation on the judgment of the holding mode of the user can be eliminated according to the operation type of the touch operation, and the accuracy and the efficiency of determining the holding mode of the user are improved.
Having described the basic principles of the present disclosure, various non-limiting embodiments of the present disclosure are specifically described below.
Application scene overview
It should be noted that the following application scenarios are only shown for facilitating understanding of the spirit and principles of the present disclosure, and embodiments of the present disclosure are not limited in this respect. Rather, embodiments of the present disclosure may be applied to any scenario where applicable.
When a user triggers a touch operation on a system or an application program on the mobile terminal, touch event information of the touch operation can be obtained, and a holding mode of the user, namely a left hand holding mode or a right hand holding mode, is determined according to an operation track fitted by the touch event information. Therefore, the screen display mode of the mobile terminal can be adjusted according to the holding mode of the user, and the requirement of one-hand operation of the user is better met.
Exemplary method
Exemplary embodiments of the present disclosure first provide a grip pattern detection method of a mobile terminal. The method can be applied to mobile terminals such as smart phones, tablet computers and portable computers. In the display screen of the mobile terminal, a graphical user interface may be displayed, and when the user performs a touch operation in the graphical user interface, the mobile terminal may determine a mode in which the user holds the mobile terminal at the current time, such as a left-hand holding mode or a right-hand holding mode.
Fig. 1 shows an exemplary flow of a grip pattern detection method of a mobile terminal in the present exemplary embodiment, and may include:
step S110, responding to the touch operation acted on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points in the graphical user interface, which are generated within the duration time corresponding to the touch operation;
step S120, fitting an operation track of touch operation according to the touch event information, and determining the operation type of the touch operation according to the operation track;
step S130, a holding mode of a user holding the mobile terminal in a preset time is determined based on the operation type, wherein the holding mode comprises a left hand holding mode and a right hand holding mode.
Each step in fig. 1 is described in detail below.
In step S110, in response to a touch operation on the gui, touch event information of the touch operation is obtained.
The touch event information may include a duration of the touch operation and position coordinates in the graphical user interface corresponding to a series of touch points generated by the touch operation within the duration. The duration may be an interval of time that the user's finger experiences from falling to lifting in one touch operation. In some cases, when the user continuously performs the touch operation and the time interval between two adjacent operations is smaller than a preset time threshold, such as 0.2 seconds, 0.5 seconds, and the like, the duration may be determined as the time interval corresponding to the continuous operation of the user.
When receiving a touch operation of a user acting on a graphical user interface, the mobile terminal can acquire touch event information generated by the touch operation. In general, a touch event generated by a touch operation of a user may generally include the following processes: triggering an Action Down event when a user's finger touches the display screen; when a user finger clicks or slides on the display screen, a movement event (action_move) is generated, and the movement event can be triggered for a plurality of times along with the operation times of the user finger; when the user's finger is moved away from the display screen, a move-away event (action_up) is triggered. The mobile terminal can respond to the touch operation of the user and acquire the position coordinates of each touch point at the corresponding moment, wherein the position coordinates trigger the touch operation.
In an alternative embodiment, the touch event information acquired in response to the previous touch operation may be emptied whenever a new touch operation is received. Therefore, the life cycle of the touch operation can be restarted to be recorded, and the touch event information of the new touch operation can be acquired. By the method, occupation of redundant information of historical touch operation on computer resources and the like can be reduced, and the efficiency of processing touch event information is improved.
In order to obtain touch event information of the mobile terminal in various running states, in an alternative embodiment, a transparent floating layer may be disposed in the graphical user interface, where the transparent floating layer may include a touch operation detector, so that when touch event information of a touch operation is obtained, the touch event information of the touch operation may be obtained by the touch operation detector.
The touch event information may include position coordinates of each touch point corresponding to the touch operation, and information such as direction and speed of each touch point. In this exemplary embodiment, a plurality of application programs may be installed in the mobile terminal, and the transparent floating layer may be a system program of the mobile terminal and may be executed by default, that is, the touch operation detector set in the transparent floating layer may receive touch event information of a touch operation, regardless of whether the mobile terminal currently runs the application program or not and which application program is running. In some cases, the transparent floating layer may also be a program in a specific application program, and may be used to receive touch event information generated in the specific application program. After the touch event information is acquired, the transparent floating layer can transmit the touch event information to a method for processing the touch event or a registered event processing program. In addition, the transparent floating layer can be only used for receiving and transmitting touch event information of touch operation without any blocking processing, so that the use of a system or an application program of the mobile terminal is not affected, and the user does not feel in the whole process.
By the method, the transparent floating layer can be set as a system program and also can be set as a program in a specific application program, so that various touch operations acting on the graphical user interface, whether the operations are operations of system functions of the mobile terminal or operations in various application programs running on the mobile terminal, can be detected and received through the corresponding transparent floating layer. Therefore, the flexibility and applicability of acquiring the touch event information can be improved.
Further, after the touch event information of the touch operation is obtained, the following method may be further executed:
according to the time sequence data, determining whether coordinate values of position coordinates corresponding to a series of touch points monotonically increase or monotonically decrease along with the time sequence;
and when the coordinate values of the position coordinates corresponding to a series of touch points are determined to monotonically increase or monotonically decrease along the time sequence, determining that the touch operation is an effective operation.
For example, the time series data may be ordered according to a time sequence, and it is sequentially determined whether the coordinate value of the position coordinate at each time in the time series data is single-point increment or monotonic decrement, and when it is determined that the coordinate value of the position coordinate at each time is single-point increment or monotonic decrement, the touch operation is determined to be an effective operation, otherwise, the touch operation is determined to be an ineffective operation. The invalid operation may be an irregular sliding operation performed by the user on the display screen, or a touch operation generated by the user through a portion other than a finger, such as a palm surface. For example, when the user slides a finger back and forth in the display screen, the coordinate values of the position coordinates of each touch point in the time series data exhibit a cyclic change of increasing first and decreasing second, at which time the touch operation can be determined as an invalid operation.
In an alternative embodiment, it may be determined whether the coordinate values of the position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease with time sequence by:
establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time sequence data into a coordinate point in the two-dimensional coordinate system;
coordinate points in the two-dimensional coordinate system are sequentially connected to obtain a position curve of each coordinate point, and whether the position curve monotonically increases or monotonically decreases along the time direction is determined.
Specifically, each data point may be plotted in a two-dimensional coordinate system based on the time value and the position coordinate in the time-series data, and then each plotted coordinate point may be connected to determine the change in the coordinate values of the abscissa and the ordinate. Taking the abscissa as the moment and the ordinate as the position as an example, along the increasing direction of each coordinate axis, if the value of each coordinate point on the position curve is in increasing or decreasing trend along the direction of the ordinate axis, it can be determined that the position curve is monotonically increasing or monotonically decreasing along the time direction.
By the method, whether coordinate values of position coordinates of each touch point show monotonicity change can be judged, irregular operation in touch operation is identified to be determined as invalid operation, influence of the invalid operation on determining the holding mode of the mobile terminal is avoided, and efficiency and accuracy of determining the holding mode of the mobile terminal are improved.
In step S120, an operation track of the touch operation is fitted according to the touch event information, and an operation type of the touch operation is determined according to the operation track.
In this exemplary embodiment, the operation track may be curve data formed by a connection line between position coordinates of a series of touch points corresponding to the touch operation when the user performs the touch operation; the operation type of the touch operation may include various types according to the operation manner of the touch operation, and may include, for example, a click operation, a slide operation, and the like.
After the touch event information is acquired, an operation track of the touch operation can be fitted according to position coordinates of a series of touch points generated in the duration time of the touch operation in the touch event information, and then the operation type of the touch operation can be determined according to the operation track. For example, in an alternative embodiment, the operation type of the touch operation may be determined by:
determining the operation distance of touch operation according to the operation track;
when the operation distance is larger than a preset threshold value, determining the operation type of the touch operation as sliding operation;
and when the operation distance is not greater than the preset threshold value, determining the operation type of the touch operation as click operation.
The operation distance of the touch operation may be an actual distance that a series of touch points corresponding to the touch operation pass through, or may be a straight line distance between a start point and an end point corresponding to the touch operation.
Further, in the duration of the touch operation, the position coordinates of each touch point corresponding to the touch operation may be sequentially arranged according to a time sequence, and based on this, in an alternative embodiment, the operation track of the touch operation may be obtained by fitting by the following method:
determining the position coordinates of each touch point in a series of touch points corresponding to the touch operation according to the touch event information and the moment corresponding to the position coordinates of each touch point, and generating time sequence data of the series of touch points;
and connecting each touch point in turn according to the time sequence of the position coordinates of each touch point based on the time sequence data so as to fit an operation track.
Specifically, the position coordinates of each touch point and the time of generating the position coordinates may be determined according to the touch event information to generate time series data, for example, the time series data may be expressed as: { t1 (x 1, y 1); t2 (x 2, y 2); t3 (x 3, y 3) … …, where t represents time, x represents the abscissa and y represents the ordinate. After generating the time series data about the position coordinates of each touch point, the position coordinates of each touch point may be sequentially connected according to a time sequence, so as to obtain an operation track of the touch operation.
In an alternative embodiment, when the number of detected touch points is greater, in order to improve the efficiency of fitting the operation track, the time series data may be sampled, for example, from the first data point, one data point may be selected as a sample point every N data points, thereby obtaining sampled time series data. Wherein N is a positive integer less than the number of touch points.
By the method, the operation track of the touch operation can be fitted according to the touch event information, and the operation type of the touch operation is determined according to the operation track, so that influence of some irrelevant operations on judging the holding mode of the user can be eliminated, and the efficiency of determining the holding mode is improved.
In step S130, a grip pattern of a user who grips the mobile terminal for a preset time is determined based on the operation type.
Wherein the grip modes may include a left hand grip mode and a right hand grip mode; the preset time may be a period of time after the user triggers the touch operation, and may be generally set according to actual requirements, for example, may be set to 3 seconds, 5 seconds, and the like after the user triggers the touch operation.
After determining the operation type of the touch operation, a user who holds the mobile terminal for a preset time, that is, a holding mode of the user of the mobile terminal, may be determined according to the operation type. For example, in an alternative embodiment, referring to fig. 2, the grip pattern of the user of the mobile terminal may be determined by the following steps S210 to S220:
In step S210, for the click operation, an operation position of the touch operation is determined according to the operation track, and a holding mode of a user of the mobile terminal is determined according to a distribution area of the operation position in the graphical user interface.
Specifically, for the click operation, an operation position of the touch operation may be determined according to an operation track, and whether a distribution area of the operation position in the graphical user interface is a left area or a right area of the graphical user interface may be determined, so as to determine a holding mode of a user of the mobile terminal as a left hand holding mode corresponding to the left area, or determine a holding mode of the user of the mobile terminal as a right hand holding mode corresponding to the right area.
In practical applications, the division of the left and right side areas of the mobile terminal may vary with the screen display direction of the mobile terminal, for example, as shown in fig. 3, in the landscape screen state, the screen display direction of the mobile terminal may include two directions shown in fig. 3A and 3B, and in the two display directions, the left side area of the mobile terminal may be located at the bottom area and the top area side of the mobile terminal when the mobile terminal is in the portrait screen direction, respectively. Thus, in order to determine the left and right side areas of the graphical user interface, in an alternative embodiment, step S210 may also be implemented by:
Determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size and the screen display direction of the mobile terminal;
in the graphical user interface, determining that the holding mode is a left hand holding mode when the operation position is in a left region of the preset axis;
when the operation position is in the right side area of the preset axis, determining that the holding mode is a right hand holding mode;
the screen display direction comprises a horizontal screen direction and a vertical screen direction; the preset axis may be determined according to a screen size and a screen display direction of the mobile terminal, for example, a center axis of a display screen may be determined as the preset axis. In some cases, the preset axis may also be set as a middle axis of the touch area when the user operates in the left hand and the right hand according to the usage habit of the user, and the middle axis may be different from the central axis of the display screen.
In this exemplary embodiment, the gravity sensor may detect a gravity change of the mobile terminal, convert the gravity change into an electrical signal, determine whether a screen display direction of the mobile terminal is a horizontal screen or a vertical screen according to the electrical signal, determine a preset axis according to a screen size and the screen display direction, further determine a positional relationship between an operation position and the preset axis, determine a holding mode when the operation position is in a left area of the preset axis as a left-hand holding mode, and determine a holding mode when the operation position is in a right area of the preset axis as a right-hand holding mode.
By the method, the holding mode of the user of the mobile terminal when the touch operation is the click operation can be determined.
In step S220, for the sliding operation, a grip pattern of a user of the mobile terminal is determined according to a trajectory profile of the operation trajectory.
When the touch operation is a sliding operation, the distance of the operation track of the touch operation is longer, so that the holding mode of the mobile terminal can be judged according to the track curve of the operation track.
Specifically, in an alternative embodiment, the holding mode of the mobile terminal when the touch operation is a sliding operation may be determined by the following method:
taking a reference line of the track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve;
and calculating the distribution quantity of the plurality of reference points on two sides of the reference line, and determining the area where the side with the largest distribution quantity is located so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
Taking a straight line between a starting point and an ending point of the track curve as a reference line, sampling the track curve at equal intervals according to the reference line, for example, sampling the reference line at equal intervals, determining a plurality of points on the reference line, making a straight line along the direction of each point perpendicular to the reference line, determining the intersection point of the straight line and the track curve to obtain a plurality of reference points, then determining one side corresponding to the largest number of the distribution numbers of the reference points on two sides of the reference line, and determining the holding mode corresponding to the one side as the holding mode of the mobile terminal. For example, referring to fig. 4A, where the reference points are all located to the right of the reference line, it may be determined that the grip mode is a left hand grip mode. For another example, referring to fig. 4B, when the reference points are all located in the left region of the reference line, it may be determined that the grip mode is the right hand grip mode.
In an alternative embodiment, the number threshold may be set so that when the number of the reference points on one side of the reference line is greater than the number threshold, the grip mode corresponding to the side greater than the number threshold is determined as the grip mode of the mobile terminal. In particular, when the number of the reference points on both sides of the reference line is not greater than the number threshold, it is indicated that the number of the reference points is smaller, and the track curve can be sampled at equal intervals again according to the reference line.
Further, since the track curve has the characteristics of position, shape, etc., in an alternative embodiment, referring to fig. 5, the grip pattern of the user of the mobile terminal may also be determined by the following method:
in step S510, a track image of the touch operation is generated according to the operation track, and track features of the track image are extracted.
In the present exemplary embodiment, the track features include track position features and track shape features of the track image. Depending on the size of the graphical user interface, the operation trajectory may be converted into a trajectory image having the same size as the size of the graphical user interface, for example, as shown with reference to fig. 6A and 6B, a trajectory image generated in one left-hand mode and a trajectory image generated in one right-hand mode are shown, respectively. The track features of the track image, such as track position features and track shape features, are extracted by a feature extraction algorithm, for example, the track image may be divided into a plurality of image areas, and the pixel distribution in each image area is analyzed to determine the track position features and track shape features of the track image. The track position feature may be used to represent the position of a point in the track curve in the track image, for example, the position of a key point such as a start point, an inflection point, an end point, etc. in the track curve may be included; the track shape features may be used to represent the shape, distance, etc. of each segment of the operational track.
In step S520, a history track image associated with the user of the mobile terminal is obtained, and track features of the track image are matched with track features of the history track image, so as to obtain a matching degree of the track image and the history track image.
The history trajectory image may be a trajectory image generated by a user performing a sliding operation using one hand over a period of time. Generally, the historical track image may include track images of multiple users operating in one hand, i.e., left and right. The matching degree can be used for representing the similarity of the two track images, and the higher the similarity is, the more similar the track positions and the shapes of the two track images are, and otherwise, the larger the track positions and the shapes of the two track images are different.
For example, the pixel distribution of each image area in the track image may be matched with the pixel distribution of the corresponding image area in the history track image, so as to obtain the matching degree between each image area, and further determine the matching degree between the track image and the history track image.
In step S530, when the matching degree is greater than the matching degree threshold, the grip pattern of the user of the mobile terminal is determined as the grip pattern corresponding to the history track image. The matching degree threshold value can be customized according to requirements, for example, can be set to 0.8, 0.9 and the like.
By performing feature matching on the historical track image and the track image, the matching degree of the track image and the historical track image is determined, so that the holding mode when the matching degree is larger than the matching degree threshold value is determined as the holding mode of the mobile terminal, and the accuracy of determining the holding mode can be improved. In addition, along with the continuous increase of the operation times of users, the historical track images are gradually enriched, and the analysis of various track images can be realized by the method, and accordingly, the sensitivity and the accuracy of detecting the holding mode of the user to the mobile terminal can be improved.
Further, in order to improve the accuracy of determining the grip pattern, when determining the grip pattern of the user who grips the mobile terminal for a preset time, the following method may be further performed:
determining the number of times that the holding mode of a user holding the mobile terminal is continuously the same holding mode;
and when the number of times is larger than the first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
In the preset time, the user can continuously trigger multiple touch operations, and at this time, the mobile terminal can detect the holding mode of the mobile terminal when each touch operation is performed, so that when the number of times that the holding mode of the mobile terminal is detected to be the same holding mode continuously is greater than the first preset number, the same holding mode is determined to be the holding mode of the user of the mobile terminal. The first preset number may be set to 3 times, 5 times, etc., or may be set to other values according to actual requirements.
Further, in an alternative embodiment, the following method may also be performed:
when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acted on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation;
and determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is continuously the same holding mode, so as to determine that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
Wherein the second preset number of times may be a value smaller than the first preset number of times. When the two continuous detected holding modes of the mobile terminal are different, the holding mode of the mobile terminal can be temporarily stopped to be determined, and then the holding mode of the mobile terminal corresponding to the next touch operation is judged. And when the number of times that the holding mode of the mobile terminal corresponding to the next touch operation is continuously the same mode is larger than a second preset threshold value, determining that the same holding mode is the holding mode of a user of the mobile terminal.
By the method, when the holding modes of the mobile terminal detected twice in succession are different, the final holding mode can be determined according to the times that the holding modes corresponding to the touch operation triggered subsequently are the same holding mode, so that the possibility of determining the holding mode according to accidental operation of a user is avoided, and the accuracy of determining the holding mode can be improved.
In addition, after determining the holding mode of the mobile terminal, in order to facilitate the user operation, in an alternative embodiment, after determining the holding mode of the user holding the mobile terminal for a preset time, the display layout of the graphical user interface may be adjusted based on the holding mode.
Specifically, in an alternative embodiment, the display layout of the graphical user interface may be adjusted by:
and if the holding mode is a left hand holding mode, adjusting the display layout of the graphical user interface according to the left hand layout strategy.
The left-hand layout strategy may include any of the following:
(1) And adjusting the display position of the interface element to the left area of the graphical user interface according to the direction of the interface element in the graphical user interface relative to the user of the mobile terminal.
Wherein the interface elements in the graphical user interface may include any one or more of text, images, and operational controls in the graphical user interface, and the operational controls may include hover controls or fixed controls. For example, referring to fig. 7, in the left-hand mode, text and operation controls in the graphical user interface may be adjusted to be displayed in the left region, where the operation controls may include a hover control and a fixed control, and as shown, the hover control is a circular hover icon displayed on the left edge, and the fixed control may include a text operation control that is displayed in a fixed manner such as "about a mobile phone", "software update", "system navigation mode", and the like.
(2) And adjusting the area of the display interface in the graphical user interface to generate a zoom interface of the display interface, and displaying the zoom interface in the left area of the graphical user interface. For example, referring to FIG. 8, a zoom interface 810 having a display scale smaller than that of the graphical user interface may be displayed in the lower left corner region of the graphical user interface.
Correspondingly, in an alternative embodiment, in the right hand holding mode, the display layout of the graphical user interface may be adjusted by:
if the holding mode is a right hand holding mode, adjusting the display layout of the graphical user interface according to a right hand layout strategy;
the right-hand layout strategy comprises any one of the following steps:
(1) And adjusting the display direction of the interface element to the right area of the graphical user interface according to the direction of the interface element in the graphical user interface relative to the user of the mobile terminal.
Wherein the interface elements in the graphical user interface may include any one or more of text, images, and operational controls in the graphical user interface, and the operational controls may include hover controls or fixed controls. For example, referring to fig. 9, in the right-hand mode, characters and operation controls in the graphical user interface may be adjusted to be displayed in a right area, and correspondingly, the operation controls may include a hover control and a fixed control, where the hover control is a circular hover icon displayed on the right edge, and the fixed control may include a text operation control that is displayed in a fixed manner such as "about a mobile phone", "software update", "system navigation mode", and the like.
(2) And adjusting the area of the display interface in the graphical user interface to generate a zoom interface of the display interface, and displaying the zoom interface in the right area of the graphical user interface. For example, referring to FIG. 10, a zoom interface 1010 having a display scale smaller than that of the graphical user interface may be displayed in the lower right corner region of the graphical user interface.
By the method, the display content in the graphical user interface can be adjusted to be suitable for the display layout operated by a single hand of a user, for example, the display direction of interface elements in the graphical user can be dynamically adjusted, for example, the display direction of suspension controls displayed on the left side and the right side of the mobile terminal can be automatically adjusted, great convenience is provided for the user to operate the mobile terminal by a single hand, and normal operation of the user is not influenced.
Fig. 11 shows a flowchart of determining a holding mode in the present exemplary embodiment, and as shown, may include the following steps:
in step S1110, in response to a touch operation on the gui, touch event information of the touch operation is obtained.
The touch event information may include a duration of the touch operation and position coordinates in the graphical user interface corresponding to a series of touch points generated by the touch operation within the duration.
In step S1120, an operation distance of the touch operation is determined according to the touch event information.
Specifically, the operation distance of the touch operation may be determined according to the distance that a series of touch points pass through in the touch event information, or may be determined according to the linear distance between the corresponding touch points at the start point and the end point in the touch event information.
In step S1130, it is determined whether the operation distance of the touch operation is greater than a preset threshold. When the operation distance of the touch operation is greater than the preset threshold, step S1140 is executed; when the operation distance of the touch operation is not greater than the preset threshold, step S1140 is executed, otherwise step S1150 is executed.
When the operation distance of the touch operation is greater than the preset threshold, the operation track of the touch operation is longer, and the operation type of the touch operation can be determined to be a sliding operation, and step S1140 is executed; when the operation distance of the touch operation is not greater than the preset threshold, the operation track of the touch operation is short, and it may be determined that the operation type of the touch operation is a click operation, and step S1150 is performed.
In step S1140, an operation track of the touch operation is fitted according to the touch event information, and the operation track is subjected to feature analysis.
Specifically, the curve characteristics of the operation track may be analyzed, for example, the track curve may be sampled at equal intervals with reference to a reference line between the start point and the end point of the track curve, so as to obtain a plurality of reference points, and further, the number of the plurality of reference points on both sides of the reference line may be determined. Alternatively, the position features and shape features of the trajectory image of the operation trajectory may be analyzed.
In step S1150, an operation position of the touch operation is determined.
When the touch operation is a click operation, the operation position of the touch operation may be determined according to the operation track, for example, the operation position may be determined according to an intermediate point between a start point and an end point of the operation track, or a cluster analysis may be performed on points in the operation track, and a position of a point corresponding to the cluster center may be determined as the operation position.
In step S1160, the preset axis is determined according to the screen display direction and the screen size. The display screen of the mobile terminal is divided into a left area and a right area by a preset axis.
In step S1170, the display area where the operation position of the touch operation is located is determined. That is, it is determined on which side of the left and right side areas of the display screen the operation position is located.
In step S1180, a grip pattern of the user of the mobile terminal is determined. That is, it is determined whether the grip mode of the user of the mobile terminal is the left hand grip mode or the right hand grip mode. Specifically, for the sliding operation, the grip pattern corresponding to the side with the larger number of reference points may be determined as the grip pattern of the user of the mobile terminal, or the matching degree of the track image of the operation track and the history track image may be calculated, and the grip pattern corresponding to the history track image with the matching degree larger than the matching degree threshold may be determined as the grip pattern of the user of the mobile terminal.
Corresponding to the click operation, the holding mode of the user of the mobile terminal device may be determined as a left hand holding mode or a right hand holding mode directly according to whether the operation position is located in the left side area or the right side area of the display screen.
In step S1190, the display layout of the graphical user interface is adjusted based on the grip pattern.
The display layout of the graphical user interface can be automatically adjusted according to the grip pattern of the user of the terminal device so that the user of the terminal device can operate with one hand.
In summary, according to the method for detecting a holding mode of a mobile terminal in the embodiment of the present disclosure, touch event information of a touch operation may be obtained in response to the touch operation applied to a graphical user interface, an operation track of the touch operation may be fitted according to the touch event information, an operation type of the touch operation may be determined, and whether the holding mode of a user holding the mobile terminal in a preset time is a left-hand holding mode or a right-hand holding mode may be determined based on the operation type. On the one hand, through the method, the touch event information can be analyzed to determine the holding mode of the user of the mobile terminal, the distance between the hand of the user and the edge of the mobile terminal is not required to be detected through a capacitive sensor and the like, the convenience of determining the holding mode of the user is improved, the occupation of the excessive sensors on the volume and the like of the mobile terminal is reduced, and the production and manufacturing cost is reduced; on the other hand, by determining the operation type of the touch operation and determining the holding mode of the user of the mobile terminal based on the operation type, the influence of the irrelevant operation on the judgment of the holding mode of the user can be eliminated according to the operation type of the touch operation, and the accuracy and the efficiency of determining the holding mode of the user are improved.
Exemplary apparatus
The exemplary embodiment of the disclosure also provides a holding mode detection device of the mobile terminal. Referring to fig. 12, the grip pattern detection apparatus 1200 of the mobile terminal may include:
the acquiring module 1210 may be configured to respond to a touch operation applied to the gui, and acquire touch event information of the touch operation, where the touch event information includes a duration of the touch operation and position coordinates of a series of touch points in the gui generated during the duration corresponding to the touch operation;
the fitting module 1220 may be configured to fit an operation track of the touch operation according to the touch event information, and determine an operation type of the touch operation according to the operation track;
the determining module 1230 may be used for determining a grip pattern of a user who grips the mobile terminal for a preset time based on the operation type, the grip pattern including a left hand grip pattern and a right hand grip pattern.
In an alternative embodiment, the fitting module 1220 is configured to:
determining the position coordinates of each touch point in a series of touch points corresponding to the touch operation and the time corresponding to the position coordinates of each touch point according to the touch event information, and generating time sequence data of the series of touch points;
And connecting each touch point in turn according to the time sequence of the position coordinates of each touch point based on the time sequence data so as to fit an operation track.
In an alternative embodiment, the operation type includes a click operation and/or a slide operation, and the determining module is configured to:
for click operation, determining an operation position of touch operation according to an operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in a graphical user interface;
for a sliding operation, a grip pattern of a user of the mobile terminal is determined according to a trajectory profile of the operation trajectory.
In an alternative embodiment, determination module 1230 is configured to:
determining the operation distance of touch operation according to the operation track;
when the operation distance is larger than a preset threshold value, determining the operation type of the touch operation as sliding operation; and
and when the operation distance is not greater than the preset threshold value, determining the operation type of the touch operation as click operation.
In an alternative embodiment, determination module 1230 is configured to:
determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size and the screen display direction of the mobile terminal, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction;
In the graphical user interface, determining that the holding mode is a left hand holding mode when the operation position is in a left region of the preset axis;
when the operation position is in the right side area of the preset axis, the holding mode is determined to be a right hand holding mode.
In an alternative embodiment, determination module 1230 is configured to:
taking a reference line of the track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve;
and calculating the distribution quantity of the plurality of reference points on two sides of the reference line, and determining the area where the side with the largest distribution quantity is located so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
In an alternative embodiment, determination module 1230 is configured to:
generating a track image of touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image;
acquiring a historical track image associated with a user of the mobile terminal, and matching track characteristics of the track image with track characteristics of the historical track image to obtain matching degree of the track image and the historical track image;
And when the matching degree is larger than the matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
In an alternative embodiment, upon determining a grip pattern of a user holding the mobile terminal for a preset time, the determining module 1230 is configured to:
determining the number of times that the holding mode of a user holding the mobile terminal is continuously the same holding mode;
and when the number of times is larger than the first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
In an alternative embodiment, after determining the grip pattern of the user holding the mobile terminal for a preset time, the determining module 1230 is configured to:
when the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acted on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation;
and determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is continuously the same holding mode, so as to determine that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
In an alternative embodiment, after acquiring the touch event information of the touch operation, the fitting module 1220 is configured to:
according to the time sequence data, determining whether coordinate values of position coordinates corresponding to a series of touch points monotonically increase or monotonically decrease along with the time sequence;
and when the coordinate values of the position coordinates corresponding to a series of touch points are determined to monotonically increase or monotonically decrease along the time sequence, determining that the touch operation is an effective operation.
In an alternative embodiment, the fitting module 1220 is further configured to:
establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time sequence data into a coordinate point in the two-dimensional coordinate system;
coordinate points in the two-dimensional coordinate system are sequentially connected to obtain a position curve of each coordinate point, and whether the position curve monotonically increases or monotonically decreases along the time direction is determined.
In an alternative embodiment, after determining the grip pattern of the user holding the mobile terminal for a preset time, the determining module 1230 is further configured to:
the display layout of the graphical user interface is adjusted based on the grip pattern.
In an alternative embodiment, determination module 1230 is configured to:
If the holding mode is a left hand holding mode, adjusting the display layout of the graphical user interface according to a left hand layout strategy;
the left-hand layout strategy comprises any one of the following steps:
according to the direction of the interface element in the graphical user interface relative to the user of the mobile terminal, adjusting the display position of the interface element to the left side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
and adjusting the area of the display interface in the graphical user interface to generate a zoom interface of the display interface, and displaying the zoom interface in the left area of the graphical user interface.
In an alternative embodiment, determination module 1230 is configured to:
if the holding mode is a right hand holding mode, adjusting the display layout of the graphical user interface according to a right hand layout strategy;
the right-hand layout strategy comprises any one of the following steps:
according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display direction of the interface element to the right side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
And adjusting the area of the display interface in the graphical user interface to generate a zoom interface of the display interface, and displaying the zoom interface in the right area of the graphical user interface.
In an alternative embodiment, a transparent floating layer is disposed in the graphical user interface, where the transparent floating layer includes a touch operation detector, and when acquiring touch event information of a touch operation, the acquiring module 1210 is configured to:
and acquiring touch event information of the touch operation through a touch operation detector.
In addition, other specific details of the embodiments of the present disclosure are described in the foregoing embodiments of the method, and are not described herein.
Exemplary storage Medium
A storage medium according to an exemplary embodiment of the present disclosure is described below.
In the present exemplary embodiment, the above-described method may be implemented by a program product, such as a portable compact disc read only memory (CD-ROM) and including program code, and may be run on a device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RE, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).
Exemplary electronic device
An electronic device of an exemplary embodiment of the present disclosure is described with reference to fig. 13. The electronic device may be the mobile terminal described above.
The electronic device 1300 shown in fig. 13 is merely an example and should not be construed to limit the functionality and scope of use of embodiments of the present disclosure in any way.
As shown in fig. 13, the electronic device 1300 is embodied in the form of a general purpose computing device. The components of the electronic device 1300 may include, but are not limited to: at least one processing unit 1310, at least one memory unit 1320, a bus 1330 connecting the different system components (including memory unit 1320 and processing unit 1310), a display unit 1340.
Wherein the storage unit stores program code that is executable by the processing unit 1310 such that the processing unit 1310 performs steps according to various exemplary embodiments of the present disclosure described in the above section of the "exemplary method" of the present specification. For example, the processing unit 1310 may perform the method steps as shown in fig. 1, 2, 5, and 11, etc.
The storage unit 1320 may include volatile storage units such as a Random Access Memory (RAM) 1321 and/or a cache memory 1322, and may further include a Read Only Memory (ROM) 1323.
The storage unit 1320 may also include a program/utility 1324 having a set (at least one) of program modules 1325, such program modules 1325 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
Bus 1330 may include a data bus, an address bus, and a control bus.
The electronic device 1300 may also communicate with one or more external devices 1400 (e.g., keyboard, pointing device, bluetooth device, etc.), which can be via an input/output (I/O) interface 1350. The electronic device 1300 also includes a display unit 1340 that is connected to an input/output (I/O) interface 1350 for display. Also, mobile terminal 1300 can communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, for example, the Internet, through a network adapter 1360. As shown, the network adapter 1360 communicates with other modules of the electronic device 1300 over the bus 1330. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 1300, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
It should be noted that while several modules or sub-modules of the apparatus are mentioned in the detailed description above, such partitioning is merely exemplary and not mandatory. Indeed, the features and functionality of two or more units/modules described above may be embodied in one unit/module in accordance with embodiments of the present disclosure. Conversely, the features and functions of one unit/module described above may be further divided into ones that are embodied by a plurality of units/modules.
Furthermore, although the operations of the methods of the present disclosure are depicted in the drawings in a particular order, this is not required to or suggested that these operations must be performed in this particular order or that all of the illustrated operations must be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform.
While the spirit and principles of the present disclosure have been described with reference to several particular embodiments, it is to be understood that this disclosure is not limited to the particular embodiments disclosed nor does it imply that features in these aspects are not to be combined to benefit from this division, which is done for convenience of description only. The disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (30)

1. A grip pattern detection method of a mobile terminal displaying a graphical user interface, the method comprising:
responding to touch operation acted on the graphical user interface, and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points generated in the duration time corresponding to the touch operation in the graphical user interface;
Fitting an operation track of the touch operation according to the touch event information, and determining an operation type of the touch operation according to the operation track; the operation type includes a sliding operation;
determining a holding mode of a user holding the mobile terminal in a preset time based on the operation type, wherein the holding mode comprises a left hand holding mode and a right hand holding mode;
for the sliding operation, the determining a holding mode of a user holding the mobile terminal for a preset time based on the operation type includes:
taking a reference line of a track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve;
and calculating the distribution quantity of the plurality of reference points on two sides of the reference line, and determining the area where the side with the largest distribution quantity is located, so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
2. The method according to claim 1, wherein the fitting the operation track of the touch operation according to the touch event information includes:
Determining the position coordinates of each touch point in a series of touch points corresponding to the touch operation and the time corresponding to the position coordinates of each touch point according to the touch event information, and generating time sequence data of the series of touch points;
and connecting each touch point in turn according to the time sequence of the position coordinates of each touch point based on the time sequence data so as to fit the operation track.
3. The method of claim 1, wherein the operation type comprises a click operation, and wherein the determining a grip pattern of a user who grips the mobile terminal for a preset time based on the operation type comprises:
and for the clicking operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface.
4. A method according to claim 3, wherein said determining an operation type of the touch operation according to the operation trajectory comprises:
determining the operation distance of the touch operation according to the operation track;
When the operation distance is larger than a preset threshold value, determining the operation type of the touch operation as the sliding operation; and
and when the operation distance is not greater than the preset threshold value, determining the operation type of the touch operation as the click operation.
5. A method according to claim 3, wherein said determining a grip pattern of a user of said mobile terminal according to a distribution area of said operation positions in said graphical user interface comprises:
determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size of the mobile terminal and the screen display direction, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction;
determining, in the graphical user interface, that the grip mode is a left hand grip mode when the operational position is in a left region of a preset axis;
and determining that the holding mode is a right hand holding mode when the operation position is in a right side area of the preset axis.
6. A method according to claim 3, wherein said determining a grip pattern of a user of the mobile terminal for the sliding operation from a trajectory profile of the operation trajectory comprises:
Generating a track image of the touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image;
acquiring a historical track image associated with a user of the mobile terminal, and matching track characteristics of the track image with track characteristics of the historical track image to obtain matching degree of the track image and the historical track image;
and when the matching degree is larger than a matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
7. The method of claim 1, wherein upon determining a grip pattern of a user holding the mobile terminal for the preset time, the method further comprises:
determining the number of times that the holding mode of a user holding the mobile terminal is continuously the same holding mode;
and when the times are larger than a first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
8. The method of claim 7, wherein after determining the grip pattern of the user holding the mobile terminal for the preset time, the method further comprises:
When the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acted on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation;
and determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is the same holding mode continuously, so as to determine that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
9. The method of claim 2, wherein after acquiring the touch event information of the touch operation, the method further comprises:
according to the time sequence data, determining whether coordinate values of position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease along with the time sequence;
and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to monotonically increase or monotonically decrease along the time sequence, determining the touch operation as an effective operation.
10. The method according to claim 9, wherein determining whether the coordinate values of the position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease with time sequence according to the time sequence data comprises:
Establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time series data into a coordinate point in the two-dimensional coordinate system;
and sequentially connecting coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve monotonically increases or monotonically decreases along the time direction.
11. The method of claim 1, wherein after determining the grip pattern of the user holding the mobile terminal for the preset time, the method further comprises:
and adjusting a display layout of the graphical user interface based on the grip pattern.
12. The method of claim 11, wherein the adjusting the display layout of the graphical user interface based on the grip pattern comprises:
if the holding mode is a left hand holding mode, adjusting the display layout of the graphical user interface according to a left hand layout strategy;
wherein the left-hand layout strategy comprises any one of the following:
according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display position of the interface element to the left side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
And adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in the left area of the graphical user interface.
13. The method of claim 11, wherein the adjusting the display layout of the graphical user interface based on the grip pattern comprises:
if the holding mode is a right hand holding mode, adjusting the display layout of the graphical user interface according to a right hand layout strategy;
wherein the right-hand layout strategy comprises any one of the following:
according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display direction of the interface element to a right side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
and adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in a right area of the graphical user interface.
14. The method according to claim 1, wherein a transparent floating layer is provided in the graphical user interface, the transparent floating layer including a touch operation detector, and when acquiring touch event information of the touch operation, the method includes:
And acquiring touch event information of the touch operation through the touch operation detector.
15. A grip pattern detection apparatus of a mobile terminal displaying a graphical user interface, the apparatus comprising:
the acquisition module is used for responding to the touch operation acted on the graphical user interface and acquiring touch event information of the touch operation, wherein the touch event information comprises duration time of the touch operation and position coordinates of a series of touch points in the graphical user interface, which are generated in the duration time corresponding to the touch operation;
the fitting module is used for fitting out an operation track of the touch operation according to the touch event information and determining the operation type of the touch operation according to the operation track; the operation type includes a sliding operation;
the determining module is used for determining a holding mode of a user holding the mobile terminal in a preset time based on the operation type, wherein the holding mode comprises a left hand holding mode and a right hand holding mode;
for the sliding operation, the determining a holding mode of a user holding the mobile terminal for a preset time based on the operation type includes:
Taking a reference line of a track curve as a reference, and sampling the track curve at equal intervals to obtain a plurality of reference points, wherein the reference line is a straight line between a starting point and an end point of the track curve;
and calculating the distribution quantity of the plurality of reference points on two sides of the reference line, and determining the area where the side with the largest distribution quantity is located, so as to determine the holding mode corresponding to the area as the holding mode of the user of the mobile terminal.
16. The apparatus of claim 15, wherein the fitting module is configured to:
determining the position coordinates of each touch point in a series of touch points corresponding to the touch operation and the time corresponding to the position coordinates of each touch point according to the touch event information, and generating time sequence data of the series of touch points;
and connecting each touch point in turn according to the time sequence of the position coordinates of each touch point based on the time sequence data so as to fit the operation track.
17. The apparatus of claim 15, wherein the type of operation comprises a click operation, the determination module configured to:
and for the clicking operation, determining an operation position of the touch operation according to the operation track, and determining a holding mode of a user of the mobile terminal according to a distribution area of the operation position in the graphical user interface.
18. The apparatus of claim 17, wherein the determination module is configured to:
determining the operation distance of the touch operation according to the operation track;
when the operation distance is larger than a preset threshold value, determining the operation type of the touch operation as the sliding operation; and
and when the operation distance is not greater than the preset threshold value, determining the operation type of the touch operation as the click operation.
19. The apparatus of claim 18, wherein the determination module is configured to:
determining a screen display direction of the mobile terminal through a gravity sensor configured in the mobile terminal, and determining a preset axis according to the screen size of the mobile terminal and the screen display direction, wherein the screen display direction comprises a horizontal screen direction and a vertical screen direction;
determining, in the graphical user interface, that the grip mode is a left hand grip mode when the operational position is in a left region of a preset axis;
and determining that the holding mode is a right hand holding mode when the operation position is in a right side area of the preset axis.
20. The apparatus of claim 17, wherein the determination module is configured to:
Generating a track image of the touch operation according to the operation track, and extracting track characteristics of the track image, wherein the track characteristics comprise track position characteristics and track shape characteristics of the track image;
acquiring a historical track image associated with a user of the mobile terminal, and matching track characteristics of the track image with track characteristics of the historical track image to obtain matching degree of the track image and the historical track image;
and when the matching degree is larger than a matching degree threshold value, determining the holding mode of the user of the mobile terminal as the holding mode corresponding to the historical track image.
21. The apparatus of claim 15, wherein upon determining a grip pattern of a user holding the mobile terminal for the preset time, the determining module is configured to:
determining the number of times that the holding mode of a user holding the mobile terminal is continuously the same holding mode;
and when the times are larger than a first preset number, determining that the same holding mode is the holding mode of the user of the mobile terminal.
22. The apparatus of claim 21, wherein after determining the grip pattern of the user holding the mobile terminal for the preset time, the determining module is configured to:
When the holding mode of the user of the mobile terminal is different from the holding mode determined last time, receiving the next touch operation acted on the graphical user interface, and determining the holding mode of the user of the mobile terminal triggering the next touch operation;
and determining the number of times that the holding mode of the user of the mobile terminal triggering the next touch operation is the same holding mode continuously, so as to determine that the same holding mode is the holding mode of the user of the mobile terminal when the number of times is larger than a second preset number.
23. The apparatus of claim 16, wherein after acquiring the touch event information of the touch operation, the fitting module is configured to:
according to the time sequence data, determining whether coordinate values of position coordinates corresponding to the series of touch points monotonically increase or monotonically decrease along with the time sequence;
and when the coordinate values of the position coordinates corresponding to the series of touch points are determined to monotonically increase or monotonically decrease along the time sequence, determining the touch operation as an effective operation.
24. The apparatus of claim 23, wherein the fitting module is further configured to:
Establishing a two-dimensional coordinate system of time and position, and drawing each data point in the time series data into a coordinate point in the two-dimensional coordinate system;
and sequentially connecting coordinate points in the two-dimensional coordinate system to obtain a position curve of each coordinate point, and determining whether the position curve monotonically increases or monotonically decreases along the time direction.
25. The apparatus of claim 15, wherein after determining the grip pattern of the user holding the mobile terminal for the preset time, the determining module is further configured to:
and adjusting a display layout of the graphical user interface based on the grip pattern.
26. The apparatus of claim 25, wherein the determination module is configured to:
if the holding mode is a left hand holding mode, adjusting the display layout of the graphical user interface according to a left hand layout strategy;
wherein the left-hand layout strategy comprises any one of the following:
according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display position of the interface element to the left side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
And adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in the left area of the graphical user interface.
27. The apparatus of claim 25, wherein the determination module is configured to:
if the holding mode is a right hand holding mode, adjusting the display layout of the graphical user interface according to a right hand layout strategy;
wherein the right-hand layout strategy comprises any one of the following:
according to the direction of an interface element in the graphical user interface relative to a user of the mobile terminal, adjusting the display direction of the interface element to a right side area of the graphical user interface, wherein the interface element comprises any one or more of a text, an image and an operation control, and the operation control comprises a suspension control and/or a fixed control;
and adjusting the area of a display interface in the graphical user interface to generate a scaling interface of the display interface, and displaying the scaling interface in a right area of the graphical user interface.
28. The apparatus of claim 15, wherein a transparent floating layer is disposed in the graphical user interface, the transparent floating layer including a touch operation detector, and when acquiring touch event information of the touch operation, the acquisition module is configured to:
And acquiring touch event information of the touch operation through the touch operation detector.
29. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the method of any of claims 1-14.
30. A mobile terminal, comprising:
a processor;
a display screen for displaying a graphical user interface; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1-14 via execution of the executable instructions.
CN202110489502.5A 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal Active CN113204305B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110489502.5A CN113204305B (en) 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110489502.5A CN113204305B (en) 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal

Publications (2)

Publication Number Publication Date
CN113204305A CN113204305A (en) 2021-08-03
CN113204305B true CN113204305B (en) 2023-06-09

Family

ID=77028496

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110489502.5A Active CN113204305B (en) 2021-04-30 2021-04-30 Method and device for detecting holding mode of mobile terminal, medium and mobile terminal

Country Status (1)

Country Link
CN (1) CN113204305B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114936002B (en) * 2022-06-10 2024-06-14 斑马网络技术有限公司 Interface display method and device and vehicle

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103870199A (en) * 2014-03-31 2014-06-18 华为技术有限公司 Method for recognizing user operation mode on handheld device and handheld device
CN104571882A (en) * 2013-10-25 2015-04-29 中兴通讯股份有限公司 User operating mode judging method and device based on terminal and terminal
CN104598123A (en) * 2014-12-22 2015-05-06 深圳市万普拉斯科技有限公司 Method and device for displaying screen display picture of mobile terminal
CN105260121A (en) * 2015-10-23 2016-01-20 东莞酷派软件技术有限公司 Terminal control method, terminal control device and terminal
CN106371758A (en) * 2016-09-22 2017-02-01 维沃移动通信有限公司 Mobile terminal holding mode detection method and mobile terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106814958A (en) * 2015-12-01 2017-06-09 小米科技有限责任公司 The touch control method and device of function key

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104571882A (en) * 2013-10-25 2015-04-29 中兴通讯股份有限公司 User operating mode judging method and device based on terminal and terminal
CN103870199A (en) * 2014-03-31 2014-06-18 华为技术有限公司 Method for recognizing user operation mode on handheld device and handheld device
CN104598123A (en) * 2014-12-22 2015-05-06 深圳市万普拉斯科技有限公司 Method and device for displaying screen display picture of mobile terminal
CN105260121A (en) * 2015-10-23 2016-01-20 东莞酷派软件技术有限公司 Terminal control method, terminal control device and terminal
CN106371758A (en) * 2016-09-22 2017-02-01 维沃移动通信有限公司 Mobile terminal holding mode detection method and mobile terminal

Also Published As

Publication number Publication date
CN113204305A (en) 2021-08-03

Similar Documents

Publication Publication Date Title
EP2359224B1 (en) Generating gestures tailored to a hand resting on a surface
US9354804B2 (en) Touch event anticipation in a computing device
KR101502659B1 (en) Gesture recognition method and touch system incorporating the same
EP2359212B1 (en) Interface adaptation system
CN103544143B (en) Method and apparatus for recommending text
EP2821906B1 (en) Method for processing touch operation and mobile terminal
US8432301B2 (en) Gesture-enabled keyboard and associated apparatus and computer-readable storage medium
US20120194431A1 (en) Zero-click activation of an application
US20150077362A1 (en) Terminal with fingerprint reader and method for processing user input through fingerprint reader
WO2012019350A1 (en) Finger identification on a touchscreen
US20150026586A1 (en) Translation of touch input into local input based on a translation profile for an application
US20140160054A1 (en) Anchor-drag touch symbol recognition
US9280284B2 (en) Method, apparatus and computer readable medium for polygon gesture detection and interaction
CN108228040A (en) Mobile terminal and floating barrier method of controlling operation thereof, device
US9025878B2 (en) Electronic apparatus and handwritten document processing method
CN105278771A (en) Non-blocking touch handheld electronic device, method and graphical user interface
US9182908B2 (en) Method and electronic device for processing handwritten object
US20130321303A1 (en) Touch detection
CN107368205B (en) Handwriting input method and mobile terminal
KR20150027885A (en) Operating Method for Electronic Handwriting and Electronic Device supporting the same
CN113204305B (en) Method and device for detecting holding mode of mobile terminal, medium and mobile terminal
US20140348334A1 (en) Portable terminal and method for detecting earphone connection
US9235338B1 (en) Pan and zoom gesture detection in a multiple touch display
CN106886351B (en) Display method and device of terminal time information and computer equipment
CN107132927A (en) Input recognition methods and device and the device for identified input character of character

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant