CN105718069B - Information processing method and electronic equipment - Google Patents
Information processing method and electronic equipment Download PDFInfo
- Publication number
- CN105718069B CN105718069B CN201410725300.6A CN201410725300A CN105718069B CN 105718069 B CN105718069 B CN 105718069B CN 201410725300 A CN201410725300 A CN 201410725300A CN 105718069 B CN105718069 B CN 105718069B
- Authority
- CN
- China
- Prior art keywords
- point
- distance
- requirement
- threshold
- operating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention discloses information processing methods and electronic equipment, wherein the electronic equipment supports and displays a virtual input area, the virtual input area supports and displays keys, the method comprises the steps of receiving th operation implemented by an operation body in the virtual input area, analyzing the th operation to obtain operation characteristic information of the operation body, judging whether the th operation meets operation requirements or not based on the operation characteristic information of the operation body, and sending prompt information based on an analysis result when the th operation is represented by the obtained analysis result and does not meet the operation requirements, wherein the prompt information is used for indicating the operation body to adjust the th operation so that the adjusted th operation meets the operation requirements.
Description
Technical Field
The present invention relates to information processing technologies, and in particular, to information processing methods and electronic devices.
Background
Electronic devices such as smart phones and tablet computers provided with touch screen display units are increasingly used in , in practical applications, users often need to use the electronic devices to perform fast input, but when the touch screen display units in the electronic devices display virtual keys, because the users cannot use the virtual keys to perform positioning correction, input efficiency and accuracy are affected, and related technologies have no effective solutions for how to achieve fast and accurate input of the virtual keys.
Disclosure of Invention
The embodiment of the invention provides information processing methods and electronic equipment, which can improve the accuracy and the input efficiency of inputting by using virtual keys and improve the user experience.
The technical scheme of the embodiment of the invention is realized as follows:
the embodiment of the invention provides information processing methods, which are applied to electronic equipment, wherein virtual input areas are supported and displayed by the electronic equipment, and keys are supported and displayed by the virtual input areas, and the method comprises the following steps:
receiving an th operation by an operator in the virtual input area;
analyzing the th operation to obtain the operation characteristic information of the operation body;
judging whether the th operation meets an operation requirement based on the operation characteristic information of the operation body;
when the obtained analysis result indicates that the th operation does not meet the operation requirement, sending out prompt information based on the analysis result, wherein,
the prompt information is used for instructing the operation body to adjust the th operation so that the adjusted th operation meets the operation requirement.
Preferably, before determining whether the th operation satisfies the operation requirement, the method further comprises:
detecting the number of operation points corresponding to the th operation sensed at the virtual input area and detecting the duration of time the operation points are sensed;
when the number of the operation points of the th operation is larger than a th threshold value and the duration of sensing the operation points is larger than a second threshold value, switching to a detection state to judge whether the th operation meets the operation requirement.
Preferably, the determining whether the th operation meets the operation requirement based on the operation characteristic information of the operation body includes:
comparing the position of the operation point corresponding to the th operation sensed in the virtual input area with the position of a reference operation point;
when the operating point of the th operation deviates from the reference operating point by a distance less than a third threshold, it is determined that the th operation satisfies the operating requirement, otherwise, it is determined that the th operation does not satisfy the operating requirement.
Preferably, before determining that the th operation satisfies the operational requirement, the method further comprises:
determining a operation reference line based on at least the th operation point and the position of the second operation point;
comparing the minimum included angle between the th operation reference line and a preset operation reference line with a fourth threshold;
and when the obtained comparison result indicates that the minimum included angle is larger than the fourth threshold value, determining that the th operation meets the operation requirement.
Preferably, sending out prompt information based on the analysis result includes:
sending out the prompt information based on the distance of the position of the th operation point deviating from the position of the reference operation point and the minimum included angle between the th operation reference line and a preset operation reference line,
the prompt information is used for indicating the operation body to adjust the corresponding operation point to move the offset distance to the reference operation point and indicating the operation body to adjust the angle relative to the reference operation line so that the minimum included angle is smaller than the fourth threshold value.
Preferably, before determining that the th operation satisfies the operational requirement, the method further comprises:
determining a second operation reference line based on at least the positions of a third operation point and a fourth operation point of the operation points;
comparing the th distance with a fifth threshold, the th distance being a distance of a fifth one of the operating points from the second operating reference line;
determining that the operation meets the operational requirement when the determined comparison result indicates that the distance is less than the fifth threshold.
Preferably, sending out prompt information based on the analysis result includes:
issuing the prompt information based on the distance of the operating point of the th operation from the reference operating point and the th distance, wherein,
the prompt information is used to instruct the operating body to adjust the operating point corresponding to the operating body to move to the reference operating point by the offset distance, and instruct the operating body to adjust the position of the fifth operating point so that the -th distance is smaller than the third threshold.
Preferably, the sending out the prompt message includes sending out at least of the following types of prompt messages:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
The embodiment of the present invention further provides types of information processing electronic devices, where the electronic devices include:
a display unit used for displaying virtual input areas, wherein the virtual input areas support the display of keys;
a receiving unit configured to receive an th operation performed by an operation body in the virtual input area;
the analysis unit is used for analyzing the th operation to obtain the operation characteristic information of the operation body;
a judging unit configured to judge whether the th operation satisfies an operation requirement based on operation characteristic information of the operation body;
and the prompting unit is used for sending prompting information based on the analysis result when the obtained analysis result represents that the th operation does not meet the operation requirement, wherein the prompting information is used for indicating the operation body to adjust the th operation so that the adjusted th operation meets the operation requirement.
Preferably, the electronic device further includes:
a detection unit for detecting the number of operation points corresponding to the th operation sensed in the virtual input area and detecting a duration of time during which the operation points are sensed;
when the number of the operation points of the th operation is larger than a th threshold value and the duration of sensing the operation points is larger than a second threshold value, switching to a detection state to trigger the judging unit to judge whether the th operation meets the operation requirement.
Preferably, the judging unit includes:
an comparison module for comparing the sensed position of the operation point corresponding to the th operation in the virtual input area with a position of a reference operation point;
and the judging module is used for judging that the operation meets the operation requirement when the distance of the operating point of the operation deviating from the reference operating point is less than a third threshold, and otherwise, judging that the operation does not meet the operation requirement.
Preferably, the judging unit further includes:
an determination module for determining a operation reference line based on at least the positions of and second of the operation points;
the judging module is further configured to compare the minimum included angle between the th operation reference line and a preset operation reference line with a fourth threshold, determine that the obtained comparison result represents that the minimum included angle is larger than the fourth threshold, and determine that the th operation meets the operation requirement when the distance from the operation point of the th operation to the reference operation point is smaller than a third threshold, otherwise, determine that the th operation does not meet the operation requirement.
Preferably, the prompting unit is further configured to send the prompting information based on a distance between the position of the operation point operated at the th operation and the position of the reference operation point and a minimum included angle between the th operation reference line and a preset operation reference line,
the prompt information is used for indicating that the operation point corresponding to the operation body moves the offset distance to the reference operation point, and indicating that the operation body adjusts the angle relative to the reference operation line, so that the minimum included angle is smaller than the fourth threshold value.
Preferably, the judging unit further includes:
the second determining module is used for determining a second operation datum line at least based on the positions of a third operation point and a fourth operation point in the operation points;
the judging module is further configured to compare the th distance with a fifth threshold, where the th distance is a distance from a fifth operation point of the operation points to the second operation reference line, determine that the th operation meets the operation requirement when the obtained comparison result indicates that the th distance is smaller than the fifth threshold, and otherwise determine that the th operation does not meet the operation requirement.
Preferably, the prompting unit is further configured to issue the prompting information based on a distance that the operating point of the th operation deviates from the reference operating point and the th distance, wherein,
the prompt information is used to instruct the operating body to adjust the operating point corresponding to the operating body to move to the reference operating point by the offset distance, and instruct the operating body to adjust the position of the fifth operating point so that the -th distance is smaller than the third threshold.
Preferably, the prompting unit is further configured to issue at least of the following types of prompting messages:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
In the embodiment of the invention, whether the operation meets the operation requirement is judged by analyzing the operation characteristic information of th operation of a user, and prompt is carried out when the operation requirement is not met without needing to directly pay attention to the position of a finger keystroke, and when the operation th operation does not meet the operation requirement, for example, when the distance between the initial position of the finger and the position of a virtual key is too large, or fingers and a plurality of virtual keys are clicked, prompt information is sent to instruct the user to carry out calibration, so that the input efficiency and the accuracy are improved,
drawings
FIG. 1 is a schematic flow chart illustrating an implementation of an information processing method according to an embodiment of the present invention;
FIG. 2a is a schematic diagram of a second implementation flow of the information processing method according to the embodiment of the present invention;
FIG. 2b is a diagram illustrating a user in an input ready state according to an embodiment of the present invention;
FIG. 3a is a schematic view of a third implementation flow of an information processing method according to an embodiment of the present invention;
fig. 3b to fig. 3d are schematic views of a scene for sending a prompt message in the embodiment of the present invention;
FIG. 4a is a schematic diagram of a flow chart of implementing the information processing method in the embodiment of the present invention;
FIG. 4b is a schematic diagram of a scenario in which a prompt message is sent out in the embodiment of the present invention;
FIG. 5a is a schematic diagram of an implementation flow of an information processing method according to an embodiment of the present invention;
FIG. 5b is a schematic diagram of a scenario in which a prompt message is sent out in the embodiment of the present invention;
fig. 6a to 6b are schematic structural diagrams of an electronic device according to an embodiment of the invention.
Detailed Description
The inventor finds that the virtual keyboard displayed on the screen of a tablet personal computer or a touch screen notebook computer is designed into a full key layout, and users use two fingers to input characters on a large-size keyboard efficiently, and compared with a physical keyboard, the virtual keyboard is used for positioning by using a smooth surface of the virtual keyboard difficultly, so that the input accuracy is low, and in order to avoid input errors, the users need to pay attention to the key stroke position of every fingers in the input process, so that the input efficiency is very low;
the inventor also finds that, in the process of implementing the invention, when the electronic device supports and displays virtual input area, and the virtual input area supports and displays keys, as shown in fig. 1, in step 101, the th operation performed by an operation body (corresponding to the finger of the user) is received in the virtual input area, in step 102, the th operation is analyzed to obtain operation characteristic information of the operation body, in step 103, whether the th operation meets the operation requirement is judged based on the operation characteristic information of the operation body, in step 104, when the obtained analysis result indicates that the th operation does not meet the operation requirement, prompt information is sent based on the analysis result to instruct the operation body to adjust the th operation so that the adjusted th operation meets the operation requirement, thus, when the operation of the user is calibrated, the user does not need to pay attention to the position of the finger directly, for example, when the initial position of the finger is too far away from the position of the virtual key, or when fingers and a plurality of virtual keys are hit, the detailed input instruction of the user is sent, and the detailed description of the invention is further combined with the following detailed description of the input efficiency of the present invention.
Example
The information processing method of kinds is described in this embodiment, and is applied to an electronic device, wherein the electronic device supports and displays virtual input area, and the virtual input area supports and displays keys, as shown in fig. 2a, the information processing method described in this embodiment includes the following steps:
in step 201, an operation performed by the operator is received in the virtual input area.
At step 202, the number of sensed operation points corresponding to the th operation in the virtual input area is detected, and the duration of time for which the operation points are sensed is detected.
Here, when the user performs the th operation with a finger, the finger may contact the display unit of the electronic device, and when the finger contacts the display unit of the electronic device, the display unit is triggered to sense the operation point at the contact portion, or the finger may not contact the display unit of the electronic device, and when the distance between the finger and the display unit is within the sensing distance of the display unit because the finger itself is a conductor, the display unit may sense the operation point corresponding to the finger.
In step 203, it is determined whether the th operation satisfies the conditions that the th operation has a number of operating points greater than the th threshold and a duration of the operating point at which the th operation is sensed is greater than a second threshold, and if so, step 204 is performed, otherwise, step 207 is performed.
Step 203 is to judge whether the user touches the virtual keys, if no touch occurs, the pause process between the touched keys is represented, a detection state can be entered, whether the placement position of the finger on the display unit of the electronic device is accurate is detected, and the subsequent step 204 and step 205 are to switch to enter the detection state to judge whether the th operation meets the processing requirement.
And step 204, analyzing the th operation to obtain the operation characteristic information of the operation body.
The operation characteristic information of the operation body comprises the position of the erasing point obtained by sensing the operation body and the duration of sensing the operation point.
And step 206, sending out prompt information based on the analysis result.
Wherein the prompt information is used for instructing the operation body to adjust the th operation so that the adjusted th operation meets the operation requirement.
Step 207 is a process of completing input based on operation , and the generated signal is used to send to an application triggering the invoking of text input, so that the application obtains the information input by the user.
As examples, as shown in fig. 2b, when the user is in the input preparation state, at least fingers of the hand will normally contact the electronic device display unit (corresponding to the th operation), so that the number of the contacts sensed by the electronic device display unit is at least 5 (corresponding to the th threshold), and the contact time exceeds the time interval (corresponding to the second threshold) during which the user continuously performs the th operation to perform the input, and when the number of the operation points of the nd operation satisfies the above condition, it indicates that the input is currently in the pause state, and the user may continue to perform the input based on the current pose of the fingers.
Example two
The information processing method of kinds is described in this embodiment, and is applied to an electronic device, wherein virtual input areas are supported and displayed by the electronic device, and keys are supported and displayed by the virtual input areas, as shown in fig. 3a, the information processing method described in this embodiment includes the following steps:
in step 301, an operation th by the operator is received in the virtual input area.
In step 302, the number of operation points corresponding to the th operation sensed in the virtual input area is detected, and the duration of time for which the operation points are sensed is detected.
Here, when the user performs the th operation with a finger, the finger may contact the display unit of the electronic device, and when the finger contacts the display unit of the electronic device, the display unit is triggered to sense the operation point at the contact portion, or the finger may not contact the display unit of the electronic device, and when the distance between the finger and the display unit is within the sensing distance of the display unit because the finger itself is a conductor, the display unit may sense the operation point corresponding to the finger.
And step 304, switching to enter a detection state to judge whether the th operation meets the operation requirement.
In step 306, the position of the operation point corresponding to the th operation sensed in the virtual input area is compared with the position of the reference operation point.
Since the th operation point is obtained by the electronic device sensing different fingers (corresponding to the operation body), by comparing the th operation point with the reference operation point (the reference operation point may be the virtual key "a", "S", "D", "F", "J", "K", "L", "corresponding to the geometric center position), it can be determined whether the th operation is accurate at the initial position of the virtual input area of the electronic device.
And 307, judging whether the distance of the operating point of the th operation deviating from the reference operating point is smaller than a third threshold, if so, judging that the th operation meets the operating requirement, exiting the detection state, and turning to 309, otherwise, judging that the th operation does not meet the operating requirement, and turning to 308.
The third threshold may correspond to a size (e.g., a side length) of the virtual key, such that when the distance from the operating point of the th operation to the reference operating point exceeds the third threshold, it indicates that the user does not accurately stop the finger at the position of the reference virtual key in the pause state, i.e., does not satisfy the operating requirement, schematic diagrams of the th operation satisfying the operating requirement are shown in fig. 3b, and neither the distance from the operating point of the th operation to the reference operating point exceeds the size of the virtual key, at this time, the prompt information "satisfy the operating requirement" may be displayed on the display unit, schematic diagrams of the th operation not satisfying the requirement are shown in fig. 3c, and the distances from the operating point of the th operation to the reference operating point exceed the size of the virtual key, i.e., the operating point of the th operation falls on.
And 308, sending out prompt information based on the analysis result.
Wherein the prompt information is used for instructing the operation body to adjust the th operation so that the adjusted th operation meets the operation requirement.
A schematic diagram of sending out the prompt information based on different analysis results is shown in fig. 3d, taking an example that the electronic device senses an operation point corresponding to a right finger, a dotted arrow represents an operation point of the right index finger and a reference operation point (i.e. a distance from the center of the right index finger to the center of the key J), and if the distance between the operation point of the right index finger and the reference point is shown by an arrow 1, it indicates that the placement position of the current index finger is very accurate, and the prompt information good can be sent out; if the distance between the operating point of the index finger of the right hand and the reference operating point is shown by an arrow 2, which indicates that the operating point of the index finger of the right hand has a small distance (which belongs to a range that does not cause an error of the touch key), a prompt message "OK Be careful" can Be sent; if the distance between the operating point of the index finger of the right hand and the reference operating point is shown by an arrow 3, the distance between the operating point corresponding to the index finger of the right hand and the reference operating point exceeds a third threshold (if a touch is made based on the position, an input Error will be caused), and a prompt message "Error Need home position" can be sent to prompt the user to adjust the placement position of the finger.
It should be noted that the prompt message is sent in the form of an image in fig. 3d, in practical applications, the prompt message may be sent in the form of voice, or in the form of vibration induction (a vibrator may be provided in the electronic device), a vibration prompt is sent when the operation does not meet the operation requirement, or certainly, the prompt message may be sent when the operation meets the operation requirement and the difference does not meet the requirement.
It should be noted that, as shown in fig. 3d, in step 309, only fingers in palms click the screen to possibly determine the keystroke behavior, and the multi-finger simultaneous click contact cannot be recognized as the correct keystroke operation.
In the embodiment, whether the operation requirement is met or not is judged based on the position of the operation point of the finger contacting the display unit (corresponding to the th operation) in the input pause state and the reference operation point, and when the operation requirement is not met, the position of the finger is prompted to be adjusted to meet the operation requirement, so that the efficiency and the accuracy of subsequent input operation can be obviously improved.
EXAMPLE III
The information processing method of kinds is described in this embodiment, and is applied to an electronic device, wherein virtual input areas are supported and displayed by the electronic device, and keys are supported and displayed by the virtual input areas, as shown in fig. 4a, the information processing method described in this embodiment includes the following steps:
in step 401, an operation th by the operator is received in the virtual input area.
At step 402, the number of sensed operation points corresponding to the th operation in the virtual input area is detected, and the duration of time the operation points are sensed is detected.
Here, when the user performs the th operation with a finger, the finger may contact the display unit of the electronic device, and when the finger contacts the display unit of the electronic device, the display unit is triggered to sense the operation point at the contact portion, or the finger may not contact the display unit of the electronic device, and when the distance between the finger and the display unit is within the sensing distance of the display unit because the finger itself is a conductor, the display unit may sense the operation point corresponding to the finger.
In step 403, it is determined whether the th operation satisfies the conditions that the th operation has a number of operating points greater than the th threshold and a duration of sensing the th operation has a point greater than a second threshold, and if so, step 404 is performed, otherwise, step 410 is performed.
As examples of step 403, when the user is in the input preparation state, at least fingers of the hand will normally contact the electronic device display unit (corresponding to operation), so that the number of contacts sensed by the electronic device display unit is at least 5 (corresponding to threshold), and the contact time exceeds the time interval (corresponding to second threshold) during which the user continuously performs operation for input, when the number of operation points of operation satisfies the above condition, it indicates that the input is currently in the pause state, the user may continue to perform input based on the current pose of the fingers, if the operation is calibrated in the pause state, so that the operation satisfies the operation requirement (e.g., accurately matching the positions of the respective fingers and the reference virtual keys, and matching the placement pose of the palm relative to the display unit and the reference pose), the input efficiency and the accuracy of subsequent user performing input based on the current pose can be improved.
The operation characteristic information of the operation body comprises the position of an operation point obtained by sensing the operation body and the duration of sensing the operation point.
In step 405, the position of the operation point corresponding to the th operation sensed in the virtual input area is compared with the position of the reference operation point.
Since the th operation point is obtained by the electronic device sensing different fingers (corresponding to the operation body), by comparing the th operation point with the reference operation point (the reference operation point may correspond to the geometric center position of the virtual keys "a", "S", "D", "F", "J", "K", "L", "J"), it can be determined whether the th operation is accurate at the initial position of the virtual input area of the electronic device.
At step 406, the distance of the operating point of the th operation from the reference operating point is compared to a third threshold.
In step 407, a th operation reference line is determined based on at least the th operation point and the position of the second operation point among the operation points.
For example, the th operation reference line may be determined using the operation points corresponding to the right index finger and the right little finger, and of course, the th operation reference line may be determined using the operation points corresponding to other fingers, such as the right middle finger and the right ring finger.
And step 408, judging whether the distance of the th operation point deviating from the reference operation point is smaller than a third threshold, the minimum included angle between the th operation reference line and the preset operation reference line is smaller than a fourth threshold, if so, judging that the th operation meets the operation requirement and executing step 410, otherwise, judging that the th operation does not meet the operation requirement and executing step 409.
The third threshold may correspond to the size (e.g., side length) of the virtual key, and the distance of the operating point of the th operation from the reference operating point exceeds the third threshold, which indicates that the user does not have the finger accurately stop at the position of the reference virtual key in the pause state, for example, the right hand, the operating point of the th operation may be any corresponding operating points of the index finger, ring finger, middle finger and little finger,
the preset operation reference line can be a reference virtual key such as "a", "S", "D", "F", "J", "K", "L", "a straight line formed by connection, and since the th operation point is obtained by the electronic device sensing different fingers (corresponding operation bodies), the included angle between the th operation reference line corresponding to the th operation point and the preset reference operation line reflects the deviation angle of the palm placing direction (the palm placing direction is the placing direction of the palm relative to the virtual input area of the electronic device when the th operation is performed) relative to the palm reference placing direction;
therefore, when the operating point of the th operation deviates from the reference operating point by a distance exceeding a third threshold and by an angle smaller than a fourth threshold (e.g., 10 degrees), it may be determined that the th operation satisfies the operating requirement.
And step 409, sending out prompt information based on the distance of the position of the th operation point deviating from the position of the reference operation point and the minimum included angle between the th operation reference line and the preset operation reference line.
The prompt information is used for indicating the operation point corresponding to the operation body adjustment to move to the reference operation point by the offset distance and indicating the operation body adjustment to adjust the angle relative to the reference operation line so that the minimum included angle is smaller than a third threshold value.
The schematic diagram of sending out the prompt information based on the different analysis results is shown in fig. 4b, taking an example that the electronic device senses an operation point corresponding to a right finger, a dashed arrow represents that the operation point of the right index finger is shifted by a distance from a reference operation point (i.e. a distance from the center of the right index finger to the center of the key J), if the distance from the operation point of the right index finger to the key J is shown by an arrow 1, when the distance from the operation point of the right index finger to the reference operation point (corresponding to the key J) is zero (i.e. completely overlapped), and a minimum included angle α between a first reference line corresponding to the operation point of the right index finger and the right middle finger and a preset reference line is smaller than a fourth threshold value (e.g. 10 degrees), it indicates that the current placement position of the palm is very accurate, if the distance from the operation point of the right index finger to the reference operation point is shown by an arrow 2, it indicates that there is a small distance from the operation point of the right index finger and the reference operation point, and a deviation α occurs in the placement direction of the palm placement of the reference point, and the palm placement direction of the palm placement of the palm is larger than a preset reference point, the palm placement direction of the palm, the palm is larger than a deviation of the palm placement direction of the palm placement of the palm, for example, the palm is 39593, and the palm is larger than a virtual palm, and the palm of the palm, the palm of the palm, and the palm is larger than the palm, and the palm, if the palm.
It should be noted that the prompt message is sent in the form of an image in fig. 4b, in practical applications, the prompt message may be sent in the form of voice, or in the form of vibration (a vibrator may be provided in the electronic device), a vibration prompt is sent when the operation does not meet the operation requirement, or certainly, the prompt message may be sent when the operation meets the operation requirement and the difference does not meet the requirement.
And step 410, detecting the virtual key triggered by the operation point operated at , and generating a signal corresponding to the triggered virtual key.
Step 410 is to complete the input processing based on the th operation, and the generated signal is used to send to the application triggering the invoking of text input, so that the application can obtain the information input by the user, it should be pointed out that only fingers in the palms click the screen in the user input process, and the multi-finger simultaneous click contact cannot be recognized as the correct keystroke operation.
In the embodiment, whether the operation requirement is met or not is judged based on the position of the operation point of the finger contacting the display unit (corresponding to the th operation) in the input pause state and the reference operation point, and when the operation requirement is not met, the position of the finger is prompted to be adjusted to meet the operation requirement, so that the efficiency and the accuracy of subsequent input operation can be obviously improved.
Example four
In this embodiment, information processing methods are described, which are applied to an electronic device, wherein the electronic device supports and displays virtual input areas, and the virtual input areas support and display keys, as shown in fig. 5a, the information processing method described in this embodiment includes the following steps:
in step 501, an operation performed by the operator is received in the virtual input area.
At step 502, the number of operation points sensed in the virtual input area corresponding to the th operation is detected, and the duration of time during which the operation points are sensed is detected.
Here, when the user performs the th operation with a finger, the finger may contact the display unit of the electronic device, and when the finger contacts the display unit of the electronic device, the display unit is triggered to sense the operation point at the contact portion, or the finger may not contact the display unit of the electronic device, and when the distance between the finger and the display unit is within the sensing distance of the display unit because the finger itself is a conductor, the display unit may sense the operation point corresponding to the finger.
In step 503, it is determined whether the th operation satisfies the conditions that the th operation has a number of operating points greater than the th threshold and a duration of sensing the th operation has a point greater than a second threshold, and if so, step 504 is performed, otherwise, step 510 is performed.
As examples of step 503, when the user is in the input preparation state, at least fingers of the hand will normally contact the electronic device display unit (corresponding to operation), so that the number of contacts sensed by the electronic device display unit is at least 5 (corresponding to threshold), and the contact time exceeds the time interval (corresponding to second threshold) during which the user continuously performs operation for input, when the number of operation points of operation satisfies the above condition, it indicates that the input is currently in the pause state, the user may continue to perform input based on the current pose of the fingers, if the operation is calibrated in the pause state, so that the operation satisfies the operation requirement (e.g., accurately matching the positions of the respective fingers and the reference virtual keys, and matching the placement pose of the palm relative to the display unit and the reference pose), the input efficiency and the accuracy of subsequent user performing input based on the current pose can be improved.
Steps 504 to 507 are processing for switching into a detection state to determine whether the th operation satisfies the operation requirement.
And step 504, analyzing the th operation to obtain the operation characteristic information of the operation body.
The operation characteristic information of the operation body comprises the position of an operation point obtained by sensing the operation body and the duration of sensing the operation point.
In step 505, the position of the operation point corresponding to the th operation sensed in the virtual input area is compared with the position of the reference operation point.
Since the th operation point is obtained by the electronic device sensing different fingers (corresponding to the operation body), by comparing the th operation point with the reference operation point (the reference operation point may correspond to the geometric center position of the virtual keys "a", "S", "D", "F", "J", "K", "L", "J"), it can be determined whether the th operation is accurate at the initial position of the virtual input area of the electronic device.
At step 506, the distance of the operating point of the th operation from the reference operating point is compared to a third threshold.
Step 507, determining a second operation reference line at least based on the positions of the third operation point and the fourth operation point in the operation points.
For example, the th operation reference line may be determined using an operation point corresponding to the right index finger and the right little finger, but of course, the second operation reference line may be determined using an operation point corresponding to another finger, such as the middle finger and the ring finger of the right hand.
Step 508, judging whether the distance of the th operation point from the reference operation point is smaller than a third threshold, whether the th distance is smaller than a fifth threshold (the th distance is the distance from the fifth operation point to the second operation reference line), if so, judging that the th operation meets the operation requirement and executing step 510, otherwise, judging that the th operation does not meet the operation requirement and executing step 509.
The third threshold may correspond to the size (e.g., side length) of the virtual key, and the distance of the operating point of the th operation from the reference operating point exceeds the third threshold, which indicates that the user does not have the finger accurately stop at the position of the reference virtual key in the pause state, for example, the right hand, the operating point of the th operation may be any corresponding operating points of the index finger, ring finger, middle finger and little finger,
the preset operation reference line can be a reference virtual key such as ' A ', ' S ', ' D ', ' F ', ' J ', ' K ', ' L ', ' a straight line formed by connection, and because the operation point of the th operation is obtained by the electronic equipment sensing different fingers (corresponding to operation bodies), the distance between the fifth operation point (different from the third operation point and the fourth operation point) and the second operation reference line reflects the bending degree of the contact connecting line of the finger sensed by the electronic equipment display unit (the larger the bending degree is, the more inaccurate the position of the finger is);
therefore, when the operating point of the th operation deviates from the reference operating point by a distance exceeding the third threshold and the th distance is less than the fifth threshold, it may be determined that the th operation satisfies the operation requirement.
In step 509, a prompt message is issued based on the distance by which the position of the operation point of the th operation deviates from the position of the reference operation point and the th distance.
The prompt information is used for instructing the operation body to adjust the operation point corresponding to the operation body to move to the reference operation point by the offset distance of the operation point, and instructing the operation body to adjust the position of the finger corresponding to the fifth operation point.
The schematic diagram of sending the prompt information based on the different analysis results is shown in fig. 5b, taking an example that the electronic device senses an operation point corresponding to a right finger, a dashed arrow indicates that the operation point of the right index finger is shifted from a reference operation point (i.e. the distance from the center of the right index finger to the center of the key J), if the distance from the operation point corresponding to the right index finger to the key J is shown by an arrow 1 and the distance D1 between the operation point of the middle finger of the right hand and the second reference line is smaller than a fifth threshold, it indicates that the placement pose of the finger is very accurate, the prompt information good can be sent out, if the distance between the operation point of the right index finger and the reference operation point is shown by an arrow 2 and the distance D2 between the operation point of the middle finger of the right hand and the second reference line is smaller than the fifth threshold, and if the placement direction of the palm is compared with the reference placement direction of the palm, it indicates that there is a small distance between the operation point of the right index finger and the reference operation point, and the right finger is shifted from the reference operation point D2, the virtual distance between the right finger and the virtual distance between the second reference finger is larger than the distance D2 of the placement of the middle finger placement of the second reference finger, and the virtual placement of the second index finger placement of the right hand, and the virtual placement of the second index finger placement of the second reference finger placement of the second finger is larger than the second finger placement of the second reference finger placement of the second finger placement.
It should be noted that the prompt message is sent in the form of an image in fig. 5b, in practical applications, the prompt message may be sent in the form of voice, or in the form of vibration (a vibrator may be provided in the electronic device), a vibration prompt is sent when the operation does not meet the operation requirement, or certainly, the prompt message may be sent when the operation meets the operation requirement and the difference does not meet the requirement.
And step 510, detecting a virtual key triggered by the operation point of the th operation, and generating a signal corresponding to the triggered virtual key.
Step 510 is to complete the input processing based on the th operation, and generate a signal for sending to the application triggering the invoking of text input, so that the application obtains the information input by the user, it should be noted that, in the user input process, only fingers in the palms click the screen to be possible to determine the keystroke behavior, and the simultaneous multi-finger click contact cannot be recognized as the correct keystroke operation.
In the embodiment, whether the operation requirement is met or not is judged based on the position of the operation point of the finger contacting the display unit (corresponding to the th operation) in the input pause state and the reference operation point, and when the operation requirement is not met, the position of the finger is prompted to be adjusted to meet the operation requirement, so that the efficiency and the accuracy of subsequent input operation can be obviously improved.
This embodiment describes kinds of processing electronic devices, and as shown in fig. 6, the electronic devices include:
a display unit 10 for displaying a virtual input area supporting display of keys;
a receiving unit 20 configured to receive an th operation performed by an operation body in the virtual input area;
the analysis unit 30 is used for analyzing the th operation to obtain the operation characteristic information of the operation body;
a judging unit 40 configured to judge whether the th operation satisfies an operation requirement based on operation characteristic information of the operation body;
and the prompting unit 50 is used for sending prompting information based on the analysis result when the obtained analysis result indicates that the th operation does not meet the operation requirement, wherein the prompting information is used for indicating the operation body to adjust the th operation so that the adjusted th operation meets the operation requirement.
As implementations, the electronic device further includes:
a detecting unit 60 for detecting the number of operation points corresponding to the th operation sensed in the virtual input area and detecting a duration of time during which the operation points are sensed;
when the number of the operation points of the th operation is greater than the th threshold and the duration of sensing the operation points is greater than the second threshold, the detection state is switched to trigger the determining unit 40 to determine whether the th operation meets the operation requirement.
As embodiments, the judging unit 40 includes (not shown in the figure):
an comparison module for comparing the sensed position of the operation point corresponding to the th operation in the virtual input area with a position of a reference operation point;
and a judging module (coupled with the th comparing module) for judging that the th operation meets the operation requirement when the operation point of the th operation deviates from the reference operation point by a distance smaller than a third threshold value, otherwise, judging that the th operation does not meet the operation requirement.
As embodiments, the determining unit 40 further includes (not shown in the figure):
an determining module (coupled to the determining module) for determining a operation reference line based on at least the positions of and the second of the operation points;
the judging module is further configured to compare the minimum included angle between the th operation reference line and a preset operation reference line with a fourth threshold, determine that the obtained comparison result represents that the minimum included angle is larger than the fourth threshold, and determine that the th operation meets the operation requirement when the distance from the operation point of the th operation to the reference operation point is smaller than a third threshold, otherwise, determine that the th operation does not meet the operation requirement.
The prompting unit 50 is further configured to issue the prompting information based on a distance that the position of the operation point of the th operation deviates from the position of the reference operation point and a minimum included angle between the th operation reference line and a preset operation reference line, as embodiments,
the prompt information is used for indicating that the operation point corresponding to the operation body moves the offset distance to the reference operation point, and indicating that the operation body adjusts the angle relative to the reference operation line, so that the minimum included angle is smaller than the fourth threshold value.
As embodiments, the determining unit 40 further includes (not shown in the figure):
a second determining module (coupled to the judging module) for determining a second operation reference line based on at least the positions of a third operation point and a fourth operation point of the operation points;
the judging module is further configured to compare the th distance with a fifth threshold, where the th distance is a distance from a fifth operation point of the operation points to the second operation reference line, determine that the th operation meets the operation requirement when the obtained comparison result indicates that the th distance is smaller than the fifth threshold, and otherwise determine that the th operation does not meet the operation requirement.
The prompting unit 50 is further configured to issue the prompting information based on a distance of the operation point of the th operation from the reference operation point and the th distance, as embodiments,
the prompt information is used to instruct the operating body to adjust the operating point corresponding to the operating body to move to the reference operating point by the offset distance, and instruct the operating body to adjust the position of the fifth operating point so that the -th distance is smaller than the third threshold.
As implementation manners, the prompting unit 50 is further configured to issue at least of the following types of prompting messages:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
In practical applications, the display unit 10 may be implemented by a display screen of an electronic device, the receiving unit 20 may be implemented by a display unit and a touch driving integrated circuit, the analyzing unit 30, the determining unit 40, and the detecting unit 60 may be implemented by a Microprocessor (MCU) or a logic programmable array (FPGA) of the electronic device, the prompting unit 50 may be implemented by the display screen of the electronic device when an image prompt message needs to be sent, the prompting unit 50 may be implemented by a microphone of the electronic device when a voice prompt message needs to be sent, and the prompting unit 50 may be implemented by a vibrator of the electronic device when a vibration sensing prompt message needs to be sent.
It will be understood by those skilled in the art that all or part of the steps of implementing the above method embodiments may be implemented by hardware associated with program instructions, and that the program may be stored in computer readable storage medium, and when executed, the program performs the steps of the above method embodiments, and the storage medium includes various media capable of storing program codes, such as removable storage device, Read-Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk.
Based on the understanding, the technical solution of the embodiments of the present invention or the portions contributing to the prior art may be embodied in the form of a software product stored in storage media, which includes several instructions for making computer devices (which may be personal computers, servers, or network devices) execute all or part of the methods described in the embodiments of the present invention.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (16)
1, information processing method applied to electronic equipment, wherein virtual input area is supported and displayed by the electronic equipment, and the virtual input area is supported and displayed by keys, the method comprises:
receiving an th operation by an operator in the virtual input area;
analyzing the th operation to obtain the operation characteristic information of the operation body;
comparing the position of the th operation point in the operation characteristic information of the operation body with the position of a reference operation point to judge whether the th operation meets the operation requirement;
when the obtained analysis result indicates that the th operation does not meet the operation requirement, sending out prompt information based on the analysis result, wherein,
and the prompt information is used for indicating a user to calibrate so that the positions of the fingers are accurately matched with the positions of the reference virtual keys.
2. The method of claim 1, wherein before determining whether the th operation satisfies an operation requirement, the method further comprises:
detecting the number of operation points corresponding to the th operation sensed at the virtual input area and detecting the duration of time the operation points are sensed;
when the number of the operation points of the th operation is larger than a th threshold value and the duration of sensing the operation points is larger than a second threshold value, switching to a detection state to judge whether the th operation meets the operation requirement.
3. The method of claim 1, wherein comparing the position of the operation point of the th operation in the operation characteristic information of the operation body with a position of a reference operation point to determine whether the th operation meets an operation requirement comprises:
comparing the position of the operation point corresponding to the th operation sensed in the virtual input area with the position of a reference operation point;
when the operating point of the th operation deviates from the reference operating point by a distance less than a third threshold, it is determined that the th operation satisfies the operating requirement, otherwise, it is determined that the th operation does not satisfy the operating requirement.
4. The method of claim 3, wherein before determining that the th operation satisfies an operational requirement, the method further comprises:
determining a operation reference line based on at least the th operation point and the position of the second operation point;
comparing the minimum included angle between the th operation reference line and a preset operation reference line with a fourth threshold;
and when the obtained comparison result indicates that the minimum included angle is larger than the fourth threshold value, determining that the th operation meets the operation requirement.
5. The method of claim 4, wherein issuing a prompt based on the parsing result comprises:
sending out the prompt information based on the distance of the position of the th operation point deviating from the position of the reference operation point and the minimum included angle between the th operation reference line and a preset operation reference line,
the prompt information is used for indicating the operation body to adjust the offset distance of the corresponding operation point to the reference operation point and indicating the operation body to adjust the angle relative to the reference operation line so that the minimum included angle is smaller than the fourth threshold value.
6. The method of claim 3, wherein before determining that the th operation satisfies an operational requirement, the method further comprises:
determining a second operation reference line based on at least the positions of a third operation point and a fourth operation point of the operation points;
comparing the th distance with a fifth threshold, the th distance being a distance of a fifth one of the operating points from the second operating reference line;
determining that the operation meets the operational requirement when the determined comparison result indicates that the distance is less than the fifth threshold.
7. The method of claim 6, wherein issuing a prompt based on the parsing result comprises:
issuing the prompt information based on the distance of the operating point of the th operation from the reference operating point and the th distance, wherein,
the prompt information is used for instructing the operating body to adjust the distance by which the operating point corresponding to the operating body moves to the reference operating point, and instructing the operating body to adjust the position of the fifth operating point so that the -th distance is smaller than the third threshold.
8. The method of any of claims 1-7, wherein the issuing of the prompt includes issuing at least of the following types of prompts:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
An electronic device of the type 9, , comprising:
a display unit used for displaying virtual input areas, wherein the virtual input areas support the display of keys;
a receiving unit configured to receive an th operation performed by an operation body in the virtual input area;
the analysis unit is used for analyzing the th operation to obtain the operation characteristic information of the operation body;
a determination unit configured to compare a position of the th operation point in the operation characteristic information of the operation body with a position of a reference operation point to determine whether the th operation satisfies an operation requirement;
and the prompting unit is used for sending out prompting information based on the analysis result when the obtained analysis result represents that the th operation does not meet the operation requirement, wherein the prompting information is used for indicating a user to calibrate so that the positions of the fingers and the reference virtual key are accurately matched.
10. The electronic device of claim 9, further comprising:
a detection unit for detecting the number of operation points corresponding to the th operation sensed in the virtual input area and detecting a duration of time during which the operation points are sensed;
when the number of the operation points of the th operation is larger than a th threshold value and the duration of sensing the operation points is larger than a second threshold value, switching to a detection state to trigger the judging unit to judge whether the th operation meets the operation requirement.
11. The electronic device according to claim 9, wherein the determination unit includes:
an comparison module for comparing the sensed position of the operation point corresponding to the th operation in the virtual input area with a position of a reference operation point;
and the judging module is used for judging that the operation meets the operation requirement when the distance of the operating point of the operation deviating from the reference operating point is less than a third threshold, and otherwise, judging that the operation does not meet the operation requirement.
12. The electronic device according to claim 11, wherein the determination unit further includes:
an determination module for determining a operation reference line based on at least the positions of and second of the operation points;
the judging module is further configured to compare the minimum included angle between the th operation reference line and a preset operation reference line with a fourth threshold, determine that the obtained comparison result represents that the minimum included angle is larger than the fourth threshold, and determine that the th operation meets the operation requirement when the distance from the operation point of the th operation to the reference operation point is smaller than a third threshold, otherwise, determine that the th operation does not meet the operation requirement.
13. The electronic device of claim 12,
the prompting unit is further used for sending out the prompting information based on the distance of the position of the th operation point deviating from the position of the reference operation point and the minimum included angle between the th operation reference line and a preset operation reference line,
the prompt information is used for indicating the operation point corresponding to the operation body to move to the reference operation point by the offset distance and indicating the operation body to adjust the angle relative to the reference operation line so that the minimum included angle is smaller than the fourth threshold value.
14. The electronic device according to claim 11, wherein the determination unit further includes:
the second determining module is used for determining a second operation datum line at least based on the positions of a third operation point and a fourth operation point in the operation points;
the judging module is further configured to compare the th distance with a fifth threshold, where the th distance is a distance from a fifth operation point of the operation points to the second operation reference line, determine that the th operation meets the operation requirement when the obtained comparison result indicates that the th distance is smaller than the fifth threshold, and otherwise determine that the th operation does not meet the operation requirement.
15. The electronic device of claim 14,
the prompting unit is also used for sending out the prompting information based on the distance of the th operation point deviating from the reference operation point and the th distance,
the prompt information is used for instructing the operating body to adjust the distance by which the operating point corresponding to the operating body moves to the reference operating point, and instructing the operating body to adjust the position of the fifth operating point so that the -th distance is smaller than the third threshold.
16. The electronic device according to any of the claims 9-15 and , wherein the prompting unit is further configured to issue at least types of prompting messages:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410725300.6A CN105718069B (en) | 2014-12-02 | 2014-12-02 | Information processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410725300.6A CN105718069B (en) | 2014-12-02 | 2014-12-02 | Information processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105718069A CN105718069A (en) | 2016-06-29 |
| CN105718069B true CN105718069B (en) | 2020-01-31 |
Family
ID=56142859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410725300.6A Active CN105718069B (en) | 2014-12-02 | 2014-12-02 | Information processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105718069B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101685342A (en) * | 2008-09-26 | 2010-03-31 | 联想(北京)有限公司 | Method and device for realizing dynamic virtual keyboard |
| CN103049118A (en) * | 2011-10-14 | 2013-04-17 | 北京搜狗科技发展有限公司 | Method and device for judging holding states on touch equipment |
| CN103186329A (en) * | 2011-12-27 | 2013-07-03 | 富泰华工业（深圳）有限公司 | Electronic equipment and touch input control method thereof |
| CN103443744A (en) * | 2010-11-30 | 2013-12-11 | 清洁之匙公司 | Dynamically located onscreen keyboard |
| CN103889522A (en) * | 2012-01-24 | 2014-06-25 | 松下电器产业株式会社 | Electronic apparatus |
| CN104020878A (en) * | 2014-05-22 | 2014-09-03 | 小米科技有限责任公司 | Touch input control method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9239678B2 (en) * | 2009-09-21 | 2016-01-19 | Beijing Lenovo Software Ltd. | Electronic device and method, cell phone, program to achieve preset operation command thereof |
| CN102289325B (en) * | 2011-09-21 | 2015-05-13 | 宇龙计算机通信科技(深圳)有限公司 | Mobile terminal, touch area recognition device and method |
| CN102736850B (en) * | 2012-04-20 | 2015-01-28 | 中兴通讯股份有限公司 | Input method and device |
-
2014
- 2014-12-02 CN CN201410725300.6A patent/CN105718069B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101685342A (en) * | 2008-09-26 | 2010-03-31 | 联想(北京)有限公司 | Method and device for realizing dynamic virtual keyboard |
| CN103443744A (en) * | 2010-11-30 | 2013-12-11 | 清洁之匙公司 | Dynamically located onscreen keyboard |
| CN103049118A (en) * | 2011-10-14 | 2013-04-17 | 北京搜狗科技发展有限公司 | Method and device for judging holding states on touch equipment |
| CN103186329A (en) * | 2011-12-27 | 2013-07-03 | 富泰华工业（深圳）有限公司 | Electronic equipment and touch input control method thereof |
| CN103889522A (en) * | 2012-01-24 | 2014-06-25 | 松下电器产业株式会社 | Electronic apparatus |
| CN104020878A (en) * | 2014-05-22 | 2014-09-03 | 小米科技有限责任公司 | Touch input control method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105718069A (en) | 2016-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3120234B1 (en) | Touch keyboard calibration | |
| CN101685342B (en) | Method and device for realizing dynamic virtual keyboard | |
| US9377871B2 (en) | System and methods for determining keyboard input in the presence of multiple contact points | |
| US7023427B2 (en) | Method and system for detecting multiple touches on a touch-sensitive screen | |
| EP2332023B1 (en) | Two-thumb qwerty keyboard | |
| US9891816B2 (en) | Method and mobile terminal for processing touch input in two different states | |
| US20130162603A1 (en) | Electronic device and touch input control method thereof | |
| WO2017032016A1 (en) | Interface operating method and electronic terminal | |
| US10409489B2 (en) | Input apparatus | |
| CN105528130A (en) | A control method and device and an electronic apparatus | |
| US20180052598A1 (en) | Multi-touch based drawing input method and apparatus | |
| CN103389862A (en) | Information processing apparatus, information processing method, and program | |
| US20170277419A1 (en) | Method and Electronic Device for Replying to a Message | |
| US20140105664A1 (en) | Keyboard Modification to Increase Typing Speed by Gesturing Next Character | |
| US20120182260A1 (en) | Input device | |
| CN110825306B (en) | Braille input method, device, terminal and readable storage medium | |
| CN110297592B (en) | Processing method and electronic equipment | |
| EP2778858A1 (en) | Electronic device including touch-sensitive keyboard and method of controlling same | |
| CN105718069B (en) | Information processing method and electronic equipment | |
| US9092407B2 (en) | Virtual interface adjustment methods and systems | |
| EP2778859B1 (en) | Method and apparatus for word prediction using the position of a non-typing digit | |
| CN105260044A (en) | Electronic equipment and touch operation recognition method | |
| EP2840468A1 (en) | Input method and device | |
| TWI498793B (en) | Optical touch system and control method | |
| JP6135242B2 (en) | Terminal device, key input method, and key input program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |