CN111026322A - Keyboard layout method and device, electronic equipment and storage medium - Google Patents

Keyboard layout method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN111026322A
CN111026322A CN201911215036.0A CN201911215036A CN111026322A CN 111026322 A CN111026322 A CN 111026322A CN 201911215036 A CN201911215036 A CN 201911215036A CN 111026322 A CN111026322 A CN 111026322A
Authority
CN
China
Prior art keywords
finger
area
key
input method
function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911215036.0A
Other languages
Chinese (zh)
Inventor
汪守成
彭元涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
iFlytek Co Ltd
Original Assignee
iFlytek Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by iFlytek Co Ltd filed Critical iFlytek Co Ltd
Priority to CN201911215036.0A priority Critical patent/CN111026322A/en
Publication of CN111026322A publication Critical patent/CN111026322A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/0279Improving the user comfort or ergonomics
    • H04M1/0281Improving the user comfort or ergonomics for providing single handed use or left/right hand conversion

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Input From Keyboards Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides a keyboard layout method, a keyboard layout device, electronic equipment and a storage medium, wherein the method comprises the following steps: determining a finger sliding track under the single-hand operation of a user; determining a finger reachable area under the single-hand operation of the user based on the finger sliding track; a virtual keyboard is disposed within the finger-reachable region. The method, the device, the electronic equipment and the storage medium provided by the embodiment of the invention determine the finger reachable area under the single-hand operation of the user based on the finger sliding track, realize the acquisition of the personalized finger reachable area and can completely meet the single-hand operation habit of the user. The virtual keyboard is arranged in the finger-reachable area, so that a user can touch all keys in the virtual keyboard during single-hand operation, the input efficiency of the single-hand operation is improved, and the input experience of the single-hand operation is optimized.

Description

Keyboard layout method and device, electronic equipment and storage medium
Technical Field
The invention relates to the technical field of input methods, in particular to a keyboard layout method, a keyboard layout device, electronic equipment and a storage medium.
Background
In order to provide better visual experience for users, the display screen of the current intelligent terminal is getting larger and larger in size. Existing virtual keyboards automatically flood the screen by default. As the size of the display screen increases, the size of the virtual keyboard on the display screen also increases.
When a user uses a virtual keyboard on a large-screen intelligent terminal to perform key input, two hands are usually needed to operate the large-screen intelligent terminal to ensure that each input method area can be clicked. And in many times, the user can only operate with one hand due to various reasons, the range of touch control of the single hand holding the intelligent terminal is limited, the key input is difficult to complete, and the inconvenience of the key input greatly influences the user experience.
Disclosure of Invention
The embodiment of the invention provides a keyboard layout method, a keyboard layout device, electronic equipment and a storage medium, which are used for solving the problem that the existing large-screen intelligent terminal is inconvenient for single-hand key input.
In a first aspect, an embodiment of the present invention provides a keyboard layout method, including:
determining a finger sliding track under the single-hand operation of a user;
determining a finger reachable area under the single-hand operation of the user based on the finger sliding track;
a virtual keyboard is disposed within the finger-reachable region.
Preferably, the arranging the virtual keyboard in the finger-reachable area specifically includes:
arranging the input method part of the virtual keyboard in an input method area;
arranging a functional part of the virtual keyboard in a functional area;
wherein the input method region and the functional region constitute the finger-reachable region.
Preferably, the arranging the input method part of the virtual keyboard in the input method area further comprises:
determining a finger rotation center and a finger length based on the finger sliding track;
determining an input method area endpoint on the finger sliding track based on the finger rotation center, the finger length and a preset finger inclination angle;
determining the input method region in the finger-reachable region based on the input method region end points and the finger rotation center.
Preferably, the arranging the input method part of the virtual keyboard in the input method area further comprises:
adjusting the size of a corresponding response area of each key in the input method part in the input method area based on the key information of the user; the user key information includes at least one of a key speed, a key heat and a click probability of each key.
Preferably, the adjusting, based on the user key information, the size of a response area corresponding to each key in the input method area in the input method part specifically includes:
determining a weight of each key in the input method part based on the user key information;
and determining the size of a corresponding response area of each key in the input method area based on the weight of each key and the size of the input method area.
Preferably, the arranging the functional part of the virtual keyboard in the functional area further comprises:
based on the current input information, adjusting the corresponding response area of each function key in the function part in the function area; the current input information includes a current input scene and/or current on-screen text.
Preferably, the adjusting, based on the current input information, a corresponding response area of each function key in the function portion in the function area specifically includes:
determining a function recommendation weight of each function key in the function part corresponding to the current input information;
and adjusting the size and/or the sequence of the corresponding response area of each function key in the function area based on the function recommendation weight of each function key.
In a second aspect, an embodiment of the present invention provides a keyboard layout apparatus, including:
the track determining unit is used for determining a finger sliding track under the single-hand operation of a user;
the area determining unit is used for determining a finger reachable area under the single-hand operation of the user based on the finger sliding track;
a keyboard layout unit for laying a virtual keyboard within the finger-reachable area.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a bus, where the processor and the communication interface, the memory complete communication with each other through the bus, and the processor may call a logic instruction in the memory to perform the steps of the method provided in the first aspect.
In a fourth aspect, an embodiment of the present invention provides a non-transitory computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of the method as provided in the first aspect.
According to the keyboard layout method and device, the electronic equipment and the storage medium, the finger reachable area under the single-hand operation of the user is determined based on the finger sliding track, the personalized acquisition of the finger reachable area is realized, and the individual single-hand operation habit of the user can be completely met. The virtual keyboard is arranged in the finger-reachable area, so that a user can touch all keys in the virtual keyboard during single-hand operation, the input efficiency of the single-hand operation is improved, and the input experience of the single-hand operation is optimized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a keyboard layout method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a finger accessible area according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a layout flow of a virtual keyboard according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a layout structure of a virtual keyboard according to an embodiment of the present invention;
fig. 5 is a schematic flow chart of a method for determining an input method area according to an embodiment of the present invention;
fig. 6 is a schematic diagram of an input method area according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a key arrangement of an input method area according to an embodiment of the present invention;
fig. 8 is a schematic view illustrating a key arrangement of an input method area according to another embodiment of the present invention;
fig. 9 is a schematic structural diagram of a keyboard layout apparatus according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to provide better visual experience for users, the display screen of the intelligent terminal is getting larger and larger in size. Taking a smart phone as an example, in all current smart phones, the layout and size of a virtual keyboard are unified by default, a screen is automatically paved, and when a user needs personalized layout, switching can be performed only according to the layout specified by a system.
When a user uses a virtual keyboard on a large-screen mobile phone to perform key input, both hands are usually required to operate the mobile phone to ensure that each input method area can be clicked. In many times, the user can only operate with one hand for various reasons, and when the user types with the right hand, the leftmost key is difficult to press, so that the inconvenience of key input greatly affects the user experience. How to meet the requirement of one-hand operation of a user is still a problem to be solved urgently by technical personnel in the field.
Accordingly, the embodiment of the invention provides a keyboard layout method. Fig. 1 is a schematic flowchart of a keyboard layout method according to an embodiment of the present invention, and as shown in fig. 1, the method may be applied to the layout of virtual keyboards in touch screens of various intelligent terminals to achieve an input problem held by a single hand, where the intelligent terminal may be a smart phone, a tablet computer, or the like. The method comprises the following steps:
and step 110, determining a finger sliding track under the single-hand operation of the user.
Specifically, the user naturally slides on the touch screen of the intelligent terminal with a finger in a one-hand operation state, and the intelligent terminal records the natural sliding track of the finger on the touch screen, namely the finger sliding track. Here, the finger sliding track may be formed by coordinates of a plurality of finger touch points, the finger sliding track may be a section of arc line formed by a single sliding of a finger of the user, or may be a plurality of arc lines formed by multiple sliding of a finger of the user, and an end point of the arc line may be an edge of the touch screen, or may be any point in the touch screen, which is not specifically limited in the embodiment of the present invention.
For example, the user holds the smartphone with the right hand and slides naturally on the touch screen with the thumb of the right hand, and the smartphone can obtain the finger sliding trajectory. Here, the user may perform one-handed operation by using either the right hand or the left hand, or may perform a sliding operation by using the thumb or the fingers. It should be noted that the finger that naturally slides on the touch screen when the user operates with one hand is the same finger as the finger that is input by the subsequent key.
And step 120, determining a finger reachable area under the single-hand operation of the user based on the finger sliding track.
Specifically, the finger-reachable region is a region on the touch screen that can be touched by a finger for touching the key for input when the user operates the touch screen with one hand. Through the collected finger sliding tracks, the tracks which can be touched by the user furthest during single-hand operation can be simulated, and then the touch screen is divided into a finger-reachable area and a finger-inaccessible area. Here, the finger reachable region is customized for the finger sliding trajectory of the user, and can completely match the actual situation of the single-hand operation of the user.
Fig. 2 is a schematic diagram of a finger-reachable area provided in an embodiment of the present invention, in fig. 2, a matrix frame is a touch screen, a sector portion filled with oblique lines on the touch screen is the finger-reachable area, an arc line of an edge of the finger-reachable area is determined by a finger sliding track, an edge of the finger-reachable area may be obtained by extending a section of the finger sliding track according to a curvature of the finger sliding track, or an edge of the finger-reachable area may be obtained by fitting a plurality of sections of the finger sliding tracks into an arc line intersecting with an edge of the touch screen, which is not specifically limited in this embodiment of the present invention.
Step 130, laying the virtual keyboard in the finger-reachable area.
Specifically, after the finger-reachable area is determined, the virtual keyboard can be arranged in the finger-reachable area, so that each key in the virtual keyboard is located at a position where the user can touch the virtual keyboard during one-hand operation, and the problem that the key cannot be touched under one-hand operation due to the fact that a touch screen is too large and the key position exceeds the range where the finger can touch the virtual keyboard is solved.
The method provided by the embodiment of the invention determines the finger reachable area under the single-hand operation of the user based on the finger sliding track, realizes the acquisition of the personalized finger reachable area, and can completely meet the single-hand operation habit of the user. The virtual keyboard is arranged in the finger-reachable area, so that a user can touch all keys in the virtual keyboard during single-hand operation, the input efficiency of the single-hand operation is improved, and the input experience of the single-hand operation is optimized.
Based on the foregoing embodiment, fig. 3 is a schematic diagram of a layout flow of a virtual keyboard according to an embodiment of the present invention, and as shown in fig. 3, in the method, step 130 specifically includes:
and step 131, arranging the input method part of the virtual keyboard in the input method area.
In step 132, the functional portion of the virtual keyboard is laid out in the functional area.
The input method area and the function area form a finger-reachable area.
Specifically, the virtual keyboard may be divided into two parts, an input method part and a function part, wherein the input method part includes each input key, such as 9 keys in a nine-key pinyin input mode, 26 keys in a full-key input mode, and the function part includes each function key, such as an emoji key, an input mode switching key, a voice input key, a candidate punctuation key, and the like. Correspondingly, the finger-reachable area is also divided into an input method area and a function area, wherein the input method area corresponds to the input method part of the virtual keyboard, and the function area corresponds to the function part of the virtual keyboard.
The conventional virtual keyboard is a regular rectangular area with a flat layout, keys are aligned in rows or columns, and a finger-reachable area is a sector area. When the virtual keyboard is arranged in the finger-reachable area, the overall shape of the virtual keyboard can be adjusted in a rectangular mode based on the shape of the finger-reachable area, the virtual keyboard is adjusted to be in a fan-shaped layout mode and arranged in the finger-reachable area, the straight layout of an input method part in the virtual keyboard can be kept, the layout of a function part in the virtual keyboard is only adjusted to adapt to the shape of the finger-reachable area, the input method part in the virtual keyboard can be adjusted according to the radian of an arc at the edge of the finger-reachable area, the input method part is distributed in an arc shape, and after the input method part is arranged in the finger-reachable area, the function part is filled in a blank position of the finger-reachable area.
Preferably, in order to adapt to the input habit of the user, when the input method portions are laid out in the finger-reachable region, the layout of the function portions may be implemented by setting the input method region to a rectangular region or other regular regions adapted to the straight layout, and using an irregular region other than the input method region in the finger-reachable region as a function region, while maintaining the straight layout of the input method portions.
It should be noted that, in the embodiment of the present invention, the execution sequence of step 131 and step 132 is not specifically limited, and step 131 may be executed before step 132, or may be executed after step 132, or may be executed synchronously with step 132.
For example, fig. 4 is a schematic diagram of a layout structure of a virtual keyboard according to an embodiment of the present invention, in fig. 4, a region filled with cross lines is an input method region in a finger-reachable region, 3 regions filled with oblique lines are a functional region 1, a functional region 2, and a functional region 3 in the finger-reachable region, respectively, the input method region is a regular rectangular region for laying input method portions in a straight layout in the virtual keyboard, and the functional region is an irregular region for laying functional portions in the virtual keyboard.
According to the method provided by the embodiment of the invention, the input method part in the flat layout is arranged in the input method area of the finger touch accessible area, and the layout mode of the input method part in the conventional virtual keyboard is reserved as much as possible so as to adapt to the input habit of the user, so that the user can smoothly perform key input when switching to the single-hand operation mode. Meanwhile, the functional part is arranged in the functional area of the finger touch area, so that the basic function of the conventional virtual key is met while the thumb touch area is fully utilized.
Based on any of the above embodiments, fig. 5 is a schematic flowchart of a method for determining an input method region according to an embodiment of the present invention, as shown in fig. 5, in the method, before step 131, the method further includes:
step 1301, determining a finger rotation center and a finger length based on the finger sliding track.
Specifically, the finger sliding track may be approximated to a section of circular arc obtained by drawing a circle with the center of rotation of the finger as the center of the circle and the length of the finger as the radius. Here, the center of rotation of the finger is approximated to be at the finger joint.
When the sliding track of the finger is known, the rotation center of the finger and the length of the finger can be determined according to the principle of finding the circle center and the radius of a known circular arc. Further, the finger rotation center and the finger length can be obtained by the principle that the circle center and the radius can be determined by three points on the circle, and the calculation formula of the finger rotation center is as follows:
Figure BDA0002299275340000071
Figure BDA0002299275340000072
the calculation formula of the finger length is as follows:
Figure BDA0002299275340000073
in the formula, the coordinate of the point O is the coordinate of the center of a circle, OxIs the x-axis coordinate of point O, OyThe coordinate of the Y axis of the point O is any A, B, C three points on the finger sliding track, and the coordinate of the three points is recorded as (A)x,k,Ay,k)、(Bx,k,By,k) And (C)x,k,Cy,k) Wherein k is the group number of the finger sliding track, and n is the group number of the finger sliding track.
Step 1302, determining an end point of the input method area on the finger sliding track based on the finger rotation center, the finger length and the preset finger inclination angle.
Here, preset finger inclination angle is used for representing the user and holding intelligent terminal in the one hand, and when the finger was placed naturally on touch screen, the inclination of finger. Preferably, the preset finger inclination angle may be 45 °.
After the finger rotation center and the finger length are determined, a circle is made by taking the finger rotation center as the center of the circle and the finger length as the radius, the ray with the finger rotation center as the end point and the preset finger inclination angle as the direction is taken, and the intersection point of the circle and the ray is taken as the end point of the input method area. The specific calculation formula is as follows:
Mx=Ox-Rcosθ
My=Oy-Rsinθ
in the formula, MxAnd MyThe coordinates of the input method area end point M on the x axis and the y axis are respectively, and theta is a preset finger inclination angle.
And step 1303, determining the input method area in the finger-reachable area based on the end point of the input method area and the rotation center of the finger.
Specifically, after the input method region end points are determined, the input method region end points and the finger rotation center are taken as two diagonal end points of the input method region, so that the input method region is determined in the finger-reachable region. It should be noted that, according to the human engineering, when the user holds the smart terminal with one hand, the finger rotation center is usually located on the side of the touch screen.
For example, fig. 6 is a schematic diagram of an input method area according to an embodiment of the present invention, in fig. 6, O is a finger rotation center, R is a finger length, θ is a preset finger tilt angle, M is an input method area end point, and a box filled with a cross line is an input method area end point determined based on M and O.
According to the method provided by the embodiment of the invention, the input method area is determined based on the finger rotation center, the finger length and the preset finger inclination angle, so that the input method part is arranged at the position closest to the finger joint, the position is the most convenient and comfortable position in ergonomics, and the portability and comfort of single-hand input can be improved.
Based on any embodiment, the method further includes, after the step 131:
step 141, adjusting the size of a response area corresponding to each key in the input method area in the input method part based on the key information of the user; the user key information includes at least one of a key velocity, a key heat, and a click probability of each key.
Specifically, in the user key information, the key speed of each key is the speed of each key clicked by the user. For any key, the key speed can be represented as a time interval between the time when the user clicks the previous key and the time when the user clicks the key, and the smaller the time interval, the faster the key speed is, which means that the user is easier to click the key. The larger the time interval, the slower the key speed, indicating that the user is more difficult to click on the key. Generally, the key speed is related to the arrangement positions of the keys, and the farther the keys are arranged, the larger the finger moving distance is, and the slower the key speed is. In addition, when the keys are arranged close to the edge, the finger needs to be bent when clicking the keys, and the key speed is slowed down.
The key heat of each key is the frequency of clicking each key by the user within the preset time, and the higher the frequency is, the higher the key heat is, the greater the possibility of clicking the key by the user is.
The click probability of each key is the predicted probability of each key clicked by the user at the moment, and the click probability can be predicted through the text content input by the user. There are many methods for predicting the click probability, for example, the click probability can be predicted based on a hidden markov model (HMM model), where the HMM model is one of input method decoding models based on an N-Gram language model, and can be used to find a chinese character string W that best represents a string of pinyin strings P, and a mathematical language is used to describe, i.e., maximize the conditional probability, and corresponds to the following formula:
Figure BDA0002299275340000091
in the above formula, Pr (W) represents the degree of smoothness of the Chinese character string, and is usually calculated by using an N-Gram language model (or other language models), and Pr (P | W) is the probability that the input pinyin string is P when the Chinese character string W is displayed, and can be decomposed into the successive multiplication II of the probabilities of the pinyin strings corresponding to each Chinese character in the Chinese character stringiPr(pi|wi) Wherein p isiFor each individual character corresponding phonetic string, wiFor each individual character, subscript i corresponds to each individual character, Pr (p), in the Chinese character stringi|wi) The probability of each pinyin string corresponding to a single character. The maximum conditional probability is calculated, and details are not repeated in the embodiment of the present invention.
The user key information may be any one or more of the key speed, the key heat and the click probability of each key, and the size of the corresponding response area of each key in the input method area may be preset or dynamically adjusted based on the user key information. Here, any key corresponds to a response area in the input method area, and when the coordinate clicked by the user is located in any response area, it is determined that the user clicks the key corresponding to the response area.
For example, when the user key information includes the key speed of each key, the size of the key response area with low key speed can be correspondingly increased; when the key information of the user comprises the key heat of each key, the size of a key response area with high key heat can be correspondingly increased; when the user key information contains the click probability of each key, the size of the key response area with high click probability can be correspondingly increased, and through the operation, the user can more easily click the key which is difficult to click originally due to long distance, or the key with high heat and high click probability.
Based on any of the above embodiments, in the method, step 141 specifically includes: determining the weight of each key in the input method part based on the key information of the user; and determining the size of the corresponding response area of each key in the input method area based on the weight of each key and the size of the input method area.
Specifically, the weight of each key is used to reflect the size of the response area occupied by the key in the input method area, and the higher the occupancy ratio is, the larger the corresponding response area is. The determination of the weight is determined based on the user key information, for example, the ratio of the average time interval of any key to the sum of the average time intervals of each key may be used as the weight of the key, or the ratio of the click probability of any key to the sum of the click probabilities of each key may be used as the weight of the key. Here, the average time interval is used to characterize the key speed of the key press.
The area of the response region of each key can be determined according to the weight of each key and the area of the input method region, and on the basis, the width and the height of the input method region and the arrangement position of each key in the input method region are combined to further determine the width and the height of each key, so that the adjustment of the response region of each key is directly performed according to the width and the height of the key under the condition of meeting the straight layout rule of the input method region. Further, in the pinyin nine-key input mode, the size of the corresponding response area of each key in the input method area may be determined by combining the following formula:
Figure BDA0002299275340000101
wherein m and n are positive integers of 3 or less, and represent the number of rows and columns, respectively, and amn、bmnAnd tmnRespectively the width, height and interval time of the mth row and nth column keys, XMAnd YMThe width and height of the input method area are represented by the x-axis and y-axis coordinates of the end point M in the O point coordinate system.
Figure BDA0002299275340000111
The weight of the keys in the mth row and the nth column is multiplied by the area of the input method area, and then the area of the response area of the keys can be obtained. The area of the response region of the keys can be embodied as the product of the width and the height of the keys, in the input method part of the flat layout, the sum of the heights of each row of keys is equal to the height of the input method region, and the sum of the widths of each row of keys is equal to the width of the input method region. The width and the height of the response area of each key in the input method area can be calculated through the formula, the width and the height of the response area of each key both meet the straight layout rule of the input method area, and the adjustment of the response area of each key can be directly carried out according to the calculation result.
Fig. 7 is a schematic diagram of key setting of an input method area according to an embodiment of the present invention, in fig. 7, points O and M are two end points of the input method area, and the size of a response area corresponding to 9 keys in the input method area is determined according to a key speed, that is, a box in the diagram. It should be noted that in the input method area, gaps between the response areas of the keys are negligible and may not be remembered, and the gaps are actually small, so that the calculation of the size and the position of the response areas of the keys is not affected.
For another example, the ratio of the sum of the click probability of any key and the click probability of each key may be used as the weight of the key, and the area of the response region of each key may be determined based on the weight of each key and the area of the input method region. In the pinyin nine-key input mode, the size of the corresponding response area of each key in the input method area can be determined by combining the following formula:
Figure BDA0002299275340000112
in the formula, PrmnIs the click probability of the mth row and nth column keys, Pr11+Pr12+…+Pr33=1。
Figure BDA0002299275340000113
The weight of the nth row key in the mth row obtained based on the click probability of each key is the ratio of the click probability of the key to the sum of the click probabilities of the keys. a ism1+am2+am3=XMThe sum of the widths of the keys used for limiting the mth row is equal to the width of the input method area, b1n+b2n+b3n=YMThe sum of the heights for limiting the nth row of keys is equal to the height of the input method area. The width and the height of the response area of each key in the input method area can be calculated through the formula, and the coordinates of the four end points of each key are obtained, so that the adjustment of the response area of each key is facilitated.
According to the length and the width of each key response area, the position coordinates of four corner points of each key response area in a coordinate system with the O point as the origin can be determined. For example, fig. 8 is a schematic diagram of key arrangement of an input method area according to another embodiment of the present invention, and in fig. 8, the coordinates of the corner point position at the lower right corner of the key with the number 13 are (0, b)33+b23) The angular point position coordinate of the upper right corner is (0, b)33+b23+b13)。
According to any of the above embodiments, the method further includes, after the step 132:
step 142, based on the current input information, adjusting the corresponding response area of each function key in the function area in the function part; the current input information includes a current input scene and/or current on-screen text.
Specifically, in the application process of the virtual keyboard, the functional part of the virtual keyboard can be adjusted according to the current input scene. Here, the current input scenario may be a social scenario, a document editing scenario, or the like, and the current input scenario may be determined by obtaining package name information of the current application, and the package name information may be obtained from input box information when the virtual keyboard pops up, which is not specifically limited in this embodiment of the present invention. For example, when the entry information is com.tenent.mm (WeChat) or com.tenent.mobileqq (QQ), it is determined that the current input scene is a social scene. In addition, the functional part of the virtual keyboard can be adjusted according to the current on-screen text, or the functional part can be adjusted by combining the current input scene and the current on-screen text.
The function part of the virtual keyboard comprises a plurality of function keys, and the size, position, sorting and other characteristics of the corresponding area of each function key in the function area are associated with the current input information, for example, in a social scene, the function keys related to expressions can be preferentially recommended, and the function keys related to the expressions are sorted according to the clicking popularity, so that a user can conveniently click the most desired expression. For another example, if the user inputs "happy" text, the function key associated with "happy", for example, the function key corresponding to the expression associated with "happy" may be determined by keyword matching, and if there are a plurality of associated function keys, the higher the matching degree is, the larger the area of the response region is, and the position is further forward.
According to the method provided by the embodiment of the invention, the response area of the function key in the function area is adjusted based on the current input scene, so that the adaptability of the virtual keyboard function part to the corresponding input scene can be improved, and a user can click the function key to be clicked more easily.
Based on any of the above embodiments, in this method, step 142 specifically includes: determining function recommendation weight of each function key in a function part corresponding to the current input information; and adjusting the size and/or the sequencing of the corresponding response area of each function key in the function area based on the function recommendation weight of each function key.
Specifically, each function key corresponds to a function recommendation weight, and the function recommendation weight is used for representing the importance degree of the function key in the function part. The function recommendation weights of different function keys may be set in advance for different input scenarios. For example, in a social scenario, the function recommendation weight of the expression-related function key is higher, and in a document editing scenario, the function recommendation weight of the expression-related function key is lower.
After determining the function recommendation weight of each function key, the corresponding response region of each function key in the function region may be correspondingly adjusted according to the function recommendation weight of each function key, where the adjustment of the response region includes adjustment of the size and/or the position of the response region. The higher the function recommendation weight of the function key is, the larger the area of the response region occupied by the function key in the function region is, and the more the position is, and the smaller the function recommendation weight is, the smaller the area of the response region occupied by the function key in the function region is, and the more the position is.
For example, the area of the response region of the function key can be expressed by the following formula:
Sn=Smin*Cn/Cmin
in the formula, SnArea of response region for nth function key, SminArea of response region of function key being minimum, CnRecommending weight for the function of the nth function key, specifically expressed as the click frequency of the nth function key in a preset period, CminAnd recommending the weight for the minimum function, wherein the weight is expressed as the minimum value of the clicking frequency of all the function keys in a preset period. Thus, the response area of the nth function key may be the product of the ratio of the function recommendation weight of the function key to the minimum function recommendation weight and the minimum response area.
For another example, the method may perform keyword matching on a top screen text input by the user with the input method local resource file library, extract a function matched with the top screen text from the input method local resource file library, determine a corresponding function key, increase a function recommendation weight of the corresponding function key, and preferentially display a response region corresponding to the function key in the function region, so that the user can click the function key.
According to the method provided by the embodiment of the invention, the adjustment of the function part is carried out based on the function recommendation weight, so that the flexibility of the virtual keyboard in the input process is enhanced, and the user experience is optimized.
Based on any one of the above embodiments, an embodiment of the present invention provides a keyboard layout method, including the following steps:
firstly, a user naturally slides on a touch screen of the intelligent terminal by using a finger in a one-hand operation state, and the intelligent terminal records the natural sliding track of the finger on the touch screen to obtain the finger sliding track.
Secondly, the intelligent terminal simulates a track which can be touched by a user furthest during single-hand operation according to the finger sliding track, and further cuts out a finger-reachable area in the touch screen.
Then, the intelligent terminal calculates the finger rotation center and the finger length according to the finger sliding track by utilizing the principle that the circle center and the radius are determined by three points, on the basis, the end point of the input method area is determined on the finger sliding track according to the angle of 45 degrees when the finger naturally inclines, the end point of the input method area and the finger rotation center are used as two opposite angle end points of the input method area, the input method area is determined in the finger touch area, the input method part of the virtual keyboard is arranged in the input method area, and the function part of the virtual keyboard is arranged in the function area outside the input method area in the finger touch area.
In addition, the size of the corresponding response area of each key of the input method part in the input method area and the size and the position of the corresponding response area of each function key of the function part in the function area can be adjusted in real time, the adjustment basis of the input method part can be at least one of the key speed, the key heat and the click probability of each key, and the adjustment basis of the function part can be the current input scene, the on-screen text and the like.
The method provided by the embodiment of the invention determines the finger reachable area under the single-hand operation of the user based on the finger sliding track, realizes the acquisition of the personalized finger reachable area, and can completely meet the single-hand operation habit of the user. The virtual keyboard is arranged in the finger-reachable area, so that a user can touch all keys in the virtual keyboard during single-hand operation, the input efficiency of the single-hand operation is improved, and the input experience of the single-hand operation is optimized.
Based on any of the above embodiments, fig. 9 is a schematic structural diagram of a keyboard layout apparatus according to an embodiment of the present invention, as shown in fig. 9, the apparatus includes a track determining unit 910, an area determining unit 920, and a keyboard layout unit 930;
the track determining unit 910 is configured to determine a finger sliding track under one-handed operation of a user;
the region determining unit 920 is configured to determine a finger reachable region under the single-handed operation of the user based on the finger sliding trajectory;
the keyboard layout unit 930 is configured to lay out a virtual keyboard within the finger-reachable area.
The device provided by the embodiment of the invention determines the finger reachable area under the single-hand operation of the user based on the finger sliding track, realizes the acquisition of the personalized finger reachable area, and can completely meet the single-hand operation habit of the user. The virtual keyboard is arranged in the finger-reachable area, so that a user can touch all keys in the virtual keyboard during single-hand operation, the input efficiency of the single-hand operation is improved, and the input experience of the single-hand operation is optimized.
In any of the above embodiments, the keyboard layout unit 930 in the apparatus includes:
the input method layout subunit is used for laying the input method part of the virtual keyboard in an input method area;
the function layout subunit is used for arranging the function part of the virtual keyboard in a function area;
wherein the input method region and the functional region constitute the finger-reachable region.
Based on any embodiment, the device further comprises an input method area determining unit; the input method area determination unit specifically includes:
determining a finger rotation center and a finger length based on the finger sliding track;
determining an input method area endpoint on the finger sliding track based on the finger rotation center, the finger length and a preset finger inclination angle;
determining the input method region in the finger-reachable region based on the input method region end points and the finger rotation center.
Based on any one of the above embodiments, the apparatus further comprises an input method adjusting unit; the input method adjusting unit is used for:
adjusting the size of a corresponding response area of each key in the input method part in the input method area based on the key information of the user; the user key information includes at least one of a key speed, a key heat and a click probability of each key.
Based on any one of the above embodiments, in the apparatus, the input method adjustment unit is specifically configured to:
determining a weight of each key in the input method part based on the user key information;
and determining the size of a corresponding response area of each key in the input method area based on the weight of each key and the size of the input method area.
Based on any embodiment above, the apparatus further comprises a function adjusting unit; the function adjusting unit is configured to:
based on the current input information, adjusting the corresponding response area of each function key in the function part in the function area; the current input information includes a current input scene and/or current on-screen text.
Based on any one of the above embodiments, in the apparatus, the function adjusting unit is specifically configured to:
determining a function recommendation weight of each function key in the function part corresponding to the current input information;
and adjusting the size and/or the sequence of the corresponding response area of each function key in the function area based on the function recommendation weight of each function key.
Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 10, the electronic device may include: a processor (processor)1010, a communication Interface (Communications Interface)1020, a memory (memory)1030, and a communication bus 1040, wherein the processor 1010, the communication Interface 1020, and the memory 1030 communicate with each other via the communication bus 1040. Processor 1010 may call logic instructions in memory 1030 to perform the following method: determining a finger sliding track under the single-hand operation of a user; determining a finger reachable area under the single-hand operation of the user based on the finger sliding track; a virtual keyboard is disposed within the finger-reachable region.
Furthermore, the logic instructions in the memory 1030 can be implemented in software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Embodiments of the present invention further provide a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented to perform the method provided in the foregoing embodiments when executed by a processor, and the method includes: determining a finger sliding track under the single-hand operation of a user; determining a finger reachable area under the single-hand operation of the user based on the finger sliding track; a virtual keyboard is disposed within the finger-reachable region.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A keyboard layout method, comprising:
determining a finger sliding track under the single-hand operation of a user;
determining a finger reachable area under the single-hand operation of the user based on the finger sliding track;
a virtual keyboard is disposed within the finger-reachable region.
2. The keyboard layout method according to claim 1, wherein the arranging the virtual keyboard in the finger-reachable area specifically comprises:
arranging the input method part of the virtual keyboard in an input method area;
arranging a functional part of the virtual keyboard in a functional area;
wherein the input method region and the functional region constitute the finger-reachable region.
3. The keyboard layout method of claim 2, wherein the arranging the input method portion of the virtual keyboard in the input method area further comprises:
determining a finger rotation center and a finger length based on the finger sliding track;
determining an input method area endpoint on the finger sliding track based on the finger rotation center, the finger length and a preset finger inclination angle;
determining the input method region in the finger-reachable region based on the input method region end points and the finger rotation center.
4. The keyboard layout method according to claim 2, wherein the arranging the input method portion of the virtual keyboard in the input method area further comprises:
adjusting the size of a corresponding response area of each key in the input method part in the input method area based on the key information of the user; the user key information includes at least one of a key speed, a key heat and a click probability of each key.
5. The keyboard layout method according to claim 4, wherein the adjusting, based on the user key information, the size of the response area corresponding to each key in the input method section in the input method area specifically includes:
determining a weight of each key in the input method part based on the user key information;
and determining the size of a corresponding response area of each key in the input method area based on the weight of each key and the size of the input method area.
6. The keyboard layout method according to claim 2, wherein the arranging the functional part of the virtual keyboard in the functional area further comprises:
based on the current input information, adjusting the corresponding response area of each function key in the function part in the function area; the current input information includes a current input scene and/or current on-screen text.
7. The keyboard layout method according to claim 6, wherein the adjusting, based on the current input information, the corresponding response area of each function key in the function section in the function area specifically comprises:
determining a function recommendation weight of each function key in the function part corresponding to the current input information;
and adjusting the size and/or the sequence of the corresponding response area of each function key in the function area based on the function recommendation weight of each function key.
8. A keyboard layout device, comprising:
the track determining unit is used for determining a finger sliding track under the single-hand operation of a user;
the area determining unit is used for determining a finger reachable area under the single-hand operation of the user based on the finger sliding track;
a keyboard layout unit for laying a virtual keyboard within the finger-reachable area.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor, when executing the program, implements the steps of the keyboard layout method according to any of claims 1 to 7.
10. A non-transitory computer readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the keyboard layout method according to any one of claims 1 to 7.
CN201911215036.0A 2019-12-02 2019-12-02 Keyboard layout method and device, electronic equipment and storage medium Pending CN111026322A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911215036.0A CN111026322A (en) 2019-12-02 2019-12-02 Keyboard layout method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911215036.0A CN111026322A (en) 2019-12-02 2019-12-02 Keyboard layout method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN111026322A true CN111026322A (en) 2020-04-17

Family

ID=70203873

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911215036.0A Pending CN111026322A (en) 2019-12-02 2019-12-02 Keyboard layout method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111026322A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112000272A (en) * 2020-08-25 2020-11-27 北京百度网讯科技有限公司 Keyboard panel layout adjusting method and device, electronic equipment and storage medium
CN114063876A (en) * 2021-09-30 2022-02-18 北京搜狗科技发展有限公司 Virtual keyboard setting method, device and storage medium
CN114090158A (en) * 2021-11-22 2022-02-25 北京百度网讯科技有限公司 Display method, display device, electronic apparatus, and medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102203715A (en) * 2011-05-23 2011-09-28 华为终端有限公司 An input method, an input device and a terminal device
CN104007906A (en) * 2013-02-26 2014-08-27 三星电子株式会社 Character input method based on size adjustment of predicted input key and related electronic device
CN104182163A (en) * 2013-05-27 2014-12-03 华为技术有限公司 Method and device for displaying virtual keyboard
CN106648398A (en) * 2015-11-03 2017-05-10 重庆邮电大学 Display control method and device
CN106951174A (en) * 2017-03-22 2017-07-14 维沃移动通信有限公司 The method of adjustment and mobile terminal of a kind of dummy keyboard
CN107728921A (en) * 2017-09-29 2018-02-23 努比亚技术有限公司 Interface content intelligent display method, mobile terminal and computer-readable recording medium
CN108536501A (en) * 2018-02-08 2018-09-14 北京百度网讯科技有限公司 A kind of input interface response layout generation method, device and server
CN110248027A (en) * 2019-06-21 2019-09-17 广东虹勤通讯技术有限公司 A kind of method and system improving handheld terminal one-handed performance convenience

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102203715A (en) * 2011-05-23 2011-09-28 华为终端有限公司 An input method, an input device and a terminal device
CN104007906A (en) * 2013-02-26 2014-08-27 三星电子株式会社 Character input method based on size adjustment of predicted input key and related electronic device
CN104182163A (en) * 2013-05-27 2014-12-03 华为技术有限公司 Method and device for displaying virtual keyboard
CN106648398A (en) * 2015-11-03 2017-05-10 重庆邮电大学 Display control method and device
CN106951174A (en) * 2017-03-22 2017-07-14 维沃移动通信有限公司 The method of adjustment and mobile terminal of a kind of dummy keyboard
CN107728921A (en) * 2017-09-29 2018-02-23 努比亚技术有限公司 Interface content intelligent display method, mobile terminal and computer-readable recording medium
CN108536501A (en) * 2018-02-08 2018-09-14 北京百度网讯科技有限公司 A kind of input interface response layout generation method, device and server
CN110248027A (en) * 2019-06-21 2019-09-17 广东虹勤通讯技术有限公司 A kind of method and system improving handheld terminal one-handed performance convenience

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112000272A (en) * 2020-08-25 2020-11-27 北京百度网讯科技有限公司 Keyboard panel layout adjusting method and device, electronic equipment and storage medium
CN112000272B (en) * 2020-08-25 2022-05-06 北京百度网讯科技有限公司 Keyboard panel layout adjusting method and device, electronic equipment and storage medium
CN114063876A (en) * 2021-09-30 2022-02-18 北京搜狗科技发展有限公司 Virtual keyboard setting method, device and storage medium
WO2023051119A1 (en) * 2021-09-30 2023-04-06 北京搜狗科技发展有限公司 Virtual keyboard setting method and apparatus, storage medium, and computer program product
CN114090158A (en) * 2021-11-22 2022-02-25 北京百度网讯科技有限公司 Display method, display device, electronic apparatus, and medium
CN114090158B (en) * 2021-11-22 2024-04-02 北京百度网讯科技有限公司 Display method, display device, electronic equipment and medium

Similar Documents

Publication Publication Date Title
US10795574B2 (en) Input method, input apparatus, and terminal device
Grussenmeyer et al. Accessible touchscreen technology for people with visual impairments: a survey
US9256366B2 (en) Systems and methods for touch-based two-stage text input
Nesbat A system for fast, full-text entry for small electronic devices
US8754861B2 (en) Touch-screen keyboard facilitating touch typing with minimal finger movement
US20240143165A1 (en) Content control system
CN111026322A (en) Keyboard layout method and device, electronic equipment and storage medium
US8493346B2 (en) Morphing touchscreen keyboard interface
US20140006995A1 (en) Method for touch input and device therefore
WO2013189290A1 (en) Touch screen keyboard and input method thereof
US20160148409A1 (en) Accessibility techniques for presentation of symbolic expressions
CN103473003A (en) Character input error correction method and device
Billah et al. Accessible gesture typing for non-visual text entry on smartphones
Alajarmeh Non-visual access to mobile devices: A survey of touchscreen accessibility for users who are visually impaired
CN103605642A (en) Automatic error correcting method and system for text input
CN105260113B (en) Slide input method, device and terminal device
CN108491152B (en) Touch screen terminal control method, terminal and medium based on virtual cursor
EP2821901A1 (en) Method and apparatus for processing keyboard input
KR101454578B1 (en) Method for inputting characters using software korean keypad
CN107132927A (en) Input recognition methods and device and the device for identified input character of character
TW201833732A (en) Direction-based text input method, system and computer-readable recording medium using the same
US11204662B2 (en) Input device with touch sensitive surface that assigns an action to an object located thereon
CN110764647A (en) Input error correction method, input error correction device, electronic equipment and storage medium
CN112463014B (en) Input panel display method, related equipment and readable storage medium
US20200264768A1 (en) Method for providing a code input interface to a user in a screen interactive device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200417

RJ01 Rejection of invention patent application after publication