CN113760165B - Interface data processing method and device and computer readable storage medium - Google Patents

Interface data processing method and device and computer readable storage medium Download PDF

Info

Publication number
CN113760165B
CN113760165B CN202010508159.XA CN202010508159A CN113760165B CN 113760165 B CN113760165 B CN 113760165B CN 202010508159 A CN202010508159 A CN 202010508159A CN 113760165 B CN113760165 B CN 113760165B
Authority
CN
China
Prior art keywords
keyboard
virtual keyboard
display state
height
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010508159.XA
Other languages
Chinese (zh)
Other versions
CN113760165A (en
Inventor
魏先宇
夏胜飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202010508159.XA priority Critical patent/CN113760165B/en
Publication of CN113760165A publication Critical patent/CN113760165A/en
Application granted granted Critical
Publication of CN113760165B publication Critical patent/CN113760165B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses an interface data processing method, a device and a computer readable storage medium, wherein the method comprises the following steps: displaying a virtual keyboard; responding to triggering operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from the current first display state to a second display state indicated by user operation behavior data; the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes. By adopting the method and the device, the data input efficiency when the virtual keyboard is used for inputting the data can be improved, and the power consumption of the equipment can be reduced.

Description

Interface data processing method and device and computer readable storage medium
Technical Field
The present application relates to the field of data processing technologies, and in particular, to an interface data processing method and apparatus, and a computer readable storage medium.
Background
An application program may typically invoke a virtual keyboard that is used by a user to enter data into a mobile application. For example, the mobile application may be a communication application, in which a virtual keyboard is required to enter the content of a message when sending the message to other users.
In the prior art, when the virtual keyboard is used for inputting data, the data can be selected from the virtual keyboard for inputting, for example, expression data displayed in the virtual keyboard is selected for inputting. When the expression data displayed in the virtual keyboard is selected for recording, if the user needs to browse more expression data displayed in the virtual keyboard, the user is required to continuously slide the virtual keyboard, page changing and viewing are performed on the expression data displayed in the virtual keyboard, so that the efficiency of recording data through the virtual keyboard is low, and in addition, the virtual keyboard is frequently operated for viewing a certain expression data, so that the power consumption of the equipment is increased. The frequently operating the virtual keyboard may mean that operations such as changing pages are frequently performed on expression data in the virtual keyboard.
Disclosure of Invention
The application provides an interface data processing method, an interface data processing device and a computer readable storage medium, which can improve data input efficiency when a virtual keyboard is used for inputting data and reduce equipment power consumption.
In one aspect, the present application provides an interface data processing method, including:
Displaying a virtual keyboard;
Responding to triggering operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard;
displaying the virtual keyboard from the current first display state to a second display state indicated by user operation behavior data;
The virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
In one aspect, the present application provides an interface data processing apparatus, including:
the display module is used for displaying the virtual keyboard;
the telescopic response module is used for responding to the triggering operation aiming at the virtual keyboard and acquiring the user operation behavior data aiming at the virtual keyboard;
the state switching module is used for displaying the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data;
The virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
Wherein the triggering operation includes a moving operation;
A state switching module comprising:
A data determining unit for determining a moving direction and a moving distance of the moving operation according to the user operation behavior data;
the target height determining unit is used for determining the keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the moving distance and the moving direction indicated by the first display state, and determining the keyboard height in the second display state as the target keyboard height;
And the first switching display unit is used for displaying the virtual keyboard from the initial keyboard height to the target keyboard height.
The user operation behavior data comprise a moving track corresponding to the moving operation; the moving direction includes upward movement and downward movement;
a data determination unit comprising:
a position determining subunit for determining a movement start position and a movement end position of the movement operation according to the movement track;
A distance determining subunit, configured to determine a movement distance according to the movement start position and the movement end position;
a first direction determining sub-unit for determining that the moving direction is upward movement when the vertical height of the movement start position is smaller than the vertical height of the movement end position;
a second direction determining sub-unit for determining that the moving direction is moved downward when the vertical height of the movement start position is greater than the vertical height of the movement end position;
Then, the target height determining unit includes:
The change height determining subunit is used for determining a height adjustment value of the virtual keyboard according to the moving distance and the moving proportion coefficient;
a first height determining subunit, configured to determine, when the moving direction is upward movement, a sum of the initial keyboard height and the height adjustment value as a keyboard height of the virtual keyboard in the second display state;
and a second height determining subunit for determining a difference between the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state when the movement direction is downward movement.
Wherein the triggering operation includes a moving operation;
The method further comprises the following steps:
The first acceleration acquisition module is used for acquiring the acceleration of the mobile operation in the vertical direction according to the operation behavior data of the user;
The first acceleration judging module is used for executing the display of the virtual keyboard from the current first display state to the second display state indicated by the user operation behavior data if the acceleration of the mobile operation in the vertical direction is greater than or equal to a first acceleration threshold value;
and the second acceleration judging module is used for keeping the virtual keyboard to display in the first display state if the acceleration of the moving operation in the vertical direction is smaller than the first acceleration threshold value.
Wherein the triggering operation includes a moving operation;
The method further comprises the following steps:
The second acceleration acquisition module is used for acquiring the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction according to the user operation behavior data;
A third acceleration acquisition module for determining an acceleration reference value according to the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction;
The third acceleration judging module is used for executing the display of the virtual keyboard from the current first display state to the second display state indicated by the user operation behavior data if the acceleration of the mobile operation in the vertical direction is larger than the acceleration of the mobile operation in the horizontal direction and the acceleration reference value is larger than or equal to the second acceleration threshold value;
And the fourth acceleration judging module is used for keeping the virtual keyboard to display in the first display state if the acceleration of the moving operation in the vertical direction is smaller than the acceleration of the moving operation in the horizontal direction or the acceleration reference value is smaller than the second acceleration threshold value.
Wherein, display module still is used for:
responding to comment operation aiming at comment data in a comment page, and displaying a virtual keyboard and a comment quotation page containing the comment data; the virtual keyboard and comment data in the comment quotation page are not overlapped with each other;
Wherein the comment reference page is a sub-page that is displayed independently above the comment page.
Wherein, flexible response module includes:
The control component acquisition unit is used for responding to the triggering operation aiming at the virtual keyboard and acquiring a page view control component of the comment quotation page; the page view control component is a control component in an application program where the comment quotes a page;
and the permission judging unit is used for acquiring user operation behavior data aiming at the virtual keyboard when detecting that the application program has keyboard state switching permission aiming at the virtual keyboard according to the page view control component.
Wherein, the method further comprises the following steps:
The keyboard determining module is used for determining the virtual keyboard in the second display state as a target virtual keyboard;
the page position determining module is used for determining the self-adaptive page position of the comment reference page above the comment page based on the position relation between the comment data in the comment reference page and the target virtual keyboard and the page view control component;
The page position adjusting module is used for adjusting the page position of the comment reference page to the self-adaptive page position; the target virtual keyboard and comment data in the comment reference page after position adjustment are not overlapped with each other.
Wherein, the state switching module includes:
the data synchronization unit is used for synchronizing the user operation behavior data to the page view control component based on the virtual keyboard;
The first parameter generation unit is used for generating a first state change parameter corresponding to the user operation behavior data based on the page view control component;
and the second switching display unit is used for controlling the virtual keyboard to be displayed as a second display state indicated by the first state change parameter by the first display state based on the page view control component.
The first display state comprises an original display state and an expanded display state;
A state switching module comprising:
The second parameter generating unit is used for determining the height of the adjusting keyboard corresponding to the virtual keyboard according to the operation behavior data of the user; the height of the keyboard is adjusted to be the height of the extended keyboard or the original keyboard;
the third switching display unit is used for determining the height of the expansion keyboard as the height of the keyboard in the second display state when the first display state is the original display state and the height of the adjustment keyboard is the height of the expansion keyboard, and displaying the virtual keyboard as the height of the expansion keyboard from the original keyboard in the original display state;
And the fourth switching display unit is used for determining the original keyboard height as the keyboard height in the second display state when the first display state is the expansion display state and the adjusted keyboard height is the original keyboard height, and displaying the virtual keyboard as the original keyboard height from the expansion keyboard height in the expansion display state.
The virtual keyboard comprises a data selection area; the data selection area in the first display state has a first area size; the data selection area in the second display state has a second area size;
The state switching module is specifically configured to:
displaying the virtual keyboard from the first display state to the second display state, displaying the data selection area from the first area size to the second area size, and carrying out rearrangement display on the data to be selected in the data selection area with the second area size.
The triggering operation comprises a voice control operation; the user operation behavior data comprise voice audio data corresponding to voice control operation;
A state switching module comprising:
the voice recognition unit is used for carrying out voice recognition on the voice audio data to obtain a second state change parameter aiming at the virtual keyboard;
and the fifth switching display unit is used for displaying the virtual keyboard from the first display state to the second display state indicated by the second state change parameter.
In one aspect the application provides a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the method of one aspect of the application.
An aspect of the present application provides a computer readable storage medium storing a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of the above aspect.
Firstly, displaying a virtual keyboard; responding to triggering operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from the current first display state to a second display state indicated by user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch and retract the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data input efficiency of the user when inputting the data through the input keyboard is improved. In addition, because more data can be displayed in the virtual keyboard which stretches out and draws back for the user to check, the user can quickly find the required data in the virtual keyboard which stretches out and draws back without frequently operating the virtual keyboard to find the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequently operating the virtual keyboard may refer to frequently changing pages and viewing data in the virtual keyboard.
Drawings
In order to more clearly illustrate the application or the technical solutions of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it being obvious that the drawings in the description below are only some embodiments of the application, and that other drawings can be obtained from them without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a system architecture according to the present application;
Fig. 2a is a schematic page diagram of a terminal device according to the present application;
Fig. 2b is a schematic page diagram of a terminal device according to the present application;
FIG. 3 is a schematic flow chart of an interface data processing method provided by the application;
Fig. 4 is a schematic view of a scene of a state change of a keyboard expansion display provided by the application;
fig. 5a is a schematic view of a scene of keyboard expansion and contraction provided by the application;
fig. 5b is a schematic view of a scene of keyboard expansion and contraction provided by the application;
Fig. 6 is a schematic view of a scene of keyboard expansion and contraction provided by the application;
fig. 7 is a schematic view of a scene of keyboard expansion and contraction provided by the application;
FIG. 8 is a schematic flow chart of a keyboard expansion method provided by the application;
FIG. 9 is a schematic diagram of an interface data processing device according to the present application;
fig. 10 is a schematic structural diagram of a computer device according to the present application.
Detailed Description
The following description of the embodiments of the present application will be made more apparent and fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the application are shown. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture according to the present application. As shown in fig. 1, the system architecture diagram may include a plurality of terminal devices including a terminal device 200a, a terminal device 200b, and a terminal device 200c, and a server 100. Wherein the terminal device 200a, the terminal device 200b, and the terminal device 200c are all capable of communicating with the server 100. The terminal device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a Mobile Internet Device (MID), a virtual device or a wearable device (e.g. a smart watch, a smart bracelet, etc.), etc. The description of the present application is made here by taking the communication between the terminal device 200a and the server 100 as an example, please refer to the following procedure.
Referring to fig. 2a, fig. 2a is a schematic page diagram of a terminal device according to the present application. As shown in fig. 2a, the terminal page 100a is a terminal page in the terminal device 200a, and the terminal page 100a includes a dynamic 111a issued by the user, where the dynamic 111a is a picture. Also included in terminal page 100a is comment sub-page 110a for that dynamic 111 a. As can be seen by the terminal page 100a, the comment sub-page 110a may be a sub-page that is displayed independently over the page in which the dynamic 111a is located, and thus, it can be appreciated that in the terminal page 100a, the comment sub-page 110a obscures the page in which the dynamic 111a is located. Comment sub-page 110a includes user 'happy' comment "how to get up" for dynamic 111a, and user 'daily' comment 101a for dynamic 111 a. Comment 101a is "o ha, my small rocket has not been found". Assuming that the user holding the terminal device is the target user, the comment sub-page 110a may be displayed by the terminal device 200a after responding to the comment operation of the target user for comment "o ha, my small rocket has not been. It can be appreciated that all comments for the dynamic 111a are also displayed in the page where the dynamic 111a is located, including the comments "how pyridazine" and the comments "how ha, my small rocket are not" in the comment sub-page 110a, and thus, the comment operation is an operation of "how ha, my small rocket is not" for the comments "by the target user in the page where the dynamic 111a is located.
After responding to the comment operation of the target user for comment "ha, my small rocket is not available", the terminal device 200a may display not only the comment sub-page 110a, but also an input keyboard 102a, where the input keyboard 102a is used to support the target user to input the comment content of "ha, my small rocket is not available". Since the comment sub-page 110a is displayed after the terminal device 200a responds to the comment "o ha, my small rocket has not been" by the target user, the comment "o ha, my small rocket has not been" may be regarded as the focus content that is the focus of the target user, where the focus content refers to the content that the target user may possibly focus. Therefore, when the comment sub page 110a is displayed, the comment 101a is always displayed above the input keyboard 102a, so that the input keyboard 102a does not block the comment 101a, and further, when the user inputs comment content through the input keyboard 102a, the user can always view the comment 101a.
More, the input keyboard 102a includes a data selection area 103a, the data selection area 103a includes a plurality of emoticons, the target user is supported to browse the emoticons in the data selection area 103a, and one or more emoticons are selected as comment contents for comment "acha, my small rocket is not available". The terminal device 200a can acquire the acceleration of the upward sliding operation in the vertical direction in response to the upward sliding operation of the target user in the data selection area 103a, and when the acceleration is greater than a certain threshold (which can be set by itself), the keyboard height of the input keyboard 102a can be increased. The raising of the keyboard height of the input keyboard 102a may specifically refer to raising the area height of the data selection area 103a in the input keyboard 102 a. Here, the area height of the data selection area 103a may be increased by a fixed height, which may be set by itself, for example, a page height required for displaying two lines of emoticons. After increasing the keyboard height of the input keyboard 102a, the terminal apparatus 200a may display the terminal page 104a.
The terminal page 104a includes an input keyboard 106a obtained by raising the keyboard height of the input keyboard 102a, and a data selection area 105a obtained by raising the area height of the data selection area 103a in the input keyboard 106 a. As shown in the terminal page 104a, by increasing the area height of the data selection area 102a, more emoticons can be displayed in the resulting data selection area 105a for viewing and selection by the target user. It should be understood that the input keyboard 102a and the input keyboard 106a are the same input keyboard, but the input keyboard 102a and the input keyboard 106a have different keyboard heights.
As shown in the terminal page 104a, when the keyboard height of the input keyboard 102a is increased and the input keyboard 106a is displayed, the page position of the comment sub-page 110a in the terminal page is correspondingly adjusted. The comment sub page 112a displayed in the terminal page 104a is a sub page obtained after adjusting the page position of the comment sub page 110 a. It will be appreciated that comment sub-page 110a and comment sub-page 112a are also the same comment sub-page, but have different page positions. The criteria for adjusting the page position of the comment sub page 110a is to cause the focal content (i.e., the comment 101 a) in the comment sub page 112a to be displayed above the input keyboard 106a, that is, to cause the comment 101a to be unobstructed by the input keyboard 106 a.
The data selection area 103a and the data selection area 105a may be collectively referred to as a data selection area, and the input keyboard 102a and the input keyboard 106a may be collectively referred to as an input keyboard. When the target user selects an emoticon as comment contents of "ha, my small rocket has no" in the data selection area, the selected emoticon is displayed in the input box 115a in the input keyboard. The terminal device 200a may respond to the click operation of the target user on the "send" button in the input keyboard, and send the comment content that is input by the target user in the input box 115a to the server 100, so that the server 100 may synchronize the comment content that is input by the target user in the input box 115a to other terminal devices that can view the user of the dynamic 111a, so that the user of the dynamic 111a can be viewed, and all comments for the dynamic 111a and comments for the comments can also be viewed. The comment content entered by the target user in the input box 115a may include an emoticon selected by the target user in the data selection area.
Referring to fig. 2b, fig. 2b is a schematic page diagram of a terminal device according to the present application. As shown in fig. 2b, the terminal page 104a is the terminal page 104a in fig. 2a described above. The terminal device 200a may also respond to the downward sliding operation of the target user in the data selection area 105a of the terminal page 104a, and obtain the sliding acceleration of the downward sliding operation, if the acceleration is greater than a certain threshold, the threshold may be set by itself, and the area height of the data selection area 105a may be restored to the area height of the data selection area 103a, so as to obtain the data selection area 109a in the terminal page 107a, and at the same time, the page position of the comment sub page 112a may be restored to the page position of the comment sub page 110a, so as to obtain the comment sub page 113a in the terminal page 107a. In other words, the terminal apparatus 200a can display the terminal page 107a in response to the downward sliding operation of the target user in the data selection area 105a of the terminal page 104a.
By the method provided by the application, the input keyboard can be expanded and contracted according to the operation of the user, namely, the input keyboard can be enlarged or contracted according to the operation of the user. When the input keyboard is enlarged, the content displayed in the data selection area of the input keyboard is increased, so that a user can browse more content displayed in the data selection area at one time, the browsing efficiency of the user for the content displayed in the data selection area can be improved, the selecting efficiency of the user for the content displayed in the data selection area is improved, and the comment efficiency of the user for comment data by using the input keyboard is improved.
Referring to fig. 3, fig. 3 is a flow chart of an interface data processing method provided by the present application, and as shown in fig. 3, the method may include:
Step S101, displaying a virtual keyboard;
Specifically, the execution body in this embodiment may be any one terminal device. The virtual keyboard may be a keyboard component integrated in an application installed in the terminal device, or the virtual keyboard may be a keyboard application installed in the terminal device. The virtual keyboard may also be referred to as an input keyboard, which is a medium for a user to enter data into the terminal device.
The terminal device may display the virtual keyboard in response to a data entry operation by the user. The data input operation of the user may refer to comment operation of the user on a certain item in a certain application, for example, in communication application, dynamic comment operation issued by friends, or in takeaway software, comment operation on merchants, etc.; the data input operation of the user can also refer to the reply operation of the user to the instant messaging message of a certain friend, for example, in the chat page of the user of the communication application and the friend, the input operation of the user to the message sent to the friend by the user and the like. It will be appreciated that the user data entry operations described above are by way of example only, and in fact, the user data entry operations may be any operations that the user triggers to display a virtual keyboard. In other words, when the user wants to enter data in the terminal device, the terminal device may display the virtual keyboard in response to a related operation of the user, where the related operation of the user may refer to a click operation of the user with respect to the input box, or the like. Alternatively, the virtual keyboard shown here may also be a virtual keyboard that has been resized.
Step S102, responding to triggering operation for a virtual keyboard, and acquiring user operation behavior data for the virtual keyboard;
specifically, after the terminal device displays the virtual keyboard, the terminal device may respond to the triggering operation of the user on the virtual keyboard, and obtain the user operation behavior data of the user on the virtual keyboard. And, the current display state of the virtual keyboard may be referred to as a first display state. In other words, the first display state refers to a display state of the virtual keyboard before the terminal device responds to a triggering operation of the user on the virtual keyboard. The triggering operation for the virtual keyboard may refer to a movement operation of the user for the virtual keyboard, the movement operation may be a gesture sliding operation of the user in the virtual keyboard, and the movement operation may also be an eye gaze movement operation of the user for the virtual keyboard. More, the triggering operation for the virtual keyboard can also refer to the voice control operation of the user for the virtual keyboard. Or a keyboard expansion button may be further provided in the virtual keyboard, where the keyboard expansion button is used to change the keyboard size of the virtual keyboard, for example, the keyboard expansion button may be used to enlarge the keyboard size of the virtual keyboard or reduce the keyboard size of the virtual keyboard, so that, for triggering operation of the virtual keyboard, a click command of the user on the keyboard expansion button may be further indicated, and optionally, the click command may also be a long-press command or any other gesture operation command.
The display state of the virtual keyboard mainly refers to a state of a keyboard size displayed in a terminal page by the virtual keyboard, and the keyboard size can refer to a keyboard height of the virtual keyboard. Alternatively, in some scenarios, the keyboard size may also refer to the keyboard width size of the virtual keyboard, e.g., when the width of the terminal page displayed by the terminal device is large, the virtual keyboard may be displayed as a different keyboard width in the terminal page of the terminal device. Therefore, the first display state may refer to a display state when the size of the keyboard is minimum when the virtual keyboard is not expanded, and the first display state may also refer to a display state when the size of the keyboard is larger than the minimum size of the virtual keyboard after the expansion.
When the triggering operation for the virtual keyboard is the moving operation, the moving track corresponding to the moving operation may be included in the user operation behavior data acquired by the terminal device. For example, when the movement operation is a gesture sliding operation of the user in the virtual keyboard, the movement trajectory in the user operation behavior data may be a trajectory of the gesture sliding of the user in the virtual keyboard. For another example, when the movement operation is an eye gaze movement operation of the user with respect to the virtual keyboard, the movement locus in the user operation behavior data may be a movement locus of an eye gaze position of the user when the user gazes at the virtual keyboard.
More, when the triggering operation for the virtual keyboard is a voice control operation, the user operation behavior data acquired by the terminal device may be voice audio data recorded by the user, where the voice audio data is voice audio indicating how the virtual keyboard stretches and contracts by the user, that is, voice audio indicating how the virtual keyboard adjusts the size of the keyboard.
More, when the triggering operation for the virtual keyboard is the clicking operation for the keyboard telescopic button, the user operation behavior obtained by the terminal device may be the clicking times of the user for the keyboard telescopic button. Or when the triggering operation for the virtual keyboard is long-press operation for the keyboard telescopic button, the user operation behavior obtained by the terminal equipment can be long-time of the user for the keyboard telescopic button.
Step S103, displaying the virtual keyboard from the current first display state to a second display state indicated by user operation behavior data; the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes;
specifically, the terminal device may switch and display the virtual keyboard from the current first display state to the second display state indicated by the obtained user operation behavior data. When the triggering operation for the virtual keyboard is a mobile operation, the terminal device may acquire a movement track in the user operation behavior data, and the terminal device may also acquire a movement start position and a movement end position of the movement track.
If the movement operation is the gesture sliding operation, the track start point of the movement track may refer to a gesture position when the user starts to slide the virtual keyboard, and the track end point of the movement track may refer to a gesture position when the user stops to slide the virtual keyboard. In this case, the movement track is a gesture sliding track from the track start point to the track end point.
If the movement operation is the eye-gaze movement operation, the eye-gaze movement operation is triggered by a related instruction. For example, when the terminal device detects that the user blinks continuously 3 times (may be another number of times) within a threshold time (may be set by itself), the eye gaze movement operation may be triggered, and the gaze position of the user gazing at the virtual keyboard at this time may be used as the trajectory start point of the movement trajectory. Then, when the terminal device detects that the user blinks continuously for 3 times again within the threshold time, the terminal device can acquire the gazing position of the user gazing at the virtual keyboard at the moment as the track end point of the moving track. In this case, the moving track is the eye gaze track of the user from the track start point to the track end point.
The terminal device may acquire a movement start position and a movement end position included in the movement track. Specifically, the above-mentioned moving operation of the user with respect to the virtual keyboard may be a continuous operation, for example, continuously sliding from one position to another position in the virtual keyboard, without disengaging the virtual keyboard during the sliding. Thus, the terminal device can acquire several movement positions of the user during the execution of the movement operation in response to the movement operation of the user with respect to the virtual keyboard. For example, during a user performing a moving operation, the terminal device may acquire one moving position every 1 millisecond according to a time interval. Or the terminal device may acquire a moving position every 1 mm according to the distance interval. In other words, the terminal device may acquire a plurality of movement positions in the movement track, the plurality of movement positions being generated by one movement operation of the user with respect to the virtual keyboard.
Therefore, assuming that a moving position x is included among a plurality of moving positions of a moving trajectory acquired by the terminal device, when the moving position x is taken as a moving end position, a last moving position of the acquired moving position x can be taken as a moving start position. When the movement position x is taken as the movement start position, the next movement position of the acquired movement position x can be taken as the movement end position.
Therefore, it is understood that the terminal device, in response to a moving operation by the user, can acquire a plurality of moving positions, of which moving positions other than the last acquired moving position can be taken as a moving start position, and moving positions other than the first acquired moving position can be taken as a moving end position. The last acquired movement position is the movement start position of the current acquired movement position, and the next acquired movement position is the movement end position of the current acquired movement position. In other words, any two adjacent mobile positions among the plurality of mobile positions acquired by the terminal device can be used as a pair of a mobile start position and a mobile end position.
The terminal device may calculate, according to the movement start position and the movement end position, a movement distance of the user with respect to the virtual keyboard, where the movement distance may be a distance between the movement start position and the movement end position in a horizontal direction in the terminal page, or the movement distance may also be a distance between the movement start position and the movement end position in a vertical direction in the terminal page. The terminal device may also detect a movement direction of the movement operation, which includes upward movement and downward movement, based on the movement start position and the movement end position.
Wherein the terminal device can judge the moving direction of the moving operation by the magnitude relation between the height of the movement start position and the movement end position in the vertical direction. Wherein the height of the moving position in the vertical direction may be simply referred to as the vertical height. That is, the terminal device may detect a magnitude relation between the vertical height of the movement start position and the vertical height of the movement end position, and when the terminal device detects that the vertical height of the movement start position is greater than the vertical height of the movement end position, the terminal device may consider that the movement operation performed by the user is sliding downward in the virtual keyboard, and may determine that the movement direction is downward. When the terminal device detects that the vertical height of the movement start position is smaller than the vertical height of the movement end position, the movement operation performed by the user can be considered to slide upwards in the virtual keyboard, and the terminal device can determine that the movement direction is upward movement.
Alternatively, the terminal device may determine the movement direction of the movement operation by a positional relationship of the movement start position and the movement end position in the horizontal direction. When the terminal device detects that the movement start position is on the left side of the movement end position in the horizontal direction, the movement operation performed by the user can be considered to slide rightwards in the virtual keyboard, and the terminal device can take the upward movement as the movement direction. When the terminal device detects that the movement start position is on the right side of the movement end position in the horizontal direction, the movement operation performed by the user can be considered to slide leftwards in the virtual keyboard, and the terminal device can take the downward movement as the movement direction.
Then, the terminal device can calculate the keyboard height of the virtual keyboard in the second display state according to the obtained moving direction and moving distance between the moving starting position and the moving ending position and the initial keyboard height of the virtual keyboard. The initial keyboard height of the virtual keyboard refers to the keyboard height of the virtual keyboard in the first display state, in other words, the initial keyboard height of the virtual keyboard is the keyboard height indicated by the first display state of the virtual keyboard. The keyboard height of the virtual keyboard in the second display state may be referred to as the target keyboard height, and therefore, it is understood that the virtual keyboard is displayed from the first display state to the second display state, i.e., the virtual keyboard is displayed from the initial keyboard height to the target keyboard height herein.
The calculation process of the target keyboard height is specifically described below:
Specifically, the terminal device may obtain a movement scaling factor, and since the movement distance is an actual distance of the user moving in the virtual keyboard obtained through the movement operation, the movement scaling factor characterizes a proportional relationship between a height variation degree of the virtual keyboard and the movement distance. Thus, by the above-described movement distance and movement scaling factor, a height adjustment value for the virtual keyboard can be obtained, which characterizes the height at which the keyboard height of the virtual keyboard needs to be enlarged or reduced, in other words, the height of the virtual keyboard needs to be changed. For example, when the movement distance between the movement start position and the movement end position is 1cm, the height adjustment value of the virtual keyboard may be 2cm, and the movement proportionality coefficient is 2, which indicates that the keyboard height of the virtual keyboard needs to be increased by 2cm, or the keyboard height of the virtual keyboard needs to be reduced by 2 cm. The value of the motion scaling factor may be determined according to the actual application scenario, which is not limited.
When the movement direction between the movement start position and the movement end position is downward movement, the terminal device may subtract the height adjustment value from the initial keyboard height of the virtual keyboard to obtain a target keyboard height of the virtual keyboard, that is, when the movement direction is downward movement, the target keyboard height is a difference between the initial keyboard height and the height adjustment value. In this case, the first display state is a display state in which the keyboard height of the virtual keyboard has been increased, and the terminal device may readjust the keyboard height of the virtual keyboard in which the keyboard height has been increased by responding to a triggering operation of the user on the virtual keyboard.
When the movement direction between the movement start position and the movement end position is upward movement, the terminal device may use the initial keyboard height of the virtual keyboard to add the height adjustment value to obtain the target keyboard height of the virtual keyboard, that is, when the movement direction is upward movement, the target keyboard height is the sum of the initial keyboard height and the height adjustment value. In this case, the first display state is a display state in which the keyboard height of the virtual keyboard is not increased or is not increased to the maximum value, and the terminal device can increase the keyboard height of the current virtual keyboard by responding to the triggering operation of the user on the virtual keyboard.
The height adjustment value for the virtual keyboard is obtained through the movement proportionality coefficient, and the keyboard height of the virtual keyboard is adjusted to the target keyboard height through the height adjustment value. The highest keyboard height and the lowest keyboard height of the virtual keyboard can be set, and the terminal equipment can respond to the mobile operation of the user on the virtual keyboard and adjust the keyboard height of the virtual keyboard to any one of the highest keyboard height and the lowest keyboard height.
For example, when the moving operation is an operation in which the user slides up the virtual keyboard, the virtual keyboard may continuously become high in the form of an animation when the user slides up the virtual keyboard, and the keyboard height of the virtual keyboard also stops to become high when the user stops sliding up the virtual keyboard. Or when the moving operation is an operation in which the user slides down the virtual keyboard, the virtual keyboard may continuously go low in the form of an animation when the user slides down the virtual keyboard, and the keyboard height of the virtual keyboard also stops to go low when the user stops sliding down the virtual keyboard. In this case, it may be understood that the number of display states of the virtual keyboard may be several, where the number of display states corresponds to a number of virtual keyboards having different keyboard heights, and the first display state may be any one display state of the virtual keyboard, and the second display state may be a next display state of the first display state.
Referring to fig. 4, fig. 4 is a schematic view of a scene of a keyboard with a retractable display state change according to the present application. When the movement track of the user is the track from the position 100g to the position 101g, and the terminal device can acquire 6 movement positions in the movement track, where the 6 movement positions are positions in the movement track corresponding to the same trigger operation of the user on the virtual keyboard, in other words, the 6 movement positions can be 6 positions to which the user slides in the process of sliding up the virtual keyboard (the process of sliding up once). The 6 moving positions are a moving position L1, a moving position L2, a moving position L3, a moving position L4, a moving position L5, and a moving position L6, respectively. Wherein the moving position L1 is the above-mentioned position 100g, and the moving position L6 is the above-mentioned position 101g.
Assume that the vertical heights of the moving positions L1, L2, L3, L4, L5, and L6 in the vertical direction become gradually larger, that is, the moving trajectory of the positions 100g to 101g is the trajectory of the user making an upward slide in the virtual keyboard. First, when the user slides to the moving position L1, the display state T1 of the virtual keyboard at this time may be set as the first display state. When the user slides from the moving position L1 to the moving position L2, the keyboard height of the virtual keyboard can also be correspondingly increased, where the increased keyboard height of the virtual keyboard can be seen in the above-mentioned procedure, for example, in accordance with the moving distance and the moving proportionality coefficient. When the user slides from the moving position L1 to the moving position L2, the display state T2 of the virtual keyboard at this time may be set as the second display state, and thus the 1 st time of the virtual keyboard from the first display state to the second display state is completed.
Then, the display state T2 of the virtual keyboard at this time may be re-used as the first display state of the virtual keyboard, and when the user slides from the moving position L2 to the moving position L3, the keyboard height of the virtual keyboard may be correspondingly increased, and the display state T3 corresponding to the moving position L3 at this time may be used as the second display state of the virtual keyboard, so that the 2 nd time of the virtual keyboard from the first display state to the second display state is completed.
Then, the display state T3 at this time may be re-used as the first display state of the virtual keyboard, and when the user slides from the moving position L3 to the moving position L4, the keyboard height of the virtual keyboard may be correspondingly increased, and the display state T4 corresponding to the moving position L4 at this time may be used as the second display state of the virtual keyboard, so that the 3 rd time of displaying the virtual keyboard from the first display state to the second display state is completed.
Then, the display state T4 at this time may be re-used as the first display state of the virtual keyboard, and when the user slides from the moving position L4 to the moving position L5, the keyboard height of the virtual keyboard may be correspondingly increased, and the display state T5 corresponding to the moving position L5 at this time may be used as the second display state of the virtual keyboard, so that the 4 th time of displaying the virtual keyboard from the first display state to the second display state is completed.
Finally, the display state T5 at this time may be re-used as the first display state of the virtual keyboard, and when the user slides from the moving position L5 to the moving position L6, the keyboard height of the virtual keyboard may be correspondingly increased, and the display state T6 corresponding to the moving position L6 at this time may be used as the second display state of the virtual keyboard, so that the 5 th time of switching the virtual keyboard from the first display state to the second display state is completed.
From the above, the terminal device can respond to the movement operation of the user on the virtual keyboard to continuously increase the keyboard height of the virtual keyboard, and the virtual keyboard can be displayed from the first display state to the second display state for multiple times in the process.
Therefore, it can be understood that when the movement position L1 is taken as the movement start position, the movement end position is taken as the movement position L2; when the movement position L2 is taken as the movement start position, the movement end position is taken as the movement position L3; when the movement position L3 is taken as the movement start position, the movement end position is taken as the movement position L4; when the movement position L4 is taken as the movement start position, the movement end position is taken as the movement position L5; when the movement position L5 is taken as the movement start position, the movement end position is the movement position L6. In other words, between any two adjacent moving positions, a pair of a moving end position and a moving start position may be formed.
It is emphasized again that the above-described moving positions L1, L2, L3, L4, L5, and L6 are acquired during one continuous moving operation by the user. Therefore, if more than 2 moving positions in one moving track are obtained, the virtual keyboard is also subjected to multiple times of switching display from the first display state to the second display state in the process of executing the moving operation by the user to obtain the moving track corresponding to the moving operation, so that the purpose that the keyboard height of the virtual keyboard can continuously change along with the moving operation of the user on the virtual keyboard can be achieved.
Optionally, as long as the terminal device detects that the acceleration corresponding to two adjacent moving positions in a moving track meets the standard, the keyboard height of the virtual keyboard can be expanded and increased to a fixed height or reduced to a fixed height according to the moving direction.
In other words, since the user may continuously acquire a plurality of movement positions to which the movement operation of the callback is moved when performing the movement operation on the virtual keyboard, for example, the plurality of movement positions may be the above 6 movement positions. Therefore, as long as the acceleration between the pair of movement start position and movement end position satisfies the criterion when the terminal device detects that there is a plurality of movement positions, it is possible to raise the keyboard height of the virtual keyboard to a certain fixed keyboard height set by the system or to reduce the keyboard height of the virtual keyboard to a certain fixed keyboard height set by the system. The acceleration meets the standard, and whether the virtual keyboard is required to be displayed from the first display state to the second display state can be judged through the second acceleration and the first acceleration. And if the virtual keyboard is required to be displayed from the first display state to the second display state, indicating that the acceleration meets the standard. And if the virtual keyboard does not need to be displayed from the first display state to the second display state, indicating that the acceleration does not meet the standard. The virtual keyboard can be stretched and contracted without the need of a user to execute a moving operation, and the acceleration between two adjacent moving positions which are moved to meet the standard during the period of executing the moving operation by the user.
The virtual keyboard can comprise a data selection area, wherein the data selection area is an area for displaying data to be selected, and the data to be selected in the data selection area is data for a user to browse and select as input terminal equipment. Therefore, the above-mentioned increase of the keyboard height of the virtual keyboard may refer to increasing the area height of the data selection area of the virtual keyboard, and by increasing the area height of the data selection area, the keyboard height of the virtual keyboard may also be increased accordingly. Similarly, the keyboard height of the virtual keyboard, namely the area height of the data selection area of the virtual keyboard, is reduced, and the keyboard height of the virtual keyboard can be correspondingly reduced by reducing the area height of the data selection area.
For example, it may be understood that the area size of the data selection area included in the virtual keyboard in the first display state may be the first area size, and the area size of the data selection area included in the virtual keyboard in the second display state may be the second area size. Wherein the first region size and the second region size are different region sizes. In the process of displaying (either switching display or adjusting display) the virtual keyboard from the first display state to the second display state, correspondingly, the data selection area in the virtual keyboard is also displayed from the first area size to the second area size. In other words, the area size of the data selection area in the first display state is the first area size, and the area size of the data selection area in the second display state is the second area size. The first region size and the second region size may be sizes including different region heights.
When the first area size is smaller than the second area size, it may be indicated that the area height of the data selection area is increased, and after the area height of the data selection area is increased, the data to be selected in the data selection area is also subjected to rearrangement display, so that more data to be selected can be displayed in the data selection area with the increased area height for the user to browse and select.
Similarly, when the first area size is larger than the second area size, it may be indicated that the area height of the data selection area is reduced, and after the area height of the data selection area is reduced, the data to be selected in the data selection area is also subjected to rearrangement display, so that the data to be selected displayed in the data selection area with the reduced area height may be reduced.
The data to be selected in the data selecting area may be video data, document data, expression data, picture data, or sticker data. The rearrangement display of the data to be selected in the data selection area may mean that the data to be selected displayed in the data selection area before the area height is increased is kept unchanged, and other more data to be selected are displayed in the newly increased area in the data selection area after the area height is increased.
The terminal device can also calculate the acceleration of the user in the vertical direction and the acceleration in the horizontal direction of the movement operation of the virtual keyboard through the movement starting position and the movement ending position. For convenience of description, the acceleration of the movement operation in the vertical direction may be referred to as a first acceleration, and the acceleration of the movement operation in the horizontal direction may be referred to as a second acceleration. The terminal device can judge whether to switch the virtual keyboard from the first display state to the second display state according to the first acceleration.
Here, the first acceleration and the second acceleration refer to accelerations between the movement start position and the movement end position. The first acceleration may be calculated by a movement time from a movement start position to a movement end position and a vertical distance in a vertical direction between the movement start position and the movement end position when the user performs the movement operation. The above-described second acceleration may be calculated by a movement time from a movement start position to a movement end position and a horizontal distance in a horizontal direction between the movement start position and the movement end position when the user performs the movement operation.
The terminal device may determine whether the virtual keyboard needs to be displayed from the first display state to the second display state only by the first acceleration. Specifically, when the first acceleration is greater than the first acceleration threshold, the terminal device may display the virtual keyboard from the first display state to the second display state, for example, to adjust the initial keyboard height of the virtual keyboard to the target keyboard height as described above. Otherwise, when the first acceleration is smaller than or equal to the first acceleration threshold, the virtual keyboard can be kept in the first display state for display, that is, the virtual keyboard is not switched from the first display state to the second display state. The specific value of the first acceleration threshold value can be set according to the actual application scene, which is not limited.
The terminal device can also judge whether the virtual keyboard is required to be switched from the first display state to the second display state through the first acceleration and the second acceleration. Specifically, the terminal device may obtain the acceleration reference value through the second acceleration and the first acceleration. Wherein, the second acceleration is a 1, the first acceleration is a 2, and the acceleration reference value is a 3 The acceleration reference may be understood as a hypotenuse acceleration consisting of a first acceleration and a second acceleration, which hypotenuse acceleration may characterize the actual acceleration of the user when performing the triggering operation.
In other words, it is understood that the first acceleration, the second acceleration, and the acceleration reference may form a right triangle, the acceleration reference is a hypotenuse of the right triangle, and the first acceleration and the second acceleration are two right sides of the right triangle. When the second acceleration is greater than the first acceleration and the acceleration reference value is greater than or equal to the second acceleration threshold value, the virtual keyboard can be displayed from the first display state to the second display state. Conversely, when the second acceleration is smaller than the first acceleration or the acceleration reference value is smaller than the second acceleration threshold value, the virtual keyboard can be kept to be displayed in the first display state, that is, the virtual keyboard is not displayed in the second display state from the first display state. The second acceleration threshold may also be set according to the actual application scenario, which is not limited. For example, the second acceleration threshold may beNamely when/>The virtual keyboard may be displayed from the first display state to the second display state, where 320 and 820 may be in pixels/millisecond.
Alternatively, the display states of the virtual keyboard may include only two display states, one being an original display state and one being an extended display state. The original display state is a display state in which the keyboard height of the virtual keyboard is not increased, and generally, when the virtual keyboard is initially displayed in the terminal page, the display state may be the original display state. The extended display state is a display state after the keyboard height of the virtual keyboard is increased, and the extended display state is a display state when the keyboard height of the virtual keyboard is increased to a certain fixed keyboard height, wherein the fixed keyboard height can be a certain keyboard height set by a developer. Therefore, the first display state of the virtual keyboard may be an original display state or may be an extended display state.
When the terminal device determines the first acceleration and/or the second acceleration according to the user operation behavior data and meets the condition of displaying the virtual keyboard from the first display state to the second display state, the terminal device can acquire a keyboard adjustment height for the virtual keyboard, wherein the keyboard adjustment height is used for indicating whether the virtual keyboard is displayed in an original display state or in an expanded display state. The height of the keyboard is adjusted by two values, namely the height of the extended keyboard and the height of the original keyboard. The display state of the virtual keyboard at the height of the extended keyboard is the extended display state, and the display state of the virtual keyboard at the height of the original keyboard is the original display state.
If the terminal device obtains the movement direction aiming at the trigger operation according to the user operation behavior data to move downwards, which indicates that the user wants to reduce the keyboard height of the virtual keyboard, the keyboard adjustment height generated by the terminal device is the original keyboard height. If the terminal device obtains the moving direction aiming at the trigger operation according to the user operation behavior data, which is upward movement, and indicates that the user wants to increase the keyboard height of the virtual keyboard, the keyboard adjustment height generated by the terminal device is the expansion keyboard height.
Therefore, when the terminal device detects that the first display state of the virtual keyboard is the original display state and the keyboard adjustment height is the extended keyboard height, the terminal device can display the virtual keyboard from the original display state to the extended display state, that is, adjust the keyboard height of the virtual keyboard from the original keyboard height to the extended keyboard height.
When the terminal device detects that the first display state of the virtual keyboard is the extended display state and the keyboard adjustment height is the original keyboard height, the terminal device can display the virtual keyboard from the extended display state to the original display state, that is, adjust the keyboard height of the virtual keyboard from the extended keyboard height to the original keyboard height.
When the terminal device detects that the first display state of the virtual keyboard is the extended display state and the keyboard adjustment height is the extended keyboard height, the terminal device can keep the virtual keyboard in the extended display state unchanged, namely keep the keyboard height of the virtual keyboard unchanged.
When the terminal device detects that the first display state of the virtual keyboard is the original display state and the keyboard adjustment height is the original keyboard height, the terminal device can keep the virtual keyboard unchanged in the original display state, namely keep the keyboard height of the virtual keyboard unchanged in the original keyboard height.
Optionally, when the triggering operation for the virtual keyboard is a voice control operation, the user operation behavior data obtained by the terminal device may be voice audio data corresponding to the voice control operation. The terminal device may perform voice recognition on the voice audio data to obtain a second state change parameter for the virtual keyboard, where the second state change parameter is also a parameter for indicating how the virtual keyboard adjusts the height of the keyboard.
For example, when the terminal device recognizes that the voice content recorded by the user is "to raise the height of the keyboard by a little" by performing voice recognition on the voice audio data, the terminal device may obtain a unit change height for the virtual keyboard, where the unit change height may be a certain fixed height preset by the system, and the raising of the height of the keyboard may mean that the height of the keyboard of the virtual keyboard is raised by the unit change height. Therefore, the second state change parameter may be the unit change height, and the terminal device may increase the keyboard height of the virtual keyboard by the unit change height. The virtual keyboard with the unit change height not increased is in the first display state, and the virtual keyboard with the unit change height increased is in the second display state.
Optionally, when the triggering operation for the virtual keyboard is a clicking operation for a user for a keyboard expansion button in the virtual keyboard, the user operation behavior data obtained by the terminal device may be the number of times of clicking for the keyboard expansion button by the user. The user can increase or decrease the height of the keyboard of the virtual keyboard by one click (other times), and the terminal device can calculate the product of the number of clicks of the user on the telescopic button of the keyboard and the height of the unit change, as the height of the virtual keyboard required to be changed, for example, increase the height of the keyboard by 5 cm or decrease the height of the keyboard by 5 cm.
When the triggering operation for the virtual keyboard is long-time pressing operation for the keyboard telescopic button in the virtual keyboard by a user, the user operation behavior data acquired by the terminal equipment can be long-time for the keyboard telescopic button by the user. The user can increase or decrease the height of the keyboard of the virtual keyboard by 1 second (other unit time) each time, and the terminal device can calculate the product of the length of the user aiming at the keyboard expansion button and the height of the unit change, as the height of the virtual keyboard required to be changed, for example, increase the height of the keyboard by 5 cm or decrease the height of the keyboard by 5 cm.
Wherein, two keyboard expansion buttons can be provided in the virtual keyboard, one for increasing the keyboard height of the virtual keyboard and one for decreasing the keyboard height of the virtual keyboard. Or only one keyboard expansion button can be provided, when the clicking operation is performed on the keyboard expansion button, the keyboard height of the virtual keyboard can be increased, and when the long-pressing operation is performed on the keyboard expansion button, the keyboard height of the virtual keyboard can be reduced.
Fig. 5a is a schematic view of a keyboard expansion scene according to the present application. As shown in fig. 5a, the terminal page 100b is a chat page of the user with the user's flower on the day, the user's flower sent the message "up on the day", and the user's flower sent the message "learn well" on the day. The terminal device may display the virtual keyboard 109b in response to a message entry operation by the user from day to day. Then, the terminal device may display the terminal page 103b in response to the user's daily sliding operation for the data selection area 102b in the virtual keyboard 109b, where the sliding operation is the triggering operation for the virtual keyboard. As shown in the terminal page 103b, the terminal device increases the area height of the data selection area 102b by responding to the user's upward sliding operation with respect to the data selection area 102b, resulting in the data selection area 104b. 8 pictures are shown in the data selection area 102b, and the 8 pictures are the data to be selected in the data selection area 102 b. More data to be selected is shown in the data selection area 104b than in the data selection area 102b, and more 4 pictures are shown in the data selection area 104a in addition to 8 pictures in the data selection area 102 b.
Referring to fig. 5b, fig. 5b is a schematic view of a keyboard expansion scene provided by the present application. The terminal page 100b in fig. 5b is the terminal page 100b in fig. 5a, and the user may wake up the voice control function of the virtual keyboard by voice "hi keyboard", and the operation of waking up the voice control function may be referred to as the above voice control operation. The wake-up voice may be other voices, such as "back-off, keyboard" and the like. After waking up the voice control function of the virtual keyboard, the terminal device can acquire voice audio data recorded by the user, and after performing voice recognition on the voice audio data, the terminal device can recognize that the content "raise the keyboard by a bit" in the display frame 106 b. Then, the terminal device can raise the area height of the data selection area by the unit change height according to the content "raise the keyboard by a little", and display the terminal page 107b. As shown in the terminal page 107b, the data selecting area 108b is a data selecting area obtained by increasing the area height of the data selecting area 102b by a unit change height, where the unit change height may refer to the height of one row of data to be selected, that is, the height of one picture.
Further, the virtual keyboard displayed in the above step S101 may be displayed by the terminal device in response to the comment operation of the user on the comment data in the comment page, in which case, the terminal device may display not only the virtual keyboard but also a comment reference page including comment data of the user performing the comment operation, that is, comment data including comment data that the user wants to comment. The comment reference page can be a sub page which is independently displayed on the comment page, and the virtual keyboard displayed in the terminal page and comment data of comments desired by the user in the comment reference page are not overlapped with each other. In other words, the virtual keyboard displayed in the terminal page does not cause shielding to comment data of comments desired by the user in the comment reference page. For example, referring to fig. 2a, the page where the dynamic 111a in fig. 2a is located may be referred to as the comment page, the comment sub-page 110a may be referred to as the comment reference page, the comment 101a in the comment sub-page 110a is comment data that the user wants to comment, and the virtual keyboard 102a does not overlap with the comment data 101a in the comment sub-page 110 a.
Then, the terminal device may obtain a page view control component (UIViewController) of the comment reference page in response to a triggering operation of the user on the virtual keyboard. It should be noted that, each page may correspond to a page view control component, where the page view control component is allocated to an application program where each page is located. The comment reference page described above is the uppermost page displayed in the terminal device, i.e., the top page, and thus the page view control component of the comment reference page may be referred to as the top page view control component. It can be understood that the virtual keyboard and the comment reference page can be sub-objects in the top page, and the virtual keyboard can determine the keyboard state switching permission of the current virtual keyboard through the top page view control component, i.e. determine whether the virtual keyboard has the keyboard state switching permission.
The keyboard state switching authority can be realized by a developer through a keyboard expansion protocol written in an application program where an input keyboard is located. In other words, if the keyboard expansion protocol is written in the application program where the virtual keyboard is located, the top page view control component may determine that the virtual keyboard has the keyboard expansion authority according to the keyboard expansion protocol. Or the keyboard expansion right can also be set by a user, for example, the virtual keyboard can be a keyboard application, a keyboard expansion setting function can be provided in the terminal equipment, the user can trigger the setting function, so that the keyboard application can expand and contract in any terminal page, namely, the virtual keyboard has keyboard state switching right in any terminal page, and the top page view control component can detect the keyboard state switching right set by the user on the keyboard application.
When the terminal device detects that the virtual keyboard has the keyboard expansion right through the top page view control component, the terminal device can acquire the user operation behavior data aiming at the virtual keyboard and can switch and display the virtual keyboard from a first display state to a second display state indicated by the user operation behavior data. When the terminal device detects that the virtual keyboard does not have the keyboard expansion right through the top page view control component, the virtual keyboard cannot expand or contract, namely, the keyboard size of the virtual keyboard cannot be changed, the terminal device does not need to acquire the user operation behavior data, and in this case, the terminal device can enable the virtual keyboard to be in a first display state unchanged.
More, the virtual keyboard in the second display state may be referred to as a target virtual keyboard. The terminal equipment can acquire the position relation between comment data which the user wants to comment in the comment reference page and the target virtual keyboard through the top page view control component. The terminal equipment can obtain the self-adaptive page position of the comment reference page above the comment page through the position relation. By adjusting the page position of the comment citation page to the self-adaptive page position, the target virtual keyboard can not cause shielding, namely mutual non-overlapping, on comment data which users want to comment in the comment citation page. The method can also be that the page position of the top page where the comment quotation page is located in the terminal page is adjusted, so that the target virtual keyboard does not cause shielding to comment data of a comment which a user wants to comment in the comment quotation page. The positional relationship may be referred to as an overlapping positional relationship between the target virtual keyboard and comment data in the comment reference page that the user wants to comment. For example, referring to fig. 2a, the input keyboard 106a in the terminal page 104a of fig. 2a may be referred to as the target virtual keyboard. The comment sub page 112a in the terminal page 104a is a comment reference page adjusted to the self-adaptive page position, and the page position of the comment sub page 110a in the terminal page 100a is adjusted to the self-adaptive page position of the comment sub page 112a in the terminal page 104a, so that the target virtual keyboard obtained after the keyboard height of the input keyboard 102a is improved, and comment data 101a which a user wants to comment in the comment sub page 112a is not blocked, so that the user can conveniently view the comment data 101a.
Alternatively, when the user reviews the comment data in the comment page, the terminal device may display only the virtual keyboard on the comment page, instead of displaying the comment reference page. In this case, comment data that are commented by the user in the comment page are required to be displayed above the virtual keyboard, so that the virtual keyboard does not block the comment data that are commented by the user in the comment page. Similarly, when the keyboard height of the virtual keyboard is increased or reduced to obtain the target virtual keyboard, the data position of the data in the comment page in the terminal page needs to be correspondingly adjusted, so that comment data of a user in the comment page is displayed above the target virtual keyboard, that is, the target virtual keyboard cannot block the comment data of the user in the comment page. The adjusting the data position in the comment page may mean that if the keyboard height of the virtual keyboard is increased, it is equivalent to displaying all the data (including the comment data of the user) displayed in the comment page in a sliding manner, so that the position of the comment data of the user in the comment page in the whole terminal page is moved up, and the moved up height may be the same as the keyboard height increased by the virtual keyboard. Otherwise, if the keyboard height of the virtual keyboard is reduced, the data displayed in the comment page is displayed in a sliding manner, so that the position of comment data, which is commented by a user, in the comment page in the whole terminal page is moved downwards, and the moved-downwards height can be the same as the reduced keyboard height of the virtual keyboard.
More, the keyboard height of the virtual keyboard can be self-adjusted by the virtual keyboard, or the event that the virtual keyboard needs to adjust the keyboard height can be informed to the top page view control component and adjusted by the top page view control component. For example, the terminal device may synchronize the obtained user operation behavior data to the page view control component through the virtual keyboard. The page view control component may generate a first state change parameter corresponding to the user operation behavior data, where the first state change parameter is also a parameter for indicating how the keyboard size of the virtual keyboard changes, for example, the first state change parameter may be the second state change parameter or the third state change parameter. The page view control component may display the virtual keyboard from a first display state to a second display state of the virtual keyboard indicated by the first state change parameter. The first state change parameter generated by the page view control component may not be generated by user operation behavior data, but may be written into an application program where the virtual keyboard is located by a developer in advance, and the keyboard height of the virtual keyboard may be adjusted to a fixed height, for example, the keyboard height of the virtual keyboard may be adjusted to the original keyboard height indicated by the original display state, or the keyboard height of the virtual keyboard may be adjusted to the extended keyboard height indicated by the extended display state.
Referring to fig. 6, fig. 6 is a schematic view of a keyboard telescopic scene provided by the present application. As shown in fig. 6, when the user edits the personalized signature, the terminal device may also increase the keyboard height of the virtual keyboard in response to the user sliding up operation on the virtual keyboard. The terminal page 100c includes a data entry area 101c and a virtual keyboard 102c, and the personalized signature edited by the user in the data entry area 101c is "happy, but still keeps smiling/forgiveness me for a lifetime, and is free to love. The data to be selected displayed in the data selection area of the virtual keyboard 102c is a sticker, and the terminal device can respond to the upward sliding operation of the user on the virtual keyboard 102c, expand the keyboard height of the virtual keyboard 102c, and display the terminal page 103c. As shown in the terminal page 103c, the virtual keyboard 105c is a virtual keyboard obtained by increasing the keyboard height of the virtual keyboard 102a, and more stickers than the virtual keyboard 102c are displayed in the virtual keyboard 105 c. It should be noted that, virtual keyboard 102a and virtual keyboard 105c are actually the same virtual keyboard, but virtual keyboard 102a and virtual keyboard 105c are in different telescopic display states of the same virtual keyboard.
Referring to fig. 7, fig. 7 is a schematic view of a keyboard telescopic scene provided by the present application. As shown in fig. 7, the terminal page 100d may be a dynamic page of a friend of the user on the day, where the dynamic page 100d includes a dynamic 101d of the friend of the user on the day. The terminal device may display the virtual keyboard 105d in the terminal page, i.e., display the terminal page 104d, in response to the user's comment operation for the dynamic 101d from day to day. The comment operation of the user on the dynamic 101d on the day may refer to a click operation of the comment button 102d in the terminal page 100d on the day of the user, or a click operation of the input box 103d on the day of the user. The plurality of emoticons are displayed in the data selection area of the virtual keyboard 105d, and the terminal device 105d may raise the area height of the data selection area of the virtual keyboard 105d in response to the user's daily upward sliding operation with respect to the data selection area of the virtual keyboard 105d, and when the user stops the upward sliding operation in the data selection area, obtain the virtual keyboard 107d, that is, display the terminal page 106d. Virtual keyboard 107d displays more emoticons than virtual keyboard 105 d. Then, the terminal device may further continue to raise the area height of the data selection area of the virtual keyboard 107d in response to the user continuing to slide up the data selection area in the virtual keyboard 107d every day, and when the user stops the slide up operation in the data selection area, obtain the virtual keyboard 109d, that is, display the terminal page 108d. In this case, the terminal device may continue to raise the area height of the data selection area in the virtual keyboard 109d until the highest area height of the data selection area is reached in response to the user's daily upward sliding operation in the virtual keyboard 109 d.
More, it should be noted that, when the virtual keyboard is raised to the highest keyboard height set by the system, the terminal device may also continue to respond to the user's up-sliding operation for the data selection area in the virtual keyboard, so as to keep the keyboard height of the virtual keyboard unchanged, and continue to scroll upwards to display other more data to be selected in the data selection area. In this case, the user perceives that the data to be selected originally displayed in the data selection area is moved out of the data selection area from the upper edge of the data selection area through the up-sliding operation, and more data to be selected is moved into the data selection area from the lower edge of the data selection area.
Similarly, when the virtual keyboard is raised to the lowest keyboard height set by the system, the terminal device can also continuously respond to the sliding operation of the user on the data selection area in the virtual keyboard, keep the keyboard height of the virtual keyboard unchanged, and scroll down in the data selection area to display the data to be selected above the data selection area browsed before. In this case, the user perceives that the data to be selected originally displayed in the data selection area is moved out of the data selection area from the lower edge of the data selection area by a sliding operation, and the other data to be selected is moved into the data selection area from the upper edge of the data selection area.
In addition, when the virtual keyboard is raised to a certain keyboard height to which the user slides, and the sliding operation of the user in the data selection area does not meet the acceleration standard, the current keyboard height may be kept unchanged, that is, the virtual keyboard is not stretched, but as the user slides the data selection area, the terminal device may scroll the data to be selected displayed in the data selection area to display different data to be selected, such as scroll up display or scroll down display.
Firstly, displaying a virtual keyboard; responding to triggering operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from the current first display state to a second display state indicated by user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch and retract the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data input efficiency of the user when inputting the data through the input keyboard is improved. In addition, because more data can be displayed in the virtual keyboard which stretches out and draws back for the user to check, the user can quickly find the required data in the virtual keyboard which stretches out and draws back without frequently operating the virtual keyboard to find the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequently operating the virtual keyboard may refer to frequently changing pages and viewing data in the virtual keyboard.
Referring to fig. 8, fig. 8 is a flow chart of a keyboard expansion method provided by the application. As shown in fig. 8, the method may include:
Step S201, a user slides an expression panel;
Specifically, the expression panel is a data selection area in the virtual keyboard, a plurality of expression symbols are displayed in the data selection area, and when the user slides the expression panel, the terminal device can respond to the sliding operation of the user on the expression panel.
Step S202, receiving a sliding callback;
Specifically, the terminal device may obtain a sliding callback of the sliding operation by responding to the sliding operation of the user on the expression panel, where the sliding callback is generated when the user slides the expression panel, and the user operation behavior data may be used to learn the change of the sliding position in the expression panel when the user performs the sliding operation.
Step S203, acquiring a topmost page view control component;
Specifically, the topmost page view control component, that is, the page view control component of the terminal page displayed at the topmost layer, that is, the top page view control component described above. The terminal device may obtain the top page view control component.
Step S204, the page view control component judges whether the virtual keyboard accords with a keyboard expansion protocol;
Specifically, the terminal device can judge whether the virtual keyboard accords with the keyboard expansion protocol through the acquired top page view control component. If yes, the following step S205 is executed, and if not, the current process is ended without expanding the virtual keyboard.
Step S205, the new position is larger than the old position in the vertical direction;
Specifically, the terminal device may acquire a new position of the sliding operation of the user on the expression panel, that is, the movement termination position, and an old position, that is, the movement start position. The terminal device may determine whether the height of the movement termination position in the vertical direction is greater than the movement start position. If yes, it indicates that the user is performing the upward sliding operation on the tablet affection, the following step S206 is performed. If not, it is indicated that the user is performing a downward sliding operation on the tablet affection board, the following step S207 is performed.
Step S206, the acceleration meets the standard;
Specifically, if the acceleration of sliding from the movement start position to the movement end position satisfies the criterion, the following step S208 is performed. The acceleration meeting the criterion may be that the first acceleration of the movement starting position sliding to the movement ending position is greater than the first acceleration threshold, or that the first acceleration of the movement starting position sliding to the movement ending position is greater than the second acceleration, and the acceleration reference value is greater than or equal to the second acceleration threshold, and the specific criterion may be referred to above in step S103. If the acceleration from the movement starting position to the movement ending position does not meet the standard, the virtual keyboard is not stretched, and the current process is ended.
Step S207, the acceleration satisfies the criterion, or has returned to the top;
Specifically, if the acceleration of sliding from the movement start position to the movement end position satisfies the criterion, or has slid down to the upper top of the expression panel, the following step S209 is performed. If the acceleration from the movement starting position to the movement ending position does not meet the standard, the virtual keyboard is not stretched, and the current process is ended.
Step S208, enlarging the height of the keyboard;
Specifically, the terminal device can expand the keyboard height of the virtual keyboard, can expand the keyboard height of the virtual keyboard to a certain fixed keyboard height, and can also follow the sliding operation of the user on the expression panel, so that the keyboard height of the virtual keyboard is correspondingly expanded to the keyboard height to which the user slides. The specific process of expanding the keyboard height of the virtual keyboard can also be referred to above in step S103.
Step S209, reducing the height of the keyboard;
Specifically, the terminal device may reduce the keyboard height of the virtual keyboard, may reduce the keyboard height of the virtual keyboard to a certain fixed keyboard height, or may follow the sliding operation of the user on the expression panel, and correspondingly reduce the keyboard height of the virtual keyboard to the keyboard height to which the user slides. The specific process of reducing the keyboard height of the virtual keyboard can also be referred to above in step S103.
Step S210, notifying the event to the page view control component;
Specifically, the terminal device may notify the top page view control component of an event that the keyboard height of the virtual keyboard needs to be enlarged or reduced.
Step S211, whether a focus object exists;
Specifically, the top page view control component detects whether there is a focus object in the top page, that is, an object that the user needs to pay attention to, when knowing that the virtual keyboard needs to be enlarged or reduced, for example, the focus object may be comment data 101a in fig. 2 a. If yes, the following step S212 is executed, if not, the virtual keyboard is stretched, and the current process is ended.
Step S212, automatically adjusting the position of the focus object;
specifically, the top page view control component correspondingly adjusts the position of the focus object according to the adjusted keyboard height of the virtual keyboard, so that the focus object is not covered by the adjusted virtual keyboard. The terminal device can adjust the position of the focus object by adjusting the page position of the top page where the focus object is located. The specific procedure can also be seen in step S103 described above. When the adjustment of the keyboard height of the virtual keyboard and the object position of the focus object is completed, the current process ends.
Firstly, displaying a virtual keyboard; responding to triggering operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from the current first display state to a second display state indicated by user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data input efficiency of the user when inputting the data through the input keyboard is improved. In addition, because more data can be displayed in the virtual keyboard which stretches out and draws back for the user to check, the user can quickly find the required data in the virtual keyboard which stretches out and draws back without frequently operating the virtual keyboard to find the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequently operating the virtual keyboard may refer to frequently changing pages and viewing data in the virtual keyboard.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an interface data processing device provided by the present application. The interface data processing means may be a computer program (comprising program code) running in a computer device, for example the interface data processing means is an application software; the device can be used for executing corresponding steps in the method provided by the embodiment of the application. As shown in fig. 9, the interface data processing apparatus 1 may include: a display module 101, a telescopic response module 102, and a status switching module 103;
a display module 101 for displaying a virtual keyboard;
The telescopic response module 102 is used for responding to the triggering operation for the virtual keyboard and acquiring user operation behavior data for the virtual keyboard;
a state switching module 103, configured to display the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data;
The virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
The specific function implementation manner of the display module 101, the telescopic response module 102, and the state switching module 103 is please refer to step S101-step S103 in the embodiment corresponding to fig. 3, and no further description is given here.
Wherein the triggering operation includes a moving operation;
The state switching module 103 includes: a data determination unit 10301, a target height determination unit 10302, and a first switching display unit 10303;
A data determination unit 10301 for determining a moving direction and a moving distance of the moving operation based on the user operation behavior data;
A target height determining unit 10302 configured to determine a keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the movement distance, and the movement direction indicated by the first display state, and determine the keyboard height in the second display state as a target keyboard height;
the first switching display unit 10303 is used for displaying the virtual keyboard as a target keyboard height from the initial keyboard height.
The specific functional implementation manner of the data determining unit 10301, the target height determining unit 10302, and the first switching display unit 10303 is referred to step S103 in the embodiment corresponding to fig. 3, and will not be described herein.
The user operation behavior data comprise a moving track corresponding to the moving operation; the moving direction includes upward movement and downward movement;
The direction determination unit 10302 includes: a position determination subunit 103011, a distance determination subunit 103012, a first direction determination subunit 103013, and a second direction determination subunit 103014;
A position determination subunit 103011 for determining a movement start position and a movement end position of the movement operation according to the movement locus;
A distance determination subunit 103012 for determining a movement distance from the movement start position and the movement end position;
A first direction determining subunit 103013 for determining that the moving direction is upward movement when the vertical height of the movement start position is smaller than the vertical height of the movement end position;
a second direction determining subunit 103014 for determining that the movement direction is downward movement when the vertical height of the movement start position is greater than the vertical height of the movement end position;
Then, the target height determination unit 10302 includes: a varying height determination subunit 103021, a first height determination subunit 103022, and a second height determination subunit 103023;
A change height determining subunit 103021, configured to determine a height adjustment value of the virtual keyboard according to the movement distance and the movement scaling factor;
A first height determining subunit 103022, configured to determine, when the movement direction is upward movement, a sum of the initial keyboard height and the height adjustment value as a keyboard height of the virtual keyboard in the second display state;
and a second height determining subunit 103023 for determining, when the movement direction is downward movement, a difference between the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state.
The specific functional implementation manner of the position determining subunit 103011, the distance determining subunit 103012, the first direction determining subunit 103013, and the second direction determining subunit 103014 is referred to step S103 in the embodiment corresponding to fig. 3, and the specific functional implementation manner of the changing height determining subunit 103021, the first height determining subunit 103022, and the second height determining subunit 103023 is referred to step S103 in the embodiment corresponding to fig. 3, and will not be described herein.
Wherein the triggering operation includes a moving operation;
the interface data processing apparatus 1 further includes: a first acceleration acquisition module 104, a first acceleration determination module 105, and a second acceleration determination module 106;
a first acceleration obtaining module 104, configured to obtain acceleration of the mobile operation in a vertical direction according to the user operation behavior data;
A first acceleration determination module 105, configured to execute displaying the virtual keyboard from the current first display state to a second display state indicated by the user operation behavior data if the acceleration of the mobile operation in the vertical direction is greater than or equal to the first acceleration threshold;
The second acceleration determination module 106 is configured to keep the virtual keyboard displayed in the first display state if the acceleration of the mobile operation in the vertical direction is less than the first acceleration threshold.
The specific function implementation manner of the first acceleration obtaining module 104, the first acceleration determining module 105, and the second acceleration determining module 106 is please refer to step S103 in the embodiment corresponding to fig. 3, and a detailed description thereof is omitted herein.
Wherein the triggering operation includes a moving operation;
The interface data processing apparatus 1 further includes: a second acceleration acquisition module 107, a third acceleration acquisition module 108, a third acceleration determination module 109, and a fourth acceleration determination module 110;
A second acceleration acquisition module 107 for acquiring an acceleration of the moving operation in the vertical direction and an acceleration of the moving operation in the horizontal direction according to the user operation behavior data;
A third acceleration acquisition module 108 for determining an acceleration reference value based on the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction;
A third acceleration determination module 109, configured to execute displaying the virtual keyboard from the current first display state to a second display state indicated by the user operation behavior data if the acceleration of the mobile operation in the vertical direction is greater than the acceleration of the mobile operation in the horizontal direction and the acceleration reference value is greater than or equal to the second acceleration threshold value;
the fourth acceleration determination module 110 is configured to keep the virtual keyboard displayed in the first display state if the acceleration of the moving operation in the vertical direction is smaller than the acceleration of the moving operation in the horizontal direction, or the acceleration reference value is smaller than the second acceleration threshold value.
The specific function implementation manner of the second acceleration obtaining module 107, the third acceleration obtaining module 108, the third acceleration determining module 109 and the fourth acceleration determining module 110 is please refer to step S103 in the embodiment corresponding to fig. 3, and no further description is given here.
Wherein, the display module 101 is further configured to:
responding to comment operation aiming at comment data in a comment page, and displaying a virtual keyboard and a comment quotation page containing the comment data; the virtual keyboard and comment data in the comment quotation page are not overlapped with each other;
Wherein the comment reference page is a sub-page that is displayed independently above the comment page.
Wherein, the flexible response module 102 includes: a control component acquisition unit 1021 and a right determination unit 1022;
A control component obtaining unit 1021, configured to obtain a page view control component of a comment reference page in response to a triggering operation for a virtual keyboard; the page view control component is a control component in an application program where the comment quotes a page;
The permission determination unit 1022 is configured to obtain user operation behavior data for the virtual keyboard when it is detected that the application program has a keyboard state switching permission for the virtual keyboard according to the page view control component.
The specific function implementation manner of the control component obtaining unit 1021 and the permission determining unit 1022 is please refer to step S103 in the embodiment corresponding to fig. 3, and a detailed description is omitted herein.
Wherein, the interface data processing device 1 further comprises: a keyboard determination module 111, a page position determination module 112, and a page position adjustment module 113;
A keyboard determining module 111, configured to determine the virtual keyboard in the second display state as a target virtual keyboard;
A page position determining module 112, configured to determine an adaptive page position of the comment reference page above the comment page based on a positional relationship between the comment data in the comment reference page and the target virtual keyboard, and the page view control component;
The page position adjustment module 113 is configured to adjust a page position of the comment reference page to an adaptive page position; the target virtual keyboard and comment data in the comment reference page after position adjustment are not overlapped with each other.
The specific function implementation manner of the keyboard determining module 111, the page position determining module 112, and the page position adjusting module 113 is please refer to step S103 in the embodiment corresponding to fig. 3, and a detailed description is omitted herein.
Wherein, the state switching module 103 includes: a data synchronization unit 10304, a first parameter generation unit 10305, and a second switching display unit 10306;
A data synchronization unit 10304 for synchronizing user operation behavior data to the page view control component based on the virtual keyboard;
A first parameter generating unit 10305, configured to generate, based on the page view control component, a first state change parameter corresponding to the user operation behavior data;
The second switching display unit 10306 is configured to control, based on the page view control component, the virtual keyboard to be displayed as a second display state indicated by the first state change parameter by the first display state.
The specific function implementation manner of the data synchronization unit 10304, the first parameter generation unit 10305, and the second switching display unit 10306 refer to step S103 in the embodiment corresponding to fig. 3, and will not be described herein.
The first display state comprises an original display state and an expanded display state;
the state switching module 103 includes: a second parameter generation unit 10307, a third switching display unit 10308, and a fourth switching display unit 10309;
a second parameter generating unit 10307, configured to determine a keyboard adjustment height corresponding to the virtual keyboard according to the user operation behavior data; the keyboard adjusting height is the extended keyboard height or the original keyboard height;
a third switching display unit 10308, configured to determine, when the first display state is an original display state and the keyboard adjustment height is an extended keyboard height, the extended keyboard height as the keyboard height in the second display state, and display the virtual keyboard from the original keyboard height in the original display state to the extended keyboard height;
And a fourth switching display unit 10309, configured to determine the original keyboard height as the keyboard height in the second display state and display the virtual keyboard as the original keyboard height from the extended keyboard height in the extended display state when the first display state is the extended display state and the keyboard adjustment height is the original keyboard height.
The specific functional implementation manner of the second parameter generating unit 10307, the third switching display unit 10308, and the fourth switching display unit 10309 refer to step S103 in the embodiment corresponding to fig. 3, and are not described herein.
The virtual keyboard comprises a data selection area; the data selection area in the first display state has a first area size; the data selection area in the second display state has a second area size;
The state switching module 103 is specifically configured to:
displaying the virtual keyboard from the first display state to the second display state, displaying the data selection area from the first area size to the second area size, and carrying out rearrangement display on the data to be selected in the data selection area with the second area size.
The triggering operation comprises a voice control operation; the user operation behavior data comprise voice audio data corresponding to voice control operation;
the state switching module 103 includes: a voice recognition unit 10310 and a fifth switching display unit 10311;
the voice recognition unit 10310 is configured to perform voice recognition on the voice audio data to obtain a second state change parameter for the virtual keyboard;
the fifth switching display unit 10311 is configured to display the virtual keyboard from the first display state to the second display state indicated by the second state change parameter.
The specific functional implementation manner of the voice recognition unit 10310 and the fifth switching display unit 10311 is please refer to step S103 in the embodiment corresponding to fig. 3, and a detailed description is omitted herein.
Firstly, displaying a virtual keyboard; responding to triggering operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from the current first display state to a second display state indicated by user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch and retract the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data input efficiency of the user when inputting the data through the input keyboard is improved. In addition, because more data can be displayed in the virtual keyboard which stretches out and draws back for the user to check, the user can quickly find the required data in the virtual keyboard which stretches out and draws back without frequently operating the virtual keyboard to find the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequently operating the virtual keyboard may refer to frequently changing pages and viewing data in the virtual keyboard.
Referring to fig. 10, fig. 10 is a schematic structural diagram of a computer device according to the present application. As shown in fig. 10, the computer device 1000 may include: processor 1001, network interface 1004, and memory 1005, in addition, computer device 1000 may further comprise: a user interface 1003, and at least one communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display (Display), a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface, among others. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 1005 may also optionally be at least one storage device located remotely from the processor 1001. As shown in fig. 10, an operating system, a network communication module, a user interface module, and a device control application program may be included in the memory 1005, which is one type of computer storage medium.
In the computer device 1000 shown in FIG. 10, the network interface 1004 may provide network communication functions; while user interface 1003 is primarily used as an interface for providing input to a user; and the processor 1001 may be used to invoke the device control application stored in the memory 1005 to implement the description of the interface data processing method in the corresponding embodiment of fig. 3. It should be understood that the computer device 1000 described in the present application may also perform the description of the interface data processing apparatus 1 in the embodiment corresponding to fig. 9, which is not repeated herein. In addition, the description of the beneficial effects of the same method is omitted.
Furthermore, it should be noted here that: the present application further provides a computer readable storage medium, in which the aforementioned computer program executed by the interface data processing apparatus 1 is stored, and the computer program includes program instructions, when executed by a processor, can execute the description of the interface data processing method in the corresponding embodiment of fig. 3, and therefore, a detailed description will not be given here. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the embodiments of the computer storage medium according to the present application, please refer to the description of the method embodiments of the present application. As an example, program instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or on multiple computing devices distributed across multiple sites and interconnected by a communication network, where the multiple computing devices distributed across multiple sites and interconnected by a communication network may constitute a blockchain system.
Those skilled in the art will appreciate that implementing all or part of the above-described methods may be accomplished by way of computer programs, which may be stored on a computer-readable storage medium, and which, when executed, may comprise the steps of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (Random Access Memory, RAM), or the like.
The foregoing disclosure is illustrative of the present application and is not to be construed as limiting the scope of the application, which is defined by the appended claims.

Claims (14)

1. An interface data processing method, comprising:
displaying a virtual keyboard, wherein the virtual keyboard comprises a data selection area, and the data selection area is an area for displaying data to be selected;
Responding to a triggering operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard, wherein the triggering operation comprises a mobile operation;
Acquiring acceleration of the mobile operation in the vertical direction according to the user operation behavior data;
If the acceleration of the mobile operation in the vertical direction is greater than or equal to a first acceleration threshold value, displaying the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes, the data selection area in the first display state has a first area size, the data selection area in the second display state has a second area size, and more data to be selected are displayed in the data selection area with the second area size than data to be selected are displayed in the data selection area with the first area size;
and if the acceleration of the moving operation in the vertical direction is smaller than the first acceleration threshold value, the virtual keyboard is kept to be displayed in the first display state.
2. The method of claim 1, wherein displaying the virtual keyboard from a current first display state to a second display state indicated by the user operational behavior data comprises:
Determining the moving direction and the moving distance of the moving operation according to the user operation behavior data;
Determining the keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the moving distance and the moving direction indicated by the first display state, and determining the keyboard height in the second display state as a target keyboard height;
and displaying the virtual keyboard as the target keyboard height from the initial keyboard height.
3. The method of claim 2, wherein the user operation behavior data includes a movement trace corresponding to the movement operation; the moving direction comprises upward movement and downward movement;
The determining the moving direction and the moving distance of the moving operation according to the user operation behavior data comprises the following steps:
Determining a movement starting position and a movement ending position of the movement operation according to the movement track;
Determining the movement distance according to the movement starting position and the movement ending position;
When the vertical height of the movement starting position is smaller than the vertical height of the movement ending position, determining the movement direction as the upward movement;
When the vertical height of the movement starting position is larger than the vertical height of the movement ending position, determining the movement direction as the downward movement;
and determining the keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the moving distance and the moving direction indicated by the first display state, wherein the determining comprises the following steps:
determining a height adjustment value of the virtual keyboard according to the moving distance and the moving proportion coefficient;
When the moving direction is the upward movement, determining the sum of the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state;
And when the moving direction is the downward movement, determining the difference between the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state.
4. The method according to claim 1, wherein the method further comprises:
Acquiring the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction according to the user operation behavior data;
determining an acceleration reference value according to the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction;
If the acceleration of the moving operation in the vertical direction is greater than the acceleration of the moving operation in the horizontal direction and the acceleration reference value is greater than or equal to a second acceleration threshold value, executing the step of displaying the virtual keyboard from the current first display state to a second display state indicated by the user operation behavior data;
And if the acceleration of the moving operation in the vertical direction is smaller than the acceleration of the moving operation in the horizontal direction or the acceleration reference value is smaller than the second acceleration threshold value, the virtual keyboard is kept to be displayed in the first display state.
5. The method of claim 1, wherein displaying the virtual keyboard comprises:
responding to comment operation aiming at comment data in a comment page, and displaying the virtual keyboard and a comment quotation page containing the comment data; the virtual keyboard and the comment data in the comment reference page are not overlapped with each other;
The comment reference page is a sub-page that is displayed independently above the comment page.
6. The method of claim 5, wherein the obtaining user operational behavior data for the virtual keyboard in response to the triggering operation for the virtual keyboard comprises:
Responding to triggering operation aiming at the virtual keyboard, and acquiring a page view control component of the comment reference page; the page view control component is a control component in an application program where the comment reference page is located;
And when detecting that the application program has keyboard state switching rights for the virtual keyboard according to the page view control component, acquiring the user operation behavior data for the virtual keyboard.
7. The method of claim 6, wherein the method further comprises:
determining the virtual keyboard in the second display state as a target virtual keyboard;
Determining an adaptive page position of the comment reference page above the comment page based on a positional relationship between the comment data in the comment reference page and the target virtual keyboard, and the page view control component;
Adjusting the page position of the comment reference page to the adaptive page position; and the target virtual keyboard and the comment data in the comment reference page after position adjustment are not overlapped with each other.
8. The method of claim 6, wherein displaying the virtual keyboard from a current first display state to a second display state indicated by the user operational behavior data comprises:
Synchronizing the user operational behavior data to the page view control component based on the virtual keyboard;
Generating a first state change parameter corresponding to the user operation behavior data based on the page view control component;
And based on the page view control component, controlling the virtual keyboard to be displayed in the second display state indicated by the first state change parameter by the first display state.
9. The method of claim 1, wherein the first display state comprises an original display state and an extended display state;
the displaying the virtual keyboard from the current first display state to the second display state indicated by the user operation behavior data comprises the following steps:
determining the keyboard adjustment height corresponding to the virtual keyboard according to the user operation behavior data; the keyboard adjusting height is the extended keyboard height or the original keyboard height;
when the first display state is the original display state and the keyboard adjustment height is the extended keyboard height, determining the extended keyboard height as the keyboard height in the second display state, and displaying the virtual keyboard from the original keyboard height in the original display state to the extended keyboard height;
When the first display state is the expansion display state and the keyboard adjusting height is the original keyboard height, determining the original keyboard height as the keyboard height in the second display state, and displaying the virtual keyboard as the original keyboard height from the expansion keyboard height in the expansion display state.
10. The method of claim 1, wherein displaying the virtual keyboard from a current first display state to a second display state indicated by the user operational behavior data comprises:
Displaying the virtual keyboard from the first display state to the second display state, displaying the data selection area from the first area size to the second area size, and carrying out rearrangement display on data to be selected in the data selection area with the second area size.
11. The method of claim 1, wherein the triggering operation comprises a voice control operation; the user operation behavior data comprise voice audio data corresponding to the voice control operation;
the displaying the virtual keyboard from the current first display state to the second display state indicated by the user operation behavior data comprises the following steps:
Performing voice recognition on the voice audio data to obtain a second state change parameter aiming at the virtual keyboard;
And displaying the virtual keyboard from the first display state to the second display state indicated by the second state change parameter.
12. An interface data processing apparatus, comprising:
The display module is used for displaying a virtual keyboard, wherein the virtual keyboard comprises a data selection area, and the data selection area is an area for displaying data to be selected;
the telescopic response module is used for responding to the triggering operation aiming at the virtual keyboard and acquiring user operation behavior data aiming at the virtual keyboard, wherein the triggering operation comprises a mobile operation;
The state switching module is used for displaying the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes, the data selection area in the first display state has a first area size, the data selection area in the second display state has a second area size, and more data to be selected are displayed in the data selection area with the second area size than data to be selected are displayed in the data selection area with the first area size;
The first acceleration acquisition module is used for acquiring the acceleration of the mobile operation in the vertical direction according to the user operation behavior data;
The first acceleration judging module is used for triggering the state switching module to display the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data if the acceleration of the mobile operation in the vertical direction is greater than or equal to a first acceleration threshold value;
And the second acceleration judging module is used for keeping the virtual keyboard to display in the first display state if the acceleration of the moving operation in the vertical direction is smaller than the first acceleration threshold value.
13. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the method of any of claims 1-11.
14. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program comprising program instructions which, when executed by a processor, perform the method of any of claims 1-11.
CN202010508159.XA 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium Active CN113760165B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010508159.XA CN113760165B (en) 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010508159.XA CN113760165B (en) 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN113760165A CN113760165A (en) 2021-12-07
CN113760165B true CN113760165B (en) 2024-04-19

Family

ID=78785167

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010508159.XA Active CN113760165B (en) 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN113760165B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114968063A (en) * 2022-05-26 2022-08-30 Oppo广东移动通信有限公司 Display method and device of virtual keyboard, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488400A (en) * 2013-09-27 2014-01-01 京东方科技集团股份有限公司 Method and device for building virtual keyboard
CN104007917A (en) * 2013-02-27 2014-08-27 联想(北京)有限公司 Control method for virtual keyboard and electronic device
CN104808945A (en) * 2015-04-29 2015-07-29 努比亚技术有限公司 Display method and display device of virtual keys
CN107193476A (en) * 2017-05-10 2017-09-22 北京百度网讯科技有限公司 Data inputting method and device, computer equipment and computer-readable recording medium
CN108628534A (en) * 2018-05-14 2018-10-09 维沃移动通信有限公司 A kind of character methods of exhibiting and mobile terminal
CN109240591A (en) * 2018-09-26 2019-01-18 北京金山安全软件有限公司 Interface display method and device
CN110456907A (en) * 2019-07-24 2019-11-15 广东虚拟现实科技有限公司 Control method, device, terminal device and the storage medium of virtual screen

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014008670A1 (en) * 2012-07-13 2014-01-16 华为技术有限公司 Method and terminal for determining operation object
US10379737B2 (en) * 2015-10-19 2019-08-13 Apple Inc. Devices, methods, and graphical user interfaces for keyboard interface functionalities

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104007917A (en) * 2013-02-27 2014-08-27 联想(北京)有限公司 Control method for virtual keyboard and electronic device
CN103488400A (en) * 2013-09-27 2014-01-01 京东方科技集团股份有限公司 Method and device for building virtual keyboard
CN104808945A (en) * 2015-04-29 2015-07-29 努比亚技术有限公司 Display method and display device of virtual keys
CN107193476A (en) * 2017-05-10 2017-09-22 北京百度网讯科技有限公司 Data inputting method and device, computer equipment and computer-readable recording medium
CN108628534A (en) * 2018-05-14 2018-10-09 维沃移动通信有限公司 A kind of character methods of exhibiting and mobile terminal
CN109240591A (en) * 2018-09-26 2019-01-18 北京金山安全软件有限公司 Interface display method and device
CN110456907A (en) * 2019-07-24 2019-11-15 广东虚拟现实科技有限公司 Control method, device, terminal device and the storage medium of virtual screen

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
适合手游的手机屏幕和键盘尺寸的研究;段佳玮;自动化应用;20170125(第01期);第36-38页 *

Also Published As

Publication number Publication date
CN113760165A (en) 2021-12-07

Similar Documents

Publication Publication Date Title
US11921978B2 (en) Devices, methods, and graphical user interfaces for navigating, displaying, and editing media items with multiple display modes
US11681866B2 (en) Device, method, and graphical user interface for editing screenshot images
US11842044B2 (en) Keyboard management user interfaces
KR102448427B1 (en) Devices, methods, and graphical user interfaces for navigating between user interfaces and interacting with control objects
KR102222143B1 (en) Handwriting keyboard for screens
KR102476243B1 (en) Touch input cursor manipulation
US10304163B2 (en) Landscape springboard
US10275436B2 (en) Zoom enhancements to facilitate the use of touch screen devices
EP3093755B1 (en) Mobile terminal and control method thereof
KR20220138007A (en) Devices, methods, and graphical user interfaces for navigating between user interfaces and interacting with control objects
US20220391158A1 (en) Systems and Methods for Interacting with Multiple Display Devices
US11755146B2 (en) Devices and methods for processing touch inputs
CN113760165B (en) Interface data processing method and device and computer readable storage medium
JP2014085793A (en) Display device and display control method
US20220091736A1 (en) Method and apparatus for displaying page, graphical user interface, and mobile terminal
US11393164B2 (en) Device, method, and graphical user interface for generating CGR objects
CN112764623B (en) Content editing method and device
US20230418413A1 (en) Devices and Methods for Processing Touch Inputs
WO2022256681A2 (en) Systems and methods for interacting with multiple display devices
CN116627302A (en) Character selection control method, device, electronic equipment and readable storage medium
CN115525196A (en) Node processing method, node processing device, computer readable storage medium and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant