CN113760165A - Interface data processing method and device and computer readable storage medium - Google Patents

Interface data processing method and device and computer readable storage medium Download PDF

Info

Publication number
CN113760165A
CN113760165A CN202010508159.XA CN202010508159A CN113760165A CN 113760165 A CN113760165 A CN 113760165A CN 202010508159 A CN202010508159 A CN 202010508159A CN 113760165 A CN113760165 A CN 113760165A
Authority
CN
China
Prior art keywords
keyboard
virtual keyboard
display state
height
page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010508159.XA
Other languages
Chinese (zh)
Other versions
CN113760165B (en
Inventor
魏先宇
夏胜飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202010508159.XA priority Critical patent/CN113760165B/en
Publication of CN113760165A publication Critical patent/CN113760165A/en
Application granted granted Critical
Publication of CN113760165B publication Critical patent/CN113760165B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses an interface data processing method, an interface data processing device and a computer readable storage medium, wherein the method comprises the following steps: displaying a virtual keyboard; responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes. By the aid of the method and the device, data entry efficiency when data are entered by using the virtual keyboard can be improved, and power consumption of the device is reduced.

Description

Interface data processing method and device and computer readable storage medium
Technical Field
The present application relates to the field of data processing technologies, and in particular, to an interface data processing method and apparatus, and a computer-readable storage medium.
Background
An application program may typically invoke a virtual keyboard that is used by a user to enter data into a mobile application. For example, the mobile application may be a messaging application, and when sending a message to another user in the messaging application, a virtual keyboard may be used to enter the content of the message.
In the prior art, when data is entered by using a virtual keyboard, data can be selected from the virtual keyboard for entry, for example, expression data displayed in the virtual keyboard is selected for entry. When selecting expression data displayed in a virtual keyboard for entry, if more expression data displayed in the virtual keyboard needs to be browsed, a user needs to continuously slide the virtual keyboard to page and view expression data displayed in the virtual keyboard, so that the efficiency of data entry through the virtual keyboard is low, and the power consumption of equipment is increased by frequently operating the virtual keyboard to view certain expression data. The frequent operation of the virtual keyboard may mean that operations such as page changing are frequently performed on expression data in the virtual keyboard.
Disclosure of Invention
The application provides an interface data processing method, an interface data processing device and a computer readable storage medium, which can improve data entry efficiency when a virtual keyboard is used for entering data and reduce equipment power consumption.
One aspect of the present application provides an interface data processing method, including:
displaying a virtual keyboard;
responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard;
displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data;
the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
One aspect of the present application provides an interface data processing apparatus, including:
the display module is used for displaying the virtual keyboard;
the telescopic response module is used for responding to the triggering operation aiming at the virtual keyboard and acquiring user operation behavior data aiming at the virtual keyboard;
the state switching module is used for displaying the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data;
the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
Wherein the trigger operation comprises a move operation;
a state switching module comprising:
the data determining unit is used for determining the moving direction and the moving distance of the moving operation according to the user operation behavior data;
the target height determining unit is used for determining the keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the moving distance and the moving direction indicated by the first display state, and determining the keyboard height in the second display state as the target keyboard height;
and the first switching display unit is used for displaying the virtual keyboard as the target keyboard height from the initial keyboard height.
The user operation behavior data comprises a movement track corresponding to movement operation; the moving direction includes upward movement and downward movement;
a data determination unit comprising:
the position determining subunit is used for determining a movement starting position and a movement ending position of the movement operation according to the movement track;
a distance determining subunit, configured to determine a movement distance according to the movement starting position and the movement ending position;
a first direction determining subunit for determining the moving direction as an upward movement when the vertical height of the movement start position is smaller than the vertical height of the movement end position;
a second direction determining subunit for determining the moving direction as downward movement when the vertical height of the movement start position is greater than the vertical height of the movement end position;
then, the target height determination unit includes:
the height change determining subunit is used for determining a height adjustment value of the virtual keyboard according to the moving distance and the moving scale coefficient;
the first height determining subunit is used for determining the sum of the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state when the moving direction is upward movement;
and a second height determining subunit, configured to determine, when the moving direction is downward movement, a difference between the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state.
Wherein the trigger operation comprises a move operation;
the method further comprises the following steps:
the first acceleration acquisition module is used for acquiring the acceleration of the mobile operation in the vertical direction according to the user operation behavior data;
the first acceleration judging module is used for displaying the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data if the acceleration of the mobile operation in the vertical direction is greater than or equal to a first acceleration threshold;
and the second acceleration judging module is used for keeping the virtual keyboard to display in the first display state if the acceleration of the moving operation in the vertical direction is smaller than the first acceleration threshold.
Wherein the trigger operation comprises a move operation;
the method further comprises the following steps:
the second acceleration acquisition module is used for acquiring the acceleration of the mobile operation in the vertical direction and the acceleration of the mobile operation in the horizontal direction according to the user operation behavior data;
the third acceleration acquisition module is used for determining an acceleration reference value according to the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction;
the third acceleration judging module is used for displaying the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data if the acceleration of the moving operation in the vertical direction is greater than the acceleration of the moving operation in the horizontal direction and the acceleration reference value is greater than or equal to a second acceleration threshold value;
and the fourth acceleration judging module is used for keeping the virtual keyboard to display in the first display state if the acceleration of the movement operation in the vertical direction is smaller than the acceleration of the movement operation in the horizontal direction or the acceleration reference value is smaller than the second acceleration threshold value.
Wherein, the display module is further configured to:
responding to comment operation aiming at comment data in the comment page, and displaying a virtual keyboard and a comment reference page containing the comment data; the virtual keyboard and comment data in the comment reference page are not overlapped;
the comment reference page is a sub-page independently displayed on the comment page.
Wherein, flexible response module includes:
the control component acquisition unit is used for responding to the trigger operation aiming at the virtual keyboard and acquiring a page view control component of the comment reference page; the page view control component refers to a control component in an application program where the page is located for the comment;
and the permission judging unit is used for acquiring user operation behavior data aiming at the virtual keyboard when detecting that the application program has keyboard state switching permission aiming at the virtual keyboard according to the page view control component.
Wherein, the method further comprises:
the keyboard determining module is used for determining the virtual keyboard in the second display state as a target virtual keyboard;
the page position determining module is used for determining the self-adaptive page position of the comment reference page above the comment page based on the position relation between the comment data in the comment reference page and the target virtual keyboard and the page view control component;
the page position adjusting module is used for adjusting the page position of the comment quotation page to a self-adaptive page position; the target virtual keyboard and comment data in the comment reference page after position adjustment are not overlapped.
Wherein, the state switching module includes:
the data synchronization unit is used for synchronizing the user operation behavior data to the page view control component based on the virtual keyboard;
the first parameter generation unit is used for generating a first state change parameter corresponding to the user operation behavior data based on the page view control component;
and the second switching display unit is used for controlling the virtual keyboard to be displayed in a second display state indicated by the first state change parameter from the first display state based on the page view control component.
The first display state comprises an original display state and an expanded display state;
a state switching module comprising:
the second parameter generation unit is used for determining the height of the adjustment keyboard corresponding to the virtual keyboard according to the user operation behavior data; adjusting the height of the keyboard to be the height of an expanded keyboard or the height of an original keyboard;
the third switching display unit is used for determining the height of the extended keyboard as the height of the keyboard in the second display state and displaying the virtual keyboard as the height of the extended keyboard from the height of the original keyboard in the original display state when the first display state is the original display state and the height of the keyboard is adjusted to be the height of the extended keyboard;
and the fourth switching display unit is used for determining the original keyboard height as the keyboard height in the second display state and displaying the virtual keyboard as the original keyboard height from the extended keyboard height in the extended display state when the first display state is the extended display state and the adjusted keyboard height is the original keyboard height.
Wherein the virtual keyboard comprises a data selection area; the data selection area in the first display state has a first area size; the data selection area in the second display state has a second area size;
the state switching module is specifically configured to:
displaying the virtual keyboard from the first display state to the second display state, displaying the data selection area from the first area size to the second area size, and performing layout display on the data to be selected in the data selection area with the second area size.
Wherein the triggering operation comprises a voice control operation; the user operation behavior data comprises voice audio data corresponding to voice control operation;
a state switching module comprising:
the voice recognition unit is used for carrying out voice recognition on the voice audio data to obtain a second state change parameter aiming at the virtual keyboard;
and the fifth switching display unit is used for displaying the virtual keyboard from the first display state to the second display state indicated by the second state change parameter.
An aspect of the application provides a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the method of an aspect of the application.
An aspect of the application provides a computer-readable storage medium having stored thereon a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of the above-mentioned aspect.
The method includes the steps that firstly, a virtual keyboard is displayed; responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data entry efficiency of the user when entering the data through the input keyboard is improved. In addition, as more data can be displayed in the telescopic virtual keyboard for the user to check, the user can quickly search the required data in the telescopic virtual keyboard without frequently operating the virtual keyboard to search the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequent operation of the virtual keyboard may refer to frequent page change and viewing of data in the virtual keyboard.
Drawings
In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic diagram of a system architecture provided herein;
fig. 2a is a schematic page diagram of a terminal device provided in the present application;
fig. 2b is a schematic page diagram of a terminal device provided in the present application;
FIG. 3 is a schematic flow chart diagram illustrating an interface data processing method provided herein;
FIG. 4 is a schematic view of a keyboard expansion/contraction display state change scenario provided in the present application;
FIG. 5a is a schematic view of a keyboard expansion and contraction scenario provided in the present application;
FIG. 5b is a schematic diagram illustrating a keyboard expansion scenario provided in the present application;
FIG. 6 is a schematic diagram illustrating a keyboard expansion scenario provided in the present application;
FIG. 7 is a schematic diagram illustrating a keyboard expansion scenario provided in the present application;
FIG. 8 is a flowchart illustrating a keyboard scaling method according to the present application;
FIG. 9 is a schematic structural diagram of an interface data processing apparatus provided in the present application;
fig. 10 is a schematic structural diagram of a computer device provided in the present application.
Detailed Description
The technical solutions in the present application will be described clearly and completely with reference to the accompanying drawings in the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture provided in the present application. As shown in fig. 1, the system architecture diagram may include a plurality of terminal devices including a terminal device 200a, a terminal device 200b, and a terminal device 200c, and a server 100. Among them, the terminal device 200a, the terminal device 200b, and the terminal device 200c can communicate with the server 100 each other. The terminal device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a Mobile Internet Device (MID), a virtual device, or a wearable device (e.g., a smart watch, a smart bracelet, etc.), and the like. The description of the present application is made by taking the communication between the terminal device 200a and the server 100 as an example, and please refer to the following procedure.
Referring to fig. 2a, fig. 2a is a schematic page view of a terminal device provided in the present application. As shown in fig. 2a, the terminal page 100a is a terminal page in the terminal device 200a, and the dynamic 111a published by the user is included in the terminal page 100a, where the dynamic 111a is a picture. The terminal page 100a also includes a comment sub-page 110a for the dynamic 111 a. As seen from the terminal page 100a, the comment sub-page 110a may be a sub-page independently displayed on the page where the dynamic state 111a is located, and therefore, it can be understood that, in the terminal page 100a, the comment sub-page 110a causes an occlusion on the page where the dynamic state 111a is located. The comment sub-page 110a includes a comment "how to" for the dynamic 111a by the user "happy" and a comment 101a for the dynamic 111a by the user "day, and the comment 101a is" a haha, and my small rocket is not available ". Assuming that the user holding the terminal device is the target user, the comment sub-page 110a may be displayed after the terminal device 200a responds to a comment operation of the target user on a comment "uhaha, i.e., my small rocket does not exist". It can be understood that all comments about the dynamic 111a are also displayed in the page where the dynamic 111a is located, including the comment "how to" and the comment "haha, and my small rocket does not exist" in the comment sub-page 110a, and therefore, the comment operation is an operation of the target user about the comment "haha, and my small rocket does not exist" in the page where the dynamic 111a is located.
After responding to a comment operation of a target user for a comment "uha, my rocket does not exist", the terminal device 200a may display not only the comment sub-page 110a, but also an input keyboard 102a, where the input keyboard 102a is used to support the target user to input comment content for a comment "uha, my rocket does not exist". Since the comment sub page 110a is displayed after the terminal device 200a responds to a comment operation of the target user on the comment "uha, my small rocket does not exist", the comment "uha, my small rocket does not exist" may be used as a focus content concerned by the target user, and the focus content refers to a content that the target user may pay attention to. Therefore, when the comment sub page 110a is displayed, the comment 101a is always displayed above the input keyboard 102a, so that the input keyboard 102a does not obstruct the comment 101a, and the user can always view the comment 101a when inputting the comment content through the input keyboard 102 a.
More, the input keyboard 102a includes a data selection area 103a, the data selection area 103a includes a plurality of emoticons, and the target user is supported to browse the emoticons in the data selection area 103a and select one or more emoticons as comment content for a comment "a ha, i.e., my small rocket does not exist". The terminal device 200a may obtain an acceleration of the upward sliding operation in the vertical direction in response to the upward sliding operation of the target user in the data selection area 103a, and may increase the keyboard height of the input keyboard 102a when the acceleration is greater than a certain threshold (which may be set by itself). Specifically, increasing the keyboard height of the input keyboard 102a may mean increasing the area height of the data selection area 103a in the input keyboard 102 a. Here, the area height of the data selection area 103a may be increased by a fixed height, and the fixed height may be set by itself, for example, the fixed height may be a page height required when two lines of emoticons are displayed. After increasing the keyboard height of the input keyboard 102a, the terminal device 200a may display the terminal page 104 a.
The terminal page 104a includes an input keyboard 106a obtained by increasing the keyboard height of the input keyboard 102a, and the input keyboard 106a includes a data selection area 105a obtained by increasing the area height of the data selection area 103 a. As shown in the terminal page 104a, by increasing the area height of the data selection area 102a, more emoticons can be displayed in the resulting data selection area 105a for viewing and selection by the target user. It is understood that the input keypad 102a and the input keypad 106a are the same input keypad, except that the input keypad 102a and the input keypad 106a have different keypad heights.
As shown in the terminal page 104a, when the keyboard height of the input keyboard 102a is increased and the input keyboard 106a is displayed, the page position of the comment sub-page 110a in the terminal page is also adjusted correspondingly. The comment sub-page 112a displayed in the terminal page 104a is a sub-page obtained after the page position of the comment sub-page 110a is adjusted. It will be appreciated that the comment sub-page 110a and the comment sub-page 112a are also the same comment sub-page, but have different page positions. The criterion for adjusting the page position of the comment subpage 110a is to make the focus content (i.e., the comment 101a) in the comment subpage 112a displayed above the input keyboard 106a, i.e., to make the comment 101a not obstructed by the input keyboard 106 a.
The data selection area 103a and the data selection area 105a may be collectively referred to as a data selection area, and the input keyboard 102a and the input keyboard 106a may be collectively referred to as an input keyboard. When the target user selects an emoticon as the comment content of the comment "uha, my rocket did not exist" in the data selection area, the selected emoticon is displayed in the input box 115a in the input keyboard. The terminal device 200a may respond to a click operation of a target user on a "send" button in an input keyboard, and send comment content entered by the target user in the input box 115a to the server 100, so that the server 100 may synchronize the comment content entered by the target user in the input box 115a to other terminal devices to which the user who can view the above-mentioned dynamic 111a belongs, so that the user who can view the dynamic 111a can be viewed, and also can view all comments for the dynamic 111a, comments for the comments, and the like. The comment content entered by the target user in the input box 115a may include the emoticon selected by the target user in the data selection area.
Please refer to fig. 2b together, and fig. 2b is a schematic page diagram of a terminal device provided in the present application. As shown in fig. 2b, the terminal page 104a is the terminal page 104a in fig. 2 a. The terminal device 200a may further respond to a downward sliding operation of a target user in the data selection area 105a of the terminal page 104a, acquire a sliding acceleration of the downward sliding operation, and if the acceleration is greater than a certain threshold, the threshold may be set by itself, may restore the area height of the data selection area 105a to the area height of the data selection area 103a, obtain the data selection area 109a in the terminal page 107a, and simultaneously restore the page position of the comment sub-page 112a to the page position of the comment sub-page 110a, obtain the comment sub-page 113a in the terminal page 107 a. In other words, the terminal device 200a can display the terminal page 107a in response to the target user's downward sliding operation in the data selection area 105a of the terminal page 104 a.
By the method, the input keyboard can be stretched according to the operation of the user, namely the input keyboard can be enlarged or reduced according to the operation of the user. When the input keyboard is enlarged, the content displayed in the data selection area of the input keyboard is increased, so that a user can browse more content displayed in the data selection area at one time, the browsing efficiency of the user for the content displayed in the data selection area can be improved, the selection efficiency of the user for the content displayed in the data selection area is improved, and the comment efficiency of the user for commenting comment data by using the input keyboard is improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of an interface data processing method provided in the present application, and as shown in fig. 3, the method may include:
step S101, displaying a virtual keyboard;
specifically, the execution subject in this embodiment may be any terminal device. The virtual keyboard may be a keyboard component integrated in an application installed in the terminal device, or the virtual keyboard may also be a keyboard application installed in the terminal device. The virtual keyboard, which may also be referred to as an input keyboard, is a medium for a user to enter data into the terminal device.
The terminal device may display the virtual keyboard in response to a data entry operation by the user. The data entry operation of the user may refer to a comment operation of the user on a certain item in a certain application, for example, a dynamic comment operation issued by a friend in a communication application, or a comment operation on a merchant in takeaway software, or the like; the data entry operation of the user may also refer to a reply operation of the user to an instant messaging message of a certain friend, for example, an entry operation of the user to a message sent to the friend in a chat page between the user of the messaging application and the friend of the user, and the like. It will be appreciated that the above-described user data entry operations are merely examples, and in fact, a user data entry operation may be any operation that a user triggers to display a virtual keyboard. In other words, when the user wants to enter data in the terminal device, the terminal device may display the virtual keyboard in response to the user's relevant operation, where the user's relevant operation may refer to a click operation or the like of the user on the input box. Alternatively, the virtual keyboard displayed here may also be a virtual keyboard that has been resized.
Step S102, responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard;
specifically, after the terminal device displays the virtual keyboard, the terminal device may respond to a trigger operation of a user for the virtual keyboard, and acquire user operation behavior data of the user for the virtual keyboard. And, the current display state of the virtual keyboard may be referred to as a first display state. In other words, the first display state refers to a display state of the virtual keyboard before the terminal device responds to a triggering operation of the user on the virtual keyboard. The trigger operation for the virtual keyboard may refer to a movement operation of the user for the virtual keyboard, where the movement operation may be a gesture sliding operation of the user in the virtual keyboard, and the movement operation may also be an eye-gaze movement operation of the user for the virtual keyboard. Furthermore, the triggering operation for the virtual keyboard may also refer to a voice control operation for the virtual keyboard by the user. Or, a keyboard expansion button may be provided in the virtual keyboard, and the keyboard expansion button is used to change the keyboard size of the virtual keyboard, for example, the keyboard expansion button may be used to enlarge the keyboard size of the virtual keyboard or reduce the keyboard size of the virtual keyboard, so as to trigger the virtual keyboard, a click instruction of the user for the keyboard expansion button may also be referred to, and optionally, the click instruction may also be a long-time press instruction or any other gesture operation instruction.
The display state of the virtual keyboard mainly refers to a state of a keyboard size displayed by the virtual keyboard in a terminal page, and the keyboard size can refer to a keyboard height of the virtual keyboard. Optionally, in some scenarios, the keyboard size may also refer to a keyboard width size of the virtual keyboard, for example, when a terminal page displayed by the terminal device has a larger width, the virtual keyboard may be displayed in the terminal page of the terminal device as a different keyboard width. Therefore, the first display state may refer to a display state when the size of the keyboard is the smallest when the virtual keyboard is not expanded, and the first display state may also refer to a display state when the size of the keyboard is larger than the smallest size of the keyboard after the virtual keyboard is expanded.
When the trigger operation for the virtual keyboard is the movement operation, the user operation behavior data acquired by the terminal device may include a movement track corresponding to the movement operation. For example, when the movement operation is a gesture sliding operation of the user in the virtual keyboard, the movement trajectory in the user operation behavior data may be a trajectory of the gesture sliding of the user in the virtual keyboard. For another example, when the movement operation is an eye gaze movement operation of the user with respect to the virtual keyboard, the movement trajectory in the user operation behavior data may be a movement trajectory of an eye gaze position when the user gazes at the virtual keyboard.
More specifically, when the triggering operation for the virtual keyboard is a voice control operation, the user behavior operation data acquired by the terminal device may be voice audio data entered by the user, where the voice audio data is a voice audio indicating how the virtual keyboard is stretched and contracted by the user, that is, a voice audio indicating how the virtual keyboard adjusts the size of the keyboard.
More, when the triggering operation for the virtual keyboard is a click operation for a keyboard telescopic button, the user behavior operation acquired by the terminal device may be the number of clicks of the keyboard telescopic button by the user. Or, when the triggering operation for the virtual keyboard is a long-press operation for a keyboard telescopic button, the user behavior operation acquired by the terminal device may be a long-press time of the user for the keyboard telescopic button.
Step S103, displaying the virtual keyboard from the current first display state to a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes;
specifically, the terminal device may switch and display the virtual keyboard from a current first display state to a second display state indicated by the acquired user operation behavior data. When the triggering operation for the virtual keyboard is a moving operation, the terminal device may acquire a moving track in the user operation behavior data, and the terminal device may also acquire a moving start position and a moving end position of the moving track.
If the movement operation is the gesture sliding operation, the track starting point of the movement track may refer to a gesture position when the user starts sliding the virtual keyboard, and the track ending point of the movement track may refer to a gesture position when the user stops sliding the virtual keyboard. In this case, the movement track is a gesture sliding track from the track starting point to the track ending point of the user.
If the movement operation is the eye fixation movement operation, the eye fixation movement operation is triggered by a related instruction. For example, when the terminal device detects that the user blinks continuously 3 times (or other times) within a threshold time (which may be set by itself), the eye-gaze movement operation may be triggered, and the gaze position where the user gazes at the virtual keyboard at this time is used as the track starting point of the movement track. Then, when the terminal device detects that the user blinks continuously for 3 times within the threshold time again, the terminal device may acquire the gaze position where the user gazes at the virtual keyboard at that time as the trajectory end point of the movement trajectory. In this case, the movement trajectory is an eye-gazing trajectory of the user from the trajectory starting point to the trajectory ending point.
The terminal device may obtain a movement start position and a movement end position included in the movement trajectory. Specifically, the movement operation of the user on the virtual keyboard may be a continuous operation, for example, continuously sliding from one position to another position in the virtual keyboard without disengaging the virtual keyboard during the sliding. Therefore, the terminal device can acquire a plurality of moving positions of the user during the execution of the moving operation during the response of the user to the moving operation of the virtual keyboard. For example, during a moving operation performed by the user, the terminal device may acquire a moving position every 1 millisecond according to the time interval. Or the terminal device may acquire a moving position every 1 mm according to the distance interval. In other words, the terminal device may acquire a plurality of moving positions in the moving trajectory, where the plurality of moving positions are generated by one moving operation of the user on the virtual keyboard.
Therefore, assuming that the plurality of movement positions of the movement trajectory acquired by the terminal device include the movement position x, when the movement position x is taken as the movement termination position, the last movement position of the acquired movement position x may be taken as the movement start position. When the movement position x is set as the movement start position, the movement position next to the acquired movement position x may be set as the movement end position.
Therefore, it can be understood that, in response to the movement operation by the user, the terminal device may acquire a plurality of movement positions, and of the plurality of movement positions, movement positions other than the movement position acquired last may be used as the movement start position, and of the plurality of movement positions, movement positions other than the movement position acquired first may be used as the movement end position. The last acquired moving position is a moving start position of the currently acquired moving position, and the next acquired moving position is a moving end position of the currently acquired moving position. In other words, any two adjacent mobile positions among the plurality of mobile positions acquired by the terminal device may be a pair of the mobile start position and the mobile end position.
The terminal device may calculate a moving distance of the user with respect to the virtual keyboard according to the moving starting position and the moving ending position, where the moving distance may be a distance between the moving starting position and the moving ending position in a horizontal direction in the terminal page, or the moving distance may also be a distance between the moving starting position and the moving ending position in a vertical direction in the terminal page. The terminal device may further detect a moving direction of the moving operation, which includes an upward movement and a downward movement, based on the movement start position and the movement end position.
The terminal device can judge the moving direction of the moving operation according to the size relation between the heights of the moving starting position and the moving ending position in the vertical direction. Here, the height of the movement position in the vertical direction may be simply referred to as a vertical height. That is, the terminal device may detect a magnitude relationship between a vertical height of the movement start position and a vertical height of the movement end position, and when the terminal device detects that the vertical height of the movement start position is greater than the vertical height of the movement end position, it may be considered that the movement operation performed by the user is sliding downward in the virtual keyboard, and the terminal device may determine that the movement direction is downward movement. When the terminal device detects that the vertical height of the movement starting position is smaller than the vertical height of the movement ending position, the movement operation performed by the user may be considered to be sliding upwards in the virtual keyboard, and the terminal device may determine that the movement direction is upwards movement.
Optionally, the terminal device may further determine the moving direction of the moving operation according to a position relationship between the moving start position and the moving end position in the horizontal direction. When the terminal device detects that the movement starting position is in the horizontal direction and is on the left side of the movement ending position, the movement operation performed by the user can be considered as sliding to the right in the virtual keyboard, and the terminal device can use the upward movement as the movement direction. When the terminal device detects that the movement start position is in the horizontal direction, at the right side of the movement end position, it may be considered that the movement operation performed by the user is to slide leftward in the virtual keyboard, and the terminal device may take the above-described downward movement as the above-described movement direction.
Then, the terminal device may calculate the keyboard height of the virtual keyboard in the second display state according to the obtained moving direction, moving distance between the moving start position and the moving end position, and the initial keyboard height of the virtual keyboard. The initial keyboard height of the virtual keyboard refers to the keyboard height of the virtual keyboard in the first display state, in other words, the initial keyboard height of the virtual keyboard is the keyboard height indicated by the first display state of the virtual keyboard. The keyboard height of the virtual keyboard in the second display state may be referred to as a target keyboard height, and therefore, it is understood that the virtual keyboard is displayed from the first display state to the second display state, that is, the virtual keyboard is displayed from the initial keyboard height to the target keyboard height.
The calculation process of the target keyboard height is described in detail below:
specifically, the terminal device may obtain the movement scaling factor, and the movement scaling factor represents a proportional relationship between the height change degree of the virtual keyboard and the movement distance, because the movement distance is the actual distance of the user moving in the virtual keyboard, which is obtained through the movement operation. Therefore, by the above-mentioned moving distance and the moving scale factor, a height adjustment value for the virtual keyboard, which represents a height at which the keyboard height of the virtual keyboard needs to be enlarged or reduced, in other words, a height at which the keyboard height of the virtual keyboard needs to be changed, can be obtained. For example, when the moving distance between the moving start position and the moving end position is 1 cm, the height adjustment value of the virtual keyboard may be 2 cm, and the moving scale factor is 2, which indicates that the height of the virtual keyboard needs to be increased by 2 cm or decreased by 2 cm. The value of the motion scaling factor can be determined according to the actual application scenario, and is not limited to this.
When the moving direction between the moving starting position and the moving ending position is downward movement, the terminal device may subtract the height adjustment value from the initial keyboard height of the virtual keyboard to obtain a target keyboard height of the virtual keyboard, that is, when the moving direction is downward movement, the target keyboard height is a difference between the initial keyboard height and the height adjustment value. In this case, the first display state is a display state in which the keyboard height of the virtual keyboard has been increased, and the terminal device may reduce the keyboard height of the virtual keyboard whose keyboard height has been increased by responding to a trigger operation of the user on the virtual keyboard.
When the moving direction between the moving starting position and the moving ending position is upward movement, the terminal device may obtain a target keyboard height of the virtual keyboard by adding the height adjustment value to the initial keyboard height of the virtual keyboard, that is, when the moving direction is upward movement, the target keyboard height is the sum of the initial keyboard height and the height adjustment value. The first display state is a display state in which the keyboard height of the virtual keyboard is not increased or not increased to the maximum value, and the terminal device can increase the keyboard height of the current virtual keyboard by responding to the triggering operation of the user on the virtual keyboard.
The height adjustment value for the virtual keyboard is obtained through the movement proportionality coefficient, and then the keyboard height of the virtual keyboard is adjusted to the target keyboard height through the height adjustment value, so that the effect that the keyboard height of the virtual keyboard can be increased or decreased along with the gesture or the eye gaze track of the user according to the movement operation of the user on the virtual keyboard is achieved. That is, the highest keyboard height and the lowest keyboard height of the virtual keyboard can be set, and the terminal device can respond to the movement operation of the user for the virtual keyboard and adjust the keyboard height of the virtual keyboard to any one of the highest keyboard height and the lowest keyboard height.
For example, when the moving operation is an operation of sliding the virtual keyboard upward by the user, the virtual keyboard may be continuously raised in the form of animation when the user slides the virtual keyboard upward, and the keyboard height of the virtual keyboard may also be stopped being raised when the user stops sliding the virtual keyboard upward. Alternatively, when the moving operation is an operation in which the user slides down the virtual keyboard, the virtual keyboard may be continuously lowered in the form of animation when the user slides down the virtual keyboard, and the keyboard height of the virtual keyboard also stops being lowered when the user stops sliding down the virtual keyboard. In this case, it can be understood that there may be a plurality of display states of the virtual keyboard, the plurality of display states correspond to a plurality of virtual keyboards having different keyboard heights, the first display state may be any one display state of the virtual keyboard, and the second display state may be a next display state of the first display state.
Referring to fig. 4, fig. 4 is a schematic view illustrating a scene of a change of a telescopic display state of a keyboard according to the present application. When the movement track of the user is a track from the position 100g to the position 101g, and the terminal device may acquire 6 movement positions in the movement track, where the 6 movement positions are positions in the movement track corresponding to the same trigger operation of the virtual keyboard by the user, in other words, the 6 movement positions may be 6 positions that the user slides to in a process of sliding up the virtual keyboard (a process of sliding up once). The 6 shift positions are shift position L1, shift position L2, shift position L3, shift position L4, shift position L5, and shift position L6, respectively. The moving position L1 is the position 100g, and the moving position L6 is the position 101 g.
It is assumed that the vertical heights of the movement position L1, the movement position L2, the movement position L3, the movement position L4, the movement position L5 and the movement position L6 in the vertical direction become gradually larger, that is, the movement locus of the position 100g to the position 101g is a locus of a user sliding up in the virtual keyboard. First, when the user slides to the movement position L1, the display state T1 of the virtual keyboard at this time may be set as the first display state described above. When the user slides from the moving position L1 to the moving position L2, the keyboard height of the virtual keyboard may also be correspondingly increased, and the increased keyboard height of the virtual keyboard may be referred to the above process, for example, according to the moving distance and the moving scale factor. When the user slides from the moving position L1 to the moving position L2, the display state T2 of the virtual keyboard at this time can be set as the second display state, and thus the 1 st time of displaying the virtual keyboard from the first display state to the second display state is completed.
Then, the display state T2 of the virtual keyboard may be set as the first display state of the virtual keyboard again, the keyboard height of the virtual keyboard may be correspondingly increased when the user slides from the moving position L2 to the moving position L3, and the display state T3 corresponding to the moving position L3 may be set as the second display state of the virtual keyboard, so that the 2 nd time of displaying the virtual keyboard from the first display state to the second display state is completed.
Then, the display state T3 at this time may be re-set as the first display state of the virtual keyboard, and when the user slides from the moving position L3 to the moving position L4, the keyboard height of the virtual keyboard is correspondingly increased, and the display state T4 corresponding to the moving position L4 at this time may be set as the second display state of the virtual keyboard, so that the 3 rd time of displaying the virtual keyboard from the first display state to the second display state is completed.
Then, the display state T4 at this time may be re-set as the first display state of the virtual keyboard, and when the user slides from the moving position L4 to the moving position L5, the keyboard height of the virtual keyboard is correspondingly increased, and the display state T5 corresponding to the moving position L5 at this time may be set as the second display state of the virtual keyboard, so that the 4 th time of displaying the virtual keyboard from the first display state to the second display state is completed.
Finally, the display state T5 at this time may be re-set as the first display state of the virtual keyboard, and when the user slides from the moving position L5 to the moving position L6, the keyboard height of the virtual keyboard is correspondingly increased, and the display state T6 corresponding to the moving position L6 at this time may be set as the second display state of the virtual keyboard, so that the 5 th time of switching the display of the virtual keyboard from the first display state to the second display state is completed.
As can be seen from the above, the terminal device may continuously increase the keyboard height of the virtual keyboard in response to the user's moving operation on the virtual keyboard, and the virtual keyboard may be displayed from the first display state to the second display state multiple times in the process.
Therefore, it can be understood that when the movement position L1 is taken as the movement start position, the movement end position is the movement position L2; when the movement start position is set to the movement position L2, the movement end position is the movement position L3; when the movement start position is set to the movement position L3, the movement end position is the movement position L4; when the movement start position is set to the movement position L4, the movement end position is the movement position L5; when the movement start position is set to the movement position L5, the movement end position is the movement position L6. In other words, a pair of the movement ending position and the movement starting position can be formed between any two adjacent movement positions.
It is emphasized again that the above-mentioned moving position L1, moving position L2, moving position L3, moving position L4, moving position L5 and moving position L6 are obtained during one continuous moving operation by the user. Therefore, if more than 2 moving positions in one moving track are obtained, in the process that the user performs the moving operation to obtain the moving track corresponding to the moving operation, the virtual keyboard is switched from the first display state to the second display state for multiple times, so that the purpose that the keyboard height of the virtual keyboard can be continuously changed along with the moving operation of the user on the virtual keyboard can be achieved.
Optionally, as long as the terminal device detects that the accelerations corresponding to the two adjacent moving positions in one moving track meet the standard, the keyboard height of the virtual keyboard may be expanded and increased to a fixed height according to the moving direction, or the keyboard height of the virtual keyboard may be reduced and decreased to a fixed height.
In other words, when the user performs a moving operation on the virtual keyboard, the terminal device may continuously obtain a plurality of movement positions to which the moving operation has been recalled, for example, the plurality of movement positions may be the above 6 movement positions. Therefore, as long as the terminal device detects that the acceleration between the pair of movement starting positions and the movement ending positions in the plurality of movement positions meets the criterion, the keyboard height of the virtual keyboard can be increased to a certain fixed keyboard height set by the system, or the keyboard height of the virtual keyboard can be reduced to a certain fixed keyboard height set by the system. The acceleration satisfies the criterion, and the following description may be referred to determine whether the virtual keyboard needs to be displayed from the first display state to the second display state through the second acceleration and the first acceleration. If the virtual keyboard needs to be displayed from the first display state to the second display state, the acceleration is indicated to meet the standard. If the virtual keyboard does not need to be displayed from the first display state to the second display state, it indicates that the acceleration does not meet the criteria. The effect achieved by the method is that the virtual keyboard can be stretched without a user executing a moving operation, and the virtual keyboard can be stretched when the acceleration between two adjacent moving positions meets the standard during the period of executing the moving operation by the user.
The virtual keyboard can comprise a data selection area, the data selection area is an area used for displaying data to be selected, and the data to be selected in the data selection area is used for being browsed by a user and selected as data input into the terminal equipment. Therefore, the above-mentioned increasing the keyboard height of the virtual keyboard may refer to increasing the area height of the data selection area of the virtual keyboard, and by increasing the area height of the data selection area, the keyboard height of the virtual keyboard may also be increased accordingly. Similarly, the keyboard height of the virtual keyboard is reduced, that is, the area height of the data selection area of the virtual keyboard is reduced, and by reducing the area height of the data selection area, the keyboard height of the virtual keyboard is also reduced correspondingly.
For example, it is understood that the area size of the data selection area included in the virtual keyboard in the first display state may be a first area size, and the area size of the data selection area included in the virtual keyboard in the second display state may be a second area size. Wherein the first region size and the second region size are different region sizes. In the process of displaying (switching display or adjusting display) the virtual keyboard from the first display state to the second display state, correspondingly, the data selection area in the virtual keyboard is displayed from the first area size to the second area size. In other words, the area size of the data selection area in the first display state is the first area size, and the area size of the data selection area in the second display state is the second area size. The first region size and the second region size may be sizes that include different region heights.
When the first area size is smaller than the second area size, it may be indicated that the area height of the data selection area is increased, and after the area height of the data selection area is increased, the data to be selected in the data selection area is re-laid out and displayed, so that more data to be selected may be displayed in the data selection area with the increased area height for the user to browse and select.
Similarly, when the first area size is larger than the second area size, it may indicate that the area height of the data selection area is reduced, and after the area height of the data selection area is reduced, the data to be selected in the data selection area is rearranged and displayed, so that the data to be selected displayed in the data selection area with the reduced area height may be reduced.
The data to be selected in the data selection area may be video data, document data, expression data, picture data, or sticker data. The step of displaying the data to be selected in the data selection area in a re-layout manner may be to keep the data to be selected displayed in the data selection area before the height of the area is increased unchanged, and display more other data to be selected in a newly added area in the data selection area after the height of the area is increased.
The terminal device can also calculate the acceleration of the user in the vertical direction and the acceleration of the user in the horizontal direction with respect to the movement operation of the virtual keyboard through the movement starting position and the movement ending position. For convenience of description, the acceleration of the moving operation in the vertical direction may be referred to as a first acceleration, and the acceleration of the moving operation in the horizontal direction may be referred to as a second acceleration. The terminal device may determine whether to switch the virtual keyboard from the first display state to the second display state according to the first acceleration.
Here, the first acceleration and the second acceleration refer to accelerations between the movement start position and the movement end position. The first acceleration may be calculated by a movement time from the movement start position to the movement end position and a vertical distance in a vertical direction between the movement start position and the movement end position when the user performs the moving operation. The second acceleration may be calculated by a movement time from the movement start position to the movement end position and a horizontal distance in a horizontal direction between the movement start position and the movement end position when the user performs the moving operation.
The terminal device may determine whether the virtual keyboard needs to be displayed from the first display state to the second display state only by the first acceleration. Specifically, when the first acceleration is greater than the first acceleration threshold, the terminal device may display the virtual keyboard from the first display state to the second display state, for example, adjust the initial keyboard height of the virtual keyboard to the target keyboard height. Conversely, when the first acceleration is less than or equal to the first acceleration threshold, the virtual keyboard can be kept in the first display state for displaying, that is, the virtual keyboard is not switched from the first display state to the second display state for displaying. The specific value of the first acceleration threshold may be set according to an actual application scenario, which is not limited to this.
The terminal device can also jointly judge whether the virtual keyboard needs to be switched from the first display state to the second display state or not through the first acceleration and the second acceleration. Specifically, the terminal device may obtain the acceleration reference value through the second acceleration and the first acceleration. Wherein, the second acceleration is recorded as a1The first acceleration is a2The acceleration reference value is a3Then, then
Figure BDA0002527286720000181
The acceleration reference value may be understood as a hypotenuse acceleration of the first acceleration and the second acceleration, which may characterize the actual acceleration of the user when performing the triggering operation.
In other words, it is understood that the first acceleration, the second acceleration and the acceleration reference value may form a right triangle, the acceleration reference value is the hypotenuse of the right triangle, and the first acceleration and the second acceleration are the two legs of the right triangle. When the second acceleration is greater than the first acceleration and the acceleration reference value is greater than or equal to the second acceleration threshold, the virtual keyboard may be displayed from the first display state to the second display state. Conversely, when the second acceleration is smaller than the first acceleration or the acceleration reference value is smaller than the second acceleration threshold, the virtual keyboard can be kept in the first display state for displaying, that is, the virtual keyboard is not displayed from the first display state to the second display state. The second acceleration threshold may also be set according to an actual application scenario, which is not limited to this. For example, the second acceleration threshold may be
Figure BDA0002527286720000191
Namely when
Figure BDA0002527286720000192
The virtual keyboard may be displayed from a first display state to a second display state, where 320 and 820 may be in pixels/millisecond.
Alternatively, the display states of the virtual keyboard may include only two display states, one being an original display state and the other being an extended display state. The original display state is a display state in which the keyboard height of the virtual keyboard is not increased, and generally, when the virtual keyboard is initially displayed in the terminal page, the display state of the virtual keyboard can be the original display state. The extended display state is a display state in which the keyboard height of the virtual keyboard is increased, and the extended display state is a display state in which the keyboard height of the virtual keyboard is increased to a certain fixed keyboard height, which may be a certain keyboard height set by a developer. Therefore, the first display state of the virtual keyboard may be an original display state or an expanded display state.
When the terminal device determines the first acceleration and/or the second acceleration through the user operation behavior data and meets the condition that the virtual keyboard is displayed from the first display state to the second display state, the terminal device may acquire a keyboard adjustment height for the virtual keyboard, where the keyboard adjustment height is used to indicate whether the virtual keyboard is displayed in an original display state or an extended display state. The values of the keyboard adjusting height are two, one is the extended keyboard height, and the other is the original keyboard height. The display state of the virtual keyboard at the height of the extended keyboard is the extended display state, and the display state of the virtual keyboard at the height of the original keyboard is the original display state.
And if the terminal equipment obtains that the moving direction aiming at the trigger operation is downward movement according to the user operation behavior data, which indicates that the user wants to reduce the height of the keyboard of the virtual keyboard, the height of the keyboard generated by the terminal equipment is adjusted to be the original height of the keyboard. And if the terminal equipment obtains that the moving direction aiming at the trigger operation is upward movement according to the user operation behavior data, which indicates that the user wants to improve the keyboard height of the virtual keyboard, the keyboard adjusting height generated by the terminal equipment is the extended keyboard height.
Therefore, when the terminal device detects that the first display state of the virtual keyboard is the original display state and the keyboard adjustment height is the extended keyboard height, the terminal device may display the virtual keyboard from the original display state to the extended display state, that is, adjust the keyboard height of the virtual keyboard from the original keyboard height to the extended keyboard height.
When the terminal device detects that the first display state of the virtual keyboard is the extended display state and the keyboard adjustment height is the original keyboard height, the terminal device may display the virtual keyboard from the extended display state to the original display state, that is, adjust the keyboard height of the virtual keyboard from the extended keyboard height to the original keyboard height.
When the terminal device detects that the first display state of the virtual keyboard is the extended display state and the keyboard adjustment height is the extended keyboard height, the terminal device may keep the virtual keyboard in the extended display state, that is, keep the keyboard height of the virtual keyboard as the extended keyboard height.
When the terminal device detects that the first display state of the virtual keyboard is the original display state and the keyboard adjustment height is the original keyboard height, the terminal device may keep the virtual keyboard in the original display state, that is, keep the keyboard height of the virtual keyboard unchanged as the original keyboard height.
Optionally, when the triggering operation for the virtual keyboard is a voice control operation, the user operation behavior data acquired by the terminal device may be voice audio data corresponding to the voice control operation. The terminal device may perform voice recognition on the voice audio data to obtain a second state change parameter for the virtual keyboard, where the second state change parameter is also a parameter for indicating how to adjust the keyboard height of the virtual keyboard.
For example, when the terminal device performs voice recognition on the voice audio data to recognize that the voice content input by the user is "increase the height of the keyboard by a little", the terminal device may obtain a unit change height for the virtual keyboard, where the unit change height may be a certain fixed height preset by the system, and increasing the height of the keyboard by a little may mean increasing the height of the keyboard of the virtual keyboard by the unit change height. Therefore, here, the second state change parameter may be the unit change height, and the terminal device may increase the keyboard height of the virtual keyboard by the unit change height. The virtual keyboard without the unit change height being increased is in the first display state, and the virtual keyboard with the unit change height being increased is in the second display state.
Optionally, when the triggering operation for the virtual keyboard is a click operation of a user on a keyboard telescopic button in the virtual keyboard, the user operation behavior data acquired by the terminal device may be a click number of the user on the keyboard telescopic button. The user may increase or decrease the height of the virtual keyboard by the unit change height every time the user clicks (or other times), and the terminal device may calculate a product between the number of times the user clicks the retractable button of the keyboard and the unit change height as the height of the virtual keyboard that needs to be changed, for example, increase the height of the keyboard by 5 cm or decrease the height of the keyboard by 5 cm.
When the triggering operation for the virtual keyboard is a long-time pressing operation of a user for a keyboard telescopic button in the virtual keyboard, the user operation behavior data acquired by the terminal device may be a long-time pressing operation of the user for the keyboard telescopic button. The user can increase or decrease the keyboard height of the virtual keyboard by the unit change height every 1 second (or other unit time), and the terminal device can calculate the product of the long pressing time of the user for the keyboard telescopic button and the unit change height as the height of the virtual keyboard to be changed, for example, increasing the keyboard height by 5 cm or decreasing the keyboard height by 5 cm.
Two keyboard telescopic buttons can be provided in the virtual keyboard, one keyboard telescopic button is used for improving the keyboard height of the virtual keyboard, and the other keyboard telescopic button is used for reducing the keyboard height of the virtual keyboard. Alternatively, only one keyboard telescopic button may be provided, and when a click operation is performed on the keyboard telescopic button, the keyboard height of the virtual keyboard may be increased, and when a long-time press operation is performed on the keyboard telescopic button, the keyboard height of the virtual keyboard may be decreased.
Please refer to fig. 5a, fig. 5a is a schematic view of a keyboard expansion and contraction scenario provided in the present application. As shown in fig. 5a, the terminal page 100b is a chat page between the user and each of the users, where each of the users sends a message "day-to-day up" to each of the users, and each of the users sends a message "good learning" to each of the users. The terminal device may display the virtual keyboard 109b in response to the user's day-to-day message entry operations. Next, the terminal device may display the terminal page 103b in response to a daily sliding operation of the user with respect to the data selection area 102b in the virtual keyboard 109b, where the sliding operation is the above-mentioned trigger operation with respect to the virtual keyboard. As shown in the terminal page 103b, the terminal device raises the area height of the data selection area 102b by responding to the user's upward sliding operation with respect to the data selection area 102b, resulting in a data selection area 104 b. 8 pictures are shown in the data selection area 102b, and the 8 pictures are data to be selected in the data selection area 102 b. Compared with the data selection area 102b, the data selection area 104b shows more data to be selected, and specifically, the data selection area 104a displays more 4 pictures besides 8 pictures in the data selection area 102 b.
Please refer to fig. 5b, and fig. 5b is a schematic view of a keyboard expansion and contraction scenario provided in the present application. The terminal page 100b in fig. 5b is the terminal page 100b in fig. 5a, and the user can wake up the voice manipulation function of the virtual keyboard by using the voice "hi keyboard", and the operation of waking up the voice manipulation function can be referred to as the above-mentioned voice control operation. The voice of the wake-up may also be other voices, such as "come from home, come from keyboard", and the like. After the voice control function of the virtual keyboard is awakened, the terminal device can acquire the voice audio data recorded by the user, and after the terminal device performs voice recognition on the voice audio data, the content "turn the keyboard up a bit" in the display frame 106b can be recognized. Then, the terminal device may raise the area height of the data selection area by the unit change height according to the content "raise the keyboard a little bit", and display the terminal page 107 b. As shown in the terminal page 107b, the data selection area 108b is a data selection area obtained by increasing the area height of the data selection area 102b by a unit change height, where the unit change height may refer to the height of a line of data to be selected, that is, the height of a picture.
More specifically, the virtual keyboard displayed in step S101 may be displayed by the terminal device in response to a comment operation of the user on comment data in the comment page, in which case, the terminal device may display not only the virtual keyboard but also a comment reference page, where the comment reference page includes comment data of the comment operation performed by the user, that is, comment data that the user wants to comment on. The comment reference page may be a sub-page independently displayed on the comment page, and the virtual keyboard displayed in the terminal page and the comment data that the user wants to comment on in the comment reference page do not overlap with each other. In other words, the virtual keyboard displayed in the terminal page does not obstruct comment data that the user wants to comment on the comment reference page. For example, referring to fig. 2a, a page where the dynamic state 111a in fig. 2a is located may be referred to as the comment page, the comment sub-page 110a may be referred to as the comment reference page, the comment 101a in the comment sub-page 110a is comment data that the user wants to comment, and the comment data 101a in the comment sub-page 110a are not overlapped with each other by the virtual keyboard 102 a.
Then, the terminal device may respond to a trigger operation of the user for the virtual keyboard, and obtain a page view control component (UIViewController) of the comment reference page. It should be noted that each page may correspond to a page view control component, and the page view control component is allocated to the application program where each page is located. The comment reference page is the topmost page displayed in the terminal device, namely the top page, so that the page view control component of the comment reference page can be called as a top page view control component. It can be understood that both the virtual keyboard and the comment reference page can be child objects in the top page, and the virtual keyboard can judge the keyboard state switching permission of the current virtual keyboard through the top page view control component, that is, judge whether the virtual keyboard has the keyboard state switching permission.
The keyboard state switching authority can be realized by a keyboard scaling protocol written in an application program where an input keyboard is located by a developer. In other words, if the keyboard scaling protocol is written in the application program in which the virtual keyboard is located, the top page view control component may determine that the virtual keyboard has the keyboard scaling right according to the keyboard scaling protocol. Or the keyboard expansion and contraction authority can also be set by the user, for example, the virtual keyboard can be a keyboard application, a keyboard expansion and contraction setting function can be provided in the terminal device, and the user can trigger the setting function, so that the keyboard application can expand and contract in any terminal page, that is, the virtual keyboard has the keyboard state switching authority in any terminal page, and the top page view control component can detect the keyboard state switching authority set by the user for the keyboard application.
When the terminal device detects that the virtual keyboard has the keyboard expansion right through the top page view control component, the terminal device can acquire the user operation behavior data for the virtual keyboard and can switch and display the virtual keyboard from a first display state to a second display state indicated by the user operation behavior data. When the terminal device detects that the virtual keyboard does not have the keyboard stretching right through the top page view control assembly, the virtual keyboard is indicated to be not stretchable, namely the keyboard size of the virtual keyboard cannot be changed, the terminal device does not need to acquire the user operation behavior data, and under the condition, the terminal device can enable the virtual keyboard to be in the first display state.
Further, the virtual keyboard in the second display state may be referred to as a target virtual keyboard. The terminal equipment can acquire the position relation between comment data which the user wants to comment in the comment reference page and the target virtual keyboard through the top page view control component. The terminal equipment can obtain the self-adaptive page position of the comment quotation page on the comment page through the position relation. By adjusting the page position of the comment reference page to the self-adaptive page position, the target virtual keyboard can prevent comment data which the user wants to comment in the comment reference page from being shielded, namely, the comment data are not overlapped. The page position of the top page where the comment reference page is located in the terminal page can be adjusted, so that the target virtual keyboard does not shield comment data which the user wants to comment in the comment reference page. The position relationship may be an overlapping position relationship between the target virtual keyboard and comment data that the user wants to comment on in the comment reference page. For example, referring to fig. 2a, the input keyboard 106a in the terminal page 104a of fig. 2a may be referred to as the target virtual keyboard. The comment subpage 112a in the terminal page 104a is a comment reference page adjusted to the adaptive page position, and the page position of the comment subpage 110a in the terminal page 100a is adjusted to the adaptive page position of the comment subpage 112a in the terminal page 104a, so that the height of the keyboard of the input keyboard 102a is increased to obtain a target virtual keyboard, and the comment data 101a which the user wants to comment on in the comment subpage 112a is not shielded, and the comment data 101a can be conveniently viewed by the user.
Optionally, when the user comments on the comment data in the comment page, the terminal device may only display the virtual keyboard on the comment page, instead of displaying the comment reference page. Under the condition, comment data commented by the user in the comment page is required to be displayed above the virtual keyboard, so that the comment data commented by the user in the comment page cannot be shielded by the virtual keyboard. Similarly, when the keyboard height of the virtual keyboard is increased or decreased to obtain the target virtual keyboard, the data position of the data in the comment page in the terminal page needs to be correspondingly adjusted, so that the comment data commented by the user in the comment page is displayed above the target virtual keyboard, that is, the comment data commented by the user in the comment page is not shielded by the target virtual keyboard. If the height of the keyboard of the virtual keyboard is increased, the adjustment of the data position in the comment page means that all data (including comment data of the user) displayed in the comment page are displayed in a sliding manner, so that the position of the comment data of the user in the comment page in the whole terminal page is moved upwards, and the height of the upwards movement can be the same as the height of the keyboard increased by the virtual keyboard. On the contrary, if the keyboard height of the virtual keyboard is reduced, the data displayed in the comment page is equivalently displayed in a sliding mode, so that the comment data commented by the user in the comment page is moved downwards in the whole terminal page, and the height of the downward movement can be the same as the height of the keyboard reduced by the virtual keyboard.
More, the keyboard height of the virtual keyboard can be adjusted by the virtual keyboard itself, or the virtual keyboard informs the top page view control component of the event that the keyboard height needs to be adjusted, and the event is adjusted by the top page view control component. For example, the terminal device may synchronize the obtained user operation behavior data to the page view control component through a virtual keyboard. The page view control component may generate a first state change parameter corresponding to the user operation behavior data, where the first state change parameter is also a parameter for indicating how a keyboard size of the virtual keyboard changes, and for example, the first state change parameter may be the second state change parameter or the third state change parameter. The page view control component may display the virtual keyboard from a first display state to a second display state of the virtual keyboard indicated by the first state change parameter. The first state change parameter generated by the page view control component may not be generated by the user behavior operation data, but may be generated by a developer by writing the first state change parameter into an application program where the virtual keyboard is located in advance, and adjusting the keyboard height of the virtual keyboard to which fixed height is fixed, for example, the keyboard height of the virtual keyboard may be adjusted to an original keyboard height indicated by the original display state, or the keyboard height of the virtual keyboard may be adjusted to an extended keyboard height indicated by the extended display state.
Please refer to fig. 6, fig. 6 is a schematic view illustrating a keyboard expansion and contraction scenario provided in the present application. As shown in fig. 6, when the user edits the personalized signature, the terminal device may also increase the keyboard height of the virtual keyboard in response to the user's upward sliding operation on the virtual keyboard. The terminal page 100c includes a data entry area 101c and a virtual keyboard 102c, and a personality signed by a user edited in the data entry area 101c is "good person", but a user still wants to keep smiling/forgiving the life of the user and does not lay a favorite free ". The data to be selected displayed in the data selection area of the virtual keyboard 102c is a sticker, and the terminal device may respond to an upward sliding operation of the user on the virtual keyboard 102c, expand the keyboard height of the virtual keyboard 102c, and display the terminal page 103 c. As shown in the terminal page 103c, the virtual keyboard 105c is a virtual keyboard obtained by increasing the keyboard height of the virtual keyboard 102a, and more stickers than the virtual keyboard 102c are displayed in the virtual keyboard 105 c. It should be noted that the virtual keyboard 102a and the virtual keyboard 105c are actually the same virtual keyboard, and only the virtual keyboard 102a and the virtual keyboard 105c are in different telescopic display states of the same virtual keyboard.
Please refer to fig. 7, fig. 7 is a schematic view illustrating a scene of keyboard expansion and contraction according to the present application. As shown in fig. 7, the terminal page 100d may be a dynamic page of friends of the user day, and the terminal page 100d includes a dynamic 101d of friends of the user day. The terminal device may display the virtual keyboard 105d in the terminal page, that is, display the terminal page 104d, in response to a comment operation of the user for the dynamic state 101d every day. The comment operation of the user on the dynamic state 101d every day may refer to a click operation of the user on the comment button 102d in the terminal page 100d every day, or a click operation of the user on the input box 103d every day. A plurality of emoticons are displayed in the data selection area of the virtual keyboard 105d, the terminal device 105d may respond to the user's up-sliding operation on the data selection area of the virtual keyboard 105d every day, so as to raise the area height of the data selection area of the virtual keyboard 105d, and when the user stops the up-sliding operation in the data selection area, the virtual keyboard 107d is obtained, that is, the terminal page 106d is displayed. Virtual keyboard 107d exhibits more emoticons than virtual keyboard 105 d. Then, the terminal device may further continue to increase the area height of the data selection area of the virtual keyboard 107d in response to the user continuing the upward sliding operation on the data selection area in the virtual keyboard 107d every day, and when the user stops the upward sliding operation in the data selection area, obtain the virtual keyboard 109d, that is, display the terminal page 108 d. In this case, the terminal device may continue to increase the area height of the data selection area in the virtual keyboard 109d in response to the user's up-sliding operation in the virtual keyboard 109d every day until the highest area height of the data selection area is reached.
Furthermore, it should be noted that, when the virtual keyboard is raised to the highest keyboard height set by the system, the terminal device may also continue to respond to the user's upward sliding operation on the data selection area in the virtual keyboard, keep the keyboard height of the virtual keyboard unchanged, and continue to scroll upward in the data selection area to display other more data to be selected. In this case, the user perceives that the data to be selected originally displayed in the data selection area is moved out of the data selection area from the upper edge of the data selection area and more data to be selected is moved into the data selection area from the lower edge of the data selection area by the sliding-up operation.
Similarly, when the virtual keyboard is raised to the lowest keyboard height set by the system, the terminal device may also continue to respond to the user's downslide operation for the data selection area in the virtual keyboard, keep the keyboard height of the virtual keyboard unchanged, and scroll down and display the data to be selected above the previously browsed data selection area in the data selection area. In this case, the user perceives that the data to be selected, which is originally displayed in the data selection area, is moved out of the data selection area from the lower edge of the data selection area and the other data to be selected is moved into the data selection area from the upper edge of the data selection area through the sliding-down operation.
In addition, when the virtual keyboard is raised to a certain keyboard height to which the user slides, and the sliding operation of the user in the data selection area does not meet the acceleration standard, the current keyboard height may be kept unchanged, that is, the virtual keyboard is not stretched, but the terminal device may scroll the data to be selected shown in the data selection area to display different data to be selected, such as an upward scroll display or a downward scroll display, along with the sliding operation of the user on the data selection area.
The method includes the steps that firstly, a virtual keyboard is displayed; responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data entry efficiency of the user when entering the data through the input keyboard is improved. In addition, as more data can be displayed in the telescopic virtual keyboard for the user to check, the user can quickly search the required data in the telescopic virtual keyboard without frequently operating the virtual keyboard to search the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequent operation of the virtual keyboard may refer to frequent page change and viewing of data in the virtual keyboard.
Please refer to fig. 8, fig. 8 is a flowchart illustrating a keyboard retracting method according to the present application. As shown in fig. 8, the method may include:
step S201, a user slides an expression panel;
specifically, the expression panel is a data selection area in the virtual keyboard, a plurality of emoticons are displayed in the data selection area, and when the user slides the expression panel, the terminal device can respond to the sliding operation of the user on the expression panel.
Step S202, receiving a sliding callback;
specifically, the terminal device may obtain a slide callback of the slide operation by responding to the slide operation of the user on the expression panel, where the slide callback is user operation behavior data generated when the user slides the expression panel, and the change of the slide position in the expression panel when the user executes the slide operation may be known by the user operation behavior data.
Step S203, acquiring a topmost page view control component;
specifically, the topmost page view control component, that is, the page view control component of the terminal page displayed on the topmost layer, is the top page view control component described above. The terminal device may obtain the top page view control component.
Step S204, the page view control component judges whether the virtual keyboard accords with a keyboard expansion protocol;
specifically, the terminal device may determine whether the virtual keyboard conforms to the keyboard scaling protocol through the acquired top page view control component. If yes, the following step S205 is executed, and if not, the current process is ended, and the virtual keyboard is not expanded or contracted.
Step S205, the new position is larger than the old position in the vertical direction;
specifically, the terminal device may obtain a new position and an old position of the sliding operation of the expression panel by the user, where the new position is the movement termination position, and the old position is the movement start position. The terminal device may determine whether the height of the movement termination position in the vertical direction is greater than the movement start position. If yes, indicating that the user is performing a slide-up operation on the surface panel, the following step S206 is performed. If not, it indicates that the user is performing a downward sliding operation on the surface board, the following step S207 is performed.
Step S206, the acceleration meets the standard;
specifically, if the acceleration sliding from the movement start position to the movement end position satisfies the criterion, the following step S208 is executed. The acceleration satisfying the criterion may mean that a first acceleration of the movement starting position sliding to the movement ending position is greater than a first acceleration threshold, or that the first acceleration of the movement starting position sliding to the movement ending position is greater than a second acceleration, and the acceleration reference value is greater than or equal to the second acceleration threshold, and the specific criterion may be referred to in step S103. If the acceleration sliding from the movement starting position to the movement ending position does not meet the standard, the virtual keyboard is not stretched, and the current process is finished.
Step S207, the acceleration meets the standard, or the top is already returned;
specifically, if the acceleration of the slide from the above-described movement start position to the movement end position satisfies the criterion, or the slide has been made downward to the upper top of the expression panel, the following step S209 is executed. If the acceleration sliding from the movement starting position to the movement ending position does not meet the standard, the virtual keyboard is not stretched, and the current process is finished.
Step S208, enlarging the height of the keyboard;
specifically, the terminal device may expand the keyboard height of the virtual keyboard to a certain fixed keyboard height, or may correspondingly expand the keyboard height of the virtual keyboard to the keyboard height that the user slides to along with the sliding operation of the user on the expression panel. The specific process of expanding the keyboard height of the virtual keyboard can also be referred to the above step S103.
Step S209, reducing the height of the keyboard;
specifically, the terminal device may reduce the keyboard height of the virtual keyboard to a certain fixed keyboard height, or may correspondingly reduce the keyboard height of the virtual keyboard to the keyboard height that the user slides to along with the sliding operation of the user on the expression panel. The specific process of reducing the keyboard height of the virtual keyboard can also refer to step S103.
Step S210, notifying the event to a page view control component;
specifically, the terminal device may notify the top page view control component of an event that the keyboard height of the virtual keyboard needs to be increased or decreased.
Step S211, whether there is a focus object;
specifically, the top page view control component detects whether there is a focus object in the top page when it is known that the virtual keyboard needs to be enlarged or reduced, where the focus object is an object that the user needs to focus on, and the focus object may be, for example, the comment data 101a in fig. 2 a. If yes, the following step S212 is executed, and if not, the virtual keyboard is completely stretched, and the current process is ended.
Step S212, automatically adjusting the position of the focus object;
specifically, the top page view control component can correspondingly adjust the position of the focus object according to the height of the keyboard after the virtual keyboard is adjusted, so that the focus object is not shielded by the adjusted virtual keyboard. The terminal device can adjust the position of the focus object by adjusting the page position of the top page where the focus object is located. See step S103 above for a specific procedure. When the adjustment of both the keyboard height of the virtual keyboard and the object position of the focus object is completed, the current process is ended.
The method includes the steps that firstly, a virtual keyboard is displayed; responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data entry efficiency of the user when entering the data through the input keyboard is improved. In addition, as more data can be displayed in the telescopic virtual keyboard for the user to check, the user can quickly search the required data in the telescopic virtual keyboard without frequently operating the virtual keyboard to search the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequent operation of the virtual keyboard may refer to frequent page change and viewing of data in the virtual keyboard.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an interface data processing apparatus provided in the present application. The interface data processing means may be a computer program (including program code) running on a computer device, for example the interface data processing means being an application software; the apparatus may be used to perform the corresponding steps in the methods provided by the embodiments of the present application. As shown in fig. 9, the interface data processing apparatus 1 may include: the display module 101, the telescopic response module 102 and the state switching module 103;
a display module 101, configured to display a virtual keyboard;
the telescopic response module 102 is configured to respond to a trigger operation for the virtual keyboard and acquire user operation behavior data for the virtual keyboard;
the state switching module 103 is configured to display a current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data;
the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
For specific implementation of functions of the display module 101, the telescopic response module 102, and the state switching module 103, please refer to steps S101 to S103 in the embodiment corresponding to fig. 3, which is not described herein again.
Wherein the trigger operation comprises a move operation;
the state switching module 103 includes: a data determination unit 10301, a target height determination unit 10302, and a first switching display unit 10303;
a data determination unit 10301 configured to determine a movement direction and a movement distance of the movement operation according to the user operation behavior data;
a target height determining unit 10302 for determining a keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the movement distance, and the movement direction indicated by the first display state, and determining the keyboard height in the second display state as the target keyboard height;
a first switching display unit 10303 for displaying the virtual keyboard from the initial keyboard height as a target keyboard height.
For specific implementation of the functions of the data determining unit 10301, the target height determining unit 10302, and the first switching display unit 10303, please refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
The user operation behavior data comprises a movement track corresponding to movement operation; the moving direction includes upward movement and downward movement;
a direction determination unit 10302 including: a position determining subunit 103011, a distance determining subunit 103012, a first direction determining subunit 103013, and a second direction determining subunit 103014;
a position determining subunit 103011 configured to determine a movement start position and a movement end position of the moving operation based on the movement trajectory;
a distance determining subunit 103012 configured to determine a movement distance from the movement start position and the movement end position;
a first direction determining subunit 103013 for determining the moving direction as upward movement when the vertical height of the movement start position is smaller than the vertical height of the movement end position;
a second direction determining subunit 103014, configured to determine the moving direction as downward movement when the vertical height of the movement start position is greater than the vertical height of the movement end position;
then, the target height determining unit 10302 includes: a change height determination subunit 103021, a first height determination subunit 103022, and a second height determination subunit 103023;
a change height determining subunit 103021, configured to determine a height adjustment value of the virtual keyboard according to the movement distance and the movement scale factor;
a first height determining subunit 103022, configured to determine, when the moving direction is upward movement, the sum of the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state;
a second height determining subunit 103023, configured to determine the difference between the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state when the moving direction is downward movement.
For specific functional implementation of the position determining subunit 103011, the distance determining subunit 103012, the first direction determining subunit 103013, and the second direction determining subunit 103014, please refer to step S103 in the embodiment corresponding to fig. 3, and for specific functional implementation of the change height determining subunit 103021, the first height determining subunit 103022, and the second height determining subunit 103023, refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
Wherein the trigger operation comprises a move operation;
the interface data processing apparatus 1 further includes: a first acceleration acquisition module 104, a first acceleration determination module 105, and a second acceleration determination module 106;
the first acceleration acquisition module 104 is configured to acquire an acceleration of the mobile operation in the vertical direction according to the user operation behavior data;
the first acceleration determination module 105 is configured to, if the acceleration of the mobile operation in the vertical direction is greater than or equal to a first acceleration threshold, perform display of the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data;
and a second acceleration determination module 106, configured to, if the acceleration of the moving operation in the vertical direction is smaller than the first acceleration threshold, keep the virtual keyboard in the first display state for displaying.
For specific implementation of functions of the first acceleration obtaining module 104, the first acceleration determining module 105, and the second acceleration determining module 106, please refer to step S103 in the corresponding embodiment of fig. 3, which is not described herein again.
Wherein the trigger operation comprises a move operation;
the interface data processing apparatus 1 further includes: a second acceleration acquisition module 107, a third acceleration acquisition module 108, a third acceleration determination module 109, and a fourth acceleration determination module 110;
a second acceleration acquisition module 107, configured to acquire, according to the user operation behavior data, an acceleration of the movement operation in the vertical direction and an acceleration of the movement operation in the horizontal direction;
a third acceleration obtaining module 108, configured to determine an acceleration reference value according to an acceleration of the moving operation in the vertical direction and an acceleration of the moving operation in the horizontal direction;
a third acceleration determining module 109, configured to, if the acceleration of the moving operation in the vertical direction is greater than the acceleration of the moving operation in the horizontal direction, and the acceleration reference value is greater than or equal to the second acceleration threshold value, perform displaying of the virtual keyboard from the current first display state to the second display state indicated by the user operation behavior data;
and a fourth acceleration determination module 110, configured to, if the acceleration of the moving operation in the vertical direction is smaller than the acceleration of the moving operation in the horizontal direction, or the acceleration reference value is smaller than the second acceleration threshold, keep the virtual keyboard in the first display state for displaying.
For specific implementation of functions of the second acceleration obtaining module 107, the third acceleration obtaining module 108, the third acceleration determining module 109, and the fourth acceleration determining module 110, please refer to step S103 in the corresponding embodiment of fig. 3, which is not described herein again.
Wherein, the display module 101 is further configured to:
responding to comment operation aiming at comment data in the comment page, and displaying a virtual keyboard and a comment reference page containing the comment data; the virtual keyboard and comment data in the comment reference page are not overlapped;
the comment reference page is a sub-page independently displayed on the comment page.
The telescopic response module 102 includes: a control component acquisition unit 1021 and a permission determination unit 1022;
a control component obtaining unit 1021, configured to obtain a page view control component of a comment reference page in response to a trigger operation for a virtual keyboard; the page view control component refers to a control component in an application program where the page is located for the comment;
the permission determining unit 1022 is configured to obtain user operation behavior data for the virtual keyboard when it is detected that the application has a keyboard state switching permission for the virtual keyboard according to the page view control component.
For a detailed implementation manner of the functions of the control component obtaining unit 1021 and the permission determining unit 1022, please refer to step S103 in the corresponding embodiment of fig. 3, which is not described herein again.
Wherein, interface data processing apparatus 1, still include: a keyboard determining module 111, a page position determining module 112 and a page position adjusting module 113;
a keyboard determining module 111, configured to determine the virtual keyboard in the second display state as a target virtual keyboard;
the page position determining module 112 is used for determining an adaptive page position of the comment reference page above the comment page based on the position relation between the comment data in the comment reference page and the target virtual keyboard and the page view control component;
the page position adjusting module 113 is configured to adjust a page position of the comment reference page to an adaptive page position; the target virtual keyboard and comment data in the comment reference page after position adjustment are not overlapped.
For a specific implementation manner of the functions of the keyboard determining module 111, the page position determining module 112, and the page position adjusting module 113, please refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
The state switching module 103 includes: a data synchronization unit 10304, a first parameter generation unit 10305, and a second switching display unit 10306;
a data synchronization unit 10304 for synchronizing the user operation behavior data to the page view control component based on the virtual keyboard;
a first parameter generating unit 10305, configured to generate, based on the page view control component, a first state change parameter corresponding to the user operation behavior data;
and a second switching display unit 10306 for controlling the virtual keyboard to be displayed in a second display state indicated by the first state change parameter from the first display state based on the page view control component.
For specific implementation of functions of the data synchronization unit 10304, the first parameter generation unit 10305, and the second switching display unit 10306, please refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
The first display state comprises an original display state and an expanded display state;
the state switching module 103 includes: a second parameter generation unit 10307, a third switching display unit 10308, and a fourth switching display unit 10309;
a second parameter generating unit 10307, configured to determine, according to the user operation behavior data, a keyboard adjustment height corresponding to the virtual keyboard; the height of the keyboard is adjusted to be the height of an expanded keyboard or the height of an original keyboard;
a third switching display unit 10308, configured to determine the extended keyboard height as the keyboard height in the second display state and display the virtual keyboard as the extended keyboard height from the original keyboard height in the original display state when the first display state is the original display state and the keyboard adjustment height is the extended keyboard height;
a fourth switching display unit 10309, configured to determine the original keyboard height as the keyboard height in the second display state and display the virtual keyboard as the original keyboard height from the extended keyboard height in the extended display state when the first display state is the extended display state and the keyboard adjustment height is the original keyboard height.
For a specific implementation manner of the functions of the second parameter generating unit 10307, the third switching display unit 10308, and the fourth switching display unit 10309, please refer to step S103 in the corresponding embodiment of fig. 3, which is not described herein again.
Wherein the virtual keyboard comprises a data selection area; the data selection area in the first display state has a first area size; the data selection area in the second display state has a second area size;
the state switching module 103 is specifically configured to:
displaying the virtual keyboard from the first display state to the second display state, displaying the data selection area from the first area size to the second area size, and performing layout display on the data to be selected in the data selection area with the second area size.
Wherein the triggering operation comprises a voice control operation; the user operation behavior data comprises voice audio data corresponding to voice control operation;
the state switching module 103 includes: a voice recognition unit 10310 and a fifth switching display unit 10311;
a voice recognition unit 10310, configured to perform voice recognition on the voice audio data to obtain a second state change parameter for the virtual keyboard;
and a fifth switching display unit 10311 for displaying the virtual keyboard from the first display state to the second display state indicated by the second state change parameter.
For specific functional implementation manners of the voice recognition unit 10310 and the fifth switching display unit 10311, please refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
The method includes the steps that firstly, a virtual keyboard is displayed; responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard; displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data; the virtual keyboard in the first display state has a different keyboard size than the virtual keyboard in the second display state. Therefore, the method provided by the application can stretch the virtual keyboard, so that more data can be displayed in the stretched virtual keyboard for a user to check, the browsing efficiency of the user on the data in the virtual keyboard can be improved, and the data entry efficiency of the user when entering the data through the input keyboard is improved. In addition, as more data can be displayed in the telescopic virtual keyboard for the user to check, the user can quickly search the required data in the telescopic virtual keyboard without frequently operating the virtual keyboard to search the required data, so that the power consumption of the equipment can be reduced, and the data searching efficiency is improved. The frequent operation of the virtual keyboard may refer to frequent page change and viewing of data in the virtual keyboard.
Referring to fig. 10, fig. 10 is a schematic structural diagram of a computer device provided in the present application. As shown in fig. 10, the computer device 1000 may include: the processor 1001, the network interface 1004, and the memory 1005, and the computer device 1000 may further include: a user interface 1003, and at least one communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display) and a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a standard wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 1005 may optionally be at least one memory device located remotely from the processor 1001. As shown in fig. 10, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a device control application program.
In the computer device 1000 shown in fig. 10, the network interface 1004 may provide a network communication function; the user interface 1003 is an interface for providing a user with input; and the processor 1001 may be configured to call the device control application stored in the memory 1005 to implement the description of the interface data processing method in the embodiment corresponding to fig. 3. It should be understood that the computer device 1000 described in this application can also perform the description of the interface data processing apparatus 1 in the embodiment corresponding to fig. 9, and is not described herein again. In addition, the beneficial effects of the same method are not described in detail.
Further, here, it is to be noted that: the present application further provides a computer-readable storage medium, where the computer program executed by the aforementioned interface data processing apparatus 1 is stored in the computer-readable storage medium, and the computer program includes program instructions, and when the processor executes the program instructions, the description of the interface data processing method in the embodiment corresponding to fig. 3 can be performed, so that details are not repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in the embodiments of the computer storage medium referred to in the present application, reference is made to the description of the embodiments of the method of the present application. As an example, program instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network, which may comprise a block chain system.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto but rather by the claims appended hereto.

Claims (15)

1. An interface data processing method is characterized by comprising the following steps:
displaying a virtual keyboard;
responding to the trigger operation aiming at the virtual keyboard, and acquiring user operation behavior data aiming at the virtual keyboard;
displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data;
the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
2. The method of claim 1, wherein the triggering operation comprises a moving operation;
the displaying the virtual keyboard from the current first display state to the second display state indicated by the user operation behavior data includes:
determining the moving direction and the moving distance of the moving operation according to the user operation behavior data;
determining the keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the moving distance and the moving direction indicated by the first display state, and determining the keyboard height in the second display state as a target keyboard height;
and displaying the virtual keyboard as the target keyboard height from the initial keyboard height.
3. The method according to claim 2, wherein the user operation behavior data includes a movement track corresponding to the movement operation; the moving direction includes upward movement and downward movement;
determining the moving direction and the moving distance of the moving operation according to the user operation behavior data, wherein the determining comprises the following steps:
determining a movement starting position and a movement ending position of the movement operation according to the movement track;
determining the moving distance according to the moving starting position and the moving ending position;
determining the moving direction as the upward movement when a vertical height of the movement start position is less than a vertical height of the movement end position;
determining the moving direction as the downward movement when a vertical height of the movement start position is greater than a vertical height of the movement end position;
then, the determining the keyboard height of the virtual keyboard in the second display state according to the initial keyboard height, the moving distance and the moving direction indicated by the first display state includes:
determining a height adjustment value of the virtual keyboard according to the moving distance and the moving scale coefficient;
when the moving direction is the upward movement, determining the sum of the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state;
and when the moving direction is the downward movement, determining the difference between the initial keyboard height and the height adjustment value as the keyboard height of the virtual keyboard in the second display state.
4. The method of claim 1, wherein the triggering operation comprises a moving operation;
the method further comprises the following steps:
acquiring the acceleration of the mobile operation in the vertical direction according to the user operation behavior data;
if the acceleration of the mobile operation in the vertical direction is greater than or equal to a first acceleration threshold, executing the display of the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data;
and if the acceleration of the movement operation in the vertical direction is smaller than the first acceleration threshold, keeping the virtual keyboard to be displayed in the first display state.
5. The method of claim 1, wherein the triggering operation comprises a moving operation;
the method further comprises the following steps:
acquiring the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction according to the user operation behavior data;
determining an acceleration reference value according to the acceleration of the moving operation in the vertical direction and the acceleration of the moving operation in the horizontal direction;
if the acceleration of the movement operation in the vertical direction is larger than the acceleration of the movement operation in the horizontal direction, and the acceleration reference value is larger than or equal to a second acceleration threshold value, displaying the virtual keyboard from the current first display state as a second display state indicated by the user operation behavior data;
and if the acceleration of the movement operation in the vertical direction is smaller than the acceleration of the movement operation in the horizontal direction, or the acceleration reference value is smaller than the second acceleration threshold value, keeping the virtual keyboard to be displayed in the first display state.
6. The method of claim 1, wherein displaying the virtual keyboard comprises:
responding to comment operation aiming at comment data in a comment page, and displaying the virtual keyboard and a comment reference page containing the comment data; the virtual keyboard and the comment data in the comment reference page are not overlapped with each other;
the comment reference page is a sub-page independently displayed above the comment page.
7. The method of claim 6, wherein the obtaining user operation behavior data for the virtual keyboard in response to the triggering operation for the virtual keyboard comprises:
responding to the trigger operation aiming at the virtual keyboard, and acquiring a page view control component of the comment reference page; the page view control component refers to a control component in an application program where the page is located for the comment;
and when detecting that the application program has keyboard state switching right for the virtual keyboard according to the page view control component, acquiring the user operation behavior data for the virtual keyboard.
8. The method of claim 7, further comprising:
determining the virtual keyboard in the second display state as a target virtual keyboard;
determining an adaptive page position of the comment reference page above the comment page based on a positional relationship between the comment data in the comment reference page and the target virtual keyboard and the page view control component;
adjusting the page position of the comment reference page to the self-adaptive page position; the comment data in the target virtual keyboard and the comment reference page after position adjustment are not overlapped.
9. The method of claim 7, wherein displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data comprises:
synchronizing the user operational behavior data to the page view control component based on the virtual keyboard;
generating a first state change parameter corresponding to the user operation behavior data based on the page view control component;
controlling the virtual keyboard to be displayed in the second display state indicated by the first state change parameter from the first display state based on the page view control component.
10. The method of claim 1, wherein the first display state comprises an original display state and an expanded display state;
the displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data includes:
determining a keyboard adjusting height corresponding to the virtual keyboard according to the user operation behavior data; the keyboard adjusting height is the height of an expanded keyboard or the height of an original keyboard;
when the first display state is the original display state and the keyboard adjustment height is the extended keyboard height, determining the extended keyboard height as the keyboard height in the second display state, and displaying the virtual keyboard as the extended keyboard height from the original keyboard height in the original display state;
and when the first display state is the extended display state and the keyboard adjustment height is the original keyboard height, determining the original keyboard height as the keyboard height in the second display state, and displaying the virtual keyboard as the original keyboard height from the extended keyboard height in the extended display state.
11. The method of claim 1, wherein the virtual keyboard comprises a data selection area; the data selection area in the first display state has a first area size; the data selection area in the second display state has a second area size;
the displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data includes:
displaying the virtual keyboard from the first display state to the second display state, displaying the data selection area from the first area size to the second area size, and performing re-layout display on the data to be selected in the data selection area with the second area size.
12. The method of claim 1, wherein the triggering operation comprises a voice control operation; the user operation behavior data comprises voice audio data corresponding to the voice control operation;
the displaying the virtual keyboard from a current first display state to a second display state indicated by the user operation behavior data includes:
performing voice recognition on the voice audio data to obtain a second state change parameter aiming at the virtual keyboard;
and displaying the virtual keyboard from the first display state to the second display state indicated by the second state change parameter.
13. An interface data processing apparatus, comprising:
the display module is used for displaying the virtual keyboard;
the telescopic response module is used for responding to the triggering operation aiming at the virtual keyboard and acquiring user operation behavior data aiming at the virtual keyboard;
the state switching module is used for displaying the current first display state of the virtual keyboard as a second display state indicated by the user operation behavior data;
the virtual keyboard in the first display state and the virtual keyboard in the second display state have different keyboard sizes.
14. A computer arrangement comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to carry out the steps of the method according to any one of claims 1-12.
15. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program comprising program instructions which, when executed by a processor, perform the method of any of claims 1-12.
CN202010508159.XA 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium Active CN113760165B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010508159.XA CN113760165B (en) 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010508159.XA CN113760165B (en) 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN113760165A true CN113760165A (en) 2021-12-07
CN113760165B CN113760165B (en) 2024-04-19

Family

ID=78785167

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010508159.XA Active CN113760165B (en) 2020-06-05 2020-06-05 Interface data processing method and device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN113760165B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114968063A (en) * 2022-05-26 2022-08-30 Oppo广东移动通信有限公司 Display method and device of virtual keyboard, electronic equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488400A (en) * 2013-09-27 2014-01-01 京东方科技集团股份有限公司 Method and device for building virtual keyboard
CN104007917A (en) * 2013-02-27 2014-08-27 联想(北京)有限公司 Control method for virtual keyboard and electronic device
US20150128080A1 (en) * 2012-07-13 2015-05-07 Huawei Technologies Co., Ltd. Method and terminal for determining operation object
CN104808945A (en) * 2015-04-29 2015-07-29 努比亚技术有限公司 Display method and display device of virtual keys
CN107193476A (en) * 2017-05-10 2017-09-22 北京百度网讯科技有限公司 Data inputting method and device, computer equipment and computer-readable recording medium
CN108628534A (en) * 2018-05-14 2018-10-09 维沃移动通信有限公司 A kind of character methods of exhibiting and mobile terminal
CN109240591A (en) * 2018-09-26 2019-01-18 北京金山安全软件有限公司 Interface display method and device
US20190339863A1 (en) * 2015-10-19 2019-11-07 Apple Inc. Devices, Methods, and Graphical User Interfaces for Keyboard Interface Functionalities
CN110456907A (en) * 2019-07-24 2019-11-15 广东虚拟现实科技有限公司 Control method, device, terminal device and the storage medium of virtual screen

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150128080A1 (en) * 2012-07-13 2015-05-07 Huawei Technologies Co., Ltd. Method and terminal for determining operation object
CN104007917A (en) * 2013-02-27 2014-08-27 联想(北京)有限公司 Control method for virtual keyboard and electronic device
CN103488400A (en) * 2013-09-27 2014-01-01 京东方科技集团股份有限公司 Method and device for building virtual keyboard
CN104808945A (en) * 2015-04-29 2015-07-29 努比亚技术有限公司 Display method and display device of virtual keys
US20190339863A1 (en) * 2015-10-19 2019-11-07 Apple Inc. Devices, Methods, and Graphical User Interfaces for Keyboard Interface Functionalities
CN107193476A (en) * 2017-05-10 2017-09-22 北京百度网讯科技有限公司 Data inputting method and device, computer equipment and computer-readable recording medium
CN108628534A (en) * 2018-05-14 2018-10-09 维沃移动通信有限公司 A kind of character methods of exhibiting and mobile terminal
CN109240591A (en) * 2018-09-26 2019-01-18 北京金山安全软件有限公司 Interface display method and device
CN110456907A (en) * 2019-07-24 2019-11-15 广东虚拟现实科技有限公司 Control method, device, terminal device and the storage medium of virtual screen

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
段佳玮: "适合手游的手机屏幕和键盘尺寸的研究", 自动化应用, no. 01, 25 January 2017 (2017-01-25), pages 36 - 38 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114968063A (en) * 2022-05-26 2022-08-30 Oppo广东移动通信有限公司 Display method and device of virtual keyboard, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113760165B (en) 2024-04-19

Similar Documents

Publication Publication Date Title
US11921978B2 (en) Devices, methods, and graphical user interfaces for navigating, displaying, and editing media items with multiple display modes
US11842044B2 (en) Keyboard management user interfaces
JP2023159124A (en) System, method, and graphical user interface for interaction with augmented and virtual reality environments
KR101720849B1 (en) Touch screen hover input handling
JP2022025111A (en) Device, method and graphical user interface for displaying affordance on back ground
KR20190039337A (en) Touch input cursor manipulation
JP2017517074A (en) Input device and user interface interaction
CN102270081A (en) Method and device for adjusting size of list element
CN109542304B (en) Display content loading method, device, equipment and storage medium
US11755146B2 (en) Devices and methods for processing touch inputs
CN117501234A (en) System and method for interacting with multiple display devices
US20230091771A1 (en) Device Control Method, Storage Medium, and Non-Transitory Computer-Readable Electronic Device
CN112527165A (en) Method, device and equipment for adjusting interface display state and storage medium
CN106325490A (en) Method for controlling electronic device and associated electronic device
CN113760165B (en) Interface data processing method and device and computer readable storage medium
JP7351828B2 (en) Web browser display method and terminal device using the same
CN108536653B (en) Input method, input device and input device
US10303346B2 (en) Information processing apparatus, non-transitory computer readable storage medium, and information display method
CN109804340B (en) Method and device for page display, graphical user interface and mobile terminal
CN110399086B (en) Game picture display control method and device, storage medium and electronic equipment
KR101343409B1 (en) The terminal and method which zooms in or out a part of touch screen area
CN114967955A (en) Device control method, device, storage medium and electronic device
CN112764623B (en) Content editing method and device
CN112035039B (en) Information display control method and device, electronic equipment and readable storage medium
JP2014106769A (en) Electronic apparatus and control program and display control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant