CN111338555B - Method, device, equipment and storage medium for realizing input through virtual keyboard - Google Patents
Method, device, equipment and storage medium for realizing input through virtual keyboard Download PDFInfo
- Publication number
- CN111338555B CN111338555B CN202010102902.1A CN202010102902A CN111338555B CN 111338555 B CN111338555 B CN 111338555B CN 202010102902 A CN202010102902 A CN 202010102902A CN 111338555 B CN111338555 B CN 111338555B
- Authority
- CN
- China
- Prior art keywords
- input
- split screen
- information
- virtual keyboard
- displaying
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
Abstract
The embodiment of the invention discloses a method, a device, equipment and a storage medium for realizing input through a virtual keyboard. The method comprises the following steps: acquiring sensor data; determining the use state of a user on a terminal screen according to the sensor data, wherein the use state comprises a folded state and an unfolded state; determining an input split screen and an information split screen based on the using state, wherein the input split screen works in a keyboard input mode for displaying a virtual keyboard, and the information split screen works in an application interaction mode for displaying an application interface; operating the input method and displaying the virtual keyboard on the input split screen; and acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface. The method can determine the input split screen and the information split screen based on the use state of the terminal screen by the user, the input split screen is only used for displaying the virtual keyboard, the information split screen is only used for displaying the application interface, the virtual keyboard cannot shield the application interface, the virtual keyboard cannot be frequently popped up and hidden when the application is operated, and the use experience of the user is improved.
Description
Technical Field
The invention relates to the field of human-computer interaction, in particular to a method, a system, equipment and a storage medium for realizing input through a virtual keyboard.
Background
The touch display screen is a part for displaying a User Interface (UI) on the terminal, and the flexible touch display screen can be realized as a folding display screen. In the related art, a terminal having a folding display screen may be in a folded state or an unfolded state. When the folding display screen is in a folding state, the folding display screen can be folded outwards in a U shape; when in the unfolded state, the foldable display screen can be unfolded into a plane or a V shape with a certain angle. At present, a virtual keyboard display mode of a traditional touch screen mobile phone is used when a user inputs data through a virtual keyboard of a folding screen mobile phone.
The traditional touch screen mobile phone realizes input through a virtual keyboard, and the virtual keyboard blocks a part of a screen for displaying an application interface after popping up in different application scenes. This kind of mode easily causes the important information of application interface on the screen to be sheltered from, influences user's normal use, and when horizontal screen uses, this kind of problem is more serious to switch of virtual keyboard hiding and popping up can appear when the user carries out the operation selection input position to the display interface, for example the user has to when filling out the form: calling out virtual keyboard entries, filling out content, closing the virtual keyboard, selecting the next field, calling out the virtual keyboard again, filling out content … … so forth many times, and furthermore, in game/video and like scenarios, the called out virtual keyboard often blocks out important game/video interfaces and the user experience is poor.
Disclosure of Invention
In view of this, the present invention provides a method for implementing input through a virtual keyboard, which enables a certain sub-screen of a folding screen mobile phone to work in a keyboard input mode to optimize the input experience of a user, according to the particularity of the folding screen mobile phone.
In order to solve the technical problems, the invention adopts the following technical scheme:
in one embodiment, the present invention provides a method for implementing input through a virtual keyboard, the method comprising:
acquiring sensor data;
determining the use state of a user on a terminal screen according to the sensor data, wherein the use state comprises a folded state and an unfolded state;
determining an input split screen and an information split screen based on the use state, wherein the input split screen works in a keyboard input mode and is used for displaying a virtual keyboard, and the information split screen works in an application interaction mode and is used for displaying an application interface;
operating an input method and displaying a virtual keyboard on the input split screen;
and acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface.
In one embodiment, the present invention provides an apparatus for implementing input through a virtual keyboard, comprising:
the sensor data acquisition module is used for acquiring sensor data;
the using state judging module is used for determining the using state of the terminal screen by the user according to the sensor data, and the using state comprises a folded state and an unfolded state;
the split screen determining module is used for determining input split screens and information split screens based on the using state, wherein the input split screens work in a keyboard input mode and are used for displaying a virtual keyboard, and the information split screens work in an application interaction mode and are used for displaying an application interface; the virtual keyboard display module is used for operating an input method and displaying a virtual keyboard on the input split screen;
and the input module is used for acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface.
In one embodiment, the present invention provides a device for implementing input through a virtual keyboard, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by one or more processors, the one or more programs enable the one or more processors to implement methods for implementing input via a virtual keyboard as previously described.
In one embodiment, the present invention provides a computer-readable storage medium storing a computer program comprising program instructions that, when executed, implement the aforementioned method of implementing input via a virtual keyboard.
The method for realizing input through the virtual keyboard provided by the invention provides a keyboard input mode for keeping the continuous display and work of the virtual keyboard, two split screens of the terminal can be respectively determined as an input split screen and an information split screen based on the use state of a terminal screen by a user, the input split screen work is configured for displaying the virtual keyboard in the keyboard input mode, at the moment, the virtual keyboard is not frequently popped up and hidden through the input through the virtual keyboard, the use experience of the user is improved, the information split screen is only used for displaying an application interface, the application interface is not shielded by the virtual keyboard, and the use experience of the user is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only part of the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a flow chart of a method for implementing input via a virtual keyboard according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating an effect of implementing input through a virtual keyboard according to an embodiment of the present invention;
FIG. 3 is a flowchart of a method for implementing input via a virtual keyboard according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of an apparatus for implementing input through a virtual keyboard according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a device for implementing input through a virtual keyboard according to an embodiment of the present invention.
Detailed Description
The technical solution in the implementation of the present application is described clearly and completely below with reference to the drawings in the embodiments of the present application. It is to be understood that the specific embodiments described herein are merely illustrative of some, and not restrictive, of the current application. It should be further noted that, based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without any creative effort belong to the protection scope of the present application.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
Furthermore, the terms "first," "second," and the like may be used herein to describe various orientations, actions, steps, elements, or the like, but the orientations, actions, steps, or elements are not limited by these terms. These terms are only used to distinguish one direction, action, step or element from another direction, action, step or element. For example, a first region could be termed a second region, and, similarly, a second region could be termed a first region, without departing from the scope of the present invention. The first region and the second region are both regions, but they are not the same region. The terms "first", "second", etc. are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise. It should be noted that when one portion is referred to as being "secured to" another portion, it may be directly on the other portion or there may be an intervening portion. When a portion is said to be "connected" to another portion, it may be directly connected to the other portion or intervening portions may be present. The terms "vertical," "horizontal," "left," "right," and the like as used herein are for illustrative purposes only and do not denote a unique embodiment.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. A process may be terminated when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
Referring to fig. 1, in an embodiment, a method for implementing input through a virtual keyboard is provided, and the method may be applied to a terminal having at least two split screens, in this embodiment, a folding screen mobile phone is taken as an example (two separate split screens may be used, and two split screens formed by bending a flexible screen may also be used). Specifically, the method comprises the following steps:
and S110, acquiring sensor data.
The folding screen mobile phone has different working states as one of the terminals with the folding screen: a folded state and an unfolded state. Different working states reflect different use requirements of the user to a certain extent, which is an important judgment basis for how to perform subsequent input through the virtual keyboard in this embodiment, and therefore sensor data for judging the working state of the terminal needs to be acquired.
And S120, determining the use state of the terminal screen by the user according to the sensor data, wherein the use state comprises a folded state and an unfolded state.
After the sensor data for judging the working state of the folding-screen mobile phone is acquired, the working state of the folding-screen mobile phone needs to be judged according to the sensor data, because the working state of the folding-screen mobile phone is the use state of the screen of the folding-screen mobile phone by the user, and the use state of the screen of the folding-screen mobile phone by the user reflects the actual use requirement of the user to a certain extent, so that whether the user needs to use a virtual keyboard for input can be analyzed, that is, the folding state and the unfolding state are set as the judgment conditions for whether the user needs to use the virtual keyboard to complete information entry.
S130, determining input split screens and information split screens based on the using states, wherein the input split screens work in a keyboard input mode and are used for displaying a virtual keyboard, and the information split screens work in an application interaction mode and are used for displaying an application interface.
When the user has input requirements according to the using state of the folding screen mobile phone, the processor of the folding screen mobile phone can determine input split screens for displaying the virtual keyboard according to preset rules (a certain split screen can be preset as the input split screen, and the adjustment can be carried out according to the user requirements), control the input split screens to work in a keyboard input mode, wherein the keyboard input mode refers to the mode of continuously keeping the working state of the virtual keyboard, at the moment, the virtual keyboard cannot be hidden due to the operation of the user on the application interface, and the application interface is displayed on the information split screens independently, so the virtual keyboard cannot shield the application interface.
And S140, operating the input method and displaying the virtual keyboard on the input split screen.
After the input split screen is determined, the input method can be directly operated according to requirements, and the input method is displayed on the input split screen.
And S150, acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface.
After the virtual keyboard is fixed on the input split screen display, a user can complete input through the virtual keyboard, and input information is filled into an application interface.
As shown in fig. 2, the effect diagram of the input implemented by the virtual keyboard is that the virtual keyboard continuously exists on the input split screen for displaying the virtual keyboard. For example, when a user fills in a form, in a conventional manner, after selecting an input box, a virtual keyboard pops up at the bottom of a touch screen, when the user selects another input box after completing input, the user needs to drag the form and the like, at this time, the virtual keyboard is hidden to ensure that the form has a larger display range to facilitate the user operation, but the display position of the form is usually adjusted adaptively, after selecting another input box, the virtual keyboard pops up again, at this time, a part of the content of the form is often shielded, the user needs to adjust the display position of the form again to observe the content of the form, and the user operation on the form causes the virtual keyboard to be hidden, which greatly affects the user experience, whereas in the keyboard input mode in this embodiment, the user does not cause the virtual keyboard to be hidden when performing any operation on the form, that is, the display area occupied by the virtual keyboard is only for the virtual keyboard and is not used for displaying other applications, while the folding screen has sufficient display area for displaying the display area of other applications enough for the user to use.
The embodiment provides a method for realizing input through a virtual keyboard, and aims to solve the problem of complex operation when a user frequently calls out and hides the virtual keyboard, a keyboard input mode for keeping the virtual keyboard continuously displayed and working is provided.
In one embodiment, the detailed explanation of the input split screen determined according to the preset rule for displaying the virtual keyboard in the previous embodiment is further performed, that is, the determining the input split screen and the information split screen based on the use state includes:
and if the use state is the folding state, acquiring target detection data, determining input split screen and information split screen according to the target detection data, wherein the target detection data comprises operation trigger data and gravity sensing data.
In this embodiment, the folding state is used as a basis for determining that a user has an input requirement (further, a folding angle used as a judgment basis can be specifically limited, for example, 90-100 °), and after it is determined that the user needs to use a virtual keyboard, it is required to determine input split screens in the folding screen mobile phone for displaying the virtual keyboard.
Specifically, in this embodiment, two manners of determining input split screen and information split screen are provided, which respectively correspond to two target detection data, that is, target detection data are obtained, and determining input split screen and information split screen according to the target detection data includes steps S131 to 132 and steps S133 to 134 (not shown):
s131, acquiring operation trigger data when a user triggers a key and/or touches a screen of the terminal.
And S132, according to the operation trigger data and a preset rule, taking the split screen corresponding to the key triggered by the user as an input split screen and/or taking the split screen where the user firstly performs touch operation as an input split screen, and taking the other split screen corresponding to the folded state as an information split screen.
S131 and S132 are detailed processes of determining the input split screen and the information split screen according to the operation trigger data of the user, for example, two split screens of the folding screen cell phone A, B are determined, after the working state of the screen is determined to be the folded state, the screen touched by the user for the first time is the B screen, the B screen is used as the input split screen, the a screen is used as the information split screen, and for example, after the working state of the screen is determined to be the folded state, the user has triggered the first key, the split screen corresponding to the first key is the a screen, the a screen is used as the input split screen, and the B screen is used as the information split screen. Of course, this is merely an example, and the corresponding rule may be adjusted according to actual requirements.
And S133, acquiring gravity sensing data for judging the terminal posture.
S134, determining the position relation of the two split screens corresponding to the folded state according to the gravity sensing data, taking the split screen with the highest gravity center as an information split screen and taking the split screen with the lowest gravity center as an input split screen.
Step S133 and step S134 actually determine which split screen the user needs to use as the input split screen by himself or herself according to the specific placement and use posture of the folding-screen mobile phone, for example, the folding-screen mobile phone has A, B split screens, and after the folding-screen mobile phone is folded by the user, the user horizontally places a part of the folding-screen mobile phone corresponding to the a screen on the desktop, and keeps the B screen facing the user and the a screen facing upward, so that the center of the a screen is the lowest, and the a screen is used as the input split screen.
In this embodiment, the folding state of the screen is used as a criterion for determining the input split screen and the information split screen, and actually, the user needs to use the input split screen in some cases when the user is in the expanded state, so that in some alternative embodiments, when the user is in the expanded state, a mode for determining the input split screen and the information split screen is also provided, which specifically includes:
if the use state is the expansion state, acquiring an input mode instruction of a user, and determining input split screen and information split screen based on the input mode instruction, specifically, the input mode instruction of the user may be a preset gesture operation and/or a key instruction input by the user, for example, simultaneously pressing a volume key and a power key, and after the input mode instruction of the user is acquired, determining the input split screen for displaying a virtual keyboard and the information split screen for displaying an application interface according to a preset rule, where the preset rule may be the same as the rule for determining input split screen and information split screen in the folding state.
Different applications have different use requirements, when a user uses certain applications and needs to display the applications on two split screens, or when the virtual keyboard is hidden and popped up to better meet the use habits of the user, in some embodiments, the user can close the keyboard input mode for inputting the split screens through a second input mode instruction, namely, the two split screens are information split screens for displaying application interfaces to complete application interaction. At this time, the user can have the popup and hiding of the virtual keyboard when using the application.
The embodiment provides a method for realizing input through a virtual keyboard, a specific mode of determining input split screens and information split screens through target detection data in a folded state is provided, the input split screens and the information split screens can be determined according to touch screen operation and key operation of a user and the position relation of the two split screens, the actual use requirements of the user are further considered, the user experience is improved, the method for realizing input through the virtual keyboard further provides that the use state is determined to be the input split screens and the information split screens in an unfolded state, and more requirements are met.
An embodiment supplements and explains a specific application scenario in the method for realizing input through a virtual keyboard on the basis of the above embodiment, and specifically, as shown in fig. 3, the method for realizing input through a virtual keyboard provided by the embodiment includes:
and S210, acquiring sensor data.
And S220, determining the use state of the user on the terminal screen according to the sensor data, wherein the use state comprises a folded state and an unfolded state.
And S230, determining an input split screen and an information split screen based on the using state, wherein the input split screen works in a keyboard input mode and is used for displaying a virtual keyboard, and the information split screen works in an application interaction mode and is used for displaying an application interface.
S240, operating the input method and displaying the virtual keyboard on the input split screen
And S251, acquiring an application opening instruction and an input position selection instruction input by a user, and displaying a corresponding application interface on the information split screen according to the application opening instruction and the input position selection instruction.
And S252, acquiring input information of a user based on the input split screen, inputting the input information into corresponding application, and displaying the input information on the application interface.
S251-252 is based on the case of single application use input split screen: the information split screen is used for application interaction of a user, the user can perform a series of operations such as opening an application, closing the application, dragging the application, selecting an input position and the like through the information split screen, and when the user operates the information split screen, the virtual keyboard is always displayed on the input split screen.
S261, a first application opening instruction and a second application opening instruction input by a user are obtained, a corresponding first application interface and a corresponding second application interface are displayed on the information split screen, and the second application interface floats on the first application interface.
S262, acquiring a first input position selection instruction input by a user based on the information split screen, wherein an input position selected by the first input position selection instruction is a first application interface.
S263, acquiring first input information of a user based on the virtual keyboard, inputting the first input information into a first application, and displaying the first input information on the first application interface.
And S264, acquiring a second input position selection instruction input by the user based on the information split screen, wherein the input position selected by the second input position selection instruction is a second application interface.
S265, second input information of the user is obtained based on the virtual keyboard, and the second input information is input into a second application and displayed on a second application interface.
Steps S261-265 are the process of using input split screen in the case of multiple applications with floating windows: the user can open a plurality of applications on the information split screen, an application interface is suspended above other application interfaces, the user can select input positions on different application interfaces through switching of the information split screen, information input is achieved through input split screen, and when the user operates the information split screen, the input split screen always keeps displaying the virtual keyboard.
S271, a third application opening instruction and a fourth application opening instruction input by a user are obtained, a corresponding third application interface and a corresponding fourth application interface are displayed on the information split screen, and the fourth application interface and the third application interface are displayed side by side or in parallel.
And S272, acquiring a third input position selection instruction input by the user based on the information split screen, wherein the input position selected by the third input position selection instruction is a third application interface.
And S273, acquiring third input information of the user based on the virtual keyboard, inputting the third input information into a third application, and displaying the third input information on the third application interface.
And S274, acquiring a fourth input position selection instruction input by the user based on the information split screen, wherein the input position selected by the fourth input position selection instruction is a fourth application interface.
And S275, acquiring fourth input information of the user based on the virtual keyboard, inputting the fourth input information into a fourth application, and displaying the fourth input information on the fourth application interface.
Steps S271-275 are a procedure of using input split screen in the case of multiple applications displayed side by side/column: the user can open a plurality of applications on the information split screen, the application interfaces can be displayed in parallel or side by side, certainly, the user can also customize the position relation between the application interfaces in modes of dragging the application interfaces on the information split screen and the like, the user can select input positions on different application interfaces through touch operation switching on the information split screen, input information is input through the input split screen, and when the user operates the information split screen, the input split screen always keeps displaying a virtual keyboard.
On the basis of the previous embodiment, the embodiment further provides an input split-screen use process in different application scenes, the input split-screen work is configured in a keyboard input mode and used for displaying the virtual keyboard, at the moment, the virtual keyboard is used for realizing that input cannot frequently pop up and hide the virtual keyboard, the information split-screen is only used for displaying an application interface, the virtual keyboard cannot shield the application interface, and the use experience of a user is improved.
In an embodiment, the present invention provides an apparatus for implementing input through a virtual keyboard, and fig. 4 is a schematic structural diagram of the apparatus, and as shown in fig. 4, the apparatus includes:
a sensor data acquisition module 310 for acquiring sensor data.
And a use state judging module 320 for determining a use state of the terminal screen by the user according to the sensor data, wherein the use state comprises a folded state and an unfolded state.
And a split screen determining module 330, configured to determine an input split screen and an information split screen based on the usage status, where the input split screen is operated in a keyboard input mode for displaying a virtual keyboard, and the information split screen is operated in an application interaction mode for displaying an application interface.
And the virtual keyboard display module 340 is used for operating the input method and displaying a virtual keyboard on the input split screen.
And an input module 350, configured to obtain input information through the virtual keyboard and display the input information on a corresponding application interface.
Optionally, in some embodiments, the split screen determining module 330 is configured to: and if the use state is the folding state, acquiring target detection data, determining input split screen and information split screen according to the target detection data, wherein the target detection data comprises operation trigger data and gravity sensing data.
Optionally, in some embodiments, the split screen determining module 330 includes:
the operation triggering unit is used for acquiring operation triggering data when a user triggers a key and/or performs touch operation on a screen of the terminal; and according to the operation trigger data and a preset rule, taking the split screen corresponding to the key triggered by the user as an input split screen and/or taking the split screen where the user firstly performs touch operation as an input split screen, and taking the other split screen corresponding to the folded state as an information split screen.
The gravity sensing unit is used for acquiring gravity sensing data for judging the posture of the terminal; and determining the position relation of two sub-screens corresponding to the folded state according to the gravity sensing data, taking the sub-screen with the highest gravity center as an information sub-screen and taking the sub-screen with the lowest gravity center as an input sub-screen.
Optionally, in some embodiments, the input module is configured to: acquiring an application opening instruction and an input position selection instruction input by a user, and displaying a corresponding application interface on the information split screen according to the application opening instruction and the input position selection instruction; and acquiring input information of a user based on the input split screen, inputting the input information into corresponding application and displaying the input information on the application interface.
Optionally, in some embodiments, the input module is configured to: acquiring a first application opening instruction and a second application opening instruction input by a user, and displaying a corresponding first application interface and a second application interface on the information split screen, wherein the second application interface floats on the first application interface; acquiring a first input position selection instruction input by a user based on the information split screen, wherein an input position selected by the first input position selection instruction is a first application interface; acquiring first input information of a user based on the virtual keyboard, inputting the first input information into a first application, and displaying the first input information on a first application interface; acquiring a second input position selection instruction input by the user based on the information split screen, wherein the input position selected by the second input position selection instruction is a second application interface; and acquiring second input information of the user based on the virtual keyboard, inputting the second input information into a second application, and displaying the second input information on a second application interface.
Optionally, in some embodiments, the input module is configured to: acquiring a third application opening instruction and a fourth application opening instruction input by a user, and displaying a corresponding third application interface and a corresponding fourth application interface on the information split screen, wherein the fourth application interface and the third application interface are displayed side by side or in parallel; acquiring a third input position selection instruction input by a user based on the information split screen, wherein the input position selected by the third input position selection instruction is a third application interface; acquiring third input information of a user based on the virtual keyboard, inputting the third input information into a third application, and displaying the third input information on a third application interface; acquiring a fourth input position selection instruction input by a user based on the information split screen, wherein the input position selected by the fourth input position selection instruction is a fourth application interface; and acquiring fourth input information of the user based on the virtual keyboard, inputting the fourth input information into a fourth application, and displaying the fourth input information on a fourth application interface.
The embodiment provides a device for realizing input through a virtual keyboard, and can provide a keyboard input mode for keeping the continuous display and work of the virtual keyboard, two split screens of a terminal can be respectively determined as an input split screen and an information split screen according to the use state of a user on the terminal screen, the input split screen work is configured for displaying the virtual keyboard in the keyboard input mode, at the moment, the virtual keyboard is enabled to be popped up and hidden frequently, the use experience of the user is improved, the information split screen is only used for displaying an application interface, the virtual keyboard cannot shield the application interface, and the use experience of the user is further improved.
Fig. 5 is a schematic structural diagram of a device 400 for implementing input through a virtual keyboard according to an embodiment of the present invention, where the device may be a folding-screen mobile phone, a folding-screen tablet, or other terminal with a folding screen, as shown in fig. 5, the device includes a memory 410 and a processor 420, the number of the processors 420 in the device may be one or more, and one processor 420 is taken as an example in fig. 5; the memory 410 and the processor 420 in the device may be connected by a bus or other means, and fig. 5 illustrates the connection by a bus as an example.
The memory 410 is used as a computer readable storage medium for storing software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the method for implementing input through a virtual keyboard in the embodiment of the present invention (for example, the sensor data acquisition module 310, the use state determination module 320, the split screen determination module 330, the virtual keyboard display module 340, and the input module 350 in the device for implementing input through a virtual keyboard). The processor 420 executes various functional applications of the device and data processing by executing software programs, instructions and modules stored in the memory 410, that is, implements the above-described method of implementing input through the virtual keyboard.
Wherein the processor 420 is configured to run the computer executable program stored in the memory 410 to implement the following steps: step S110, acquiring sensor data; step S120, determining the use state of the terminal screen by the user according to the sensor data, wherein the use state comprises a folded state and an unfolded state; step S130, determining input split screens and information split screens based on the using state, wherein the input split screens work in a keyboard input mode and are used for displaying a virtual keyboard, and the information split screens work in an application interaction mode and are used for displaying an application interface; step S140, operating an input method and displaying a virtual keyboard on the input split screen; and S150, acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface.
Of course, the device provided in the embodiment of the present invention is not limited to the method operations described above, and may also perform related operations in the method for implementing input through a virtual keyboard provided in any embodiment of the present invention.
Illustratively, in one embodiment, the processor 420, when executing the computer program, further implements: after the using state of a terminal screen by a user is determined according to the sensor data, if the using state is a folded state, target detection data are obtained, input split screen and information split screen are determined according to the target detection data, and the target detection data comprise operation trigger data and gravity sensing data.
Illustratively, in one embodiment, the processor 420, when executing the computer program, further implements: after determining the use state of a terminal screen by a user according to the sensor data, if the use state is a folded state, acquiring operation trigger data when the user triggers a key and/or when the user touches the screen of the terminal;
and according to the operation trigger data and a preset rule, taking the split screen corresponding to the key triggered by the user as an input split screen and/or taking the split screen where the user firstly performs touch operation as an input split screen, and taking the other split screen corresponding to the folded state as an information split screen.
Illustratively, in one embodiment, the processor 420, when executing the computer program, further implements: after determining the use state of a terminal screen by a user according to the sensor data, if the use state is a folded state, acquiring gravity sensing data for judging the posture of the terminal; and determining the position relation of two sub-screens corresponding to the folded state according to the gravity sensing data, taking the sub-screen with the highest gravity center as an information sub-screen and taking the sub-screen with the lowest gravity center as an input sub-screen.
Illustratively, in one embodiment, the processor 420, when executing the computer program, further performs the steps of:
sensor data is acquired.
And determining the use state of the terminal screen by the user according to the sensor data, wherein the use state comprises a folded state and an unfolded state.
And determining an input split screen and an information split screen based on the use state, wherein the input split screen works in a keyboard input mode and is used for displaying a virtual keyboard, and the information split screen works in an application interaction mode and is used for displaying an application interface.
And operating the input method and displaying the virtual keyboard on the input split screen.
The method comprises the steps of obtaining a first application opening instruction and a second application opening instruction input by a user, and displaying a corresponding first application interface and a corresponding second application interface on the information split screen, wherein the second application interface floats on the first application interface.
And acquiring a first input position selection instruction input by a user based on the information split screen, wherein the input position selected by the first input position selection instruction is a first application interface.
First input information of a user is acquired based on the virtual keyboard, and the first input information is input into a first application and displayed on a first application interface.
And acquiring a second input position selection instruction input by the user based on the information split screen, wherein the input position selected by the second input position selection instruction is a second application interface.
And acquiring second input information of the user based on the virtual keyboard, inputting the second input information into a second application, and displaying the second input information on a second application interface.
The memory 410 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 410 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 410 may further include memory located remotely from processor 420, which may be connected to devices through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The embodiment provides equipment for realizing input through a virtual keyboard, and can provide a keyboard input mode for keeping the continuous display and work of the virtual keyboard, two split screens of a terminal can be respectively determined as an input split screen and an information split screen according to the use state of a user on the terminal screen, the input split screen work is configured for displaying the virtual keyboard in the keyboard input mode, at the moment, the virtual keyboard is enabled to be popped up and hidden frequently, the use experience of the user is improved, the information split screen is only used for displaying an application interface, the virtual keyboard cannot shield the application interface, and the use experience of the user is further improved.
In one embodiment, there is also provided a storage medium containing computer-executable instructions which, when executed by a computer processor, perform a method of enabling input via a virtual keyboard, the method of enabling input via a virtual keyboard comprising:
acquiring sensor data;
determining the use state of a user on a terminal screen according to the sensor data, wherein the use state comprises a folded state and an unfolded state;
and determining an input split screen and an information split screen based on the use state, wherein the input split screen works in a keyboard input mode and is used for displaying a virtual keyboard, and the information split screen works in an application interaction mode and is used for displaying an application interface.
And operating the input method and displaying the virtual keyboard on the input split screen.
And acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface.
Of course, the storage medium provided by the embodiment of the present invention contains computer-executable instructions, and the computer-executable instructions are not limited to the operations of the method described above, and may also perform related operations in the method for implementing input through a virtual keyboard provided by any embodiment of the present invention.
Illustratively, in one embodiment, the computer program when executed by the processor further implements: after the using state of a terminal screen by a user is determined according to the sensor data, if the using state is a folded state, target detection data are obtained, input split screen and information split screen are determined according to the target detection data, and the target detection data comprise operation trigger data and gravity sensing data.
Illustratively, in one embodiment, the computer program when executed by the processor further implements: after determining the use state of a terminal screen by a user according to the sensor data, if the use state is a folded state, acquiring operation trigger data when the user triggers a key and/or when the user touches the screen of the terminal; and according to the operation trigger data and a preset rule, taking the split screen corresponding to the key triggered by the user as an input split screen and/or taking the split screen where the user firstly performs touch operation as an input split screen, and taking the other split screen corresponding to the folded state as an information split screen.
Illustratively, in one embodiment, the computer program when executed by the processor further implements: after determining the use state of a terminal screen by a user according to the sensor data, if the use state is a folded state, acquiring gravity sensing data for judging the posture of the terminal; and determining the position relation of two sub-screens corresponding to the folded state according to the gravity sensing data, taking the sub-screen with the highest gravity center as an information sub-screen and taking the sub-screen with the lowest gravity center as an input sub-screen.
Illustratively, in one embodiment, the computer program when executed by the processor further performs the steps of:
sensor data is acquired.
And determining the use state of the terminal screen by the user according to the sensor data, wherein the use state comprises a folded state and an unfolded state.
And determining an input split screen and an information split screen based on the use state, wherein the input split screen works in a keyboard input mode and is used for displaying a virtual keyboard, and the information split screen works in an application interaction mode and is used for displaying an application interface.
And operating the input method and displaying the virtual keyboard on the input split screen.
The method comprises the steps of obtaining a first application opening instruction and a second application opening instruction input by a user, and displaying a corresponding first application interface and a corresponding second application interface on the information split screen, wherein the second application interface floats on the first application interface.
And acquiring a first input position selection instruction input by a user based on the information split screen, wherein the input position selected by the first input position selection instruction is a first application interface.
First input information of a user is acquired based on the virtual keyboard, and the first input information is input into a first application and displayed on a first application interface.
And acquiring a second input position selection instruction input by the user based on the information split screen, wherein the input position selected by the second input position selection instruction is a second application interface.
And acquiring second input information of the user based on the virtual keyboard, inputting the second input information into a second application, and displaying the second input information on a second application interface.
From the above description of the embodiments, it is clear to those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly can be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a device, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the embodiment of the authorization system, the included units and modules are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
According to the computer-readable storage medium provided by the embodiment, when a computer program stored on the computer-readable storage medium is executed, a keyboard input mode for keeping the continuous display and work of a virtual keyboard can be provided, two split screens of a terminal can be respectively determined as an input split screen and an information split screen according to the use state of a terminal screen by a user, the input split screen work is configured in the keyboard input mode and used for displaying the virtual keyboard, at the moment, the virtual keyboard is popped up and hidden frequently, the input is not frequently realized through the virtual keyboard, the use experience of the user is improved, the information split screen is only used for displaying an application interface, the application interface is not shielded by the virtual keyboard, and the use experience of the user is further improved.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (7)
1. A method for realizing input through a virtual keyboard is characterized by comprising the following steps:
acquiring sensor data;
determining the use state of a user on a terminal screen according to the sensor data, wherein the use state comprises a folded state and an unfolded state;
determining an input split screen and an information split screen based on the use state, wherein the input split screen works in a keyboard input mode and is used for displaying a virtual keyboard, and the information split screen works in an application interaction mode and is used for displaying an application interface;
operating an input method and displaying a virtual keyboard on the input split screen;
acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface;
wherein the determining input split screen and information split screen based on the usage status comprises:
if the use state is the folding state, target detection data are obtained, and input split screen and information split screen are determined according to the target detection data;
the acquiring of the target detection data and the determining of the input split screen and the information split screen according to the target detection data comprise:
acquiring operation trigger data when a user triggers a key and/or touches a screen of a terminal;
and according to the operation trigger data and a preset rule, taking the split screen corresponding to the key triggered by the user as an input split screen and/or taking the split screen where the user firstly performs touch operation as an input split screen, and taking the other split screen corresponding to the folded state as an information split screen.
2. The method of claim 1, wherein the obtaining input information through the virtual keyboard and displaying the input information on a corresponding application interface comprises:
acquiring an application opening instruction and an input position selection instruction input by a user, and displaying a corresponding application interface on the information split screen according to the application opening instruction and the input position selection instruction;
and acquiring input information triggered by a user based on the virtual keyboard, inputting the input information into a corresponding application and displaying the input information on the application interface.
3. The method of claim 1, wherein the obtaining input information through the virtual keyboard and displaying the input information on a corresponding application interface comprises:
acquiring a first application opening instruction and a second application opening instruction input by a user, and displaying a corresponding first application interface and a second application interface on the information split screen, wherein the second application interface floats on the first application interface;
acquiring a first input position selection instruction input by a user based on the information split screen, wherein an input position selected by the first input position selection instruction is a first application interface;
acquiring first input information of a user based on the virtual keyboard, inputting the first input information into a first application, and displaying the first input information on a first application interface;
acquiring a second input position selection instruction input by the user based on the information split screen, wherein the input position selected by the second input position selection instruction is a second application interface;
and acquiring second input information of the user based on the virtual keyboard, inputting the second input information into a second application, and displaying the second input information on a second application interface.
4. The method of claim 1, wherein the obtaining input information through the virtual keyboard and displaying the input information on a corresponding application interface comprises:
acquiring a third application opening instruction and a fourth application opening instruction input by a user, and displaying a corresponding third application interface and a corresponding fourth application interface on the information split screen, wherein the fourth application interface and the third application interface are displayed side by side or in parallel;
acquiring a third input position selection instruction input by a user based on the information split screen, wherein the input position selected by the third input position selection instruction is a third application interface;
acquiring third input information of a user based on the virtual keyboard, inputting the third input information into a third application, and displaying the third input information on a third application interface;
acquiring a fourth input position selection instruction input by a user based on the information split screen, wherein the input position selected by the fourth input position selection instruction is a fourth application interface;
and acquiring fourth input information of the user based on the virtual keyboard, inputting the fourth input information into a fourth application, and displaying the fourth input information on a fourth application interface.
5. An apparatus for enabling input via a virtual keyboard, comprising:
the sensor data acquisition module is used for acquiring sensor data;
the using state judging module is used for determining the using state of the terminal screen by the user according to the sensor data, and the using state comprises a folded state and an unfolded state;
the split screen determining module is used for determining input split screens and information split screens based on the using state, wherein the input split screens work in a keyboard input mode and are used for displaying a virtual keyboard, and the information split screens work in an application interaction mode and are used for displaying an application interface;
the virtual keyboard display module is used for operating an input method and displaying a virtual keyboard on the input split screen;
the input module is used for acquiring input information through the virtual keyboard and displaying the input information on a corresponding application interface;
the split screen determining module is further used for acquiring target detection data if the using state is a folding state, and determining input split screen and information split screen according to the target detection data;
the split screen determining module comprises:
the operation triggering unit is used for acquiring operation triggering data when a user triggers a key and/or performs touch operation on a screen of the terminal; and according to the operation trigger data and a preset rule, taking the split screen corresponding to the key triggered by the user as an input split screen and/or taking the split screen where the user firstly performs touch operation as an input split screen, and taking the other split screen corresponding to the folded state as an information split screen.
6. An apparatus for implementing input through a virtual keyboard, comprising
One or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, enable the one or more processors to implement a method for enabling input via a virtual keyboard as recited in any of claims 1-4.
7. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of carrying out an input via a virtual keyboard according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010102902.1A CN111338555B (en) | 2020-02-19 | 2020-02-19 | Method, device, equipment and storage medium for realizing input through virtual keyboard |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010102902.1A CN111338555B (en) | 2020-02-19 | 2020-02-19 | Method, device, equipment and storage medium for realizing input through virtual keyboard |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111338555A CN111338555A (en) | 2020-06-26 |
| CN111338555B true CN111338555B (en) | 2022-03-15 |
Family
ID=71183479
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010102902.1A Active CN111338555B (en) | 2020-02-19 | 2020-02-19 | Method, device, equipment and storage medium for realizing input through virtual keyboard |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111338555B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111949969A (en) * | 2020-08-11 | 2020-11-17 | 深圳传音控股股份有限公司 | Keyboard style switching method and device and readable storage medium |
| CN112035901B (en) * | 2020-09-03 | 2023-09-12 | 北京元心科技有限公司 | Information input method, device, electronic equipment and medium |
| CN115037976A (en) * | 2021-03-03 | 2022-09-09 | Oppo广东移动通信有限公司 | Display method, terminal and storage medium |
| CN115495003A (en) * | 2021-09-18 | 2022-12-20 | 荣耀终端有限公司 | Keyboard display method, folding screen device and computer readable storage medium |
| CN114168063A (en) * | 2021-12-13 | 2022-03-11 | 杭州灵伴科技有限公司 | Virtual key display method, head-mounted display device, and computer-readable medium |
| US11960668B1 (en) | 2022-11-10 | 2024-04-16 | Honeywell International Inc. | Cursor management methods and systems for recovery from incomplete interactions |
| US11954325B1 (en) | 2023-04-05 | 2024-04-09 | Honeywell International Inc. | Methods and systems for assigning text entry components to cursors |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013125745A1 (en) * | 2012-02-21 | 2013-08-29 | Lg Electronics Inc. | Electronic device and method of controlling the same |
| CN103399710A (en) * | 2013-08-07 | 2013-11-20 | 福州瑞芯微电子有限公司 | Multi-window operating achieving mobile terminal and method |
| CN107430433A (en) * | 2015-01-07 | 2017-12-01 | 三星电子株式会社 | Display device and its operating method |
| CN107479627A (en) * | 2017-07-19 | 2017-12-15 | 武汉华星光电技术有限公司 | Notebook and the two-in-one computer of flat board |
| CN107678724A (en) * | 2017-10-19 | 2018-02-09 | 广东欧珀移动通信有限公司 | A kind of method for information display, device, mobile terminal and storage medium |
| CN107728901A (en) * | 2017-10-24 | 2018-02-23 | 广东欧珀移动通信有限公司 | interface display method, device and terminal |
| CN109085961A (en) * | 2011-11-16 | 2018-12-25 | 三星电子株式会社 | For running the mobile device and its method of multiple applications |
| CN109542314A (en) * | 2018-11-22 | 2019-03-29 | 维沃移动通信有限公司 | A kind of picture editing method and terminal device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160357358A1 (en) * | 2015-06-07 | 2016-12-08 | Apple Inc. | Device, Method, and Graphical User Interface for Manipulating Application Windows |
| CN107102806A (en) * | 2017-01-25 | 2017-08-29 | 维沃移动通信有限公司 | A kind of split screen input method and mobile terminal |
| CN109302508A (en) * | 2017-07-25 | 2019-02-01 | 中兴通讯股份有限公司 | A kind of method, the method for display control and the terminal of determining double screen relative position |
-
2020
- 2020-02-19 CN CN202010102902.1A patent/CN111338555B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109085961A (en) * | 2011-11-16 | 2018-12-25 | 三星电子株式会社 | For running the mobile device and its method of multiple applications |
| WO2013125745A1 (en) * | 2012-02-21 | 2013-08-29 | Lg Electronics Inc. | Electronic device and method of controlling the same |
| CN103399710A (en) * | 2013-08-07 | 2013-11-20 | 福州瑞芯微电子有限公司 | Multi-window operating achieving mobile terminal and method |
| CN107430433A (en) * | 2015-01-07 | 2017-12-01 | 三星电子株式会社 | Display device and its operating method |
| CN107479627A (en) * | 2017-07-19 | 2017-12-15 | 武汉华星光电技术有限公司 | Notebook and the two-in-one computer of flat board |
| CN107678724A (en) * | 2017-10-19 | 2018-02-09 | 广东欧珀移动通信有限公司 | A kind of method for information display, device, mobile terminal and storage medium |
| CN107728901A (en) * | 2017-10-24 | 2018-02-23 | 广东欧珀移动通信有限公司 | interface display method, device and terminal |
| CN109542314A (en) * | 2018-11-22 | 2019-03-29 | 维沃移动通信有限公司 | A kind of picture editing method and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111338555A (en) | 2020-06-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111338555B (en) | Method, device, equipment and storage medium for realizing input through virtual keyboard | |
| US11561680B2 (en) | Method and apparatus for adding icon to interface of android system, and mobile terminal | |
| KR101527827B1 (en) | Split-screen display method and apparatus, and electronic device thereof | |
| CN106951163B (en) | Display control method and device | |
| CN110874166B (en) | Page switching method and device, storage medium and computer equipment | |
| US20220155922A1 (en) | Side-toolbar-display method, terminal, and storage medium | |
| CN108829314B (en) | Screenshot selecting interface selection method, device, equipment and storage medium | |
| CN108064369B (en) | Interaction method and device of flexible display screen | |
| CN111580923B (en) | Control method and device and electronic equipment | |
| MX2013003517A (en) | Systems and methods relating to user interfaces for docking portable electronic devices. | |
| US9377944B2 (en) | Information processing device, information processing method, and information processing program | |
| CN108108078B (en) | Electronic equipment, display control method and related product | |
| CN108052254B (en) | Information processing method and electronic equipment | |
| CN108845752A (en) | touch operation method, device, storage medium and electronic equipment | |
| CN114415886A (en) | Application icon management method and electronic equipment | |
| US20160011773A1 (en) | User equipment and operation control method therefor | |
| US20150103025A1 (en) | Information processing device, method and program | |
| CN110413167A (en) | A kind of the screenshotss method and terminal device of terminal device | |
| CN104714739A (en) | Information processing method and electronic equipment | |
| CN114995713A (en) | Display control method and device, electronic equipment and readable storage medium | |
| CN114518819A (en) | Icon management method and device and electronic equipment | |
| CN110785741A (en) | Generating user interface containers | |
| EP3655849B1 (en) | Method for handling on a mobile terminal a list of contents each associated to a sub-content | |
| CN112148406A (en) | Page switching method and device, electronic equipment and readable storage medium | |
| WO2014021832A1 (en) | Remote display area including input lenses each depicting a region of a graphical user interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220216 Address after: 650106 No. 6666, Gaoxin Avenue, high tech Zone, Kunming, Yunnan Applicant after: Kunming Wentai Communication Co.,Ltd. Address before: Room 912-49, block B, 666 Beijing East Road, Huangpu District, Shanghai Applicant before: SHANGHAI WINGTECH ELECTRONICS TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |