CN114090158B - Display method, display device, electronic equipment and medium - Google Patents
Display method, display device, electronic equipment and medium Download PDFInfo
- Publication number
- CN114090158B CN114090158B CN202111390412.7A CN202111390412A CN114090158B CN 114090158 B CN114090158 B CN 114090158B CN 202111390412 A CN202111390412 A CN 202111390412A CN 114090158 B CN114090158 B CN 114090158B
- Authority
- CN
- China
- Prior art keywords
- virtual
- virtual key
- data
- group
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000004590 computer program Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 6
- 239000007787 solid Substances 0.000 description 6
- 230000006870 function Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Abstract
The disclosure provides a display method, a device, equipment, a medium and a product, relates to the technical field of computers, and is applied to scenes such as electronic equipment display and input methods. The display method comprises the following steps: acquiring operation data for a virtual input device and gesture data of electronic equipment, wherein the virtual input device is displayed on the electronic equipment; based on the operation data and the gesture data, a display mode of the virtual input device is adjusted.
Description
Technical Field
The present disclosure relates to the field of computer technology, and is applied to scenes such as electronic device display and input methods, and more particularly, to a display method, apparatus, electronic device, medium, and program product.
Background
In inputting content using an electronic device, it is often necessary to display a virtual input device so that a user inputs content based on the virtual input device. However, the related art does not consider the input needs of the user when displaying the virtual input device, resulting in poor user experience when inputting content.
Disclosure of Invention
The present disclosure provides a display method, apparatus, electronic device, storage medium, and program product.
According to an aspect of the present disclosure, there is provided a display method including: acquiring operation data for a virtual input device and gesture data of electronic equipment, wherein the virtual input device is displayed on the electronic equipment; and adjusting a display mode of the virtual input device based on the operation data and the gesture data.
According to another aspect of the present disclosure, there is provided a display apparatus including: the device comprises an acquisition module and a first adjustment module. The electronic equipment comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring operation data aiming at a virtual input device and gesture data of the electronic equipment, and the virtual input device is displayed on the electronic equipment; and the first adjusting module is used for adjusting the display mode of the virtual input device based on the operation data and the gesture data.
According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor and a memory communicatively coupled to the at least one processor. Wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the display method described above.
According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the above-described display method.
According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the above-described display method.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 schematically illustrates an application scenario of a display and apparatus according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates a flow chart of a display method according to an embodiment of the disclosure;
FIG. 3 schematically illustrates a schematic diagram of adjusting a display mode according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates a schematic diagram of adjusting a display mode according to another embodiment of the present disclosure;
FIG. 5 schematically illustrates a block diagram of a display device according to an embodiment of the disclosure; and
fig. 6 is a block diagram of an electronic device for performing a display method for implementing an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.
Where expressions like at least one of "A, B and C, etc. are used, the expressions should generally be interpreted in accordance with the meaning as commonly understood by those skilled in the art (e.g.," a system having at least one of A, B and C "shall include, but not be limited to, a system having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
The embodiment of the disclosure provides a display method, which comprises the following steps: operation data for a virtual input device and gesture data of the electronic equipment are acquired, and the virtual input device is displayed on the electronic equipment. Then, based on the operation data and the posture data, the display mode of the virtual input device is adjusted.
Fig. 1 schematically illustrates an application scenario of a display and apparatus according to an embodiment of the present disclosure. It should be noted that fig. 1 illustrates only an example of an application scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments, or scenarios.
As shown in fig. 1, the application scenario 100 according to this embodiment may include an electronic device 110, and the electronic device 110 may be a smart phone, a tablet computer, or the like.
The electronic device 110, for example, displays a virtual input device 111, which virtual input device 111 may include a virtual keyboard. In another example, virtual input device 111 may also be other virtual controls in addition to a virtual keyboard.
The user can hold the electronic device 110, and when the user needs to input the related content through the virtual input apparatus 111, if the electronic device 110 is oversized, it may cause inconvenience in operation when the user inputs the content. For example, some virtual keys in the virtual keyboard are displayed in a middle area of the electronic device 110, making it difficult for a user to click on the virtual keys while holding the electronic device 110.
In view of this, the embodiment of the present disclosure provides a display method, and a display method according to an exemplary embodiment of the present disclosure is described below with reference to fig. 2 to 4 in conjunction with the application scenario of fig. 1. The display method of the embodiment of the present disclosure may be performed by the electronic device shown in fig. 1, for example.
Fig. 2 schematically illustrates a flow chart of a display method according to an embodiment of the present disclosure.
As shown in fig. 2, the display method 200 of the embodiment of the present disclosure may include, for example, operations S210 to S220.
In operation S210, operation data for a virtual input device and gesture data of an electronic apparatus are acquired.
In operation S220, a display mode of the virtual input device is adjusted based on the operation data and the gesture data.
By way of example, the virtual input device may comprise a virtual keyboard, and the virtual input device may be displayed on a display screen of the electronic device. The operation data is, for example, data generated by clicking or touching the virtual input device by the user. The electronic device comprises a smart phone or a tablet personal computer, for example, a gyroscope is arranged in the electronic device, and gesture data of a user when the user holds the electronic device to input content can be obtained through the gyroscope. The gesture data characterizes, for example, tilt direction, tilt angle, etc. information of the electronic device.
Next, the input habit of the user may be determined based on the operation data and the gesture data, and the convenience or comfort of the user in inputting the content through the virtual input device may be known through the input habit. Then, the display mode of the virtual input device is adjusted according to the operation data and the gesture data, and when a user inputs related content through the adjusted virtual input device, the user can click or touch each virtual key in the virtual input device more easily, so that the operation convenience and the comfort of the user are improved.
According to the embodiment of the disclosure, when a user inputs related content through the virtual input device, operation data of the user and gesture data of the electronic equipment are collected, so that input habits of the user are known based on the operation data and the gesture data, and the display mode of the virtual input device is conveniently adjusted based on the operation data and the gesture data to adapt to the input habits of the user, so that the operation convenience and the comfort of the user are improved.
Fig. 3 schematically illustrates a schematic diagram of adjusting a display mode according to an embodiment of the present disclosure.
As shown in fig. 3, the virtual input device includes, for example, a plurality of virtual keys. The operation data includes, for example, operation data for each virtual key. When the user clicks the virtual key, operation data for the virtual key is acquired, and simultaneously gesture data of the electronic device can be acquired, wherein the gesture data comprises direction data, and the direction data characterizes the inclination direction of the electronic device.
Then, based on the operation data and the direction data for the virtual keys, the tilt direction of the electronic device when each virtual key is operated is determined, that is, the virtual key to which the operation data is determined based on the operation data, and the tilt direction for the virtual key is determined based on the direction data.
For example, when the user holds the electronic device with both hands and the electronic device is in a horizontal plane, the tilting directions include, for example, tilting to the left (left side of the electronic device downward, right side upward) and tilting to the right (right side of the electronic device downward, left side upward). When tilting to the left, the left hand of the user is lower than the right hand in the horizontal direction, i.e. the edge portion of the electronic device held by the left hand of the user is lower than the edge portion of the electronic device held by the right hand of the user. When tilting to the right, the user's right hand is lower than the left hand in the horizontal direction, i.e. the edge portion of the electronic device held by the user's right hand is lower than the edge portion of the electronic device held by the user's left hand.
For example, when the user holds the electronic device with both hands and the electronic device is in a vertical plane, the tilting directions include, for example, tilting to the left (left side of the electronic device is rearward, right side is forward) and tilting to the right (right side of the electronic device is rearward, left side is forward). When tilting to the left, the left hand of the user is located behind the right hand, i.e. the edge portion of the electronic device held by the left hand of the user is located behind the edge portion of the electronic device held by the right hand of the user. When tilting to the right, the right hand of the user is positioned behind the left hand, i.e. the edge portion of the electronic device held by the right hand of the user is positioned behind the edge portion of the electronic device held by the left hand of the user. It is understood that the anterior-posterior direction is defined relative to the user's body (or face).
Then, based on the corresponding inclination direction of each virtual key, a group to which each virtual key belongs is determined, so that a plurality of groups are obtained, and the corresponding inclination directions of the virtual keys of each group in the plurality of groups are consistent. The embodiment of the present disclosure takes a plurality of groups of 2 groups as an example, and for a certain group, the corresponding tilt directions of all virtual keys in the group are tilted to the left, for example.
For example, for a certain virtual key, multiple clicking operations of the user for the virtual key are acquired, operation data generated by the multiple clicking operations are accumulated, and then the inclination direction of the electronic device when the user clicks the virtual key is determined based on the operation data. If the tilt direction of the electronic device is tilted to the left when the user clicks the virtual key multiple times, the virtual key is divided into a first group 311, and if the tilt direction is tilted to the right, the virtual key is divided into a second group 312.
After obtaining the plurality of groups, displaying the virtual keys in each group in a target area of the electronic device, wherein the position information of the target area is associated with the corresponding inclination direction of each group. For example, virtual keys in the first group 311 are displayed in the left region of the electronic device and virtual keys in the second group 312 are displayed in the right region of the electronic device.
When a user clicks a virtual key with a left hand, if the virtual key is difficult to touch, the user will typically tilt the electronic device to the left for easy clicking, so that it may be characterized that the user has less comfort in clicking the virtual key with a left hand and needs to tilt the electronic device to the left. In order to improve click comfort of a user, the virtual keyboard is split into at least two parts, virtual keys of a left part (a first group 311) are displayed on the left side of the electronic device, and virtual keys of a right part (a second group 312) are displayed on the right side of the electronic device, so that the user can click the virtual keys conveniently, and comfort of the user is improved.
In another example, one virtual key may belong to multiple groupings. For example, when the corresponding tilt direction of a certain virtual key includes N corresponding tilt directions, it is determined that the virtual key belongs to N groups among a plurality of groups, the N groups are in one-to-one correspondence with the N corresponding tilt directions, and N is an integer greater than 1.
In other words, if the tilt direction for a certain virtual key is not fixed, for example, when the user is used to click the virtual key with the left hand or the right hand, the virtual key may be divided into the first group 311 and the second group 312, that is, when the virtual keyboard is split into two parts to be displayed, the virtual key may be displayed on both the left side and the right side of the electronic device, so that the user may click the virtual key with both the left hand and the right hand.
Fig. 4 schematically illustrates a schematic diagram of adjusting a display mode according to another embodiment of the present disclosure.
As shown in fig. 4, for a certain virtual key (a virtual key shown by a black solid box) in the virtual keyboard 410, if the operation data indicates that the user uses the left hand when clicking the virtual key, and the tilt direction of the electronic device is tilted to the left, it indicates that the user is used to click the virtual key using the left hand, and the tilt direction indicates that the comfort level is poor when the user clicks the virtual key.
To improve click comfort for the user, the virtual keyboard 410 may be displayed separately, i.e., the plurality of virtual keys in the virtual keyboard 410 may be divided into multiple groups, such as a first group 411A (or a first group 411B) and a second group 412A (or a second group 412B). The first group 411A is for example displayed in the left position of the electronic device, the second group 412A is for example displayed in the right position of the electronic device, and the virtual keys shown as black solid boxes belong to the first group 411A, for example.
In embodiments of the present disclosure, the gesture data may include angle data in addition to direction data. For each of the plurality of groupings, determining a tilt angle of the electronic device when each virtual key in the grouping is operated based on the operation data for the grouping and the angle data for the grouping.
For example, taking the first group 411A as an example, when the user clicks a virtual key (for example, a virtual key indicated by a black solid box) in the first group 411A, at least one of position information and size information of each virtual key is adjusted according to a corresponding inclination angle of the clicked virtual key.
For example, for tilt scene 400A and tilt scene 400B, when the user clicks on a virtual key (e.g., a virtual key shown as a black solid box), the corresponding tilt angle of tilt scene 400B is greater than the corresponding tilt angle of tilt scene 400A, which characterizes less comfort for the user clicking on the virtual key of first packet 411A in tilt scene 400B.
At this time, based on the corresponding inclination angle of the virtual key, the position information of the virtual key is adjusted, so that the virtual key is close to the edge of the electronic device. For example, the position of the virtual keys in the first group 411A may be adjusted to be near the left edge of the electronic device, facilitating the user's use of the left hand to click on the virtual keys in the first group 411A. In addition, if the virtual keys of the first group 411A are located too close to the lower edge of the electronic device (which is inconvenient for the user to operate at this time), the virtual keys of the first group 411A may be adjusted toward the upper edge of the electronic device, so that the virtual keys of the first group 411A are slightly far from the lower edge of the electronic device, so as to facilitate the user to operate.
In addition, the size of the virtual key may also be compressed in a direction toward an edge of the electronic device based on the corresponding tilt angle of the virtual key. For example, the virtual keys of the first group 411B may be compressed toward the left edge of the electronic device such that the virtual key size of the first group 411B becomes smaller (reduced in width) to facilitate the user's left hand clicking on the keys of the first group 411B.
In addition, when the positions and the sizes of the virtual keys are adjusted, the positions and the sizes of all the virtual keys in the group can be adjusted, the positions and the sizes of one virtual key (for example, the virtual keys shown by the black solid boxes) in the group can be independently adjusted, or the positions and the sizes of all the virtual keys in the row where the virtual key (for example, the virtual keys shown by the black solid boxes) is located can be adjusted. It will be appreciated that the embodiments of the present disclosure are not particularly limited as to which virtual keys are adjusted in position and size.
Illustratively, the larger the inclination angle is, the greater the degree of position change and the degree of size change are when the position and the size of the virtual key are adjusted. I.e. the larger the tilt angle, the closer the virtual keys are located in the group to the edge of the electronic device, the smaller the size of the virtual keys.
According to the embodiment of the disclosure, the virtual keyboard can be divided into a plurality of groups for display based on the operation data and the inclination direction of the electronic equipment, and the position and the size of the virtual keyboard can be adjusted according to the inclination angle, so that a user can operate the virtual keyboard conveniently, and the operation convenience and the comfort are improved.
In another embodiment of the present disclosure, the gesture data of the electronic device includes, for example, angle data, and the virtual input means includes a plurality of virtual keys. The entire virtual keyboard may be directly determined based on the operation data and the angle data, without being divided into a plurality of groups, as to the tilt angle of the electronic device when each virtual key is operated. And then respectively adjusting the position information and the size information of each virtual key according to the corresponding inclination angle of each virtual key.
For example, when a user is used to click a certain virtual key with a left hand, if the corresponding inclination angle when clicking the virtual key is larger, the position of the virtual key can be adjusted to be closer to the left side of the electronic device, and the virtual key can be compressed towards the left edge of the electronic device, so that the size of the virtual key is reduced (the width is reduced), and the center point of the virtual key is closer to the left edge of the electronic device, so that the user can click the virtual key with the left hand conveniently.
Fig. 5 schematically shows a block diagram of a display device according to an embodiment of the present disclosure.
As shown in fig. 5, a display device 500 of an embodiment of the present disclosure includes, for example, an acquisition module 510 and a first adjustment module 520.
The acquisition module 510 may be configured to acquire operation data for a virtual input device and gesture data of an electronic apparatus, where the virtual input device is displayed on the electronic apparatus. According to an embodiment of the present disclosure, the obtaining module 510 may perform, for example, operation S210 described above with reference to fig. 2, which is not described herein.
The first adjustment module 520 may be used to adjust the display mode of the virtual input device based on the operation data and the gesture data. According to an embodiment of the present disclosure, the first adjustment module 520 may perform, for example, the operation S220 described above with reference to fig. 2, which is not described herein.
According to an embodiment of the present disclosure, the gesture data includes direction data, and the virtual input device includes a plurality of virtual keys; the first adjustment module 520 includes: the display device comprises a first determining sub-module, a second determining sub-module and a display sub-module. The first determining submodule is used for determining the inclination direction of the electronic equipment when each virtual key in the plurality of virtual keys is operated based on the operation data and the direction data; the second determining submodule is used for determining a group to which each virtual key belongs based on the corresponding inclination direction of each virtual key so as to obtain a plurality of groups, wherein the corresponding inclination directions of the virtual keys in each group are consistent; and the display sub-module is used for displaying the virtual keys in each group in a target area of the electronic equipment, and the position information of the target area is associated with the corresponding inclination direction of each group.
According to an embodiment of the present disclosure, the second determination submodule is further configured to: and under the condition that the corresponding inclination directions of the virtual keys comprise N corresponding inclination directions, determining that the virtual keys belong to N groups in a plurality of groups, wherein the N groups are in one-to-one correspondence with the N corresponding inclination directions, and N is an integer larger than 1.
According to an embodiment of the present disclosure, the gesture data further includes angle data; the apparatus 500 may further include: a determining module and a second adjusting module. A determining module configured to determine, for each of a plurality of groups, an inclination angle of the electronic device when each virtual key in the group is operated, based on the operation data for the group and the angle data for the group; and the second adjusting module is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
According to an embodiment of the present disclosure, the gesture data includes angle data, and the virtual input device includes a plurality of virtual keys; the first adjustment module 520 includes: a third determination sub-module and an adjustment sub-module. A third determining sub-module for determining an inclination angle of the electronic device when each virtual key of the plurality of virtual keys is operated based on the operation data and the angle data; and the adjusting sub-module is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
According to an embodiment of the present disclosure, the second adjustment module or adjustment sub-module is further configured to: based on the corresponding inclination angle of the virtual key, adjusting the position information of the virtual key to enable the virtual key to be close to the edge of the electronic equipment; the size of the virtual key is compressed in a direction towards an edge of the electronic device based on the corresponding tilt angle of the virtual key.
In the technical scheme of the disclosure, the related processes of collecting, storing, using, processing, transmitting, providing, disclosing and the like of the personal information of the user accord with the regulations of related laws and regulations, and the public order colloquial is not violated.
According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
Fig. 6 is a block diagram of an electronic device for performing a display method for implementing an embodiment of the present disclosure.
Fig. 6 illustrates a schematic block diagram of an example electronic device 600 that may be used to implement embodiments of the present disclosure. The electronic device 600 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the apparatus 600 includes a computing unit 601 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM603, various programs and data required for the operation of the device 600 may also be stored. The computing unit 601, ROM602, and RAM603 are connected to each other by a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Various components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, mouse, etc.; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 601 performs the respective methods and processes described above, such as a display method. For example, in some embodiments, the display method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM602 and/or the communication unit 609. When the computer program is loaded into the RAM603 and executed by the computing unit 601, one or more steps of the display method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the display method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable display device such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel, sequentially, or in a different order, provided that the desired results of the disclosed aspects are achieved, and are not limited herein.
The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.
Claims (12)
1. A display method, comprising:
acquiring operation data for a virtual input device and gesture data of electronic equipment, wherein the virtual input device is displayed on the electronic equipment, the gesture data comprises direction data, and the virtual input device comprises a plurality of virtual keys;
determining an inclination direction of the electronic device when each virtual key of the plurality of virtual keys is operated based on the operation data and the direction data;
determining a group to which each virtual key belongs based on the corresponding inclination direction of each virtual key to obtain a plurality of groups, wherein the corresponding inclination direction of the virtual key of each group in the plurality of groups is consistent; and
and displaying the virtual keys in each group in a target area of the electronic equipment, wherein the position information of the target area is associated with the corresponding inclination direction of each group.
2. The method of claim 1, wherein the determining, based on the corresponding tilt direction of each virtual key, the group to which each virtual key belongs comprises:
and under the condition that the corresponding inclination directions of the virtual keys comprise N corresponding inclination directions, determining that the virtual keys belong to N groups in the plurality of groups, wherein the N groups are in one-to-one correspondence with the N corresponding inclination directions, and N is an integer larger than 1.
3. The method of claim 1, wherein the gesture data further comprises angle data; the method further comprises the steps of:
for each of the plurality of groupings, determining an inclination angle of the electronic device when each virtual key in the grouping is operated based on the operation data for the grouping and the angle data for the grouping; and
and adjusting at least one of position information and size information of each virtual key based on the corresponding inclination angle of each virtual key.
4. The method of claim 1, wherein the gesture data further comprises angle data; the method further comprises the steps of:
determining an inclination angle of the electronic device when each virtual key of the plurality of virtual keys is operated based on the operation data and the angle data; and
and adjusting at least one of position information and size information of each virtual key based on the corresponding inclination angle of each virtual key.
5. The method of claim 3 or 4, wherein the adjusting at least one of the position information and the size information of each virtual key based on the corresponding tilt angle of each virtual key comprises:
based on the corresponding inclination angle of the virtual key, adjusting the position information of the virtual key so that the virtual key is close to the edge of the electronic equipment; and
and based on the corresponding inclination angle of the virtual key, compressing the size of the virtual key towards the edge of the electronic equipment.
6. A display device, comprising:
the electronic equipment comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring operation data aiming at a virtual input device and gesture data of the electronic equipment, the virtual input device is displayed on the electronic equipment, the gesture data comprises direction data, and the virtual input device comprises a plurality of virtual keys;
a first determining sub-module for determining, based on the operation data and the direction data, a tilt direction of the electronic device when each virtual key of the plurality of virtual keys is operated;
a second determining submodule, configured to determine, based on the corresponding tilt direction of each virtual key, a group to which each virtual key belongs, so as to obtain a plurality of groups, where the corresponding tilt directions of the virtual keys in each group in the plurality of groups are consistent; and
and the display sub-module is used for displaying the virtual keys in each group in a target area of the electronic equipment, and the position information of the target area is associated with the corresponding inclination direction of each group.
7. The apparatus of claim 6, wherein the second determination submodule is further to:
and under the condition that the corresponding inclination directions of the virtual keys comprise N corresponding inclination directions, determining that the virtual keys belong to N groups in the plurality of groups, wherein the N groups are in one-to-one correspondence with the N corresponding inclination directions, and N is an integer larger than 1.
8. The apparatus of claim 6, wherein the gesture data further comprises angle data; the apparatus further comprises:
a determining module configured to determine, for each of the plurality of groups, an inclination angle of the electronic device when each virtual key in the group is operated, based on the operation data for the group and the angle data for the group; and
and the second adjusting module is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
9. The apparatus of claim 6, wherein the gesture data comprises angle data; the apparatus further comprises:
a third determining sub-module for determining an inclination angle of the electronic device when each virtual key of the plurality of virtual keys is operated based on the operation data and the angle data; and
and the adjustment sub-module is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
10. The apparatus of claim 8 or 9, wherein the second adjustment module or the adjustment sub-module is further configured to:
based on the corresponding inclination angle of the virtual key, adjusting the position information of the virtual key so that the virtual key is close to the edge of the electronic equipment; and
and based on the corresponding inclination angle of the virtual key, compressing the size of the virtual key towards the edge of the electronic equipment.
11. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
12. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111390412.7A CN114090158B (en) | 2021-11-22 | 2021-11-22 | Display method, display device, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111390412.7A CN114090158B (en) | 2021-11-22 | 2021-11-22 | Display method, display device, electronic equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114090158A CN114090158A (en) | 2022-02-25 |
| CN114090158B true CN114090158B (en) | 2024-04-02 |
Family
ID=80303185
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111390412.7A Active CN114090158B (en) | 2021-11-22 | 2021-11-22 | Display method, display device, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114090158B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101251781A (en) * | 2008-03-13 | 2008-08-27 | 魏新成 | Virtual keyboard performing input and function operations through mobile phones transverse screen status display |
| CN102023806A (en) * | 2010-12-17 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Input method for touch screen |
| TW201308188A (en) * | 2011-08-04 | 2013-02-16 | Chinatrust Commercial Bank Ltd | Key display method of virtual keyboard |
| TW201317836A (en) * | 2011-10-18 | 2013-05-01 | Jia-Ling Li | Programmable virtual keyboard input method |
| CN103576886A (en) * | 2012-08-07 | 2014-02-12 | 李焌坚 | Scheme of digital double-pinyin double-stroke input method and keyboard thereof |
| US9134809B1 (en) * | 2011-03-21 | 2015-09-15 | Amazon Technologies Inc. | Block-based navigation of a virtual keyboard |
| CN108008896A (en) * | 2017-12-20 | 2018-05-08 | 广东欧珀移动通信有限公司 | Display control method and related product |
| CN111026322A (en) * | 2019-12-02 | 2020-04-17 | 科大讯飞股份有限公司 | Keyboard layout method and device, electronic equipment and storage medium |
| CN111124242A (en) * | 2019-12-12 | 2020-05-08 | 科大讯飞股份有限公司 | Function key display method and device, electronic equipment and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130002565A1 (en) * | 2011-06-28 | 2013-01-03 | Microsoft Corporation | Detecting portable device orientation and user posture via touch sensors |
| WO2016007946A1 (en) * | 2014-07-11 | 2016-01-14 | Handwriting Without Tears | System and method for teaching pre-keyboarding and keyboarding |
-
2021
- 2021-11-22 CN CN202111390412.7A patent/CN114090158B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101251781A (en) * | 2008-03-13 | 2008-08-27 | 魏新成 | Virtual keyboard performing input and function operations through mobile phones transverse screen status display |
| CN102023806A (en) * | 2010-12-17 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Input method for touch screen |
| US9134809B1 (en) * | 2011-03-21 | 2015-09-15 | Amazon Technologies Inc. | Block-based navigation of a virtual keyboard |
| TW201308188A (en) * | 2011-08-04 | 2013-02-16 | Chinatrust Commercial Bank Ltd | Key display method of virtual keyboard |
| TW201317836A (en) * | 2011-10-18 | 2013-05-01 | Jia-Ling Li | Programmable virtual keyboard input method |
| CN103576886A (en) * | 2012-08-07 | 2014-02-12 | 李焌坚 | Scheme of digital double-pinyin double-stroke input method and keyboard thereof |
| CN108008896A (en) * | 2017-12-20 | 2018-05-08 | 广东欧珀移动通信有限公司 | Display control method and related product |
| CN111026322A (en) * | 2019-12-02 | 2020-04-17 | 科大讯飞股份有限公司 | Keyboard layout method and device, electronic equipment and storage medium |
| CN111124242A (en) * | 2019-12-12 | 2020-05-08 | 科大讯飞股份有限公司 | Function key display method and device, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 虚拟键盘技术专利综述;贾晓艳;;中国发明与专利(03);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114090158A (en) | 2022-02-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111524166B (en) | Video frame processing method and device | |
| CN112580324B (en) | Text error correction method, device, electronic equipment and storage medium | |
| CN114612600B (en) | Virtual image generation method and device, electronic equipment and storage medium | |
| CN110737336A (en) | video display direction adjusting method, device and computer readable storage medium | |
| CN114792355B (en) | Virtual image generation method and device, electronic equipment and storage medium | |
| CN112488914A (en) | Image splicing method, device, terminal and computer readable storage medium | |
| CN115147265A (en) | Virtual image generation method and device, electronic equipment and storage medium | |
| CN110633717A (en) | Training method and device for target detection model | |
| CN113657518B (en) | Training method, target image detection method, device, electronic device, and medium | |
| CN113628239B (en) | Display optimization method, related device and computer program product | |
| CN113033346B (en) | Text detection method and device and electronic equipment | |
| CN111191619A (en) | Method, device and equipment for detecting virtual line segment of lane line and readable storage medium | |
| CN114327057A (en) | Object selection method, device, equipment, medium and program product | |
| CN111737636B (en) | Path curve generation method, device, computer equipment and storage medium | |
| CN114090158B (en) | Display method, display device, electronic equipment and medium | |
| CN113657408A (en) | Method and device for determining image characteristics, electronic equipment and storage medium | |
| CN112541934B (en) | Image processing method and device | |
| CN113905040A (en) | File transmission method, device, system, equipment and storage medium | |
| CN113360074B (en) | Soft keyboard display method, related device and computer program product | |
| CN111461969A (en) | Method, device, electronic equipment and computer readable medium for processing picture | |
| CN113961132B (en) | Interactive processing method and device, electronic equipment and storage medium | |
| CN113377201A (en) | Input method panel display method and device | |
| CN114820908B (en) | Virtual image generation method and device, electronic equipment and storage medium | |
| CN114327346B (en) | Display method, display device, electronic apparatus, and storage medium | |
| CN113377380B (en) | User interface component deployment method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |