CN114090158A - Display method, display device, electronic apparatus, and medium - Google Patents
Display method, display device, electronic apparatus, and medium Download PDFInfo
- Publication number
- CN114090158A CN114090158A CN202111390412.7A CN202111390412A CN114090158A CN 114090158 A CN114090158 A CN 114090158A CN 202111390412 A CN202111390412 A CN 202111390412A CN 114090158 A CN114090158 A CN 114090158A
- Authority
- CN
- China
- Prior art keywords
- virtual
- data
- virtual key
- group
- adjusting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004590 computer program Methods 0.000 claims description 11
- 238000005516 engineering process Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 239000007787 solid Substances 0.000 description 6
- 230000006870 function Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present disclosure provides a display method, apparatus, device, medium, and product, which relate to the field of computer technology and are applied to scenes such as electronic device display, input method, and the like. The display method comprises the following steps: acquiring operation data aiming at a virtual input device and posture data of the electronic equipment, wherein the virtual input device is displayed on the electronic equipment; adjusting a display mode of the virtual input device based on the operation data and the posture data.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and more particularly, to a display method, an apparatus, an electronic device, a medium, and a program product, which are applied to a scene such as a display method and an input method of an electronic device.
Background
In inputting content using an electronic device, it is often necessary to display a virtual input device so that a user can input content based on the virtual input device. However, the related art does not consider the input requirements of the user when displaying the virtual input device, resulting in poor user experience when inputting content.
Disclosure of Invention
The disclosure provides a display method, a display apparatus, an electronic device, a storage medium, and a program product.
According to an aspect of the present disclosure, there is provided a display method including: acquiring operation data for a virtual input device and attitude data of an electronic device, wherein the virtual input device is displayed on the electronic device; adjusting a display mode of the virtual input device based on the operational data and the gesture data.
According to another aspect of the present disclosure, there is provided a display device including: the device comprises an acquisition module and a first adjusting module. The electronic equipment comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring operation data aiming at a virtual input device and posture data of the electronic equipment, and the virtual input device is displayed on the electronic equipment; a first adjusting module for adjusting a display mode of the virtual input device based on the operation data and the posture data.
According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor and a memory communicatively coupled to the at least one processor. Wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the above-described display method.
According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the above-described display method.
According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the above-described display method.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 schematically illustrates an application scenario of a display and apparatus according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates a flow chart of a display method according to an embodiment of the present disclosure;
FIG. 3 schematically illustrates a schematic diagram of adjusting a display mode according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates a schematic diagram of adjusting a display mode according to another embodiment of the present disclosure;
FIG. 5 schematically illustrates a block diagram of a display device according to an embodiment of the present disclosure; and
fig. 6 is a block diagram of an electronic device for performing a display method for implementing an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
An embodiment of the present disclosure provides a display method, including: operation data for a virtual input device and attitude data of an electronic apparatus are acquired, and the virtual input device is displayed on the electronic apparatus. Then, a display mode of the virtual input device is adjusted based on the operation data and the posture data.
Fig. 1 schematically illustrates an application scenario of a display and apparatus according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of an application scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the application scenario 100 according to the embodiment may include an electronic device 110, and the electronic device 110 may be a smartphone, a tablet computer, or the like.
The electronic device 110 for example displays a virtual input means 111, which virtual input means 111 may comprise a virtual keyboard. In another example, the virtual input device 111 may also be other virtual controls besides a virtual keyboard.
The user can hold the electronic device 110, and when the user needs to input the related content through the virtual input device 111, if the size of the electronic device 110 is too large, the user will have inconvenience in inputting the content. For example, certain virtual keys of the virtual keyboard are displayed in a middle area of the electronic device 110, making it difficult for a user to click on the virtual keys in the case of holding the electronic device 110.
In view of this, the disclosed embodiments provide a display method, and the following describes a display method according to an exemplary embodiment of the present disclosure with reference to fig. 2 to 4 in conjunction with the application scenario of fig. 1. The display method of the embodiment of the present disclosure may be performed by the electronic device shown in fig. 1, for example.
Fig. 2 schematically shows a flow chart of a display method according to an embodiment of the present disclosure.
As shown in fig. 2, the display method 200 of the embodiment of the present disclosure may include, for example, operations S210 to S220.
In operation S210, operation data for the virtual input device and gesture data of the electronic apparatus are acquired.
In operation S220, a display mode of the virtual input apparatus is adjusted based on the operation data and the posture data.
Illustratively, the virtual input device may include a virtual keyboard, and the virtual input device may be displayed on a display screen of the electronic apparatus. The operation data is generated by, for example, a user clicking or touching the virtual input device. The electronic device includes, for example, a smart phone or a tablet computer, and a gyroscope is provided in the electronic device, and the gyroscope can acquire gesture data when a user holds the electronic device to input content. The pose data characterizes, for example, tilt direction, tilt angle, etc. information of the electronic device.
Next, an input habit of the user may be determined based on the operation data and the posture data, and a degree of convenience or a degree of comfort of the user in inputting the content through the virtual input device may be known through the input habit. Then, the display mode of the virtual input device is adjusted according to the operation data and the posture data, and when a user inputs related contents through the adjusted virtual input device, the user can click or touch each virtual key in the virtual input device more easily, so that the operation convenience and the comfort of the user are improved.
According to the embodiment of the disclosure, when a user inputs related content through the virtual input device, operation data of the user and posture data of the electronic equipment are collected, so that the input habit of the user can be known based on the operation data and the posture data, and the display mode of the virtual input device can be adjusted to adapt to the input habit of the user based on the operation data and the posture data, so that the operation convenience and the comfort of the user are improved.
Fig. 3 schematically illustrates a schematic diagram of adjusting a display mode according to an embodiment of the present disclosure.
As shown in fig. 3, the virtual input means includes, for example, a plurality of virtual keys. The operation data includes, for example, operation data for each virtual key. When the user clicks the virtual key, operation data for the virtual key is acquired, and meanwhile gesture data of the electronic device can be acquired, wherein the gesture data comprises direction data, for example, and the direction data represents the inclination direction of the electronic device.
Then, based on the operation data and the direction data for the virtual keys, the tilt direction of the electronic device when each virtual key is operated is determined, i.e. the virtual key for which the operation data is determined, and the tilt direction for the virtual key is determined based on the direction data.
For example, when the user holds the electronic device with both hands and the electronic device is horizontal, the tilt directions include, for example, tilting to the left (left side of the electronic device is down, right side is up) and tilting to the right (right side of the electronic device is down, left side is up). When leaning to the left, the left hand of the user is lower than the right hand in the horizontal direction, i.e. the edge part of the electronic equipment held by the left hand of the user is lower than the edge part of the electronic equipment held by the right hand of the user. When tilted to the right, the user's right hand is lower than the left hand in the horizontal direction, i.e. the edge portion of the electronic device held by the user's right hand is lower than the edge portion of the electronic device held by the user's left hand.
For example, when the user holds the electronic device with both hands and the electronic device is in an upright position, the tilt directions include, for example, tilting to the left (left side of the electronic device is backward and right side is forward) and tilting to the right (right side of the electronic device is backward and left side is forward). When leaning to the left, the user's left hand is positioned behind the right hand, i.e., the portion of the edge of the electronic device held by the user's left hand is positioned behind the portion of the edge of the electronic device held by the user's right hand. When tilted to the right, the user's right hand is positioned behind the left hand, i.e., the portion of the edge of the electronic device held by the user's right hand is positioned behind the portion of the edge of the electronic device held by the user's left hand. It is understood that the front-to-back direction is defined relative to the user's body (or face).
Then, a group to which each virtual key belongs is determined based on the corresponding tilt direction of each virtual key, thereby obtaining a plurality of groups, and the corresponding tilt directions of the virtual keys of each group in the plurality of groups are identical. The embodiment of the present disclosure takes the plurality of groups as 2 groups as an example, and for a certain group, the corresponding tilt directions of all virtual keys in the group are all tilted to the left, for example.
For example, for a virtual key, a plurality of times of clicking operations of the virtual key by a user are acquired, operation data generated by the plurality of times of operations are accumulated, and then the tilt direction of the electronic device when the virtual key is clicked by the user is determined based on the operation data. If the tilt direction of the electronic device is to tilt to the left when the user clicks the virtual key multiple times, the virtual key is classified into a first group 311, and if the tilt direction is to tilt to the right, the virtual key is classified into a second group 312.
After a plurality of groups are obtained, the virtual keys in each group are displayed in a target area of the electronic equipment, and the position information of the target area is associated with the corresponding inclination direction of each group. For example, the virtual keys in the first grouping 311 are displayed in a left region of the electronic device and the virtual keys in the second grouping 312 are displayed in a right region of the electronic device.
When a user clicks a virtual key with the left hand, if the virtual key is hard to touch, the user usually tilts the electronic device to the left for easy clicking, so that it can be characterized that the user is used to click the virtual key with the left hand and the comfort level is low when the user clicks the virtual key, and the electronic device needs to be tilted to the left. In order to improve the clicking comfort of the user, the virtual keyboard is divided into at least two parts, the virtual keys of the left part (the first group 311) are displayed on the left side of the electronic device, and the virtual keys of the right part (the second group 312) are displayed on the right side of the electronic device, so that the user can click the virtual keys conveniently, and the clicking comfort of the user is improved.
In another example, one virtual key may belong to multiple groups. For example, when the corresponding tilt direction of a certain virtual key includes N corresponding tilt directions, it is determined that the virtual key belongs to N groups of a plurality of groups, the N groups are in one-to-one correspondence with the N corresponding tilt directions, and N is an integer greater than 1.
In other words, if the tilting direction of a certain virtual key is not fixed, for example, when the user is used to click the virtual key with left hand or right hand, the virtual key may be divided into the first group 311 and the second group 312, that is, when the virtual keyboard is displayed by being separated into two parts, the virtual key may be displayed on both left side and right side of the electronic device, so that the user can click the virtual key with both left hand or right hand.
Fig. 4 schematically illustrates a schematic diagram of adjusting a display mode according to another embodiment of the present disclosure.
As shown in fig. 4, for a certain virtual key (virtual key shown by black solid box) in the virtual keyboard 410, if the operation data indicates that the user uses the left hand when clicking the virtual key, and the tilt direction of the electronic device is tilted to the left, it indicates that the user is accustomed to using the left hand to click the virtual key, and the tilt direction indicates that the user does not have good comfort when clicking the virtual key.
To improve the clicking comfort of the user, the virtual keyboard 410 may be displayed separately, i.e., the virtual keys in the virtual keyboard 410 are divided into multiple groups, for example, into a first group 411A (or a first group 411B) and a second group 412A (or a second group 412B). The first grouping 411A is for example displayed in a left position of the electronic device, the second grouping 412A is for example displayed in a right position of the electronic device, and virtual keys shown as solid black boxes for example belong to the first grouping 411A.
In embodiments of the present disclosure, the pose data may include angle data in addition to orientation data. For each of a plurality of groups, a tilt angle of the electronic device when operating each virtual key in the group is determined based on the operation data for the group and the angle data for the group.
For example, taking the first grouping 411A as an example, when the user clicks a virtual key (e.g., a virtual key shown by a black solid box) in the first grouping 411A, at least one of the position information and the size information of each virtual key is adjusted according to the corresponding tilt angle of the clicked virtual key.
For example, for the oblique scene 400A and the oblique scene 400B, when the user clicks a virtual key (e.g., a virtual key shown by a black solid box), the corresponding tilt angle of the oblique scene 400B is greater than that of the oblique scene 400A, and this represents that the comfort level of the user clicking the virtual key of the first packet 411A in the oblique scene 400B is lower.
At this time, the position information of the virtual key is adjusted based on the corresponding inclination angle of the virtual key, so that the virtual key is close to the edge of the electronic device. For example, the virtual keys of the first grouping 411A may be positioned near the left edge of the electronic device to facilitate a user clicking on the virtual keys in the first grouping 411A using the left hand. In addition, if the virtual keys of the first group 411A are located too close to the lower edge of the electronic device (which is inconvenient for the user to operate), the virtual keys of the first group 411A may also be adjusted toward the upper edge of the electronic device such that the virtual keys of the first group 411A are slightly away from the lower edge of the electronic device for the user to operate.
In addition, the size of the virtual keys may also be compressed in a direction of an edge of the electronic device based on the corresponding tilt angles of the virtual keys. For example, the virtual keys of the first group 411B may be compressed toward the left edge of the electronic device, such that the virtual keys of the first group 411B become smaller in size (reduced in width) for the user to click on the keys of the first group 411B with the left hand.
In addition, when the positions and sizes of the virtual keys are adjusted, the positions and sizes of all the virtual keys in the group may be adjusted, the position and size of one virtual key (for example, the virtual key shown by the black solid square) in the group may be adjusted independently, or the positions and sizes of all the virtual keys in the row where the virtual key (for example, the virtual key shown by the black solid square) is located may be adjusted. It is understood that the embodiments of the present disclosure do not specifically limit which virtual keys are adjusted in position and size.
For example, the larger the tilt angle is, the larger the degree of positional change and the degree of size change when adjusting the position and size of the virtual key. That is, the larger the tilt angle, the closer the position of the group where the virtual key is located to the edge of the electronic device, the smaller the size of the virtual key.
According to the embodiment of the disclosure, the virtual keyboard can be divided into a plurality of groups to be displayed respectively based on the operation data and the inclination direction of the electronic equipment, and the position and the size of the virtual keyboard can be adjusted according to the inclination angle, so that a user can operate the virtual keyboard conveniently, and the operation convenience and the comfort level are improved.
In another embodiment of the present disclosure, the gesture data of the electronic device includes, for example, angle data, and the virtual input means includes a plurality of virtual keys. The whole virtual keyboard can be divided into a plurality of groups, and the inclination angle of the electronic equipment when each virtual key is operated can be directly determined based on the operation data and the angle data. And then respectively adjusting the position information and the size information of each virtual key according to the corresponding inclination angle of each virtual key.
For example, when a user is accustomed to use the left hand to click a virtual key, if the corresponding inclination angle when the virtual key is clicked is larger, the position of the virtual key can be adjusted to be closer to the left side of the electronic device, and the virtual key can be compressed towards the left edge of the electronic device, so that the size of the virtual key is reduced (the width is reduced), the center point of the virtual key is closer to the left edge of the electronic device, and the user can conveniently click the virtual key with the left hand.
Fig. 5 schematically illustrates a block diagram of a display device according to an embodiment of the present disclosure.
As shown in fig. 5, the display device 500 of the embodiment of the present disclosure includes, for example, an obtaining module 510 and a first adjusting module 520.
The obtaining module 510 may be configured to obtain operational data for a virtual input device and pose data for an electronic device, where the virtual input device is displayed on the electronic device. According to the embodiment of the present disclosure, the obtaining module 510 may perform, for example, the operation S210 described above with reference to fig. 2, which is not described herein again.
The first adjustment module 520 may be used to adjust a display mode of the virtual input device based on the operational data and the pose data. According to the embodiment of the present disclosure, the first adjusting module 520 may perform, for example, the operation S220 described above with reference to fig. 2, which is not described herein again.
According to an embodiment of the present disclosure, the gesture data includes direction data, the virtual input device includes a plurality of virtual keys; the first adjustment module 520 includes: the display device comprises a first determination submodule, a second determination submodule and a display submodule. The first determining submodule is used for determining the inclination direction of the electronic equipment when each virtual key in the plurality of virtual keys is operated on the basis of the operation data and the direction data; the second determining submodule is used for determining the grouping to which each virtual key belongs based on the corresponding inclination direction of each virtual key so as to obtain a plurality of groups, wherein the corresponding inclination directions of the virtual keys of each group in the plurality of groups are consistent; and the display sub-module is used for displaying the virtual keys in each group in a target area of the electronic equipment, and the position information of the target area is associated with the corresponding inclination direction of each group.
According to an embodiment of the disclosure, the second determination submodule is further configured to: and under the condition that the corresponding inclined directions of the virtual keys comprise N corresponding inclined directions, determining that the virtual keys belong to N groups of a plurality of groups, wherein the N groups correspond to the N corresponding inclined directions one by one, and N is an integer greater than 1.
According to an embodiment of the present disclosure, the pose data further comprises angle data; the apparatus 500 may further comprise: the device comprises a determining module and a second adjusting module. A determination module for determining, for each of a plurality of groups, a tilt angle of the electronic device when operating each virtual key in the group based on the operation data for the group and the angle data for the group; and the second adjusting module is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
According to an embodiment of the present disclosure, the gesture data includes angle data, and the virtual input device includes a plurality of virtual keys; the first adjustment module 520 includes: a third determination submodule and an adjustment submodule. A third determining submodule, configured to determine, based on the operation data and the angle data, an inclination angle of the electronic device when each of the plurality of virtual keys is operated; and the adjusting submodule is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
According to an embodiment of the present disclosure, the second adjusting module or the adjusting submodule is further configured to: adjusting the position information of the virtual keys based on the corresponding inclination angles of the virtual keys to enable the virtual keys to be close to the edge of the electronic equipment; based on the corresponding tilt angle of the virtual key, the size of the virtual key is compressed in a direction of an edge of the electronic device.
In the technical scheme of the disclosure, the collection, storage, use, processing, transmission, provision, disclosure and other processing of the personal information of the related user are all in accordance with the regulations of related laws and regulations and do not violate the good customs of the public order.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
Fig. 6 is a block diagram of an electronic device for performing a display method for implementing an embodiment of the present disclosure.
FIG. 6 illustrates a schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure. The electronic device 600 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the apparatus 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM603, various programs and data required for the operation of the device 600 can also be stored. The calculation unit 601, the ROM602, and the RAM603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
A number of components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, a mouse, or the like; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 601 executes the respective methods and processes described above, such as the display method. For example, in some embodiments, the display method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM602 and/or the communication unit 609. When the computer program is loaded into the RAM603 and executed by the computing unit 601, one or more steps of the display method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the display method by any other suitable means (e.g. by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable display device such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (15)
1. A display method, comprising:
acquiring operation data for a virtual input device and attitude data of an electronic device, wherein the virtual input device is displayed on the electronic device; and
adjusting a display mode of the virtual input device based on the operational data and the pose data.
2. The method of claim 1, wherein the gesture data comprises orientation data, the virtual input device comprises a plurality of virtual keys; the adjusting a display mode of the virtual input device based on the operational data and the gesture data comprises:
determining a tilt direction of the electronic device when each of the plurality of virtual keys is operated based on the operation data and the direction data;
determining a group to which each virtual key belongs based on the corresponding tilt direction of each virtual key to obtain a plurality of groups, wherein the corresponding tilt direction of the virtual key of each group in the plurality of groups is consistent; and
displaying the virtual keys in each group in a target area of the electronic equipment, wherein the position information of the target area is associated with the corresponding inclination direction of each group.
3. The method of claim 2, wherein the determining the group to which the each virtual key belongs based on the corresponding tilt direction of the each virtual key comprises:
determining that the virtual key belongs to N groups of the plurality of groups when the corresponding tilt directions of the virtual key include N corresponding tilt directions, where the N groups are in one-to-one correspondence with the N corresponding tilt directions, and N is an integer greater than 1.
4. The method of claim 2, wherein the pose data further comprises angle data; the method further comprises the following steps:
for each of the plurality of groups, determining a tilt angle of the electronic device when operating each virtual key in the group based on the operation data for the group and the angle data for the group; and
and adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
5. The method of claim 1, wherein the gesture data comprises angle data, the virtual input device comprises a plurality of virtual keys; the adjusting a display mode of the virtual input device based on the operational data and the gesture data comprises:
determining a tilt angle of the electronic device when each of the plurality of virtual keys is operated based on the operation data and the angle data; and
adjusting at least one of the position information and the size information of each virtual key based on the corresponding tilt angle of each virtual key.
6. The method of claim 4 or 5, wherein the adjusting at least one of the position information and the size information of the each virtual key based on the corresponding tilt angle of the each virtual key comprises:
adjusting the position information of the virtual key based on the corresponding inclination angle of the virtual key to enable the virtual key to be close to the edge of the electronic equipment; and
and compressing the size of the virtual key towards the edge of the electronic equipment based on the corresponding inclination angle of the virtual key.
7. A display device, comprising:
the electronic equipment comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring operation data aiming at a virtual input device and posture data of the electronic equipment, and the virtual input device is displayed on the electronic equipment; and
a first adjusting module for adjusting a display mode of the virtual input device based on the operation data and the posture data.
8. The device of claim 7, wherein the gesture data comprises orientation data, the virtual input device comprises a plurality of virtual keys; the first adjustment module includes:
a first determining submodule, configured to determine, based on the operation data and the direction data, a tilt direction of the electronic device when each of the plurality of virtual keys is operated;
a second determining submodule, configured to determine, based on a corresponding tilt direction of each virtual key, a group to which each virtual key belongs, so as to obtain a plurality of groups, where the corresponding tilt directions of the virtual keys of each group in the plurality of groups are consistent; and
and the display sub-module is used for displaying the virtual keys in each group in a target area of the electronic equipment, and the position information of the target area is associated with the corresponding inclination direction of each group.
9. The apparatus of claim 8, wherein the second determination submodule is further to:
and under the condition that the corresponding inclined directions of the virtual keys comprise N corresponding inclined directions, determining that the virtual keys belong to N groups of the groups, wherein the N groups are in one-to-one correspondence with the N corresponding inclined directions, and N is an integer greater than 1.
10. The apparatus of claim 8, wherein the pose data further comprises angle data; the device further comprises:
a determination module for determining, for each of the plurality of groups, a tilt angle of the electronic device when operating each virtual key in the group based on the operation data for the group and the angle data for the group; and
and the second adjusting module is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
11. The device of claim 7, wherein the gesture data comprises angle data, the virtual input device comprises a plurality of virtual keys; the first adjustment module includes:
a third determining submodule, configured to determine, based on the operation data and the angle data, an inclination angle of the electronic device when each of the plurality of virtual keys is operated; and
and the adjusting submodule is used for adjusting at least one of the position information and the size information of each virtual key based on the corresponding inclination angle of each virtual key.
12. The apparatus of claim 10 or 11, wherein the second adjustment module or the adjustment sub-module is further configured to:
adjusting the position information of the virtual key based on the corresponding inclination angle of the virtual key to enable the virtual key to be close to the edge of the electronic equipment; and
and compressing the size of the virtual key towards the edge of the electronic equipment based on the corresponding inclination angle of the virtual key.
13. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.
14. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-6.
15. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111390412.7A CN114090158B (en) | 2021-11-22 | 2021-11-22 | Display method, display device, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111390412.7A CN114090158B (en) | 2021-11-22 | 2021-11-22 | Display method, display device, electronic equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114090158A true CN114090158A (en) | 2022-02-25 |
| CN114090158B CN114090158B (en) | 2024-04-02 |
Family
ID=80303185
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111390412.7A Active CN114090158B (en) | 2021-11-22 | 2021-11-22 | Display method, display device, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114090158B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101251781A (en) * | 2008-03-13 | 2008-08-27 | 魏新成 | Virtual keyboard performing input and function operations through mobile phones transverse screen status display |
| CN102023806A (en) * | 2010-12-17 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Input method for touch screen |
| US20130002565A1 (en) * | 2011-06-28 | 2013-01-03 | Microsoft Corporation | Detecting portable device orientation and user posture via touch sensors |
| TW201308188A (en) * | 2011-08-04 | 2013-02-16 | Chinatrust Commercial Bank Ltd | Key display method of virtual keyboard |
| TW201317836A (en) * | 2011-10-18 | 2013-05-01 | Jia-Ling Li | Programmable virtual keyboard input method |
| CN103576886A (en) * | 2012-08-07 | 2014-02-12 | 李焌坚 | Scheme of digital double-pinyin double-stroke input method and keyboard thereof |
| US9134809B1 (en) * | 2011-03-21 | 2015-09-15 | Amazon Technologies Inc. | Block-based navigation of a virtual keyboard |
| US20160012745A1 (en) * | 2014-07-11 | 2016-01-14 | Handwriting Without Tears | System and method for teaching pre-keyboarding and keyboarding |
| CN108008896A (en) * | 2017-12-20 | 2018-05-08 | 广东欧珀移动通信有限公司 | Display control method and related product |
| CN111026322A (en) * | 2019-12-02 | 2020-04-17 | 科大讯飞股份有限公司 | Keyboard layout method and device, electronic equipment and storage medium |
| CN111124242A (en) * | 2019-12-12 | 2020-05-08 | 科大讯飞股份有限公司 | Function key display method and device, electronic equipment and storage medium |
-
2021
- 2021-11-22 CN CN202111390412.7A patent/CN114090158B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101251781A (en) * | 2008-03-13 | 2008-08-27 | 魏新成 | Virtual keyboard performing input and function operations through mobile phones transverse screen status display |
| CN102023806A (en) * | 2010-12-17 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Input method for touch screen |
| US9134809B1 (en) * | 2011-03-21 | 2015-09-15 | Amazon Technologies Inc. | Block-based navigation of a virtual keyboard |
| US20130002565A1 (en) * | 2011-06-28 | 2013-01-03 | Microsoft Corporation | Detecting portable device orientation and user posture via touch sensors |
| TW201308188A (en) * | 2011-08-04 | 2013-02-16 | Chinatrust Commercial Bank Ltd | Key display method of virtual keyboard |
| TW201317836A (en) * | 2011-10-18 | 2013-05-01 | Jia-Ling Li | Programmable virtual keyboard input method |
| CN103576886A (en) * | 2012-08-07 | 2014-02-12 | 李焌坚 | Scheme of digital double-pinyin double-stroke input method and keyboard thereof |
| US20160012745A1 (en) * | 2014-07-11 | 2016-01-14 | Handwriting Without Tears | System and method for teaching pre-keyboarding and keyboarding |
| CN108008896A (en) * | 2017-12-20 | 2018-05-08 | 广东欧珀移动通信有限公司 | Display control method and related product |
| CN111026322A (en) * | 2019-12-02 | 2020-04-17 | 科大讯飞股份有限公司 | Keyboard layout method and device, electronic equipment and storage medium |
| CN111124242A (en) * | 2019-12-12 | 2020-05-08 | 科大讯飞股份有限公司 | Function key display method and device, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 贾晓艳;: "虚拟键盘技术专利综述", 中国发明与专利, no. 03 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114090158B (en) | 2024-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11373384B2 (en) | Parameter configuration method, apparatus, and device for three-dimensional face model, and storage medium | |
| CN103955339A (en) | Terminal operation method and terminal equipment | |
| CN103729109B (en) | A kind of interface display method and terminal | |
| CN114120414B (en) | Image processing method, image processing apparatus, electronic device, and medium | |
| CN114792355B (en) | Virtual image generation method and device, electronic equipment and storage medium | |
| CN113033346B (en) | Text detection method and device and electronic equipment | |
| CN113628239B (en) | Display optimization method, related device and computer program product | |
| CN113223113A (en) | Lane line processing method and device, electronic equipment and cloud control platform | |
| CN112085814A (en) | Electronic map display method, device, equipment and readable storage medium | |
| CN111191619A (en) | Method, device and equipment for detecting virtual line segment of lane line and readable storage medium | |
| CN113419865A (en) | Cloud resource processing method, related device and computer program product | |
| CN112150380A (en) | Method and device for correcting image, electronic equipment and readable storage medium | |
| CN111833391A (en) | Method and device for estimating image depth information | |
| CN114090158B (en) | Display method, display device, electronic equipment and medium | |
| US11651568B2 (en) | Data selection for spatial reconstruction | |
| WO2022252635A1 (en) | Face positioning method, apparatus and device based on multi-task fusion, and storage medium | |
| CN113657408B (en) | Method and device for determining image characteristics, electronic equipment and storage medium | |
| CN112541934A (en) | Image processing method and device | |
| CN113360074B (en) | Soft keyboard display method, related device and computer program product | |
| CN113377201A (en) | Input method panel display method and device | |
| CN113961132B (en) | Interactive processing method and device, electronic equipment and storage medium | |
| CN117850591A (en) | Interaction control method and electronic equipment | |
| CN113010619A (en) | Bubble display method and device, electronic equipment and storage medium | |
| US9971425B2 (en) | Dynamic device sensitivity control | |
| CN113343005A (en) | Searching method, searching device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |