CN117112094A - Control interaction method and device, storage medium and electronic device - Google Patents

Control interaction method and device, storage medium and electronic device Download PDF

Info

Publication number
CN117112094A
CN117112094A CN202310906943.XA CN202310906943A CN117112094A CN 117112094 A CN117112094 A CN 117112094A CN 202310906943 A CN202310906943 A CN 202310906943A CN 117112094 A CN117112094 A CN 117112094A
Authority
CN
China
Prior art keywords
control
tilting
inclination
user interface
graphical user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310906943.XA
Other languages
Chinese (zh)
Inventor
陈惠�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN202310906943.XA priority Critical patent/CN117112094A/en
Publication of CN117112094A publication Critical patent/CN117112094A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Abstract

The application discloses a control interaction method and device, a storage medium and an electronic device, and relates to the technical field of computers. The method comprises the following steps: acquiring first tilt information of a first tilt operation in response to the first tilt operation on the terminal device; determining a first control in the graphical user interface in response to the first tilt angle satisfying the tilt condition; executing control switching from the first control according to the first inclination information; in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface; and if the second tilting operation to the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation to the appointed position in the terminal equipment, executing the triggering operation to the second control. The method and the device solve the technical problems that in the related technology, the control at the other end of the screen cannot be touched by single-hand horizontal screen operation, so that interaction experience is poor and equipment is easy to slide down.

Description

Control interaction method and device, storage medium and electronic device
Technical Field
The present application relates to the field of computer technologies, and in particular, to a control interaction method, a device, a storage medium, and an electronic device.
Background
When a user performs one-hand horizontal screen operation on a mobile device, the user usually uses the thumb of one hand to finish gesture operations such as clicking, sliding and the like, but under the condition that the control position is positioned at the other end of the screen, the control positioned at the other end of the screen can not be touched in the moving range of fingers of the user, so that the operation and use progress of the user is directly interrupted, and the interactive experience is poor. In addition, in the single-hand transverse screen operation process, the fingers used for operation by the user are also used for fixing equipment, and if the fingers are moved greatly, the problems of mobile phone sliding off, equipment damage and the like are easily caused.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
At least some embodiments of the present application provide a control interaction method, a device, a storage medium, and an electronic apparatus, so as to at least solve the technical problems in the related art that a single-hand horizontal screen operation cannot reach a control at the other end of a screen, resulting in poor interaction experience and easy equipment slipping.
According to one embodiment of the present application, there is provided a control interaction method, providing a graphical user interface through a terminal device, the method including: acquiring first inclination information of a first inclination operation in response to the first inclination operation on the terminal equipment, wherein the first inclination information comprises a first inclination angle; determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface; executing control switching from the first control according to the first inclination information; in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity key or the position of a second preset control in the graphical user interface; if the second tilting operation to the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation to the appointed position in the terminal equipment, the triggering operation is executed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition.
According to one embodiment of the present application, there is also provided a control interaction device for providing a graphical user interface through a terminal device, the device including: the terminal equipment comprises an acquisition module, a control module and a control module, wherein the acquisition module is used for responding to a first tilting operation of the terminal equipment and acquiring first tilting information of the first tilting operation, wherein the first tilting information comprises a first tilting angle; the first determining module is used for determining a first control in the graphical user interface in response to the fact that the first inclination angle meets an inclination condition, wherein the first control is a control for a user to execute triggering operation in the graphical user interface within a preset time interval before the first inclination operation, or is a first preset control in the graphical user interface; the first control switching module is used for executing control switching from a first control according to the first inclination information; the second determining module is used for responding to a first triggering operation on a designated position in the terminal equipment in the control switching process, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity button or the position of a second preset control in the graphical user interface; and the first triggering module is used for executing triggering operation on the second control if the second tilting operation on the terminal equipment is not detected within a preset time interval or responding to the second triggering operation on the appointed position in the terminal equipment, so that the graphical user interface displays display content corresponding to the triggering operation on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition.
According to one embodiment of the present application, there is also provided a computer readable storage medium having a computer program stored therein, wherein the computer program is configured to perform the control interaction method of any of the above when run on a computer or processor.
According to one embodiment of the present application, there is also provided an electronic device including a memory having a computer program stored therein and a processor configured to run the computer program to perform the control interaction method of any of the above.
In at least some embodiments of the present application, a gravity sensing technology is adopted, a graphical user interface is provided through a terminal device, and first tilt information of a first tilt operation is obtained in response to the first tilt operation on the terminal device, where the first tilt information includes a first tilt angle; determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface; executing control switching from the first control according to the first inclination information; in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity key or the position of a second preset control in the graphical user interface; if the second tilting operation on the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation on the designated position in the terminal equipment, the triggering operation is performed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation performed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition, the purposes of switching the selected control in the graphical user interface and performing the triggering operation on the selected control are achieved by performing the tilting operation on the terminal equipment, the technical effects that the selection and the triggering operation can be performed on the control in the graphical user interface without touching the graphical user interface in the one-hand transverse screen operation process are achieved, the interaction experience is improved, and the technical problems that the one-hand transverse screen operation cannot touch the control at the other end of the screen, the interaction experience is poor and equipment slipping is easy to cause in the related technology are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
FIG. 1 is a block diagram of a hardware architecture of a mobile terminal of a control interaction method according to an embodiment of the present application;
FIG. 2 is a flow chart of a control interaction method according to one embodiment of the application;
FIG. 3 is a schematic diagram of a coordinate system according to one embodiment of the application;
FIG. 4 is a schematic diagram of a tilting operation according to one embodiment of the application;
FIG. 5 is a schematic illustration of a tilting operation according to one embodiment of the application;
FIG. 6 is a schematic diagram of a tilting operation according to one embodiment of the application;
FIG. 7 is a schematic diagram of a tilting operation according to one embodiment of the application;
FIG. 8 is a schematic diagram of a preset control according to one embodiment of the present application;
FIG. 9 is a schematic diagram of a second control according to one embodiment of the application;
FIG. 10 is a schematic representation of three-dimensional coordinate system updating according to one embodiment of the application;
FIG. 11 is a schematic diagram of a graphical user interface display according to one embodiment of the application;
FIG. 12 is a schematic diagram of a graphical user interface partitioning area according to one embodiment of the present application;
FIG. 13 is a schematic view of a floating window according to an alternative embodiment of the present application;
FIG. 14 is a schematic diagram of a control interaction device according to one embodiment of the application;
fig. 15 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order that those skilled in the art will better understand the present application, a technical solution in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In a possible implementation manner, when a single-hand transverse screen operation is performed on a terminal device in the technical field of computers, a single-hand thumb is generally used for completing gesture operations such as clicking, sliding and the like, after the inventor is practiced and studied carefully, the technical problems that part of controls cannot be touched and equipment is easy to fall off still exist, based on the technical problems, an application scene of the embodiment of the application is a scene for controlling the terminal device, a control interaction method is provided, a gravity sensing technology is adopted, a graphical user interface is provided through the terminal device, and first inclination information of the first inclination operation is obtained in response to the first inclination operation on the terminal device, wherein the first inclination information comprises a first inclination angle; determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface; executing control switching from the first control according to the first inclination information; in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity key or the position of a second preset control in the graphical user interface; if the second tilting operation on the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation on the designated position in the terminal equipment, the triggering operation is performed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation performed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition, the purposes of switching the selected control in the graphical user interface and performing the triggering operation on the selected control are achieved by performing the tilting operation on the terminal equipment, the technical effects that the selection and the triggering operation can be performed on the control in the graphical user interface without touching the graphical user interface in the one-hand transverse screen operation process are achieved, the interaction experience is improved, and the technical problems that the one-hand transverse screen operation cannot touch the control at the other end of the screen, the interaction experience is poor and equipment slipping is easy to cause in the related technology are solved.
The above-described method embodiments according to the present application may be implemented in a mobile terminal, a computer terminal or similar computing device. Taking the mobile terminal as an example, the mobile terminal can be a smart phone, a tablet computer, a palm computer, a mobile internet device, a PAD, a game machine and other terminal devices. Fig. 1 is a hardware structure block diagram of a mobile terminal of a control interaction method according to an embodiment of the present application. As shown in fig. 1, the mobile terminal may include one or more (only one is shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a Central Processing Unit (CPU), a Graphics Processor (GPU), a Digital Signal Processing (DSP) chip, a Microprocessor (MCU), a programmable logic device (FPGA), a neural Network Processor (NPU), a Tensor Processor (TPU), an Artificial Intelligence (AI) type processor, etc.) and a memory 104 for storing data, and in one embodiment of the present application, may further include: a transmission device 106, an input output device 108, and a display device 110.
In some optional embodiments, which are based on game scenes, the device may further provide a human-machine interaction interface with a touch-sensitive surface, where the human-machine interaction interface may sense finger contacts and/or gestures to interact with a Graphical User Interface (GUI), where the human-machine interaction functions may include the following interactions: executable instructions for performing the above-described human-machine interaction functions, such as creating web pages, drawing, word processing, making electronic documents, games, video conferencing, instant messaging, sending and receiving electronic mail, talking interfaces, playing digital video, playing digital music, and/or web browsing, are configured/stored in a computer program product or readable storage medium executable by one or more processors.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 is merely illustrative and not limiting of the structure of the mobile terminal described above. For example, the mobile terminal may also include more or fewer components than shown in fig. 1, or have a different configuration than shown in fig. 1.
According to one embodiment of the present application, there is provided an embodiment of a control interaction method, it being noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system, such as a set of computer executable instructions, and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order other than that illustrated herein.
In a possible implementation manner, the embodiment of the application provides a control interaction method, and a graphical user interface is provided through terminal equipment, wherein the terminal equipment can be local terminal equipment or client equipment in a cloud interaction system. Fig. 2 is a flowchart of a control interaction method according to an embodiment of the present application, in which a graphical user interface is provided by a terminal device, as shown in fig. 2, the method includes the steps of:
step S20, in response to the first tilting operation on the terminal device, first tilting information of the first tilting operation is acquired.
Wherein the first inclination information includes a first inclination angle.
The first tilting operation is used for contactlessly switching a selected control in the graphical user interface, and establishes a three-dimensional coordinate system on the graphical user interface of the terminal device, and the first tilting operation can be understood as an operation for tilting the terminal device around a horizontal axis or a vertical axis of the three-dimensional coordinate system. As shown in fig. 3, fig. 3 is a schematic diagram of a coordinate system according to an embodiment of the present application, in which a vertical side of a graphical user interface is an X-axis (vertical axis) and a horizontal side is a Y-axis (horizontal axis) when a terminal device is horizontally displayed, and a normal direction perpendicular to the graphical user interface is a Z-axis, so as to complete establishment of a three-dimensional coordinate system.
It can be understood that the three-dimensional coordinate system established by the embodiment of the application is not fixed, and the three-dimensional coordinate systems established when the terminal equipment is in different poses are different. Since the user may be in a standing posture or a lying posture when holding the terminal device in a hand and performing a landscape operation, that is, the posture of the terminal device may not be the same before performing a tilting operation on the terminal device, the three-dimensional coordinate system established based on the terminal device is not fixed. For example, the X-axis of the three-dimensional coordinate axis may be perpendicular to the ground when the user is in a standing posture, and the X-axis of the three-dimensional coordinate axis may be parallel to the ground when the user is in a lying posture, which is not limited by the embodiment of the present application.
The tilting operation of the terminal device may be understood as an operation of performing tilting with a lateral side or a vertical side of the terminal device as a fixed rotation axis, and when the lateral side of the terminal device is a fixed rotation axis, the lateral side under the graphical user interface of the terminal device is generally a fixed rotation axis. When the vertical edge of the terminal equipment is used as a fixed rotation axis, the fixed rotation axis is determined to be the left vertical edge or the right vertical edge of the graphical user interface according to the hand of a user holding the terminal equipment. Typically, the fixed pivot axis is the vertical edge on the right side of the graphical user interface when the terminal device is in the right hand of the user, and the fixed pivot axis is the vertical edge on the left side of the graphical user interface when the terminal device is in the left hand of the user.
The tilting angle of the tilting operation is understood to be the angle formed between the graphical user interface of the terminal device after tilting, the fixed rotation axis and the graphical user interface of the terminal device before tilting. Fig. 4 to 7 are schematic diagrams illustrating a tilting operation according to an embodiment of the present application, and fig. 4 to 7 are schematic diagrams illustrating tilting operations performed in different directions for the terminal device shown in fig. 3, respectively, taking the pose of the terminal device shown in fig. 3 as an example of the pose of the terminal device before the tilting operation is performed.
Fig. 4 shows a schematic diagram of a tilting operation performed on the terminal device in a counterclockwise direction around the horizontal axis, wherein the tilting operation uses the horizontal edge of the graphical user interface as a fixed rotation axis, and the corresponding tilting angle is shown as α1 in fig. 4. Accordingly, fig. 5 shows a schematic diagram of a tilting operation performed on the terminal device in a clockwise direction about the horizontal axis, with the horizontal side of the terminal device as a fixed rotation axis, corresponding to the tilting angle shown as α2 in fig. 5.
Fig. 6 shows a schematic diagram of a tilting operation performed on the terminal device in a clockwise direction about the longitudinal axis, with the vertical side on the right side of the graphical user interface as a fixed rotation axis, corresponding to a tilting angle indicated as α3 in fig. 6. Fig. 7 shows a schematic diagram of a tilting operation performed on the terminal device in a counterclockwise direction about the longitudinal axis, with the vertical side on the right side of the graphical user interface as a fixed rotation axis, corresponding to the tilting angle indicated as α4 in fig. 7.
The tilt operations performed on the terminal device are all associated with tilt information, and the tilt operations and their associated tilt information can be determined based on gravity sensing techniques. For example, a first tilt operation to the terminal device may be determined according to a gyroscope in the terminal device, and first tilt information of the first tilt operation may be acquired, and the first tilt information may include a first tilt angle of the first tilt operation.
In the embodiment of the application, the first tilting operation is used for selecting the control to be triggered in the graphical user interface, so that a user can realize the technical effect of selecting the control to be triggered in the graphical user interface without touching the graphical user interface.
Step S22, in response to the first tilt angle satisfying the tilt condition, determining a first control in the graphical user interface.
The first control is a control for executing triggering operation in the graphical user interface by a user within a preset time interval before the first tilting operation, or is a first preset control in the graphical user interface.
In order to avoid misoperation caused by random shaking of the terminal equipment by a user, an execution standard needs to be set for the tilting operation, and when the tilting operation is detected, whether the tilting angle of the tilting operation meets the tilting condition needs to be judged, wherein the tilting operation meeting the tilting condition is regarded as the tilting operation which is executed by the user and used for switching the contactless execution control.
The tilting condition may be that the tilting angle of the tilting operation is equal to or greater than a preset angle threshold, and the preset angle threshold may be set to 45 degrees, for example, and embodiments of the present application are not limited. When the first inclination angle of the first inclination operation is greater than or equal to 45 degrees, the first inclination angle is indicated to meet the inclination condition, and then the first control in the graphical user interface is determined.
It can be appreciated that, before the first tilting operation is performed on the terminal device, the user can perform a triggering operation on any control in the graphical user interface according to the requirement, so that the control currently selected by the graphical user interface is the control selected by the user in performing the triggering operation, and then the first tilting operation performed on the terminal device starts to perform control switching from the control selected by the user. Specifically, the first control may be a control selected by a user to perform a triggering operation on the graphical user interface within a preset time interval before performing the first tilting operation, and the preset time interval may be set to 3 seconds, which is not limited in the embodiment of the present application.
Or, before the first tilting operation is performed on the terminal device, the currently selected control in the graphical user interface may be a preset first preset control, and the first preset control may be a control at a fixed position in the graphical user interface. As shown in fig. 8, fig. 8 is a schematic diagram of a preset control according to an embodiment of the present application, taking a preset fixed position in a graphical user interface as an example at (x 1, y1, z 1) in a three-dimensional coordinate system, where the first preset control is the corresponding a control at (x 1, y1, z 1) in fig. 8.
And step S24, executing control switching from the first control according to the first inclination information.
The first tilting operation is used for switching the selected control in the graphical user interface, and control switching is started to be executed from the currently selected control (namely, the first control) of the graphical user interface according to the first tilting information of the first tilting operation, so that a user can realize control switching without touching the graphical user interface. And step S26, in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface.
The designated position is the position of the entity key or the position of a second preset control in the graphical user interface.
The designated location in the terminal device may be a location of an entity key in the terminal device, such as a volume key, for example, and embodiments of the present application are not limited. When the designated position is the position of the physical key, the first triggering operation may be a pressing operation on the physical key, and the pressing operation may be, for example, a single pressing operation, a continuous multiple pressing operation, or a long pressing operation.
Alternatively, the designated location may be a virtual control in the graphical user interface, such as the second preset control shown in fig. 8, which may be a hover control in the graphical user interface, where the position of the hover control may be adjusted at will. It will be appreciated that during the control switching process, the second preset control of the suspension is not switched to. When the designated position is the position of the virtual key, the first triggering operation may be a touch operation on the virtual key, and for example, the touch operation may be a single touch operation, a continuous multiple touch operation, or a long-press touch operation, which is not limited in the embodiment of the present application.
In the control switching process, if a first trigger operation to a designated position in the terminal equipment is detected, stopping executing control switching, determining a second control currently selected in the graphical user interface, wherein the second control can be understood as a control selected in the graphical user interface after executing a first tilting operation.
As shown in fig. 9, fig. 9 is a schematic diagram of a second control according to an embodiment of the present application, taking an example of performing a first tilting operation of tilting counterclockwise around a horizontal axis starting from an a control at (x 1, y1, z 1), when a first triggering operation for a specified position is detected, a D control at a currently selected position (x 2, y2, z 2) in the graphical user interface, that is, the second control is the D control.
And step S28, if the second tilting operation to the terminal equipment is not detected within the preset time interval, or the second triggering operation to the appointed position in the terminal equipment is responded, the triggering operation is executed to the second control, so that the graphical user interface displays the display content corresponding to the triggering operation executed to the second control.
Wherein the second inclination angle of the second inclination operation satisfies the inclination condition.
The preset time interval is a time interval from the moment of determining the second control, and may be preset to be 3 seconds, which is not limited in the embodiment of the present application.
The fact that the second tilting operation on the terminal equipment is not detected within the preset time interval can be understood as that the user does not have the requirement of control switching at present, and further it is determined that the second control currently selected by the graphical user interface is the control needed by the user to execute triggering operation. It is understood that, in order to avoid the erroneous operation, the second inclination angle of the second inclination operation also needs to satisfy the preset condition.
In the embodiment of the application, an initial three-dimensional coordinate system is established based on the initial pose of the terminal equipment, the inclination angle of the first inclination operation is determined according to the initial three-dimensional coordinate system, and any subsequent inclination operation on the terminal equipment can change the pose of the terminal equipment, so that any inclination operation can update the three-dimensional coordinate system to the three-dimensional coordinate system established by the transverse side and the vertical side of the current pose of the terminal equipment. It is understood that the tilt angle of any pair of tilt operations of the terminal device is determined based on a three-dimensional coordinate system corresponding to the pose of the terminal device before the tilt operations are performed.
Illustratively, as shown in fig. 10, fig. 10 is a three-dimensional coordinate system updating schematic diagram according to one embodiment of the present application, taking a first tilting operation as an example of performing a tilting operation about a horizontal axis in a counterclockwise direction on a terminal device. Before the first tilting operation is performed, the three-dimensional coordinate system of the terminal device is the three-dimensional coordinate system constructed by the XYZ axes in fig. 10, and after the first tilting operation is performed, the three-dimensional coordinate system of the terminal device is updated to the three-dimensional coordinate system constructed by the X ' Y ' Z ' axes in fig. 10. And further, after the first tilting operation, if the second tilting operation is performed on the terminal device, a second tilting angle of the second tilting operation is determined according to the three-dimensional coordinate system constructed by the updated X ' Y ' Z ' axis, and a specific tilting angle determining manner is referred to the foregoing description of the tilting angle determining manner, which is not repeated herein.
If the second tilting operation on the terminal equipment is not detected within the preset time interval from the determination of the second control, determining that the second control is the control which is finally selected by the user, and accordingly executing the triggering operation on the second control, so that the graphical user interface displays display content corresponding to the triggering operation on the second control.
Or if the second triggering operation on the appointed position in the terminal equipment is detected within the preset time interval from the determination of the second control, determining that the second control is the control which is finally selected by the user, and executing the triggering operation on the second control, so that the graphical user interface displays the display content corresponding to the triggering operation on the second control. For example, when the designated position is the position of the physical key, for example, the position of the volume key, the second triggering operation may be a pressing operation on the physical key, and for example, the pressing operation may be a single pressing operation, a continuous multiple pressing operation, or a long pressing operation, which is not limited in the embodiment of the present application. When the designated position is the position of the virtual key, for example, the position of the suspension control, the second triggering operation may be a touch operation on the virtual key, and the touch operation may be, for example, a one-time touch operation, a continuous multiple-time touch operation, or a long-press touch operation.
Fig. 11 is a schematic diagram of display content of a gui according to an embodiment of the present application, where after a triggering operation is performed on a second control, the gui displays display content corresponding to the triggering operation performed on the second control. Taking the second control as the B control in fig. 11 as an example, after the B control is triggered, the graphical user interface displays the content B corresponding to the B control, where the size of the display interface of the content B is not limited.
Providing a graphical user interface through the terminal equipment by adopting the gravity sensing technology through the steps, and responding to a first tilting operation of the terminal equipment to acquire first tilting information of the first tilting operation, wherein the first tilting information comprises a first tilting angle; determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface; executing control switching from the first control according to the first inclination information; in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity key or the position of a second preset control in the graphical user interface; if the second tilting operation on the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation on the designated position in the terminal equipment, the triggering operation is performed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation performed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition, the purposes of switching the selected control in the graphical user interface and performing the triggering operation on the selected control are achieved by performing the tilting operation on the terminal equipment, the technical effects that the selection and the triggering operation can be performed on the control in the graphical user interface without touching the graphical user interface in the one-hand transverse screen operation process are achieved, the interaction experience is improved, and the technical problems that the one-hand transverse screen operation cannot touch the control at the other end of the screen, the interaction experience is poor and equipment slipping is easy to cause in the related technology are solved.
In one possible embodiment, the method may further comprise the following execution steps: and if the second tilting operation of the terminal equipment is detected within the preset time interval, executing control switching from the second control according to the second tilting information of the second tilting operation.
After determining the second control according to the first trigger operation in step S26, if the second tilt operation on the terminal device is detected within the preset time interval, it may be understood that the user still has a need for control switching, that is, the second control currently selected by the graphical user interface is not the control that the user needs to perform the trigger operation, so that control switching needs to be performed again from the second control according to the second tilt information of the second tilt operation.
It is understood that the tilting direction of the second tilting operation may be any tilting direction, and embodiments of the present application are not limited to the tilting direction of the second tilting operation.
As shown in fig. 4, if the first control is an a control, after the control switch is performed from the a control according to the first inclination information of the first inclination operation around the counterclockwise direction of the horizontal axis, and after determining that the second control is a B control according to the first trigger operation on the designated position, if the inclination operation around the counterclockwise direction of the horizontal axis (i.e., the second inclination operation) is detected within 3 seconds again, the control switch is performed from the B control according to the detected inclination information around the counterclockwise direction of the horizontal axis (i.e., the second inclination information of the second inclination operation), and further determining other controls until the target control that is required to be selected by the user in the graphical user interface is continuously determined.
It will be appreciated that there may be multiple tilting operations before determining the target control that the user needs to select, and embodiments of the present application are not limited.
In one possible embodiment, the method may further comprise the following execution steps: in the control switching process, responding to a third tilting operation on the terminal equipment, and executing control switching from a first current control according to third tilting information of the third tilting operation, wherein the first current control is a control selected in a graphical user interface when the third tilting operation is detected, and a third tilting angle of the third tilting operation meets a tilting condition.
In the process of starting to execute the control switching in step S24, if the third tilting operation on the terminal device is detected, it indicates that the user needs to change the tilting direction of the tilting operation in the process of switching the control, so that the control switching is started from the currently selected control (i.e. the first current control) of the graphical user interface according to the third tilting information of the third tilting operation.
It is understood that, in order to avoid the erroneous operation, the third inclination angle of the third inclination operation also needs to satisfy the preset condition. Further, the third tilting direction of the third tilting operation is not the same direction as the first tilting direction of the first tilting operation.
In a possible implementation manner, the graphical user interface includes at least one area, different areas correspond to different first priorities, any area in the at least one area includes at least one control, different controls correspond to different second priorities, and in step S24, performing control switching from the first control according to the first tilt information may include the following steps:
step S240, performing control switching from the first control based on the first tilt information and the control switching order. The control switching sequence comprises a transverse control switching sequence and a longitudinal control switching sequence, wherein the transverse control switching sequence is determined according to a first priority and a second priority of the control in the horizontal axis direction, and the longitudinal control switching sequence is determined according to the first priority and the second priority of the control in the vertical axis direction.
When executing the control switch, the control switch needs to be executed from the first control based on the first tilt information and the control switch order.
As shown in fig. 12, fig. 12 is a schematic view of a graphical user interface according to an embodiment of the present application, wherein the graphical user interface is divided into at least one region, here, five regions, for example, a first region, a second region, a third region, a fourth region and a fifth region.
Each region corresponds to a first priority, and different regions correspond to different first priorities, which can be preset, and here, the first priorities of the first region to the fifth region are gradually reduced, for example, the first priority of the first region is the largest, and the first priority of the fifth region is the smallest.
Each zone includes at least one control, the first zone shown in fig. 12 includes one control, namely an a control, the second zone includes six controls, namely B control to G control, the third zone includes two controls, namely an H control and an I control, the fourth zone includes five controls, namely a J control to an N control, and the fifth zone includes ten controls, namely an O control to an X control.
Each control corresponds to a second priority, different controls correspond to different second priorities, and the second priorities of the controls in the embodiment of the application can be preset, and comprise the second priority of the controls in the horizontal axis direction and the second priority of the controls in the vertical axis direction, and the control switching sequence can be determined according to the second priorities of the controls. It should be noted that, in the embodiment of the present application, the tilting direction includes tilting about a horizontal axis and tilting about a vertical axis, so that the control switching sequence includes a horizontal control switching sequence and a vertical control switching sequence, the horizontal control switching sequence is determined according to a first priority of a region and a second priority of a control in the horizontal axis direction, and the vertical control switching sequence is determined according to the first priority of the region and the second priority of the control in the vertical axis direction.
It will be appreciated that, because of the irregular arrangement of controls in the graphical user interface, the lateral control switch order and the longitudinal control switch order each include at least one order. Illustratively, the portrait control switching sequence in FIG. 12 includes: a control-B control-C control-D control-E control-F control-G control-H control-J control-O control-T control, I control-J control, K control-O control, L control-O control, M control-O control, N control-O control, P control-U control, Q control-V control, R control-W control, S control-X control, O control-J control, J control-H control, H control-B control, B control-A control and other longitudinal switching sequences are not listed herein. Accordingly, the lateral control switching sequence of the controls in fig. 12 includes: the cross switching sequences of the A control-B control-H control-I control-J control-K control-L control-M control-N control-O control-P control-Q control-R control-S control-T control-U control-V control-W control-X control, C control-H control, D control-H control, E control-H control, F control-H control, G control-H control, O control-J control, J control-H control, H control-B control, B control-A control and the like are not listed here.
The transverse control switching sequence and the longitudinal control switching sequence are determined based on the first priority of the region and the second priority of the control, and when the control switching of different regions is involved, the control switching sequence is defined as the position of the control with the largest second priority in the next region is preferentially switched according to the size sequence of the first priority. Illustratively, when switching from the second region to the third region, the control switching sequence is a G control-H control, and when switching from the third region to the second region, the control switching sequence is an H control-B control.
In one possible implementation, the first preset control is a control with the highest second priority in the area with the highest first priority. Illustratively, in the graphical user interface shown in fig. 12, the first priorities of the regions are in order of order from large to small: the first area is larger than the second area, the third area is larger than the fourth area, the fifth area is larger than the fourth area, and the second priority of the control is as follows according to the arrangement sequence from big to small: the A control > B control … > X control, and the first preset control is the A control in the first area.
In one possible implementation, the first tilt information further includes a first tilt direction, and in step S240, performing control switching from the first control based on the first tilt information and the control switching sequence includes performing the steps of:
Step S2400, determining a first switching speed based on the first inclination angle, wherein the first switching speed is a speed of switching from the first control to the second control;
step S2401, performing control switching from the first control based on the first switching speed, the first tilting direction, and the control switching order.
The first inclination direction in the first inclination information is used to indicate which inclination direction the first inclination operation is in the counterclockwise direction about the horizontal axis, and the counterclockwise direction about the horizontal axis.
Whether a transverse control switching sequence or a longitudinal control switching sequence is adopted in the control switching process can be determined based on the inclination direction, and illustratively, if the first inclination direction rotates around the transverse axis, the longitudinal control switching sequence is adopted, and if the first inclination direction rotates around the longitudinal axis, the transverse control switching sequence is adopted.
In the embodiment of the application, the control switching speed in the control switching process can be fixed switching speed, and the switching speed can be adjusted according to the inclination angle of the inclination operation. Illustratively, the larger the inclination angle, the faster the switching speed may be set.
When executing the control switching from the first control based on the first tilt information and the control switching order, a first switching speed of the control switching may be determined according to a first tilt angle of the first tilt operation, so that the control switching is executed from the first control based on the first switching speed, the first tilt direction and the control switching order.
In one possible implementation, after performing the control switch from the first control based on the first switching speed, the first tilting direction, and the control switching order in step S2401, the method may further include performing the steps of:
step S24010, in response to an adjustment operation of the first tilting operation in the control switching process, adjusting the first tilting angle based on the adjustment operation, and determining a second switching speed corresponding to the adjusted first tilting angle, wherein the adjusted first tilting angle meets the tilting condition;
and step S24011, executing control switching from a second current control based on the second switching speed, the first tilting direction and the control switching sequence, wherein the second current control is a control selected in the graphical user interface when the adjustment operation is detected.
In the embodiment of the application, the control switching speed is determined based on the inclination angle, and the user can control the speed of control switching by adjusting the inclination angle of the inclination operation.
In the control switching process, the adjustment operation can be understood as an operation of adjusting the first inclination angle of the first inclination operation, that is, an operation of adjusting the speed of the control corresponding to the first inclination angle. According to the adjustment operation, the adjusted first inclination angle can be determined, and further, the second switching speed corresponding to the adjusted first inclination angle is determined, so that control switching is continuously executed from the currently selected control (namely the second current control) in the graphical user interface according to the second control switching speed, and the control switching speed is changed from the first switching speed before adjustment to the second switching speed after adjustment.
It should be noted that the adjustment operation corresponds to an update operation of the tilting operation, and the tilting operation after adjustment and the tilting operation before adjustment are also substantially the same tilting operation, so that the adjustment operation and the tilting operation after adjustment each determine the tilting angle based on the same three-dimensional coordinate system, that is, each determine the tilting angle based on the three-dimensional coordinate system established by the pose of the terminal device before the tilting operation is performed.
It can be understood that the inclination angle of any inclination operation in the embodiment of the present application needs to be able to execute the corresponding control switching function on the premise of meeting the inclination condition, so that the inclination angle corresponding to the inclination operation subjected to the adjustment operation still needs to meet the inclination condition.
For example, if the first inclination angle corresponding to the first inclination operation is 45 degrees, corresponding to the first switching speed v1, performing control switching from the control a according to the control switching sequence of the control a-B control-C control-D control-E control-F control. When the control is switched to the D control based on the v1 speed, an adjustment operation is detected, the first inclination angle adjusted by the adjustment operation is 50 degrees, and the second switching speed v2 corresponds to the first inclination angle adjusted by the adjustment operation, and the control switching speed can be adjusted to v2 from v1 due to the fact that the inclination condition is met by the adjusted first inclination angle 50 degrees, and then control switching is performed based on the v2 speed from the D control.
If the first inclination angle corresponding to the first inclination operation is 45 degrees, corresponding to the first switching speed v1, after the adjustment operation, the adjusted first inclination angle is 40 degrees, and corresponding to the second switching speed v2, and the adjustment operation cannot realize control speed switching because the adjusted first inclination angle 40 degrees does not meet the inclination condition, and the control switching speed at the moment is still v1, and the adjustment operation can be judged as misoperation of a user.
Therefore, the effect of flexibly regulating and controlling the control switching speed can be achieved, and the use experience of a user is improved.
In a possible implementation manner, in step S26, determining the second control in the graphical user interface may include the following steps:
step S260, responding to the first inclination direction to be anticlockwise inclined around the transverse axis, and determining a third control with a second priority lower than that of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or,
step S261, responding to the first inclination direction to be clockwise inclined around the transverse axis, and determining a fourth control with a second priority higher than the second priority of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or,
step S262, in response to the first inclination direction being clockwise inclination around the longitudinal axis, determining a fifth control with a second priority lower than that of the first control according to the transverse control switching sequence in a first area where the first control is located; or,
in step S263, in response to the first tilting direction being tilting counterclockwise about the longitudinal axis, in the first area where the first control is located, a sixth control with a second priority higher than that of the first control is determined according to the lateral control switching sequence.
In the application scenario from step S260 to step S263, the first control is located in the middle of the area where the first control is located (i.e. in the area where the first control is located, there are other controls with a priority greater than or less than the second priority of the first control), and then the second control is determined in the same area where the first control is located.
The scheme of step S260 may be shown in fig. 4, where when the inclination direction is anticlockwise about the horizontal axis, if the first control is a C control, then a third control with a second priority lower than that of the C control, i.e. a D control, is determined according to the longitudinal control switching sequence.
The scheme of step S261 may be shown in fig. 5, where when the inclination direction is clockwise about the horizontal axis, if the first control is a C control, the fourth control with the second priority higher than the second priority of the C control, i.e. the B control, is determined according to the vertical control switching sequence.
The solution in step S262 may be shown in fig. 6, where when the tilting direction is tilting clockwise around the vertical axis, if the first control is a Q control, then a fifth control with a second priority lower than that of the Q control, i.e. an R control, is determined according to the switching sequence of the lateral controls.
In the solution of step S263, as shown in fig. 7, when the inclination direction is anticlockwise about the vertical axis, if the first control is a Q control, a sixth control with a second priority higher than that of the Q control, i.e., a P control, is determined according to the switching sequence of the lateral controls.
In a possible implementation manner, in step S26, determining the second control in the graphical user interface may include the following steps:
step S264, responding to the first inclination direction to be anticlockwise around the transverse axis, and determining a seventh control in the second area according to the longitudinal control switching sequence, wherein the control with the second priority lower than the second priority of the first control does not exist in the first area where the first control exists; or,
step S265, responding to the first inclination direction to be clockwise inclined around a transverse axis, wherein no control with second priority higher than the second priority of the first control exists in a first area where the first control exists, and determining an eighth control in a third area according to a longitudinal control switching sequence, wherein the first priority of the third area is higher than the first priority of the first area; or,
step S266, in response to the first inclination direction being clockwise inclination around the longitudinal axis, and no control with a second priority lower than the second priority of the first control exists in the first area where the first control is located, determining a seventh control in the second area according to the transverse control switching sequence; or,
In step S267, in response to the first tilting direction being tilting counterclockwise about the longitudinal axis, and there being no control with a second priority higher than the second priority of the first control in the first area where the first control is located, determining an eighth control in the third area according to the lateral control switching sequence.
In the application scenario from step S264 to step S267, the first control is located at an extreme position of the area (i.e., in the area where the first control is located, there are no other controls that are greater or smaller than the second priority of the first control), and there are other areas that are greater or smaller than the first priority of the area where the first control is located, then the second control is determined in the other areas that are greater or smaller than the first priority of the area where the first control is located.
The scheme of step S264 may be shown in fig. 4, where when the inclination direction is anticlockwise about the horizontal axis, if the first control is a G control and there is no control with a second priority lower than that of the G control in the second area, then determining the H control in the third area according to the longitudinal control switching sequence.
The solution of step S265 may be shown in fig. 5, where when the inclination direction is clockwise about the horizontal axis, if the first control is an O control and there is no control with a second priority higher than the second priority of the O control in the fifth area, determining the J control in the fourth area according to the longitudinal control switching sequence.
The solution of step S266 may be shown in fig. 6, where when the tilting direction is tilting clockwise around the vertical axis, if the first control is a G control and there is no control with a second priority lower than that of the G control in the second area, then the H control in the third area is determined according to the lateral control switching sequence.
The solution of step S267 may be shown in fig. 7, where when the inclination direction is anticlockwise about the vertical axis, if the first control is an O control and there is no control with a second priority higher than the second priority of the O control in the fifth area, determining the J control in the fourth area according to the lateral control switching sequence.
It can be seen that when the first control is located in the area where the first control is located, if the target control meeting the user requirement is not located, the control jumps to the previous area or the next area according to the tilting operation to determine the target control, and when the area switching is executed, the control with the largest second priority in the previous area or the next area is preferentially selected.
In a possible implementation manner, in step S26, determining the second control in the graphical user interface may include the following steps:
step S268, determining a ninth control in response to the first inclination direction being anticlockwise around the horizontal axis or clockwise around the vertical axis, and no control with a second priority lower than that of the first control exists in the first area where the first control is located, wherein the ninth control and the first control are the same control; or,
Step S269, determining a tenth control in response to the first inclination direction being clockwise around the horizontal axis or anticlockwise around the vertical axis, and no control with a second priority higher than a second priority of the first control being present in a first area where the first control is located, wherein the tenth control and the first control are the same control.
In the application scenario of step S268 and step S269, the first control is located at an extreme position of the area where the first control is located (i.e., in the area where the first control is located, there are no other controls that are greater or smaller than the second priority of the first control), and there are no other areas that are greater or smaller than the second priority of the area where the first control is located, then the second control and the first control are the same control, i.e., no control switching is performed.
The solution of step S268 may be shown in fig. 4 and fig. 6, where when the tilting direction is tilting counterclockwise around the horizontal axis or tilting clockwise around the vertical axis, if the first control is an X control and there is no control with a second priority lower than that of the X control in the fifth area, the control selected based on the tilting operation is unchanged and still is the X control in the fifth area.
The solution of step S269 may be shown in fig. 5 or fig. 7, where when the tilting direction is tilting clockwise around the horizontal axis or tilting counterclockwise around the vertical axis, if the first control is an a control, and there is no control with a second priority higher than the second priority of the a control in the first area, the control selected based on the tilting operation is unchanged and still is the a control in the first area.
It can be seen that when the first control is located in the area with the largest first priority and the first control is the control with the largest second priority among all the controls, the selected control in the graphical user interface is not changed according to the operation of tilting clockwise around the horizontal axis or tilting counterclockwise around the vertical axis. Similarly, when the first control is located in the area with the minimum first priority and the first control is the control with the minimum second priority in all the controls, the selected control in the graphical user interface is not changed according to the operation of tilting counterclockwise around the horizontal axis or tilting clockwise around the vertical axis.
In one possible implementation, in response to the first tilting operation on the terminal device at step S20, the following steps may be performed before acquiring the first tilting information of the first tilting operation:
step S200, in response to the interactive opening operation of the terminal equipment, controlling the terminal equipment to enter an inclined interaction mode;
in step S201, in the tilt interaction mode, a tilt operation performed on the terminal device is detected.
In order to avoid that when a user does not need to switch the control by tilting operation, the control is switched due to misoperation, tilting operation executed on the terminal equipment can be detected after the terminal equipment is controlled to enter a tilting interaction mode. For example, the tilting operation performed on the terminal device may be detected after receiving an interactive-on operation for controlling the terminal device to enter the tilting interactive mode.
In one possible embodiment, the method may further comprise the following execution steps: and in the tilting interaction mode, responding to the fact that the tilting operation is not detected within a preset time interval, and executing triggering operation on the first preset control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the first preset control.
And after receiving the interactive opening operation and controlling the terminal equipment to enter the inclined interactive mode, the control currently selected by the default graphical user interface is a first preset control. If no tilting operation is detected within a preset time interval from the moment of entering the tilting interaction mode by the control terminal equipment, executing triggering operation on the first preset control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the first preset control.
Illustratively, the first preset control may be the control a in fig. 3, and the preset time interval may be preset to 3 seconds, which is not limited by the embodiment of the present application.
Further, in one possible implementation, in step S26, determining the second control in the graphical user interface may also be performed by:
the trigger hotspots of controls in a graphical user interface are generally rectangular areas with center coordinates (x, y, z) of the trigger hotspots. It will be appreciated that the triggering hot zone may be a circular area or other shapes, and the size of the triggering hot zone may be set according to the requirements, which is not limited in the embodiments of the present application.
By acquiring the central anchor coordinates (x, y, z) of the trigger hotspots of all the loading controls in the current interface of the graphical user interface. The x and y coordinates of the top left corner of the default graphical user interface are the largest (which can be understood to be the largest for the center anchor coordinates of the a control in fig. 3), and the center coordinates of the trigger hotspots in the top left corner are (x 3, y3, z).
Taking the example that the first position of the first control is (x 4, y4, z), when the anticlockwise tilting operation of the terminal equipment around the y axis is detected, if the tilting angle of the tilting operation is greater than or equal to the preset angle threshold, selecting a corresponding control below the first position, calculating the triggering hot zone with the smallest value of the y 4-y|in all central anchor coordinates in the current interface, meeting the condition that x is less than x4, the smallest value of the y x-x4| and the triggering hot zone with the smallest value of the y x-x4| is not equal to 0, and determining the control corresponding to the position of the triggering hot zone as the second control.
Correspondingly, when the inclination operation of the terminal equipment in the clockwise direction around the y axis is detected, if the inclination angle of the inclination operation is larger than or equal to a preset angle threshold, selecting a corresponding control above the first position, calculating the triggering hot areas with the smallest values of the y4-y| in all central anchor coordinates in the current interface, meeting the minimum values of the x & gtx 4, |x-x4| and the minimum values of the|x-x 4| and the|x 4| in the triggering hot areas, and determining the control corresponding to the position of the triggering hot areas as a second control.
When the inclination operation of the terminal equipment in the clockwise direction around the x axis is detected, if the inclination angle of the inclination operation is larger than or equal to a preset angle threshold, selecting a corresponding control on the right side of the first position, calculating the triggering hot zone with the smallest value of the I x4-x I in all central anchor coordinates in the current interface, meeting the condition that y is smaller than y4, the value of the I y-y 4I is the smallest and the value of the I y-y 4I is not equal to 0, and determining the control corresponding to the position of the triggering hot zone as a second control.
When the anticlockwise inclination operation of the terminal equipment around the x axis is detected, if the inclination angle of the inclination operation is larger than or equal to a preset angle threshold, selecting a corresponding control at the left side of the first position, calculating the triggering hot zone with the smallest value of the I x4-x I in all central anchor coordinates in the current interface, meeting the condition that y is larger than y4, the value of the I y-y 4I is smallest, and the value of the I y-y 4I is not equal to 0, and determining the control corresponding to the position of the triggering hot zone as a second control.
It can be appreciated that, when the method for determining the second control is used for determining the second control in the same area of the first control and there is no second control meeting the requirement in the same area, the second control may be determined in a previous area or a next area, similar to those in steps S264 to S267, when the area switch is performed, the control with the largest second priority in the previous area or the next area is preferentially selected, that is, the trigger hot area with the largest x coordinate and the largest y coordinate in the previous area or the next area is preferentially selected, which is not repeated herein.
It will be appreciated that, similar to the foregoing steps S268 and S269, when the first position is the position in the graphical user interface where the x-coordinate is the largest and the y-coordinate is the largest, i.e., at (x 3, y3, z), if a tilting operation of the terminal device about the y-axis clockwise or about the x-axis counterclockwise is detected at this time, the center coordinate of the selected trigger thermal zone is still (x 3, y3, z). Similarly, when the first position is the position with the smallest x coordinate and the smallest y coordinate in the graphical user interface, that is, is located at (x 5, y5, z), if a tilting operation of the terminal device in the counterclockwise direction around the y axis or the clockwise direction around the x axis is detected at this time, the central coordinate of the selected triggering hot zone is still (x 5, y5, z).
Furthermore, in one possible embodiment, the one-hand-operated switching control can also be implemented in the graphical user interface of the terminal device by:
fig. 13 is a schematic diagram of a floating window according to an alternative embodiment of the present application, in which a movable floating window is set on a graphical user interface to control the switching and clicking of a trigger hot zone, and the floating window is expired when a switching operation needs to be performed, and as shown in fig. 13 (a), a direction key and a determination button are set on the floating window, the selection of the trigger hot zone is switched by clicking the direction key, and the operation of triggering a target control is achieved by clicking the determination button.
If no click operation is detected on the hover window within a certain time interval, the hover window is shrunk to a corner of the graphical user interface, as shown in fig. 13 (b). Clicking the floating window shown in fig. 13 (b) again exhales the floating window.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.
The embodiment also provides a control interaction device, which is used for implementing the above embodiment and the preferred implementation manner, and the description is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
FIG. 14 is a schematic diagram of a control interaction device for providing a graphical user interface via a terminal device according to one embodiment of the present application, as shown in FIG. 14, the device comprising:
an acquisition module 1401, wherein the acquisition module 1401 is configured to acquire first inclination information of a first inclination operation in response to the first inclination operation on the terminal device, where the first inclination information includes a first inclination angle; the first determining module 1402 is configured to determine, in response to the first inclination angle meeting the inclination condition, a first control in the graphical user interface, where the first control is a control for a user to perform a triggering operation in the graphical user interface within a preset time interval before the first inclination operation, or is a first preset control in the graphical user interface; the first control switching module 1403, the first control switching module 1403 is configured to perform control switching from the first control according to the first tilt information; the second determining module 1404 is configured to, in response to a first trigger operation on a designated position in the terminal device during the control switching process, stop executing control switching and determine a second control in the graphical user interface, where the designated position is a position of an entity button or is a position of a second preset control in the graphical user interface; the first trigger module 1405, where the first trigger module 1405 is configured to, if the second tilting operation on the terminal device is not detected within a preset time interval, or in response to the second triggering operation on the specified location in the terminal device, perform the triggering operation on the second control, so that the graphical user interface displays display content corresponding to the triggering operation performed on the second control, where a second tilting angle of the second tilting operation meets a tilting condition.
Optionally, the method further comprises: and the second control switching module is used for executing control switching from the second control according to second inclination information of the second inclination operation if the second inclination operation of the terminal equipment is detected within a preset time interval.
Optionally, the third control switching module is configured to, in a control switching process, respond to a third tilting operation on the terminal device, and execute control switching from the first current control according to third tilting information of the third tilting operation, where the first current control is a control selected in the graphical user interface when the third tilting operation is detected, and a third tilting angle of the third tilting operation meets a tilting condition.
Optionally, the graphical user interface includes at least one region, different regions corresponding to different first priorities, any one of the at least one region includes at least one control, different controls corresponding to different second priorities, and the first control switching module 1403 is further configured to: and executing control switching from the first control based on the first inclination information and the control switching sequence, wherein the control switching sequence comprises a transverse control switching sequence and a longitudinal control switching sequence, the transverse control switching sequence is determined according to the first priority and the second priority of the control in the transverse axis direction, and the longitudinal control switching sequence is determined according to the first priority and the second priority of the control in the longitudinal axis direction.
Optionally, the first tilt information further includes a first tilt direction, and the first control switching module 1403 is further configured to: determining a first switching speed based on the first inclination angle, wherein the first switching speed is a speed of switching from the first control to the second control; the control switch is performed from the first control based on the first switch speed, the first tilt direction, and the control switch order.
Optionally, the method further comprises: the adjusting module is used for responding to the adjusting operation of the first tilting operation in the control switching process, adjusting the first tilting angle based on the adjusting operation, and determining a second switching speed corresponding to the adjusted first tilting angle, wherein the adjusted first tilting angle meets the tilting condition; and executing control switching from a second current control based on the second switching speed, the first tilting direction and the control switching sequence, wherein the second current control is a control selected in the graphical user interface when the adjustment operation is detected.
Optionally, the second determining module 1404 is further configured to: responding to the first inclination direction to be anticlockwise inclined around a transverse axis, and determining a third control with a second priority lower than that of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or, in response to the first inclination direction being clockwise inclination around the transverse axis, determining a fourth control with a second priority higher than the second priority of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or, in response to the first inclination direction being clockwise inclination around the longitudinal axis, determining a fifth control with a second priority lower than that of the first control according to the transverse control switching sequence in a first area where the first control is located; or in response to the first tilting direction being tilting counterclockwise around the longitudinal axis, determining, in a first area where the first control is located, a sixth control with a second priority higher than that of the first control according to the transverse control switching sequence.
Optionally, the second determining module 1404 is further configured to: responding to the first inclination direction to be anticlockwise around a transverse axis, wherein a control with a second priority lower than that of the first control does not exist in a first area where the first control is located, and determining a seventh control in the second area according to a longitudinal control switching sequence, wherein the first priority of the second area is lower than that of the first area; or, in response to the first inclination direction being clockwise about the transverse axis, and no control with a second priority higher than a second priority of the first control exists in a first area where the first control exists, determining an eighth control in a third area according to the longitudinal control switching sequence, wherein the first priority of the third area is higher than the first priority of the first area; or, in response to the first inclination direction being clockwise inclination around the longitudinal axis, and no control with a second priority lower than that of the first control exists in the first area where the first control exists, determining a seventh control in the second area according to the transverse control switching sequence; or, in response to the first tilting direction being tilting counterclockwise about the longitudinal axis, and no control with a second priority higher than a second priority of the first control exists in the first area where the first control exists, determining an eighth control in the third area according to the transverse control switching sequence.
Optionally, the second determining module 1404 is further configured to: responding to the fact that the first inclination direction is anticlockwise around the transverse axis or clockwise around the longitudinal axis, and no control with second priority lower than that of the first control exists in a first area where the first control is located, and determining a ninth control, wherein the ninth control and the first control are the same control; or, determining a tenth control in response to the first inclination direction being clockwise around the horizontal axis or anticlockwise around the vertical axis, and no control with a second priority higher than a second priority of the first control exists in a first area where the first control is located, wherein the tenth control and the first control are the same control.
Optionally, the apparatus further comprises: the control module is used for responding to the interactive opening operation of the terminal equipment and controlling the terminal equipment to enter an inclined interaction mode; in the tilt interaction mode, a tilt operation performed on the terminal device is detected.
Optionally, the apparatus further comprises: and the second triggering module is used for responding to the fact that the tilting operation is not detected within a preset time interval in the tilting interaction mode, executing triggering operation on the first preset control, and enabling the graphical user interface to display content corresponding to the triggering operation on the first preset control.
Optionally, the first preset control is a control with the highest second priority in the area with the highest first priority. It should be noted that each of the above modules may be implemented by software or hardware, and for the latter, it may be implemented by, but not limited to: the modules are all located in the same processor; alternatively, the above modules may be located in different processors in any combination.
Embodiments of the present application also provide a computer readable storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run on a computer or processor.
Alternatively, in the present embodiment, the above-described computer-readable storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.
Alternatively, in this embodiment, the above-mentioned computer-readable storage medium may be located in any one of the computer terminals in the computer terminal group in the computer network, or in any one of the mobile terminals in the mobile terminal group.
Alternatively, in the present embodiment, the above-described computer-readable storage medium may be configured to store a computer program for performing the steps of:
s1, responding to a first tilting operation of terminal equipment, and acquiring first tilting information of the first tilting operation, wherein the first tilting information comprises a first tilting angle;
s2, determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface;
s3, executing control switching from the first control according to the first inclination information;
s4, in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity button or the position of a second preset control in the graphical user interface;
and S5, if the second tilting operation of the terminal equipment is not detected within the preset time interval, or the second triggering operation of the appointed position in the terminal equipment is responded, the triggering operation is executed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: and if the second tilting operation of the terminal equipment is detected within the preset time interval, executing control switching from the second control according to the second tilting information of the second tilting operation.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: in the control switching process, responding to a third tilting operation on the terminal equipment, and executing control switching from a first current control according to third tilting information of the third tilting operation, wherein the first current control is a control selected in a graphical user interface when the third tilting operation is detected, and a third tilting angle of the third tilting operation meets a tilting condition.
Optionally, the graphical user interface comprises at least one region, the different regions corresponding to different first priorities, any one of the at least one region comprising at least one control, the different controls corresponding to different second priorities, the computer readable storage medium further being arranged to store program code for: and executing control switching from the first control based on the first inclination information and the control switching sequence, wherein the control switching sequence comprises a transverse control switching sequence and a longitudinal control switching sequence, the transverse control switching sequence is determined according to the first priority and the second priority of the control in the transverse axis direction, and the longitudinal control switching sequence is determined according to the first priority and the second priority of the control in the longitudinal axis direction.
Optionally, the first tilt information further comprises a first tilt direction, the above computer readable storage medium being further arranged to store program code for performing the steps of: determining a first switching speed based on the first inclination angle, wherein the first switching speed is a speed of switching from the first control to the second control; the control switch is performed from the first control based on the first switch speed, the first tilt direction, and the control switch order.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: in the control switching process, responding to the adjustment operation of the first inclination operation, adjusting the first inclination angle based on the adjustment operation, and determining a second switching speed corresponding to the adjusted first inclination angle, wherein the adjusted first inclination angle meets the inclination condition; and executing control switching from a second current control based on the second switching speed, the first tilting direction and the control switching sequence, wherein the second current control is a control selected in the graphical user interface when the adjustment operation is detected.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: responding to the first inclination direction to be anticlockwise inclined around a transverse axis, and determining a third control with a second priority lower than that of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or, in response to the first inclination direction being clockwise inclination around the transverse axis, determining a fourth control with a second priority higher than the second priority of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or, in response to the first inclination direction being clockwise inclination around the longitudinal axis, determining a fifth control with a second priority lower than that of the first control according to the transverse control switching sequence in a first area where the first control is located; or in response to the first tilting direction being tilting counterclockwise around the longitudinal axis, determining, in a first area where the first control is located, a sixth control with a second priority higher than that of the first control according to the transverse control switching sequence.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: responding to the first inclination direction to be anticlockwise around a transverse axis, wherein a control with a second priority lower than that of the first control does not exist in a first area where the first control is located, and determining a seventh control in the second area according to a longitudinal control switching sequence, wherein the first priority of the second area is lower than that of the first area; or, in response to the first inclination direction being clockwise about the transverse axis, and no control with a second priority higher than a second priority of the first control exists in a first area where the first control exists, determining an eighth control in a third area according to the longitudinal control switching sequence, wherein the first priority of the third area is higher than the first priority of the first area; or, in response to the first inclination direction being clockwise inclination around the longitudinal axis, and no control with a second priority lower than that of the first control exists in the first area where the first control exists, determining a seventh control in the second area according to the transverse control switching sequence; or, in response to the first tilting direction being tilting counterclockwise about the longitudinal axis, and no control with a second priority higher than a second priority of the first control exists in the first area where the first control exists, determining an eighth control in the third area according to the transverse control switching sequence.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: responding to the fact that the first inclination direction is anticlockwise around the transverse axis or clockwise around the longitudinal axis, and no control with second priority lower than that of the first control exists in a first area where the first control is located, and determining a ninth control, wherein the ninth control and the first control are the same control; or, determining a tenth control in response to the first inclination direction being clockwise around the horizontal axis or anticlockwise around the vertical axis, and no control with a second priority higher than a second priority of the first control exists in a first area where the first control is located, wherein the tenth control and the first control are the same control.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: responding to the interactive opening operation of the terminal equipment, and controlling the terminal equipment to enter an inclined interaction mode; in the tilt interaction mode, a tilt operation performed on the terminal device is detected.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: and in the tilting interaction mode, responding to the fact that the tilting operation is not detected within a preset time interval, and executing triggering operation on the first preset control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the first preset control.
Optionally, the above computer readable storage medium is further configured to store program code for performing the steps of: the first preset control is a control with the highest second priority in the area with the highest first priority.
In the computer readable storage medium of this embodiment, a technical solution for control interaction is provided. Providing a graphical user interface through the terminal equipment by adopting a gravity sensing technology, and responding to a first tilting operation of the terminal equipment to obtain first tilting information of the first tilting operation, wherein the first tilting information comprises a first tilting angle; determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface; executing control switching from the first control according to the first inclination information; in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity key or the position of a second preset control in the graphical user interface; if the second tilting operation on the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation on the designated position in the terminal equipment, the triggering operation is performed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation performed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition, the purposes of switching the selected control in the graphical user interface and performing the triggering operation on the selected control are achieved by performing the tilting operation on the terminal equipment, the technical effects that the selection and the triggering operation can be performed on the control in the graphical user interface without touching the graphical user interface in the one-hand transverse screen operation process are achieved, the interaction experience is improved, and the technical problems that the one-hand transverse screen operation cannot touch the control at the other end of the screen, the interaction experience is poor and equipment slipping is easy to cause in the related technology are solved.
From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present application may be embodied in the form of a software product, which may be stored in a computer readable storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, a terminal device, or a network device, etc.) to perform the method according to the embodiments of the present application.
In an exemplary embodiment of the present application, a computer-readable storage medium stores thereon a program product capable of implementing the method described above in this embodiment. In some possible implementations, the various aspects of the embodiments of the application may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the application as described in the "exemplary methods" section of this embodiment, when the program product is run on the terminal device.
A program product for implementing the above-described method according to an embodiment of the present application may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the embodiments of the present application is not limited thereto, and in the embodiments of the present application, the computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Any combination of one or more computer readable media may be employed by the program product described above. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
It should be noted that the program code embodied on the computer readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
An embodiment of the application also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, where the transmission device is connected to the processor, and the input/output device is connected to the processor.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:
s1, responding to a first tilting operation of terminal equipment, and acquiring first tilting information of the first tilting operation, wherein the first tilting information comprises a first tilting angle;
s2, determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface;
S3, executing control switching from the first control according to the first inclination information;
s4, in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity button or the position of a second preset control in the graphical user interface;
and S5, if the second tilting operation of the terminal equipment is not detected within the preset time interval, or the second triggering operation of the appointed position in the terminal equipment is responded, the triggering operation is executed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition.
Optionally, the above processor may be further configured to perform the following steps by a computer program: and if the second tilting operation of the terminal equipment is detected within the preset time interval, executing control switching from the second control according to the second tilting information of the second tilting operation.
Optionally, the above processor may be further configured to perform the following steps by a computer program: in the control switching process, responding to a third tilting operation on the terminal equipment, and executing control switching from a first current control according to third tilting information of the third tilting operation, wherein the first current control is a control selected in a graphical user interface when the third tilting operation is detected, and a third tilting angle of the third tilting operation meets a tilting condition.
Optionally, the graphical user interface comprises at least one region, the different regions corresponding to different first priorities, any one of the at least one region comprising at least one control, the different controls corresponding to different second priorities, the processor being further configured to execute the following steps by means of a computer program: and executing control switching from the first control based on the first inclination information and the control switching sequence, wherein the control switching sequence comprises a transverse control switching sequence and a longitudinal control switching sequence, the transverse control switching sequence is determined according to the first priority and the second priority of the control in the transverse axis direction, and the longitudinal control switching sequence is determined according to the first priority and the second priority of the control in the longitudinal axis direction.
Optionally, the first tilt information further comprises a first tilt direction, and the processor may be further configured to perform the following steps by means of a computer program: determining a first switching speed based on the first inclination angle, wherein the first switching speed is a speed of switching from the first control to the second control; the control switch is performed from the first control based on the first switch speed, the first tilt direction, and the control switch order.
Optionally, the above processor may be further configured to perform the following steps by a computer program: in the control switching process, responding to the adjustment operation of the first inclination operation, adjusting the first inclination angle based on the adjustment operation, and determining a second switching speed corresponding to the adjusted first inclination angle, wherein the adjusted first inclination angle meets the inclination condition; and executing control switching from a second current control based on the second switching speed, the first tilting direction and the control switching sequence, wherein the second current control is a control selected in the graphical user interface when the adjustment operation is detected.
Optionally, the above processor may be further configured to perform the following steps by a computer program: responding to the first inclination direction to be anticlockwise inclined around a transverse axis, and determining a third control with a second priority lower than that of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or, in response to the first inclination direction being clockwise inclination around the transverse axis, determining a fourth control with a second priority higher than the second priority of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or, in response to the first inclination direction being clockwise inclination around the longitudinal axis, determining a fifth control with a second priority lower than that of the first control according to the transverse control switching sequence in a first area where the first control is located; or in response to the first tilting direction being tilting counterclockwise around the longitudinal axis, determining, in a first area where the first control is located, a sixth control with a second priority higher than that of the first control according to the transverse control switching sequence.
Optionally, the above processor may be further configured to perform the following steps by a computer program: responding to the first inclination direction to be anticlockwise around a transverse axis, wherein a control with a second priority lower than that of the first control does not exist in a first area where the first control is located, and determining a seventh control in the second area according to a longitudinal control switching sequence, wherein the first priority of the second area is lower than that of the first area; or, in response to the first inclination direction being clockwise about the transverse axis, and no control with a second priority higher than a second priority of the first control exists in a first area where the first control exists, determining an eighth control in a third area according to the longitudinal control switching sequence, wherein the first priority of the third area is higher than the first priority of the first area; or, in response to the first inclination direction being clockwise inclination around the longitudinal axis, and no control with a second priority lower than that of the first control exists in the first area where the first control exists, determining a seventh control in the second area according to the transverse control switching sequence; or, in response to the first tilting direction being tilting counterclockwise about the longitudinal axis, and no control with a second priority higher than a second priority of the first control exists in the first area where the first control exists, determining an eighth control in the third area according to the transverse control switching sequence.
Optionally, the above processor may be further configured to perform the following steps by a computer program: responding to the fact that the first inclination direction is anticlockwise around the transverse axis or clockwise around the longitudinal axis, and no control with second priority lower than that of the first control exists in a first area where the first control is located, and determining a ninth control, wherein the ninth control and the first control are the same control; or, determining a tenth control in response to the first inclination direction being clockwise around the horizontal axis or anticlockwise around the vertical axis, and no control with a second priority higher than a second priority of the first control exists in a first area where the first control is located, wherein the tenth control and the first control are the same control.
Optionally, the above processor may be further configured to perform the following steps by a computer program: responding to the interactive opening operation of the terminal equipment, and controlling the terminal equipment to enter an inclined interaction mode; in the tilt interaction mode, a tilt operation performed on the terminal device is detected.
Optionally, the above processor may be further configured to perform the following steps by a computer program: and in the tilting interaction mode, responding to the fact that the tilting operation is not detected within a preset time interval, and executing triggering operation on the first preset control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the first preset control.
Optionally, the above processor may be further configured to perform the following steps by a computer program: the first preset control is a control with the highest second priority in the area with the highest first priority.
In the electronic device of the embodiment, a technical scheme of control interaction is provided. Providing a graphical user interface through the terminal equipment by adopting a gravity sensing technology, and responding to a first tilting operation of the terminal equipment to obtain first tilting information of the first tilting operation, wherein the first tilting information comprises a first tilting angle; determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before a first inclination operation, or is a first preset control in the graphical user interface; executing control switching from the first control according to the first inclination information; in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity key or the position of a second preset control in the graphical user interface; if the second tilting operation on the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation on the designated position in the terminal equipment, the triggering operation is performed on the second control, so that the graphical user interface displays display content corresponding to the triggering operation performed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition, the purposes of switching the selected control in the graphical user interface and performing the triggering operation on the selected control are achieved by performing the tilting operation on the terminal equipment, the technical effects that the selection and the triggering operation can be performed on the control in the graphical user interface without touching the graphical user interface in the one-hand transverse screen operation process are achieved, the interaction experience is improved, and the technical problems that the one-hand transverse screen operation cannot touch the control at the other end of the screen, the interaction experience is poor and equipment slipping is easy to cause in the related technology are solved.
Fig. 15 is a block diagram of an electronic device according to an embodiment of the present application. As shown in fig. 15, the electronic device 1500 is merely an example, and should not be construed as limiting the functionality and scope of use of the embodiments of the present application.
As shown in fig. 15, the electronic apparatus 1500 is embodied in the form of a general purpose computing device. The components of the electronic device 1500 may include, but are not limited to: the at least one processor 1510, the at least one memory 1520, a bus 1530 connecting the various system components (including the memory 1520 and the processor 1510), and a display 1540.
Wherein the memory 1520 stores program code that can be executed by the processor 1510 such that the processor 1510 performs steps according to various exemplary implementations of the present application described in the above method section of the embodiment of the present application.
The memory 1520 may include readable media in the form of volatile memory units such as Random Access Memory (RAM) 15201 and/or cache memory 15202, and may further include Read Only Memory (ROM) 15203, as well as nonvolatile memory such as one or more magnetic storage devices, flash memory, or other nonvolatile solid state memory.
In some examples, memory 1520 may also include a program/utility 15204 having a set (at least one) of program modules 15205, such program modules 15205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Memory 1520 may further include memory located remotely from processor 1510, which may be connected to electronic device 1500 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Bus 1530 may be a bus representing one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processor 1510, or a local bus using any of a variety of bus architectures.
The display 1540 may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the electronic device 1500.
Optionally, the electronic apparatus 1500 may also communicate with one or more external devices 1600 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic apparatus 1500, and/or with any device (e.g., router, modem, etc.) that enables the electronic apparatus 1500 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 1550. Also, the electronic device 1500 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, e.g., the internet, through the network adapter 1560. As shown in fig. 15, the network adapter 1560 communicates with other modules of the electronic device 1500 over the bus 1530. It should be appreciated that although not shown in fig. 15, other hardware and/or software modules may be used in connection with electronic device 1500, which may include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The electronic device 1500 may further include: a keyboard, a cursor control device (e.g., a mouse), an input/output interface (I/O interface), a network interface, a power supply, and/or a camera.
It will be appreciated by those of ordinary skill in the art that the configuration shown in fig. 15 is merely illustrative and is not intended to limit the configuration of the electronic device described above. For example, electronic device 1500 may also include more or fewer components than shown in FIG. 15, or have a different configuration than shown in FIG. 1. The memory 1520 may be used to store a computer program and corresponding data, such as a computer program and corresponding data corresponding to a control interaction method in an embodiment of the present application. The processor 1510 executes various functional applications and data processing, i.e., implements the control interaction methods described above, by running computer programs stored in the memory 1520.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application, which are intended to be comprehended within the scope of the present application.

Claims (15)

1. A control interaction method, characterized in that a graphical user interface is provided by a terminal device, the method comprising:
acquiring first inclination information of a first inclination operation of the terminal equipment in response to the first inclination operation, wherein the first inclination information comprises a first inclination angle;
determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before the first inclination operation, or is a first preset control in the graphical user interface;
executing control switching from the first control according to the first inclination information;
in the control switching process, responding to a first triggering operation to a designated position in the terminal equipment, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity button or the position of a second preset control in the graphical user interface;
And if the second tilting operation of the terminal equipment is not detected within the preset time interval, or in response to the second triggering operation of the designated position in the terminal equipment, executing the triggering operation on the second control, so that the graphical user interface displays display content corresponding to the triggering operation executed on the second control, wherein a second tilting angle of the second tilting operation meets the tilting condition.
2. The method according to claim 1, wherein the method further comprises:
and if the second tilting operation of the terminal equipment is detected within the preset time interval, executing control switching from the second control according to second tilting information of the second tilting operation.
3. The method according to claim 1, wherein the method further comprises:
in the control switching process, responding to a third tilting operation of the terminal equipment, and executing control switching from a first current control according to third tilting information of the third tilting operation, wherein the first current control is a control selected in the graphical user interface when the third tilting operation is detected, and a third tilting angle of the third tilting operation meets the tilting condition.
4. The method of claim 1, wherein the graphical user interface comprises at least one region, different regions corresponding to different first priorities, any one of the at least one region comprising at least one control, different controls corresponding to different second priorities, the performing a control switch from the first control in accordance with the first tilt information comprising:
and executing control switching from the first control based on the first inclination information and the control switching sequence, wherein the control switching sequence comprises a transverse control switching sequence and a longitudinal control switching sequence, the transverse control switching sequence is determined according to the first priority and the second priority of the control in the transverse axis direction, and the longitudinal control switching sequence is determined according to the first priority and the second priority of the control in the longitudinal axis direction.
5. The method of claim 4, wherein the first tilt information further comprises a first tilt direction, wherein the performing a control switch from the first control based on the first tilt information and a control switch order comprises:
determining a first switching speed based on the first inclination angle, wherein the first switching speed is a speed of switching from the first control to the second control;
And executing control switching from the first control based on the first switching speed, the first inclination direction and the control switching sequence.
6. The method of claim 5, wherein after the performing a control switch from the first control based on the first switch speed, the first tilt direction, and the control switch order, the method further comprises:
in the control switching process, responding to the adjustment operation of the first inclination operation, adjusting the first inclination angle based on the adjustment operation, and determining a second switching speed corresponding to the adjusted first inclination angle, wherein the adjusted first inclination angle meets the inclination condition;
and executing control switching from a second current control based on the second switching speed, the first tilting direction and the control switching sequence, wherein the second current control is a control selected in the graphical user interface when the adjustment operation is detected.
7. The method of claim 4, wherein the determining a second control in the graphical user interface comprises:
responding to the first inclination direction to be anticlockwise inclined around a transverse axis, and determining a third control with a second priority lower than that of the first control according to the longitudinal control switching sequence in a first area where the first control is located; or,
Responding to the first inclination direction to be clockwise inclination around a transverse axis, and determining a fourth control with a second priority higher than that of the first control according to the longitudinal control switching sequence in the first area where the first control is located; or,
in response to the first inclination direction being clockwise inclination around a longitudinal axis, determining a fifth control with a second priority lower than that of the first control according to the transverse control switching sequence in the first area where the first control is located; or,
and responding to the first inclination direction to be anticlockwise inclined around a longitudinal axis, and determining a sixth control with a second priority higher than that of the first control according to the transverse control switching sequence in the first area where the first control is located.
8. The method of claim 4, wherein the determining a second control in the graphical user interface comprises:
responding to the first inclination direction to be anticlockwise around a transverse axis, and determining a seventh control in a second area according to the longitudinal control switching sequence, wherein no control with second priority lower than the second priority of the first control exists in the first area where the first control exists, and the first priority of the second area is lower than the first priority of the first area; or,
Responding to the first inclination direction to be clockwise inclined around a transverse axis, wherein no control with second priority higher than second priority of the first control exists in the first area where the first control exists, and determining an eighth control in a third area according to the longitudinal control switching sequence, wherein the first priority of the third area is higher than the first priority of the first area; or,
responding to the first inclination direction to be clockwise inclination around a longitudinal axis, and determining the seventh control in the second area according to the transverse control switching sequence, wherein no control with second priority lower than that of the first control exists in the first area where the first control exists; or,
and responding to the first inclination direction to be anticlockwise inclined around a longitudinal axis, and determining the eighth control in the third area according to the transverse control switching sequence, wherein no control with second priority higher than the second priority of the first control exists in the first area where the first control exists.
9. The method of claim 4, wherein the determining a second control in the graphical user interface comprises:
Determining a ninth control in response to the first inclination direction being anticlockwise about a transverse axis or clockwise about a longitudinal axis, and no control with a second priority lower than that of the first control exists in a first area where the first control exists, wherein the ninth control and the first control are the same control; or,
and determining a tenth control in response to the first inclination direction being clockwise around a transverse axis or anticlockwise around a longitudinal axis, and no control with a second priority higher than a second priority of the first control exists in the first area where the first control is located, wherein the tenth control and the first control are the same control.
10. The method of claim 1, wherein prior to the acquiring first tilt information for the first tilt operation in response to the first tilt operation for the terminal device, the method further comprises:
responding to the interactive opening operation of the terminal equipment, and controlling the terminal equipment to enter an inclined interaction mode;
and in the tilting interaction mode, detecting a tilting operation performed on the terminal equipment.
11. The method according to claim 10, wherein the method further comprises:
and in the tilting interaction mode, responding to the fact that no tilting operation is detected within the preset time interval, and executing triggering operation on the first preset control, so that the graphical user interface displays display content corresponding to the triggering operation on the first preset control.
12. The method of claim 1, wherein the graphical user interface comprises at least one region, different regions corresponding to different first priorities, any of the at least one region comprising at least one control, different controls corresponding to different second priorities;
the first preset control is the control with the highest second priority in the area with the highest first priority.
13. A control interaction device, wherein a graphical user interface is provided by a terminal device, the device comprising:
an acquisition module for acquiring first tilt information of a first tilt operation in response to the first tilt operation on the terminal device, wherein the first tilt information includes a first tilt angle;
The first determining module is used for determining a first control in the graphical user interface in response to the first inclination angle meeting an inclination condition, wherein the first control is a control for a user to execute a triggering operation in the graphical user interface within a preset time interval before the first inclination operation, or is a first preset control in the graphical user interface;
the first control switching module is used for executing control switching from the first control according to the first inclination information;
the second determining module is used for responding to a first triggering operation on a designated position in the terminal equipment in the control switching process, stopping executing control switching and determining a second control in the graphical user interface, wherein the designated position is the position of an entity button or the position of a second preset control in the graphical user interface;
and the first triggering module is used for responding to the second triggering operation of the appointed position in the terminal equipment or executing the triggering operation on the second control if the second tilting operation of the terminal equipment is not detected within the preset time interval, so that the graphical user interface displays display content corresponding to the triggering operation executed on the second control, wherein the second tilting angle of the second tilting operation meets the tilting condition.
14. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program, wherein the computer program is arranged to perform the control interaction method of any of the preceding claims 1 to 12 when run on a computer or processor.
15. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, the processor being arranged to run the computer program to perform the control interaction method of any of the preceding claims 1 to 12.
CN202310906943.XA 2023-07-21 2023-07-21 Control interaction method and device, storage medium and electronic device Pending CN117112094A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310906943.XA CN117112094A (en) 2023-07-21 2023-07-21 Control interaction method and device, storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310906943.XA CN117112094A (en) 2023-07-21 2023-07-21 Control interaction method and device, storage medium and electronic device

Publications (1)

Publication Number Publication Date
CN117112094A true CN117112094A (en) 2023-11-24

Family

ID=88801108

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310906943.XA Pending CN117112094A (en) 2023-07-21 2023-07-21 Control interaction method and device, storage medium and electronic device

Country Status (1)

Country Link
CN (1) CN117112094A (en)

Similar Documents

Publication Publication Date Title
CN110663018B (en) Application launch in a multi-display device
JP6145099B2 (en) Game controller for touch-enabled mobile devices
WO2019153824A1 (en) Virtual object control method, device, computer apparatus, and storage medium
US20170336883A1 (en) Using a hardware mouse to operate a local application running on a mobile device
CN108885521A (en) Cross-environment is shared
US11541311B2 (en) Program, electronic device, and method for simulating a joystick in a virtual space
CN108776544B (en) Interaction method and device in augmented reality, storage medium and electronic equipment
CN110448904B (en) Game view angle control method and device, storage medium and electronic device
US20210205698A1 (en) Program, electronic device, and method
CN113396378A (en) System and method for a multipurpose input device for two-dimensional and three-dimensional environments
KR102021851B1 (en) Method for processing interaction between object and user of virtual reality environment
US20150355717A1 (en) Switching input rails without a release command in a natural user interface
EP2362302B1 (en) Method for controlling motions of an object in a 3-dimensional virtual environment
CN117112094A (en) Control interaction method and device, storage medium and electronic device
JP2021524108A (en) How to handle application partitions, devices and computer readable storage media
EP3433713B1 (en) Selecting first digital input behavior based on presence of a second, concurrent, input
CN113350801A (en) Model processing method and device, storage medium and computer equipment
CN113440835A (en) Control method and device of virtual unit, processor and electronic device
JP2021067999A (en) Control device, program, and system
CN112402967B (en) Game control method, game control device, terminal equipment and medium
JP7250451B2 (en) Programs, electronic devices, and methods
JP7471782B2 (en) Program, electronic device, and method
KR102369256B1 (en) Method for providing user interface and terminal for executing the same
KR102369251B1 (en) Method for providing user interface and terminal for executing the same
CN116048281A (en) Interaction method, device, equipment and storage medium in virtual reality scene

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination