CN114690976A - System home page interface interactive operation method and device based on elastic waves - Google Patents
System home page interface interactive operation method and device based on elastic waves Download PDFInfo
- Publication number
- CN114690976A CN114690976A CN202110435281.3A CN202110435281A CN114690976A CN 114690976 A CN114690976 A CN 114690976A CN 202110435281 A CN202110435281 A CN 202110435281A CN 114690976 A CN114690976 A CN 114690976A
- Authority
- CN
- China
- Prior art keywords
- application
- touch
- elastic wave
- trigger information
- touch operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 119
- 238000000034 method Methods 0.000 title claims abstract description 66
- 238000013507 mapping Methods 0.000 claims abstract description 130
- 230000006870 function Effects 0.000 claims abstract description 119
- 238000001514 detection method Methods 0.000 claims abstract description 56
- 230000003993 interaction Effects 0.000 claims description 25
- 230000015654 memory Effects 0.000 claims description 20
- 238000012217 deletion Methods 0.000 claims description 12
- 230000037430 deletion Effects 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 12
- 239000002609 medium Substances 0.000 description 71
- 230000008569 process Effects 0.000 description 20
- 238000003860 storage Methods 0.000 description 19
- 241001422033 Thestylus Species 0.000 description 16
- 238000010586 diagram Methods 0.000 description 14
- 230000001960 triggered effect Effects 0.000 description 14
- 238000013145 classification model Methods 0.000 description 7
- 239000000463 material Substances 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 238000010276 construction Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 4
- 238000001914 filtration Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000010287 polarization Effects 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013136 deep learning model Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 210000001145 finger joint Anatomy 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 210000001015 abdomen Anatomy 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 239000007789 gas Substances 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04162—Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The embodiment of the application discloses a system home page interface interactive operation method and device based on elastic waves. According to the technical scheme provided by the embodiment of the application, the medium type of the touch object is determined according to the first elastic wave signal, a prestored mapping relation is inquired according to the gesture feature of the first touch operation and the medium type, the gesture feature, the medium type and corresponding application trigger information are stored in the mapping relation, and the application trigger information is used for triggering and starting the application function corresponding to the home page interface; and after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to open the corresponding application function based on the application trigger information. By adopting the technical means, the triggering and opening of the application function corresponding to the home page interface can be realized through the rapid detection and matching of the elastic wave signal of the touch object, the opening operation flow of various application functions of the home page interface is simplified, and the operation efficiency of the application function starting control is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of man-machine interaction, in particular to a system home interface interactive operation method and device based on elastic waves.
Background
At present, an interactive mode of an interactive tablet is mainly based on gesture detection by an infrared touch sensor and a piezoresistor pressure sensor, and gesture interactive operations such as clicking, sliding and long-time pressing are realized by monitoring information such as a click coordinate, a click duration and a touch area returned by a touch screen. In order to facilitate the use of the functions of the related applications, shortcuts of the related applications are set on a system home page interface so that a user can quickly click and use the shortcut.
However, the interaction mode of the interactive tablet is relatively single by simply defining the coordinate, the click duration and the touch area, when an application function needs to be used, the application icon needs to be clicked to enter the application interface, and then the corresponding function option is clicked on the application interface, so that the related interaction process is relatively complicated, and the user operation experience is not good enough.
Disclosure of Invention
The embodiment of the application provides a system homepage interface interactive operation method and device based on elastic waves, which can simplify the opening operation of homepage application functions and solve the technical problem that the homepage application function opening process is complicated.
In a first aspect, an embodiment of the present application provides an elastic wave-based system home interface interactive operation method, which is used for an interactive tablet, where the interactive tablet includes a display screen and an infrared touch frame, the infrared touch frame is disposed on a frame of the display screen, the interactive tablet further includes an elastic wave detection device, and the method includes:
the infrared touch frame detects a first touch operation of a touch object on a display screen corresponding to an icon; the elastic wave detection device detects a first elastic wave signal, and the first elastic wave signal is generated when the touch object contacts the display screen when the touch object performs the first touch operation;
determining the medium type of the touch object according to the first elastic wave signal, and inquiring a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, wherein the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface;
and after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to start the corresponding application function based on the application trigger information.
In a second aspect, an embodiment of the present application provides an elastic wave-based system home page interface interoperation device, which is used for an interactive tablet, where the interactive tablet includes a display screen and an infrared touch frame, the infrared touch frame is disposed on a frame of the display screen, the interactive tablet further includes an elastic wave detection device, and the elastic wave-based system home page interface interoperation device includes:
the detection module is used for detecting a first touch operation of a touch object on a display screen corresponding to an icon through the infrared touch frame; detecting a first elastic wave signal through the elastic wave detection device, wherein the first elastic wave signal is generated when the touch object contacts the display screen when the touch object performs the first touch operation;
the query module is used for determining the medium type of the touch object according to the first elastic wave signal and querying a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface;
and the response module is used for responding to the first touch operation after the corresponding application trigger information is determined, and controlling to start the corresponding application function based on the application trigger information.
In a third aspect, an embodiment of the present application provides an interactive tablet, including:
a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the elastic wave-based system home interface interoperation method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the method for elastic wave-based system home interface interoperation as described in the first aspect.
According to the embodiment of the application, a first touch operation of a touch object on a display screen corresponding to an icon is detected through an infrared touch frame; detecting a first elastic wave signal through an elastic wave detection device, wherein the first elastic wave signal is generated when a touch object performs a first touch operation and the touch object contacts a display screen; determining the medium type of the touch object according to the first elastic wave signal, and inquiring a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, wherein the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface; and after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to start the corresponding application function based on the application trigger information. By adopting the technical means, the triggering and opening of the application function corresponding to the home page interface can be realized through the rapid detection and matching of the elastic wave signal of the touch object, the opening operation flow of various application functions of the home page interface is simplified, the operation efficiency of application function starting control is improved, and the operation experience of a user is optimized.
In addition, the embodiment of the application enables a user to trigger an application function by using various touch objects through binding and custom modification of the mapping relation, so that the touch operation requirements of the user under different conditions are met, and the operation experience of the user is further optimized.
Drawings
Fig. 1 is a flowchart of a method for interactive operation of a home interface of a system based on elastic waves according to an embodiment of the present application;
FIG. 2 is a schematic diagram illustrating detection of an intermediate infrared touch frame according to an embodiment of the present application;
FIG. 3 is a schematic diagram of elastic wave detection in accordance with one embodiment of the present application;
FIG. 4 is an initial diagram of a system home interface according to an embodiment of the present application;
fig. 5 is a schematic view illustrating a home interface icon returning touch in the first embodiment of the present application;
FIG. 6 is a schematic diagram illustrating theme switching of a home page interface in an embodiment of the present application;
FIG. 7 is a schematic diagram illustrating a delete of a home interface application in an embodiment of the present application;
FIG. 8 is a schematic diagram illustrating a shortcut menu display of a home interface in an embodiment of the present application;
FIG. 9 is a schematic diagram of input channel switching according to an embodiment of the present application;
FIG. 10 is a flowchart illustrating a mapping relationship construction process according to an embodiment of the present application;
FIG. 11 is a mapping relationship binding diagram in the first embodiment of the present application;
FIG. 12 is a schematic diagram illustrating mapping relationship reconstruction in an embodiment of the present application;
fig. 13 is a schematic structural diagram of an interactive operation device of a system home interface based on elastic waves according to a second embodiment of the present application;
fig. 14 is a schematic structural diagram of an interactive tablet according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The application provides a system home page interface interactive operation method based on elastic waves, and aims to trigger the starting operation of corresponding application functions through detection and matching of the elastic waves, so that the application functions are quickly started, the starting process of the application functions is simplified, user interactive operation is simplified, and further user operation efficiency and experience are improved. Compared with the traditional interactive tablet, when the interactive operation is carried out on the system home page interface, the user needs to click the toolbar or the application list to start a certain application function, find the corresponding application program from the toolbar or the application list, click to enter the application program, and realize the corresponding application function based on the related interactive operation of the application program interface. The whole operation process is relatively complex, and for some common functions, the operation efficiency of a user is inevitably influenced by such complex interactive operation, so that the human-computer interaction experience is relatively poor. Therefore, the system home page interface interactive operation method based on the elastic waves is provided to solve the technical problem that the existing home page application function opening process is complicated.
The first embodiment is as follows:
the present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration and not limitation. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
It is noted that, in the present application, relational terms such as first and second, and the like are used solely to distinguish one entity or action or object from another entity or action or object without necessarily requiring or implying any actual such relationship or order between such entities or actions or objects. For example, the "first" and "second" of the first touch operation and the second touch operation are used to distinguish the interaction operation of touching the display screen cover plate at two different times. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated object, indicating that there may be three relationships, for example, a and/or B, which may indicate: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The system home interface interactive operation method based on elastic waves provided in the embodiment of the present application may be executed by a system home interface interactive operation device based on elastic waves, where the system home interface interactive operation device based on elastic waves may be implemented in a software and/or hardware manner, and the system home interface interactive operation device based on elastic waves may be formed by two or more physical entities, or may be formed by one physical entity. For example, the system home interface interactive operation device based on the elastic waves may be a computer with a touch function, a tablet or an interactive tablet and other smart devices.
For the convenience of understanding, the interactive tablet is taken as the interactive operation device of the elastic wave-based system home interface in the embodiment. The interactive panel may be an integrated device that operates the content displayed on the display panel and implements human-computer interaction operations through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a screen, a sound, a television, a video conference terminal, and the like. In practical application, the hardware part of the interactive flat panel is composed of a display screen, an intelligent processing system and the like, the display screen and the intelligent processing system are combined together through an integral structural part, meanwhile, a special software system is used as a support, and the display screen has a touch function. In an embodiment, the display screen displays an electronic whiteboard, a user can perform touch operation on the display screen through a finger or a touch pen, and the intelligent processing system executes corresponding interactive operation according to the touch operation input by the user. Typically, the interactive tablet is installed with at least one type of operating system, where the operating system includes but is not limited to an android system, a Linux system, and a Windows system, and the operating system processes touch operations received by the display screen to implement corresponding human-computer interaction operations.
Fig. 1 is a flowchart of an elastic wave-based system home interface interactive operation method provided in an embodiment of the present application, and referring to fig. 1, the elastic wave-based system home interface interactive operation method is used for an interactive flat panel, where the interactive flat panel includes a display screen and an infrared touch frame, the infrared touch frame is disposed on a frame of the display screen, the interactive flat panel further includes an elastic wave detection device, and the elastic wave-based system home interface interactive operation method specifically includes:
s110, detecting a first touch operation of a touch object on a display screen corresponding to an icon by the infrared touch frame; the elastic wave detection device detects a first elastic wave signal, and the first elastic wave signal is generated when the touch object contacts the display screen when the touch object performs the first touch operation.
In the scheme, the detection of the interactive panel on the touch operation not only has the detection of the gesture characteristics of the touch operation, but also has the detection of a signal which vibrates when a medium (namely a touch object) is in contact with a display interface of the interactive panel during the touch operation, namely the acquisition of an elastic wave signal. Here, mechanical vibration below the audio frequency, sound in the audio frequency range, and ultrasonic waves beyond the audio frequency are all wave phenomena of media such as gas, liquid, and solid, and such wave phenomena are called elastic waves with respect to light and electromagnetic waves.
For the detection of the touch operation, an infrared touch frame 10 based on infrared light as shown in fig. 2 is taken as an example. The infrared touch frame 10 shown in fig. 3 includes two sets of infrared emitters 101 and two sets of infrared receivers 102, each set of infrared receivers 102 is disposed opposite to one set of infrared emitters 101, respectively, and the infrared receivers 102 and the infrared emitters 101 are arranged in a one-to-one correspondence in sequence. The infrared transmitter 101 is configured to transmit an infrared light signal, the infrared receiver 102 is configured to receive the infrared light signal, and the infrared light signals densely distributed in different directions are used to form a beam grid crossing in the horizontal direction and the vertical direction to complete detection of a touch position, so as to obtain touch characteristic information of a touch operation. Specifically, when the touch object blocks the infrared light, the light measurement value of the corresponding infrared receiver 102 changes, and the position of the touch object in the touch detection area can be determined. It can be understood that, when the touch position corresponds to the position of the icon displayed on the display screen, the touch object of the current touch operation is determined as the corresponding icon.
When different touch objects touch or approach the display screen, the touch objects can completely or partially block one or more infrared lights in vertical and horizontal directions. The infrared emitters (M in total) arranged horizontally and the infrared emitters (N in total) arranged vertically scan at a certain frequency, and the infrared receiver arranged correspondingly at the other side receives the infrared light sent by the opposite side at a certain frequency. When all the vertical and horizontal infrared light scanning is finished, an M N infrared light intensity pixel graph can be obtained. First find a position greater than a first touch threshold I1, which represents a true valid touch, but which is not a half-occlusion infrared path when a noise or object is close to but not fully touching; touch locations (Xn, Yn) are labeled in order, where X and Y represent the coordinates of the location and n in the subscript represents the number of true valid touch zones. From this position, the position of the proximity area greater than the second contact threshold I2 is viewed, which represents a position greater than the noise value, and can be regarded as an extension of the real touch area, and the whole area is marked as a valid touch area. The geometric shape Sn of the touch area may be recorded by the size of the touch area, may be a geometric boundary of the original data, or may be a geometric figure obtained by fitting, such as a major axis, a minor axis and a rotation angle of an ellipse, or two side lengths and a rotation angle of a rectangle.
When the touched object is far away from the display screen cover plate, the shielding of the object on infrared light is reduced, and if the original position or the adjacent position marked as the effective touch N in the previous frame in the M x N infrared light intensity pixel diagram does not exceed the pixel of the disengagement threshold I3, the effective touch N is changed into the disengagement touch. For the same effective touch, the memory can continuously record the position of the touch point and the touch area information. Through the information, information such as the velocity vn, the acceleration an, the angular velocity α n, the angular acceleration β n, and the like of the effective touch can be further obtained.
The frame of the interactive flat plate is rectangular, the infrared touch frame shown in fig. 2 is installed on the frame, and information transmission is achieved through the circuit board in the frame and the interior of the interactive flat plate. Certainly, the infrared touch frames 10 arranged along the rectangular frame are only suitable for the design of the rectangular interactive flat plate, in the actual product implementation process, according to the difference between the application scene and the use requirement, the shapes of the interactive flat plates are also different, such as hexagonal shapes and circular shapes, the shapes of the frames also can be corresponding to hexagonal shapes and circular shapes, for the frames of different shapes, the settings of the infrared emitters 101 and the infrared receivers 102 in the infrared touch frames 10 are also different, but the arrangement principle that the detection of the touch positions is completed through the light beam grids which are crossed horizontally and vertically is still kept in one-to-one correspondence with the infrared emitters 101 and the infrared receivers 102 is maintained on the whole.
In the implementation process of the present solution, as shown in fig. 3, for the detection of the elastic wave signal, the elastic wave sensor 103 is implemented, and the elastic wave sensor 103 is specifically installed at a position where vibration generated by the display screen can be transmitted, so as to implement the detection of an event that a touch object touches the display screen on the display screen, and is not necessarily installed at the position where vibration occurs. As shown in fig. 3, elastic wave sensors 103 may be arranged at 4 corners of the display screen, and of course, there may be other arrangement manners, for example, the middle point of each side of the rectangular frame is provided, and the number may also be other numbers, for example, 2, 5, as long as elastic wave sensors 103 can detect the vibration when the touch object is in contact with the interactive interface during the touch operation, the specific arrangement number may be set specifically according to the size and detection accuracy of the display screen, generally, the larger the size of the display screen is, the higher the requirement for the detection accuracy is, and the larger the number of elastic wave sensors 103 is. Elastic wave sensor 103 may be mounted directly on the surface of the display screen, for example, directly on the upper surface of the display screen or the lower surface of the display screen, so as to receive the vibration transmitted by the display screen and improve the accuracy of touch detection. Elastic wave sensor 103 can also be installed in the frame of the display screen, reducing the influence on the internal mechanism and reducing the common mode noise interference from the display screen. Of course, the elastic wave sensor 103 may be mounted on another member in contact with the display screen, and receive the vibration occurring in the display screen through transmission of the other member.
The elastic wave sensors can be all passive elastic wave detection sensors or one or more of the elastic wave sensors can actively excite elastic waves outwards, the excited elastic waves can be detected by all the elastic wave sensors, when external touch occurs on the cover plate of the display screen, the elastic waves can be generated in addition and detected by all the elastic wave sensors, and the system can judge the type of the medium of the touch object corresponding to the external touch according to signals generated by the comprehensive action of the elastic waves.
When an object touches (including touching and sliding) the cover of the display screen, an elastic wave having characteristics is generated, and the elastic wave propagates from the contact point, along the cover to the periphery, or towards the inside of the cover. The elastic wave sensor positioned at the frame of the display screen or in the cover plate can convert vibration signals into voltage, current or magnetic flux signals according to different detection modes, and the signals are transmitted to a processor with temperature compensation, amplified and converted into digital elastic wave sensing signals.
Taking the voltage signal as an example, the voltage signal obtained by the elastic wave sensor during the contact of the object with the cover plate of the display screen is scanned at a certain frequency f, and when the voltage value is greater than the first voltage threshold V1, the voltage value is recorded as an effective voltage value higher than noise, otherwise, the voltage value is recorded as zero voltage. In a specific determination process, the first voltage threshold V1 may change with temperature because the circuit noise changes with temperature and the coupling coefficient of the piezoelectric material also changes with temperature. K voltage signals recorded continuously are an elastic wave signal segment, and the duration of the segment is T0 ═ K/f. In this segment, if none of the K signals in this segment is greater than the first voltage threshold V2, the strength of the signal does not reach the effective touch strength, and it is discarded; otherwise, it is recorded as a valid touch signal.
According to the information of the infrared touch frame, the center position and the contact shape of the touch object at the moment of ti can be known. From the temperature information, it can be derived the speed of propagation of different elastic waves in the cover, such as the wave speed of a surface wave va (T), which is a function of the temperature T, which may be anisotropic (e.g. due to the anisotropy of the cover material, or due to differences in internal stresses). According to the position information, the distance between the touch object and one elastic wave sensor is Sk, and the elastic wave signal of the touch object reaches the elastic wave sensor at the (ti + Sk/va) moment; and the intensity of the elastic wave will attenuate with distance, the ratio of the signal intensity reaching the elastic wave sensor to the original signal intensity is-1/(Sk ^ 2). The specific attenuation rate is also related to the cover plate temperature of the display screen and the frequency of the elastic wave, and overall, the higher the cover plate temperature is, the faster the attenuation rate is; the higher the frequency, the faster the decay rate. The same can be obtained, and the signal receiving time and the signal intensity relation of other elastic wave sensors are obtained.
All the elastic wave signals obtained by the elastic wave sensor can remove some noise signals according to different characteristic quantities of signals such as time, frequency and the like. First, vibration signals from outside of the touch behavior: for example, external vibration, internal vibration of a speaker or a frame may generate some vibration, and with the help of information detected by the infrared touch frame, a time period in which an effective signal appears may be determined, and elastic wave signals in other time periods are signals caused by non-touch. The non-effective touch signals in the piezoelectric sensors in different time periods are removed, and the identification and judgment of the follow-up steps on the object are facilitated. The second is from the touch behavior but the characteristics of the touching object were not previously recorded. For a touch gesture or other object touch used for interaction, there is a known characteristic frequency distribution, for example, when a finger is touched or slid with a stylus pen or an eraser, the characteristic frequency is between 1kHz and 20kHz, and signals of other frequencies are noise or unsupported signals; therefore, the voltage signal can be subjected to fast Fourier transform, and unsupported frequency intervals are filtered out from the signal interval.
It should be noted that the elastic wave sensors at the same position may be combined with one or more sensors with polarization directions. For example, two polarization directions are +/-Z directions, a difference circuit can be used for obtaining the difference value of two piezoelectric signals, the signals can be amplified, and the piezoelectric coefficient change caused by temperature and the like can be reduced. For example, one or more piezoelectric sensors in the polarization direction in the XY plane can sense one more dimension of elastic wave signals, detect propagation of different elastic waves, increase the amount of information (facilitating identification and judgment of multiple points), and increase the function of water resistance (using the characteristic signal of tangential waves due to the low shear modulus of water) or other stains.
To this end, the elastic wave sensor may output a valid elastic wave signal in the form of a corresponding voltage signal, in which information such as amplitude, frequency and phase may be confirmed, in conjunction with the previous infrared touch frame.
From the source of elastic wave generation, the device comprises various noise-generating elements (such as a motor, a loudspeaker, a fan and the like) in the interactive flat panel and noise-generating equipment (such as an indoor air conditioner, a television and the like) outside the interactive flat panel, and the elements can cause the interactive flat panel to generate elastic waves which are not intended by a user during use. Through the type of the component, the way of generating noise by the component can be confirmed, for example, the noise generated by the speaker mainly comes from the elastic wave generated in the whole medium of the interactive flat plate when the speaker makes a sound, and for the elastic wave sensor, various elastic wave signals can be detected at any time, but many of the elastic wave signals are not from the touch operation itself.
For the elements or the devices, elastic wave signals generated by the elements or the devices under different driving voltages within a preset time period can be collected in advance, and electric signals obtained by correspondingly converting the elastic wave signals are used as noise signals. All signals detected by the elastic wave sensor are subjected to noise filtering, and after noise interference is eliminated, effective elastic wave signals can be obtained. In the process of filtering noise, considering that the interferences generated by the noise signals are different, the signals generated by the touch operation can be adaptively amplified or reduced by referring to the noise signals, so as to highlight the difference between the noise signals and the signals generated by the touch operation.
Considering that when noise generated by a noise source such as a horn is slight, an elastic wave signal generated when a touch object touches the touch object is obviously higher than an elastic wave signal (namely, a noise signal) generated by the noise source such as the horn, at the moment, the difference between the two signals is not obvious, and the elastic wave band generated by the noise can be more easily confirmed and removed by setting a threshold of voltage limited by a voltage range, so that the condition of calculation amount is reduced, the efficiency of noise filtering is effectively improved, and a signal corresponding to touch operation, namely, the elastic wave signal, is quickly obtained. Specifically, within the range of the threshold value composition of the voltage, all the detected elastic wave signals and noise signals are subjected to phase comparison, signal data which is consistent with the phase of the noise signals are removed, and unnecessary calculation amount in actual calculation is reduced. In the filtering process, all the elastic wave signals and the noise signals can be compared in phase, if the phase of the elastic wave signals is consistent with that of the noise signals, signal data in the elastic wave signals, which are consistent with that of the noise signals, are deleted, and if the phase of the elastic wave signals is opposite to that of the noise signals, signal data in the elastic wave signals, which are opposite to that of the noise signals, are reserved, so that errors caused by direct subtraction under the condition that the wave bands of the noise signals are opposite to those of the elastic wave signals are avoided, and signals which really originate from touch operation in the elastic wave signals are reserved.
The touch sensing information may include pressure information detected by the pressure sensor in addition to the touch operation and the elastic wave signal described above. The principle of the pressure sensor is that pressure can cause resistance change, if constant voltage is applied to the pressure sensor, the output current value can be detected, and then the change of the piezoresistor can be obtained, and the pressure change detection of the pressure sensor is realized. The plurality of pressure sensors are arranged below the display screen and can be specifically arranged at the edge or the position close to the center, and due to the force superposition, the plurality of pressure sensors can sense pressure information at different positions and can calculate the pressure of each touch point by combining the infrared touch frame.
After the pressure information is detected by the pressure sensor, touch sensing information corresponding to touch operation occurring in the touch detection area of the interactive tablet can be further filtered. In the process that a touch object is close to or contacts with a display screen to leave the display screen, touch operation may be detected, but from an actual contact state and a touch target, the touch operation cannot be used as effective touch sensing information, for example, a touch object in an infrared display screen has a small distance before contacting and is not actually contacted, but the infrared display screen can detect the touch object; certainly, the same state exists in the leaving process, and at this time, the touch sensing information may be filtered according to the comparison result between the pressure information and the preset pressure threshold, that is, if the pressure information in a certain time period is smaller than the preset pressure threshold, the touch sensing information corresponding to the time period is filtered, and the touch operation and the elastic wave signal detected in the time period are ignored and are not responded.
Based on the detection scheme of the touch operation and the elastic wave signal, when the touch object touches the corresponding icon on the interactive flat panel display screen, the corresponding touch operation and the elastic wave signal can be detected, and the corresponding human-computer interaction operation is executed based on the detected touch operation and the elastic wave signal.
Specifically, when the interactive tablet is used, a user realizes human-computer interaction through a display screen of the touch interactive tablet. The interactive flat panel detects touch operation of a corresponding icon displayed on the current display screen and a corresponding elastic wave signal, and realizes related interactive operation based on the touch operation and detection and response of the corresponding elastic wave signal. In the embodiment of the application, in order to trigger the corresponding application function by touching the corresponding icon through the related touch object, the gesture features and the media types of different touch objects are bound with the corresponding application function in an elastic wave signal detection matching mode, when the gesture features and the elastic wave signals of the touch icon of the corresponding touch object are detected, the media types of the touch object are determined through the elastic wave signals, the pre-bound application trigger information can be determined based on the media types and the gesture features, and the corresponding application function is started by using the application trigger information. After the infrared touch frame detects the touch operation generated by the touch object contacting with the corresponding icon displayed on the interactive flat panel display screen, the touch operation is defined as a first touch operation. Meanwhile, the elastic wave detection device detects an elastic wave signal, namely a first elastic wave signal, which is correspondingly generated by the first touch operation.
S120, determining the medium type of the touch object according to the first elastic wave signal, and inquiring a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, wherein the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home interface.
In this embodiment, the response to the effective touch sensing information is determined based on the determination of the medium (i.e., the touch object) in addition to the gesture feature of the touch operation. The gesture characteristics are specifically determined by touching the corresponding icon through touch operation, such as touch duration, touch trajectory characteristics, touch operation (e.g., single-click and double-click), and/or touch area. The judgment of the touch medium is mainly realized by comparing the elastic wave signal with the pre-stored characteristics of the touch medium, and if the elastic wave signal is matched with the pre-stored characteristics of the touch medium, the type of the touch medium is determined to be the corresponding type of the touch medium; in addition, a classification model is obtained by pre-training elastic wave information of a plurality of samples based on different touch medium types, and touch sensing information is integrally input or an elastic wave signal in the touch sensing information is input into the classification model to finish the identification of the touch medium type. Specifically, the identification of the type of touch medium is realized by the following two ways:
comparing the elastic wave signal with pre-stored touch medium classification information, and confirming the touch medium type corresponding to the elastic wave signal; or the like, or a combination thereof,
and inputting the elastic wave signal into a classification model obtained by pre-training, and confirming the touch medium type corresponding to the elastic wave signal according to a classification function value output by the classification model.
The method includes that one or more set attribute information is/are directly compared with prestored touch medium classification information, for example, one or more of amplitude, frequency and phase are compared, when the matching degree of the compared attribute information reaches a set threshold value, the elastic wave signal is determined to be the corresponding touch medium type, and the comparison mode of one elastic wave signal and multiple elastic wave signals is the same, namely, the elastic wave signal and the multiple elastic wave signals are compared with the prestored touch medium classification information one by one until the matching is successful or all the comparison is completed, and the elastic wave signal and the multiple elastic wave signals are not matched.
For the classification mode through the classification model, if one touch point is in the condition, the time of each piezoelectric sensor receiving the signal is deduced through the infrared touch frame, and the information such as the strength and the phase of the characteristic frequency is found out according to the voltage signals in different time periods. The information is combined with the pressure information of the touch point as an input item, and classification function values 0,1,2,3 and 4 are output through a machine learning or/and deep learning model, wherein 0 represents an unsupported object, 1 represents a finger pulp, 2 represents a writing pen A, 3 represents a writing pen B, 4 represents an eraser, and the like. The specific setting of the classification function value may be any format value according to the actual model, for example, 0,1,2,3,4. in this embodiment, the format may also be set to 000,001,010,011,100. The classification model may further give the degree of possibility of each classification, for example, 85% of the possibility of the stylus pen a, 13% of the possibility of the stylus pen B, and 2% of the possibility of the finger abdomen, which are determined by the elastic wave signal detected during a certain touch operation, in addition to outputting a clear classification result.
For the condition of a plurality of touch points, the time of each elastic wave sensor for receiving signals is calculated through an infrared touch frame, and the information such as the intensity and the phase of characteristic frequency is found out through fast Fourier transform of voltage signals in different time periods. The information obtained from the elastic waves is combined with information (including information such as position coordinates, contact area, speed and acceleration) detected by an infrared touch frame at the touch point, and pressure information of the touch point as an information packet Infoi, all the information packets are used as input items to pass through a machine learning or deep learning model, and classification function values 0,1,2,3 and 4 are respectively output for each touch point i, wherein each classification function value represents different types of touch media, for example, 0 represents an unsupported object, 1 represents a finger pulp, 2 represents a writing pen a, 3 represents a writing pen B, 4 represents an eraser, and so on, and of course, the classification function values and the types of touch media can have different corresponding modes.
It should be noted that the pre-trained classification model is not fixed, and can perform self-training, self-reinforcement and self-optimization according to the use data of the user during the use of the interactive tablet, so that the classification judgment result is more accurate and more suitable for the use habit of the user.
Based on the identification mode of the touch medium type, the medium type corresponding to the first elastic wave signal can be determined, namely the medium type corresponding to the current touch object.
Further, the interactive tablet queries a pre-stored mapping relation based on the detected media type and the gesture feature. Before that, the interactive tablet stores media type information and corresponding gesture features of touch objects in advance, the touch objects can be touch pens, finger pulp, finger joints and other objects made of different materials according to actual use requirements, the touch objects are made of different materials, elastic wave signals generated when the touch objects touch the display screen are different, and correspondingly, the media types detected by the interactive tablet are different. The gesture features and the application triggering information corresponding to the media types are stored as corresponding mapping relations, and the application triggering information is used for triggering and starting of corresponding application functions. The mapped application trigger information can be determined through the media type and the corresponding gesture feature, and then the corresponding application function is triggered.
Specifically, when the detected gesture feature and the media type are matched with the gesture feature and the media type in the pre-stored mapping relationship, the media type and the gesture feature of the touch object of the current display screen can be determined to be the media type and the gesture feature corresponding to the pre-stored mapping relationship. It can be understood that if it is determined through the mapping query that the gesture feature and the media type match the corresponding mapping, the corresponding application function may be triggered to be started to be used.
It should be noted that, according to the touch activation requirement of the application function, if it is required to activate multiple different application functions by using detection and matching of the elastic wave signal, a mapping relationship between the media types of multiple touch objects and multiple application trigger information may be pre-constructed. And a subsequent user touches the display screen through touch objects of different media types, so that the corresponding application function can be triggered and started based on different mapping relations. Similarly, mapping relationships between various gesture features and the same media type and various application trigger information can be constructed in advance. Therefore, the operation requirement that the same touch object triggers multiple application functions is met.
Based on the pre-constructed storage of the mapping relation, whether the currently detected first elastic wave signal is matched with the pre-stored medium type and gesture characteristics or not can be determined through the follow-up inquiry of the mapping relation. And then, according to the query of the mapping relation, the application trigger information to be used by the current first elastic wave signal can be determined.
S130, after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to start the corresponding application function based on the application trigger information.
After the corresponding application trigger message is determined based on the query result of the mapping relationship, the corresponding application function can be controlled to be started through the application trigger message, so that the interactive operation process of the system home page interface based on elastic wave signal detection and matching in the embodiment of the application is completed. It can be understood that, in the whole process, the user only needs to touch the corresponding icon displayed on the display screen by using the touch object, and the triggering operation of the corresponding application function can be realized.
Illustratively, when a user performs man-machine interaction on a display screen of an interactive tablet, the elastic wave signal of a specific touch object is set as a medium type feature, and a specified gesture feature and the medium type feature are bound with specified application trigger information. And when man-machine interaction is carried out on the home page interface subsequently, if a certain application function needs to be used, the icon of the corresponding application function is touched by using the touch object of the corresponding medium type based on the prestored mapping relation, and corresponding gesture features are generated. Correspondingly, after the interactive tablet detects that the media type and the gesture characteristics corresponding to the touch operation are matched with the predicted mapping relation, the corresponding application function is triggered by using the application trigger information corresponding to the mapping relation, so that the corresponding application function achieves the control effect of one-key triggering.
Detecting a first touch operation of a touch object on the display screen corresponding to the icon through the infrared touch frame; detecting a first elastic wave signal through an elastic wave detection device, wherein the first elastic wave signal is generated when a touch object performs a first touch operation and the touch object contacts a display screen; determining the medium type of the touch object according to the first elastic wave signal, and inquiring a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, wherein the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface; and after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to start the corresponding application function based on the application trigger information. By adopting the technical means, the triggering and opening of the application function corresponding to the home page interface can be realized through the rapid detection and matching of the elastic wave signal of the touch object, the opening operation flow of various application functions of the home page interface is simplified, the operation efficiency of the application function starting control is improved, and the operation experience of a user is optimized.
On the basis of the above embodiments, a specific implementation manner of the system home interface interactive operation method based on elastic waves in the embodiments of the present application is provided. The mapping relation comprises a first mapping relation and a second mapping relation, the first mapping relation comprises the application triggering information of a theme or an input channel corresponding to the home page interface, and the second mapping relation comprises the application triggering information corresponding to the application program icon. It can be understood that different mapping relationships are constructed corresponding to the media types of one touch object, so that the touch object can touch different icons of the home page interface to trigger different application functions. The application triggering information of the application function is bound with the media type and the gesture characteristics of the touch object made of the corresponding material, so that the application function is triggered when the touch object touches the corresponding icon. To implement the triggering of multiple application functions, media types and gesture features of multiple touch objects need to be used to construct a mapping relationship with the application triggering message binding thereof. The first mapping relation and the second mapping relation are constructed by corresponding to the same medium type and gesture characteristics of one touch object, so that the using number of the touch objects can be reduced, and the triggering operation of the application function is more convenient.
Based on the first mapping relation and the second mapping relation which are constructed in advance, when different icons on the display screen are touched by using one touch object, different application functions are triggered according to different touched icons of the first touch operation.
Specifically, querying a pre-stored mapping relationship according to the gesture feature of the first touch operation and the media type includes:
determining that the icon touched by the first touch operation is a return icon of a home interface or a setting icon of an input channel;
and querying the first mapping relation based on the gesture characteristics of the first touch operation and the media type, and determining application trigger information of a theme or an input channel corresponding to the home page interface.
In the embodiment of the application, the application function corresponding to the theme and the input channel is triggered by constructing the first mapping relation in advance. When the infrared touch frame detects that the touch position of the first touch operation falls within the detection range of the return icon or the setting icon of the input channel of the home page interface, determining that the touch object of the current first touch operation is the return icon or the setting icon of the input channel of the home page interface. And comparing the pre-stored mapping relation according to the gesture characteristics of the touch operation and the media type, if the matched mapping relation is determined to exist, correspondingly extracting application trigger information of the mapping relation, and triggering the application function of the corresponding theme or the input channel of the home page interface by using the application trigger information.
After determining the application trigger information of the theme or the input channel corresponding to the home page interface, the interactive tablet responds to the first touch operation and sets the theme or the input channel of the current system based on the corresponding application trigger information. It is understood that an application trigger includes a system theme or setup information of an input channel. Therefore, when a certain system theme or an input channel needs to be set, only the touch object corresponding to the medium type needs to be used for executing corresponding touch operation, the interactive flat plate can determine corresponding application trigger information through gesture characteristics and medium type detection, and then personalized setting of the system theme or the input channel is carried out through touch operation response.
On the other hand, the querying a pre-stored mapping relationship according to the gesture feature of the first touch operation and the media type further includes:
determining that the icon touched by the first touch operation is an application icon of a home interface;
and querying the second mapping relation based on the gesture features of the first touch operation and the media type, and determining application trigger information of an application shortcut menu, application starting, application deleting or application upgrading corresponding to the application program icon.
In the embodiment of the application, corresponding to application function triggering such as application shortcut menu, application opening, application deletion or application upgrading, the triggering is performed by constructing the second mapping relationship in advance. When the infrared touch frame detects that the touch position of the first touch operation falls within the detection range of the application icon corresponding to the home interface, it is determined that the touch object of the current first touch operation is the application icon corresponding to the home interface. And comparing the pre-stored mapping relation according to the gesture characteristics of the touch operation and the media type, if the matched mapping relation is determined to exist, correspondingly extracting application trigger information of the mapping relation, and triggering application functions of an application shortcut menu, application starting, application deleting or application upgrading and the like of an application program corresponding to the home page interface by using the application trigger information.
After determining application trigger information of an application shortcut menu, application opening, application deletion or application upgrading corresponding to the application program icon, the interactive tablet responds to the first touch operation, displays the corresponding application shortcut menu based on the corresponding application trigger information, or triggers the deletion, opening or upgrading operation of the corresponding application program. It can be understood that an application trigger information includes setting information of an application function, such as an application shortcut menu, application opening, application deletion, or application upgrade. Therefore, when a certain application function of the application program needs to be triggered, only the touch object corresponding to the media type needs to be used for executing corresponding touch operation, the interactive panel can determine corresponding application trigger information through gesture characteristics and media type detection, and then application functions such as application shortcut menus, application starting, application deleting or application upgrading are executed through touch operation response.
Illustratively, referring to fig. 4, an initial display diagram of a home interface of the system according to the embodiment of the present application is provided. As shown in fig. 4, the home interface of the interactive tablet is used with the title "breeze" and the input channel "PC". When the theme or the input channel is set, the corresponding icon is touched by matching the designated touch object with the corresponding gesture feature, so that the setting of the theme or the input channel is triggered.
For example, as shown in fig. 5, a stylus is used as a touch object, an elastic wave signal of a touch operation generated by the stylus 12 touching the display screen 11 is predetermined, and the elastic wave signal is set as a medium type characteristic. And further acquiring touch operation of clicking a home interface return button by a touch object, and determining the gesture characteristics of the touch operation. And binding the media silent type characteristics and the gesture characteristics with the application triggering information of the 'silent' theme to construct a first mapping relation. When the user clicks the home interface return button displayed on the display screen 11 of the interactive tablet by using the stylus pen 12, at this time, the interactive tablet detects and matches the elastic wave signal of the touch operation by detecting the touch operation of the stylus pen 12 based on the above steps S110 to S130, and further responds to the touch operation, and determines the application trigger information of the "silent" theme based on the pre-stored first mapping relationship. As shown in fig. 6, the application trigger message is used to switch the "fresh air" theme used by the current system to a "silent" theme, and when the system returns to the top page interface, the system synchronously switches the theme, thereby completing the application function trigger operation of the "silent" theme setting. Similarly, different system theme applications can be triggered through different touch objects and corresponding gesture characteristics by binding the media types of the touch objects made of different materials and the application trigger information of the specified gesture characteristics with different themes.
In addition, in an embodiment, the media type and the designated gesture feature of the stylus pen 12 may also be directly bound with the application trigger information of "theme switching" to construct a first mapping relationship, and when a subsequent user clicks a home interface return button displayed on the display screen 11 through the stylus pen 12, the interactive tablet responds to the touch operation, and triggers a theme switching function using the application trigger information of "theme switching" based on the first mapping relationship, so as to implement theme switching of the system.
On the other hand, as shown in fig. 7, with the stylus as the touch object, the elastic wave signal of the touch operation generated by the stylus 12 touching the display screen 11 is predetermined, and this elastic wave signal is set as the medium type characteristic. And further acquiring touch operation of the touch object pressing the application program icon for a long time, and determining the gesture characteristics of the touch operation. And binding the media type characteristics, the gesture characteristics and the application trigger information of application deletion to construct a second mapping relation. When the user touches the application icon of the home interface displayed on the display screen 11 of the interactive tablet with the stylus 12, the interactive tablet detects and matches the elastic wave signal of the touch operation based on the above steps S110 to S130 by detecting the touch operation of the stylus 12, and further responds to the touch operation, determines application trigger information of "application deletion" based on a pre-stored second mapping relationship, and uses the application trigger information to delete the application function corresponding to the application icon selected by the user currently, thereby completing the trigger operation of the application deletion function.
Also, as shown in fig. 8, the medium type characteristic is set by previously setting the elastic wave signal of the stylus pen 12. And further acquiring touch operation of double-clicking the application program icon by the touch object, and determining the gesture characteristics of the touch operation. And binding the media type characteristics and the gesture characteristics with application trigger information of 'application shortcut menu display' to construct a second mapping relation. When a user touches an application icon of a home page interface displayed on the display screen 11 of the interactive tablet with the stylus pen 12, the interactive tablet detects and matches an elastic wave signal of the touch operation based on the steps S110 to S130 by detecting the touch operation of the stylus pen 12, and then responds to the touch operation, determines application trigger information of "application shortcut menu display" based on a pre-stored second mapping relationship, and triggers the application shortcut menu display of the application icon currently selected by the user with the application trigger information, thereby completing the trigger operation of the application shortcut menu display function. In addition, the interactive tablet can also realize one-key triggering of various application functions such as application program opening, application program upgrading and the like on the home interface through the finger pulp and finger joints matching with the gesture characteristics of touch operation such as single click, double click, long press and the like.
As shown in fig. 9, with the finger 13 as a touch object, an elastic wave signal of touch operation generated by the finger 13 touching a channel setting icon on the display screen 11 is predetermined, and this elastic wave signal is set as a medium type feature. And further acquiring touch operation of clicking the channel setting icon by the touch object, and determining the gesture characteristics of the touch operation. And binding the media type characteristics and the gesture characteristics with application trigger information of 'input channel setting' to construct a first mapping relation. When a user touches an "input channel" icon displayed on the display screen 11 of the interactive tablet with the finger 13 (i.e., the channel is set with the icon), at this time, the interactive tablet detects the touch operation of the finger 13, detects and matches the elastic wave signal of the touch operation based on the above steps S110 to S130, and further responds to the touch operation, determines the application trigger information of the "input channel setting" based on the pre-stored first mapping relationship, and uses the application trigger information to switch the "PC" input channel used by the current system to the "HDMI" input channel, thereby completing the application function trigger operation of the "HDMI" input channel setting, and achieving the interactive operation effect of different touch objects triggering different input channel settings. It can be understood that the one-key triggering of various application functions can be realized by using various touch objects made of different materials and binding various application triggering information by using the media types and the designated gesture characteristics to construct a mapping relation.
According to the method, the mapping relation is established by binding the application trigger information such as the home page theme setting information, the input channel setting information, the application program starting information, the application program deleting information and the application shortcut menu starting information through the elastic wave signal and the gesture characteristics of the touch object, so that the triggering of the application functions such as theme setting, input channel setting, application deleting, starting and application shortcut menu displaying can be realized through one-time triggering operation of the touch object, the triggering operation of the application functions is simplified to a great extent, the application function operating efficiency of the theme, the input channel and the application program is improved, and the operation experience of a user is further optimized.
On the basis of the foregoing embodiments, an embodiment of the present application further provides a specific implementation manner of mapping relationship binding storage, where, referring to fig. 10, a binding flow chart of a mapping relationship is provided, where the mapping relationship stores gesture features, media types, and corresponding application trigger information, and the method includes:
s1101, receiving corresponding interactive operation, and displaying a setting interface corresponding to the mapping relation;
s1102, detecting corresponding gesture features and media types based on touch operation of the touch object, and binding the corresponding application trigger information with the detected gesture features and media types to construct a mapping relation.
Specifically, when the interactive flat panel builds the mapping relationship in advance, the mapping relationship setting interface is called out through related human-computer interaction operation. Specifically, when the mapping relationship setting interface is called out, the user enters the mapping relationship setting list by clicking the mapping relationship setting icon. The mapping relation setting list displays the mapping relation corresponding to each application function. And according to the mapping relation required to be set, the user selects and clicks a corresponding option from the mapping relation setting list to enter a setting interface of the mapping relation. And then, acquiring the media type characteristics and the corresponding gesture characteristics through the touch object touch display screen, binding the media type characteristics and the corresponding gesture characteristics with corresponding application trigger information, and completing construction of a mapping relation.
Illustratively, as shown in fig. 11, when binding of application trigger information is performed, a setting interface of mapping relationships is called through relevant interaction operations. At this time, the user touches the display screen 11 with the stylus 12, the interactive tablet detects and collects the elastic wave signal of the stylus 12, the elastic wave signal is used as a medium type feature, and the medium type feature is bound with the detected gesture feature and corresponding application trigger information, so that the construction of the mapping relation is completed.
Further, after the mapping relationship is constructed by binding the corresponding application trigger information and the media type characteristic, the method further includes:
receiving a second touch operation on the setting interface, detecting gesture features and media types corresponding to the second touch operation, and binding the detected gesture features and media types with the corresponding application trigger information to reestablish the mapping relation.
Illustratively, referring to fig. 12, when the user needs to correspondingly replace the touch object bound by the application trigger information, the binding interface is called out through an interactive operation, and the replacement tool 13 is further used for touching the display screen 11 to reacquire the media type feature and the gesture feature. As shown in fig. 12, the elastic wave signal of the replacement tool 13 is re-collected as the medium type feature and is bound to the corresponding gesture feature and application trigger information, so as to complete the change of the mapping relationship.
By the aid of the mapping relation construction and the adaptive modification, a user can use various touch objects conveniently, and trigger corresponding application functions based on the recognition and matching of the elastic waves, operation processes triggered by the application functions are reduced, the mapping relation is customized, construction and modification are achieved, a more convenient and rapid operation mode is provided, and accordingly work efficiency and operation experience of the user are improved.
On the basis of the embodiment, corresponding to the starting, deleting and shortcut menu display functions of one application program, operation triggering can be carried out through different gesture characteristics of one touch object. For example, the media type characteristic and the single-click gesture characteristic of the touch object are bound with the application trigger information of 'application open' to construct a second mapping relation. Then the opening function of the corresponding application program can be triggered by clicking the application program icon through the touch object; and binding the medium type characteristics and the long-press gesture characteristics of the touch object with application trigger information of 'application deletion' to construct a second mapping relation. Then the long-time pressing of the application icon through the touch object can trigger the deleting function of the corresponding application program; and binding the medium type characteristic and the double-click gesture characteristic of the touch object with the application trigger information of the application shortcut menu display to construct a second mapping relation. Then, the shortcut menu display function of the corresponding application program can be triggered by double-clicking the application program icon through the touch object. Based on the plurality of mapping relationships bound in advance, different application functions can be triggered through different touch operations of one touch object. In the above, different mapping relationships are established by binding the same media type feature, different gesture features and different application trigger information, so that one touch object can integrate one key trigger function of multiple application functions, the trigger operation efficiency of the application functions is further improved, and the operation experience of a user is improved.
Example two:
on the basis of the above embodiments, fig. 13 is a schematic structural diagram of a system home interface interactive operation device based on elastic waves according to a second embodiment of the present application. Referring to fig. 13, the elastic wave based system home page interface interactive operation device provided in this embodiment is used for an interactive tablet, where the interactive tablet includes a display screen and an infrared touch frame, the infrared touch frame is disposed on a frame of the display screen, the interactive tablet further includes an elastic wave detection device, and the elastic wave based system home page interface interactive operation device specifically includes: a detection module 21, a query module 22 and a response module 23.
The detection module 21 is configured to detect, through the infrared touch frame, a first touch operation of a touch object on the display screen corresponding to an icon; detecting a first elastic wave signal through the elastic wave detection device, wherein the first elastic wave signal is generated when the touch object contacts the display screen when the touch object performs the first touch operation;
the query module 22 is configured to determine a medium type of the touch object according to the first elastic wave signal, and query a pre-stored mapping relationship according to the gesture feature of the first touch operation and the medium type, where the mapping relationship stores the gesture feature, the medium type, and corresponding application trigger information, and the application trigger information is used to trigger starting of an application function corresponding to a home interface;
the response module 23 is configured to, after determining the corresponding application trigger information, respond to the first touch operation, and control to open the corresponding application function based on the application trigger information.
On the basis of the above embodiment, the mapping relationship includes a first mapping relationship and a second mapping relationship, where the first mapping relationship includes the application trigger information of the theme or the input channel corresponding to the home interface, and the second mapping relationship includes the application trigger information corresponding to the application icon.
On the basis of the above embodiment, the query module 22 includes: the method comprises the following steps:
determining that the icon touched by the first touch operation is a return icon of a home interface or a setting icon of an input channel;
and querying the first mapping relation based on the gesture characteristics of the first touch operation and the media type, and determining application trigger information of a theme or an input channel corresponding to the home page interface.
Correspondingly, after the corresponding application trigger information is determined, in response to the first touch operation, controlling to open the corresponding application function based on the application trigger information, including:
and after determining the application trigger information of the theme or the input channel corresponding to the home page interface, responding to the first touch operation, and setting the theme or the input channel of the current system based on the corresponding application trigger information.
On the basis of the above embodiment, the query module 22 further includes:
determining that the icon touched by the first touch operation is an application icon of a home interface;
and querying the second mapping relation based on the gesture features of the first touch operation and the media type, and determining application trigger information of an application shortcut menu, application starting, application deleting or application upgrading corresponding to the application program icon.
Correspondingly, after determining the corresponding application trigger information, responding to the first touch operation, and controlling to open the corresponding application function based on the application trigger information, further comprising:
and after determining application trigger information of an application shortcut menu, application opening, application deletion or application upgrading corresponding to the application program icon, responding to the first touch operation, and displaying a corresponding application shortcut menu or triggering deletion, opening or upgrading operation of a corresponding application program based on the corresponding application trigger information.
On the basis of the above embodiment, the query module 22 further includes:
the receiving unit is used for receiving corresponding interactive operation and displaying a setting interface corresponding to the mapping relation;
and the construction unit is used for detecting corresponding gesture characteristics and media types based on touch operation of the touch object and binding the corresponding application trigger information with the detected gesture characteristics and media types to construct a mapping relation.
And the rebuilding unit is used for receiving a second touch operation on the setting interface, detecting the gesture characteristics and the media types corresponding to the second touch operation, and binding the detected gesture characteristics and the media types with the corresponding application trigger information to rebuild the mapping relation.
Detecting a first touch operation of a touch object on the display screen corresponding to the icon through the infrared touch frame; detecting a first elastic wave signal through an elastic wave detection device, wherein the first elastic wave signal is generated when a touch object performs a first touch operation and the touch object contacts a display screen; determining the medium type of the touch object according to the first elastic wave signal, and inquiring a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, wherein the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface; and after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to start the corresponding application function based on the application trigger information. By adopting the technical means, the triggering and opening of the application function corresponding to the home page interface can be realized through the rapid detection and matching of the elastic wave signal of the touch object, the opening operation flow of various application functions of the home page interface is simplified, the operation efficiency of the application function starting control is improved, and the operation experience of a user is optimized.
In addition, the embodiment of the application enables a user to trigger an application function by using various touch objects through binding and custom modification of the mapping relation, meets the touch operation requirements of the user under different conditions, and further optimizes the operation experience of the user.
The elastic wave-based system home interface interactive operation device provided by the second embodiment of the application can be used for executing the elastic wave-based system home interface interactive operation method provided by the first embodiment, and has corresponding functions and beneficial effects.
Example three:
an embodiment of the present application provides an interactive tablet, and referring to fig. 14, the interactive tablet includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors 31 in the interactive tablet may be one or more, and the number of memories 32 in the interactive tablet may be one or more. The processor 31, memory 32, communication module 33, input device 34, and output device 35 of the interactive tablet may be connected by a bus or other means.
The memory 32 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the elastic wave-based system home interface interoperation method according to any embodiment of the present application (for example, a detection module, an inquiry module, and a response module in an elastic wave-based system home interface interoperation device). The memory 32 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory 32 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 32 may further include memory located remotely from the processor, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, implements the above-mentioned elastic wave-based system home interface interactive operation method.
The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.
The interactive flat panel provided by the embodiment can be used for executing the interactive operation method of the system home interface based on the elastic wave provided by the embodiment, and has corresponding functions and beneficial effects.
Example four:
the embodiment of the present application further provides a storage medium containing computer-executable instructions, where the computer-executable instructions, when executed by a computer processor, are configured to perform a method for interactive operation of a home interface of a system based on elastic waves, where the method is used for an interactive tablet, where the interactive tablet includes a display screen and an infrared touch frame, the infrared touch frame is disposed on a border of the display screen, the interactive tablet further includes an elastic wave detection apparatus, and the method includes: the infrared touch frame detects a first touch operation of a touch object on a display screen corresponding to an icon; the elastic wave detection device detects a first elastic wave signal, and the first elastic wave signal is generated when the touch object contacts the display screen when the touch object performs the first touch operation; determining the medium type of the touch object according to the first elastic wave signal, and inquiring a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, wherein the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface; and after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to open the corresponding application function based on the application trigger information.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Of course, the storage medium provided in the embodiments of the present application contains computer-executable instructions, and the computer-executable instructions are not limited to the method for interactive operation of the system home interface based on elastic waves as described above, and may also perform related operations in the method for interactive operation of the system home interface based on elastic waves as provided in any embodiments of the present application.
The elastic wave based system home interface interaction operation device, the storage medium, and the interaction tablet provided in the above embodiments may execute the elastic wave based system home interface interaction operation method provided in any embodiment of the present application, and reference may be made to the elastic wave based system home interface interaction operation method provided in any embodiment of the present application without detailed technical details described in the above embodiments.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (10)
1. The utility model provides a system home page interface interactive operation method based on elastic wave, is used for the mutual dull and stereotyped, the mutual dull and stereotyped includes display screen and infrared touch frame, infrared touch frame sets up in the frame of display screen, its characterized in that, the mutual dull and stereotyped still includes elastic wave detection device, the method includes:
the infrared touch frame detects a first touch operation of a touch object on a display screen corresponding to an icon;
the elastic wave detection device detects a first elastic wave signal, and the first elastic wave signal is generated when the touch object contacts the display screen when the touch object performs the first touch operation;
determining the medium type of the touch object according to the first elastic wave signal, and inquiring a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, wherein the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface;
and after the corresponding application trigger information is determined, responding to the first touch operation, and controlling to start the corresponding application function based on the application trigger information.
2. The elastic wave-based system home page interface interaction operation method according to claim 1, wherein the mapping relationship includes a first mapping relationship and a second mapping relationship, the first mapping relationship includes the application trigger information of a subject or an input channel corresponding to the home page interface, and the second mapping relationship includes the application trigger information corresponding to an application icon.
3. The elastic wave-based system home interface interaction operation method according to claim 2, wherein the querying the pre-stored mapping relationship according to the gesture feature of the first touch operation and the media type comprises:
determining that the icon touched by the first touch operation is a return icon of a home interface or a setting icon of an input channel;
and querying the first mapping relation based on the gesture characteristics of the first touch operation and the media type, and determining application trigger information of a theme or an input channel corresponding to the home page interface.
4. The elastic wave-based system home interface interaction operation method according to claim 3, wherein after determining the corresponding application trigger information, in response to the first touch operation, controlling to open the corresponding application function based on the application trigger information, and including:
and after determining the application trigger information of the theme or the input channel corresponding to the home page interface, responding to the first touch operation, and setting the theme or the input channel of the current system based on the corresponding application trigger information.
5. The elastic wave-based system home interface interaction operation method according to claim 2, wherein the querying the pre-stored mapping relationship according to the gesture feature of the first touch operation and the media type further comprises:
determining that the icon touched by the first touch operation is an application icon of a home interface;
and querying the second mapping relation based on the gesture features of the first touch operation and the media type, and determining application trigger information of an application shortcut menu, application starting, application deleting or application upgrading corresponding to the application program icon.
6. The elastic wave-based system home interface interaction operation method according to claim 5, wherein after the corresponding application trigger information is determined, in response to the first touch operation, the corresponding application function is controlled to be started based on the application trigger information, and further comprising:
and after determining application trigger information of an application shortcut menu, application opening, application deletion or application upgrading corresponding to the application program icon, responding to the first touch operation, and displaying a corresponding application shortcut menu or triggering deletion, opening or upgrading operation of a corresponding application program based on the corresponding application trigger information.
7. The elastic wave-based system home interface interaction operation method according to claim 1, wherein the mapping relation stores gesture features, media types and corresponding application trigger information, and comprises:
receiving corresponding interactive operation, and displaying a setting interface corresponding to the mapping relation;
and detecting corresponding gesture features and media types based on touch operation of the touch object, and binding the corresponding application trigger information with the detected gesture features and media types to construct a mapping relation.
8. The elastic wave based system home interface interaction operation method according to claim 7, further comprising, after the mapping relationship is established by binding the corresponding application trigger information with the detected gesture features and the media types:
receiving a second touch operation on the setting interface, detecting gesture features and media types corresponding to the second touch operation, and binding the detected gesture features and media types with the corresponding application trigger information to reestablish the mapping relation.
9. The utility model provides a system home page interface interactive operation device based on elastic wave for it is mutual dull and stereotyped, it includes display screen and infrared touch frame to interact dull and stereotyped, infrared touch frame set up in the frame of display screen, its characterized in that, it still includes elastic wave detection device to interact dull and stereotyped, system home page interface interactive operation device based on elastic wave includes:
the detection module is used for detecting a first touch operation of a touch object on the display screen corresponding to the icon through the infrared touch frame; detecting a first elastic wave signal through the elastic wave detection device, wherein the first elastic wave signal is generated when the touch object contacts the display screen when the touch object performs the first touch operation;
the query module is used for determining the medium type of the touch object according to the first elastic wave signal and querying a pre-stored mapping relation according to the gesture feature of the first touch operation and the medium type, the mapping relation stores the gesture feature, the medium type and corresponding application trigger information, and the application trigger information is used for triggering and starting an application function corresponding to a home page interface;
and the response module is used for responding to the first touch operation after the corresponding application trigger information is determined, and controlling to start the corresponding application function based on the application trigger information.
10. An interactive tablet, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the elastic wave-based system home interface interoperation method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110435281.3A CN114690976A (en) | 2021-04-22 | 2021-04-22 | System home page interface interactive operation method and device based on elastic waves |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110435281.3A CN114690976A (en) | 2021-04-22 | 2021-04-22 | System home page interface interactive operation method and device based on elastic waves |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114690976A true CN114690976A (en) | 2022-07-01 |
Family
ID=82135374
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110435281.3A Pending CN114690976A (en) | 2021-04-22 | 2021-04-22 | System home page interface interactive operation method and device based on elastic waves |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114690976A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298462A (en) * | 2011-05-31 | 2011-12-28 | 汉王科技股份有限公司 | Electronic device based on vibration induction and control method thereof |
| CN103677402A (en) * | 2012-09-19 | 2014-03-26 | 柯尼卡美能达株式会社 | Image processing apparatus, operation standardization method, and operation standardization program |
| CN104915136A (en) * | 2014-03-14 | 2015-09-16 | Lg电子株式会社 | Mobile terminal and method of controlling the same |
| US20160162178A1 (en) * | 2014-12-04 | 2016-06-09 | Konica Minolta, Inc. | Handwriting input device, non-transitory recording medium storing computer readable contact body determination program, and contact body determination method |
| CN105824553A (en) * | 2015-08-31 | 2016-08-03 | 维沃移动通信有限公司 | Touch method and mobile terminal |
| CN107291277A (en) * | 2017-08-14 | 2017-10-24 | 广州视源电子科技股份有限公司 | A kind of method of false-touch prevention, device, equipment and storage medium |
| CN110119208A (en) * | 2019-05-15 | 2019-08-13 | 京东方科技集团股份有限公司 | Suspend display imaging device and the display touch control method that suspends |
| CN110413188A (en) * | 2018-04-28 | 2019-11-05 | 北京钛方科技有限责任公司 | Smart machine control method and device |
| CN112558852A (en) * | 2019-09-26 | 2021-03-26 | 北京钛方科技有限责任公司 | Control method and system for vehicle-mounted device, vehicle, electronic device and storage medium |
-
2021
- 2021-04-22 CN CN202110435281.3A patent/CN114690976A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298462A (en) * | 2011-05-31 | 2011-12-28 | 汉王科技股份有限公司 | Electronic device based on vibration induction and control method thereof |
| CN103677402A (en) * | 2012-09-19 | 2014-03-26 | 柯尼卡美能达株式会社 | Image processing apparatus, operation standardization method, and operation standardization program |
| CN104915136A (en) * | 2014-03-14 | 2015-09-16 | Lg电子株式会社 | Mobile terminal and method of controlling the same |
| US20160162178A1 (en) * | 2014-12-04 | 2016-06-09 | Konica Minolta, Inc. | Handwriting input device, non-transitory recording medium storing computer readable contact body determination program, and contact body determination method |
| CN105824553A (en) * | 2015-08-31 | 2016-08-03 | 维沃移动通信有限公司 | Touch method and mobile terminal |
| CN107291277A (en) * | 2017-08-14 | 2017-10-24 | 广州视源电子科技股份有限公司 | A kind of method of false-touch prevention, device, equipment and storage medium |
| CN110413188A (en) * | 2018-04-28 | 2019-11-05 | 北京钛方科技有限责任公司 | Smart machine control method and device |
| CN110119208A (en) * | 2019-05-15 | 2019-08-13 | 京东方科技集团股份有限公司 | Suspend display imaging device and the display touch control method that suspends |
| CN112558852A (en) * | 2019-09-26 | 2021-03-26 | 北京钛方科技有限责任公司 | Control method and system for vehicle-mounted device, vehicle, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8289292B2 (en) | Electronic device with touch input function and touch input method thereof | |
| US20190033994A1 (en) | Method of executing functions of a terminal including pen recognition panel and terminal supporting the method | |
| CN107608558B (en) | Mobile terminal having touch screen and method for providing user interface in mobile terminal | |
| CN103513927B (en) | Selectively refuse the touch contact in the fringe region of touch-surface | |
| US20120026105A1 (en) | Electronic device and method thereof for transmitting data | |
| CN103210366A (en) | Apparatus and method for proximity based input | |
| JP2004062658A (en) | Coordinate input device, control method for the same, and program | |
| US10564740B2 (en) | Pen device—panel interaction based on electromagnetic signals output by the pen device | |
| CN101980117A (en) | Touch control method and device | |
| CN106415472A (en) | Gesture control method, device, terminal apparatus and storage medium | |
| CN113791700A (en) | Elastic wave-based interaction method and device, interaction panel and storage medium | |
| CN107463290A (en) | Response control mehtod, device, storage medium and the mobile terminal of touch operation | |
| CN111475098A (en) | Windowing operation method and device for intelligent interactive large screen | |
| CN110442264A (en) | A kind of touch data processing method, device, equipment and storage medium | |
| CN114690930A (en) | Handwriting processing method and device, interactive panel and storage medium | |
| CN114690853B (en) | Interaction method and interaction panel | |
| US20210221228A1 (en) | A user interface for vehicles | |
| CN110531905B (en) | Icon control method and terminal | |
| CN114690976A (en) | System home page interface interactive operation method and device based on elastic waves | |
| CN113608662A (en) | Touch response method and device, terminal equipment and storage medium | |
| CN114690933A (en) | Virtual pen application control method and device, interactive panel and storage medium | |
| CN111093030B (en) | Equipment control method and electronic equipment | |
| CN113805725B (en) | Display control method and device for interactive panel | |
| EP3547091A1 (en) | Floating touch control sensing method, floating touch control sensing system and floating touch control electronic device | |
| CN113805725A (en) | Display control method and device for interactive panel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |