WO2019119995A1 - 触摸信号的处理方法、装置、及电子设备和存储介质 - Google Patents

触摸信号的处理方法、装置、及电子设备和存储介质 Download PDF

Info

Publication number
WO2019119995A1
WO2019119995A1 PCT/CN2018/114055 CN2018114055W WO2019119995A1 WO 2019119995 A1 WO2019119995 A1 WO 2019119995A1 CN 2018114055 W CN2018114055 W CN 2018114055W WO 2019119995 A1 WO2019119995 A1 WO 2019119995A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
protocol
application
electromagnetic
touch signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/114055
Other languages
English (en)
French (fr)
Inventor
邱伟波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shirui Electronics Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Publication of WO2019119995A1 publication Critical patent/WO2019119995A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/046Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger

Definitions

  • the present invention relates to the field of electromagnetic touch technology, and in particular, to a method and device for processing a touch signal, and an electronic device and a storage medium.
  • the screen of many electronic devices can be composed of a display screen and an electromagnetic touch screen.
  • the electromagnetic touch screen can be composed of an electromagnetic board and a touch board. It is necessary to sense the electromagnetic signal emitted by the electromagnetic pen to perform information interaction. When the electromagnetic pen contacts the electronic device.
  • the screen can sense the frequency of the electromagnetic signal emitted by the electromagnetic pen and the change of its own magnetic flux.
  • the touch panel can obtain the touch signal triggered by the electromagnetic pen through the change of the magnetic flux and the frequency of the electromagnetic signal, and the touch signal can include the pressure. Sensing signal and touch position signal.
  • the "pressure sensor" inside the electromagnetic pen feels different pressures, and the frequency of the electromagnetic signal emitted according to the induced pressure is different, and the resulting pressure sensitive signal is different, and finally The thickness of the lines presented on the screen will also be different.
  • the electromagnetic touch screen generally only supports the operation of a single electromagnetic pen.
  • many application scenarios require two or more electromagnetic pens to be simultaneously operated on the screen of the electronic device, such as in the teaching field.
  • the present invention provides a method and an apparatus for processing a touch signal, and an electronic device and a storage medium to solve the problem that the related art only supports the operation of a single electromagnetic pen.
  • a touch signal processing system includes a host device and an electromagnetic screen device, wherein the electromagnetic screen device is equipped with an electromagnetic touch system, and the host device is equipped with an operating system.
  • the operating system includes an application detection code and a touch driver;
  • the application detection code is used to:
  • the determined signal transmission protocol is a multi-touch protocol
  • triggering a multi-point encapsulation event to notify the electromagnetic touch system to perform data encapsulation according to the multi-touch protocol
  • the electromagnetic touch system is used to:
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to the multi-touch protocol, and the encapsulated touch signal is sent to the operating system;
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to the standard protocol, and the encapsulated touch signal is sent to the operating system;
  • the touch driver is configured to parse the touch signal to trigger a response operation of the touch signal.
  • a host device equipped with an operating system, the operating system including an application detection code and a touch driver;
  • the application detection code is used to:
  • the determined signal transmission protocol is a multi-touch protocol
  • triggering a multi-point encapsulation event to notify the electromagnetic touch system to perform data encapsulation according to the multi-touch protocol
  • the touch driving is used to parse a touch signal sent by the electromagnetic touch system to trigger a response operation of the touch signal.
  • an electromagnetic screen device which is equipped with an electromagnetic touch system
  • the electromagnetic touch system is used to:
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to the multi-touch protocol, wherein the multi-point encapsulation event is detected by the operating system to the currently accessed application, and is determined to be applicable to the The signal transmission protocol of the application is triggered when the multi-touch protocol is used;
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to a standard protocol supporting single electromagnetic pen input;
  • a method for processing a touch signal comprising the steps of:
  • the multi-point encapsulation event is triggered to notify the electromagnetic screen device side to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol.
  • the method is applied to an operating system, the method further comprising the steps of:
  • the encapsulated touch signal is received and parsed to trigger a response operation of the touch signal.
  • the determining a touch signal transmission protocol corresponding to the application includes:
  • the signal transmission protocol applicable to the application is the standard protocol.
  • the electromagnetic screen device side is notified to perform data encapsulation on the electromagnetic pen triggered touch signal according to the standard protocol.
  • the application corresponding to the multi-touch protocol includes a text editing application and/or an image editing application.
  • the text editing application includes an application for a whiteboard application.
  • a method for processing a touch signal comprising the steps of:
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to the multi-touch protocol, wherein the multi-point encapsulation event is detected by the host device side to the currently accessed application, and is determined to be applicable to The signal transmission protocol of the application is triggered when the multi-touch protocol is used;
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to a standard protocol supporting single electromagnetic pen input;
  • a packaged touch signal is sent to the operating system to cause the operating system to respond to the touch signal.
  • the data packet is encapsulated by the electromagnetic pen triggered touch signal according to the multi-touch protocol, including:
  • All the encoded touch signals are packaged into a package of the same data packet, and a coded touch signal triggered by an electromagnetic pen in the data packet corresponds to a touch point.
  • the sending the encapsulated touch signal to the operating system comprises:
  • the encapsulated touch signal is sent to a USB port corresponding to the multi-touch descriptor, and the encapsulated touch signal is uploaded to the operating system by the USB port.
  • a device for processing a touch signal includes:
  • An application detection module for detecting an application currently accessed
  • a protocol determining module for determining a signal transmission protocol applicable to the application
  • the event triggering module is configured to trigger a multi-point encapsulation event when the determined signaling protocol is a multi-touch protocol, to notify the electromagnetic screen device side to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol.
  • a device for processing a touch signal includes:
  • the multi-point encapsulation module is configured to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol when the multi-point encapsulation event is detected, where the multi-point encapsulation event is detected by the host device side to be currently accessed.
  • An application and determining that the signal transmission protocol applicable to the application is triggered by a multi-touch protocol;
  • the single-package module is configured to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to a standard protocol supporting single electromagnetic pen input when no multi-point encapsulation event is detected;
  • a signal sending module configured to send the encapsulated touch signal to the operating system, so that the operating system responds to the touch signal.
  • an electronic device which is equipped with an operating system, a processor, and a memory for storing the processor-executable instructions; wherein the processor is configured to perform the above The operation in the processing method of the touch signal.
  • an electronic device equipped with an electromagnetic touch screen, a processor, and a memory for storing the processor executable instructions; wherein the processor is configured to execute The operation in the processing method of the touch signal as described above.
  • the electronic device comprises a smart tablet.
  • the smart tablet includes an electronic whiteboard.
  • one or more machine-readable storage medium having stored thereon instructions for causing a terminal device to perform a touch signal processing method as described above when executed by one or more processors Operation.
  • one or more machine-readable storage medium having stored thereon instructions for causing a terminal device to perform a touch signal processing method as described above when executed by one or more processors The operation in .
  • the host device may first detect the currently accessed application, and determine a signal transmission protocol applicable to the detected application, in a signal suitable for the application.
  • the transmission protocol is a standard protocol supporting single electromagnetic pen input
  • the electromagnetic screen device can be notified to perform data encapsulation and transmission on the touch signal triggered by the electromagnetic pen according to the standard protocol, so that the operating system carried by the host device triggers on each electromagnetic pen.
  • the touch signals are all responsive, and thus embodiments of the present invention are capable of supporting at least two electromagnetic pens to simultaneously operate the screen of the electronic device.
  • the embodiment of the present invention encapsulates the time-multi-touch protocol used by the touch signals triggered by the at least two electromagnetic pens, and the operating system uses the native touch driver to parse the touch signals without adding a proprietary protocol. Therefore, the embodiment of the present invention The solution is easy to be compatible with various operating systems.
  • FIG. 1A is a block diagram of a processing system for a touch signal according to an exemplary embodiment of the present invention
  • FIG. 1B is a flowchart of a method for processing a touch signal according to an exemplary embodiment of the present invention
  • 1C is a flowchart of a method of processing a touch signal according to another exemplary embodiment of the present invention.
  • FIG. 2A is an architectural diagram of a system for implementing processing of a touch signal, according to another exemplary embodiment of the present invention.
  • 2B-2D are application scenario diagrams of an electronic device according to an exemplary embodiment of the present invention.
  • FIG. 3 is a block diagram of a processing apparatus for a touch signal according to an exemplary embodiment of the present invention
  • FIG. 4 is a block diagram of a processing apparatus for a touch signal according to another exemplary embodiment of the present invention.
  • FIG. 5 is a hardware structural diagram of an electronic device according to an exemplary embodiment of the present invention.
  • first, second, third, etc. may be used to describe various information in the present invention, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
  • first information may also be referred to as the second information without departing from the scope of the invention.
  • second information may also be referred to as the first information.
  • word "if” as used herein may be interpreted as "when” or “when” or “in response to a determination.”
  • the operating system of the electromagnetic screen device docking only supports single electromagnetic pen writing, such as window system, Android system, etc. If there are more than two electromagnetic pens on the screen corresponding to the electromagnetic screen device, the cursor point will be two The writing position of the electromagnetic pen is switched back and forth, and the situation of "grabbing coordinates" appears.
  • the related technology generally uses a custom proprietary protocol to package and transmit and analyze the touch data triggered by two or more electromagnetic pens, but the specific application that can be packaged and parsed can only be customized by the party that customizes the proprietary protocol. It is difficult for a third-party application to parse and recognize the touch data of the package, and the operating system needs to develop a related proprietary protocol to analyze and recognize the touch data, which results in poor compatibility of the related technology and is difficult to be promoted and applied.
  • the embodiment of the present invention proposes a method for processing touch data, which detects the currently accessed application by Determining a signal transmission protocol applicable to the application; when the determined signal transmission protocol is a multi-touch protocol, triggering a multi-point encapsulation event to notify the electromagnetic panel device side to trigger the electromagnetic pen according to the multi-touch protocol
  • the touch signal performs data encapsulation, so that the electromagnetic touch system performs data encapsulation on the touch signal triggered by the electromagnetic pen according to the standard protocol.
  • the solution of the present invention can switch between the multi-touch protocol and the standard protocol supporting the electromagnetic pen input by determining the signal transmission protocol applicable to the currently accessed application, and the two protocols are different.
  • the protocols are not proprietary protocols. Both the operating system and the third-party applications can analyze and identify the touch data through these two protocols, without developing a proprietary protocol. Therefore, while supporting the writing of multiple electromagnetic pens, the compatibility is also good.
  • the system for carrying out the method of the present invention and the implementation of the method of the present invention are described below in conjunction with the embodiments.
  • FIG. 1A is a block diagram of a processing system 100 for a touch signal according to an exemplary embodiment of the present invention.
  • the processing system 100 may include a magnetic screen device 120 and a host device 140.
  • An electromagnetic touch system 121 is mounted in the electromagnetic screen device 120;
  • an operating system 141 is mounted in the host device 140, and the operating system 141 includes an application detection code 1411 and a touch drive 1412.
  • the host device 140 may refer to a part of the device for implementing a touch response in the host or the host of the electronic device.
  • the electromagnetic screen device 120 may refer to an electromagnetic touch input device that is independent of the electronic device, and may also refer to An electromagnetic touch input device mounted on various electronic devices, such as a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, a smart writing device , an email transceiver, a game console, a tablet, a wearable device, a smart locomotive, a driverless car, a smart refrigerator, other smart home devices, or a combination of any of these devices.
  • the smart writing device can be an electronic whiteboard, an electronic blackboard, or the like.
  • the above electronic device can be installed with various applications required by the user, such as a text editing application, an image editing application, a social application, an e-commerce application, a search application, and a browser application.
  • a text editing application such as a text editing application, an image editing application, a social application, an e-commerce application, a search application, and a browser application.
  • text-editing applications such as whiteboard applications.
  • a situation may occur in which multiple electromagnetic pens are simultaneously operated on a screen corresponding to the electronic device, and the solution of the present invention may be based on electronic in advance in order to support simultaneous operation of multiple electromagnetic pens under the condition.
  • the various application scenarios of the device determine whether the application installed in the electronic device has the requirement of supporting simultaneous operation of multiple electromagnetic pens, and mark the application with the requirement.
  • the applicable signal transmission protocol is defined as a multi-touch protocol, and the signal transmission protocol applicable to other applications without the requirement is defined as a standard protocol supporting single electromagnetic pen input.
  • the host device 140 can detect the current through the application detection code 1411 included in the operating system 141 during the actual operation of the host device 140.
  • the accessed application, and determining a signal transmission protocol applicable to the application, triggering a multi-point encapsulation event to notify the electromagnetic touch system 121 to follow the multi-touch when the determined signaling protocol is a multi-touch protocol The protocol encapsulates the touch signal.
  • the triggered multi-point encapsulation event can be preset by the designer or user of the solution according to actual scenario requirements. In some examples, it may be set that when detecting that the signal transmission protocol applicable to the currently accessed application is a multi-touch protocol, the triggered multi-point encapsulation event is to send a multi-point encapsulation notification.
  • the multi-point encapsulation event triggered is: no multi-package notification is sent, and the detection is applicable.
  • the signal transmission protocol of the currently accessed application in order to support the standard protocol of the single electromagnetic pen input, sends a single package notification, and the electromagnetic touch system 121 follows a standard co-package protocol supporting single electromagnetic pen input.
  • the multi-point encapsulation event triggered when the signal transmission protocol applicable to the currently accessed application is detected as a multi-touch protocol is: sending a multi-point encapsulation notification, A single packet encapsulation notification is sent when a signal transmission protocol suitable for the currently accessed application is detected, in order to support a standard protocol for single electromagnetic pen input.
  • the electromagnetic screen device 120 that is connected to the host device 140 is equipped with an electromagnetic touch system 121.
  • the touch screen corresponding to the electromagnetic touch system 121 is an electromagnetic touch screen, and may also include an electromagnetic board as a touch sensor.
  • the signal may include a change amount of the magnetic flux and a frequency of the received electromagnetic signal, and the converted touch signal may include a touch position signal corresponding to the magnetic flux change amount, a pressure sensitive signal corresponding to the frequency, and the touch position signal may include
  • the touch sense signal may include a pressure value by touching the X coordinate and the Y coordinate of the position.
  • the touch signal triggered by the electromagnetic pen may be data-encapsulated according to the multi-touch protocol; when the multi-point encapsulation event is not detected, the single electromagnetic pen is supported according to the support.
  • the input standard protocol performs data encapsulation on the touch signal triggered by the electromagnetic pen; after the touch signal is packaged, the packaged touch signal can be sent to the operating system 141.
  • the operating system 141 may send the received touch signal to the touch driver 1412 included therein, and the touch signal is parsed by the touch driver 1412 to trigger the response operation of the touch signal.
  • the touch driver 1412 may send the parsed touch signal to an input subsystem (input_device) in the operating system 141, for example, parsing according to a corresponding protocol during parsing, and parsing the touch signal of the multi-touch protocol package.
  • the touch signal is analyzed according to the analysis protocol corresponding to the multi-touch protocol.
  • the touch signal is analyzed according to the analysis protocol corresponding to the standard protocol.
  • the input subsystem can be composed of a device driver layer, an input core layer and an event processing layer.
  • the device driver layer can convert the underlying hardware input into a unified event form, report to the input core layer, and input the core layer can be turned on and off as hardware.
  • the device registration and operation interface of the driver layer input informs the event processing layer to process the event.
  • FIG. 1B is a flowchart of a method for processing a touch signal according to an exemplary embodiment of the present invention.
  • the embodiment is applied to the host device side, and may include the following steps S101-S103:
  • Step S101 Detect the currently accessed application.
  • Step S102 Determine a signal transmission protocol applicable to the application.
  • Step S103 When the determined signal transmission protocol is a multi-touch protocol, trigger a multi-point encapsulation event to notify the electromagnetic screen device side to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol.
  • the method of the present invention can be applied to the operating system of the host device, and the corresponding program code is loaded into the code included in the operating system.
  • the method in this embodiment can also be applied to the same side of the host device or the host device.
  • the corresponding program code is made into a separate APP and is installed in the associated device of the host device or the host device, which is not limited in this embodiment of the present invention.
  • the host device mentioned here corresponding to the host device mentioned in the embodiment related to FIG. 1A, may be used for implementing a touch response in a host or a host of various electronic devices mentioned in the embodiment related to FIG. 1A. Part of the device.
  • the solution is to support the simultaneous operation of the plurality of electromagnetic pens, and the application program installed in the electronic device may be determined based on various application scenarios of the electronic device in advance. Supports the simultaneous operation of multiple electromagnetic pens, marking applications that have this requirement.
  • an application whitelist may be established, and the application whitelist may include an application identifier of an application that needs to support simultaneous operation of multiple electromagnetic pens; or an application that needs to support simultaneous operation of multiple electromagnetic pens may correspond to a multi-touch protocol.
  • the protocol identifier is stored, and the protocol identifier herein can be set by the designer of the present invention according to actual needs; and some display attributes of the application that need to support multiple electromagnetic pens simultaneously can be changed, such as the application icon displayed in the interface is marked red. In other embodiments, the marking may be performed in other manners, which is not limited in the embodiment of the present invention.
  • the applicable signal transmission protocol can be defined as a USB protocol that supports simultaneous operation of multiple electromagnetic pens, and the signal transmission protocol applicable to other applications without the requirement is defined as supporting a single electromagnetic pen.
  • a customized USB protocol can be adopted, and the USB protocol can encapsulate the touch signals triggered by the electromagnetic pens into the package of the same data packet, and then report to the operating system.
  • this custom USB protocol is not a native description protocol for operating systems such as Window and Android. It is difficult for the operating system to automatically parse the encapsulated data packets. It is necessary to add a resolution protocol corresponding to the customized USB protocol. Therefore, this support is provided.
  • the limitation of the multi-electromagnetic pen simultaneous operation scheme is generally only applicable to the application developed by the developer itself, and is difficult to be compatible with the application developed by the third party.
  • the designers of the present invention adopt a multi-touch protocol (Multitouch Digitizer) of operating systems such as Window and Android, and designate them as signal transmission protocols suitable for tagged applications. Therefore, the electromagnetic touch system on the electromagnetic screen device side performs data encapsulation on the touch signal triggered by the multi-electromagnetic pen according to the multi-touch protocol. After receiving the encapsulated touch signal, the operating system can resolve it by itself without adding a custom USB protocol.
  • Multitouch Digitizer Multitouch Digitizer
  • an application suitable for the multi-touch protocol may be a text editing application and/or an image editing application.
  • the text editing application includes an application for a whiteboard application.
  • an application that does not need to support multi-electromagnetic pen simultaneous operation in the current scene may be deleted from an application suitable for the multi-touch protocol.
  • the function of simultaneously operating multiple electromagnetic pens can be provided, and the current or the periodic detection can be detected after the application in the host device starts running.
  • the application accessed, and the currently accessed application can refer to the uppermost application in the foreground application stack, and can also refer to the application where the cursor is currently located. Other detection methods in the field can be taken during detection, and the implementation of the present invention This example does not limit this.
  • the currently accessed application it can be determined according to the mark of each application in advance. If it is a pre-marked application that needs to support simultaneous operation of multiple electromagnetic pens, determine whether the applicable signal transmission protocol of the application is a multi-touch protocol or The above standard agreement.
  • the pre-generated application whitelist can be retrieved to determine whether there is an application identifier of the detected application in the application whitelist, and if not, it is determined to be applicable to the application.
  • the signal transmission protocol is the standard protocol, such as the Pen Digitizer, which may refer to a USB protocol that supports single electromagnetic pen input.
  • the touch signal obtained by the electromagnetic touch system in the electromagnetic screen device may include at least two touch signals triggered by the electromagnetic pen, which is convenient for the embodiment of the present invention.
  • the electromagnetic screen device side encapsulates the touch signal according to the multi-touch protocol, and can trigger a multi-point encapsulation event, which can be pre-agreed by the host device side and the electromagnetic screen device side to indicate the currently accessed application.
  • the applicable signal transmission protocol is a multi-touch protocol, which can notify the electromagnetic screen device side to perform data encapsulation on the touch signal according to the multi-touch protocol.
  • the multi-touch notification can be sent, and the notification can include the protocol name of the multi-touch protocol. Or other characters that identify multi-touch protocols.
  • the multi-point encapsulation event triggered is: no multi-package notification is sent, and the detection is applicable.
  • the signal transmission protocol of the currently accessed application is a standard protocol that supports single electromagnetic pen input, and then sends a single package notification to notify the electromagnetic device side of the standard co-package protocol supporting the single electromagnetic pen input.
  • the single-package notification may be pre-scheduled by the host device side and the electromagnetic screen device side, and the signal transmission protocol used to indicate that the currently accessed application is applicable is a multi-touch protocol, for example, a protocol name that may include a multi-touch protocol. , or other characters that identify multi-touch protocols.
  • the multi-point encapsulation event triggered when the signal transmission protocol applicable to the currently accessed application is detected as a multi-touch protocol is: sending a multi-point encapsulation notification, when the detection is applicable
  • the signal transmission protocol of the currently accessed application when it is a standard protocol that supports single electromagnetic pen input, sends a single package notification.
  • the encapsulated touch signal may also be received and parsed to trigger a response operation of the touch signal.
  • the parsed touch signal can be sent to the input subsystem of the operating system after parsing.
  • FIG. 1C is a flowchart of a method for processing a touch signal according to another exemplary embodiment of the present invention.
  • the embodiment is applied to the electromagnetic screen device side, and may include the following steps S105-S107:
  • Step S105 when detecting a multi-point encapsulation event, performing data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol, wherein the multi-point encapsulation event is detected by the host device side, and the currently accessed application is detected, and Triggered when it is determined that the signal transmission protocol applicable to the application is a multi-touch protocol.
  • Step S106 When the multi-point encapsulation event is not detected, the touch signal triggered by the electromagnetic pen is data-encapsulated according to a standard protocol supporting single electromagnetic pen input.
  • Step S107 Send a packaged touch signal to the operating system, so that the operating system responds to the touch signal.
  • the method implemented by the present invention can be applied to an electromagnetic touch system mounted on an electromagnetic screen device, and the corresponding program code is loaded into the code included in the electromagnetic touch system, and the method of the embodiment can also be separately applied to the electromagnetic screen device or In the related device on the same side of the electromagnetic screen device, the corresponding program code is made into a separate APP, which is installed in the associated device of the electromagnetic screen device or the electromagnetic screen device, which is not limited in the embodiment of the present invention.
  • the electromagnetic screen device mentioned here corresponds to the electromagnetic screen device mentioned in the embodiment of FIG. 1A, and details are not described herein again.
  • the multi-point encapsulation event, the multi-touch protocol, the standard protocol, and the like according to the embodiment of the present invention are corresponding to the technical content of FIG. 1A and/or FIG. 1B, and details are not described herein again.
  • the multi-point encapsulation notification is not received or the single-point encapsulation notification is received (as described above), it is determined that the multi-point encapsulation event is not detected, and then the signal transmission is currently applied.
  • the protocol is the standard protocol.
  • USB protocol mentioned in the embodiment of FIG. 1B if data encapsulation is performed, no matter how many electromagnetic pen-triggered touch signals are detected, all the touch signals detected each time are taken as The touch signal triggered by the single electromagnetic pen performs data encapsulation, and the touch signal can be mapped into the package body of the USB protocol when encapsulating.
  • the touch signal can be mapped to the body of the USB protocol in the format in Table 1 below (corresponding to the descriptor of the hid pen):
  • the obtained touch signal may include at least two electromagnetic pen triggers.
  • the touch signal, the touch signal triggered by each electromagnetic pen refers to the bare data before the protocol package, and may include the bit pressure sense signal and the touch position signal.
  • the pressure sensitive signal may be the pressure value of the electromagnetic pen on the screen.
  • the touch position signal may include an X, Y coordinate of the position at which the electromagnetic pen contacts the screen.
  • the touch signals triggered by the electromagnetic pen can be data-encapsulated, and all the touch signals triggered by the electromagnetic pen can be mapped to the multi-touch protocol during packaging.
  • the same packet is in the body of the package.
  • the touch signal triggered by each electromagnetic pen may be first encoded according to the multi-touch protocol. And satisfying the data in the format specified by the multi-touch protocol, and then packaging all the encoded touch signals into a package of the same data packet, wherein the encoded touch signal triggered by an electromagnetic pen in the data packet corresponds to a touch point.
  • the touch signal can be mapped to the body of the multi-touch protocol in the format of Table 2 below (corresponding to the hid multi-touch descriptor):
  • the touch signal triggered by the first electromagnetic pen is encoded as data corresponding to the first point of the multi-touch, including status, ID, X, Y, and Pressure information, corresponding byte numbers 1 to 8;
  • the touch signal of the pen is encoded as the data corresponding to the second point of the multi-touch, including the status ID, X, Y, Pressure information, corresponding byte numbers 9 to 16; the byte number 17 indicates that there are several in the current data packet. Touch the point (several pens).
  • the touch signals triggered by the respective electromagnetic pens may be data-encapsulated according to a multi-touch protocol, and all the electromagnetic pen-triggered touch signals may be mapped to the package of the same data packet of the multi-touch protocol during packaging.
  • the embodiment of the present application may further package the package by using other methods, and may implement compatibility by using an operating system native description protocol to support simultaneous operation of multiple electromagnetic pens, or adopt other methods. The embodiment does not limit this.
  • the encapsulated touch signal can be sent to the operating system, such as sending the encapsulated touch signal to the USB port corresponding to the multi-touch descriptor, and the packaged touch signal is uploaded to the operating system by the USB port.
  • the packaged touch signal can be transmitted to the operating system through a protocol interface (HID-compiant pen) compatible with the single electromagnetic pen included in the drive interface.
  • a protocol interface HID-compiant pen
  • the packaged touch signal can be transmitted to the operating system through a USB port (HID-compiant touch sceen) corresponding to the multi-touch descriptor included in the drive interface, and the USB port is compatible.
  • USB port HID-compiant touch sceen
  • the operating system may parse the touch signal by using a corresponding protocol, parse out the touch signal triggered by the electromagnetic pen, and then convert it into a corresponding input event, such as a touch event, a pressure event, a button event. And then, an operation corresponding to the input event is performed.
  • a corresponding input event such as a touch event, a pressure event, a button event.
  • an operation corresponding to the input event is performed.
  • the electromagnetic screen device can be controlled to display the writing content triggered by each electromagnetic pen.
  • the system 200 can include an electromagnetic screen device and a host device.
  • the host device is equipped with an operating system 240
  • the electromagnetic screen device is equipped with an electromagnetic touch system 220.
  • the electromagnetic touch system 220 can include an electromagnetic board 221 and a touch main board 222 connected to each other.
  • the system 200 can further include a driving interface 230 connected to the touch main board 222, an operating system 240 docked with the driving interface 230, and an operating system 240.
  • the docked memory 250 wherein the operating system 240 includes an application detection code 241 and a touch driver 240, in which a pre-generated application whitelist is stored.
  • the application detection code 241 can detect the currently accessed application in real time, and after detecting, can obtain the pre-generated application whitelist from the memory 250, from the received
  • the application identifier of the application is searched in the application whitelist, and if the detected application identifier of the application is in the application whitelist, it is determined that the signal transmission protocol applicable to the application is a multi-touch protocol, and the drive interface 230 is
  • the electromagnetic screen device sends a multi-point package notification to notify the touch main board 222 to package the touch signals triggered by the electromagnetic pens sensed by the electromagnetic plates 221 according to the multi-touch protocol, and then pass the packaged touch signals through the drive interface 230.
  • the image is transmitted to the operating system 240, and the touch driver 242 parses the touch signal according to the multi-touch protocol, and controls the electromagnetic screen device to display the corresponding content according to the analyzed touch signal.
  • the system 200 shown in FIG. 2A is applied to an electronic whiteboard, which can be installed in a classroom podium.
  • the teacher may select multiple students to answer questions, as shown in Figure 2B, the student Wang and the student Zhang. The two students need to write the idiom “in peace” according to the teacher’s request.
  • the electromagnetic board 221 can detect the touch signal triggered by each electromagnetic pen, and the touch main board 222 can package the detected touch signal according to the multi-touch protocol, and through the driving interface.
  • the USB port included in the 230 is uploaded to the operating system 24. After the operating system 240 parses the touch signal, the control electronic whiteboard displays the corresponding written content.
  • the operating system 240 controls the electronic whiteboard to display the written content of the student Wang as "flat", and displays the inside of the student Zhang as "heart-to-heart".
  • the teacher found that the student Zhang was wrong in writing.
  • the teacher can annotate the writing content of the student Zhang through the electromagnetic pen he holds. For example, the typo "written by" written by the student Zhang is crossed.
  • the electromagnetic board 221 can detect To the touch signal triggered by each electromagnetic pen, the touch main board 222 can package the detected touch signal according to the multi-touch protocol, and upload it to the operating system 240 through the USB port included in the drive interface 230, and the operating system 240 parses the touch signal. Thereafter, the control electronic whiteboard displays the corresponding written content as shown in FIG. 2D.
  • the invention also provides an embodiment of the device.
  • FIG. 3 is a block diagram of a processing apparatus for a touch signal according to an exemplary embodiment of the present invention.
  • the apparatus may include an application detection module 310, a protocol determination module 320, and an event triggering module 330.
  • the application detection module 310 is configured to detect an application that is currently accessed.
  • the protocol determination module 320 is configured to determine a signal transmission protocol applicable to the application.
  • the event triggering module 330 is configured to trigger a multi-point encapsulation event when the determined signaling protocol is a multi-touch protocol, to notify the electromagnetic screen device side to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol. .
  • the processing device of the touch signal of the embodiment of the present invention is applied to an operating system, and may further include:
  • a parsing module configured to receive the encapsulated touch signal and parse to trigger a response operation of the touch signal.
  • the application detection module 310 can also be used to:
  • the signal transmission protocol applicable to the application is the standard protocol.
  • the touch signal when the signal transmission protocol determined by the application detection module 310 is the multi-touch protocol, the touch signal includes at least two electromagnetic pen-triggered touch signals.
  • the touch signal processing apparatus of the embodiment of the present invention may further include:
  • the single notification module is configured to notify the electromagnetic screen device side to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the standard protocol when the determined signaling protocol is a standard protocol supporting single electromagnetic pen input.
  • the application corresponding to the multi-touch protocol includes a text editing application and/or an image editing application.
  • the text editing application includes an application for a whiteboard application.
  • FIG. 4 is a block diagram of a processing apparatus for a touch signal according to another exemplary embodiment of the present invention.
  • the apparatus may include a multi-point package module 410, a single-package module 420, and a signal transmission module 430.
  • the multi-point encapsulation module 410 is configured to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol when the multi-point encapsulation event is detected, where the multi-point encapsulation event is detected by the host device side.
  • the application is accessed and is determined to be triggered when the signal transmission protocol for the application is a multi-touch protocol.
  • the single-package module 420 is configured to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to a standard protocol supporting single electromagnetic pen input when no multi-point encapsulation event is detected.
  • the signal sending module 430 is configured to send the encapsulated touch signal to the operating system, so that the operating system responds to the touch signal.
  • the multi-point encapsulation module 410 can also be used to:
  • the touch signals triggered by the electromagnetic pens are compiled into the same data packet, and within the data packet, a touch signal triggered by an electromagnetic pen acts as a touch signal of a point.
  • the signaling module 430 can also be used to:
  • the encapsulated touch signal is sent to a USB port corresponding to the multi-touch descriptor, and the encapsulated touch signal is uploaded to the operating system by the USB port.
  • the application corresponding to the multi-touch protocol includes a text editing application and/or an image editing application.
  • the text editing application includes an application for a whiteboard application.
  • the device embodiment since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment.
  • the device embodiments described above are merely illustrative, wherein the units or modules described as separate components may or may not be physically separate, and the components displayed as units or modules may or may not be physical units. Or modules, which can be located in one place, or distributed to multiple network units or modules. Some or all of the modules may be selected according to actual needs to achieve the objectives of the present invention. Those of ordinary skill in the art can understand and implement without any creative effort.
  • Embodiments of the touch signal processing apparatus of the present invention can be applied to an electronic device.
  • This can be implemented by a computer chip or an entity, or by a product having a certain function.
  • the specific form of the electronic device may be a personal computer with an electromagnetic touch screen, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, a smart writing device.
  • the smart writing device can be an electronic whiteboard, an electronic blackboard, or the like.
  • the device embodiment may be implemented by software, or may be implemented by hardware or a combination of hardware and software.
  • a processor of the electronic device in which it is located reads a corresponding computer program instruction in a readable medium such as a non-volatile memory into a memory.
  • a hardware level as shown in FIG. 5, is a hardware structure diagram of an electronic device in which the processing device for the touch signal of the present invention is located, except for the processor, the memory, the network interface, and the non-volatile memory shown in FIG. 5.
  • the electronic device in which the device is located in the embodiment is generally based on the actual function of the electronic device, such as an electromagnetic touch screen, and may include other hardware, and details are not described herein.
  • the memory of the electronic device can store program instructions executable by the processor; the processor can couple the memory.
  • the processor is configured to read the program instructions stored by the memory and, in response, perform the following operations:
  • the multi-point encapsulation event is triggered to notify the electromagnetic screen device side to perform data encapsulation on the touch signal triggered by the electromagnetic pen according to the multi-touch protocol.
  • the operations performed by the processor may also refer to the related description in the method embodiment mentioned in the embodiment of FIG. 1B above, and details are not described herein.
  • a processor is operative to read program instructions stored in the memory and, in response, perform the following operations:
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to the multi-touch protocol, wherein the multi-point encapsulation event is detected by the host device side to the currently accessed application, and is determined to be applicable to The signal transmission protocol of the application is triggered when the multi-touch protocol is used;
  • the touch signal triggered by the electromagnetic pen is data-encapsulated according to a standard protocol supporting single electromagnetic pen input;
  • a packaged touch signal is sent to the operating system to cause the operating system to respond to the touch signal.
  • the operations performed by the processor may also refer to the related description in the method embodiments mentioned in the foregoing embodiment of FIG. 1C, and details are not described herein.
  • the operations performed by the processor may refer to the related description in the foregoing processing method of the touch signal, and details are not described herein.
  • an embodiment of the present invention further provides a machine readable storage medium (memory of an electronic device), wherein the readable storage medium stores program instructions, where the program instructions include the implementations of FIG. 1B and/or FIG. 1C above.
  • the instructions corresponding to the steps of the processing method of the touch signal mentioned in the example.
  • the terminal device When executed by one or more processors, the terminal device is caused to perform the processing method of the touch signal mentioned in the embodiment of FIG. 1B and/or FIG. 1C above.
  • Embodiments of the invention may take the form of a computer program product embodied on one or more readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) in which program code is embodied.
  • Computer-readable readable storage media include both permanent and non-persistent, removable and non-removable media, and information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • machine readable storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only Memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage
  • PRAM phase change memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • RAM random access memory
  • ROM read only Memory
  • EEPROM electrically erasable programmable read only memory
  • flash memory or other memory technology
  • CD-ROM compact disc
  • DVD digital versatile disc

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种触摸信号的处理方法、装置及电子设备和存储介质,所述方法包括:检测当前被访问的应用程序(S101);确定适用于所述应用程序的信号传输协议(S102);在所确定的信号传输协议为多点触摸协议时,触发多点封装事件(S103),以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。上述方法可以支持至少两支电磁笔同时对电磁式触摸屏进行操作。

Description

触摸信号的处理方法、装置、及电子设备和存储介质 技术领域
本发明涉及电磁式触控技术领域,尤其涉及触摸信号的处理方法、装置及电子设备和存储介质。
背景技术
很多电子设备的屏幕可以由显示屏和电磁式触摸屏构成,电磁式触摸屏可以由电磁板和触控主板组成,需要感应到电磁笔发射的电磁信号,才能进行信息交互,当电磁笔接触电子设备的屏幕时,电磁板能感应到电磁笔发射的电磁信号的频率以及自身的磁通量的变化,触控主板通过磁通量的变化和电磁信号的频率可以获得电磁笔触发的触摸信号,该触摸信号可以包括压感信号和触摸位置信号。
此外,用户对电磁笔(笔尖)施压不同时,电磁笔内部的“压力传感器”感受到压力不同,根据所感应的压力发出的电磁信号的频率不同,进而所得的压感信号不同,最终在屏幕上呈现的线条的粗细也会不同。
而电磁式触摸屏一般只支持单支电磁笔的操作,但是,随着电子设备的应用推广,很多应用场景会需要两支以上的电磁笔同时在电子设备的屏幕上操作,如应用在教学领域的电子平板,课堂互动教学时,可能有多个学生需要同时通过同一电子平板的屏幕答题,因此,支持两支以上的电磁笔同时在电子设备的屏幕上操作是亟待解决的问题。
发明内容
有鉴于此,本发明提供一种触摸信号的处理方法、装置及电子设备和存储介质,以解决相关技术只支持单支电磁笔操作的问题。
根据本发明的第一方面,提供一种触摸信号的处理系统,包括主机设 备和电磁屏设备,所述电磁屏设备内搭载有电磁触控系统,所述主机设备内搭载有操作系统,所述操作系统包括应用检测代码和触摸驱动;
所述应用检测代码用于:
检测当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议;
在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁触控系统按照多点触摸协议进行数据封装;
所述电磁触控系统用于:
在检测到多点封装事件时,按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装,并向所述操作系统发送封装后的触摸信号;
在未检测到多点封装事件时,按照所述标准协议对电磁笔触发的触摸信号进行数据封装,并向所述操作系统发送封装后的触摸信号;
所述触摸驱动用于对所述触摸信号进行解析,以触发所述触摸信号的响应操作。
根据本发明的第二方面,提供一种主机设备,搭载有操作系统,所述操作系统包括应用检测代码和触摸驱动;
所述应用检测代码用于:
检测当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议;
在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁触控系统按照多点触摸协议进行数据封装;
所述触摸驱动用于对所述电磁触控系统发送的触摸信号进行解析,以触发所述触摸信号的响应操作。
根据本发明的第三方面,提供一种电磁屏设备,搭载有电磁触控系统;
所述电磁触控系统用于:
在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由操作系统检测到当前被访问 的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发;
在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;
向所述操作系统发送封装后的触摸信号。
根据本发明的第四方面,提供一种触摸信号的处理方法,包括步骤:
检测当前被访问的应用程序;
确定适用于所述应用程序的信号传输协议;
在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。
在一个实施例中,所述方法应用于操作系统,所述方法还包括以下步骤:
接收封装后的触摸信号并解析,以便触发所述触摸信号的响应操作。
在一个实施例中,所述确定与所述应用程序对应的触摸信号传输协议,包括:
调取预生成的应用白名单;
判断检测到的应用程序的应用标识是否在所述应用白名单中;
如果是,则确定适用于所述应用程序的信号传输协议为多点触摸协议对应;
如果不是,则确定适用于所述应用程序的信号传输协议为所述标准协议。
在一个实施例中,在所确定的信号传输协议为支持单电磁笔输入的标准协议时,通知所述电磁屏设备侧按照所述标准协议对电磁笔触发的触摸信号进行数据封装。
在一个实施例中,所述多点触摸协议对应的应用程序包括文本编辑类应用程序和/或图像编辑类应用程序。
在一个实施例中,所述文本编辑类应用程序包括白板应用的应用程序。
根据本发明的第五方面,提供一种触摸信号的处理方法,包括步骤:
在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由主机设备侧检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发;
在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;
向所述操作系统发送封装后的触摸信号,以便所述操作系统响应所述触摸信号。
在一个实施例中,所述按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装,包括:
按照所述多点触摸协议,将每支电磁笔触发的触摸信号编码为满足所述多点触摸协议规定的格式的数据;
将编码后的所有触摸信号打包到同一个数据包的包体内,在该数据包内一支电磁笔触发的编码后的触摸信号对应一个触摸点。
在一个实施例中,所述向操作系统发送封装后的触摸信号,包括:
将封装后的触摸信号发送至多点触摸描述符对应的USB端口,由所述USB端口将封装后的触摸信号上传到所述操作系统。
根据本发明的第六方面,提供一种触摸信号的处理装置,包括:
应用检测模块,用于检测当前被访问的应用程序;
协议确定模块,用于确定适用于所述应用程序的信号传输协议;
事件触发模块,用于在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。
根据本发明的第七方面,提供一种触摸信号的处理装置,包括:
多点封装模块,用于在检测到多点封装事件时,按照多点触摸协议对 电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由主机设备侧检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发;
单笔封装模块,用于在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;
信号发送模块,用于向所述操作系统发送封装后的触摸信号,以便所述操作系统响应所述触摸信号。
根据本发明的第八方面,提供一种电子设备,所述电子设备搭载了操作系统、处理器以及用于存储所述处理器可执行指令的存储器;其中,所述处理器被配置为执行如上所述触摸信号的处理方法中的操作。
根据本发明的第九方面,提供一种电子设备,所述电子设备搭载了电磁式触摸屏、处理器以及用于存储所述处理器可执行指令的存储器;其中,所述处理器被配置为执行如上所述的触摸信号的处理方法中的操作。
在一个实施例中,所述电子设备包括智能手写板。
在一个实施例总,所述智能手写板包括电子白板。
根据本发明的第十方面,提供一个或多个机器可读存储介质,其上存储有指令,当由一个或多个处理器执行时,使得终端设备执行如上所述的触摸信号的处理方法中的操作。
根据本发明的第十一方面,提供一个或多个机器可读存储介质,其上存储有指令,当由一个或多个处理器执行时,使得终端设备执行如上所述的触摸信号的处理方法中的操作。
实施本发明提供的实施例,在电磁屏设备封装发送触摸信号前,主机设备可以先检测当前被访问的应用程序,并确定检测到的应用程序适用的信号传输协议,在适用于应用程序的信号传输协议为支持单电磁笔输入的标准协议时,即可通知电磁屏设备按照所述标准协议对电磁笔触发的触摸信号进行数据封装发送,以便主机设备搭载的操作系统对各支电磁笔触发的触摸信号均做出响应,因此,本发明的实施例能够支持至少两支电磁笔 同时对电子设备的屏幕进行操作。
此外,本发明实施例封装至少两支电磁笔触发的触摸信号采用的时多点触摸协议,操作系统采用原生的触摸驱动即可以解析出触摸信号,无需添加私有协议,因此,本发明实施例的方案便于与各类操作系统兼容。
附图说明
图1A是本发明一示例性实施例示出的触摸信号的处理系统的架构图;
图1B是本发明一示例性实施例示出的触摸信号的处理方法的流程图;
图1C是本发明另一示例性实施例示出的触摸信号的处理方法的流程图;
图2A是本发明另一示例性实施例示出的实现触摸信号的处理的系统的架构图;
图2B-图2D是本发明一示例性实施例示出的电子设备的应用场景图;
图3是本发明一示例性实施例示出的触摸信号的处理装置的框图;
图4是本发明另一示例性实施例示出的触摸信号的处理装置的框图;
图5是本发明一示例性实施例示出的电子设备的硬件结构图。
具体实施方式
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本发明的一些方面相一致的装置和方法的例子。
在本发明使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本发明。在本发明和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目 的任何或所有可能组合。
应当理解,尽管在本发明可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本发明范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。
实际应用中,电磁屏设备对接的操作系统只支持单电磁笔书写,如window系统、Android系统等,如果有两支以上的电磁笔在电磁屏设备对应的屏幕进行书写,光标点会在两支电磁笔的书写位置来回切换,出现“抢坐标”的状况。
要避免该状况出现,需要使操作系统支持两支以上的电磁笔在电磁屏设备对应的屏幕进行书写。相关技术一般是采用自定义的私有协议对两支以上的电磁笔触发的触摸数据进行封装传输和解析识别,但是能进行封装和解析的只能是自定义该私有协议的一方开发的特定应用,第三方应用难以对其封装的触摸数据进行解析识别,而且操作系统需要同时开发相关的私有协议才能解析识别触摸数据,这就导致该相关技术的兼容性差,难以得到推广应用。
为了在支持两支以上的电磁笔在电磁屏设备对应的屏幕进行书写的同时,提高兼容性,本发明的实施例提出了一种触摸数据的处理方法,该方法通过检测当前被访问的应用,确定适用于所述应用程序的信号传输协议;在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装,以便所述电磁触控系统按照所述标准协议对电磁笔触发的触摸信号进行数据封装。
综上可知,本发明的方案通过确定当前被访问的应用适用的信号传输协议,在被访问的应用不同时,可以在多点触摸协议和支持但电磁笔输入 的标准协议间切换,而且这两种协议均不是私有协议,无论是操作系统还是第三方应用均可以通过这两种协议对触摸数据进行解析识别,无需开发私有协议。因此,在支持多电磁笔书写的同时,兼容性也较好。以下结合实施例介绍下实现本发明的方法的系统以及本发明的方法的实现过程。
请参阅图1A,图1A是本发明一示例性实施例示出的触摸信号的处理系统100的架构图,该处理系统100可以包括电磁屏设备120以及主机设备140。电磁屏设备120内搭载有电磁触控系统121;主机设备140内搭载有操作系统141,操作系统141包括应用检测代码1411和触摸驱动1412。
本发明实施例中,主机设备140可以指电子设备的主机或主机中用于实现触摸响应的部分设备,电磁屏设备120可以指独立于电子设备之外的电磁式的触摸输入设备,也可以指装设在各种电子设备上的电磁式的触摸输入设备,这里的电子设备可以是膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、智能书写设备、电子邮件收发设备、游戏控制台、平板计算机、可穿戴设备、智能机车、无人驾驶汽车、智能冰箱、其他智能家居设备或者这些设备中的任意几种设备的组合。智能书写设备可以是电子白板、电子黑板等等。
上述电子设备内可以安装有用户所需的各种应用程序,如文本编辑类应用程序、图像编辑类应用程序、社交类应用程序、电商类应用程序、搜索类应用程序、浏览器类应用程序等等,文本编辑类应用程序如白板应用的应用程序。
在某些应用程序对应的应用场景,可能出现多支电磁笔同时在电子设备对应的屏幕上操作的状况,本发明的方案为了在该状况下支持多支电磁笔的同时操作,可以预先基于电子设备的各种应用场景,确定电子设备内安装的应用程序是否有支持多电磁笔同时操作的需求,将有该需求的应用程序进行标记。并将其适用的信号传输协议定为多点触摸协议,将其他没有该需求的应用程序适用的信号传输协议定为支持单电磁笔输入的标准协议。
对需要支持多电磁同时操作的应用程序标记,并确定好点设备内应用程序适用的信号传输协议后,主机设备140实际运行过程中,可以通过操作系统141所含的应用检测代码1411,检测当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议,在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁触控系统121按照多点触摸协议封装触摸信号。
所触发的多点封装事件可以由本方案的设计人员或者用户根据实际场景需求预先设定。一些例子中,可以设定,在检测到适用于当前被访问的应用程序的信号传输协议为多点触摸协议时,触发的多点封装事件为发送多点封装通知。
另一些例子中,还可以设定在检测到适用于当前被访问的应用程序的信号传输协议为多点触摸协议时,触发的多点封装事件是:不发送多点封装通知,在检测到适用于当前被访问的应用程序的信号传输协议,为支持单电磁笔输入的标准协议时,再发送单笔封装通知,电磁触控系统121按照支持单电磁笔输入的标准协封装协议。
在其他实施例中:还可以设定还可以设定在检测到适用于当前被访问的应用程序的信号传输协议为多点触摸协议时,触发的多点封装事件是:发送多点封装通知,在检测到适用于当前被访问的应用程序的信号传输协议,为支持单电磁笔输入的标准协议时,发送单笔封装通知。
而与主机设备140对接的电磁屏设备120,搭载有电磁触控系统121,该电磁触控系统121对应的触摸屏是电磁式触摸屏,还可以包括作为触摸传感器的电磁板,该电磁板采集的触感信号可以包括磁通量的变化量和接收的电磁信号的频率,转换所得的触摸信号可以包括与所述磁通变化量对应的触摸位置信号、与所述频率对应的压感信号,触摸位置信号可以包括触摸位置的X坐标和Y坐标,压感信号可以包括压力值。
电磁触控系统121获得上述触摸信号后,如果检测到多点封装事件,可以按照多点触摸协议对电磁笔触发的触摸信号进行数据封装;未检测到 多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;封装好触摸信号后,可以向操作系统141发送封装后的触摸信号。
操作系统141接收到封装后的触摸信号后,可以将接收的触摸信号发送到其所含的触摸驱动1412,由触摸驱动1412对所述触摸信号进行解析,以触发所述触摸信号的响应操作。
此外,为了响应触摸信号,触摸驱动1412可以将解析后的触摸信号发送至操作系统141中的输入子系统(input_device),例如:解析时按照相应协议解析,解析多点触摸协议封装的触摸信号时按照多点触摸协议对应的解析协议进行触摸信号的解析;解析所述标砖协议封装的触摸信号时,按照所述标准协议对应的解析协议进行触摸信号的解析。
该输入子系统可以由设备驱动层、输入核心层和事件处理层构成,其中,设备驱动层可以将底层的硬件输入转化为统一事件形式,向输入核心层汇报,输入核心层可以承上启下,为硬件的驱动层输入的设备注册与操作接口,通知事件处理层对事件进行处理。
以下结合附图1B和附图1C分别对主机设备侧和电磁屏设备侧执行的操作进行详细介绍:
请参阅图1B,图1B是本发明一示例性实施例示出的触摸信号的处理方法的流程图,该实施例应用于主机设备侧,可以包括以下步骤S101-S103:
步骤S101、检测当前被访问的应用程序。
步骤S102、确定适用于所述应用程序的信号传输协议。
步骤S103、在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。
本发明实施的方法可以应用于主机设备搭载的操作系统,将其对应的程序代码加载到操作系统所含的代码中,本实施例的方法也可以单独应用于主机设备或主机设备同侧的关联设备内,将其对应程序代码制成单独的 APP,装设于主机设备或主机设备的关联设备内,本发明实施例对此不做限制。这里提到的主机设备,与图1A所涉及的实施例中提到的主机设备相应,可以是图1A所涉及的实施例中提到的各种电子设备的主机或主机中用于实现触摸响应的部分设备。
这些电子设备内安装有用户所需的各种应用程序,如文本编辑类应用程序、图像编辑类应用程序、社交类应用程序、电商类应用程序、搜索类应用程序、浏览器类应用程序等等,文本编辑类应用程序如白板应用的应用程序。在某些应用程序对应的应用场景中,可能出现多个用户需要通过电磁笔同时操作电子设备的状况,例如:教学场景,讲台上安装有代替传统黑板的电子白板,老师教学时可能会挑选多个同学答题,并让多个同学同时在电子白板书写答案。
在上述多个用户需要通过电磁笔同时操作电子设备的状况下,本方案为支持多支电磁笔的同时操作,可以预先基于电子设备的各种应用场景,确定电子设备内安装的应用程序是否有支持多电磁笔同时操作的需求,将有该需求的应用程序进行标记。实际标记时,可以建立一个应用白名单,该应用白名单中可以包括需支持多电磁笔同时操作的应用程序的应用标识;也可以将需支持多电磁笔同时操作的应用程序对应多点触摸协议的协议标识进行存储,这里的协议标识可以由本发明的设计人员根据实际需求设定;还可以改变需支持多电磁笔同时操作的应用程序的一些显示属性,如将界面中显示的应用图标标红,在其他实施例中,还可以采取其他方式进行标记,本发明实施例对此不做限制。
针对标记的应用程序,为了满足其需求,可以将其适用的信号传输协议定为支持多电磁笔同时操作的USB协议,将其他没有该需求的应用程序适用的信号传输协议定为支持单电磁笔输入的标准协议。
其中,在确定支持多电磁笔同时操作的USB协议时,可以采用自定义的USB协议,该USB协议可以将各电磁笔触发的触摸信号封装到同一数据包的包体中,然后上报到操作系统,但是这种自定义的USB协议并非 Window、Android等操作系统原生的描述协议,操作系统难以自动解析封装后的数据包,需要添加与自定义的USB协议对应的解析协议,因此,这种支持多电磁笔同时操作的方案的局限性大,一般只能应用在开发方自己开发的应用程序中,难以与第三方开发的应用程序兼容。
考虑到与第三方开发的应用程序的兼容性,本发明的设计人员采用Window、Android等操作系统原生的多点触摸协议(Multitouch Digitizer),将其定为适用于标记的应用程序的信号传输协议,以便电磁屏设备侧的电磁触控系统按照多点触摸协议,对多电磁笔触发的触摸信号进行数据封装。操作系统在接收到封装的触摸信号后,便可以自行解析,无需添加自定义的USB协议。
在确定好标记的应用程序适用的信号传输协议为多点触摸协议后,本发明实施例针对不同的应用场景,可以根据用户需求,对适用于多点触摸协议的应用程序进行更新,例如:将某些应用场景中需要支持多电磁笔同时操作的应用程序,添加到适用于多点触摸协议的应用程序中。某些例子中,适用于多点触摸协议的应用程序可以是文本编辑类应用程序和/或图像编辑类应用程序。其中,文本编辑类应用程序包括白板应用的应用程序。在其他例子中,随着场景的改变,还可以将在当前场景不需要支持多电磁笔同时操作的应用程序,从适用于多点触摸协议的应用程序中删除。
确定好适用于多点触摸协议的应用程序后,为了及时适应多电磁笔同时操作场景,提供多电磁笔同时操作的功能,可以在主机设备内的应用程序开始运行后,定时或周期检测当前被访问的应用程序,而当前访问的应用程序可以指前台的应用程序栈中最上层的应用程序,也可以指光标当前所在的应用程序,检测时可以采取本领域的其他检测方式,本发明的实施例对此不做限制。
针对当前访问的应用程序,可以根据预先对各应用程序的标记进行确定,如果是预先标记的需要支持多电磁笔同时操作的应用程序,确定该应用程序适用的信号传输协议是多点触摸协议还是上述标准协议。
例如:通过应用白名单标记应用程序时,可以调取预生成的应用白名单,判断所述应用白名单中是否有检测到的应用程序的应用标识,如果没有,则确定适用于所述应用程序的信号传输协议为所述标准协议,所述标准协议如Pen Digitizer,可以指支持单电磁笔输入的USB协议。
在确定适用于所述应用程序的信号传输协议为多点触摸协议时,电磁屏设备内的电磁触控系统得到的触摸信号可能包括至少两支电磁笔触发的触摸信号,本发明实施例为便于电磁屏设备侧按照多点触摸协议对触摸信号进行封装,可以触发多点封装事件,该多点封装事件可以由主机设备侧与电磁屏设备侧预先约定好,用于表示当前被访问的应用程序适用的信号传输协议为多点触摸协议,可以通知电磁屏设备侧按照多点触摸协议对触摸信号进行数据封装,例如,可以发送多点触摸通知,该通知可以包括多点触摸协议的协议名称,或者其他标识多点触摸协议的字符。
另一些例子中,还可以设定在检测到适用于当前被访问的应用程序的信号传输协议为多点触摸协议时,触发的多点封装事件是:不发送多点封装通知,在检测到适用于当前被访问的应用程序的信号传输协议,为支持单电磁笔输入的标准协议时,再发送单笔封装通知,通知电磁屏设备侧按照支持单电磁笔输入的标准协封装协议。该单笔封装通知可以由主机设备侧与电磁屏设备侧预先预定好,用于表示当前被访问的应用程序适用的信号传输协议为多点触摸协议,例如,可以包括多点触摸协议的协议名称,或者其他标识多点触摸协议的字符。
另一些实施例中:还可以设定在检测到适用于当前被访问的应用程序的信号传输协议为多点触摸协议时,触发的多点封装事件是:发送多点封装通知,在检测到适用于当前被访问的应用程序的信号传输协议,为支持单电磁笔输入的标准协议时,发送单笔封装通知。
此外,本发明实施例的方法应用于操作系统时,还可以接收封装后的触摸信号并解析,以便触发所述触摸信号的响应操作。在解析后可以将解析的触摸信号发送到操作系统的输入子系统。
请参阅图1C,图1C是本发明另一示例性实施例示出的触摸信号的处理方法的流程图,该实施例应用于电磁屏设备侧,可以包括以下步骤S105-S107:
步骤S105、在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由主机设备侧检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发。
步骤S106、在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装。
步骤S107、向所述操作系统发送封装后的触摸信号,以便所述操作系统响应所述触摸信号。
本发明实施的方法可以应用于电磁屏设备搭载的电磁触控系统,将其对应的程序代码加载到电磁触控系统所含的代码中,本实施例的方法也可以单独应用于电磁屏设备或电磁屏设备同侧的关联设备内,将其对应程序代码制成单独的APP,装设于电磁屏设备或电磁屏设备的关联设备内,本发明实施例对此不做限制。这里提到的电磁屏设备,与图1A所涉及的实施例中提到的电磁屏设备相应,在此不再赘述。
此外,本发明实施例涉及的多点封装事件、多点触摸协议、标准协议等,与图1A和/或图1B涉及的技术内容相应,在此不再赘述。
实际应用中,在获得触摸信号后,如果未接收到多点封装通知或接收到单点封装通知(如上所述),则确定未检测到多点封装事件,那么适用于当前被访问的信号传输协议为所述标准协议,如图1B涉及的实施例提到的所述USB协议时,如果进行数据封装,无论检测到多少支电磁笔触发的触摸信号,每次将检测到的所有触摸信号作为单支电磁笔触发的触摸信号进行数据封装,封装时可以将触摸信号映射到所述USB协议的包体中。
某些例子中,可以按以下表1中的格式(对应于hid笔的描述符)将触摸信号映射到所述USB协议的包体中:
表1:
Figure PCTCN2018114055-appb-000001
此外,在获得触摸信号后,如果接收到多点封装通知或未接收到单点封装通知(如上所述),则确定检测到多点封装事件,获得的触摸信号可以包括至少两支电磁笔触发的触摸信号,每支电磁笔触发的触摸信号指按协议封装前的裸数据,可以包括位压感信号和触摸位置信号,某些例子中,压感信号可以是电磁笔对屏幕的压力值,触摸位置信号可以包括电磁笔接触屏幕的位置的X、Y坐标。
按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装时,可以将各支电磁笔触发的触摸信号进行数据封装,封装时可以将所有电磁笔触发的触摸信号映射到多点触摸协议的同一数据包的包体中。
某些例子中,将所有电磁笔触发的触摸信号映射到多点触摸协议的同一数据包的包体中时,可以按照所述多点触摸协议,先将每支电磁笔触发的触摸信号编码为满足所述多点触摸协议规定的格式的数据,然后将编码后的所有触摸信号打包到同一个数据包的包体内,在该数据包内一支电磁笔触发的编码后的触摸信号对应一个触摸点。
实际应用中,可以可以按以下表2中的格式(对应于hid多点触摸的 描述符)将触摸信号映射到多点触摸协议的包体中:
表2:
Figure PCTCN2018114055-appb-000002
如表2所示,第1支电磁笔触发的触摸信号编码为对应多点触摸第1个点的数据,包括状态、ID、X、Y、Pressure信息,对应字节号1至8;第2支笔的触摸信号编码为对应多点触摸的第2个点的数据,包括状态ID、X、Y、Pressure信息,对应字节号9至16;字节号17表明当前数据包里面有几个触摸点(几支笔)。
在其他例子中,还可以按照多点触摸协议,将各支电磁笔触发的触摸信号进行数据封装,封装时可以将所有电磁笔触发的触摸信号映射到多点触摸协议的同一数据包的包体中后,本申请实施例还可以采用其他方式对该包体进行打包,打包时可以采用操作系统原生的描述协议,来实现兼容,以支持多电磁笔的同时操作,或者采用其他方式,本发明实施例对此不做 限制。
封装后可以向操作系统发送封装后的触摸信号,如将封装后的触摸信号发送至多点触摸描述符对应的USB端口,由所述USB端口将封装后的触摸信号上传到所述操作系统。
对于按所述USB协议封装的触摸信号,可以通过通过驱动接口所含的兼容单电磁笔的协议接口(HID-compiant pen),向操作系统传输封装后的触摸信号。
对于按照多点触摸协议封装的触摸信号,可以通过驱动接口所含的多点触摸描述符对应的USB端口(HID-compiant touch sceen),向操作系统传输封装后的触摸信号,该USB端口可以兼容触摸屏的多点触摸协议。
所述操作系统接收到封装后的触摸信号后,可以采用对应的协议对触摸信号进行解析,解析出电磁笔触发的触摸信号,然后转换为相应的输入事件,如触摸事件、压力事件、按键事件等,然后做出与输入事件相应的操作,例如:所述应用程序为白板应用的应用程序时,电磁笔触发的触摸信号对应的输入事件一般为添加书写内容的事件,所述操作系统响应所述触摸信号后,可以控制电磁屏设备显示各电磁笔触发的书写内容。
以下结合附图2A至2D介绍一种实现触摸信号的处理的系统200,该系统200可以包括电磁屏设备和主机设备,主机设备搭载有操作系统240,电磁屏设备搭载有电磁触控系统220,电磁触控系统220可以包括相互连接的电磁板221与触控主板222,该系统200还可以包括与触控主板222连接的驱动接口230、与驱动接口230对接的操作系统240、与操作系统240对接的存储器250,其中,操作系240包括应用检测代码241和触摸驱动240,存储器250内存储有预生成的应用白名单。
当应用程序在装设有系统200的电子设备内运行后,应用检测代码241可以实时检测当前被访问的应用程序,检测到后,可以从存储器250中获取预生成的应用白名单,从接收的应用白名单中查找应用程序的应用标识,如果检测到的应用程序的应用标识在所述应用白名单中,则确定适用于该 应用程序的信号传输协议为多点触摸协议,通过驱动接口230向电磁屏设备发送多点封装通知,通知触控主板222按照多点触摸协议,对电磁板221感应到的各支电磁笔触发的触摸信号进行封装,然后通过驱动接口230的将封装后的触摸信号传送至操作系统240,由触摸驱动242按照多点触摸协议解析出触摸信号,按照解析出的触摸信号控制电磁屏设备显示对应的内容。
某些场景下,如果多个用户同时通过各自持有的电磁笔触摸电磁屏设备,如图2B所示的场景,图2A所示系统200应用于电子白板,该电子白板可以安装在教室的讲台上,老师教学时可能会挑选多个学生答题,如图2B中所示的学生王某和学生张某,这两个学生需要同时按照老师要求书写成语“平心而论”,在两个学生分别通过各自持有的电磁笔接触电子白板,开始书写后,电磁板221可以检测到各电磁笔触发的触摸信号,触控主板222可以按照多点触摸协议对检测到的触摸信号进行封装,并通过驱动接口230所含的USB端口上传到操作系统24,操作系统240解析触摸信号后,控制电子白板显示相应的书写内容。
如图2C所示,在两个学生各自书写一部分内容后,操作系统240控制电子白板显示学生王某书写内容为“平心”,显示学生张某书写的内为“凭心”。在这种状况下,老师发现学生张某书写内容错误。在两个学生继续书写时,老师可以通过其持有的电磁笔对学生张某的书写内容进行批注,例如:对学生张某书写的错字“凭”打叉,此时,电磁板221可以检测到各电磁笔触发的触摸信号,触控主板222可按照多点触摸协议对检测到的触摸信号进行封装,并通过驱动接口230所含的USB端口上传到操作系统240,操作系统240解析触摸信号后,控制电子白板显示如图2D所示的相应的书写内容。
与前述方法的实施例相对应,本发明还提供了装置的实施例。
参见图3,图3是本发明一示例性实施例示出的触摸信号的处理装置的框图,该装置可以包括:应用检测模块310、协议确定模块320和事件触发模块330。
其中,应用检测模块310,用于检测当前被访问的应用程序。
协议确定模块320,用于确定适用于所述应用程序的信号传输协议。
事件触发模块330,用于在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。
一些例子中,本发明实施例的触摸信号的处理装置应用于操作系统,还可以包括:
解析模块,用于接收封装后的触摸信号并解析,以便触发所述触摸信号的响应操作。
另一些例子中,应用检测模块310还可以用于:
调取预生成的应用白名单;
判断检测到的应用程序的应用标识是否在所述应用白名单中;
如果是,则确定适用于所述应用程序的信号传输协议为多点触摸协议对应;
如果不是,则确定适用于所述应用程序的信号传输协议为所述标准协议。
另一些例子中,在应用检测模块310所确定的信号传输协议为所述多点触摸协议时,所述触摸信号包括至少两支电磁笔触发的触摸信号。
另一些例子中,本发明实施例的触摸信号处理装置还可以包括:
单笔通知模块,用于在所确定的信号传输协议为支持单电磁笔输入的标准协议时,通知所述电磁屏设备侧按照所述标准协议对电磁笔触发的触摸信号进行数据封装。
另一些例子中,所述多点触摸协议对应的应用程序包括文本编辑类应用程序和/或图像编辑类应用程序。
作为例子,所述文本编辑类应用程序包括白板应用的应用程序。
参见图4,图4是本发明另一示例性实施例示出的触摸信号的处理装置的框图,该装置可以包括:多点封装模块410、单笔封装模块420和信号发 送模块430。
其中,多点封装模块410,用于在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由主机设备侧检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发。
单笔封装模块420,用于在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装。
信号发送模块430,用于向所述操作系统发送封装后的触摸信号,以便所述操作系统响应所述触摸信号。
一些例子中,多点封装模块410还可以用于:
按照所述多点触摸协议,将各电磁笔触发的触摸信号编译到同一个数据包内,在该数据包内,一支电磁笔触发的触摸信号作为一个点的触摸信号。
作为例子,信号发送模块430还可以用于:
将封装后的触摸信号发送至多点触摸描述符对应的USB端口,由所述USB端口将封装后的触摸信号上传到所述操作系统。
另一些例子中,所述多点触摸协议对应的应用程序包括文本编辑类应用程序和/或图像编辑类应用程序。
作为例子,所述文本编辑类应用程序包括白板应用的应用程序。
上述装置中各个单元(或模块)的功能和作用的实现过程具体详见上述方法中对应步骤的实现过程,在此不再赘述。
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元或模块可以是或者也可以不是物理上分开的,作为单元或模块显示的部件可以是或者也可以不是物理单元或模块,即可以位于一个地方,或者也可以分布到多个网络单元或模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本发明方案的目 的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。
本发明触摸信号的处理装置的实施例可以应用在电子设备上。具体可以由计算机芯片或实体实现,或者由具有某种功能的产品来实现。一种典型的实现中,电子设备的具体形式可以是具有电磁式触摸屏的个人计算机、膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、智能书写设备、电子邮件收发设备、游戏控制台、平板计算机、可穿戴设备、互联网电视、智能机车、无人驾驶汽车、智能冰箱、其他智能家居设备或者这些设备中的任意几种设备的组合。智能书写设备可以是电子白板、电子黑板等等。
装置实施例可以通过软件实现,也可以通过硬件或者软硬件结合的方式实现。以软件实现为例,作为一个逻辑意义上的装置,是通过其所在电子设备的处理器将非易失性存储器等可读介质中对应的计算机程序指令读取到内存中运行形成的。从硬件层面而言,如图5所示,为本发明触摸信号的处理装置所在电子设备的一种硬件结构图,除了图5所示的处理器、内存、网络接口、以及非易失性存储器之外,实施例中装置所在的电子设备通常根据该电子设备的实际功能,如搭载有电磁式触摸屏,还可以包括其他硬件,对此不再赘述。电子设备的存储器可以存储处理器可执行的程序指令;处理器可以耦合存储器。
一些实施例中,处理器用于读取所述存储器存储的程序指令,并作为响应,执行如下操作:
检测当前被访问的应用程序;
确定适用于所述应用程序的信号传输协议;
在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。
作为例子,处理器所执行的操作还可以参考上文图1B涉及的实施例提 到的方法实施例中相关的描述,在此不予赘述。
另一些例子中,一处理器用于读取所述存储器存储的程序指令,并作为响应,执行如下操作:
在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由主机设备侧检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发;
在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;
向所述操作系统发送封装后的触摸信号,以便所述操作系统响应所述触摸信号。
作为例子,处理器所执行的操作还可以参考上文图1C涉及的实施例提到的方法实施例中相关的描述,在此不予赘述。
在其他实施例中,处理器所执行的操作可以参考上文触摸信号的处理方法实施例中相关的描述,在此不予赘述。
此外,本发明实施例还提供一种机器可读存储介质(电子设备的存储器),所述可读存储介质中存储有程序指令,所述程序指令包括以上图1B和/或图1C涉及的实施例提到的触摸信号的处理方法的各步骤对应的指令。当由一个或多个处理器执行时,使得终端设备执行以上图1B和/或图1C涉及的实施例提到的触摸信号的处理方法。
本发明实施例可采用在一个或多个其中包含有程序代码的可读存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。计算机可用可读存储介质包括永久性和非永久性、可移动和非可移动媒体,可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。机器可读存储介质的例子包括但不限于:相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取 存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明保护的范围之内。

Claims (20)

  1. 一种触摸信号的处理系统,其特征在于,包括主机设备和电磁屏设备,所述电磁屏设备内搭载有电磁触控系统,所述主机设备内搭载有操作系统,所述操作系统包括应用检测代码和触摸驱动;
    所述应用检测代码用于:
    检测当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议;
    在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁触控系统按照多点触摸协议进行数据封装;
    所述电磁触控系统用于:
    在检测到多点封装事件时,按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装,并向所述操作系统发送封装后的触摸信号;
    在未检测到多点封装事件时,按照所述标准协议对电磁笔触发的触摸信号进行数据封装,并向所述操作系统发送封装后的触摸信号;
    所述触摸驱动用于对所述触摸信号进行解析,以触发所述触摸信号的响应操作。
  2. 一种主机设备,其特征在于,搭载有操作系统,所述操作系统包括应用检测代码和触摸驱动;
    所述应用检测代码用于:
    检测当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议;
    在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁触控系统按照多点触摸协议进行数据封装;
    所述触摸驱动用于对所述电磁触控系统发送的触摸信号进行解析,以触发所述触摸信号的响应操作。
  3. 一种电磁屏设备,其特征在于,搭载有电磁触控系统;
    所述电磁触控系统用于:
    在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由操作系统检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发;
    在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;
    向所述操作系统发送封装后的触摸信号。
  4. 一种触摸信号的处理方法,其特征在于,包括步骤:
    检测当前被访问的应用程序;
    确定适用于所述应用程序的信号传输协议;
    在所确定的信号传输协议为多点触摸协议时,触发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。
  5. 根据权利要求4所述的方法,其特征在于,所述方法应用于操作系统,所述方法还包括以下步骤:
    接收封装后的触摸信号并解析,以便触发所述触摸信号的响应操作。
  6. 根据权利要求4所述的方法,其特征在于,所述确定与所述应用程序对应的触摸信号传输协议,包括:
    调取预生成的应用白名单;
    判断检测到的应用程序的应用标识是否在所述应用白名单中;
    如果是,则确定适用于所述应用程序的信号传输协议为多点触摸协议对应;
    如果不是,则确定适用于所述应用程序的信号传输协议为所述标准协议。
  7. 根据权利要求4所述的方法,其特征在于,在所确定的信号传输协议为支持单电磁笔输入的标准协议时,通知电磁屏设备侧按照所述标准协议对电磁笔触发的触摸信号进行数据封装。
  8. 根据权利要求4至7中任一项所述的方法,其特征在于,所述多点触摸协议对应的应用程序包括文本编辑类应用程序和/或图像编辑类应用程序。
  9. 根据权利要求8所述的方法,其特征在于,所述文本编辑类应用程序包括白板应用的应用程序。
  10. 一种触摸信号的处理方法,其特征在于,包括步骤:
    在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由主机设备侧检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发;
    在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;
    向所述操作系统发送封装后的触摸信号,以便所述操作系统响应所述触摸信号。
  11. 根据权利要求10所述的方法,其特征在于,所述按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装,包括:
    按照所述多点触摸协议,将每支电磁笔触发的触摸信号编码为满足所述多点触摸协议规定的格式的数据;
    将编码后的所有触摸信号打包到同一个数据包的包体内,在该数据包内一支电磁笔触发的编码后的触摸信号对应一个触摸点。
  12. 根据权利要求10所述的方法,其特征在于,所述向操作系统发送封装后的触摸信号,包括:
    将封装后的触摸信号发送至多点触摸描述符对应的USB端口,由所述USB端口将封装后的触摸信号上传到所述操作系统。
  13. 一种触摸信号的处理装置,其特征在于,包括:
    应用检测模块,用于检测当前被访问的应用程序;
    协议确定模块,用于确定适用于所述应用程序的信号传输协议;
    事件触发模块,用于在所确定的信号传输协议为多点触摸协议时,触 发多点封装事件,以通知电磁屏设备侧按照所述多点触摸协议对电磁笔触发的触摸信号进行数据封装。
  14. 一种触摸信号的处理装置,其特征在于,包括:
    多点封装模块,用于在检测到多点封装事件时,按照多点触摸协议对电磁笔触发的触摸信号进行数据封装,其中,所述多点封装事件由主机设备侧检测到当前被访问的应用程序,并确定适用于所述应用程序的信号传输协议是多点触摸协议时触发;
    单笔封装模块,用于在未检测到多点封装事件时,按照支持单电磁笔输入的标准协议对电磁笔触发的触摸信号进行数据封装;
    信号发送模块,用于向所述操作系统发送封装后的触摸信号,以便所述操作系统响应所述触摸信号。
  15. 一种电子设备,其特征在于,所述电子设备搭载了操作系统、处理器以及用于存储所述处理器可执行指令的存储器;其中,所述处理器被配置为执行如权利要求4至9中任一项所述方法中的操作。
  16. 一种电子设备,其特征在于,所述电子设备搭载了电磁式触摸屏、处理器以及用于存储所述处理器可执行指令的存储器;其中,所述处理器被配置为执行如权利要求10至12中任一项所述方法中的操作。
  17. 根据权利要求16所述的设备,其特征在于,所述电子设备包括智能手写板。
  18. 根据权利要求17所述的设备,其特征在于,所述智能手写板包括电子白板。
  19. 一个或多个机器可读存储介质,其特征在于,其上存储有指令,当由一个或多个处理器执行时,使得终端设备执行如权利要求4至9中任一项所述方法中的操作。
  20. 一个或多个机器可读存储介质,其特征在于,其上存储有指令,当由一个或多个处理器执行时,使得终端设备执行如权利要求10至12中任一项所述方法中的操作。
PCT/CN2018/114055 2017-12-19 2018-11-06 触摸信号的处理方法、装置、及电子设备和存储介质 Ceased WO2019119995A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711376033.6A CN108132729A (zh) 2017-12-19 2017-12-19 触摸信号的处理方法、装置、及电子设备和存储介质
CN201711376033.6 2017-12-19

Publications (1)

Publication Number Publication Date
WO2019119995A1 true WO2019119995A1 (zh) 2019-06-27

Family

ID=62391906

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/114055 Ceased WO2019119995A1 (zh) 2017-12-19 2018-11-06 触摸信号的处理方法、装置、及电子设备和存储介质

Country Status (2)

Country Link
CN (1) CN108132729A (zh)
WO (1) WO2019119995A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108132729A (zh) * 2017-12-19 2018-06-08 广州视源电子科技股份有限公司 触摸信号的处理方法、装置、及电子设备和存储介质
CN109062433A (zh) * 2018-07-23 2018-12-21 广州视源电子科技股份有限公司 触控数据处理的方法、装置、智能设备和存储介质
CN112882766A (zh) * 2021-02-03 2021-06-01 广州华欣电子科技有限公司 一种数据处理方法、装置和系统
CN114327102B (zh) * 2021-12-06 2023-07-21 深圳市千分一智能技术有限公司 协议切换方法、装置、设备及计算机可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101533322A (zh) * 2009-04-13 2009-09-16 杭州电子科技大学 一种多点触摸板及多点触摸定位方法
CN102819391A (zh) * 2012-07-24 2012-12-12 华平信息技术(南昌)有限公司 一种多场景下具有并行性的多点触摸手势反馈系统及方法
CN204515747U (zh) * 2015-03-02 2015-07-29 深圳市优笔触控科技有限公司 电容电磁双控电子签名设备
CN104881191A (zh) * 2015-05-20 2015-09-02 青岛元盛光电科技有限公司 一种大尺寸电容电磁一体触摸装置
CN108132729A (zh) * 2017-12-19 2018-06-08 广州视源电子科技股份有限公司 触摸信号的处理方法、装置、及电子设备和存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8289289B2 (en) * 2008-04-03 2012-10-16 N-trig, Ltd. Multi-touch and single touch detection
JP2012133729A (ja) * 2010-12-24 2012-07-12 Sony Corp 情報処理装置、情報処理方法、およびプログラム
CN102193863A (zh) * 2011-04-26 2011-09-21 青岛海信移动通信技术股份有限公司 一种多点触控操作的实现方法及装置
JP5862549B2 (ja) * 2012-11-28 2016-02-16 コニカミノルタ株式会社 データ処理装置、操作受付方法およびブラウジングプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101533322A (zh) * 2009-04-13 2009-09-16 杭州电子科技大学 一种多点触摸板及多点触摸定位方法
CN102819391A (zh) * 2012-07-24 2012-12-12 华平信息技术(南昌)有限公司 一种多场景下具有并行性的多点触摸手势反馈系统及方法
CN204515747U (zh) * 2015-03-02 2015-07-29 深圳市优笔触控科技有限公司 电容电磁双控电子签名设备
CN104881191A (zh) * 2015-05-20 2015-09-02 青岛元盛光电科技有限公司 一种大尺寸电容电磁一体触摸装置
CN108132729A (zh) * 2017-12-19 2018-06-08 广州视源电子科技股份有限公司 触摸信号的处理方法、装置、及电子设备和存储介质

Also Published As

Publication number Publication date
CN108132729A (zh) 2018-06-08

Similar Documents

Publication Publication Date Title
EP4163778B1 (en) Touch control method and apparatus
US11144195B2 (en) Fast data copying method and electronic device
US20190065030A1 (en) Display apparatus and control method thereof
US20160357221A1 (en) User terminal apparatus and method of controlling the same
US9535595B2 (en) Accessed location of user interface
CN106415446B (zh) 通过触觉交互对内容属性的可访问性检测
WO2019119995A1 (zh) 触摸信号的处理方法、装置、及电子设备和存储介质
WO2020019616A1 (zh) 触控数据处理的方法、装置、智能设备和存储介质
CN109697004B (zh) 用于触摸设备书写批注的方法、装置、设备及存储介质
CN108287739A (zh) 一种操作引导方法及移动终端
KR20170096408A (ko) 어플리케이션을 표시하는 방법 및 이를 지원하는 전자 장치
CN107908489A (zh) 复制粘贴的方法和移动终端
US10462243B2 (en) Method and device for interaction between terminals
WO2019105187A1 (zh) 触感信号的处理方法、系统、装置及电子设备
EP3690604A1 (en) Display control method and system, and virtual reality device
CN103841460A (zh) 一种图像数据传输方法及电子设备
US9794635B2 (en) Distribution device, distribution method, and non-transitory computer readable storage medium
CN107885823A (zh) 音频信息的播放方法、装置、存储介质及电子设备
CN108595134A (zh) 智能交互平板及矢量图处理方法、装置和设备
WO2019105188A1 (zh) 触感信号的处理方法、系统、装置及电子设备
CN109240495A (zh) 一种控制自动翻页的方法及设备
US11669346B2 (en) System and method for displaying customized user guides in a virtual client application
CN111368151A (zh) 显示方法及电子设备
CN110908552B (zh) 多窗口操作控制方法、装置、设备及存储介质
CN106888151A (zh) 消息处理方法和系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18891018

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21.10.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18891018

Country of ref document: EP

Kind code of ref document: A1