CN117692483A

CN117692483A - Input event transmission method, electronic equipment and storage medium

Info

Publication number: CN117692483A
Application number: CN202311052240.1A
Authority: CN
Inventors: 聂光
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2023-08-18
Filing date: 2023-08-18
Publication date: 2024-03-12

Abstract

The application provides an input event transmission method, electronic equipment and a storage medium, which relate to the technical field of information and are applied to a control end and comprise the following steps: under the condition that the control end remotely controls the controlled equipment, acquiring a current swipe input event, wherein the current swipe input event comprises at least one of the following information: current rowing speed, current rowing direction, current picking point moment and current picking point position; filtering the current stroke input event under the condition that the current stroke input event meets a preset filtering condition; otherwise, the current stroke input event is sent to the controlled device. The embodiment of the application realizes the reduction of the load of the network channel.

Description

Input event transmission method, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of information technologies, and in particular, to an input event transmission method, an electronic device, and a storage medium.

Background

Remote control means that local equipment and electronic equipment to be controlled are communicated by means of remote dialing through a computer network or the two parties access the same network and the like, the desktop environment of the controlled equipment is displayed on the local equipment, and remote equipment is controlled by operating the local equipment. For example, a remote desktop service in a Windows system (a computer operating system), can implement manipulation of a device hosting the Windows system by operating a local device.

A common application scenario of the remote desktop service is to control a PC (Personal Computer ) device carrying a Windows system through a mobile device carrying an Android system (an operating system of a mobile device), for example, as shown in fig. 1, remotely control a computer by using a mobile device such as a tablet computer, a mobile phone, etc., transmit a data stream including audio and video of the computer end to the mobile device through a network channel, display by using the remote desktop service, capture an input event of the mobile device end by using the remote desktop service, generate a control stream, and transmit the control stream to the computer end through the network channel, so as to realize control of the computer.

However, in the process of remote desktop service, frequent reporting of the incoming event and too high reporting rate often occur, and the channel is blocked for the network channel with limited load, so that the transmission delay of the incoming event and the abnormal conditions such as slow response of remote control occur.

Disclosure of Invention

An embodiment of the application aims to provide an input event transmission method, electronic equipment and a storage medium, so as to reduce the load of a network channel. The specific technical scheme is as follows:

in a first aspect, an input event transmission method is applied to a first terminal device, where the first terminal device is in communication connection with a second terminal device; the method comprises the following steps:

In a first time period, responding to the fact that a handwriting pen strokes on the first terminal equipment, the first terminal equipment sends a first input event and a second input event to the second terminal equipment, no other input event is sent between the first input event and the second input event, and in the first time period, the sending time of the first input event and the sending time of the second input event differ by a first duration, and the speed of the handwriting pen strokes is a first speed;

in a second time period, responding to the sliding of the handwriting pen on the first terminal device, and sending a third input event and a fourth input event to the second terminal device by the first terminal device, wherein no other input event is sent between the third input event and the fourth input event, and the sending time of the third input event and the sending time of the fourth input event are different by a second time period; the speed of the handwriting stroke is a second speed, the first speed is smaller than the second speed, and the first time period is longer than the second time period;

in a third time period, responding to the sliding of the handwriting pen on the first terminal device, the first terminal device sends a fifth input event and a sixth input event to the second terminal device, no other input event is sent between the fifth input event and the sixth input event, the sending time of the fifth input event and the sending time of the sixth input event differ by a third duration, and in the third time period, the speed of the handwriting pen moving is a third speed, the third speed is smaller than the second speed, and the third duration is longer than the second duration.

In one embodiment of the present application, no other input event is acquired between the first input event and the second input event; other input events are collected between the third input event and the fourth input event; no other input event is collected between the fifth input event and the sixth input event.

In one embodiment of the present application, a first number of input events is collected between the first input event and the second input event; a second number of input events are acquired between the third input event and the fourth input event; a third number of input events are collected between the fifth input event and the sixth input event; the second number is greater than the first number, and the second number is greater than the third number.

In one embodiment of the present application, the method further comprises:

in a fourth period, responding to the sliding of the handwriting pen on the first terminal device, the first terminal device sends a seventh input event and an eighth input event to the second terminal device, no other input event is sent between the seventh input event and the eighth input event, the sending time of the seventh input event and the sending time of the eighth input event differ by a fourth duration, and in the fourth period, the track of the handwriting pen movement is a fourth track;

In a fifth period, responding to the sliding of the handwriting pen on the first terminal device, the first terminal device sending a ninth input event and a tenth input event to the second terminal device, wherein no other input event is sent between the ninth input event and the tenth input event, the sending time of the ninth input event and the tenth input event differ by a fifth duration, and in the fifth period, the track of the handwriting pen is a fifth track; the fourth track has a degree of curvature that is less than the degree of curvature of the fifth track, and the fourth time period is greater than the fifth time period.

In one embodiment of the present application, no other input event is acquired between the seventh input event and the eighth input event; other input events are collected between the ninth input event and the tenth input event.

In one embodiment of the present application, a fourth number of input events is collected between the seventh input event and the eighth input event; a fifth number of input events are collected between the ninth input event and the tenth input event; the fifth number is greater than the fourth number.

In one embodiment of the present application, the first terminal device collects input events according to a preset sampling frequency.

In one embodiment of the present application, the method further comprises:

responding to the handwriting pen to swipe on the first terminal device, and acquiring a first swipe input event, wherein the first swipe input event comprises at least one of the following information: the first stroke speed, the first stroke direction, the first sampling point moment and the first sampling point position;

filtering the first swipe input event under the condition that the first swipe input event meets a preset filtering condition; otherwise, the first swipe input event is sent to the second terminal device.

In one possible implementation, the first swipe input event includes the first swipe speed, the first swipe direction, and the first pick point location;

filtering the first swipe input event under the condition that the first swipe input event meets a preset filtering condition; otherwise, the first swipe input event is sent to the second terminal device, including:

acquiring a previous stroke direction and a previous acquisition point position of a previous stroke input event sent to the second terminal device last time before the first stroke input event under the condition that the first stroke speed exceeds a preset speed threshold;

Determining a first angle difference according to the first stroke direction and the previous stroke direction;

determining a first distance according to the first mining point position and the last mining point position;

determining a first degree of bending according to the first distance and the first angle difference;

and sending the first swipe input event to the second terminal equipment under the condition that the first bending degree exceeds a preset bending degree threshold value.

In one embodiment of the present application, the filtering unit is configured to filter the first swipe input event if the first swipe input event meets a preset filtering condition; otherwise, the first swipe input event is sent to the second terminal device, including:

filtering the first swipe input event if the first degree of curvature does not exceed a preset degree of curvature threshold and the first distance does not exceed a preset distance threshold;

and transmitting the first swipe input event to the second terminal device under the condition that the first bending degree does not exceed a preset bending degree threshold value and the first distance exceeds a preset distance threshold value.

In one embodiment of the present application, the first swipe input event includes the first swipe speed and the first picking point moment;

acquiring a last acquisition point moment of a last stroke input event which is transmitted to the second terminal equipment last time under the condition that the first stroke speed does not exceed a preset speed threshold;

filtering the scratching input event under the condition that the time difference between the first sampling point time and the last sampling point time does not exceed a preset time difference threshold;

and under the condition that the time difference between the first sampling point time and the last sampling point time exceeds a preset time difference threshold, transmitting the first scratching input event to the second terminal equipment.

In one possible embodiment, the first terminal device remotely controls the second terminal device via a wide area network.

In a second aspect, an embodiment of the present application provides an input event transmission method, applied to a control end, where the method includes:

under the condition that the control end remotely controls the controlled equipment, acquiring a current swipe input event, wherein the current swipe input event comprises at least one of the following information: current rowing speed, current rowing direction, current picking point moment and current picking point position;

Filtering the current stroke input event under the condition that the current stroke input event meets a preset filtering condition; otherwise, the current stroke input event is sent to the controlled device.

In one embodiment of the present application, the current swipe input event includes the current swipe speed, the current swipe direction, and the current pick point position;

filtering the current stroke input event under the condition that the current stroke input event meets a preset filtering condition; otherwise, the current stroke input event is sent to the controlled device, which comprises the following steps:

acquiring a previous stroke direction and a previous acquisition point position of a previous stroke input event which is transmitted to the controlled equipment last time under the condition that the current stroke speed exceeds a preset speed threshold;

determining a current angle difference according to the current rowing direction and the previous rowing direction;

determining a current distance according to the current mining point position and the last mining point position;

determining a current bending degree according to the current distance and the current angle difference;

and under the condition that the current bending degree exceeds a preset bending degree threshold value, transmitting the current scratching input event to the controlled equipment.

In one embodiment of the present application, the filtering unit is configured to filter the current swipe input event if the current swipe input event meets a preset filtering condition; otherwise, the current stroke input event is sent to the controlled device, which comprises the following steps:

filtering the current swipe input event when the current bending degree does not exceed a preset bending degree threshold and the current distance does not exceed a preset distance threshold;

and transmitting the current swipe input event to the controlled device under the condition that the current bending degree does not exceed a preset bending degree threshold value and the current distance exceeds a preset distance threshold value.

In one embodiment of the present application, the current swipe input event includes the current swipe speed and the current acquisition point moment;

acquiring a last acquisition point moment of a last stroke input event which is transmitted to the controlled equipment last time under the condition that the current stroke speed does not exceed a preset speed threshold;

Filtering the scratching input event under the condition that the time difference between the current sampling point time and the last sampling point time does not exceed a preset time difference threshold;

and under the condition that the time difference between the current sampling point time and the last sampling point time exceeds a preset time difference threshold, transmitting the current scratching input event to the controlled equipment.

In one embodiment of the present application, the control terminal remotely controls the controlled device through a wide area network.

In a third aspect, an embodiment of the present application provides an input event transmission apparatus, applied to a control end, where the apparatus includes:

the event acquisition module is used for acquiring a current scratching input event under the condition that the control end remotely controls the controlled equipment, wherein the current scratching input event comprises at least one of the following information: current rowing speed, current rowing direction, current picking point moment and current picking point position;

the event processing module is used for filtering the current swipe input event under the condition that the current swipe input event meets a preset filtering condition; otherwise, the current stroke input event is sent to the controlled device.

The event processing module is specifically configured to:

In one embodiment of the present application, the event processing module is specifically configured to:

the event processing module is specifically configured to:

In a fourth aspect, an embodiment of the present application provides an electronic device, including:

a memory for storing a computer program;

and the processor is used for realizing any one of the input event transmission methods when executing the programs stored in the memory.

In a fifth aspect, embodiments of the present application provide a computer readable storage medium having a computer program stored therein, the computer program implementing any of the above described input event transmission methods when executed by a processor.

The beneficial effects of the embodiment of the application are that:

the input event transmission method provided by the embodiment of the application is applied to a control end, under the condition that the control end remotely controls controlled equipment, a current scratching input event of the control end is obtained, the obtained current scratching input event comprises at least one item of information such as a current scratching speed, a current scratching direction, a current mining point moment, a current mining point position and the like, then under the condition that the current scratching input event meets preset filtering conditions, the current scratching input event is filtered, and otherwise, the current scratching input event is sent to the controlled equipment, so that the controlled equipment is controlled. The number of the current swipe input events which meet the preset filtering conditions can be reduced, and therefore the load of a network channel can be reduced.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following description will briefly introduce the drawings that are required to be used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other embodiments may also be obtained according to these drawings to those skilled in the art.

Fig. 1 is a schematic diagram of a remote control scenario according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 3 is a block diagram of a software implementation of an electronic device provided in an embodiment of the present application;

fig. 4 is a software structural block diagram of an electronic device in remote control according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a stylus according to an embodiment of the present disclosure for inputting an input event;

fig. 6 is a signaling flow diagram of an input event transmission method according to an embodiment of the present application;

fig. 7 is a flow chart of an input event transmission method according to an embodiment of the present application;

FIG. 8 is an illustrative example graph of a current distance and a current angle difference provided by an embodiment of the present application;

fig. 9 is a schematic diagram of an input event transmission device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. Based on the embodiments herein, a person of ordinary skill in the art would be able to obtain all other embodiments based on the disclosure herein, which are within the scope of the disclosure herein.

In the remote control process of the related technology, the conditions of frequent point reporting and over-high point reporting rate of the rowing type input event often occur, the input event is excessive, and the channel blockage is caused to the network channel with limited load, so that the transmission delay of the input event is caused, and the abnormal conditions of slow response of the remote control occur.

The input event transmission method provided by the embodiment of the application can be applied to any electronic device which has remote control capability, can be used as a control end in a remote control process and can input a stroke input event, and the electronic device can be electronic device with display screen hardware and corresponding software support. For example, the electronic device may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, a notebook computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook, a personal digital assistant (personal digital assistant, PDA), a home device, or the like, and the specific type of the electronic device is not limited in this application.

In one possible embodiment, in order to more clearly describe the electronic device provided in the embodiment of the present application, an exemplary description will be given below of one possible application scenario of the electronic device provided in the embodiment of the present application. It can be understood that the following examples are only one possible application scenario of the electronic device provided in the embodiments of the present application, and in other possible embodiments, the electronic device provided in the embodiments of the present application may also be applied to other possible application scenarios, where the following examples do not limit any limitation.

The input event transmission method provided by the embodiment of the application is suitable for any near-field transmission scene, such as a local area network remote control scene, and far-field transmission scene, such as a wide area network remote control scene. Because the near field transmission scene is always WLAN (wireless local area network) direct connection, delay is low, and the conditions of too high load of a network channel, channel blocking caused by excessive input events, slow response of the input events and the like are less, the embodiment of the application can be mainly applied to the far field transmission scene.

Common input events include a stroke input event and a click input event, wherein the stroke input event is usually realized by a handwriting pen, a touch pad, a mouse and the like, for example, the handwriting board or a finger strokes on the touch pad, the mouse is suspended to stroke or dragging after a left/right button of the mouse is pressed, and the like; click type input events are often realized by clicking input devices such as a touch screen, a mouse and the like. The number of the input events captured by the remote desktop service in unit time is determined by the report rate of the input devices, i.e. the number of the input events captured by the remote desktop service is the same as the number of the events reported by the input devices. Because frequent point reporting and too high point reporting rate occur in the stroke input event, the channel blockage is caused to the network channel with limited load, so that abnormal conditions occur.

The PC device is an electronic device with a control terminal, the mobile phone/tablet computer is an electronic device with a control terminal, a display interface in a display screen of the PC device is thrown onto the mobile phone/tablet, and the PC device is controlled by inputting a swipe input event on the mobile phone/tablet, for example, by using a handwriting pen. Because the handwriting pen has high point reporting rate, the input events are excessive, so that network channels are blocked, input is delayed, and the response of the PC equipment to the input events is slowed down.

It should be understood that the foregoing is illustrative of a scenario and is not intended to limit the scenario of the present application in any way.

First, in a first aspect of the embodiments of the present application, an electronic device is provided, and as shown in fig. 2, the electronic device 200 may include a processor 201, a communication module 202, and the like.

The processor 201 may include one or more processing units, for example: processor 201 may include an application processor (application processor, AP), a modem processor, a graphics processor, an image signal processor (image signal processor, ISP), a controller, a memory, a video stream codec, a digital signal processor, a baseband processor, and/or a neural-Network Processor (NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors 201.

The controller may be a neural hub and command center of the electronic device 200. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 201 for storing instructions and data.

In some embodiments, the memory in the processor 201 is a cache memory. The memory may hold instructions or data that the processor 201 has just used or recycled. If the processor 201 needs to reuse the instruction or data, it may be called directly from memory. Repeated accesses are avoided and the latency of the processor 201 is reduced, thus improving the efficiency of the system.

In some embodiments, the processor 201 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The communication module 202 may be a Modem and may be connected to an antenna.

As shown in fig. 2, in some embodiments, the electronic device 200 may further include an external memory interface 205, an internal memory 204, a usb interface 206, a charge management module 207, a power management module 208, a battery 209, and a sensor module 203, among others.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent cognition of the electronic device 200 may be implemented by the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The charge management module 207 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger.

In some wired charging embodiments, the charging management module 207 may receive a charging input of a wired charger through the USB interface 206.

In some wireless charging embodiments, the charging management module 207 may receive wireless charging input through a wireless charging coil of the electronic device 200. The battery 209 is charged by the charging management module 207, and the electronic device 200 can be powered by the power management module 208.

The power management module 208 is used to connect the battery 209, the charge management module 207 and the processor 201. The power management module 208 receives input from the battery 209 and/or the charge management module 207 and provides power to the processor 201, the internal memory 204, the external memory, the communication module 202, and the like. The power management module 208 may also be configured to monitor battery capacity, battery cycle times, battery health (leakage, impedance), and other parameters.

In other embodiments, the power management module 208 may also be disposed in the processor 201.

In other embodiments, the power management module 208 and the charging management module 207 may also be disposed in the same device.

The external memory interface 205 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 200. The external memory card communicates with the processor 201 via an external memory interface 205 to implement data storage functions. For example, files such as music, video streams, etc. are stored in an external memory card.

The internal memory 204 may be used to store computer executable program code that includes instructions. The processor 201 executes various functional applications of the electronic device 200 and data processing by executing instructions stored in the internal memory 204. The internal memory 204 may include a stored program area and a stored data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 200 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 204 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash memory (universal flash storage, UFS), and the like.

The sensor module 203 in the electronic device 200 may include components such as image sensors, touch sensors, pressure sensors, gyroscopic sensors, barometric pressure sensors, magnetic sensors, acceleration sensors, distance sensors, proximity sensors, ambient light sensors, fingerprint sensors, temperature sensors, bone conduction sensors, etc. to enable sensing and/or acquisition of different signals.

Optionally, the electronic device 200 may also include peripheral devices such as a mouse, keys, indicator lights, keyboard, speakers, microphone, etc.

The keys include a start key, a volume key, etc. The keys may be mechanical keys. Or may be a touch key. The electronic device 200 may receive key inputs, generating key signal inputs related to user settings and function controls of the electronic device 200.

The indicator may be an indicator light, which may be used to indicate a change in state of charge and charge, or may be used to indicate a message, missed call, notification, etc.

It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic apparatus 200.

In other embodiments, the electronic device 200 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

In an electronic device, a software system of the electronic device may be divided into several layers, as shown in fig. 3, and fig. 3 is a frame diagram of the electronic device according to an embodiment of the present application, including a frame diagram of a software implementation and a frame diagram of a hardware abstraction layer. The layered architecture divides the software system of the electronic device into several layers, each of which has a distinct role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the electronic device application system of the control side may be divided into an application layer (application), a framework layer (fwk), and a driver layer (hardware abstract layer, HAL).

The application layer may include a series of application packages that run applications by calling an application program interface (application programming interface, API) provided by the application framework layer. The application package may include a plurality of applications, such as an application having a remote control function, an input method application, a call application, and a map application.

The framework layer provides APIs and programming frameworks for application programs of the application layer. The application framework layer includes a number of predefined functions. As shown in fig. 3, the application framework layer may include an Input event distribution module (Input Dispatcher), an Input event reading module (Input Reader), and the like. In addition, the application framework layer may further include an input event service module (service), an input event trigger service module (trigger service), an input event indication module (link), and the like. The input event reading module is used for acquiring the structured data reported by the input device driver and analyzing the structured data to obtain an input event, and the input event distribution module sends the input event to the remote control application. It is understood that the remote control application in the present application refers to an application having a remote control function, and the application may also have other functions, such as instant messaging, screen recording, and the like, and is not particularly limited to an application only for remote control.

The driving layer is a layer between hardware and software for driving the hardware so that the hardware operates. A plurality of drivers for driving hardware operations may be installed in the driver layer. For example, an input device driver (input trigger hal) (the input device driver may include an input device driver corresponding to a stylus, an input device driver corresponding to a mouse, an input device driver corresponding to a touch screen, etc.), an input event trigger driver (Input Trigger driver), an event input driver, and the like.

In addition, the electronic device further comprises a hardware abstraction layer, which comprises hardware capable of realizing input, wherein the hardware comprises the electronic device, such as a touch screen, and also comprises external devices of the electronic device, such as a handwriting pen and a mouse. The hardware abstraction layer is connected with the driving layer and is used for reporting the data input by the input hardware to the driving layer.

In the remote control process, as shown in fig. 4, the electronic device is a control end device, and the control end device runs a remote control application program. In the hardware abstraction layer, a user inputs by using input hardware, and an input device of the driving layer drives input based on the input hardware to generate corresponding structured data.

The input event reading module of the framework layer obtains structured data driven by the input device, and specifically, the structured data may include acquisition point time information, acquisition point position information and the like, and may also include pressure sensing information of input hardware during input, input event types (for example, downward swipe information (down), upward swipe information (up), movement information (move)), and the like. The input event reading module converts the acquired structured data into a rowing input event, and the input event reading module analyzes the rowing input event based on the structured data. The input event reading module sends the swipe input event to the input event distribution module, which sends the swipe input event to the remote control application.

An input event acquisition module in the remote control application program acquires the current swipe input event sent by the input event distribution module and sends the current swipe input event to an input event filtering module. The input event filtering module is used for filtering the stroking input event: and filtering the current stroke input event under the condition that the current stroke input event meets the preset filtering condition, otherwise, transmitting the current stroke input event to a network channel transmitting end. And the network channel transmitting end transmits the unfiltered scratch input event to the controlled equipment. The software system of the controlled device is divided into a plurality of layers, including at least an application layer, a system core layer, a hardware abstraction layer and a hardware interface layer. The application program layer comprises a preset application program with a remote control function, and the preset application program comprises a network channel receiving module and an input event injection module. The system core layer comprises a plurality of system processes and managers, and the preset application program calls the system processes and the managers in the system core layer, so that the system processes and the managers call hardware abstract resources in the hardware abstract layer, and the hardware abstract resources are connected to the hardware interface layer, so that the opinion resources are finally called. In one example, the network channel receiving module of the controlled device invokes opinion resources such as a network card of the controlled device to receive the input event of the control end, and finally acts the input event on hardware through the input event injection module, thereby realizing control of the controlled device.

In one example, most cell phones/tablet computers contain multiple processors. The operating system, user interface and applications are all executing on Application Processor (AP, application processor), which typically employs the CPU of an ARM chip. The radio frequency communication control software of the mobile phone/tablet computer runs on another separate CPU, and the CPU is called Baseband Processor (BP, baseband processor). The AP includes RIL (Radio Interface Layer ) to provide an interface for communication between the AP's software system and the wireless device, and provides an abstraction layer for wireless communication between the AP and BP, which is responsible for reliable transmission of data, transmission of AP-side requests, and resolution of BP-side responses. The Modem is one of BP, and is used for transmitting and receiving data, and when the electronic device at the control end is a mobile phone/tablet computer, the control end device includes an AP side (for example, a Linux system or an Android system (two operating systems) may be included) and a Modem side (Modem), where the AP includes the software system, and the Modem is used for a Local Area Network (LAN) to connect to a Wide Area Network (WAN).

Therefore, as shown in fig. 4, the network channel transmitting end uses the Modem to realize the transmission of the swipe input event, and the Modem transmits the current swipe input event through the antenna and transmits the current swipe input event to the controlled device through the network channel. The network channel receiving end is used for receiving a current scratching input event sent by the Modem, transmitting the current scratching input event to the input event injection module, and the input event injection module transmits the current scratching input event to an input device driver in the driving layer so that the input device driver finishes the input of the input device driver in the controlled device based on the current scratching input event. Illustratively, the controlled device may be a Windows system device.

It should be noted that, the application layer, the application framework layer, the driver layer, and the hardware device layer may also include other contents, which are not specifically limited herein.

By the method, after the current stroke input event is acquired, the current stroke input event can be reported layer by layer, so that the preset application with the remote control function can filter the current stroke input event according to the preset filtering condition after receiving the current stroke input event, only the current stroke input event which does not meet the preset filtering condition is transmitted, the event transmission of a control end to controlled equipment in the remote control process is reduced as much as possible, the load of a network channel is reduced, the possibility of channel blocking for the network channel is reduced, the transmission delay probability of the input event is reduced, and the occurrence of abnormal conditions such as slow response of the remote control is reduced as much as possible.

The control end and the controlled equipment can be in remote control connection through the wide area network, and the mode of establishing the remote control connection between the control end and the controlled equipment can be referred to a communication mode in the prior art. In one example, a unique identifier of the controlled device may be input in the control end, where the unique identifier may be an account name, ID, address, etc. of the controlled device, and the control end obtains an IP address (Internet Protocol Address ) of the controlled device according to the unique identifier, and in some examples, the unique identifier may be directly an IP address of the controlled device. The control end establishes WebRTC (Web Real-Time Communications, web Real-time communication) with the controlled device based on the controlled device IP address, and performs transmission of the data stream and the control stream by using the established WebRTC, thereby implementing remote control connection.

In one embodiment of the present application, as shown in fig. 6, a signaling flow diagram of an input event transmission method is provided. In the figure, the control end is a tablet personal computer, the input device is a touch screen, the control end is obtained through a handwriting pen, and the controlled device is a PC.

In step S601, the touch screen acquires a stroke input event inputted by the handwriting pen, and reports the stroke input event to the handwriting pen driver in the driving layer.

Input device drivers for the control end may include stylus drivers, touch screen drivers, mouse drivers, and the like. In one example, the touch screen includes an EMR (Electro Magnetic Resonance technology, electromagnetic response) sensor circuit that is mutually inductive with the stylus, which may be specifically an electromagnetic stylus, and the electromagnetic sensor circuit may be continuously switched between a transmitting mode and a receiving mode. In a transmitting mode, the electromagnetic sensor circuit generates alternating current, a coil in the electromagnetic sensor circuit and a coil in a handwriting pen (electromagnetic pen) can work like a primary winding and a secondary winding of a transformer, alternating current voltages are generated at two ends of the handwriting pen coil, so that a resonance circuit is formed by the coil and a capacitor of a circuit formed by the coil in the handwriting pen, and electric energy is accumulated through the L-C oscillation circuit; the electromagnetic sensor circuit is now in a transmit mode. After the resonance is stabilized, the electromagnetic sensor circuit stops generating current and switches the operation mode from the transmission mode to the reception mode. After entering the receiving mode, the coil of the stylus pen will become the primary side and the coil of the electromagnetic sensor circuit will become the secondary side. At this time, the stored energy in the handwriting pen is sent out in the form of electromagnetic signals (RF radio frequency), and the electromagnetic sensor circuit can detect the signals sent out by the handwriting pen; the correct position of the handwriting pen is calculated through the signal intensity received by a plurality of antenna coils which are close to each other in the electromagnetic sensor circuit. The electromagnetic sensor circuit of the touch screen acquires an input event input by the handwriting pen and reports the input event to the handwriting pen driver. In addition, the control end device can be connected with an input device of a peripheral, such as a mouse, and an input event generated by the mouse can be directly reported to a mouse driver.

The first circuit part in the touch screen calculates the induction signal to obtain an input event by acquiring the induction signal sent by the component carried by the handwriting pen, wherein the induction signal comprises coordinates of a sampling point where the stroke input event occurs, sampling point moment when the stroke input event occurs, pressure sensing when the stroke input event is input and the like.

The first circuit portion in the touch screen reports a swipe input event to an input device driver in the driver layer, the particular input device driver corresponding to the input driver of the touch screen.

Step S602, the stylus driver encapsulates the stroke input event to obtain structured data, and sends the encapsulated structured data to the frame layer.

The input device drives to package the stroke input event based on the driving protocol, and the obtained structured data is obtained. The stylus driver writes the structured data into a designated file node, and the inputroller in the framing layer periodically checks the file node and reads the newly written structured data.

In one example, structured data for a touch screen drive may be as follows:

[8958.771941]/dev/input/event10:EV_ABS ABS_MT_POSITION_X 0000031d

[8958.771941]/dev/input/event10:EV_ABS ABS_MT_POSITION_Y 000002ff

[8958.771941]/dev/input/event10:EV_MSC MSC_TIMESTAMP 0002ee00

[8958.771941]/dev/input/event10:EV_SYN SYN_REPORT 00000000 rate 118

wherein 8958.771941 is acquisition point time information in the hardware input process, event10 is an identifier of a hardware device that triggers an input event, that is, event10 represents an input event input by a touch screen. EV_ABS_MT_POSITION_X represents X-axis coordinate information of the acquisition point POSITION input by hardware, and 0000031d represents a specific numerical value of the X-axis coordinate information; ev_abs_mt_position_y represents Y-axis coordinate information of the dot POSITION input by hardware, and 000002ff represents a specific value of the Y-axis coordinate information. Ev_msc msc_ TIMESTAMP is time stamp information (time stamp of the trigger time), and 0002ee00 is a specific value of the time stamp information. EV_SYN_SYN_REPORT is a split event flag for splitting different input events, 00000000 is a preset value, which indicates that the current input event is ended, and rate 118 indicates the current sampling rate, which corresponds to the time difference from the last input event.

In one example, the structured data for a stylus driver may be as follows:

[8958.771941]/dev/input/event9:EV_ABS ABS_X 0000031d

[8958.771941]/dev/input/event9:EV_ABS ABS_Y 000002ff

[8958.771941]/dev/input/event9:EV_MSC MSC_TIMESTAMP 0002ee00

[8958.771941]/dev/input/event9:EV_SYN SYN_REPORT 00000000 rate 118

wherein 8958.771941 is the acquisition point time information in the hardware input process, event9 is the identification of the hardware device triggering the input event, i.e. event9 represents the input event of handwriting pen input. EV_ABS_X represents X-axis coordinate information of a sampling point position input by hardware, and 0000031d represents a specific numerical value of the X-axis coordinate information; EV_ABS_Y represents Y-axis coordinate information of the sampling point position input by hardware, and 000002ff represents a specific value of the Y-axis coordinate information. In one example, the X axis is the horizontal axis of the touch screen, the Y axis is the vertical axis of the touch screen, and the stylus pen performs the input process on the touch screen as shown in fig. 5.

Ev_msc msc_ TIMESTAMP is time stamp information (time stamp of the trigger time), and 0002ee00 is a specific value of the time stamp information. EV_SYN_SYN_REPORT is a split event flag for splitting different input events, 00000000 is a preset value, which indicates that the current input event is ended, and rate 118 indicates the current sampling rate, which corresponds to the time difference from the last input event.

In step S603, the input framework in the framework layer parses the structured data reported by the stylus driver to generate a swipe input event, and distributes the swipe input event to the remote control application of the application layer.

After the I nputreader reads the structured data, the structured data may be parsed, i.e., the type of each piece of data in the structured data is analyzed and converted into a scratch input event (essentially an object) that can be identified by a system application (e.g., an android system application), and the InputDispatcher distributes the scratch input event to the remote control application. The process of generating a swipe input event in one example may be: the method comprises the steps of analyzing the type of the Kth piece of data in structured data by an inputroller, determining that the piece of data represents an X coordinate, extracting a coordinate value of the X coordinate, and filling the coordinate value into a position of the X coordinate value of a stroke input event which accords with the application specification of an android system; after the analysis and filling of each piece of data in the structured data are completed, a swipe input event is obtained.

It is understood that the remote control application in the present application refers to an application having a remote control function, and the application may also have other functions, such as instant messaging, screen recording, and the like, and is not particularly limited to an application only for remote control. In one example, the Input framework may include an Input event distribution module (Input Dispatcher), an Input event reading module (Input Reader), and the like. The input event reading module is used for acquiring the structured data reported by the input device driver (including handwriting pen distinction) and analyzing to obtain an input event, and the input event distribution module distributes the input event to the remote control application.

In step S604, the remote control application call speed monitor determines parameters of the swipe input event, and determines whether to filter based on the parameters of the swipe input event.

The speed monitor is a native tool class in the system, and parameters of the swipe input event can be obtained by calling the speed monitor, and the parameters of the swipe input event can include a swipe speed (including an X direction in XY coordinates), a swipe direction (a Y direction in XY coordinates) and the like during swipe input.

Whether the stroke input event is filtered or not is determined, and in fact, whether the stroke input event is transmitted to a remote end or not is determined. When judging whether the stroke input event needs to be filtered, judging whether the stroke input event meets the preset filtering condition or not by combining the acquired sampling point position and the sampling point moment of the stroke input event based on the acquired parameters of the stroke input event. The preset filtering condition is preset, and indicates that the stroke input event meeting the condition needs to be filtered without continuing to send.

In step S605, when the swipe input event is not filtered, the swipe input event is sent to the Modem side.

And under the condition that the preset filtering condition is not met, judging that the stroke input event is not filtered. And under the condition that the preset filtering condition is met, judging that the stroke input event needs to be filtered, and discarding the stroke input event needing to be filtered. It will be appreciated that the filtered (discarded) input events are not sent to the controlled device.

The input device driver, the framework layer and the remote control application program are all located on the AP side, and the remote control application program transmits the stroke input event to the hardware abstraction layer and transmits the stroke input event to the Modem side through the hardware interface under the condition that the stroke input event is not filtered and needs to be transmitted. And under the condition that the stroke input event meets the preset filtering condition, the stroke input event is filtered out without continuing to send.

In step S606, the Modem transmits the swipe input event to the controlled device.

In one example, the controlled device may be a PC.

In the following description of filtering determination of a swipe input event, as shown in fig. 7, in one embodiment of the present application, a flowchart of a method for transmitting an input event is provided, and in this embodiment, a step of determining whether an input event is filtered is a specific step example of steps S604 to S605.

The MotionEvent is the current swipe input event; v is the current swipe speed, which in one example can be obtained by a tracker, in fig. 6 by calling a speed listener (class) function. Alpha is a preset speed threshold, which is one of preset filtering conditions for judging whether the swipe input event is filtered. Δt is the current time difference, and refers to the time difference between the current swipe input event and the sampling point moment of the last swipe input event. Beta is a preset time difference threshold, which is one of preset filtering conditions for judging whether the stroke input event is filtered. Δθ is the current angle difference, referring to the angle difference between the swipe angle of the current swipe input event and the last swipe input event. Δd is the current distance, which is the distance difference between the current swipe input event and the sampling point where the last swipe input event occurred. The current bending degree, i.e., the angular difference of the current swipe input event compared to the unit swipe distance between the last swipe input events. Gamma is a preset bending degree threshold value, delta is a preset distance threshold value, and both are one of preset filtering conditions for judging whether the stroke input event is filtered.

The preset speed threshold, the preset time difference threshold, the preset bending degree threshold and the preset distance threshold are all preset constants, and specifically, the preset speed threshold, the preset time difference threshold, the preset bending degree threshold and the preset distance threshold can be empirical values or are measured through practical experiments.

In step S701, a first swipe input event (MotionEvent) is acquired.

The first swipe input event may be a swipe input event acquired at any time. For example, the first swipe input event may be a swipe input event acquired at a certain historical time, or may be a swipe input event acquired at a current time.

Step S702, determining whether the first swipe speed of the first MotionEvent satisfies v > α, wherein if v > α, step S706 is executed, otherwise step S703 is executed.

When v > alpha, the stroking speed is larger, the acquisition point is in a high-speed motion scene, and if the event is filtered out, the loss influence of the event can be caused to control the controlled end, so that further judgment is needed.

If the first swipe speed v of the first swipe event is less than or equal to alpha, the swipe speed is smaller and is in a low-speed scene, and then the next judgment is carried out.

Step S703, calculating a difference Δt between the acquisition time of the first MotionEvent and the last unfiltered MotionEvent, and determining whether Δt > β is satisfied, wherein if Δt > β, step S705 is executed, otherwise step S704 is executed.

If delta t > beta, the time difference of the first stroke input event is larger than that of the previous unfiltered stroke input event of the first stroke input event, the first stroke input event has actual input meaning, and the first stroke input event is sent to the controlled equipment;

if Δt is less than or equal to β, the time difference of the first swipe input event is smaller than that of the previous unfiltered swipe input event, the first swipe input event does not have an actual input meaning, and the first swipe input event is filtered.

Step S704, filter the first MotionEvent.

Step S705, the first MotionEvent is sent to the controlled device.

Step S706, calculating the difference between the speed direction of the first MotionEvent and the speed direction of the last unfiltered MotionEven to obtain a first angle difference delta theta; calculating the distance between the first MotionEvent and the sampling point position of the last unfiltered MotionEven to obtain a first distance delta d, a step of; judging whether or not to meetWherein if->Step five is performed, otherwise step seven is performed. />

If it isThe bending degree (bending degree) of the first stroke input event is larger than that of the previous stroke input event, the first stroke input event has actual input meaning, and the first stroke input event is sent to the controlled equipment;

if it isThe bending degree of the first stroke input event is smaller than that of the previous stroke input event, and the next judgment is carried out.

Step S707, determining whether Δd > δ is satisfied, wherein if Δd > δ, step S705 is performed, otherwise step S704 is performed.

If delta d > delta, the distance between the first stroke input event and the last stroke input event is larger, the first stroke input event has actual input meaning, and the first stroke input event is sent to the controlled equipment;

if Δd is less than or equal to δ, the distance between the first swipe input event and the last swipe input event is smaller, the first swipe input event does not have an actual input meaning, and the first swipe input event is filtered.

Specifically, a detailed description of the first angle difference and the first distance is shown in fig. 8.

Wherein v1, v2, v3, v4 respectively represent the stroke direction and the stroke speed of the first stroke input event, the second stroke input event, the third stroke input event, and the fourth stroke input event in order. Δθ1 is an angle difference in the stroke direction between the first stroke input event and the second stroke input event, and Δθ2 is an angle difference in the stroke direction between the third stroke input event and the fourth stroke input event; Δd1 is the distance of the sampling point between the first and second swipe input events, and Δd2 is the distance of the sampling point between the third and fourth swipe input events.

The embodiment of the application also provides an input event transmission method which is applied to the first terminal equipment, and the first terminal equipment is in communication connection with the second terminal equipment; the method comprises the following steps:

in a first time period, responding to the movement of a handwriting pen on a first terminal device, the first terminal device transmits a first input event and a second input event to a second terminal device, no other input event is transmitted between the first input event and the second input event, the transmission time of the first input event and the transmission time of the second input event are different by a first duration, and the movement speed of the handwriting pen is a first speed;

in a second time period, responding to the sliding of the handwriting pen on the first terminal device, and sending a third input event and a fourth input event to the second terminal device by the first terminal device, wherein no other input event is sent between the third input event and the fourth input event, and the sending time of the third input event and the sending time of the fourth input event are different by a second duration; the speed of handwriting stroke is a second speed, the first speed is smaller than the second speed, and the first time length is longer than the second time length;

in a third time period, responding to the sliding of the handwriting pen on the first terminal device, the first terminal device sends a fifth input event and a sixth input event to the second terminal device, no other input event is sent between the fifth input event and the sixth input event, the sending time of the fifth input event and the sending time of the sixth input event are different by a third duration, in the third time period, the speed of handwriting pen moving is a third speed, the third speed is smaller than the second speed, and the third duration is longer than the second duration.

The first terminal device may be a control terminal device, the second terminal device may be a controlled terminal device, and the first terminal device and the second terminal device may communicate over a wide area network. In a first time period, the user controls the stylus to slide on the first terminal device at a first speed, the first terminal device is spaced apart by a first time period, the first input event and the second input event are sent to the second terminal device, and no other input event is sent to the second terminal device by the first terminal device between the first input event and the second input event.

In one possible implementation manner, taking the first terminal device as a tablet computer, the input device as a handwriting pen, and the second terminal device as a Windows system PC as an example for illustration. The tablet personal computer and the PC are connected based on a WebRTC (Web Real-Time Communications) channel through a wide area network, so that remote communication of the tablet personal computer and the PC is realized, and remote control application programs are operated on the tablet personal computer and the PC, so that remote control of the tablet personal computer on the PC is realized. The tablet computer can collect input events according to a preset sampling frequency; the preset sampling frequency can be set in a self-defined manner according to practical situations, for example, 5, 10, 20 input events are acquired per second, etc.

In one example, the stylus is stroked on the tablet computer at a first speed within a first time period, the first speed is less than a preset speed threshold, that is, the stylus is moving at a slower speed, a first input event is acquired at a first time, a sampling point time (a second time) of a last unfiltered input event is acquired, a time difference between the first input event and the last input event is large, a preset time difference threshold is exceeded (the first time-the second time > the preset time difference threshold), and the tablet computer sends the first input event to the PC. And acquiring an input event at a third moment, acquiring the acquisition point moment (first moment) of the previous unfiltered stroking input event (first input event), wherein the interval time difference between the currently acquired input event and the first input event is smaller, the preset time difference threshold is not exceeded (the third moment-first moment is less than or equal to the preset time difference threshold), and the tablet personal computer filters the currently acquired input event. The method comprises the steps that a second input event is acquired at a fourth moment, the acquisition point moment (first moment) of a last unfiltered input event (first input event) is acquired, the interval time difference between the second input event and the first input event is larger, a preset time difference threshold value (fourth moment-first moment > preset time difference threshold value) is exceeded, the tablet personal computer sends the second input event to the PC, and the sending time of the first input event and the sending time of the second input event differ by a first duration. Corresponds to the logic of S701, S702, S703, S704, S705 in the above-described embodiment.

In a second time period, the user controls the stylus to slide on the first terminal device at a second speed, the first terminal device is spaced apart by a second time period, a third input event and a fourth input event are sent to the second terminal device, and no other input event is sent to the second terminal device by the first terminal device between the third input event and the fourth input event. As can be seen from the above logic for filtering sliding input events, based on the first speed being lower than the second speed, the input events filtered in the first period are more than the input events filtered in the second period, so that the time interval between two input events sent adjacently in the first period is longer than the time interval between two input events sent adjacently in the second period, i.e. the first period is longer than the second period.

In one example, the stylus is stroked on the tablet computer at a second speed within a second time period, where the second speed is greater than a preset speed threshold, that is, the stylus moves faster, and a third input event is acquired at a fifth time, where a sampling point position of the third input event is (x 1, y 1), and a sampling point position of a last unfiltered input event is (x 2, y 2). Calculating the distance between (x 1, y 1) and (x 2, y 2) to obtain a first distance, wherein the first distance is larger than a preset distance threshold value, and the tablet computer sends a third input event to the PC. And acquiring a fourth input event at the sixth moment, wherein the acquisition point position of the fourth input event is (x 4, y 4), and acquiring the acquisition point position of the last unfiltered stroking input event (third input event) is (x 1, y 1). Calculating the distance between (x 1, y 1) and (x 4, y 4) to obtain a third distance, wherein the third distance is larger than a preset distance threshold value, and the tablet computer sends a fourth input event to the PC. Corresponds to the logic of S707 in the above embodiment.

In a third time period, the user controls the stylus to slide on the first terminal device at a third speed, the first terminal device is spaced apart by a third time period, a fifth input event and a sixth input event are sent to the second terminal device, and no other input event is sent to the second terminal device by the first terminal device between the fifth input event and the sixth input event. Based on the third speed being less than the second speed, the filtered input events in the third period are more than the filtered input events in the second period, so that the time interval between two input events sent adjacently in the third period is greater than the time interval between two input events sent adjacently in the second period, i.e. the third time period is greater than the second time period.

In one example, the stylus is stroked on the tablet computer at a third speed within a third time period, where the third speed is greater than the preset speed threshold, that is, the stylus moves faster, and a fifth input event is collected at a seventh time, where a sampling point position of the fifth input event is (x 5, y 5), and a sampling point position of a last unfiltered input event is (x 6, y 6). Calculating the distance between (x 5, y 5) and (x 6, y 6) to obtain a fourth distance, wherein the fourth distance is larger than a preset distance threshold value, and the tablet computer sends a fifth input event to the PC. At the eighth moment, an input event is acquired, the acquisition point position of the input event is (x 7, y 7), and the acquisition point position of the last unfiltered input event (fifth input event) is (x 5, y 5). Calculating the distance between (x 5, y 5) and (x 7, y 7) to obtain a fifth distance, wherein the fifth distance is smaller than a preset distance threshold value, and the tablet computer filters out the input event. And acquiring a sixth input event at the ninth moment, wherein the acquisition point position of the sixth input event is (x 8, y 8), and acquiring the acquisition point position of the last unfiltered stroking input event (fifth input event) is (x 5, y 5). Calculating the distance between (x 5, y 5) and (x 8, y 8) to obtain a sixth distance, wherein the sixth distance is larger than a preset distance threshold value, and the tablet computer sends a sixth input event to the PC. Corresponds to the logic of S707 in the above embodiment.

It will be appreciated that in this embodiment, the filtering relationship between the sliding speed of the stylus and the input event is described, and the bending degree of the first track (the track of the stylus in the first period) and the bending degree of the second track (the track of the stylus in the second period) are not considered, and may be considered to be the same or approximately the same.

In one possible embodiment, the method further comprises:

in a fourth time period, responding to the sliding of the handwriting pen on the first terminal device, the first terminal device transmits a seventh input event and an eighth input event to the second terminal device, no other input event is transmitted between the seventh input event and the eighth input event, the transmission time of the seventh input event and the transmission time of the eighth input event are different by a fourth duration, and in the fourth time period, the track of handwriting stroke movement is a fourth track;

in a fifth period, responding to sliding of the handwriting pen on the first terminal device, the first terminal device transmits a ninth input event and a tenth input event to the second terminal device, no other input event is transmitted between the ninth input event and the tenth input event, the transmission time of the ninth input event and the tenth input event is different by a fifth duration, and in the fifth period, the track of handwriting pen movement is a fifth track; the fourth track has a degree of curvature less than the fifth track, and the fourth length of time is greater than the fifth length of time.

In a fourth time period, the user controls the handwriting pen to slide on the first terminal device in a fourth track, the first terminal device transmits a seventh input event and an eighth input event to the second terminal device at intervals of the fourth time period, and the first terminal device does not transmit other input events to the second terminal device between the seventh input event and the eighth input event.

In one example, the stylus is stroked on the tablet computer at a fourth speed during a fourth period of time, the fourth speed being greater than the predetermined speed threshold, i.e., the stylus is moving faster. And acquiring a seventh input event at the tenth moment, wherein the angle between the motion direction of the handwriting pen and the preset direction is theta 1, the acquisition point position of the seventh input event is (x 9, y 9), the angle theta 2 between the motion direction of the last unfiltered input event and the preset direction is acquired, and the acquisition point position is (x 10, y 10). Calculating the distance between (x 10, y 10) and (x 9, y 9) to obtain a seventh distance, calculating the angle between theta 1 and theta 2 to obtain a first angle difference, and calculating the ratio of the first angle difference to the seventh distance to obtain a first bending degree; the first bending degree is greater than a preset bending degree threshold, that is, the bending degree of the seventh input event is greater than that of the last unfiltered input event, and the tablet computer transmits the seventh input event to the PC.

An input event is acquired at the eleventh moment, at this moment, the angle between the motion direction of the stylus and the preset direction is θ3, the acquisition point position of the input event is (x 11, y 11), the angle θ1 between the motion direction of the last unfiltered input event (seventh input event) and the preset direction is acquired, and the acquisition point position is (x 9, y 9). Calculating the distance between (x 11, y 11) and (x 9, y 9) to obtain an eighth distance, calculating the angle between theta 1 and theta 3 to obtain a second angle difference, and calculating the ratio of the second angle difference to the eighth distance to obtain a second bending degree; the second bending degree is less than or equal to a preset bending degree threshold, namely the bending degree of the input event is smaller than that of the seventh input event, and the tablet personal computer filters out the input event.

An eighth input event is acquired at the twelfth moment, at this moment, the angle between the motion direction of the stylus and the preset direction is θ4, the acquisition point position of the eighth input event is (x 12, y 12), the angle θ1 between the motion direction of the last unfiltered input event (seventh input event) and the preset direction is acquired, and the acquisition point position is (x 9, y 9). Calculating the distance between (x 12, y 12) and (x 9, y 9) to obtain a ninth distance, calculating the angle between theta 1 and theta 4 to obtain a third angle difference, and calculating the ratio of the third angle difference to the ninth distance to obtain a third bending degree; the third bending degree is larger than a preset bending degree threshold, namely the bending degree of the eighth input event is larger than that of the seventh input event, and the tablet computer sends the eighth input event to the PC. Corresponds to the logic of S706 in the above embodiment.

In a fifth time period, the user controls the stylus to slide on the first terminal device with a fifth track, the first terminal device is spaced by a fifth time period, a ninth input event and a tenth input event are sent to the second terminal device, and no other input event is sent to the second terminal device by the first terminal device between the ninth input event and the tenth input event. The logic for filtering sliding input events can know that based on the bending degree of the fourth track being smaller than that of the fifth track, the filtered input events in the fourth period are redundant to the filtered input events in the fifth period; the time interval between two input events sent adjacently in the fourth period is thus greater than the time interval between two input events sent adjacently in the fifth period, i.e. the fourth time period is greater than the fifth time period.

In one example, the stylus is stroked on the tablet computer at a fifth speed during a fifth time period, the fifth speed being greater than the preset speed threshold, i.e., the stylus is moving faster. And acquiring a ninth input event at thirteenth moment, wherein the angle between the motion direction of the handwriting pen and the preset direction is theta 5, the acquisition point position of the ninth input event is (x 13, y 13), the angle theta 6 between the motion direction of the last unfiltered input event and the preset direction is acquired, and the acquisition point position is (x 14, y 14). Calculating the distance between (x 13, y 13) and (x 14, y 14) to obtain a tenth distance, calculating the angle between theta 6 and theta 5 to obtain a fourth angle difference, and calculating the ratio of the fourth angle difference to the tenth distance to obtain a fourth bending degree; the fourth bending degree is greater than the preset bending degree threshold, that is, the bending degree of the ninth input event is greater than that of the last unfiltered input event, and the tablet computer transmits the ninth input event to the PC.

A tenth input event is acquired at the fourteenth moment, at this time, the angle between the motion direction of the stylus and the preset direction is θ7, the acquisition point position of the tenth input event is (x 15, y 15), the angle θ5 between the motion direction of the last unfiltered input event (the ninth input event) and the preset direction is acquired, and the acquisition point position is (x 13, y 13). Calculating the distance between (x 13, y 13) and (x 15, y 15) to obtain an eleventh distance, calculating the angle between theta 7 and theta 5 to obtain a fifth angle difference, and calculating the ratio of the fifth angle difference to the eleventh distance to obtain a fifth bending degree; the fifth bending degree is greater than the preset bending degree threshold, namely, the bending degree of the tenth input event is greater than that of the ninth input event, and the tablet computer sends the tenth input event to the PC. Corresponds to the logic of S706 in the above embodiment.

It will be appreciated that in this embodiment, the magnitude of the sliding speed is not considered for the purpose of illustrating the filtering relationship between the bending degree of the handwriting track and the input event, and the sliding speed of the handwriting pen in the fourth period and the fifth period may be considered to be the same or approximately the same.

In the embodiment of the application, the current scratching speed of the current scratching event input by the control end is judged, when the current scratching speed exceeds the preset speed threshold, the current scratching event is indicated to be in a high-speed scene, at the moment, the current bending degree of the current scratching event and the current scratching input event transmitted to the controlled equipment last time is considered, when the current bending degree exceeds the preset bending degree threshold, the bending degree is considered to be larger, the current scratching event does not meet the filtering condition, the actual input meaning is achieved, and the current scratching event is transmitted to the controlled equipment, so that the controlled equipment realizes input; when the current bending degree does not exceed the preset bending degree threshold under the high-speed scene, the current distance between the current sampling point position of the current scratching event and the previous sampling point position of the previous scratching input event is considered, and when the current distance exceeds the preset distance threshold, the current scratching event is considered not to meet the filtering condition, so that the actual input meaning is achieved, and the current scratching event is sent to the controlled equipment, so that the controlled equipment realizes input.

When the current sliding speed does not exceed the preset speed threshold, the current sliding event is indicated to be in a low-speed scene, only the current time difference between the current sampling point moment of the current sliding event and the last sampling point moment of the last sliding input event is considered, and when the current time difference exceeds the preset time difference threshold, the current sliding event is considered to not meet the filtering condition, the current sliding event has practical input significance, and the current sliding event is sent to the controlled equipment, so that the controlled equipment realizes input. Except the above cases, the current swipe event is considered to meet the filtering condition and has no actual input meaning, and is filtered.

Therefore, the main factors influencing the scratching precision in the scratching process can be grasped, the event transmission of the control end to the controlled equipment in the remote control process is reduced as much as possible under the condition of ensuring the scratching effect, the load of a network channel is reduced, the possibility of channel blocking for the network channel is reduced, the transmission delay probability of an input event is reduced, and the occurrence of abnormal conditions such as slow response of the remote control is reduced as much as possible.

In an embodiment of the present application, in practical application, log verification may be added to the above method for transmitting input events, and for an input device (for example, a handwriting pen) with a higher report rate, most of the input events may be filtered in a conventional input scenario. (illustratively, 60% of the input events may be filtered).

The log verification may capture the point data of the input device acquired by the control end device and the point data acquired by the controlled device, where the point data may include, for example, the point coordinates of the stroke input event, the point time, and so on. Specifically, when the control end device is Android system device, the adb (Android Debug Bridge, debug bridge) tool can be used for capturing the report point data of the reported stroke input event driven by the input device in the driving layer; when the controlled device is Windows system device, the report point data of the scratch input event received by the network channel receiving end can be grabbed by writing a special application and Windows api (Windows system function).

In one embodiment of the present application, as shown in fig. 9, there is further provided an input event transmission apparatus, applied to a control end, where the apparatus includes:

the event obtaining module 901 is configured to obtain a current swipe input event when the control end remotely controls the controlled device, where the current swipe input event includes at least one of the following information: current rowing speed, current rowing direction, current picking point moment and current picking point position;

an event processing module 902, configured to filter the current swipe input event if the current swipe input event meets a preset filtering condition; otherwise, the current stroke input event is sent to the controlled device.

The input event transmission device provided by the embodiment of the application is applied to a control end, under the condition that the control end remotely controls controlled equipment, the current scratching input event of the control end is obtained, the obtained current scratching input event comprises at least one item of information such as the current scratching speed, the current scratching direction, the current mining point moment, the current mining point position and the like, then under the condition that the current scratching input event meets preset filtering conditions, the current scratching input event is filtered, and otherwise, the current scratching input event is sent to the controlled equipment, so that the controlled equipment is controlled. The number of the current swipe input events which meet the preset filtering conditions can be reduced, and therefore the load of a network channel can be reduced.

the event processing module 902 is specifically configured to:

In one embodiment of the present application, the event processing module 902 is specifically configured to:

the event processing module 902 is specifically configured to:

The input event transmission device provided by the embodiment of the application can grasp main factors influencing the scratching precision in the scratching process, reduce the event transmission of the control end to the controlled equipment in the remote control process as much as possible under the condition of ensuring the scratching effect, reduce the load of a network channel, and reduce the possibility of channel blockage to the network channel, thereby reducing the transmission delay probability of the input event and reducing the occurrence of abnormal conditions such as slow response of the remote control as much as possible

In yet another embodiment provided herein, there is also provided a computer readable storage medium having stored therein a computer program which when executed by a processor implements the steps of any of the above-described speech input methods.

In yet another embodiment provided herein, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform any of the voice input methods of the above embodiments.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the apparatus, electronic device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and references to the parts of the description of the method embodiments are only required.

The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the present application. Any modifications, equivalent substitutions, improvements, etc. that are within the spirit and principles of the present application are intended to be included within the scope of the present application.

Claims

1. An input event transmission method is characterized by being applied to first terminal equipment, wherein the first terminal equipment is in communication connection with second terminal equipment;

the method comprises the following steps:

2. The method according to claim 1, wherein the method further comprises:

3. The method according to claim 1, wherein the method further comprises:

under the condition that the first stroke input event meets a preset filtering condition, the first stroke input event is not sent to the second terminal equipment; otherwise, the first swipe input event is sent to the second terminal device.

4. The method of claim 3, wherein the first swipe input event comprises the first swipe speed, the first swipe direction, and the first pick point location;

under the condition that the first stroke input event meets a preset filtering condition, the first stroke input event is not sent to the second terminal equipment; otherwise, the first swipe input event is sent to the second terminal device, including:

5. The method according to claim 4, wherein the first swipe input event is not sent to the second terminal device if the first swipe input event meets a preset filtering condition; otherwise, the first swipe input event is sent to the second terminal device, including:

If the first bending degree does not exceed a preset bending degree threshold value and the first distance does not exceed a preset distance threshold value, the first swipe input event is not sent to the second terminal device;

6. The method of claim 3, wherein the first swipe input event comprises the first swipe speed and the first point of acquisition time;

under the condition that the time difference between the first sampling point time and the last sampling point time does not exceed a preset time difference threshold, the scratching input event is not sent to the second terminal equipment;

7. The method of claim 1, wherein the first terminal device remotely controls the second terminal device via a wide area network.

8. An input event transmission method, which is applied to a control end, comprising:

under the condition that the current stroke input event meets a preset filtering condition, the current stroke input event is not sent to the second terminal equipment; otherwise, the current stroke input event is sent to the controlled device.

9. An electronic device, comprising:

a memory for storing a computer program;

a processor for implementing the method of any of claims 1-8 when executing a program stored on a memory.

10. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when executed by a processor, implements the method of any of claims 1-8.