CN110262744B

CN110262744B - Switching method of touch device, terminal equipment and storage medium

Info

Publication number: CN110262744B
Application number: CN201910420088.5A
Authority: CN
Inventors: 黄振宇
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2019-05-20
Filing date: 2019-05-20
Publication date: 2022-12-09
Anticipated expiration: 2039-05-20
Also published as: CN110262744A

Abstract

The application relates to the field of touch interaction, and aims to solve the problem that in the prior art, after a touch device of a terminal device is switched to an external device, the external device cannot normally use the touch device, and therefore the processing performance of the terminal device is wasted.

Description

Switching method of touch device, terminal equipment and storage medium

Technical Field

The present application relates to the field of computers, and in particular, to a switching method for a touch device, a terminal device, and a storage medium.

Background

In a multi-screen interaction scene based on touch operation, the terminal equipment needs to keep synchronization of video signals with external equipment, so that the terminal equipment and the external equipment display the same user interface, and the terminal equipment immediately transfers the control right of the touch device to the external equipment while synchronizing the video signals, so that a user can perform touch operation on the external equipment through the terminal equipment. In the course of implementing the present application, the applicant has found that there are at least the following problems in the prior art: after the touch device of the terminal device is handed over to the external device, the external device cannot correctly analyze the data packet generated by the touch device due to reasons such as hardware support or incompatibility, so that the function of controlling the external device through the terminal device cannot be realized, and the controller of the touch device needs to be handed over to the terminal device again in the following process.

Disclosure of Invention

The application provides a switching method of a touch device, a terminal device and a storage medium, which can realize that the switching of the touch device is executed only when the connection between the touch device and an external device is established, and avoid the problem that the switched touch device cannot normally communicate with the external device, thereby saving the processing overhead of a second terminal device and reducing the problem of processing performance reduction caused by the waste of computing resources of the terminal device.

In a first aspect, the present application provides a switching method of a touch device, including: when the first terminal equipment switches an input video signal source to the second terminal equipment, the first terminal equipment detects the connection state of the touch device and the second terminal equipment, and the first terminal equipment comprises the touch device; if so, the first terminal device switches the touch device to the second terminal device, and the first terminal device sends a data packet to the second terminal device, where the data packet is generated by the touch device according to the touch event. Touch devices include, but are not limited to, touch screens, touch pads, or touch frames. The first terminal device switching the input video signal source to the second terminal device means that the first terminal device receives the video signal from the second terminal device and displays the video signal on a display unit, the display unit including a display screen.

In one possible embodiment, the first terminal device is connected to the second terminal device via the control data interface, and the data packet is sent to the second terminal device via the control data interface.

In one possible design, the control data interface is a USB interface;

the first terminal equipment detects whether the connection is established between the touch device and the second terminal equipment or not, and the method comprises the following steps:

measuring whether a signal level value on a power supply pin on the USB interface is greater than a level threshold value, if so, determining that the touch device is connected with second terminal equipment through the USB interface; or

Measuring whether a signal level value on a power supply pin in the USB interface is not greater than a level threshold value, if so, determining that the touch device is connected with second terminal equipment through the USB interface; or

And measuring whether the signal waveform on the power pin in the USB interface is matched with the preset waveform within the preset time, and if so, determining that the touch device is connected with the second terminal equipment through the USB interface.

In one possible design, before the first terminal device detects a connection state between the touch device and the second terminal device when the first terminal device switches the input video signal source to the second terminal device, the method further includes:

the first terminal equipment receives a first request message from the second terminal equipment; the first request message is used for requesting to switch an input video signal source of the first terminal device to the second terminal device;

the first terminal equipment sends a first response message to the second terminal equipment; the first response message carries switching permission indication information, and the switching permission indication information indicates that the first terminal equipment allows the input video signal source to be switched to the second terminal equipment.

In one possible design, the first request message includes one or more of identification information of the second terminal device, a resolution of a video signal of the second terminal device, a bitrate of the video signal of the second terminal device, and a format of the video signal of the second terminal device.

In one possible design, the first terminal device receives a video signal from the second terminal device through a video data interface, where the video data interface includes a High Definition Multimedia Interface (HDMI), a Video Graphics Array (VGA) interface, or a digital video interface (digital video interface).

In one possible design, further comprising:

and if the first terminal equipment detects that the connection between the touch device and the second terminal equipment is not established, maintaining the current connection state of the touch device.

In one possible design, the length of the data packet is related to the number of touch points corresponding to the touch event.

In a second aspect, the present application provides a terminal device, where the terminal device includes a touch device, and the terminal device further includes: a transceiving unit and a processing unit.

The processing unit is used for detecting the connection state between the touch device and the second terminal equipment under the condition that the input video signal source is switched to the second terminal equipment; wherein the first terminal device comprises a touch device;

the processing unit is further configured to switch the touch device to the second terminal device if the touch device and the second terminal device are in a connected state;

a transceiving unit, configured to send a data packet to the second terminal device; wherein the data packet is generated by the touch device according to a touch event.

In one possible design, the transceiver unit establishes a connection with the second terminal device through a control data interface, and the data packet is sent to the second terminal device through the control data interface.

In one possible design, the control data interface is a Universal Serial Bus (USB) interface;

the processing unit detecting whether the connection between the touch device and the second terminal device is established includes:

measuring whether a signal level value of a power supply pin in the USB interface is greater than a level threshold value, if so, determining that the touch device is connected with the second terminal equipment through the control data interface; or

Measuring whether a signal level value of a power supply pin in the USB interface is not greater than a level threshold value, if so, determining that the touch device is connected with the second terminal equipment through the USB interface; or

And measuring whether a signal waveform on a power supply pin in the USB interface is matched with a preset waveform within a preset time length, and if so, determining that the touch device is connected with the second terminal equipment through the USB interface.

In one possible design, the transceiver unit is further configured to:

receiving a first request message from the second terminal equipment; the first request message is used for indicating that the input video signal source of the first terminal equipment is requested to be switched;

sending a first response message to the second terminal equipment; wherein the first response message carries switching permission indication information, and the switching permission indication information indicates that the first terminal device allows switching an input video signal source to the second terminal device.

In one possible design, the first request message may include one or more of identification information of the second terminal device, a resolution of a video signal of the second terminal device, a bitrate of the video signal of the second terminal device, and a format of the video signal of the second terminal device.

In one possible design, the first terminal device receives the video signal from the second terminal device through a video data interface, where the video data interface includes a high definition multimedia interface HDMI, a video graphics array VGA interface, or a digital video interface DVI.

In one possible design, the processing unit is further configured to: and if the first terminal equipment detects that the connection between the touch device and the second terminal equipment is not established, maintaining the current connection state of the touch device.

In another aspect, the present application provides an apparatus, which can implement the switching method of the touch apparatus in the first aspect. For example, the apparatus may be a chip (such as a baseband chip, or a communication chip, etc.) or a processing server. The above-described method may be implemented by software, hardware, or by executing corresponding software by hardware.

In one possible implementation manner, the structure of the apparatus includes a processor, a memory; the processor is configured to support the apparatus to perform corresponding functions in the above-described communication method. The memory is used for coupling with the processor, which holds the necessary programs (instructions) and/or data for the device. Optionally, the communication apparatus may further include a communication interface for supporting communication between the apparatus and other network elements.

In another possible implementation manner, the apparatus may include a unit module that performs corresponding actions in the method.

In yet another possible implementation, the wireless communication device includes a processor and a transceiver, the processor is coupled to the transceiver, and the processor is configured to execute a computer program or instructions to control the transceiver to receive and transmit information; the processor is further configured to implement the above-described method when the processor executes the computer program or instructions. The transceiver may be a transceiver, a transceiver circuit, or an input/output interface. When the communication device is a chip, the transceiver is a transceiver or an input/output interface.

When the device is a chip, the sending unit may be an output unit, such as an output circuit or a communication interface; the receiving unit may be an input unit, such as an input circuit or a communication interface. When the communication device is a network device, the sending unit may be a transmitter or a transmitter; the receiving unit may be a receiver or a receiver.

Yet another aspect of the present application provides an apparatus, comprising: a memory and a processor; wherein the memory stores a set of program codes, and the processor is configured to call the program codes stored in the memory and execute the method of the aspects.

Yet another aspect of the present application provides a computer-readable storage medium having stored therein instructions, which when executed on a computer, cause the computer to perform the method of the above-described aspects.

Yet another aspect of the present application provides a computer program product containing instructions which, when run on a computer, cause the computer to perform the method of the above-described aspects.

According to the method and the device, when the first terminal equipment switches the input video signal source to the second terminal equipment, the first terminal equipment can switch the touch device to the second terminal equipment only when detecting that the connection is established between the touch device and the second terminal equipment, and the problem that the processing cost of the first terminal equipment is wasted due to the fact that the second terminal equipment detects that the touch device is unavailable after the touch device in the prior art is switched to the second terminal equipment is solved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1A is a schematic structural diagram of a multi-screen interworking system provided in the present application;

fig. 1B is a schematic interface diagram of a first terminal device and a second terminal device provided in the present application

Fig. 2 is a schematic flowchart of a switching method of a touch device provided in the present application;

fig. 3 is another schematic flow chart of a switching method of a touch device provided in the present application;

fig. 4 is a schematic diagram illustrating a switching principle of a video channel of a first terminal device provided in the present application;

fig. 5 is an interaction diagram of a switching method of a touch device provided in the present application;

FIG. 6 is another interaction diagram of a switching method of a touch device provided in the present application;

fig. 7 is a schematic structural diagram of a terminal device provided in the present application;

fig. 8 is another schematic structural diagram of a terminal device provided in the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

Fig. 1A is a schematic structural diagram of a multi-screen interaction system according to an embodiment of the present application, where the multi-screen interaction system includes a first terminal device and at least one second terminal device. Taking fig. 1A as an example, the multi-screen interaction system includes: the terminal device comprises a terminal device 10, a terminal device 11, a terminal device 12 and a terminal device 13, wherein the terminal device 10 is a first terminal device, and the terminal devices 11-13 are all second terminal devices. The first terminal device and the second terminal device may be in communication connection in a wireless manner, or may be in communication in a wired manner, for example: wireless means including but not limited to Wireless-Fidelity (WiFi), bluetooth or infrared means for communication; wired means include, but are not limited to: USB, ethernet or RS232 bus, etc. The number and form of each terminal device in fig. 1A are merely examples, and do not limit the embodiments of the present application.

In this application, the second terminal device is also referred to as an external video channel, the first terminal device can be connected to multiple external video channels simultaneously, and one external video channel is selected as an input video signal source among the multiple external video channels. The video signal from the first terminal device is called an internal video channel, for example: the internal video channel includes a video signal generated by a video chip of the first terminal device.

The first terminal device in the present application is a terminal device with a touch device, the touch device includes a touch controller and a touch panel, and the touch surface is not limited to a touch pad, a touch screen or a touch frame. The user carries out touch operation on the touch plane, the touch operation can be single-point touch operation or multi-point touch operation, the touch controller detects a touch event corresponding to the touch operation, and a data packet is generated according to the touch event. The second terminal device may be a terminal device with a touch device or may not be a terminal device with a touch device. In the following description, for the sake of simplifying the description, a touch operation of a touch device by a user refers to a touch operation of a touch surface of the touch device.

The data types transmitted by the first terminal device and the second terminal device include control data and service data, the control data includes a data packet for control generated according to the touch event, and also includes other data packets for control, for example: the data packet is used for switching the input video signal source and the touch device, and the service data of the application comprises the video signal. The control data and the service data may be transmitted through the same data interface, or may be transmitted through independent data interfaces, which is not limited in the present application.

For example, referring to fig. 1B, the terminal device 10 is a first terminal device, the terminal device 12 is a second terminal device, and the terminal device 10 and the terminal device 12 communicate with each other through a video data interface and a control data interface, where the video data interface is used for transmitting video signals and the control data interface is used for transmitting control signals, for example: a data packet generated from a touch event or a data packet for an activation generation generated by a processor.

The first terminal device and the second terminal device in the present application include, but are not limited to, a service device, a personal computer, a tablet computer, a handheld device, a vehicle-mounted device, a wearable device, a computing device or other processing device connected to a wireless modem, and the like. The terminal devices in different networks may be called different names, for example: user equipment, access terminal, subscriber unit, subscriber station, mobile station, remote terminal, mobile device, user terminal, wireless communication device, user agent or user equipment, cellular telephone, cordless telephone, session Initiation Protocol (SIP) telephone, wireless Local Loop (WLL) station, personal Digital Assistant (PDA), terminal equipment in a 5G network or future evolution network, and the like.

Referring to fig. 2, fig. 2 is a schematic flowchart of a switching method of a touch device provided in the present application, where the method includes:

s201, when the first terminal device switches the input video signal source to the second terminal device, the first terminal device detects the connection state between the touch device and the second terminal device.

Specifically, the first terminal device includes a touch device, the touch device includes a touch surface and a touch controller, the touch surface is not limited to a touch pad, a touch frame or a touch screen, a user performs a touch operation on the touch surface, and the touch controller detects a touch event and generates a data packet according to the touch event. The input video signal source is switched to the second terminal device, which means that the video signal of the second terminal device is output to the first terminal device, and the first terminal device displays the video signal on a display unit (such as a display screen, a projection screen and the like) so as to realize the synchronization of the user interface of the first terminal device and the user interface of the second terminal device.

Before the input video signal source of the first terminal device is switched, the input video signal source may be other terminal devices or may be the first terminal device (i.e., a video signal generated by the first terminal device). Under the condition that the first terminal device and the second terminal device have the capability of transmitting the video signal, the trigger of the input video signal source of the first terminal device may be the first terminal device itself or the second terminal device, and the application is not limited.

The connection state between the touch device and the second terminal device specifically refers to a connection state between the touch device and a processor of the second terminal device, and the connection state includes: the connected state represents that the touch device can be in normal communication with a processor of the second terminal equipment, and the touch device can be sent to the processor of the second terminal equipment for processing according to a data packet of a touch event; the unconnected state indicates that the touch device cannot normally communicate with the processor of the second terminal device, and the unconnected state may be caused by incompatibility between the touch device and the processor of the second terminal device, or by the fact that the processor of the second terminal device is bound with a touch device and cannot be bound with a touch device again, or by the fact that a communication link between the touch device and the second terminal device is disconnected.

For example, referring to fig. 1, when the current input video signal source of the terminal device 10 is the terminal device 10, and the terminal device 10 switches the current input video signal source from the terminal device 10 to the terminal device 12, the terminal device 10 detects the connection state between the touch device and the terminal device 12.

For another example, referring to fig. 1, when the terminal is the current video input source of the terminal device 11, and the terminal device 10 switches the current input video signal source from the terminal device 11 to the terminal device 13, the terminal device 10 detects the connection state between the touch devices and the terminal device 13.

And S202, if the connection is established between the touch device and the second terminal equipment, switching the touch device to the second terminal equipment.

Specifically, it is determined according to the detection result of S201 that a connection is established between the touch device and the second terminal, that is, the connection state between the touch device and the second terminal device is a connected state, the first terminal device switches the touch device to the second terminal device, that is, the control right of the touch device is handed over to the second terminal device, so that the touch device of the first terminal device and the second terminal device are bound, and the user device performs a touch operation on the touch device to control the second terminal device.

S203, the first terminal device sends the data packet to the second terminal device.

Specifically, after the touch device is switched to the second terminal device, the user performs a touch operation on the touch device, where the touch operation may be a single-point touch operation or a multi-point touch operation, the touch device detects a touch event corresponding to the touch operation, generates a data packet according to the touch event, the touch device sends the data packet to the second terminal device, and a processor of the second terminal device receives the data packet, parses the data packet, identifies a corresponding touch gesture, and executes a corresponding operation according to the touch gesture.

For example, a touch operation detected on the touch device corresponds to a touch point 1 and a touch point 2, the touch point 1 and the touch point 2 are in a relative motion trend, the touch device generates a data packet according to attribute information of the two touch points, the attribute information of the touch points includes but is not limited to one or more of identification of the touch points, states of the touch points, position information of the touch points and size information of the touch points, the identification information of the touch points identifies identities of the touch points, and different touch points have different identification information; the position information of the touch point indicates the position of the touch point on the touch device, typically expressed in X and Y coordinates; the size information of the touch point indicates the size of the touch point on the touch device, and may be generally expressed using a bandwidth and a length, which are in units of pixels. The second terminal device receives a data packet from the touch device of the first terminal device, analyzes attribute information of the touch point 1 and the touch point 2 carried in the data packet, recognizes that the touch gesture is a reduction gesture according to the attribute information of the two touch points, and performs reduction operation on a target object on the current user interface.

According to the method and the device, when the first terminal equipment switches the input video signal source to the second terminal equipment, the first terminal equipment can switch the touch device to the second terminal equipment only when detecting that the connection is established between the touch device and the second terminal equipment, the problem that the processing cost of the first terminal equipment is wasted due to the fact that the second terminal equipment detects that the touch device is unavailable after the touch device in the prior art is switched to the second terminal equipment is solved, the processing cost of the first terminal equipment is saved, and the loss of processing performance caused by the fact that the touch device is unnecessarily switched is reduced.

Referring to fig. 3, another schematic structural diagram of a switching method of a touch device according to an embodiment of the present application is provided, in which the method includes:

s301, the first terminal device receives a first request message from the second terminal device.

Specifically, the first request message is used to request to switch an input video signal source of the first terminal device to the second terminal device, and the first request message may be sent by the second terminal device through a control data interface, where the control data interface is used to transmit control data between the first terminal device and the second terminal device, for example: the control data interface includes a USB interface, an RS232 interface, and the like, which is not limited in the present application.

In a possible implementation, the first request message includes one or more of identification information of the second terminal device, a resolution of a video signal output by the second terminal device, a bitrate of the video signal output by the second terminal device, and a format of the video signal output by the second terminal device. The video signal output by the second terminal device is used for displaying the user interface of the second terminal device, so that the user interface displayed by the first terminal device and the user interface of the second terminal device are kept synchronous. The identification information of the second terminal device is used to indicate the identity of the second terminal device, and the identification information of the second terminal device includes, but is not limited to, one or more of a (media access control address, MAC) address, an IP address, or an International Mobile Equipment Identity (IMEI). The code rate of the video signal represents the number of bits of video data transmitted in unit time; the resolution of the video signal represents the pixel size of the video graphics. The format of the video signal includes, but is not limited to, any one of RGB24, RGB32, YUYV, UYVY, I420, NV 12.

S302, the first terminal device sends a first response message to the second terminal device.

Specifically, the first terminal device sends a first response message to the second terminal device through the control data interface, the first terminal device judges whether the first response message matches with the video signal parameter carried in the first request message according to the device capability information, if so, the first response message generated by the first terminal device carries the switching permission indication information, and the switching permission indication information indicates that the second terminal device allows the current input video signal source to be switched to the second terminal device. The indication information of allowed handover may be represented by bitmap, and different bits are used to represent the indication information of allowed handover and the indication information of rejected handover, for example: when the bit is "1", it indicates permission of switching indication information, and when the bit is "0", it indicates rejection of switching indication information.

For example, the MAC address of the second terminal device carried in the first request message is: 00-01-6C-06-A6-29, wherein the format of the video signal is RGB24, the code rate of the video format is 1824kbps, the resolution of the video format is 1920 × 1080, the first terminal device determines whether the MAC address of the first terminal device is in the authority control list, and if so, obtains the device capability information of the first terminal device to determine: the first terminal device supports the video format of RGB24, the resolution of 1824kbps and the resolution of 1920 x 1080, and generates a first response message, wherein the first response message carries the switching permission indication information, and the switching permission indication information indicates that the input video signal source is permitted to be switched to the second terminal device.

And S303, the first terminal equipment switches the input video signal source into second terminal equipment.

Specifically, when the first terminal device allows switching the input video signal source to the second terminal device, the first terminal device cuts off the currently input video signal.

For example, referring to fig. 4, a first terminal device is provided with 2 internal device channels and 3 external video channels, assuming that an input video signal source currently used by the first terminal device is an internal video channel 1, after a period of operation, the first terminal device switches the input video signal source from the internal video channel 1 to an external video channel 1, and a processor of the first terminal device gates the external video channel 1 through a switching device, thereby implementing switching of different input video signal sources.

S304, the first terminal device receives the video signal from the second terminal device through the video data interface.

Specifically, the video signal reception is used for transmitting the video signal between the first terminal device and the second terminal device, and the video data interface includes but is not limited to: any one of HDMI, VGA, and DVI. It can be seen that in the present application, the control data interface and the video data interface between the first terminal device and the second terminal device are two separate interfaces. In another possible embodiment, the video signal and the control data may be transmitted over the same interface, which has the capability to transmit the control data and the video signal simultaneously.

S305, the first terminal device displays the video signal on the display unit.

Specifically, the first terminal device pushes a video signal from the second terminal device, which is generated by the second terminal device according to its own user interface, to the display unit for display.

S306, the first terminal device detects the connection state between the touch device and the second terminal device.

Specifically, the first terminal device is provided with a touch device, the touch device is a device for performing touch interaction by a user, the touch device comprises a touch surface and a touch controller, the interaction between the user and the touch device refers to the touch operation of the finger of the user on the touch surface, the touch controller detects a touch event on the touch surface, and a data packet is generated according to the touch event.

The connection state between the touch device and the second terminal equipment comprises a connected state and an unconnected state, the connected state represents that the touch device can normally communicate with the processor of the second terminal equipment, and the unconnected state represents that the touch device cannot normally communicate with the processor of the second terminal equipment. The reason for the unconnected state may be: the touch device is incompatible with the processor of the second terminal device, or the processor of the second terminal device is bound with other touch devices, and cannot be bound with one touch device, or the communication link between the touch device and the second terminal device is disconnected, that is, the control data interface of the first terminal device and the control data interface of the second terminal device are disconnected.

In a possible implementation manner, the control Data interface between the first terminal device and the second terminal device is a USB interface, the USB interface includes a power pin VCC, a ground pin GND, a positive Data pin + Data, and a negative Data pin-Data, and the detecting, by the first terminal device, the connection state between the touch device and the second terminal device includes: and measuring whether the signal level value of the power supply pin in the USB interface is greater than a level threshold value, and if so, determining that the touch device is connected with the second terminal equipment through the USB interface. The level threshold is a pre-stored or pre-configured value of the first terminal device, and a specific value may be set as needed, which is not limited in the present application.

In another possible implementation manner, the control Data interface between the first terminal device and the second terminal device is a USB interface, the USB interface includes a power supply pin VCC, a ground pin GND, a positive Data pin + Data, and a negative Data pin-Data, and it is measured whether a signal level value of the power supply pin in the USB interface is not greater than a level threshold, and if so, it is determined that the touch device is connected to the second terminal device through the USB interface. The level value is a value pre-stored or pre-configured by the first terminal device, and a specific value may be set according to needs, which is not limited in this application.

In another possible implementation, the control Data interface between the first terminal device and the second terminal device is a USB interface, and the USB interface includes a power pin VCC, a ground pin GND, a positive Data pin + Data, and a negative Data pin-Data; and measuring whether the signal waveform of the power supply pin in the USB interface is matched with a preset waveform, and if so, determining that the touch device is connected with the second terminal equipment through the USB interface.

And S307, the first terminal equipment switches the touch device to the second terminal equipment.

Specifically, the first terminal device transfers the control right of the touch device to the second terminal device, and the touch device redirects a data packet generated by the touch event to the second terminal device, so that the user performs a touch operation on the touch device of the first terminal device to control the second terminal device.

S308, the first terminal equipment sends the data packet to the second terminal equipment.

Specifically, a user performs a touch operation on the touch device, where the touch operation may be a single-point touch operation or a multi-point touch operation, the touch device detects a touch event corresponding to the touch operation, generates a data packet according to the touch event, the touch device sends the data packet to the second terminal device, a processor of the second terminal device receives the data packet, analyzes the data packet to identify a corresponding touch gesture, and executes a corresponding operation according to the touch gesture.

S309, the first terminal equipment keeps the current connection state of the touch device.

Specifically, when the connection state between the touch device and the second terminal device is the unconnected state, the touch device is not switched to the second terminal device, and the current connection state is maintained.

For example, the touch device is currently connected with the processor of the first terminal device, and when detecting that the touch device does not establish connection with the second terminal device, the connection between the touch device and the processor of the first terminal device is maintained.

Referring to fig. 5, an interaction schematic diagram of a switching method of a touch device provided in an embodiment of the present application is shown, where in the embodiment of the present application, the method includes:

s501, the first terminal device switches the input video signal source to the second terminal device.

Specifically, the input video signal source represents a device or an apparatus for providing a video signal for the first terminal device, and the first terminal device switches the input video signal source to the second terminal device, which represents that the second terminal device inputs the video signal to the first terminal device for displaying. The first terminal equipment comprises a touch device, the touch device comprises a touch surface and a touch controller, the touch panel comprises but not limited to a touch pad, a touch frame or a touch screen, the touch controller detects a touch event occurring on the touch surface, and generates a data packet according to the data event.

After the input video signal source of the first terminal device is switched to the second terminal device, the first terminal device receives the video signal from the second terminal device and displays the video signal on the display unit.

The current input video signal source of the first terminal device may be itself (i.e. inside the first terminal device) or another terminal device.

S502, the first terminal device detects that the connection state between the touch device and the second terminal device is a connected state.

Specifically, the first terminal device detects that the connection state between the touch device and the second terminal device includes a connected state and an unconnected state, the connected state indicates that the touch device can perform normal communication with a processor of the second terminal device, and the touch device can send a data packet of a touch event to the processor of the second terminal device for processing; the unconnected state indicates that the touch device cannot normally communicate with the processor of the second terminal device, and the unconnected state may be caused by incompatibility of the touch device and the processor of the second terminal device, or by the fact that the processor of the second terminal device is bound with a touch device and cannot bind a touch device again, or by the fact that a communication link between the touch device and the second terminal device is disconnected.

S503, the first terminal device switches the touch device to the second terminal device.

Specifically, the first terminal device switches its own touch device to the second terminal device, that is, the control right of the touch device is handed over to the second terminal device, the touch device and the second terminal device are bound, and the user device performs touch operation on the touch device to realize control over the second terminal device.

S504, the first terminal device sends a data packet to the second terminal device, and the second terminal device receives the data packet from the first terminal device.

And S505, the second terminal equipment identifies the touch gesture according to the data packet.

And S506, the second terminal equipment executes the operation corresponding to the touch gesture.

For example, a touch operation detected on the touch device corresponds to a touch point 1 and a touch point 2, the touch point 1 and the touch point 2 are in a relative motion trend, the touch device generates a data packet according to attribute information of the two touch points, the attribute information of the touch points includes but is not limited to one or more of an identifier of the touch point, a state of the touch point, position information of the touch point, and size information of the touch point, the identifier information of the touch point identifies an identity of the touch point, and different touch points have different identifier information; the position information of the touch point indicates the position of the touch point on the touch device, typically expressed in X and Y coordinates; the size information of the touch point indicates the size of the touch point on the touch device, and may be generally expressed using a bandwidth and a length, which are in units of pixels. The second terminal device receives a data packet from the touch device of the first terminal device, analyzes attribute information of the touch point 1 and the touch point 2 carried in the data packet, recognizes that the touch gesture is a reduction gesture according to the attribute information of the two touch points, and performs reduction operation on a target object on the current user interface.

Referring to fig. 6, an interaction schematic diagram of a switching method of a touch device provided in the present application is shown, in an embodiment of the present application, the method includes:

s601, the second terminal device sends a first request message to the first terminal device, and the first terminal device receives the first request message from the second terminal device.

Specifically, the specific process of S601 may refer to the description of S301 in fig. 3, and is not described herein again.

And S602, the first terminal equipment allows the switching of the input video signal source.

Specifically, the second terminal device obtains the parameter information of the video signal of the second terminal device carried in the first request message, the first terminal device compares whether the device capability information is matched with the parameter information of the video signal carried in the first request message, and if so, the first terminal device allows the input video signal source to be switched to the second terminal device. The first terminal device generates a first response message, where the first response message carries indication information of allowing handover, the indication information of allowing handover may be represented by a bitmap, and different bits are used to represent the indication information of allowing handover and the indication information of rejecting handover, for example: when the bit is "1", it indicates permission of switching indication information, and when the bit is "0", it indicates rejection of switching indication information.

S603, the first terminal device sends a first response message to the second terminal device, and the second terminal device receives the first response message from the first terminal device. Wherein the first response message may be transmitted over the control data interface.

And S604, the first terminal equipment switches the input video signal source to the second terminal equipment.

Specifically, the first terminal device cuts off a video signal of a current input video signal source, and switches the input video signal source to the second terminal device.

And S605, the first terminal device detects the signal characteristics on the control data interface.

Specifically, the first terminal device detects a signal characteristic on the control data interface, the control data interface including the USB interface, the signal characteristic including, but not limited to, one or more of amplitude, phase, and frequency.

And S606, the first terminal equipment determines that the signal characteristics meet the preset conditions. Wherein the preset condition may be one or more of an amplitude condition, a phase condition and a frequency condition.

In a possible implementation manner, the control Data interface between the first terminal device and the second terminal device is a USB interface, the USB interface includes a power pin VCC, a ground pin GND, a positive Data pin + Data, and a negative Data pin-Data, and the detecting, by the first terminal device, the connection state between the touch device and the second terminal device includes: and measuring whether the signal level value of the power supply pin in the USB interface is greater than a level threshold value, and if so, determining that the touch device is connected with the second terminal equipment through the USB interface. The level threshold is a pre-stored or pre-configured value of the first terminal device, and a specific value may be set according to needs, which is not limited in this application.

S607, the first terminal device sends a second request message to the second terminal device, and the second terminal device receives the second request message from the first terminal device.

Specifically, the second request message may be transmitted through the control data interface, where the second request message is used to request for switching the touch device, the first request message may carry attribute information of the touch device, and the attribute information of the touch device includes: one or more of model, maximum number of touch points supported, resolution, response time,

and S608, allowing the second terminal equipment to switch the touch device.

Specifically, the second terminal device obtains the attribute information of the touch device carried in the second request message, compares whether the pre-stored or pre-configured attribute information of the touch device is matched with the attribute information of the touch device carried in the second request message, if yes, indicates that the second terminal device is compatible with the touch device of the first terminal device, and the second terminal device allows the touch device to be switched.

And S609, the second terminal equipment sends a second response message to the first terminal equipment, and the first terminal equipment receives the second response message from the second terminal equipment.

Specifically, the second response message may be transmitted through the control data interface, where the second response message carries indication information of allowing switching, the indication information of allowing switching indicates that the second terminal device allows switching of the touch device of the first terminal device, the indication information of allowing switching may be represented by a bitmap, and different bits are used to represent the indication information of allowing switching and the indication information of rejecting switching, for example: when the bit is "1", it indicates permission of switching indication information, and when the bit is "0", it indicates rejection of switching indication information.

S610, the first terminal device sends a data packet to the second terminal device, and the second terminal device receives the data packet from the first terminal device. Wherein the data packets are transmitted via the control data interface.

And S611, the second terminal equipment identifies the touch gesture according to the data packet.

And S612, the second terminal equipment executes the operation corresponding to the touch gesture.

Fig. 2 to 6 describe a switching method of a touch device according to an embodiment of the present application in detail.

Referring to fig. 7, fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present application, where the terminal device 7 may include a processing unit 701 and a transceiver unit 702.

A processing unit 701, configured to detect a connection state between a touch device and a second terminal device when a first terminal device switches an input video signal source to the second terminal device; wherein the terminal device 3 further comprises a touch device;

the processing unit 701 is further configured to switch the touch device to the second terminal device if the touch device is connected to the second terminal device;

a transceiving unit 702, configured to send a data packet to the second terminal device; wherein the data packet is generated by the touch device according to a touch event.

In a possible embodiment, the terminal device 7 establishes a connection with the second terminal device via a control data interface, and the data packet is sent to the second terminal device via the control data interface.

In one possible embodiment, the control data interface is a Universal Serial Bus (USB) interface;

the processing unit 701 is configured to detect a connection state between the touch device and the second terminal device, and specifically includes:

measuring whether a signal level value of a power supply pin in the USB interface is greater than a level threshold value, if so, determining that the touch device is connected with the second terminal equipment through the USB interface; or

Measuring whether a signal level value of a power supply pin in the USB interface is smaller than a level threshold value, if so, determining that the touch device is connected with the second terminal equipment through the USB interface; or

In a possible implementation, the transceiving unit 702 is further configured to:

receiving a first request message from the second terminal equipment; wherein, the first request message is used for indicating an input video signal source requesting to switch the terminal device 7;

sending a first response message to the second terminal equipment; wherein the first response message carries switching permission indication information, and the switching permission indication information indicates that the terminal device 7 allows switching the input video signal source to the second terminal device.

In a possible implementation, the first request message includes one or more of identification information of the second terminal device, a resolution of a video signal of the second terminal device, a bitrate of the video signal of the second terminal device, and a format of the video signal of the second terminal device.

In a possible embodiment, the terminal device 7 receives the video signal from the second terminal device through a video data interface, which may include a high definition multimedia interface HDMI, a video graphics array VGA interface, or a digital video interface DVI.

In a possible implementation manner, the processing unit 701 is further configured to maintain a current connection state of the touch device if it is detected that the connection between the touch device and the second terminal device is not established.

In one possible embodiment, the length of the data packet is related to the number of touch points corresponding to the touch event.

The embodiment of the present application and the method embodiments of fig. 2 to 6 are based on the same concept, and the technical effects brought by the embodiment are also the same, and the specific process may refer to the description of the method embodiments of fig. 2 to 6, and will not be described again here.

Referring to fig. 8, a schematic structural diagram of a terminal device with a touch device according to an embodiment of the present application is shown, where the terminal device may be used to implement the switching method for the touch device provided in the foregoing embodiment. Specifically, the method comprises the following steps:

the memory 820 may be used to store software programs and modules, and the processor 880 performs various functional applications and data processing by operating the software programs and modules stored in the memory 820. The memory 820 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal device, and the like. Further, the memory 820 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 820 may also include a memory controller to provide access to the memory 820 by the processor 880 and the input device 830.

The input device 830 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input device 830 may include a touch device 831 (e.g., a touch screen, touchpad, or touch frame). The touch device 831, also referred to as a touch screen or a touch pad, may collect touch operations of a user on or near the touch device 831 (e.g., operations of a user on or near the touch device 831 using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a preset program. Alternatively, the touch device 831 may include two portions of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 880, and can receive and execute commands sent from the processor 880. In addition, the touch device 831 may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves.

The output device 840 may be used to display information input by or provided to the user as well as various graphical user interfaces of the terminal device, which may be made up of graphics, text, icons, video, and any combination thereof. The output device 840 may include a Display panel 841, and the Display panel 841 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, touch device 831 can overlay display panel 841 and, upon detecting a touch operation on or near touch device 831, communicate to processor 880 to determine the type of touch event, and processor 880 can then provide a corresponding visual output on display panel 841 in accordance with the type of touch event. Although in FIG. 8, touch device 831 and display panel 841 are two separate components to implement input and output functions, in some embodiments, touch device 831 may be integrated with display panel 841 to implement input and output functions.

The input device 830 further includes a receiver 832, where the receiver 832 is configured to receive data, and the type of the received data includes traffic data and control data, such as: the receiver 832 includes an HDMI receiver for receiving video signals and a USB receiver for receiving control data. The output device 840 further includes a transmitter 842, and the transmitter 842 is used for transmitting data, and the type of data transmitted includes traffic data and control data, such as: the transmitter 842 includes an HDMI transmitter for transmitting video signals and a USB transmitter for transmitting control data. In one possible implementation, the transmitter 832 and the receiver 842 may also be combined into one transceiver.

The processor 880 is a control center of the terminal device, connects various parts of the entire terminal device using various interfaces and lines, and performs various functions of the terminal device and processes data by operating or executing software programs and/or modules stored in the memory 820 and calling data stored in the memory 820, thereby performing overall monitoring of the terminal device. Optionally, processor 880 may include one or more processing cores; processor 880 may integrate an application processor, which handles primarily the operating system, user interfaces, applications, etc., and a modem processor, which handles primarily the wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 880.

Specifically, in this embodiment, the display unit of the terminal device is a touch screen display, the terminal device further includes a memory, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for:

under the condition that an input video signal source is switched to second terminal equipment, detecting the connection state between a touch device and the second terminal equipment; the first terminal equipment comprises a touch device;

if the touch device and the second terminal equipment are in a connected state, switching the touch device to the second terminal equipment;

instruct a transmitter 842 to transmit data packets to the second terminal device; wherein the data packet is generated by the touch device according to a touch event.

In a possible implementation manner, the first terminal device establishes a connection with the second terminal device through a control data interface, and the data packet is sent to the second terminal device through the control data interface.

the processor 880 detecting a connection state between the touch device and the second terminal device includes:

In one possible implementation, the receiver 832 is further configured to: receiving a first request message from the second terminal equipment; wherein, the first request message is used for indicating an input video signal source requesting to switch the terminal equipment 8;

the transmitter 842 is further configured to send a first response message to the second terminal device; wherein, the first response message carries switching permission indication information, and the switching permission indication information indicates that the terminal device 8 allows switching the input video signal source to the second terminal device.

In a possible embodiment, the terminal device 8 receives the video signal from the second terminal device through a video data interface, which includes a high definition multimedia interface HDMI, a video graphics array VGA interface, or a digital video interface DVI.

In one possible implementation, the processor 880 further includes:

The embodiment of the present application and the method embodiments in fig. 2 to 6 are based on the same concept, and the technical effects brought by the embodiment are also the same, and the specific process may refer to the method embodiments in fig. 2 to 6, which are not described herein again.

Optionally, the terminal device may include RF (Radio Frequency) circuitry 810, memory 820 including one or more computer-readable storage media, input device 830, output device 840, sensor 850, audio circuitry 860, wiFi (wireless fidelity) module 860, processor 880 including one or more processing cores, and power supply 890. Those skilled in the art will appreciate that the terminal device configuration shown in fig. 8 does not constitute a limitation of the terminal device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

the RF circuit 810 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, for receiving downlink information from a base station and then processing the received downlink information by the one or more processors 880; in addition, data relating to uplink is transmitted to the base station. In general, RF circuitry 810 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (low noise amplifier), a duplexer, and the like. In addition, the RF circuitry 810 may also communicate with networks and other devices via wireless communications. The wireless Communication may use any Communication standard or protocol, including but not limited to 3GPP (3 rd Generation Partnership Project, 3GPP for Short), 3GPP2 (3 rd Generation Partnership Project 2, 3GPP2 for Short), UMTS (Universal Mobile Telecommunications System, UMTS for Short), LTE (Long Term Evolution, LTE for Short), LTE-a (LTE-Advanced, LTE-a for Short), WIMAX (Worldwide Access for Microwave Access, WIMAX), HSDPA (High Speed Downlink packet Access, HSDPA), HSDPA (High Speed Uplink packet Access, TDMA for Short), WCDMA (GSM for Short, WCDMA for Short, wideband Code Division multiple Access, WCDMA for Short, cdma for Short, and multiple Access, WCDMA for Short, multiple Access, and multiple Access for Short.

Optionally, the terminal device may also include at least one sensor 850, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 841 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 841 and/or backlight when the terminal device is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the terminal device is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of the terminal device, and related functions (such as pedometer and tapping) for vibration recognition; other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor and the like which can be configured on the terminal equipment are not described in detail herein.

Audio circuitry 860, speaker 861, microphone 862 may provide an audio interface between the user and the terminal device. The audio circuit 860 can transmit the electrical signal converted from the received audio data to the speaker 861, and the electrical signal is converted into a sound signal by the speaker 861 and output; on the other hand, the microphone 862 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 860, and outputs the audio data to the processor 880 for processing, and then transmits the audio data to, for example, another terminal device via the RF circuit 810, or outputs the audio data to the memory 820 for further processing. The audio circuitry 860 may also include an earbud jack to provide communication of peripheral headphones with the terminal device.

WiFi belongs to short-distance wireless transmission technology, and terminal equipment can help a user to send and receive e-mails, browse webpages, access streaming media and the like through a WiFi module 880, and provides wireless broadband internet access for the user. Although fig. 8 shows the WiFi module 880, it is understood that it does not belong to the essential constitution of the terminal device, and may be omitted entirely as needed within the scope not changing the essence of the application.

Optionally, the terminal device further includes a power supply 890 (e.g., a battery) for supplying power to each component, wherein the power supply may be logically connected to the processor 880 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. Power supply 890 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Optionally, the terminal device may further include a camera 891, a bluetooth module, and the like, where the camera 891 is configured to expose the surrounding environment to obtain a frame image, and in one mode, the camera 891 transmits parameters of the frame image obtained by exposure to the processor 880, so that the processor 880 performs processing such as denoising and enhancing on the frame image to generate a picture that can be displayed to the user; in yet another alternative, the camera 891 may have its own image processor chip, which may perform a preliminary processing on the frame of image, and then transfer the processed data to the processor 880 for the processor 880 to ultimately produce an image that can be displayed to a user. Further, the number of the cameras 891 may be one or more.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

While the foregoing is directed to embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.

Claims

1. A switching method of a touch device, comprising:

under the condition that a first terminal device switches an input video signal source into a second terminal device, the first terminal device detects the connection state between a touch device and the second terminal device; the first terminal equipment comprises a touch device;

if the touch device and the second terminal equipment are in a connected state, the first terminal equipment switches the touch device to the second terminal equipment;

the first terminal equipment sends a data packet to the second terminal equipment; wherein the data packet is generated by the touch device according to a touch event;

wherein, when the first terminal device switches the input video signal source to the second terminal device, before the first terminal device detects a connection state between the touch device and the second terminal device, the method further includes:

the first terminal equipment receives a first request message from the second terminal equipment; the first request message is used for indicating that the input video signal source of the first terminal equipment is requested to be switched;

the first terminal equipment sends a first response message to the second terminal equipment; when the first terminal device judges that the video signal parameters carried in the first request message are matched according to the device capability information, the first response message carries switching permission indication information, and the switching permission indication information indicates that the first terminal device allows an input video signal source to be switched to the second terminal device.

2. The method according to claim 1, wherein the first terminal device establishes a connection with the second terminal device through a control data interface, and the data packet is sent to the second terminal device through the control data interface.

3. The method of claim 2, wherein the control data interface is a Universal Serial Bus (USB) interface;

the detecting, by the first terminal device, the connection state between the touch apparatus and the second terminal device includes:

And measuring whether a signal waveform on a power pin in the USB interface is matched with a preset waveform within a preset time, and if so, determining that the touch device is connected with the second terminal equipment through the USB interface.

4. The method of claim 1, wherein the first request message comprises one or more of identification information of the second terminal device, a resolution of a video signal of the second terminal device, a bitrate of the video signal of the second terminal device, and a format of the video signal of the second terminal device.

5. The method of claim 1 or 4, wherein the first end device receives the video signal from the second end device via a video data interface comprising a High Definition Multimedia Interface (HDMI), a Video Graphics Array (VGA) interface, or a Digital Video Interface (DVI).

6. The method of claim 5, further comprising:

7. A terminal device, characterized in that the terminal device comprises a touch means, the terminal device comprising:

the processing unit is used for detecting the connection state between the touch device and the second terminal equipment under the condition that the terminal equipment switches the input video signal source to the second terminal equipment;

a transceiving unit, configured to send a data packet to the second terminal device; wherein the data packet is generated by the touch device according to a touch event;

the receiving and sending unit is further configured to receive a first request message from a second terminal device before detecting a connection state between the touch device and the second terminal device when the terminal device switches the input video signal source to the second terminal device; the first request message is used for indicating that an input video signal source of the terminal equipment is requested to be switched;

sending a first response message to the second terminal equipment; when the terminal equipment judges that the video signal parameters carried in the first request message are matched according to the equipment capacity information, the first response message carries switching permission indication information, and the switching permission indication information indicates that the terminal equipment allows an input video signal source to be switched to the second terminal equipment.

8. A terminal device comprising a processor, an input device, an output device and a memory, wherein the memory is configured to store a computer program comprising program instructions, and wherein the processor is configured to invoke the program instructions to perform the method of any of claims 1-6.

9. A computer-readable storage medium, characterized in that the computer storage medium stores a computer program comprising program instructions that, when executed by a processor, cause the processor to carry out the method according to any one of claims 1-6.