WO2019205634A1

WO2019205634A1 - Touch control method and device for smart interactive tablet and smart interactive tablet

Info

Publication number: WO2019205634A1
Application number: PCT/CN2018/118470
Authority: WO
Inventors: 吴佳宝; 张帆
Original assignee: 广州视源电子科技股份有限公司; 广州视臻信息科技有限公司
Priority date: 2018-04-28
Filing date: 2018-11-30
Publication date: 2019-10-31
Also published as: CN108693997A; CN108693997B

Abstract

The present invention relates to a touch control method and device for a smart interactive tablet, a smart interactive tablet and a storage medium, which are applied to the field of smart terminals. The method comprises: receiving touch operation information sent by a touch control terminal, and storing the touch operation information in a preset drive file, the drive file being used to control touch input functions of a smart interactive tablet; reading the touch operation information from the drive file, and displaying a corresponding touch response in a display interface of the smart interactive tablet. The present invention may overcome the problem wherein the efficiency of touch operations of a smart interactive tablet is low and provide more convenience for a user operating the smart interactive tablet.

Description

Touch control method and device for intelligent interactive tablet and intelligent interaction tablet

Technical field

The invention relates to the field of intelligent interactive tablet technology, in particular to a touch control method and device for a smart interactive tablet, a smart interaction tablet and a storage medium.

Background technique

With the development of human-computer interaction technology, more and more devices that facilitate people's lives and/or work are born, for example, smart interactive tablets. The smart interactive tablet is an integrated device that controls the content displayed on the display tablet and implements human-computer interaction operation through the touch technology.

In the process of implementing the present invention, the inventor has found that in the related art, when the user needs to operate the content displayed by the smart interactive tablet, the user needs to be close to the smart interactive tablet, and can operate through the touch screen of the smart interactive tablet, when the user is away from the smart When the interactive tablet is far away, or when multiple people need to operate the content, the operation efficiency is low.

Summary of the invention

Based on this, it is necessary to provide a touch control method, device, intelligent interaction tablet and storage medium of the smart interaction tablet for the problem that the smart interaction tablet touch operation is less efficient in the existing manner.

The solution provided by the embodiment of the present invention includes:

In one aspect, a touch control method for a smart interactive tablet includes:

Receiving the touch operation information sent by the touch terminal, where the touch operation information includes a type of the touch operation and the first position; the touch operation is a touch operation of the tablet mirror image displayed on the touch terminal, and the flat mirror image is Corresponding to the display interface of the smart interaction tablet, the first location is a working position of the touch operation in the tablet mirror image;

And storing the touch operation information to a preset driving file, where the driving file is used to control a touch input function of the smart interaction tablet;

Reading the touch operation information from the drive file, displaying a corresponding touch response in a display interface of the smart interaction tablet; the touch response is determined according to the type of the touch operation and the second position, the second position Determined according to the first location.

In one embodiment, the method further includes:

Obtaining display interface information of the smart interaction tablet;

Sending the display interface information to the touch terminal to display a tablet mirror image on the touch terminal.

In one embodiment, the method further includes:

Receiving an instruction for requesting touch control sent by the touch terminal, starting the preset first service and the second service;

The first service is configured to acquire a display interface of the smart interaction tablet, and send the display interface information to the touch terminal.

The second service is configured to receive touch operation information sent by the touch terminal, store the touch operation information to a preset drive file, and read the touch operation information from the drive file, on the smart interaction tablet. The corresponding touch response is displayed in the display interface.

In one embodiment, the displaying the corresponding touch response in the display interface of the smart interaction tablet includes:

Displaying a touch trace corresponding to the touch event in a display interface of the smart interaction tablet; and/or,

An execution response to the touch event is displayed in a display interface of the smart interactive tablet.

In one embodiment, the driver file is a uinput file;

and / or,

The type of the touch operation includes one or more of clicking, holding, dragging, and sliding.

In one embodiment, the action position includes: a first relative position of the touch point abscissa corresponding to the touch operation relative to a length of the tablet mirror image, and a touch point ordinate corresponding to the touch operation a second relative position of the width of the screen image relative to the tablet;

Wherein, the abscissa and the ordinate of the touch point refer to a preset XY coordinate system, the horizontal axis of the XY coordinate system coincides with the length direction of the flat mirror image, and the vertical axis of the XY coordinate system and the flat plate The width direction of the mirror image is coincident, and an origin of the XY coordinate system is a vertex of the flat mirror image;

The determining the second location includes:

Obtaining position information in the length direction according to the first relative position and the length of the smart interactive flat panel display interface;

Obtaining position information in the width direction according to the second relative position and the width of the smart interactive flat panel display interface;

The second position in the smart interactive flat panel display interface is determined according to the position information in the length direction and the position information in the width direction.

In one embodiment, before receiving the instruction for requesting touch control sent by the touch terminal, before starting the preset first service and the second service, the method further includes:

Detecting an operation instruction for initiating remote touch control, generating an information code, where the information code includes connection information of the smart interaction tablet;

The information code is displayed on the smart interactive tablet display interface. After the information code is recognized by the touch terminal, the touch terminal can be triggered to establish a communication connection with the smart interaction tablet.

In one embodiment, the information code comprises a two-dimensional code;

And/or, the connection information includes: network information of the smart interaction tablet and communication port information.

In another aspect, a touch control method for a smart interactive tablet includes:

A touch operation is performed on the tablet mirror image displayed by the touch terminal, where the tablet mirror image corresponds to the display interface of the smart interaction tablet;

Determining a type of the touch operation and a first location, where the first location is an active position of the touch operation in the tablet mirror image;

Sending the touch operation information to the smart interaction tablet, where the touch operation information includes a type of the touch operation and a first location; the touch operation information is used to trigger the smart interaction tablet to display a corresponding display in the display interface thereof. A touch response is determined according to a type of the touch operation and a second location, the second location being determined according to the first location.

In one embodiment, the method further includes:

Receiving display interface information sent by the smart interaction tablet;

A tablet mirror screen is displayed, and the tablet mirror screen is obtained based on the display interface information.

In one of the embodiments, the manner of determining the relative position comprises:

Obtaining an abscissa and an ordinate of the touch point included in the touch operation in the flat mirror image; wherein the abscissa and the ordinate of the touch point refer to a preset XY coordinate system, and the horizontal axis of the XY coordinate system a longitudinal direction of the flat mirror image, wherein a vertical axis of the XY coordinate system coincides with a width direction of the flat mirror image, and an origin of the XY coordinate system is a vertex of the flat mirror image;

Obtaining, according to an abscissa of the touch point and a length of the flat mirror image, a first relative position of an abscissa of the touch point with respect to a length of the flat mirror image;

Obtaining a second relative position of the ordinate of the touch point relative to the width of the flat mirror image according to the ordinate of the touch point and the width of the flat mirror image;

And determining, according to the first relative position and the second relative position, an action position of the touch operation in the tablet mirror image.

In one embodiment, before receiving the display interface information sent by the smart interaction tablet, the method further includes:

Identifying an information code displayed on the smart interactive tablet display interface, where the information code includes connection information of the smart interaction tablet;

Establishing a communication connection with the smart interaction tablet according to the connection information.

In another aspect, a touch control device for an intelligent interactive tablet includes:

The touch information receiving module is configured to receive the touch operation information sent by the touch terminal, where the touch operation information includes a type of the touch operation and the first position; and the touch operation is a touch on the tablet mirror image displayed by the touch terminal In operation, the tablet mirroring screen corresponds to a display interface of the smart interaction tablet, and the first location is a working position of the touch operation in the tablet mirroring screen;

Touching the information storage module, configured to store the touch operation information to a preset driving file, where the driving file is used to control a touch input function of the smart interaction tablet;

And a touch response module, configured to read the touch operation information from the drive file, and display a corresponding touch response in a display interface of the smart interaction tablet; the touch response is according to the type of the touch operation and the second The position is determined, and the second position is determined according to the first position.

In one embodiment, the method further includes:

The display interface sending module is configured to obtain display interface information of the smart interaction tablet, and send the display interface information to the touch terminal to display a tablet mirror image on the touch terminal.

The touch response module includes:

a position determining unit, configured to obtain position information in a length direction according to the first relative position and a length of the smart interactive flat panel display interface; and obtain a position in a width direction according to the second relative position and a width of the smart interactive flat display interface Information; determining the second position in the smart interactive flat panel display interface according to the position information in the length direction and the position information in the width direction.

a touch detection module, configured to detect a touch operation of a tablet mirror image displayed on the touch terminal, where the tablet mirror image corresponds to a display interface of the smart interaction tablet;

a touch information determining module, configured to determine a type of the touch operation and a first location, where the first location is a working position of the touch operation in the tablet mirror image;

And a touch information sending module, configured to send the touch operation information to the smart interaction tablet, where the touch operation information includes a type of the touch operation and a first location; the touch operation information is used to trigger a smart interaction The tablet displays a corresponding touch response in its display interface, the touch response being determined according to the type of the touch operation and the second position, the second position being determined according to the first position.

The touch control method and device of the smart interactive tablet, the user touches the displayed tablet mirror image on the touch terminal side, and the touch operation information is sent to the smart interaction tablet, and the smart interaction tablet stores the received touch operation information. The touch operation information is read from the drive file to the preset drive file, so that the touch response corresponding to the touch operation of the touch terminal is displayed in the display interface of the smart interaction tablet. Thereby, the remote touch operation of the smart interaction tablet by the touch terminal is realized, and the touch operation effect of the user is consistent with the effect of the touch operation performed on the smart interaction tablet, which is convenient for the user to operate and improves the operation efficiency.

In another aspect, an intelligent interaction tablet includes: a memory, a touch screen with a touch function, and one or more processors;

The memory for storing one or more programs;

The one or more programs are executed by the one or more processors such that the one or more processors implement the steps of the method described above.

In another aspect, a touch terminal includes: a memory, a touch screen with a touch function, and one or more processors;

The memory for storing one or more programs;

The smart interactive tablet and the touch terminal realize remote touch operation on the smart interactive tablet through the touch terminal by using one or more programs stored in the memory, and the touch operation effect and the touch operation on the smart interaction tablet The effect is consistent, user-friendly, and improved operational efficiency.

In a further aspect, a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the steps of any of the above methods.

The computer storage medium realizes a remote touch operation on the smart interaction tablet through the touch terminal through the computer program stored therein, and the touch operation effect is consistent with the effect of the touch operation performed on the smart interaction tablet, facilitating user operation and improving Operational efficiency.

DRAWINGS

1 is an application environment diagram of a touch control method of a smart interaction tablet in an embodiment;

2 is a schematic diagram of a display interface of an intelligent interactive tablet according to an embodiment;

3 is a schematic diagram of a tablet mirror image displayed by a touch terminal according to an embodiment;

4 is a schematic flowchart of a touch control method of an intelligent interaction tablet according to an embodiment;

FIG. 5 is a schematic diagram of a smart interactive tablet displaying touch traces according to an embodiment; FIG.

6 is a schematic diagram of a smart interactive tablet displaying touch traces according to another embodiment;

7 is a schematic flowchart of a touch control method of a smart interaction tablet according to another embodiment;

FIG. 8 is a schematic diagram of an X-Y coordinate system of a touch terminal according to an embodiment; FIG.

9 is a schematic flowchart of a touch control method of a smart interaction tablet according to still another embodiment;

FIG. 10 is a schematic structural diagram of a touch control apparatus of an intelligent interactive tablet according to an embodiment; FIG.

11 is a schematic structural diagram of a touch control device of a smart interaction tablet according to another embodiment;

12 is an internal structural diagram of a smart interaction tablet in an embodiment;

FIG. 13 is an internal structural diagram of a touch terminal in an embodiment.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

References to "an embodiment" herein mean that a particular feature, structure, or characteristic described in connection with the embodiments can be included in at least one embodiment of the present application. The appearances of the phrases in various places in the specification are not necessarily referring to the same embodiments, and are not exclusive or alternative embodiments that are mutually exclusive. Those skilled in the art will understand and implicitly understand that the embodiments described herein can be combined with other embodiments.

The touch control method of the smart interaction tablet provided by the present application can be applied to the application environment as shown in FIG. 1 . The one or more touch terminals 100 are communicatively connected to the smart interaction tablet 200. The touch terminal 100 can be, but is not limited to, various personal computers, notebook computers, smart phones, tablets, and portable wearable devices. The smart interactive tablet 200 can control and implement the content displayed on the display screen through touch technology. An integrated device for human-computer interaction, which integrates one or more functions such as a projector, an electronic whiteboard, a curtain, an audio, a television, and a video conferencing terminal.

The communication connection between the touch terminal 100 and the smart interaction tablet 200 may be a communication method such as USB, Internet, local area network, Bluetooth, Wi-Fi or ZigBee.

Further, after the smart interactive tablet 200 is in communication with the touch terminal 100, the display interface information is sent to each touch terminal, so that each touch terminal displays a flat panel mirror image corresponding to the display interface of the interactive smart tablet on the display screen thereof. . The display interface of the smart interactive tablet may be a display interface of the smart interactive tablet, or may be an actual screen displayed in the display of the smart interactive tablet, the actual screen being less than or equal to the display interface. In addition, the aspect ratio of the flat-panel mirror image displayed by the touch terminal and the aspect ratio of the display interface of the smart interactive tablet need to be consistent; on the other hand, the aspect ratio of the flat-panel mirror image displayed by the touch terminal, It does not need to be exactly the same as the aspect ratio of the display of the touch terminal. The display interface of the smart interaction tablet 200 and the tablet mirror image displayed by the touch terminal 100 can be respectively referred to FIG. 2 and FIG. 3 .

Further, after the smart interaction panel 200 is in communication with the touch terminal 100, the touch operation of the touch panel 100 on the tablet mirror screen is mapped to the display interface of the smart interaction panel 200, for example, the user is at the touch terminal. The 100 side performs a sliding operation on the flat mirror image, and correspondingly, a sliding response corresponding to the sliding operation appears in the display interface of the smart interactive tablet 200. In this interaction process, the touch terminal 100 can serve as a client, and the smart interaction tablet 200 can serve as a server; in general, the client corresponding to the server can have one or more, and is set according to a specific application scenario. The example is not limited.

Optionally, the touch terminal 100 and/or the smart interaction tablet 200 are installed with application software for implementing remote touch control, and the application software may be pre-installed in the touch terminal 100 and/or the smart interaction tablet 200, or When the touch terminal 100 and/or the smart interactive tablet 200 initiates the remote touch control function, the device is downloaded and installed and used in real time from a third-party device or server. The third-party device is not limited in the embodiment.

In one embodiment, as shown in FIG. 4, a touch control method for an intelligent interactive tablet is provided, wherein the method is applied to the smart interactive tablet described above as an example; the method includes the following steps:

S11, receiving touch operation information sent by the touch terminal, where the touch operation information includes a type of a touch operation and a first position; the touch operation is a touch operation of a tablet mirror image displayed on the touch terminal, the tablet The mirroring screen corresponds to a display interface of the smart interaction tablet, and the first location is a working position of the touch operation in the tablet mirror image.

In the embodiment of the present invention, the touch operation of the tablet mirror image displayed on the touch terminal may be any operation of the user on the touch display screen of the touch terminal when the touch panel displays the tablet mirror image. For example: click, hold (or long press), drag an object, single-slide (or single-finger swipe), multi-slide (or multi-finger swipe), etc., correspondingly, the types of touch operations include: click, hold The embodiment of the present invention does not limit the touch operation and its type.

In the embodiment of the present invention, the action position of the touch operation in the tablet mirror image (ie, the location where the touch operation occurs) may be a tablet image displayed on the touch terminal by the touch point (one or more touch points) corresponding to the touch operation. The actual position in the screen may also be a relative position of the touch point corresponding to the touch operation with respect to the tablet mirror image displayed by the touch terminal, and thus the above-mentioned action position is not necessarily related to the display screen of the touch terminal.

In the embodiment of the present invention, the manner in which the smart interactive tablet receives the touch operation information sent by the touch terminal may be set according to any specific communication connection manner.

S12. Store the touch operation information to a preset drive file, where the drive file is used to control a touch input function of the smart interaction tablet.

In the embodiment of the present invention, the driving file for storing the touch operation information may be a default system file for implementing the touch input function in the smart interaction tablet, or other files, whether it is a default system file or other files, and the file is accessed. Permissions are met: Only services that have access to smart interactive tablet system privileges (such as root privileges) can access them.

In the embodiment of the present invention, the touch input function of the smart interaction tablet is implemented by: detecting a touch operation on the touch screen, and writing the detected touch point information into a system file (the file may be in a system default file, or may have The file created by the user of the system authority obtains the touch operation information by accessing the system file, thereby executing the corresponding touch response, and displaying the corresponding touch response on the display interface. The displaying the corresponding touch response in the display interface of the smart interaction tablet may include: displaying the touch trace corresponding to the touch event in the display interface of the smart interaction tablet; and/or displaying the pair on the display interface of the smart interaction tablet The execution response of the touch event.

The displaying the touch trace corresponding to the touch event in the display interface of the smart interactive tablet includes: performing a hold operation on the tablet mirroring interface of the touch terminal, and correspondingly displaying the display on the display interface of the smart interactive tablet An analog hold operation is shown, the effect of which can be seen in Figure 5. For example, the user performs a sliding operation in the tablet mirroring interface of the touch terminal. Correspondingly, an analog sliding operation effect can be displayed on the display interface of the smart interactive tablet. The effect can be seen in FIG. 6 . It can be understood that the touch trace can also be other situations. By displaying the corresponding touch trace on the smart interactive tablet, the user can be prompted to respond to what touch event the smart interactive tablet is to respond to, and the user experience can be improved.

S13. The touch operation information is read from the drive file, and a corresponding touch response is displayed in a display interface of the smart interaction tablet. The touch response is determined according to the type of the touch operation and the second location. The two positions are determined based on the first position.

In the embodiment of the present invention, the service for controlling the touch input function of the smart interaction tablet has system authority, so the driver file storing the touch operation information can be accessed in real time based on the service, and the touch operation information is read therefrom, and the type of the touch operation is obtained. The location generates a touch trace corresponding to the touch operation, and then displays a corresponding touch trace at a corresponding position of the smart interactive flat panel display interface.

Through the touch control method of the smart interactive tablet in the above embodiment, the user performs a touch operation on the displayed tablet mirror image on the touch terminal side, and the touch operation information is sent to the smart interaction tablet, and the smart interaction tablet will receive the touch operation. The information is stored in the preset driving file, and the touch operation information is read from the driving file, so that the touch response corresponding to the touch operation of the touch terminal is displayed in the display interface of the smart interactive tablet. Thereby, the remote touch operation of the smart interaction tablet by the touch terminal is realized, and the touch operation effect of the user is consistent with the effect of the touch operation performed on the smart interaction tablet, which is convenient for the user to operate and improves the operation efficiency.

With reference to the foregoing embodiment, as shown in FIG. 7 , the touch control method of the smart interaction tablet is further described from the perspective of interaction between the touch terminal and the smart interaction tablet, wherein the touch terminal and the smart interaction tablet have established a communication connection, and the touch The related application in the terminal is used as the client, the related application of the smart interaction tablet is used as the server, and the service running in the remote touch control of the server has the system authority of the intelligent interactive tablet; the specific process of the touch control method of the intelligent interactive tablet is as follows: :

S201, on the client side, detecting a user's request for touch control operation.

S202. On the client side, when the detected operation of requesting the touch control is performed, an instruction for requesting touch control is sent to the smart interaction tablet.

S203. On the server side, receiving an instruction for requesting touch control sent by the touch terminal, starting a preset first service (or the same screen service) and a second service (or a touch service).

The first service is configured to acquire a display interface of the smart interaction tablet, and send the display interface information to the touch terminal; the second service is configured to receive touch operation information sent by the touch terminal, and the touch operation is performed. The information is stored to a preset driving file, and the touch operation information is read from the driving file, and a corresponding touch response is displayed in a display interface of the smart interactive tablet.

Because the transmission of touch operation information and the transmission of display interface information involve a certain amount of data, it is separated from the original control link to avoid delay or congestion when sharing data transmission.

S204. On the server side, obtain display interface information of the smart interaction tablet, and send the display interface information to the touch terminal to display a tablet mirror image on the touch terminal.

Step S204 can be performed by using the first service. Because the data volume of the display interface information of the smart interaction tablet is large, the special first service processing is beneficial to ensure the timeliness of the display interface information transmission.

S205: Receive, on the client side, display interface information sent by the smart interaction tablet, and display a tablet mirror image, where the tablet mirror image is obtained according to the display interface information.

The touch terminal displays the flat mirror image as much as possible while keeping the aspect ratio of the flat mirror image unchanged. That is, the tablet mirror image displayed on the touch terminal and the display interface of the smart interaction tablet are in a proportionally reduced relationship.

S206: On the client side, detecting a touch operation of the tablet mirror image displayed on the touch terminal.

The touch operation includes a DOWN event, a MOVE event, and an UP event, and the corresponding finger motion is an event of pressing, sliding, and lifting. Correspondingly, the type of the touch operation includes one or more of clicking, holding, dragging, and sliding. Kind.

S207. On the client side, determine a type of the touch operation and a first location, where the first location is a working position of the touch operation in the tablet mirror image.

In an embodiment, the action position of the touch operation in the tablet mirror image specifically includes: a first relative position of the abscissa of the touch point included in the touch operation relative to a length of the tablet mirror image, and The second relative position of the ordinate of the touch point included in the touch operation relative to the width of the flat mirror image. Wherein, the abscissa and the ordinate of the touch point refer to the XY coordinate system, and the horizontal axis of the XY coordinate system coincides with the longitudinal direction of the flat mirror image, and the vertical axis of the XY coordinate system and the flat mirror image The width directions coincide, and the origin of the XY coordinate system is one vertex of the flat mirror image.

For example, as shown in FIG. 8, the XY coordinate system is established by the range of the flat mirror image displayed by the final touch terminal, and the vertex of the upper left corner is the origin of the XY coordinate system, and the coordinates of the touch point in the range of the flat mirror image can be Converted to relative coordinates, the advantage is that the accuracy is high, the touch points in the mirror range can correspond to a touch point on the resolution of the tablet, and the resolution of the mirror image will not affect the click effect in order to adapt to the network.

It can be understood that the X-Y coordinate system can also be established with the other vertices of the range of the flat mirror image displayed by the final touch terminal as the origin. Correspondingly, the side of the smart interaction tablet also needs to select the origin of the coordinate system in the same way.

In Figure 8, the resolution of the display with the touch terminal is: 1920*width 1200, and the horizontal resolution of the touch terminal is: 1920*width 1080; the user is in the flat mirror image. The position coordinates of the upper touch point in the above XY coordinate system are: (480, 540), thereby determining that the occurrence position of the touch point is: x=480/1920=0.25, y=540/1080=0.5.

S208. Send, on the client side, touch operation information to the smart interaction tablet, where the touch operation information includes a type of the touch operation and a first location.

In an embodiment, an ID (identification information) is generated for each touch operation to distinguish multiple touch operations in sequence, or to distinguish multiple touch operations under multi-finger operation, for example, when two fingers perform sliding zooming, touch The operation is two, and an ID is generated for each of the two touch operations. Correspondingly, the touch operation information sent to the smart interaction tablet further includes corresponding ID information, and then the server returns to the touch on the tablet screen.

S209: Receive, on the server side, touch operation information sent by the touch terminal, and store the touch operation information to a preset driving file, where the driving file is used to control a touch input function of the smart interaction tablet.

In an embodiment, the driver file is a uinput file. The uinput file is a driver file that controls the touch input under the Linux system. The system will obtain the touch event information on the touch screen from the file. Android is also a Linux system. The system permission is required to read and write the file, and the service running on the server is the system. The service can write touch information to the uinput file for remote control.

S210, on the server side, reading the touch operation information from the driving file, and displaying a corresponding touch response in a display interface of the smart interaction tablet; the touch response is according to the type of the touch operation and the second The position is determined, and the second position is determined according to the first position.

The second location is determined by:

The XY coordinate system is established by the display interface of the intelligent interactive tablet, and the vertex of the upper left corner of the display interface is the origin of the XY coordinate system, and the horizontal axis of the XY coordinate system coincides with the length direction of the display interface, and the vertical axis and the display interface of the XY coordinate system The width direction coincides. Obtaining position information in the longitudinal direction according to the product of the first relative position (x=480/1920=0.25) and the length of the smart interactive flat panel display interface; according to the second relative position (y=540/1080=0.5) And the product of the width of the smart interactive flat panel display interface, obtaining position information in the width direction; determining the second position in the smart interactive flat panel display interface according to the position information in the length direction and the position information in the width direction. According to the second location and the type of the touch operation, the touch operation that occurs on the touch terminal can be restored on the side of the smart interaction tablet and respond to the touch operation.

At this point, the user's touch operation on the tablet mirror image on the touch terminal will be reflected on the smart interaction tablet, and the user does not need to be close to the smart interaction tablet, thereby realizing the remote touch operation on the smart interaction tablet. Moreover, since the touch terminal sends the touch operation information to the smart interactive tablet, the amount of data transmitted is reduced relative to the manner in which the touch terminal directly displays the image, which is also advantageous for reducing the delay on the display; The way in which the touch operation information is written to the drive file enables a more realistic simulation of the screen touch event on the smart interactive tablet.

In an application scenario, the touch terminal may be a mobile phone, and the smart interaction tablet may be a conference tablet; correspondingly, when multiple users participate in the conference, connect to the conference tablet through respective mobile phones, based on the connection, through the foregoing embodiment During the interaction process, the touch operation of the user's mobile phone end can be reflected on the smart interactive tablet, and the user can touch and operate the conference tablet on the mobile phone, including clicking, dragging, sliding, etc., which facilitates the user operation and improves the conference effect.

In an embodiment, before the step S201, the touch terminal and the smart interactive tablet communication connection need to be established. The connection may be established by: the server detects an operation instruction for starting the remote touch control, and generates an information code. The information code includes the connection information of the smart interaction tablet; the information code is displayed on the display interface of the smart interaction tablet; the user identifies the information code through the touch terminal, and the information code can be recognized by the touch terminal. The touch terminal is triggered to establish a communication connection with the smart interaction tablet.

In an embodiment, the information code includes a two-dimensional code; the user scans and recognizes the two-dimensional code through the touch terminal, thereby acquiring a communication connection of the smart interaction tablet, and establishing a communication connection between the touch terminal and the smart interaction tablet. No need for users to manually enter connection information to improve operational efficiency.

In an embodiment, the connection information includes: network information of the smart interaction tablet and communication port information, where the network information includes local area network information, hotspot IP information, hotspot SSID, hotspot SSID password, and the like; The SSID and the hotspot SSID password are the network hotspot information provided by the smart interaction tablet. In addition, the connection information may further include version information of the two-dimensional code, which is convenient for future expansion.

The process of the communication connection between the touch terminal and the smart interaction tablet may include: the touch terminal scans and recognizes the two-dimensional code, determines the content analysis mode by using the version number, and parses the connection information of the smart interaction tablet. If the touch terminal is connected to a WiFi hotspot, first try to establish a remote control connection with the smart interaction tablet using the LAN IP and service port number; if the touch terminal and the smart interaction tablet are not in the same LAN, the connection fails; further The touch terminal then connects the WiFi hotspot provided by the smart interactive tablet according to the hotspot SSID and the hotspot SSID password, and then establishes a remote control connection with the smart interactive tablet through the hotspot IP and the service port number; after the connection is successful, the touch terminal saves the connection information. Go to the local database, after which remote touch control of the smart interaction tablet can be implemented based on the connection.

Through the above connection manner, the touch terminal can select different connection modes to establish a communication connection with the smart interaction tablet.

Referring to FIG. 9, from the perspective of the client, a touch control method for the smart interaction tablet is also provided, including the steps of:

S31, detecting a touch operation of a tablet mirror image displayed on the touch terminal, where the tablet mirror image corresponds to a display interface of the smart interaction tablet;

S32. Determine a type of the touch operation and a first location, where the first location is a working position of the touch operation in the tablet mirror image.

S33: Send touch operation information to the smart interaction tablet, where the touch operation information includes a type of the touch operation and a first location; the touch operation information is used to trigger the smart interaction tablet to display a corresponding display in the display interface thereof. A touch response is determined according to a type of the touch operation and a second location, the second location being determined according to the first location.

In the touch control method of the smart interactive tablet, the user touches the displayed tablet mirror image on the touch terminal side, and the touch operation information is sent to the smart interaction tablet, and the smart interaction tablet stores the received touch operation information to the preset The driving file is configured to read the touch operation information from the driving file, thereby implementing a touch response corresponding to the touch operation of the touch terminal in the display interface of the smart interactive tablet. Thereby, the remote touch operation of the smart interaction tablet by the touch terminal is realized, and the touch operation effect of the user is consistent with the effect of the touch operation performed on the smart interaction tablet, which is convenient for the user to operate and improves the operation efficiency.

In one embodiment, the touch control method further includes: receiving display interface information sent by the smart interaction tablet; displaying a tablet mirror image, wherein the tablet mirror image is obtained according to the display interface information.

By displaying the tablet mirroring screen, it is convenient for the user to remotely operate the smart interactive tablet.

In one embodiment, the manner of determining the relative position comprises:

Obtaining an abscissa and an ordinate of the touch point included in the touch operation in the flat mirror image; wherein the abscissa and the ordinate of the touch point refer to a preset XY coordinate system, and the horizontal axis of the XY coordinate system a longitudinal direction of the flat mirror image, wherein a vertical axis of the XY coordinate system coincides with a width direction of the flat mirror image, and an origin of the XY coordinate system is a vertex of the flat mirror image; Obtaining a horizontal coordinate of the touch point and a length of the flat mirror image to obtain a first relative position of the abscissa of the touch point with respect to the length of the flat mirror image; according to the ordinate of the touch point and the flat mirror image Width, obtaining a second relative position of the ordinate of the touched point relative to the width of the flat mirror image; obtaining a position of the touch operation in the flat mirror image according to the first relative position and the second relative position .

By calculating the above relative position of the touch point in the flat mirror image, it is advantageous to improve the accuracy of the touch event localization and restoration.

In an embodiment, before receiving the display interface information sent by the smart interaction tablet, the method further includes: identifying an information code displayed on the smart interaction tablet display interface, where the information code includes connection information of the smart interaction tablet; The connection information establishes a communication connection with the smart interaction tablet.

Based on the communication connection, it provides a basis for subsequent instruction interaction, and display interface information and transmission of touch operation information.

It should be understood that, for each of the foregoing method embodiments, although the various steps in the flowchart are sequentially displayed as indicated by the arrows, the steps are not necessarily performed in the order indicated by the arrows. Except as explicitly stated herein, the execution of these steps is not strictly limited, and the steps may be performed in other orders. Moreover, at least some of the steps in the flowchart of the method embodiment may include a plurality of sub-steps or stages, which are not necessarily performed at the same time, but may be executed at different times, these sub-steps Alternatively, the order of execution of the stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of the other steps or other steps.

Based on the same idea as the touch control method of the smart interaction tablet in the above embodiment, a touch control device of the smart interaction tablet is also provided herein.

In an embodiment, as shown in FIG. 10, the touch control device of the smart interaction tablet includes:

The touch information receiving module 410 is configured to receive the touch operation information sent by the touch terminal, where the touch operation information includes a type of the touch operation and the first position; and the touch operation is performed on the tablet mirror image displayed by the touch terminal. In a touch operation, the tablet mirroring screen corresponds to a display interface of the smart interaction tablet, and the first location is a working position of the touch operation in the tablet mirror image.

The touch information storage module 420 is configured to store the touch operation information to a preset driving file, where the driving file is used to control a touch input function of the smart interaction tablet.

And a touch response module 430, configured to read the touch operation information from the driving file, and display a corresponding touch response in a display interface of the smart interaction tablet; the touch response is according to the type of the touch operation and The second position is determined, and the second position is determined according to the first position.

In one embodiment, the touch control device further includes: a display interface sending module, configured to acquire display interface information of the smart interaction tablet, and send the display interface information to the touch terminal to display the tablet on the touch terminal Mirror image.

In one embodiment, the action position includes: a first relative position of the touch point abscissa corresponding to the touch operation relative to a length of the tablet mirror image, and a touch point ordinate corresponding to the touch operation is relative to a second relative position of the width of the flat mirror image; wherein the abscissa and the ordinate of the touch point refer to a preset XY coordinate system, and the horizontal axis of the XY coordinate system and the length direction of the flat mirror image The vertical axis of the XY coordinate system coincides with the width direction of the flat mirror image, and the origin of the XY coordinate system is one vertex of the flat mirror image.

The touch response module 430 includes: a location determining unit, configured to obtain location information in a length direction according to the first relative location and a length of the smart interaction flat panel display interface; and display the second relative location and the smart interaction tablet according to the second relative location The width of the interface is obtained as the position information in the width direction; the second position in the smart interactive flat panel display interface is determined according to the position information in the length direction and the position information in the width direction.

In an embodiment, as shown in FIG. 11, the touch control device of the smart interaction tablet includes:

The touch detection module 510 is configured to detect a touch operation of a tablet mirror image displayed on the touch terminal, where the tablet mirror image corresponds to a display interface of the smart interaction tablet.

The touch information determining module 520 is configured to determine a type of the touch operation and a first location, where the first location is a working position of the touch operation in the tablet mirror image.

And the touch information sending module 530 is configured to send touch operation information to the smart interaction tablet, where the touch operation information includes a type of the touch operation and a first location; the touch operation information is used to trigger a smart interaction tablet A corresponding touch response is displayed in its display interface, the touch response being determined according to the type of the touch operation and the second position, the second position being determined according to the first position.

In one embodiment, the touch control device of the smart interaction tablet further includes: an interface receiving and displaying module, configured to receive display interface information sent by the smart interaction tablet; and display a tablet mirror image, wherein the tablet mirror image is according to the The display interface information is obtained.

For a specific definition of the touch control device of the smart interactive tablet, reference may be made to the above description of the touch control method for the smart interactive tablet, and details are not described herein again. The various modules in the touch control device of the smart interactive tablet described above may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in the hardware in the processor in the smart interaction tablet, or may be stored in the memory in the smart interaction tablet, so that the processor calls the execution of the corresponding operations of the above modules.

In addition, in the implementation of the touch control device of the smart interactive tablet of the above example, the logical division of each program module is only an example, and the actual application may be considered according to requirements, for example, for the configuration requirements of the corresponding hardware or the convenience of implementation of the software. The function distribution is completed by different program modules, that is, the internal structure of the touch control device of the smart interaction tablet is divided into different program modules to complete all or part of the functions described above.

In an embodiment, an intelligent interaction tablet is provided, and an internal structure diagram of the smart interaction tablet may be as shown in FIG. The smart interaction tablet includes a processor connected via a system bus, a memory, a network interface, and a display with touch function. The processor of the smart interactive tablet is used to provide computing and control capabilities. The memory of the smart interactive tablet includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for operation of an operating system and computer programs in a non-volatile storage medium. The database of the smart interaction tablet is used to store a computer program that executes the touch control method of the smart interaction tablet described above. The computer program is executed by the processor to implement the touch control method of any of the above intelligent interactive tablets. The network interface of the smart interactive tablet is used for communicating with an external terminal (such as a touch terminal) through a network connection. The touch screen of the smart interactive tablet can be a capacitive screen, an electromagnetic screen or an infrared screen. In general, the touch screen can receive a touch operation input by a user through a finger or an input device. The input device includes but is not limited to: a stylus, an infrared pen, and/or a capacitive pen.

In one embodiment, a smart interaction tablet is provided, comprising: a memory, a touch screen having a touch function, and one or more processors; the memory for storing one or more programs; when the one or A plurality of programs are executed by the one or more processors such that the one or more processors implement the steps of a touch control method of any of the smart interactive tablets described above.

The smart interactive tablet implements a remote touch operation on the smart interaction tablet through the touch terminal by running one or more programs stored in the memory, and the touch operation effect is consistent with the touch operation performed on the smart interaction tablet. It is convenient for users to operate and improve operation efficiency.

In one embodiment, a touch terminal is provided. The internal structure of the touch terminal can be as shown in FIG. The touch terminal includes a processor connected via a system bus, a memory, a network interface, and a display having a touch function. The processor of the touch terminal is used to provide calculation and control capabilities. The memory of the touch terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for operation of an operating system and computer programs in a non-volatile storage medium. The database of the touch terminal is used to store a computer program for performing the touch control method of the smart interactive tablet described above. The computer program is executed by the processor to implement the touch control method of any of the above intelligent interactive tablets. The network interface of the touch terminal is used for communicating with an external terminal (for example, a smart interaction tablet) through a network connection. The touch screen of the touch terminal can be a capacitive screen, an electromagnetic screen or an infrared screen. In general, the touch screen can receive a touch operation input by a user through a finger or an input device. The input device includes but is not limited to: a stylus, an infrared pen, and/or a capacitive pen.

In one embodiment, a touch terminal is provided, a memory, a display having a touch function, and one or more processors; the memory for storing one or more programs; when the one or more The program is executed by the one or more processors such that the one or more processors implement the steps of a touch control method of any of the smart interactive tablets described above.

The touch terminal implements a remote touch operation on the smart interaction tablet through the touch terminal by running one or more programs stored in the memory, and the touch operation effect is consistent with the touch operation performed on the smart interaction tablet. It is convenient for users to operate and improve operation efficiency.

Those skilled in the art can understand that the structures shown in FIG. 12 and FIG. 13 are only a block diagram of a part of the structure related to the solution of the present application, and do not constitute a smart interactive tablet or a touch terminal to which the solution of the present application is applied. The specific smart interactive tablet and touch terminal may include more or less components than those shown in the figure, or some components may be combined, or have different component arrangements.

In one embodiment, a computer readable storage medium is provided having stored thereon a computer program that, when executed by a processor, implements the steps of a touch control method of any of the smart interactive tablets described above.

One of ordinary skill in the art can understand that all or part of the process of implementing the above embodiments can be completed by a computer program to instruct related hardware, and the computer program can be stored in a non-volatile computer readable storage. In the medium, the computer program, when executed, may include the flow of an embodiment of the methods as described above. Any reference to a memory, storage, database or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of formats, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronization chain. Synchlink DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The technical features of the above embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, It is considered to be the range described in this specification.

In the above embodiments, the descriptions of the various embodiments are all focused, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

The terms "comprising" and "having", and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or (module) units is not limited to the listed steps or units, but may alternatively include steps or units not listed, or Also includes other steps or units inherent to such processes, methods, products, or devices.

"Multiple" as referred to herein means two or more. "and/or", describing the association relationship of the associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate that there are three cases where A exists separately, A and B exist at the same time, and B exists separately. The character "/" generally indicates that the contextual object is an "or" relationship.

The "first\second" mentioned in this article is merely an object that distinguishes similar objects, and does not represent a specific ordering for objects. It is understandably that "first\second" can be interchanged if allowed. Order or order. It is to be understood that the "first\second" distinguished objects may be interchanged as appropriate to enable the embodiments described herein to be carried out in a sequence other than those illustrated or described herein.

The above-mentioned embodiments are merely illustrative of several embodiments of the present application, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the present application. Therefore, the scope of the invention should be determined by the appended claims.

Claims

A touch control method for an intelligent interactive tablet, comprising:

Receiving the touch operation information sent by the touch terminal, where the touch operation information includes a type of the touch operation and the first position; the touch operation is a touch operation of the tablet mirror image displayed on the touch terminal, and the flat mirror image is Corresponding to the display interface of the smart interaction tablet, the first location is a working position of the touch operation in the tablet mirror image;

And storing the touch operation information to a preset driving file, where the driving file is used to control a touch input function of the smart interaction tablet;

Reading the touch operation information from the drive file, displaying a corresponding touch response in a display interface of the smart interaction tablet; the touch response is determined according to the type of the touch operation and the second position, the second position Determined according to the first location.
The touch control method according to claim 1, further comprising:

Obtaining display interface information of the smart interaction tablet;

The display interface information is sent to the touch terminal, and the display interface information is used to trigger the touch terminal to display the flat mirror image.
The touch control method according to claim 2, further comprising:

Receiving an instruction for requesting touch control sent by the touch terminal, starting the preset first service and the second service;

The first service is configured to acquire a display interface of the smart interaction tablet, and send display interface information to the touch terminal;

The second service is configured to receive touch operation information sent by the touch terminal, store the touch operation information to a preset drive file, and read the touch operation information from the drive file, on the smart interaction tablet. The corresponding touch response is displayed in the display interface.
The touch control method according to claim 3, wherein the displaying the corresponding touch response in the display interface of the smart interaction tablet comprises:

Displaying a touch trace corresponding to the touch event in a display interface of the smart interaction tablet; and/or,

An execution response to the touch event is displayed in a display interface of the smart interactive tablet.
The touch control method according to any one of claims 1 to 4, wherein the drive file is a uinput file;

and / or,

The type of the touch operation includes one or more of clicking, holding, dragging, and sliding.
The touch control method according to any one of claims 1 to 4, wherein the action position comprises: a first relative position of an abscissa of the touch point included in the touch operation with respect to a length of the flat mirror image And a second relative position of the ordinate of the touch point included in the touch operation relative to the width of the flat mirror image;

Wherein, the abscissa and the ordinate of the touch point refer to the XY coordinate system, and the horizontal axis of the XY coordinate system coincides with the longitudinal direction of the flat mirror image, and the vertical axis of the XY coordinate system and the flat mirror image The width direction coincides, and an origin of the XY coordinate system is a vertex of the flat mirror image;

The determining the second location includes:

Obtaining position information in the longitudinal direction according to the first relative position and the length of the display interface of the smart interaction tablet;

Obtaining position information in the width direction according to the second relative position and the width of the display interface of the smart interaction tablet;

The second position in the smart interactive flat panel display interface is determined according to the position information in the length direction and the position information in the width direction.
The touch control method according to claim 3, wherein the receiving the instruction to request touch control sent by the touch terminal, before starting the preset first service and the second service, further includes:

Detecting an operation instruction for initiating remote touch control, generating an information code, where the information code includes connection information of the smart interaction tablet;

The information code is displayed on the display interface of the smart interaction tablet; after the information code is recognized by the touch terminal, the touch terminal can be triggered to establish a communication connection with the smart interaction tablet.
The touch control method according to claim 7, wherein

The information code includes a two-dimensional code;

and / or,

The connection information includes: network information of the smart interaction tablet and communication port information.
A touch control method for an intelligent interactive tablet, comprising:

A touch operation is performed on the tablet mirror image displayed by the touch terminal, where the tablet mirror image corresponds to the display interface of the smart interaction tablet;

Determining a type of the touch operation and a first location, where the first location is an active position of the touch operation in the tablet mirror image;

Sending touch operation information to the smart interaction tablet, the touch operation information includes a type of the touch operation and a first location; the touch operation information is used to trigger the smart interaction tablet to display a corresponding touch response in a display interface thereof The touch response is determined according to a type of the touch operation and a second location, the second location being determined according to the first location.
The touch control method according to claim 9, further comprising:

Receiving display interface information sent by the smart interaction tablet;

A tablet mirror screen is displayed, and the tablet mirror screen is obtained based on the display interface information.
The touch control method according to claim 10, wherein the determining the relative position comprises:

Obtaining an abscissa and an ordinate of the touch point included in the touch operation in the flat mirror image; wherein the abscissa and the ordinate of the touch point refer to a preset XY coordinate system, and the horizontal axis of the XY coordinate system a longitudinal direction of the flat mirror image, wherein a vertical axis of the XY coordinate system coincides with a width direction of the flat mirror image, and an origin of the XY coordinate system is a vertex of the flat mirror image;

Obtaining a first relative position of the abscissa of the touched point relative to the length of the flat mirror image according to the abscissa of the touched point and the length of the flat mirror image;

Obtaining a second relative position of the ordinate of the touch point relative to the width of the flat mirror image according to the ordinate of the touch point and the width of the flat mirror image;

And determining, according to the first relative position and the second relative position, an action position of the touch operation in the tablet mirror image.
The touch control method according to claim 10, wherein before receiving the display interface information sent by the smart interaction tablet, the method further includes:

Identifying an information code displayed on the smart interactive tablet display interface, where the information code includes connection information of the smart interaction tablet;

Establishing a communication connection with the smart interaction tablet according to the connection information.
A touch control device for an intelligent interactive tablet, comprising:

The touch information receiving module is configured to receive the touch operation information sent by the touch terminal, where the touch operation information includes a type of the touch operation and the first position; and the touch operation is a touch on the tablet mirror image displayed by the touch terminal In operation, the tablet mirroring screen corresponds to a display interface of the smart interaction tablet, and the first location is a working position of the touch operation in the tablet mirroring screen;

Touching the information storage module, configured to store the touch operation information to a preset driving file, where the driving file is used to control a touch input function of the smart interaction tablet;

And a touch response module, configured to read the touch operation information from the drive file, and display a corresponding touch response in a display interface of the smart interaction tablet; the touch response is according to the type of the touch operation and the second The position is determined, and the second position is determined according to the first position.
The touch control device according to claim 13, further comprising:

The display interface sending module is configured to obtain display interface information of the smart interaction tablet, and send the display interface information to the touch terminal to display a tablet mirror image on the touch terminal.
The touch control device according to claim 13, wherein

The action position includes: a first relative position of the touch point abscissa corresponding to the touch operation relative to a length of the tablet mirror image, and a touch point ordinate corresponding to the touch operation relative to the tablet mirror image a second relative position of the width;

Wherein, the abscissa and the ordinate of the touch point refer to a preset XY coordinate system, the horizontal axis of the XY coordinate system coincides with the length direction of the flat mirror image, and the vertical axis of the XY coordinate system and the flat plate The width direction of the mirror image is coincident, and an origin of the XY coordinate system is a vertex of the flat mirror image;

The touch response module includes:

a position determining unit, configured to obtain position information in a length direction according to the first relative position and a length of the smart interactive flat panel display interface; and obtain a position in a width direction according to the second relative position and a width of the smart interactive flat display interface Information; determining the second position in the smart interactive flat panel display interface according to the position information in the length direction and the position information in the width direction.
A touch control device for an intelligent interactive tablet, comprising:

a touch detection module, configured to detect a touch operation of a tablet mirror image displayed on the touch terminal, where the tablet mirror image corresponds to a display interface of the smart interaction tablet;

a touch information determining module, configured to determine a type of the touch operation and a first location, where the first location is a working position of the touch operation in the tablet mirror image;

And a touch information sending module, configured to send touch operation information to the smart interaction tablet, where the touch operation information includes a type of the touch operation and a first location; and the touch operation information is used to trigger a smart interaction tablet A corresponding touch response is displayed in the display interface, the touch response being determined according to the type of the touch operation and the second position, the second position being determined according to the first position.
An intelligent interactive tablet, comprising: a memory, a display screen with a touch function, and one or more processors;

The memory for storing one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors implement the steps of the method of any of claims 1-8.
A touch terminal, comprising: a memory, a display screen with a touch function, and one or more processors;

The memory for storing one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors implement the steps of the method of any of claims 9-12.
A computer readable storage medium having stored thereon a computer program, characterized in that the program, when executed by a processor, implements the steps of the method of any one of claims 1 to 12.