CN115066892A

CN115066892A - Data transmission method and data transmission system

Info

Publication number: CN115066892A
Application number: CN202080068836.9A
Authority: CN
Inventors: 吴卓恒; 孙晓飞
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2020-12-30
Filing date: 2020-12-30
Publication date: 2022-09-16
Also published as: WO2022141275A1

Abstract

A data transmission method and a data transmission system are provided. After the second terminal receives the picture data of the first terminal, the picture data is displayed in an acquisition card window form, when the second terminal confirms that the full-screen display is carried out on the acquisition card window, the HDMI channel is switched to, and the first picture data is displayed in the HDMI channel; therefore, after the second terminal acquires the first touch operation data, the touch operation corresponding to the first touch operation data is executed, and the first touch operation data is transmitted back to the first terminal, so that the first terminal executes the touch operation corresponding to the first touch operation data and updates the display picture of the first terminal, the touch feedback function is realized, and the function of sharing the picture of the picture data of the first terminal through the internet can be realized.

Description

Data transmission method and data transmission system

Technical Field

The present application relates to the field of computers, and in particular, to a data transmission method and a data transmission system.

Background

Hospitals, banks, research institutes and other places needing internal and external network isolation generally have two interactive flat panels, wherein one interactive flat panel A can only access a local area network due to the safety limitation of the places and can not access the external network, and the other interactive flat panel B can access the internal and external networks. When a user wants to perform a video conference, it is desirable to open video conference software on the interactive tablet B to enable the shared desktop function, so as to share the picture data displayed by the interactive tablet a to participants of other video conferences. In the related art, generally, an HDMI capture card is added between two interactive panels, the HDMI capture card is used to capture the image data of the interactive panel a, and the captured image data is transmitted to the interactive panel B for display, so that the image data is transmitted to other external network devices through the network-enabled interactive panel B. Since the interactive tablet realizes the extranet access function through the main control module connected to the interactive tablet, that is, the HDMI capture card transmits the acquired picture data to the main control module of the interactive tablet B, and the picture data is displayed by the main control module, and the picture data is transmitted to the extranet device, in this case, when the user performs a touch operation on the interactive tablet B, the interactive tablet B cannot transmit the touch data to the interactive tablet a.

Disclosure of Invention

In order to solve the above problem, embodiments of the present application provide a data transmission method and a data transmission system.

The embodiment of the application provides a data transmission method, which is applied to a second terminal, wherein the second terminal comprises a host channel and an HDMI channel, and the method comprises the following steps:

receiving first picture data; the first picture data comprises picture data of a display picture displayed on the first terminal;

displaying an acquisition card window on a current display picture of the host channel, and displaying the first picture data in the acquisition card window;

after confirming that the sharing operation of the display picture is received, sending second picture data of the current display picture to a conference terminal for displaying, wherein the conference terminal is connected with the second terminal through the internet;

switching to the HDMI channel when the full-screen display of the acquisition card window is confirmed;

displaying the first picture data in a full screen mode in the HDMI channel;

after receiving first touch operation data, sending the first touch operation data to the first terminal, so that after receiving the first touch operation data, the first terminal executes touch operation corresponding to the first touch operation data and updates a display picture of the first terminal;

the first terminal is only connected with a local area network, and the second terminal is connected with the Internet.

In the embodiment of the application, after the second terminal receives the picture data of the first terminal, the picture data is displayed in the form of an acquisition card window, when the second terminal confirms that the full-screen display is carried out on the acquisition card window, the second terminal is switched to an HDMI channel, and the first picture data is displayed in the HDMI channel; therefore, after the second terminal acquires the first touch operation data, the touch operation corresponding to the first touch operation data is executed, and the first touch operation data is transmitted back to the first terminal, so that the touch operation corresponding to the first touch operation data of the first terminal updates the display picture of the first terminal, the touch feedback function is realized, and the function of picture sharing of the picture data of the first terminal through the Internet can be realized.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 is a schematic diagram of connection between two interconnected flat panels isolated by internal and external networks according to the related art;

fig. 2 is a schematic structural diagram of a data transmission system according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a data transmission system according to an embodiment of the present application;

FIG. 4 is a schematic diagram illustrating an example of a sidebar display effect according to an embodiment of the present disclosure;

fig. 5 is a schematic flowchart of a data transmission method according to an embodiment of the present application;

fig. 6 is a schematic flowchart of another data transmission method according to an embodiment of the present application;

fig. 7 is a schematic system architecture diagram of a data transmission system according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of another data transmission system according to an embodiment of the present application;

fig. 9 is a schematic flowchart of another data transmission method according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a data transmission system according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

In the following description, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The following description provides embodiments of the present application, where different embodiments may be substituted or combined, and thus the present application is intended to include all possible combinations of the same and/or different embodiments described. Thus, if one embodiment includes feature A, B, C and another embodiment includes feature B, D, then this application should also be considered to include an embodiment that includes one or more of all other possible combinations of A, B, C, D, even though this embodiment may not be explicitly recited in text below.

The following description provides examples, and does not limit the scope, applicability, or examples set forth in the claims. Changes may be made in the function and arrangement of elements described without departing from the scope of the disclosure. Various examples may omit, substitute, or add various procedures or components as appropriate. For example, the described methods may be performed in an order different than the order described, and various steps may be added, omitted, or combined. Furthermore, features described with respect to some examples may be combined into other examples.

The hardware part of the interactive flat panel is composed of a touch display module, a complete machine module (including a controller) and the like, and is combined together by a whole structural member, wherein the touch display module comprises a display screen, a touch assembly and a backlight assembly, the backlight assembly is used for providing a backlight source for the display screen, the display screen generally adopts a liquid crystal display device and is used for displaying pictures, and the touch assembly is arranged on the display screen or at the front end of the display screen and is used for collecting touch data generated by touch operation of a user and sending the collected touch data to the complete machine module for processing.

In actual use, the screen data is displayed on the display screen of the interactive panel, when a user clicks the content displayed on the display screen through a touch object such as a finger or a stylus, for example, a graphical button displayed on the display screen, the touch component of the interactive panel acquires touch data, so that the touch component converts the touch data into coordinate data of a touch point and then transmits the coordinate data to the complete machine module, or the touch data is transmitted to the complete machine module and converted into coordinate data of the touch point by the complete machine module, and the complete machine module acquires the coordinate data of the touch point and then transmits the coordinate data to a corresponding program to realize corresponding control operation, so that the display content of the display screen is driven to change, and diversified display and operation effects are realized.

Touch components are distinguished from technical principles and can be divided into five basic categories; a vector pressure sensing technology touch component, a resistance technology touch component, a capacitance technology touch component, an electromagnetic technology touch screen, an infrared technology touch component, and a surface acoustic wave technology touch component. According to the working principle of the touch assembly and the medium for transmitting information, the touch assembly can be divided into four categories: resistive, capacitive, electromagnetic, infrared, and surface acoustic wave.

In the embodiment of the application, the interactive flat panel is equivalent to a display screen with a complete machine module and a touch control function, the complete machine module is a built-in module of the interactive flat panel and does not comprise a main control module, a low-performance Android system runs in the complete machine module, and the complete machine module mainly achieves display processing and touch control data processing functions of the interactive flat panel. The hardware configuration of the whole machine module is low, and the installation of other application software is not supported except for the configuration of an operating system and basic processing software (such as whiteboard writing software and annotation application software). If the interactive flat panel needs to realize other functions, the main control module needs to be accessed, corresponding functions are realized by installing relevant application software on the main control module, for example, the files need to be displayed, the relevant display software needs to be installed on the main control module, the video conference function needs to be realized, the video conference software needs to be installed on the main control module, and the like. The main control module is an Open plug capable Specification (OPS) module on the interactive tablet, and application software running on the interactive tablet is installed on the main control module. The main control module may be an operating system such as Windows and high-performance Android, for example, the main control module may be a PC module and a high-performance Android module, which may be understood as a computer.

The interactive panel at least comprises signal source channels such as an Android channel, a host channel and an HDMI channel, wherein the signal source channels are used for receiving input signals of different signal sources, so that the interactive panel can be switched among the different signal source channels to present media contents provided by the different signal sources. The Android channel is a working channel of the whole interactive tablet computer module and is used for presenting media contents of the whole interactive tablet computer module. The signal source accessed by the host channel is the host module, so that the host channel is used for presenting the media data input by the host module of the interactive tablet. The HDMI channel is used to present media data of a signal source accessed through an HDMI interface of the interactive tablet. In addition, when the interactive flat panel is in the host channel or the HDMI channel, the display screen of the interactive flat panel actually displays two system pictures, one is a picture of an Android channel, and the other is a picture of the host channel or the HDMI channel, and the picture of the Android channel has a partially transparent area, so that the picture of the host channel or the HDMI channel is displayed in the transparent area, and the displayed picture displayed finally is a display picture of the two channels. For example, if the picture of the Android channel is a sidebar, the picture of the Android channel is a transparent region except for the display region of the sidebar, so that the display picture of the host channel or the HDMI channel can be displayed in the transparent region, and the result presented to the user is the picture of the interactive flat panel display host channel or the HDMI channel, and the sidebar of the Android channel is displayed in an overlapping manner on the picture. Specifically, the whole module presets the area size of the display frame of the host channel or the HDMI channel, and the like, so that when receiving the touch data of the touch component, the whole module sends the touch data in the preset area to the host channel or the HDMI channel for response.

More specifically, the whole machine module comprises a main control board card, peripheral circuits such as a main control chip and a power circuit of the main control chip are arranged on the main control board card, a plurality of communication interfaces for communication are further arranged, and the plurality of communication interfaces are all connected with the main control chip. The plurality of communication interfaces specifically include a serial interface, a USB interface, an HDMI interface, a Type-C interface, and/or a Touch line port (Touch out port), and the like. The whole machine module is connected with the main control module through a serial interface, and interfaces such as a USB interface and an HDMI interface are in communication connection with other equipment or terminals, so that input signals of different signal sources are received, and corresponding signal source channels are formed. For example, the whole module is connected with the main control module through the serial interface to form a host channel, so as to receive and present media content sent by the host channel, or is connected with the external device through the HDMI interface to form an HDMI channel, so as to present media data input by the external device.

The main control chip is provided with a first functional unit and a second functional unit which are totally two independent functional units, the Android system is installed on the first functional unit, and the second functional unit is used for switching and controlling a signal source channel of the interactive flat panel. The first functional unit and the second functional unit may be implemented by different codes running on the same main control chip, or may be implemented by different codes on two main control chips (at this time, the number of the main control chips is two).

When the signal source channel of the interactive flat plate is an Android channel, the whole machine module represents that the interactive flat plate is in a working channel of the whole machine module and is used for presenting media contents of the whole machine module. At this time, when the complete machine module receives the touch data sent by the touch component, the Android system performs compatibility processing of the touch data (the touch data generated by different types of touch components are processed into data in a uniform format through the compatibility processing, so that the processing process of the Android system can perform identification and response), performs operation response of the touch data, and executes corresponding operation. When the signal source channel of the interactive panel is the host channel, the whole machine module receives touch data sent by the touch component, firstly, the Android system performs compatibility processing on the touch data, and then the Android system forwards the touch data generated in the display screen area of the host channel to the host channel through the second function unit for response according to the preset area size of the display screen of the host channel. When the signal source channel of the interactive panel is the HDMI channel, the complete machine module receives the touch data sent by the touch component, firstly, the Android system performs compatibility processing on the touch data, performs operation response on the touch data, and executes corresponding operation. Then, the Android system forwards the Touch data generated in the display screen area of the HDMI channel to a Touch line port (Touch out port) through the second function unit according to the preset area size of the display screen of the HDMI channel, and the Touch line port (Touch out port) is responded by an external device.

Fig. 1 is a schematic diagram illustrating connection between two interactive flat panels isolated from an internal network and an external network in the related art, in fig. 1, a first terminal 10 and a second terminal 20 are both interactive flat panels in the embodiment of the present application, the first terminal 10 is only connected to a local area network, and the second terminal 20 is connected to the internet. The first terminal 10 includes a first main control module 11 and a first complete machine module 12, and the second terminal 20 includes a second main control module 21, a second complete machine module 22 and a second touch screen 23. The application software for displaying files of the first terminal 10 is installed on the first main control module 11, so that the HDMI capture card 30 is connected between the first main control module 11 and the second main control module 21 for transmitting the picture data in the first terminal 10 to the second terminal 20. The HDMI capture card 30 collects the frame data of the first main control module 11, and then sends the frame data to the second main control module 21 for displaying in the form of capture card window, so that the software installed in the second main control module 21, such as video conference software, can share the display frame including the capture card window to other external terminals through the internet, thereby achieving the purpose of sending the frame data of the first terminal 10 to other external terminals through the internet for frame sharing.

In this case, since the HDMI capture card 30 sends the frame data of the first main control module 11 to the second main control module 21 for display, the second terminal 20 is in the host channel, and in this case, the second complete machine module 22 sends the received touch data to the second main control module 21 for response, and cannot send the touch data of the second terminal 20 to the first terminal 10, that is, cannot implement the touch backhaul function.

If the touch feedback function is to be implemented, the image data of the first main control module 11 needs to be sent to the second complete machine module 22 for display, but since the hardware configuration of the second complete machine module 22 is relatively low, the installation of application software is not supported except for the configuration of an operating system and basic processing software (such as whiteboard writing software and annotation application software). In this case, although the touch-back function can be realized, the purpose of transmitting the screen data of the first terminal 10 to another external terminal via the internet for screen sharing cannot be realized.

Therefore, in the related art, the connection mode between the first terminal 10 and the second terminal 20 with separated internal and external networks cannot simultaneously satisfy the requirements of sharing the screen data of the first terminal 10 via the internet and transmitting the touch data of the second terminal 20 to the first terminal 10.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a data transmission system according to an embodiment of the present application. As shown in fig. 2, the data transmission system may comprise a first terminal 10, a second terminal 20 and an HDMI capture card 30.

Wherein, the HDMI collecting card 30 includes a target HDMI port 301 and a target USB port 302, the first terminal 10 includes a first main control module 11 and a first complete machine module 12, the first main control module 11 includes a first HDMI port 111 and a first USB port 112, the second terminal 20 includes a second main control module 21, the second complete machine module 22 and the second touch screen 23, the second complete machine module 22 is connected to the second main control module 21 and the second touch screen 23, the second main control module 21 includes a second HDMI port 211 and a second USB port 212, the second complete machine module 22 includes a third HDMI port 221 and a touch line port 222, the first USB port 112 is connected to the touch line port 222, the first HDMI port 111 is connected to the target HDMI port 301, the target USB port 302 is connected to the second USB port 212, the second HDMI port 211 is connected to the third HDMI port 221, the first terminal 10 is connected to a local area network only, and the second terminal 20 is connected to the internet.

As shown in fig. 3, the first HDMI port of the first master module 11 is an HDMI OUT port. The second HDMI port on the second main control module 21 is an HDMI OUT port, the third HDMI port 221 on the second complete machine module 22 is an HDMI IN port, and the TOUCH line port on the second complete machine module is a TOUCH port.

As described above, in the conventional technology, the main control module of the interactive tablet is connected to the complete machine module through the serial interface, so that data interactive communication is realized through the serial interface, and a related interactive function is realized. IN this embodiment, the HDMI OUT port on the second main control module 21 is connected to the HDMI IN port on the second complete machine module 22, and a new communication link between the second main control module 21 and the second complete machine module 22 is established, so that the second complete machine module 22 can perform data interaction through the HDMI channel, so that the data of the main control module is transmitted to the HDMI IN port of the complete machine module, and thus, part or all of the pictures displayed by the main machine channel can be sent to the HDMI channel for display. By connecting the Touch line port (Touch out port) of the second complete machine module 22 to the first USB port 112 of the first terminal, and combining the HDMI channel working mode, the Touch line port (Touch out port) can implement the characteristic of Touch data output, and can implement that the Touch data of the second terminal is transmitted back to the first terminal for response.

The first terminal 10 and the second terminal 20 may have a sidebar application running on the left or right top of the screen pages, and may have high-frequency buttons, such as "back" and "home" after clicking the side to expand, as shown in fig. 4. Shown under the host channel is a host sidebar, and shown under the HDMI channel is a full-body sidebar. The switching between the HDMI channel and the host channel is realized by monitoring the clicking operation of the side bar keys by a user.

In an embodiment, after the second terminal 20 is started, first determining a system mode of the second terminal 20; and if the system mode is a non-copy screen mode, switching the system mode to a copy screen mode. The switch can be carried out between the host channel and the HDMI channel under the copy screen mode.

The first terminal 10 and/or the second terminal 20 include, but are not limited to: personal computers, interactive tablets, handheld devices, in-vehicle devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and the like. The user terminals may be called different names in different networks, for example: user equipment, access terminal, subscriber unit, subscriber station, mobile station, remote terminal, mobile device, user terminal, wireless communication device, user agent or user equipment, cellular telephone, cordless telephone, Personal Digital Assistant (PDA), terminal equipment in a 5G network or future evolution network, and the like.

For convenience of description, in the embodiment of the present application, a description is given by taking an example in which the first terminal and the second terminal are both interactive tablets.

It should be noted that the number of each port in each module is merely explained as an example, and the specific number of each port is not limited in the embodiment of the present application.

Through the above connection mode, one end of the HDMI OUT port of the first terminal 10 is connected to the USB port of the main control module of the second terminal 20 through an HDMI acquisition card, so that the frame of the first terminal can be displayed on the main control frame of the second terminal IN a windowed manner, and then the HDMI OUT of the second main control module 21 of the second terminal 20 is connected to the HDMI IN of the second complete machine module 22 of the second terminal 20 through an HDMI line, so that the data of the main control module is transmitted to the HDMI IN port of the complete machine module, so that part or all of the frames of the host channel can be transmitted to the HDMI channel for display, and finally, the first terminal 10 and the second terminal 20 are connected to each other through a Touch line, so that the function of returning through Touch can be realized. The method solves the problem that the internal terminal can meet the requirement of a user for TOUCH return of a main control picture under a plurality of large screens by combining a mode of realizing the HDMI acquisition card, the HDMI line and the TOUCH line by combining specific software under the condition of a local area network, and can realize the function of sharing the picture of the picture data of the first terminal 10 through the Internet connected with the second terminal 20.

Next, a data transmission method provided by an embodiment of the present application will be described with reference to the data transmission system shown in fig. 1 to 4.

Referring to fig. 5, fig. 5 is a schematic flowchart of a data transmission method according to an embodiment of the present application. The embodiment mainly emphasizes the process of implementing touch backtransmission, and the method includes:

s101, after receiving first picture data sent by a first main control module through a target HDMI port, an HDMI acquisition card sends the first picture data to a second USB port of a second main control module through a target USB port;

the HDMI acquisition card can be understood as an acquisition card with a high definition multimedia port in the embodiment of the present application. The acquisition card is mainly a capturing device for capturing external analog signals such as photoelectricity, video, audio and the like and leading the analog signals into a computer for digital processing, and mainly comprises an image acquisition card, a video acquisition card, an audio acquisition card (such as a sound card), a data acquisition card and the like. The HDMI acquisition card is provided with two ports of different types, namely an HDMI port and a USB port, the two terminals can be connected through the two ports, the HDMI acquisition card receives data of an HDMI data format of one terminal through the HDMI port, converts the format of the data into data of a USB data format after the data of the HDMI data format is converted, and then sends the data of the USB data format to the other terminal.

The first main control module can be understood as an external system carried on the first terminal in the embodiment of the present application

The module, such as a PC module or a high-performance Android module, is mainly used for transmitting video-related data.

The second main control module in the embodiment of the present application may be understood as an external system module carried on the second terminal, and may also be a PC module or a high-performance Android module, and is mainly used for transmitting video related data.

The first screen data may be understood as data information corresponding to a screen displayed by the first terminal in the embodiment of the present application.

Specifically, the first main control module acquires first picture data of the first terminal and sends the first picture data to the HDMI acquisition card through the first HDMI port, the HDMI acquisition card acquires the first picture data through the target HDMI port and sends the first picture data to the second USB port of the second main control module on the second terminal through the target USB port, and therefore the first picture data of the first terminal is transmitted to the second terminal. It should be noted that, here, the first picture data acquired by the HDMI capture card through the target HDMI port is data encoded into HDMI format by the first main control module, the HDMI capture card performs format conversion on the data in HDMI data format, converts the first picture data from HDMI data format to USB data format, and sends the first picture data to the second main control module through the target USB port, that is, the first picture data received from the target HDMI port is transmitted in HDMI data format, and the first picture data sent through the target USB port is transmitted in USB data format, so that after the second main control module receives the first picture data in USB data format, the second main control module can perform display in corresponding form according to the setting of the second main control module, for example, display as a window, display full screen, or pop up a window for the user to confirm whether to perform display or not.

S102, after the second main control module receives first picture data of a first terminal acquired by the HDMI acquisition card through a second USB port, the second terminal displays an acquisition card window in a host channel working mode and displays the first picture data in the acquisition card window, wherein the first picture data comprises picture data of a display picture displayed at the first terminal;

the acquisition card window is a window on the display screen of the second terminal, which is used to display the first screen data. In the embodiment of the present application, the acquisition card window is generated by an independent program running on the second main control module, and the independent program may be referred to as an acquisition card window program. The acquisition card window program runs on the second main control module and can receive the first picture data, so that the received first picture data can be displayed in the acquisition card window.

Specifically, after receiving the first picture data in the USB data format transmitted by the HDMI capture card through the second USB port, the second main control module displays the capture card window on the current display picture of the second terminal, and displays the first picture data in the capture card window, so as to display the picture content of the first terminal on the second terminal. At this time, the second terminal is in a host channel mode and is configured to display the picture data of the second main control module. That is, the actual display effect is to display the capture card window on the frame of the second main control module in an overlapping manner, and then display the first frame data in the capture card window. For example, the second main control module originally runs video conference software and displays a video conference picture, and after receiving the first picture data through the second USB port, the second main control module displays an acquisition card window on the video conference picture and displays the first picture data in the acquisition card window. So that the picture viewed by the user is the picture data of the first terminal displayed in the form of a window on the picture of the second terminal.

S103, when the second main control module confirms that the acquisition card window is displayed in a full screen mode, channel switching information is sent to the second complete machine module, and the first picture data is sent to a third HDMI port (HDMI in port) of the second complete machine module through a second HDMI port (HDMI out port);

the channel may be understood as a data channel for accessing a memory of the display to obtain EDID format data of the EEPROM in the display, so as to determine display attribute (such as resolution, aspect ratio, and the like) information of the display, and may directly transmit physical data of the display to the terminal.

In the embodiment of the application, when a user performs full-screen display operation on a capture card window, the user operation triggers a corresponding operation signal, the second main control module determines that the operation signal for full-screen display is received, and then sends channel switching information to the second complete machine module, and meanwhile, the second main control module sends the first picture data to the second complete machine module. The full-screen display operation may be performed by clicking a preset control on the sidebar, for example, clicking a full-screen display button, selecting full-screen display through a menu, and performing voice control.

The second main control module is connected with the second complete machine module through a serial interface, and the second main control module transmits the channel switching information to the second complete machine module through the serial interface.

S104, after the second complete machine module receives the channel switching information, the host channel of the signal source channel is switched to the HDMI channel, and after the first picture data sent by the second main control module are received, the second terminal displays the first picture data in the HDMI channel working mode;

specifically, after receiving the channel switching information, the second complete machine module switches the host channel to the HDMI channel to realize channel switching, and meanwhile, receives the first picture data. The second complete machine module is connected with the second touch screen, and the second complete machine module sends the first picture data to the second touch screen for displaying, so that the display of the first picture data and the switching of channels in a full-screen mode are realized.

S105, after the first touch operation data of the second touch screen are obtained by the second complete machine module, the first touch operation data are sent to a first USB port of the first terminal through the touch line port;

in the HDMI channel, a user can perform a touch operation on a second touch screen of the second terminal, and after the user inputs touch information on the second touch screen, the second complete machine module obtains first touch operation data of the touch operation, and then responds to the touch operation on the second terminal, for example, a touch track is generated, an operation control is responded, and the like. Meanwhile, the second terminal is connected with the first terminal through a touch line, and then the second complete machine module sends the first touch operation data to the first main control module of the first terminal through the touch line so as to respond on the first terminal.

The touch operation may include a writing operation, an operation of calling a graphic control to insert the graphic, an operation of calling an adjustment control to adjust a display screen, and the like. For example, a user writes a mark on a display screen, forms a selection track, and the like on a second touch screen of the second terminal, and at this time, the second complete machine module sends the first touch operation data to the first main control module of the first terminal through the touch line, so the first terminal can also write a mark on the display screen, form a selection track, and the like.

S106, after the first terminal receives the first touch operation data through the first USB port, touch operation corresponding to the first touch operation data is executed, and a display picture of the first terminal is updated.

The first terminal receives first touch operation data sent by the second terminal through the first main control module, responds to touch operation corresponding to the first touch operation data, and meanwhile updates the display picture to present the same response effect as the second terminal, so that touch return is realized, and further, a process that a user performs operation control on the picture on the first terminal through touch operation of the second terminal is realized.

In one or more embodiments of the present application, after the second main control module of the second terminal acquires the frame data of the first terminal, the frame data is displayed in the form of the capture card window, when the second main control module confirms that the capture card window is displayed in full screen, the channel switching information is sent to the second complete machine module, and the frame data of the second main control module is sent to the third HDMI port of the second complete machine module through the second HDMI port, and after the second complete machine module receives the channel switching information, the signal source channel is switched to the HDMI channel, so that the frame data can be displayed through the HDMI channel, then, after the second complete machine module acquires the first touch operation data in the HDMI channel, the first touch operation data is transmitted back to the first main control module, so as to execute the touch operation corresponding to the first touch operation data, and update the display frame of the first terminal, thereby implementing the touch backhaul function, and the function of sharing the picture of the picture data of the first terminal through the internet can be realized.

Referring to fig. 6, fig. 6 is a schematic flowchart of another data transmission method provided in the embodiment of the present application. The embodiment mainly emphasizes that the touch back process is realized when the video conference is carried out. As shown in fig. 6, the method includes:

s201, after receiving first picture data sent by a first main control module through a target HDMI port, an HDMI acquisition card sends the picture data to a second USB port of a second main control module through a target USB port;

s202, after the second main control module receives first picture data of the first terminal acquired by the HDMI acquisition card through the second USB port, the second terminal displays an acquisition card window in a host channel working mode and displays the first picture data in the acquisition card window, wherein the first picture data comprises picture data of a display picture displayed at the first terminal;

S201-S202 can be referred to as S101-S102, and are not described herein.

And S203, after confirming that the sharing operation of the display picture is received, the second main control module sends the second picture data of the current display picture to a conference terminal for displaying, and the conference terminal is connected with the second main control module through the Internet.

The received sharing operation for the display frame may be passive reception, that is, the second main control module receives a sharing request for the display frame sent by the conference terminal through the video conference software, and after receiving an operation of confirming the sharing request by the user, confirms that the sharing operation for the display frame is received, specifically, the sharing operation may be a conference joining operation performed by the user clicking a video conference joining key when the other conference terminal invites the user to perform the video conference. Or the sharing operation of the display frame can be initiated actively, that is, after the second main control module receives a sharing instruction of the display frame initiated by the user on the video conference software, the sharing operation of the display frame is confirmed to be received. Specifically, the user may click an initiation key in the video conference software on the screen and select the participant terminal.

S204, when the second main control module confirms that the full screen display is carried out on the acquisition card window, channel switching information is sent to the second complete machine module, and the first picture data is sent to a third HDMI port of the second complete machine module through the second HDMI port;

it should be noted that, for the main control module, displaying the capture card window in full screen means that the picture actually displayed by the main control module is the full screen display window of the capture card window, and therefore, the second picture data sent by the main control module to the conference terminal for displaying is the data in the capture card window in full screen display state, that is, the conference terminal also displays the content in the capture card window in full screen, so as to achieve the consistency with the display picture of the first terminal.

S205, after receiving the channel switching information, the second complete machine module switches the signal source channel into the HDMI channel, receives the first picture data sent by the second main control module, and displays the first picture data through the second touch screen;

s206, after the second complete machine module obtains the first touch operation data of the second touch screen, corresponding touch operation is executed, and the first touch operation data are sent to the first USB port of the first main control module through the touch line port;

and S207, after receiving the first touch operation data through the first USB port, the first terminal executes touch operation corresponding to the first touch operation data, and updates a display picture of the first terminal.

Executing the touch operation corresponding to the first touch operation data, which may specifically be: drawing corresponding writing handwriting based on the first touch operation; or calling the corresponding application control based on the first touch operation.

The touch operation may be a writing operation, or an operation of calling a graphic control to insert a graphic, an operation of calling an adjustment control to adjust a display screen, or the like. For example, a user writes a mark on a display screen, forms a selection track, and the like on a second touch screen of the second terminal, and at this time, the second complete machine module sends the first touch operation data to the first main control module of the first terminal through the touch line, so the first terminal can also write a mark on the display screen, form a selection track, and the like.

S204-S207 can be referred to as S103-S106, and are not described herein.

S208, after receiving second touch operation data of the second touch screen, the second complete machine module sends the second touch operation data to the second main control module;

the second touch operation may be a writing operation.

Because the second complete machine module is respectively connected with the second touch screen and the second main control module, after a user inputs a second touch operation on the second touch screen, the second complete machine module receives second touch operation data corresponding to the second touch operation sent by the second touch screen and then sends the second touch operation data to the second main control module.

And S209, after receiving the second touch operation data, the second main control module displays the corresponding handwriting, and sends the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data.

And the second main control module writes corresponding notes after receiving the second touch operation data, and simultaneously synchronously sends the data to the conference terminal, so that the same written notes are displayed on the conference terminal, and the effects of remote control and synchronous display are realized.

And S210, after receiving the third touch operation data sent by the conference terminal, the second main control module executes the touch operation corresponding to the third touch operation data, and updates the display picture of the HDMI channel.

And the user can also perform touch operation on the conference terminal, so that the conference terminal sends corresponding second touch operation data to the second main control module, and the second main control module responds to the corresponding operation and synchronously updates the display picture. Specifically, after receiving second touch operation data sent by the conference terminal, the second main control module executes touch operation corresponding to the second touch operation data, generates corresponding touch handwriting on one transparent layer, and sends the data of the transparent layer with the touch handwriting to the second complete machine module, and the complete machine module displays the data and the first picture data in a superposition manner, so that updating of a display picture of an HDMI channel is realized, the display picture is represented as that the touch handwriting is displayed on the first picture data, and the operation of the conference terminal is restored. Therefore, in the process of picture sharing, the touch operation of the user at the conference terminal is received, and corresponding handwriting data is formed. The method and the system can receive the expert annotation data of the remote consultation specialist in a medical scene, so that a local doctor can see consultation opinions more clearly. Therefore, the scheme not only can share the intranet data to other conference terminals through the extranet terminal, but also can receive and display handwriting data of other conference terminals.

S211, when the second complete machine module confirms that the operation instruction of exiting the HDMI channel is received, switching the signal source channel into a host channel, and displaying second picture data after receiving the second picture data of the current display picture sent by the second main control module through the host channel;

the second whole machine module calls a port for displaying the whole machine side bar and displays the whole machine side bar; when the second complete machine module receives the clicking operation aiming at the preset control of the side rail of the complete machine, the second complete machine module confirms that the operation instruction of exiting the HDMI channel is received, the HDMI channel exits at the moment and is switched to the host channel, the second main control module is connected with the second complete machine module through a serial interface, the second main control module sends second picture data to the second complete machine module through the connected serial interface, and the second complete machine module sends the second picture data to the second touch screen to display the second picture data.

S212, when the second main control module confirms the windowing operation of the acquisition card window, displaying the acquisition card window on the current display picture in a windowing manner;

the windowing operation and the full-screen operation are inverse processes, and it can be understood that the HDMI channel is currently located after the full-screen operation, and the host channel is currently located after the windowing operation.

The windowing operation may also be input by clicking a preset control of the sidebar, or by voice input, and after the windowing operation is performed, the HDMI channel is switched to the host channel.

S213, the second main control module confirms the reduction operation of the acquisition card window and reduces the acquisition card window according to the preset size;

at this time, the acquisition card window covers most of the area of the display screen, so that a user can click a reduction button of an acquisition card window program to reduce the window and control the acquisition card window to reduce according to a preset size in order to facilitate the user to operate other contents displayed on the touch screen (such as starting video conference software, starting instant messaging software and the like). Of course, this time still under the host channel.

S214, when the second main control module confirms that the full screen display is carried out on the acquisition card window, the acquisition card window is displayed in the full screen on the current display picture.

Similarly, the full screen display can be realized by clicking a preset control of the side bar, or by voice input and the like, and the reduced acquisition card window is directly changed into a full screen window, and meanwhile, the host channel is switched to the HDMI channel.

For example, as shown in fig. 7, when an orthopedics doctor needs to perform a touch feedback operation explanation on an X-ray image of a sternum while performing a video conference, the doctor connects the first terminal and the second terminal through the HDMI capture card, so that image data of the first terminal is transmitted to the second main control module of the second terminal through the HDMI capture card, and the second main control module controls to generate a capture card window and display an image corresponding to the transmitted image data in the capture card window. At the moment, the doctor initiates the conference by clicking the video conference software on the second terminal screen, and invites other doctors to participate in the video conference to discuss the condition of the X-ray picture. And after responding to the initiating operation, the second terminal sends a video conference request to other conference terminals through the Internet and sends the picture data to the connected conference terminals, so that the conference terminals participating in the video conference can see the picture of the first terminal displayed on the second terminal. When a doctor clicks a preset control (such as a 'homepage' control) of a side column of a display screen of a second terminal, the second terminal displays a capture card window in a full screen mode, and at the moment, the capture card window is positioned under an HDMI channel.

In one or more embodiments of the present application, after the second host module of the second terminal acquires the frame data of the first terminal, the frame data is displayed in the form of an acquisition card window, the second host module confirms that the sharing operation of the display frame is received, and then sends the second frame data of the currently displayed frame to a conference terminal for display, the conference terminal is connected to the second host module through the internet, when the second host module confirms that the acquisition card window is displayed in a full screen, channel switching information is sent to the second complete machine module, and the frame data of the second host module is sent to a third HDMI port of the second complete machine module through the second HDMI port, after the second complete machine module receives the channel switching information, the signal source channel is switched to the HDMI channel, so that the frame data can be displayed through the HDMI channel, then under the HDMI channel, after the second complete machine module acquires the first touch operation data, and returning the first touch operation data to the first main control module, so as to execute the touch operation corresponding to the first touch operation data, update the display picture of the first terminal, realize a touch return function, and realize a function of sharing the picture of the picture data of the first terminal through the internet.

Referring to fig. 8, fig. 8 is a schematic structural diagram of another data transmission system according to an embodiment of the present application. As shown in fig. 8, the data transmission system may include a first terminal 10 and a second terminal 20.

The first terminal 10 includes a first main control module 11 and a first complete machine module 12, the first main control module 11 includes a first Type-C port 111 and a first USB port 112, the second terminal 20 includes a second main control module 21, a second complete machine module 22 and a second touch screen 23, the second complete machine module 22 is connected with the second main control module 21 and the second touch screen 23, the second main control module 21 includes a second HDMI port 211 and a second Type-C port 212, the second complete machine module 22 includes a third HDMI port 221 and a touch line port 222, the first USB port 112 is connected with the touch line port 222, the first Type-C port 111 is connected with the second Type-C port 212, the second HDMI port 211 is connected with the third HDMI port 221, the first terminal 10 is connected with a local area network only, and the second terminal 20 is connected with the internet.

As shown IN fig. 8, the second HDMI port on the second main control module 21 is an HDMI OUT port, the third HDMI port 221 on the second complete machine module 22 is an HDMI IN port, and the TOUCH line port on the second complete machine module is a TOUCH port.

The first terminal 10 is configured to send first picture data to the second Type-C port 212 of the second main control module 21 through the first Type-C port, where the first picture data includes picture data of a display picture displayed on the first terminal 10;

the second main control module 21 is configured to display the acquisition card window on the second terminal 20 through the host channel after receiving the first picture data through the second Type-C port 212, and display the first picture data in the acquisition card window;

the second main control module 21 is further configured to send channel switching information to the second complete machine module 22 when it is determined that the full screen display is performed on the capture card window, and send the first picture data to a third HDMI port 221 of the second complete machine module through the second HDMI port 211;

the second complete machine module 22 is configured to switch the signal source channel from the host channel to the HDMI channel after receiving the channel switching information, and display the first picture data through the second touch screen 23 after receiving the first picture data sent by the second main control module 21;

the second complete machine module 22 is further configured to, after acquiring the first touch operation data of the second touch screen 23, send the first touch operation data to the first USB port of the first main control module 11 through the touch line port 222; here, after the second complete machine module 22 acquires the first touch operation data, the corresponding touch operation may be executed, and the response to the first touch operation data is also implemented in the second terminal.

The first terminal 10 is further configured to execute a touch operation corresponding to the first touch operation data after receiving the first touch operation data through the first USB port 112, and update a display screen of the first terminal.

In the embodiment of the application, an HDMI acquisition card is not needed, the first terminal and the second terminal are connected through a data line with two Type-C terminals, serial port connection of the two terminals is achieved, data interaction between the two terminals is achieved, the connection mode is simple and convenient, and cost can be saved. In addition, after the second main control module of the second terminal acquires the picture data of the first terminal, the picture data is displayed in the form of an acquisition card window, when the second main control module confirms that the full screen display is carried out on the acquisition card window, channel switching information is sent to the second whole machine module, and the picture data of the second main control module is sent to a third HDMI port of the second complete machine module through the second HDMI port, the second complete machine module switches the signal source channel into the HDMI channel after receiving the channel switching information, therefore, the image data can be displayed through the HDMI channel, and then under the HDMI channel, the second complete machine module transmits the first touch operation data back to the first main control module after acquiring the first touch operation data, thereby executing the touch operation corresponding to the first touch operation data, updating the display picture of the first terminal, realizing the touch return function, and the function of sharing the picture of the picture data of the first terminal through the internet can be realized.

Next, a data transmission method provided in an embodiment of the present application will be described with reference to a data transmission system shown in fig. 8.

As shown in fig. 9, fig. 9 is a schematic flowchart of another data transmission method provided in this embodiment of the present application. The embodiment mainly emphasizes the process of implementing touch backtransmission, and the method includes:

s301, the first terminal sends first picture data to a second Type-C port of a second main control module through the first Type-C port, wherein the first picture data comprises picture data of a display picture displayed on the first terminal;

Type-C is a hardware interface specification for a universal serial bus. The biggest characteristic of the TypeC double-sided pluggable port is that the double-sided plugging of a USB interface is supported, and meanwhile, a USB data line matched with the TypeC double-sided pluggable port for use must be thinner and lighter.

And connecting the first terminal with a Type-C port of the second terminal through a USB data line, and transmitting the picture data displayed by the first terminal to a second main control module of the second terminal.

S302, after receiving the first picture data through the second Type-C port, the second main control module displays an acquisition card window on the second terminal through the host channel, and displays the first picture data in the acquisition card window;

since the two ports are the same, format conversion of the first picture data may not be necessary. After receiving the first picture data through the second Type-C port, the second main control module may perform a corresponding form of display according to the setting of the second main control module, for example, display as a window, display in a full screen, or pop up a window for a user to confirm whether to perform display or not.

In the embodiment of the present application, the first image data may be displayed in the form of a capture card window.

S303, when the second main control module confirms that the full screen display is carried out on the acquisition card window, channel switching information is sent to the second complete machine module, and the first picture data is sent to a third HDMI port of the second complete machine module through the second HDMI port;

s304, after the second complete machine module receives the channel switching information, the host channel of the signal source channel is switched into the HDMI channel, and after the first picture data sent by the second main control module is received, the first picture data is displayed through the second touch screen;

s305, after the second complete machine module obtains first touch operation data of the second touch screen, the first touch operation data are sent to a first USB port of the first main control module through a touch line port; here, after the second complete machine module acquires the first touch operation data of the second touch screen, corresponding touch operation can be executed, and a response to the first touch operation data is also realized at the second terminal;

s306, after the first terminal receives the first touch operation data through the first USB port, touch operation corresponding to the first touch operation data is executed, and a display picture of the first terminal is updated.

For specific description of S303 to S306, reference may be made to S103 to S106, which are not described herein again.

In the embodiment of the application, an HDMI acquisition card is not needed, the first terminal and the second terminal are connected through a data line with two Type-C terminals, serial port connection of the two terminals is achieved, data interaction between the two terminals is achieved, the connection mode is simple and convenient, and cost can be saved. In addition, after the second main control module of the second terminal acquires the picture data of the first terminal, the picture data is displayed in a capture card window form, when the second main control module confirms that the full screen display is carried out on the acquisition card window, channel switching information is sent to the second whole machine module, and the picture data of the second main control module is sent to a third HDMI port of the second complete machine module through the second HDMI port, the second complete machine module switches the signal source channel into the HDMI channel after receiving the channel switching information, therefore, the image data can be displayed through the HDMI channel, and then under the HDMI channel, after the second complete machine module acquires the first touch operation data, the first touch operation data is transmitted back to the first main control module, thereby executing the touch operation corresponding to the first touch operation data, updating the display picture of the first terminal, realizing the touch return function, and the function of sharing the picture of the picture data of the first terminal through the internet can be realized.

The touch return process mentioned in the present application is described below with reference to the second terminal.

It should be noted that the first terminal is connected to the local area network only, and the second terminal is connected to the internet. The second terminal includes a host channel and an HDMI channel. The two channels are used to receive input signals from different signal sources so that the channels can be switched between different signal sources to present media content provided by different signal sources. The signal source accessed by the host channel is the host module, so that the host channel is used for presenting the media data input by the host module of the interactive tablet. The HDMI channel is used to present media data of a signal source accessed through an HDMI interface of the interactive tablet.

Specifically, the system mode of the second terminal is switched to the copy screen mode, and the system mode can be switched between the host channel and the HDMI channel in the copy screen mode. The method comprises the steps that first picture data are displayed on a display picture of a first terminal, the first terminal transmits the first picture data to a second terminal, the second terminal receives the first picture data, a collection card window is displayed on a current display picture of a host channel, and the first picture data are displayed in the collection card window.

When the user carries out full-screen operation on the acquisition card window, the second terminal confirms that full-screen display is carried out on the acquisition card window, the signal source channel is switched to the HDMI channel from the host channel, and first picture data are displayed in the HDMI channel in full screen.

At the moment, the second terminal is under the HDMI channel, after receiving first touch operation data input by a user, the second terminal executes corresponding touch operation, and sends the first touch operation data to the first terminal, so that after receiving the first touch operation data, the first terminal executes touch operation corresponding to the first touch operation data, updates a display picture of the first terminal, and realizes that the touch operation on the second terminal is transmitted back to the first terminal.

And under the HDMI channel, the second terminal can also receive second touch operation data input by the user and display corresponding handwriting on the current display interface. And when the second terminal is also connected with a conference terminal, the second touch operation data is synchronously sent to the conference terminal, so that the conference terminal displays corresponding handwriting according to the second touch operation data, and the effect of the second terminal being the same as that of the display picture of the conference terminal is kept. Therefore, by the method, the touch operation data on the second terminal can be transmitted back to the first terminal, and the touch operation data on the second terminal can be transmitted to the conference terminal for display.

Under the HDMI channel, after the second terminal can receive the third touch operation data sent by the conference terminal,

and executing touch operation corresponding to the third touch operation data, and updating the display picture of the HDMI channel, so as to realize the effect of controlling the display interface of the second terminal through the conference terminal.

Of course, the user may exit the HDMI channel by operating the second terminal, thereby switching the signal source channel of the second terminal to the host channel. And under the host channel, when the windowing operation of the acquisition card window is confirmed, changing the full-screen mode into the windowing mode, and displaying the acquisition card window in a windowing mode on the current display picture. The implementation mode of exiting the HDMI channel comprises the steps that the whole machine side bar is displayed on the current display picture, and a user clicks a preset control of the whole machine side bar to confirm that an operation instruction of exiting the HDMI channel is received.

In order to operate application software or tools on the display interface conveniently, a user can adjust the size of the acquisition card window, the second terminal confirms that the adjustment operation of the acquisition card window is received, and the acquisition card window is adjusted according to the preset size.

In addition, the second terminal is connected with the conference terminal through the internet. Under the host channel, the user can operate corresponding video conference software, and after the second terminal confirms that the sharing operation of the currently displayed second picture data is received, the second picture data is sent to the connected conference terminal for displaying, so that the picture sharing effect can be realized. The sharing operation of the second picture data can be passively received by the second terminal, that is, the second terminal can receive a sharing request of a display picture sent by the conference terminal through the video conference software, and after receiving an operation of confirming the sharing request by a user, confirms that the sharing operation of the display picture is received; or the sharing operation of the display screen can be actively initiated by the second terminal, that is, after the second terminal receives a sharing instruction of the display screen initiated by the user on the video conference software, the sharing operation of the display screen is confirmed to be received.

In an embodiment, the second terminal is connected with the first terminal through an HDMI acquisition card, and the HDMI acquisition card is configured to acquire first image data of the first terminal and send the first image data to the second terminal, where the first image data includes image data of a display image displayed on the first terminal. In another embodiment, the second terminal is connected with the first terminal through a Type-C connection line, and the first terminal directly transmits the first picture data displayed on the display picture of the first terminal to the second terminal through the Type-C connection line.

In one or more embodiments of the present application, after the second terminal acquires the picture data of the first terminal, displaying the image data in the form of acquisition card window, after the second terminal confirms that the sharing operation of the displayed image is received, transmitting the second picture data of the current display picture to a conference terminal connected through the internet for display, when the second terminal confirms that the full screen display is carried out on the acquisition card window, the signal source channel is switched to the HDMI channel, therefore, the image data can be displayed through the HDMI channel, and then under the HDMI channel, after the second terminal acquires the first touch operation data, the first touch operation data is transmitted back to the first terminal, thereby the first terminal executes the touch operation corresponding to the first touch operation data, and updates the display picture to realize the touch return function, and the function of sharing the picture of the picture data of the first terminal through the internet can be realized.

The data transmission system provided by the embodiment of the present application will be described in detail below with reference to fig. 9. It should be noted that, the data transmission system shown in fig. 9 is used for executing the method of the embodiment shown in fig. 5 of the present application, and for convenience of description, only the portion related to the embodiment of the present application is shown, and details of the specific technology are not disclosed, please refer to the embodiment shown in fig. 5 of the present application.

Referring to fig. 9, fig. 9 is a schematic structural diagram of a data transmission system 800 according to an embodiment of the present application. As shown in fig. 9, the system includes: an HDMI acquisition card 801, a second master control module 802, a second complete machine module 803, and a first terminal 804, wherein:

the HDMI acquisition card 801 is used for receiving the first picture data sent by the first main control module through the target HDMI port and then sending the picture data to the second USB port of the second main control module through the target USB port;

the second main control module 802 is configured to, after receiving, through the second USB port, first picture data of the first terminal acquired by the HDMI acquisition card, the second terminal displays an acquisition card window in a host channel operating mode, and displays the first picture data in the acquisition card window, where the first picture data includes picture data of a display picture displayed at the first terminal;

the second main control module 802 is configured to send channel switching information to the second complete machine module when it is determined that the full screen display is performed on the capture card window, and send the first frame data to a third HDMI port of the second complete machine module through the second HDMI port;

the second complete machine module 803 is configured to, after receiving the channel switching information, switch the signal source channel from the host channel to the HDMI channel, and after receiving the first picture data sent by the second main control module, display the first picture data by the second terminal in an HDMI channel working mode;

a second complete machine module 803, configured to obtain first touch operation data of the second touch screen, and send the first touch operation data to the first USB port of the first terminal through the touch line port;

the first terminal 804 is configured to execute a touch operation corresponding to the first touch operation data after receiving the first touch operation data through the first USB port, and update a display screen of the first terminal.

Optionally, the second main control module 802 is further configured to send the second picture data of the current display picture to a conference terminal for displaying after confirming that the sharing operation for the display picture is received, and the conference terminal is connected to the second main control module through the internet.

Optionally, the second main control module 802 is configured to confirm that the sharing operation on the display screen is received, and specifically configured to:

receiving a sharing request of a display picture sent by a conference terminal through video conference software, and confirming that the sharing operation of the display picture is received after receiving the operation of confirming the sharing request by a user; or after receiving a sharing instruction of the display screen initiated by the user on the video conference software, confirming that the sharing operation of the display screen is received.

Optionally, the second complete machine module 803 is further configured to send second touch operation data to the second main control module after receiving the second touch operation data of the second touch screen;

the second main control module 802 is further configured to display the corresponding handwriting after receiving the second touch operation data, and send the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data.

Optionally, when the second complete machine module confirms that the operation instruction of exiting the HDMI channel is received, the second complete machine module is configured to switch the signal source channel to the host channel, and display second picture data after receiving the second picture data of the current display picture sent by the second main control module through the host channel;

and when the second main control module confirms the windowing operation of the acquisition card window, displaying the acquisition card window in a windowing manner on the current display picture.

Optionally, the second complete machine module 803 is configured to confirm that the operation instruction exiting from the HDMI channel is received, and specifically configured to:

calling a port for displaying the whole machine side bar, and displaying the whole machine side bar;

and when the second complete machine module receives the click operation aiming at the preset control of the complete machine side rail, confirming that the operation instruction of exiting the HDMI channel is received.

Optionally, the second main control module 802 is further configured to confirm a reduction operation on the capture card window, and reduce the capture card window according to a preset size.

Optionally, the second main control module 802 is further configured to confirm that the capture card window is displayed in a full screen on the current display screen when the capture card window is displayed in the full screen.

Optionally, the second main control module 802 is further configured to, after receiving third touch operation data sent by the conference terminal, execute a touch operation corresponding to the third touch operation data, and update a display picture of the HDMI channel.

Optionally, the second complete machine module 803 is further configured to determine a system mode of the second terminal;

and if the system mode is the non-copy screen mode, switching the system mode to the copy screen mode.

Optionally, the touch operation corresponding to the first touch operation data is executed, and is specifically configured to: drawing corresponding writing handwriting based on the first touch operation; or calling the corresponding application control based on the first touch operation.

In one or more embodiments of the present application, after a second main control module of a second terminal acquires picture data of a first terminal, the picture data is displayed in the form of an acquisition card window, the second main control module confirms that a sharing operation for a display picture is received, then sends second picture data of a current display picture to a conference terminal for display, the conference terminal is connected to the second main control module through the internet, when the second main control module confirms that a full screen display is performed on the acquisition card window, channel switching information is sent to a second complete machine module, the picture data of the second main control module is sent to a third HDMI port of the second complete machine module through the second HDMI port, after the second complete machine module receives the channel switching information, a signal source channel is switched to an HDMI channel, so that the picture data can be displayed through the HDMI channel, and then under the HDMI channel, after the second complete machine module acquires first touch operation data, and returning the first touch operation data to the first main control module, so as to execute the touch operation corresponding to the first touch operation data, update the display picture of the first terminal, realize a touch return function, and realize a function of sharing the picture of the picture data of the first terminal through the internet.

The present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the above-described method. The computer-readable storage medium may include, but is not limited to, any type of disk including floppy disks, optical disks, DVDs, CD-ROMs, microdrive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of media or device suitable for storing instructions and/or data.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some service ports, indirect coupling or communication connection of devices or units, and may be electrical or in other forms.

Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program which instructs associated hardware to perform the steps, and the program may be stored in a computer readable memory, and the memory may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

The above are merely exemplary embodiments of the present disclosure, and the scope of the present disclosure should not be limited thereby. That is, all equivalent changes and modifications made in accordance with the teachings of the present disclosure are intended to be included within the scope of the present disclosure. Embodiments of the present disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

A data transmission method is applied to a second terminal, the second terminal comprises a host channel and an HDMI channel, and the method comprises the following steps:

receiving first picture data, wherein the first picture data comprises picture data of a display picture displayed on a first terminal;

displaying an acquisition card window on a current display picture of the host channel, and displaying the first picture data in the acquisition card window;

when full-screen display of the acquisition card window is confirmed, switching a signal source channel from the host channel to the HDMI channel;

displaying the first picture data in a full screen mode in the HDMI channel;

after first touch operation data are received, sending the first touch operation data to the first terminal, so that after the first terminal receives the first touch operation data, touch operation corresponding to the first touch operation data is executed, and a display picture of the first terminal is updated;

the first terminal is only connected with a local area network, and the second terminal is connected with the Internet.
The method of claim 1, further comprising:

and after confirming that the sharing operation of the display picture is received, sending the second picture data of the current display picture to a conference terminal for displaying, wherein the conference terminal is connected with the second terminal through the Internet.
The method according to claim 2, wherein the confirming receipt of the sharing operation for the display screen comprises:

receiving a sharing request of a display picture sent by a conference terminal through video conference software, and confirming that the sharing operation of the display picture is received after receiving the operation of confirming the sharing request by a user; or the like, or, alternatively,

and after receiving a sharing instruction of a display picture initiated by a user on the video conference software, confirming that the sharing operation of the display picture is received.
The method of claim 1, wherein after displaying the first picture data full screen in the HDMI channel, further comprising:

receiving second touch operation data;

displaying corresponding writing handwriting on a current display interface according to the second touch operation data;

and sending the second touch operation data to the conference terminal, so that the conference terminal displays corresponding handwriting according to the second touch operation data.
The method of claim 1, further comprising:

when the operation instruction of exiting the HDMI channel is confirmed to be received, switching the signal source channel into the host channel;

and when the windowing operation of the acquisition card window is confirmed, displaying the acquisition card window in a windowing manner on the current display picture.
The method of claim 5, wherein the acknowledging receipt of the operation instruction to exit the HDMI channel comprises:

displaying the whole machine side bar on the current display picture;

and when the click operation of the preset control of the whole machine side bar is received, confirming that the operation instruction for exiting the HDMI channel is received.
The method according to claim 5, wherein after said windowing said capture card window on said current display, further comprising:

and confirming that the adjustment operation of the acquisition card window is received, and adjusting the acquisition card window according to a preset size.
The method of claim 1, further comprising:

and after third touch operation data sent by the conference terminal are received, touch operation corresponding to the third touch operation data is executed, and the display picture of the HDMI channel is updated.
The method of claim 1, wherein prior to receiving the first picture data, further comprising:

determining a system mode of the second terminal;

and if the system mode is the non-copy screen mode, switching the system mode to the copy screen mode.
The method according to claim 1, wherein the performing the touch operation corresponding to the first touch operation data comprises:

drawing corresponding writing handwriting based on the first touch operation; or the like, or, alternatively,

and calling a corresponding application control based on the first touch operation.
The method of claim 1, wherein receiving first picture data comprises:

receiving first picture data sent by a video acquisition card, wherein the video acquisition card is used for acquiring the picture data of the first terminal.
A data transmission method is characterized in that the method is applied to a data transmission system, the system comprises a first terminal, a second terminal and an HDMI acquisition card, the first terminal comprises a first HDMI port and a first USB port, the second terminal comprises a second main control module, a second complete machine module and a second touch screen, the second main control module comprises a second HDMI port and a second USB port, the second complete machine module comprises a third HDMI port and a touch line port, the first USB port is connected with the touch line port, the first HDMI port is connected with the second USB port through the HDMI acquisition card, and the second HDMI port is connected with the third HDMI port, the method comprises the following steps:

after the second master control module receives the first picture data of the first terminal acquired by the HDMI acquisition card through the second USB port, the second terminal displays an acquisition card window in a host channel working mode and displays the first picture data in the acquisition card window, wherein the first picture data comprises picture data of a display picture displayed on the first terminal;

when the second main control module confirms that the full screen display is carried out on the acquisition card window, channel switching information is sent to the second complete machine module, and the first picture data is sent to the third HDMI port of the second complete machine module through the second HDMI port;

after the second complete machine module receives the channel switching information, a signal source channel is switched from a host channel to an HDMI channel, and after the first picture data sent by the second main control module are received, the second terminal displays the first picture data in an HDMI channel working mode;

after the second complete machine module obtains first touch operation data of the second touch screen, the first touch operation data are sent to the first USB port of the first terminal through the touch line port;

and after the first terminal receives the first touch operation data through the first USB port, executing touch operation corresponding to the first touch operation data, and updating a display picture of the first terminal.
The method of claim 12, further comprising:

and after confirming that the sharing operation of the display picture is received, the second main control module sends the second picture data of the current display picture to a conference terminal for displaying, and the conference terminal is connected with the second main control module through the internet.
The method of claim 12, wherein the second master module confirms receipt of the sharing operation for the display screen, and comprises:

the second main control module receives a sharing request of a display picture sent by a conference terminal through video conference software, and confirms that the sharing operation of the display picture is received after receiving the operation confirmed by a user on the sharing request; or the like, or, alternatively,

and after receiving a sharing instruction of the display frame initiated by the user on the video conference software, the second main control module confirms that the sharing operation of the display frame is received.
The method of claim 12, wherein after the displaying the first screen data through the second touch screen, further comprising:

after receiving second touch operation data of the second touch screen, the second complete machine module sends the second touch operation data to the second main control module;

and after receiving the second touch operation data, the second main control module displays corresponding writing handwriting, and sends the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding writing handwriting according to the second touch operation data.
The method of claim 12, further comprising:

when the second complete machine module confirms that the operation instruction of exiting the HDMI channel is received, the signal source channel is switched to the host channel, second picture data of the current display picture sent by the second main control module are received through the host channel, and then the second picture data are displayed through a second touch screen;

and when the second main control module confirms the windowing operation of the acquisition card window, displaying the acquisition card window in a windowing manner on the current display picture.
The method of claim 16, wherein the second complete machine module acknowledges receipt of the operation instruction to exit the HDMI channel, comprising:

displaying the whole side bar on the current display picture;

and when the second whole machine module receives the click operation of the preset control of the whole machine side rail, confirming that the operation instruction for exiting the HDMI channel is received.
The method according to claim 17, wherein after said windowing said capture card window on said current display, further comprising:

and the second main control module confirms the adjustment operation of the acquisition card window and adjusts the acquisition card window according to the preset size.
The method of claim 12, further comprising:

and after receiving third touch operation data sent by the conference terminal, the second main control module executes touch operation corresponding to the third touch operation data and updates the display picture of the HDMI channel.
The method according to claim 12, wherein before the HDMI capture card receives the frame data from the first host module through the target HDMI port, the method further comprises:

determining a system mode of the second terminal;

and if the system mode is the non-copy screen mode, switching the system mode to the copy screen mode.
The method of claim 12, wherein the performing the touch operation corresponding to the first touch operation data comprises:

drawing corresponding writing handwriting based on the first touch operation; or the like, or, alternatively,

and calling a corresponding application control based on the first touch operation.
A data transmission method is characterized in that the method is applied to a data transmission system, the system comprises a first terminal and a second terminal, the first terminal comprises a first Type-C port and a first USB port, the second terminal comprises a second main control module, a second complete machine module and a second touch screen, the second complete machine module is respectively connected with the second main control module and the second touch screen, the second main control module comprises a second HDMI port and a second Type-C port, the second complete machine module comprises a third HDMI port and a touch line port, the first USB port is connected with the touch line port, the first HDMI port is connected with the second USB port through an HDMI acquisition card, and the second HDMI port is connected with the third HDMI port, the method comprises the following steps:

the first terminal sends first picture data to the second Type-C port of the second main control module through the first Type-C port, wherein the first picture data comprises picture data of a display picture displayed on the first terminal;

after receiving the first picture data through the second Type-C port, the second main control module displays an acquisition card window on the second terminal through a host channel, and displays the first picture data in the acquisition card window;

when the second main control module confirms that the full screen display is carried out on the acquisition card window, channel switching information is sent to the second complete machine module, and the first picture data is sent to the third HDMI port of the second complete machine module through the second HDMI port;

after receiving the channel switching information, the second complete machine module switches a signal source channel from a host channel to an HDMI channel, receives the first picture data sent by the second main control module, and displays the first picture data through the second touch screen;

after the second complete machine module obtains first touch operation data of the second touch screen, the first touch operation data are sent to the first USB port of the first main control module through the touch line port;

and after the first terminal receives the first touch operation data through the first USB port, executing touch operation corresponding to the first touch operation data, and updating a display picture of the first terminal.
A data transmission system is characterized by comprising a first terminal, a second terminal and an HDMI acquisition card, wherein the first terminal comprises a first HDMI port and a first USB port, the second terminal comprises a second main control module, a second complete machine module and a second touch screen, the second complete machine module is respectively connected with the second main control module and the second touch screen, the second main control module comprises a second HDMI port and a second USB port, the second complete machine module comprises a third HDMI port and a touch line port, the first USB port is connected with the touch line port, the first HDMI port is connected with the second USB port through the HDMI acquisition card, the second HDMI port is connected with the third HDMI port, the first terminal is only connected with a local area network, and the second terminal is connected with the Internet;

the HDMI acquisition card is used for acquiring first picture data of the first terminal and sending the first picture data to the second USB port of the second main control module, and the first picture data comprises picture data of a display picture displayed on the first terminal;

the second main control module is used for displaying an acquisition card window on the second terminal through a host channel after receiving the first picture data through the second USB port, and displaying the first picture data in the acquisition card window;

the second main control module is further configured to send channel switching information to the second complete machine module when it is determined that the full screen display is performed on the acquisition card window, and send the first picture data to the third HDMI port of the second complete machine module through the second HDMI port;

the second complete machine module is used for switching a signal source channel from a host channel to an HDMI channel after receiving the channel switching information, receiving the first picture data sent by the second main control module, and displaying the first picture data in an HDMI channel working mode;

the second complete machine module is further configured to send first touch operation data of the second touch screen to the first USB port of the first terminal through the touch line port after the first touch operation data of the second touch screen is acquired;

the first terminal is configured to execute a touch operation corresponding to the first touch operation data after receiving the first touch operation data through the first USB port, and update a display screen of the first terminal.
The system of claim 23, wherein the second master control module is further configured to send second image data of a current display image to a conference terminal for displaying after confirming that the sharing operation for the display image is received, and the conference terminal is connected to the second master control module through the internet.
The system of claim 23, wherein the second complete machine module is further configured to send second touch operation data of the second touch screen to the second main control module after receiving the second touch operation data;

and the second main control module is further used for displaying corresponding handwriting after receiving the second touch operation data, and sending the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data.
The system of claim 23,

when the second complete machine module confirms that the operation instruction of exiting the HDMI channel is received, the second complete machine module is used for switching a signal source channel into a host channel, receiving second picture data of a current display picture sent by the second main control module through the host channel, and then displaying the second picture data;

and when the second main control module confirms the windowing operation of the acquisition card window, the second main control module is used for displaying the acquisition card window in a windowing manner on the current display picture.
The system according to claim 23, wherein said second host control module is further configured to confirm that said capture card window is displayed in full screen on the current display screen when full screen display of said capture card window is performed.
The system of claim 23, wherein the second main control module is configured to, after receiving third touch operation data sent by the conference terminal, execute a touch operation corresponding to the third touch operation data, and update the display screen of the HDMI channel.
A data transmission system is characterized by comprising a first terminal and a second terminal, wherein the first terminal comprises a first Type-C port and a first USB port, the second terminal comprises a second main control module, a second complete machine module and a second touch screen, the second complete machine module is respectively connected with the second main control module and the second touch screen, the second main control module comprises a second HDMI port and a second Type-C port, the second complete machine module comprises a third HDMI port and a touch line port, the first USB port is connected with the touch line port, the first Type-C port is connected with the second Type-C port, the second HDMI port is connected with the third HDMI port, the first terminal is only connected with a local area network, and the second terminal is connected with the Internet;

the first terminal is configured to send first picture data to the second Type-C port of the second main control module through the first Type-C port, where the first picture data includes picture data of a display picture displayed at the first terminal;

the second main control module is used for displaying an acquisition card window on the second terminal through a host channel after receiving the first picture data through the second Type-C port, and displaying the first picture data in the acquisition card window;

the second main control module is further configured to send channel switching information to the second complete machine module when it is determined that the full screen display is performed on the acquisition card window, and send the first picture data to the third HDMI port of the second complete machine module through the second HDMI port;

the second complete machine module is used for switching a signal source channel from a host channel to an HDMI channel after receiving the channel switching information, receiving the first picture data sent by the second main control module, and displaying the first picture data through the second touch screen;

the second complete machine module is further configured to send first touch operation data of the second touch screen to the first USB port of the first main control module through the touch line port after the first touch operation data is acquired;

the first terminal is further configured to execute a touch operation corresponding to the first touch operation data after receiving the first touch operation data through the first USB port, and update a display screen of the first terminal.
The system of claim 29, wherein the second master control module is further configured to send second frame data of a current display frame to a conference terminal for displaying after confirming that the sharing operation for the display frame is received, and the conference terminal is connected to the second master control module through the internet.
The system of claim 29, wherein the second complete machine module is further configured to send second touch operation data of the second touch screen to the second main control module after receiving the second touch operation data;

and the second main control module is further used for displaying corresponding handwriting after receiving the second touch operation data, and sending the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data.
The system of claim 29,

when the second complete machine module confirms that the operation instruction of exiting the HDMI channel is received, the second complete machine module is used for switching a signal source channel into a host channel, receiving second picture data of a current display picture sent by the second main control module through the host channel, and then displaying the second picture data;

and when the second main control module confirms the windowing operation of the acquisition card window, the second main control module is used for displaying the acquisition card window in a windowing manner on the current display picture.
The system according to claim 29, wherein said second host control module is further configured to confirm that said capture card window is displayed in full screen on the current display screen when full screen display of said capture card window is performed.
The system of claim 29, wherein the second main control module is configured to, after receiving third touch operation data sent by a conference terminal, execute a touch operation corresponding to the third touch operation data, and update a display screen of the HDMI channel.