TW202411834A - Communication system and communication data processing method - Google Patents

Abstract

A communication data processing method, comprising: generating, by a first processor, a transmission data according to a control command and an original communication data, wherein the original communication data is received by a first terminal device, the format of the transmission data matches to an audio-visual format of a first communication program in the first terminal device; when the first terminal device and a second terminal device are in a communication connection, the first terminal device executing the first communication program transmits the transmission data to the second terminal device executing a second communication program; and obtaining, by a second processor, the control command from the transmission data, so that the second terminal device executes corresponding operations according to the control command.

Description

Communication system and communication data processing method

The present disclosure relates to a communication system and a communication data processing method, and more particularly to a technology for transmitting communication data between multiple terminal devices.

With the development of Internet communication technology, communication services that use the Internet to connect multiple terminal devices so that multiple users can communicate remotely have become increasingly popular. However, this type of communication system mostly only transmits images and audio through cameras and microphones, and lacks more interactive applications.

One aspect of the disclosed content is a communication data processing method, comprising: generating transmission data through a first processor according to a control instruction and original communication data, wherein the original communication data is received by a first terminal device, and the transmission data conforms to the video and audio format of a first communication program in the first terminal device; when the first terminal device and the second terminal device are in communication connection, the first terminal device executing the first communication program transmits the transmission data to the second terminal device executing the second communication program; and obtaining a control instruction from the transmission data through a second processor, so that the second terminal device performs a corresponding operation according to the control instruction.

Another aspect of the present disclosure is a communication system, comprising a first terminal device, an input unit, and a first processor. The first terminal device is communicatively connected to a second terminal device. The input unit is coupled to the first terminal device to receive original communication data. The first processor is coupled to the input unit to integrate control instructions with the original communication data to generate transmission data. The transmission data conforms to the audio and video format of the first communication program in the first terminal device. The first terminal device transmits the transmission data to the second terminal device through the first communication program, so that the second terminal device obtains and executes the control instructions from the transmission data.

The disclosed content integrates control commands into the original communication data and then transmits them to other terminal devices through the server. Accordingly, users of multiple terminal devices will be able to interact more flexibly to improve the application convenience of remote communication and contact.

The following will disclose multiple embodiments of the present invention with drawings. For the purpose of clarity, many practical details will be described together in the following description. However, it should be understood that these practical details should not be used to limit the present invention. In other words, in some embodiments of the present invention, these practical details are not necessary. In addition, in order to simplify the drawings, some commonly used structures and components will be shown in the drawings in a simple schematic manner.

In this document, when an element is referred to as "connected" or "coupled", it may refer to "electrically connected" or "electrically coupled". "Connected" or "coupled" may also be used to indicate that two or more elements cooperate with each other or interact with each other. In addition, although the terms "first", "second", etc. are used in this document to describe different elements, the terms are only used to distinguish between elements or operations described with the same technical terms. Unless the context clearly indicates otherwise, the terms do not specifically refer to or imply an order or sequence, nor are they used to limit the present invention.

Figures 1 and 2A are schematic diagrams of a communication system according to some embodiments of the present disclosure. In one embodiment, the communication system 100 includes a first terminal device D100 and one or more second terminal devices D200. The first terminal device D100 and the second terminal device D200 are connected to each other through a server DS. The number of the first terminal device D100 and the second terminal device D200 can be adjusted arbitrarily according to communication requirements.

In some embodiments, the communication system 100 is used to provide a "two-way" remote conference service. In other words, the first terminal device D100 and the second terminal device D200 can actively send audio and video data, and can also receive and play audio and video data. In other embodiments, the communication system 100 can be used to provide a "one-way" live video service. For example, the first terminal device D100 serves as the host of the video stream, receives audio and video data (i.e., images or audio) through the camera CAM and the microphone MIC, and uploads it to the server DS. The second terminal device D200 serves as a participant end that unilaterally receives audio and video, and receives audio and video data through the server DS.

Specifically, as shown in FIG. 2A , the first terminal device D100 is installed with a first communication program P11 and a first management program P12. The second terminal device D200 is installed with a second communication program P21 and a second management program P22. The first terminal device D100 and the second terminal device D200 respectively execute the first communication program P11 and the second communication program P21 to connect to the server DS and establish a communication connection. In some embodiments, the first communication program P11 and the second communication program P21 can be programs of communication services provided by any operator, such as ZOOM, Google Meet, Webex, Microsoft Teams, etc. For ease of explanation, the "first communication program P11, server DS, and second communication program P21" are referred to as "third-party communication services" herein. Since a person skilled in the art can understand the technical principle of the terminal devices D100 and D200 communicating through a third-party communication service, it will not be further elaborated here.

The first terminal device D100 can integrate the control command Sd into the original communication data (for example, the user's image or audio) through the first management program P12, so as to transmit it to the second terminal device D200 through the first communication program P11 and the server DS. Accordingly, the communication system 100 can be made more interactive. The control command Sd can be a functional command that drives a specific circuit or a specific program function in the second terminal device D200, for example, a flashing special effect can appear on the screen of the second terminal device D200, or the second terminal device D200 can automatically execute the corresponding driving command (such as: turning on the camera of the second terminal device D200). The control command Sd may be input by a user, or may be one of a plurality of codes stored in the first terminal device D100, and may be generated after selection by the first terminal device D100, wherein the control command Sd of the present invention is not limited to the above. Specific embodiments of the control command Sd will be described in the following paragraphs.

As shown in FIG. 2A , when the first terminal device D100 receives the original image Sc0 or the original audio Sa0, the first management program P12 is executed, so that the first terminal device D100 generates the transmission data St through the integration algorithm according to the control command and the received original communication data (i.e., the original image Sc0 and/or the original audio Sa0). Specifically, the first terminal device D100 can convert the format of the control command into the audio and video format that conforms to the first communication program P11. Since the format of the original communication data is the same as the audio and video format, the first terminal device D100 can integrate the control command into the original communication data to form the transmission data St.

For example, when executing the first management program P12, the first terminal device D100 converts the control command Sd into an audio-visual format and then embeds it into the original image Sc0 to form a transmission image Sc1; or the first terminal device D100 converts the control command Sd into an audio-visual format and then combines it with the original audio Sa0 to form a transmission audio Sa1. The format of the transmission data St formed by the transmission image Sc1 and/or the transmission audio Sa1 conforms to the audio-visual format of the first communication program P11, so the transmission data St can be directly transmitted to the second terminal device D200 through a third-party communication service.

When the first terminal device D100 and the second terminal device D200 are in communication connection with each other, the second terminal device D200 receives the "transmission data St" such as the transmission image Sc1 and/or the transmission audio Sa1. Then, the second terminal device D200 analyzes the transmission data St through the second management program P22, obtains the control instruction Sd by the inverse integration algorithm related to the aforementioned integration algorithm, and executes the corresponding operation according to the control instruction Sd. Among them, the inverse integration algorithm corresponds to the integration algorithm.

For example, in a remote conference, the conference host (e.g., the user of the first terminal device D100) can integrate the control command Sd and the original communication data into the transmission data St through the first terminal device D100, and transmit the transmission data St to one of the participants designated by him (e.g., the user of one of the second terminal devices D200), so that the second terminal device D200 automatically triggers the corresponding effect according to the control command Sd (e.g., the display interface flashes and the camera is automatically turned on to remind the user to speak). In some embodiments, the first terminal device D100 can transmit the original communication data without the control command Sd to other undesignated second terminal devices D200. In other words, the users of the other second terminal devices D200 will not be aware of the control command.

The communication system 100 of the disclosed content can convert the control command Sd into an audio and video format, and integrate (e.g., embed, merge) the control command Sd into the original communication data by an integration algorithm, so as to utilize a third-party communication service (first communication program P11, server DS, second communication program P21) to send the transmission data St. Accordingly, there will be more types of interaction between the first terminal device D100 and the second terminal device D200, and it is not limited to simple image or audio transmission. In addition, since the disclosed content can transmit data through the existing "third-party communication service", in practice, the user does not need to build a server DS or set the data encryption transmission method by himself, making the use of the communication system 100 easier and more convenient.

FIG. 2B is a partial schematic diagram of a communication system 100 according to some embodiments of the present disclosure. In one embodiment, the first management program P12 may be installed in an external first manager De1, rather than in the first terminal device D100, and the first communication program P11 is installed in the first terminal device D100. The first manager De1 is electrically connected to the first terminal device D100 (e.g., via a USB connection interface). Here, when the first terminal device D100 executes the first communication program P11 and specifies to drive the first manager De1 at the same time, the first terminal device D100 will receive the original image Sc0 and the original audio Sa0 through the first manager De1, and combine the control instruction Sd into the original image Sc0 or the original audio Sa0 through the first manager De1, and then transmit it to the first terminal device D100. Then, the first communication program P11 in the first terminal device D100 further generates transmission data St.

In some embodiments, the first manager De1 can be implemented by a flash drive installed with the aforementioned first management program P12, and when the first manager De1 is coupled to the first terminal device D100, the first management program P12 will be automatically triggered to execute. In other embodiments, the first manager De1 can also be implemented by other portable devices, such as a mobile device installed with the first management program P12, and when the mobile device is coupled to the first terminal device D100, the processor in the mobile device will automatically execute the first management program P12. In other embodiments, when the first terminal device D100 executes the first communication program P11 and drives the mobile device connected thereto (i.e., the first manager De1), the mobile device will execute the first management program P12 to combine/integrate the control instruction Sd into the original image Sc0 or the original audio Sa0, and then transmit the data to the first terminal device D100 through the coupling interface, so that the first terminal device D100 performs corresponding operations.

As mentioned above, in some embodiments, the first manager De1 may include a microphone MIC and/or a camera CAM as shown in FIG. 1. In other words, the first terminal device D100 may receive the original communication data (i.e., the original image Sc0 and/or the original audio Sa0) through the first manager De1, and the first terminal device D100 may generate the transmission data St through its own processor or the first manager De1. In other embodiments, the first manager De1 may not include a microphone MIC and/or a camera CAM, and is used to obtain the original image Sc0 and/or the original audio Sa0 from the first terminal device D100, and generate the transmission data St according to the control instruction Sd.

Similarly, in one embodiment, the second management program P22 can also be installed in a second manager electrically connected to the second terminal device D200, and the second manager can be implemented in the same manner as the first manager De1. When the second manager detects that the second terminal device D200 is executing the second communication program P21, the second terminal device D200 can obtain the control command Sd from the transmission data St through the second manager.

FIG. 3 is a flow chart of a communication data processing method according to a partial embodiment of the present disclosure. FIG. 4 is a schematic diagram of a communication system 100 according to a partial embodiment of the present disclosure. In step S301, the first terminal device D100 first executes the first communication program P11, and the second terminal device D200 first executes the second communication program P21, so that the first terminal device D100 and the second terminal device D200 establish a communication connection. At this time, the first terminal device D100 obtains the original communication data (i.e., the original image Sc0 and/or the original audio Sa0) through the input unit (such as: camera CAM or microphone MIC).

In step S302, when the first terminal device D100 executes the first communication program P11, the first processor generates transmission data St according to the control instruction Sd and the original communication data. In this embodiment, the "first processor" is the first terminal processor D110 built into the first terminal device D100, and can execute corresponding functions through the installed first management program P12. In other embodiments, the first processor can also be a "management unit" externally connected to the first terminal device D100, such as the first manager De1 shown in Figure 2B or the first management program P12 stored externally. In other words, the management unit can be a circuit or program, and the location of the setting/installation is not limited.

The first processor is used to integrate the control instruction Sd into the original communication data to generate the transmission data St. Specifically, in some embodiments, the first terminal processor D110 or the first management program P12 is used to detect/determine whether the first terminal device D100 is running the first communication program P11, or determine whether the original communication data currently received by the first terminal device D100 needs to be uploaded to the server DS through the first communication program P11. If it is confirmed that the first terminal device D100 is indeed transmitting original communication data through the first communication program P11, the first terminal processor D110 integrates the control instruction Sd and the original communication data (i.e., the original image Sc0 and/or the original audio Sa0) through the first management program P12 to generate transmission data St (i.e., transmission image Sc1 and/or transmission audio Sa1).

As mentioned above, in some embodiments, when the first management program P12 is running, it will first receive the original communication data (including the microphone MIC and/or the camera CAM), and when the first terminal device D100 runs the first communication program P11 and transmits the original communication data through the first communication program P11, the first terminal processor D110 will integrate the control instruction Sd with the original communication data (i.e., the original image Sc0 and/or the original audio Sa0) through the first management program P12 to generate the transmission data St (i.e., the transmission image Sc1 and/or the transmission audio Sa1).

In step S303, the first terminal processor D110 converts the format of the transmission data St into an audio and video format that complies with the first communication program P11 through the first management program P12. In other words, the transmission data St can be directly received by the first communication program P11, encoded or encrypted, and transmitted to the correct target (i.e., the second terminal device D200) through the server DS.

The first terminal processor D110 superimposes the command image or command audio onto the original communication data through the first management program P12 to generate the transmission data St. Taking the original image Sc0 as an example, in one embodiment, the first management program P12 first converts the control command Sd into a command image in an image format, and then uses the command image as a kind of embedded data to superimpose on the original image Sc0 to form the transmission data St. The command image can be a watermark visible to the user's naked eye, or it can be imperceptible noise in the image. In some embodiments, the first terminal device D100 can integrate the command image with the original image Sc0 through the frequency domain embedding method. Since there are many types of algorithms for integrating the command image with the original image Sc0, and people in this field can understand the integration principle, they will not be elaborated here.

Taking the original audio signal Sa0 as an example, in one embodiment, the first management program P12 first converts the control command Sd into a command audio signal in an audio format as another embedded data, so as to integrate the command audio signal into the original audio signal Sa0 to form the transmission data St. The command audio signal can be a fixed frequency audio signal data. When the command audio signal is integrated into the original audio signal Sa0, the user will only feel some noise when listening, and it will not hinder the understanding of the audio content. Since there are many types of algorithms for integrating the command audio signal and the original image Sc0, and people in the field can understand the integration principle, it will not be elaborated here.

Specifically, in some embodiments, after the first terminal processor D110 generates the transmission data St through the first management program P12, the first terminal device D100 will replace the original communication data with the transmission data St.

In other embodiments, since the format of the original communication data itself already complies with the audio and video format of the first communication program P11, the first terminal device D100 may also first convert the format of the control command Sd into an audio and video format that complies with the first communication program P11, and then combine the control command Sd and the original communication data as the transmission data St.

In step S304, when the first terminal device D100 and the second terminal device D200 are already communicatively connected via a third-party communication service (i.e., the first communication program P11, the server DS and the second communication program P21), the first terminal device D100 transmits transmission data St to the corresponding second terminal device D200 using the first communication program P11.

In step S305, the second terminal device D200 receives the transmission data St through the second communication program P21. In step S306, the second processor will parse the transmission data St to obtain the control instruction Sd from the transmission data St (transmission image Sc1 and/or transmission audio Sa1). Specifically, the second terminal device D200 uses the second communication program P21 to separate the control instruction Sd and the original communication data from the transmission data St through the inverse integration algorithm related to the integration algorithm. In this embodiment, the "second processor" is a second terminal processor D210 built into the second terminal device D200, and can execute corresponding functions through the installed second management program P22. In other embodiments, the second processor may also be a "management unit" externally connected to the second terminal device D200. The management unit may be a circuit or a program, and the location of the installation is not limited.

Specifically, the second terminal processor D210 or the second management program P22 may first identify/obtain the embedded data in the transmission data St (i.e., the command image or command audio generated by the aforementioned conversion), and then convert the format of the embedded data to restore and generate the control command Sd. For example, the second terminal processor D210 may perform image analysis on the command image in the transmission image Sc1 through the second management program P22 to obtain the control command Sd; or the second terminal processor D210 may perform audio decoding on the command audio in the transmission audio Sa1 through the second management program P22 to obtain the control command Sd.

In other embodiments, the second terminal processor D210 detects/determines that the second terminal device D200 is receiving the transmission data St through the second communication program P21 through the second management program P22, and then executes the aforementioned step S306. Specifically, when it is detected/determined that the second terminal device D200 is receiving the transmission data St through the second communication program P21, the second terminal processor D210 will suspend the transmission program for transmitting the transmission data St through the second management program P22. The aforementioned "transmission program" refers to the process of preparing to hand over the transmission data St to the playback device (such as a speaker, a display) after the second terminal device D200 receives the transmission data St through the second communication program P21. In other words, the second terminal device D200 will not directly play the transmission data St, but will first obtain the control command Sd from the transmission data St, and then resume the transmission process. Then, the second terminal device D200 will execute steps S307 and S308 respectively. In another embodiment, during the execution of the transmission process, the second terminal processor D210 can directly obtain the control command Sd from the transmission data St through the second management program P22, that is, the user will not notice any pause or interruption when watching through the playback device.

In step S307, the second terminal processor D210 performs corresponding operations according to the control instruction Sd. In step S308, the second terminal device D200 plays the original communication data and/or plays the playback screen related to the control instruction Sd through the playback device D250. Specifically, the playback device D250 of the second terminal device D200 can play the original communication data and display the audio-visual effects corresponding to the control instruction Sd (such as: reminder screen or special effects), or the playback device D250 of the second terminal device D200 can exclude the control instruction Sd from the transmission data St, and then play the original communication data such as the original image Sc0 and/or the original audio Sa0 alone, and at the same time perform the operation corresponding to the control instruction Sd (such as: turning on the microphone of the second terminal device D200).

In some embodiments, the first management program P12 and the second management program P22 have the same or corresponding functions (such as encoding and decoding, or encryption and decryption), so the second terminal device D200 can identify the embedded data in the transmission data St through the second management program P22, and restore the original communication data and control instructions Sd through analysis, separation or conversion.

For ease of understanding, the hardware configuration of the terminal device in some embodiments of the present disclosure is described in detail herein. The first terminal device D100 includes a first terminal processor D110, a storage unit D120, an input unit D130, an audio-visual circuit D140, and a playback device D150. The storage unit D120 is coupled to the first terminal processor D110 to store the first communication program P11 and the first management program P12 installed in the first terminal device D100. The first terminal processor D110 is used to execute the first communication program P11 to establish a communication connection with the second terminal device D200 through the server DS. The input unit D130 (such as a microphone or a camera) is coupled to the first terminal processor D110 to receive the original communication data. The audio-visual circuit D140 is coupled to the first terminal processor D110 and the playback device D150 to receive the audio-visual data from the first terminal processor D110 and drive the playback device D250 to present the corresponding image and/or sound after conversion and processing.

Similarly, the second terminal device D200 includes a second terminal processor D210, a storage unit D220, an input unit D230, an audio-visual circuit D240, and a playback device D250. In one embodiment, the communication system 100 is a network service capable of two-way communication. The hardware and software configuration of the second terminal device D200 can be the same as that of the first terminal device D100, so the function of each component is not described in detail here.

As shown in FIG. 4, when the second terminal device D200 running the second communication program P21 receives the transmission data St from the first terminal device D100, the second terminal device D200 will not immediately display the corresponding image or audio on the playback device D250. The second terminal processor D210 of the second terminal device D200 will first send the transmission data St to the audio-visual circuit D240 for processing (e.g., decoding), and then play it through the playback device D250, which is the aforementioned transmission process. As mentioned above, in some embodiments, when the second management program P22 detects that the second terminal device D200 is running the second communication program P21 and receives the transmission data St, the second management program P22 will be triggered to cause the second terminal processor D210 to suspend the transmission process. At this time, the transmission data St will be stored in the register of the audio-visual circuit D240. Then, the second terminal processor D210 will obtain the control instruction Sd from the transmission data St, and then execute the control instruction Sd at the same time, and play the transmission data St or the parsed original communication data through the playback device D250.

In addition, as mentioned above, the terminal device D100/D200 is not limited to integrating the control command Sd and the original communication data through the management program P12/P22, and can also be implemented through an external manager. Figures 5A and 5B show schematic diagrams of the communication system 100 according to other embodiments of the present disclosure. In Figures 5A and 5B, similar components related to the embodiment of Figure 4 are represented by the same reference numerals for easy understanding, and the specific principles of similar components have been described in detail in the previous paragraphs. If it is not necessary to introduce it because it has a cooperative operation relationship with the components of Figures 5A and 5B, it will not be repeated here.

In some embodiments, the first terminal device D100 is coupled to the first manager De1 via the connection port D160 (e.g., USB interface). When the first manager De1 (driven and triggered by the first terminal processor D110, or independently operating) detects that the first terminal processor D110 of the first terminal device D100 is executing the first communication program P11, the first terminal processor D110 will be triggered by the first manager De1, and will generate transmission data St according to the control instruction Sd and the original communication data. Since this step has been described in the aforementioned embodiment, it will not be described here.

Similarly, the second terminal device D200 is coupled to the second manager De2 via the connection port D260 (e.g., USB interface). When the second manager De2 (driven and triggered by the second terminal processor D210, or independently operated) detects that the second terminal processor D210 of the second terminal device D200 is executing the second communication program P21, the second terminal processor D210 will be triggered by the second manager De2 to suspend the current transmission program, so that the second terminal processor D210 will first suspend the transmission of the transmission data St to the audio-visual circuit D240. At this time, the second terminal processor D210 will first obtain the embedded data from the transmission data St through the second manager De2, and convert the format of the embedded data to generate the control command Sd.

The communication system disclosed in the present disclosure can not only be applied to remote conference services, but also realize more forms of remote interaction, such as remote assistance. For example, the user of the first terminal device D100 can be an engineer who provides "online video maintenance", and the user of the second terminal device D200 is a user who is seeking assistance and needs to repair the machine connected to the second terminal device D200 (such as a router or a data server machine). For the known maintenance service, the engineer can only tell the user how to perform the maintenance remotely through the phone. In other words, the user still has to enter the test code for maintenance on the second terminal device D200.

As mentioned above, using the communication system disclosed herein, when the first terminal device D100 and the second terminal device D200 establish a communication connection through a third-party communication service (first communication program P11, server DS, second communication program P21), the engineer of the first terminal device D100 can directly see the current status of the machine (e.g., through the camera of the second terminal device D200, or directly watch the screen of the second terminal device D200). Then, the engineer of the first terminal device D100 can directly integrate the maintenance code into the transmission data St in the form of a control command Sd to transmit it to the second terminal device D200. Accordingly, when the second terminal device D200 receives the transmission data St, it can directly and automatically execute the maintenance code inputted remotely by the engineer of the first terminal device D100, and the user of the second terminal device D200 does not need to operate by himself, just like the engineer personally goes to the site for maintenance.

The various elements, method steps or technical features in the aforementioned embodiments may be combined with each other and are not limited to the order of textual description or the order of diagram presentation in this disclosure.

Although the contents of this disclosure have been disclosed as above in the form of implementation, it is not intended to limit the contents of this disclosure. Anyone skilled in the art can make various changes and modifications without departing from the spirit and scope of the contents of this disclosure. Therefore, the protection scope of the contents of this disclosure shall be subject to the scope defined by the attached patent application.

100: Communication system D100: First terminal device D110: First terminal processor D120: Storage unit D130: Input unit D140: Audio and video circuit D150: Playback device D160: Port D200: Second terminal device D210: Second terminal processor D220: Storage unit D230: Input unit D240: Audio and video circuit D250: Playback device D260: Port DS: Server CAM: Camera MIC: Microphone P11: First communication program P12: First management program P21: Second communication program P22: Second management program Sc0: Original image Sa0: Original audio Sc1: Transmitted image Sa1: Transmit audio Sd: Control command St: Transmit data De1: First manager De2: Second manager S301-S308: Steps

FIG. 1 is a schematic diagram of a communication system according to some embodiments of the present disclosure. FIG. 2A is a schematic diagram of a communication system according to some embodiments of the present disclosure. FIG. 2B is a partial schematic diagram of a communication system according to some embodiments of the present disclosure. FIG. 3 is a flow chart of a communication data processing method according to some embodiments of the present disclosure. FIG. 4 is a schematic diagram of a communication system according to some embodiments of the present disclosure. FIG. 5A is a schematic diagram of a communication system according to some embodiments of the present disclosure. FIG. 5B is a schematic diagram of a communication system according to some embodiments of the present disclosure.

Domestic storage information (please note in the order of storage institution, date, and number) None Foreign storage information (please note in the order of storage country, institution, date, and number) None

100: Communication system

Ds: Server

D100: First terminal device

D200: Second terminal device

P11: First communication program

P12: First management program

P21: Second communication program

P22: Second management program

Sc0: Original image

Sa0: Original audio

Sc1: Transmitting images

Sa1: Transmit audio

Sd: control instructions

St: Transmit data

Claims (11)

A communication data processing method comprises: generating a transmission data through a first processor according to a control instruction and an original communication data, wherein the original communication data is received by a first terminal device, and the transmission data conforms to an audio and video format of a first communication program in the first terminal device; When the first terminal device is in communication connection with a second terminal device, the first terminal device executing the first communication program transmits the transmission data to the second terminal device executing a second communication program; and obtaining the control instruction from the transmission data through a second processor, so that the second terminal device performs a corresponding operation according to the control instruction. The communication data processing method as described in claim 1, wherein the method of generating the transmission data according to the control instruction and the original communication data comprises: Converting the format of the control instruction into the audio-visual format that conforms to the first communication program, wherein the format of the original communication data is the same as the audio-visual format; and Combining the control instruction with the original communication data to form the transmission data. The communication data processing method as described in claim 2, wherein the method for converting the format of the control command into the audio and video format that conforms to the first communication program is to convert the control command into a command audio signal; and the method for combining the control command with the original communication data is to integrate the command audio signal into an original audio signal in the original communication data. A communication data processing method as described in claim 2, wherein the method for converting the format of the control instruction into the audio and video format that conforms to the first communication program is to convert the control instruction into a command image; and the method for combining the control instruction with the original communication data is to superimpose the command image on an original image in the original communication data. A communication system comprises: a first terminal device, which is communicatively connected to a second terminal device; an input unit, coupled to the first terminal device, for receiving an original communication data; and a first processor, coupled to the input unit, for integrating a control instruction with the original communication data to generate a transmission data, wherein the transmission data conforms to an audio and video format of a first communication program in the first terminal device; wherein the first terminal device transmits the transmission data to the second terminal device through the first communication program, so that the second terminal device obtains and executes the control instruction from the transmission data. The communication system as described in claim 5 further includes a management unit, which integrates the control instruction and the original communication data to generate the transmission data when the first communication program is executed. A communication system as described in claim 5, wherein after the first processor generates the transmission data, the first terminal device replaces the original communication data with the transmission data. A communication system as described in claim 5, wherein the first processor converts the control command into a command audio or a command image, and superimposes the command audio or the command image on the original communication data to generate the transmission data. A communication system as described in claim 5, wherein the second terminal device is used to execute a second communication program so that the first terminal device establishes a communication connection with the second terminal device, and the communication system further comprises: a second processor, used to receive the transmission data and obtain the control instruction from the transmission data; and a playback device, coupled to the second terminal device, used to play the transmission data and perform corresponding operations according to the control instruction; wherein after the second processor receives the transmission data and obtains the control instruction, the playback device plays the original communication data or plays a playback screen related to the control instruction. A communication system as described in claim 9, wherein the first processor integrates the control instruction and the original communication data into the transmission data according to an integration algorithm, and the second processor obtains the control instruction and the original communication data from the transmission data according to an inverse integration algorithm related to the integration algorithm. A communication system as described in claim 5, wherein the control instruction is a drive instruction, a function instruction or a maintenance code.

Images