CN116097621A - Data interaction method, device, electronic device and storage medium - Google Patents

Abstract

The present disclosure relates to a data interaction method, device, electronic device, and storage medium. The method is applied to a first terminal device, and the first terminal performs screen projection interaction with a second terminal. The method includes: acquiring interaction data key data, and encapsulate the key data into M first data packets, wherein M is a natural number greater than 1; encrypt the N first data packets in the M first data packets, and send them sequentially The M first data packets are sent to the second terminal device, where N is greater than or equal to 1 and less than M; receiving the encrypted information returned by the second terminal device, determining whether to continue sending the encrypted information according to the encrypted information The interaction data, wherein the encrypted information is obtained by decrypting the encrypted first data packet by the second terminal device.

Description

Data interaction method, device, electronic device and storage medium

technical field

The present disclosure relates to the technical field of data interaction, and in particular to a data interaction method, device, electronic equipment, and storage medium.

Background technique

In recent years, there have been more and more forms of data interaction between different terminal devices, such as screen projection connections. In the scenario of screen projection connection, one terminal device saves its video, audio and other data into multi-frame data through screen recording, recording, etc., and then transmits it to another terminal device through wired connection or wireless connection, and another terminal device Then the multi-frame data can be analyzed to obtain the original video, audio and other data, and then it can be displayed or played and other display operations. During the continuous transmission of a large amount of data between two terminal devices, the data may be intercepted by malicious applications, that is, the security of data interaction is poor.

Contents of the invention

In order to overcome the problems existing in the related technology, the embodiments of the present disclosure provide a data interaction method, device, electronic equipment and storage medium, so as to solve the defects in the related technology.

According to the first aspect of the embodiments of the present disclosure, a data interaction method is provided, which is applied to a first terminal device, and the first terminal performs screen projection interaction with a second terminal, and the method includes:

Acquiring key data in the interaction data, and encapsulating the key data into M first data packets, where M is a natural number greater than 1;

Encrypting the N first data packets among the M first data packets, and sequentially sending the M first data packets to the second terminal device, where N is greater than or equal to 1 and less than M;

receiving the encrypted information returned by the second terminal device, and determining whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is performed by the second terminal device on the encrypted first data packet Decrypted to get.

In one embodiment, also includes:

Determine interaction data according to an interaction control instruction, acquire the interaction data, and determine whether key data exists in the interaction data, wherein the interaction control instruction is based on the user's understanding of the first terminal device or the second terminal device generated by the operation;

The acquisition of key data in the interaction data includes:

Responding to key data being present in the interaction data, key data in the interaction data is acquired.

In one embodiment, the determining the interaction data according to the interaction control instruction and obtaining the interaction data includes:

determining the interaction data and the application program to which the interaction data belongs according to the interaction control instruction;

Acquiring the interaction data from the application program to which the interaction data belongs.

In one embodiment, the determining whether key data exists in the interaction data includes:

determining whether there is data belonging to a preset key data list in the interaction data;

In response to the presence of data belonging to a preset key data list in the interaction data, determine that key data exists in the interaction data, and determine that among the interaction data, the data belonging to the preset key data list is key data;

In response to no data in the preset key data list exists in the interaction data, it is determined that no key data exists in the interaction data.

In one embodiment, the encrypting the N first data packets among the M first data packets includes:

Determine N according to the M and the encryption ratio;

Encrypting the first N first data packets among the M first data packets.

In one embodiment, also includes:

The encryption ratio is determined according to the computing power of the first terminal device and the quality parameters of the data transmission link.

In one embodiment, the encrypting the N first data packets among the M first data packets includes:

Encrypting the encrypted identifier, the encrypted information, and the first data packet to obtain the encrypted first data packet, wherein the encrypted identifier is used by the second terminal device to determine the process from the plurality of first data packets The encrypted first data packet.

In one embodiment, also includes:

Acquiring non-key data in the interaction data, encapsulating the key data into multiple second data packets, and sending the multiple second data packets to the second terminal device, so that the second terminal The device parses and displays the non-critical data.

In one embodiment, the interaction data includes video and/or audio.

According to the second aspect of the embodiments of the present disclosure, there is provided a data interaction method applied to a second terminal device, including:

receiving M first data packets sent by the first terminal device, wherein the M first data packets are obtained by encapsulating key data in the interaction data by the first terminal device, and the M first data packets The N first data packets are encrypted by the first terminal device, M is a natural number greater than 1, and N is greater than or equal to 1 and less than M;

Decrypting the encrypted N first data packets to obtain encrypted information;

sending the encrypted information to the first terminal device, so that the first terminal device continues to send the interaction data.

In one embodiment, before decrypting the encrypted N first data packets to obtain encrypted information, the method further includes:

Determining at least one first data packet with an encrypted identifier among the M first data packets as the encrypted first data packet.

In one embodiment, after decrypting the encrypted N first data packets, further comprising:

Analyzing and processing the M first data packets sequentially according to the receiving order to obtain the key data;

The key data is displayed according to the display manner of the key data.

In one embodiment, also includes:

receiving multiple second data packets sent by the first terminal device, wherein the multiple second data packets are obtained by encapsulating non-critical data in the interaction data by the first terminal device;

Analyzing and processing the plurality of second data packets in sequence according to the receiving order to obtain the non-critical data;

The non-key data is displayed according to the display manner of the non-key data.

In one embodiment, also includes:

generating an interaction control instruction based on the user's operation on the display result of the interaction data;

sending the interaction control instruction to the first terminal device, so that the terminal device continues to return the interaction data.

According to a third aspect of the embodiments of the present disclosure, there is provided a data interaction device, which is applied to a first terminal device, and the first terminal performs screen projection interaction with a second terminal, and the device includes:

The first acquisition module is configured to acquire key data in the interaction data, and encapsulate the key data into M first data packets, where M is a natural number greater than 1;

An encryption module, configured to encrypt N first data packets among the M first data packets, and send the M first data packets to the second terminal device in sequence, where N is greater than or equal to 1 , and less than M;

The verification module is configured to receive the encrypted information returned by the second terminal device within a preset time period, and determine whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is sent by the second terminal device It is obtained by decrypting the encrypted first data packet.

In one embodiment, it also includes a determination module for:

Determine interaction data according to an interaction control instruction, acquire the interaction data, and determine whether key data exists in the interaction data, wherein the interaction control instruction is based on the user's understanding of the first terminal device or the second terminal device generated by the operation;

The first acquisition module is specifically used for:

Responding to key data being present in the interaction data, key data in the interaction data is acquired.

In one embodiment, the determining module is configured to determine the interaction data according to the interaction control instruction, and when acquiring the interaction data, it is specifically used to:

determining the interaction data and the application program to which the interaction data belongs according to the interaction control instruction;

Acquiring the interaction data from the application program to which the interaction data belongs.

In one embodiment, when the determining module is configured to determine whether key data exists in the interaction data, it is specifically configured to:

determining whether there is data belonging to a preset key data list in the interaction data;

In response to the presence of data belonging to a preset key data list in the interaction data, determine that key data exists in the interaction data, and determine that among the interaction data, the data belonging to the preset key data list is key data;

In response to no data in the preset key data list exists in the interaction data, it is determined that no key data exists in the interaction data.

In one embodiment, when the encryption module is used to encrypt the N first data packets in the M first data packets, it is specifically used for:

Determine N according to the M and the encryption ratio;

Encrypting the first N first data packets among the M first data packets.

In one embodiment, a scaling module is also included for:

The encryption ratio is determined according to the computing power of the first terminal device and the quality parameters of the data transmission link.

In one embodiment, when the encryption module is used to encrypt the N first data packets in the M first data packets, it is specifically used for:

Encrypting the encrypted identifier, the encrypted information, and the first data packet to obtain the encrypted first data packet, wherein the encrypted identifier is used by the second terminal device to determine the process from the plurality of first data packets The encrypted first data packet.

In one embodiment, it also includes a second acquisition module for:

Acquiring non-key data in the interaction data, encapsulating the key data into multiple second data packets, and sending the multiple second data packets to the second terminal device, so that the second terminal The device parses and displays the non-critical data.

In one embodiment, the interaction data includes video and/or audio.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a data interaction apparatus applied to a second terminal device, including:

A receiving module, configured to receive M first data packets sent by the first terminal device, wherein the M first data packets are obtained by encapsulating key data in the interaction data by the first terminal device, and the M N first data packets in the first data packets are encrypted by the first terminal device, M is a natural number greater than 1, and N is greater than or equal to 1 and less than M;

A decryption module, configured to decrypt the encrypted N first data packets to obtain encrypted information;

A sending module, configured to send the encrypted information to the first terminal device, so that the first terminal device continues to send the interaction data.

In one embodiment, it also includes an identification module for:

Before decrypting the encrypted N first data packets to obtain encrypted information, determine the first data packet with an encryption identifier among the M first data packets as encrypted first packet.

In one embodiment, it also includes a first display module for:

After decrypting the encrypted N first data packets, analyzing and processing the M first data packets sequentially according to the order of receipt, to obtain the key data;

The key data is displayed according to the display manner of the key data.

In one embodiment, it also includes a first display module for:

receiving multiple second data packets sent by the first terminal device, wherein the multiple second data packets are obtained by encapsulating non-critical data in the interaction data by the first terminal device;

Analyzing and processing the plurality of second data packets in sequence according to the receiving order to obtain the non-critical data;

The non-key data is displayed according to the display manner of the non-key data.

In one embodiment, it also includes a control module for:

generating an interaction control instruction based on the user's operation on the display result of the interaction data;

sending the interaction control instruction to the first terminal device, so that the terminal device continues to return the interaction data.

According to a fifth aspect of the embodiments of the present disclosure, there is provided an electronic device, the electronic device includes a memory and a processor, the memory is used to store computer instructions that can be run on the processor, and the processor is used to execute the The computer instructions are based on the data interaction method described in the first aspect.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the method described in the first aspect is implemented.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

The disclosure obtains the key data in the interaction data, and encapsulates the key data into M first data packets, and then encrypts the N first data packets in the M first data packets, and sends the key data sequentially. The M first data packets to the second terminal device, and finally receive the encrypted information returned by the second terminal device, and determine whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is determined by the second terminal device The second terminal device decrypts the encrypted first data packet to obtain it. Since the N first data packets in the M first data packets encapsulated by the key data in the interaction data are encrypted, after the M data packets are sent to the second terminal device, according to whether the second terminal device The encrypted information that can pass the verification is returned to determine whether the second terminal device has successfully decrypted the encrypted first data packet, and then can determine whether the data sent to the second terminal device is safe, and stop sending and interacting if it is not safe data, thereby avoiding data leakage and ensuring data security.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

FIG. 1 is a flowchart of a data interaction method applied to a first terminal device according to an exemplary embodiment of the present disclosure;

Fig. 2 is a schematic diagram of an interaction process between a first terminal device and a second terminal device according to an exemplary embodiment of the present disclosure;

Fig. 3 is a schematic diagram of an encapsulation process of key data shown in an exemplary embodiment of the present disclosure;

Fig. 4 is a schematic diagram of an encryption process of key data shown in an exemplary embodiment of the present disclosure;

Fig. 5 is a schematic diagram of an encryption method of key data shown in an exemplary embodiment of the present disclosure;

Fig. 6 is a flowchart of a data interaction method applied to a second terminal device according to an exemplary embodiment of the present disclosure;

Fig. 7 is a processing flow after the second terminal device receives interaction data shown in an exemplary embodiment of the present disclosure;

Fig. 8 is a schematic structural diagram of a data interaction device applied to a first terminal device according to an exemplary embodiment of the present disclosure;

Fig. 9 is a schematic structural diagram of a data interaction device applied to a second terminal device according to an exemplary embodiment of the present disclosure;

Fig. 10 is a structural block diagram of an electronic device according to an exemplary embodiment of the present disclosure.

Detailed ways

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.

The terminology used in the present disclosure is for the purpose of describing particular embodiments only, and is not intended to limit the present disclosure. As used in this disclosure and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the present disclosure, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination."

In recent years, there have been more and more forms of data interaction between different terminal devices, such as screen projection connections. In the scenario of screen projection connection, one terminal device saves its video, audio and other data into multi-frame data through screen recording, recording, etc., and then transmits it to another terminal device through wired connection or wireless connection, and another terminal device Then the multi-frame data can be analyzed to obtain the original video, audio and other data, and then it can be displayed or played and other display operations. In the process of continuous transmission of large amounts of data between two terminal devices, the data may be intercepted by malicious applications, that is, the security of data interaction is poor. If the data includes the user's call data, contacts, account passwords, etc., It may lead to the leakage of such information, which seriously affects the security of users' personal information.

In order to ensure the security of data interaction, in related technologies, one terminal device encrypts data before transmitting data, and another terminal device decrypts data after receiving data. However, the above encryption and decryption process will not only reduce the efficiency of data interaction, but also increase the computing load of the terminal device. Taking the scenario of screen projection connection as an example, the above encryption and encryption process will greatly reduce the efficiency of video and audio transmission, causing problems such as video freeze or blur, and audio freeze or distortion. Moreover, if the malicious application that intercepts the interaction data has the ability to decrypt, it will continue to obtain the interaction data and decrypt it, resulting in continuous leakage of important information, which has a greater impact on data security.

Based on this, in a first aspect, at least one embodiment of the present disclosure provides a data interaction method. Please refer to FIG. 1 , which shows a flow of the method, including steps S101 and S103.

Wherein, the method may be applied to the first terminal device, and the first terminal performs screen projection interaction with the second terminal. The first terminal device may be a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA) handheld device, a computing device, a wearable device, and the like. The first terminal device can be the data source in the data interaction scenario, that is, the side that sends data to the outside. For example, in the scenario of projecting a screen from a smartphone to a TV, the smartphone is the data source and the TV is the data destination.

It can be understood that the method may be executed by a specific application program or a specific module of the first terminal device. For example, according to Figure 2, terminal A as the first terminal device has application C for data interaction, and application C can communicate with other application programs such as application 1, application 2, and application 3, so as to obtain information from other application programs. Interactive data such as audio data and video data, and encapsulate these interactive data and send them to terminal B as the second terminal device. Terminal B is the data end point of data interaction, and it can receive the data sent by application C, and the received The data is decapsulated, and at the same time, it can counter-control the application of terminal A, that is, send control instructions to application C, and then application C sends these control instructions to the corresponding application program. These other applications may be music applications, video applications, navigation applications, social applications, and so on.

In step S101, key data in the interaction data is obtained, and the key data is packaged into M first data packets, where M is a natural number greater than 1.

Wherein, the interaction data is data targeted for data interaction, that is, data sent by the first terminal device to the second terminal device. Taking the screencasting scene as an example, the interactive data is video, audio and other data. Key data can be data related to user privacy or account security.

During the data interaction process, the first terminal device may determine the interaction data and the application program to which the interaction data belongs according to the interaction control instruction, and obtain the interaction data from the application program to which the interaction data belongs, wherein the interaction control instruction is based on Generated by a user's operation on the first terminal device or the second terminal device. Taking the screen projection scenario as an example, after the first terminal device and the second terminal device establish a screen projection connection, the first terminal device will send the default screen to the second terminal device, so that the second terminal device displays the default screen. The default screen can be the current screen of the first terminal device, the desktop or the dedicated initial screen of the screen projection program; next, the user can operate the first terminal device, and the first terminal device generates an interactive control command based on the operation, or The above-mentioned default screen displayed on the second terminal device operates, and the second terminal device generates an interactive control instruction based on the operation and sends the interactive control instruction to the first terminal device, and the first terminal device sends an interactive control instruction to the corresponding application according to the interactive control instruction. The program acquires image, audio and other data. For example, if the interactive control instruction is to start an application on the desktop, the first terminal device starts the application and obtains the initial interface after the application is started as the interaction data.

After acquiring the interaction data, the first terminal device may determine whether key data exists in the interaction data in the following manner: first, determine whether there is data belonging to a preset key data list in the interaction data, for example, the first A preset key data list is preset in the terminal device; next, if there is data belonging to the preset key data list in the interaction data, it is determined that there is key data in the interaction data, and the interaction data is determined In the method, the data belonging to the preset key data list is key data; if the interaction data does not contain the data in the preset key data list, it is determined that the interaction data does not contain key data.

If there is key data in the interaction data, this step may be performed, that is, to obtain the key data in the interaction data. Due to the influence of the bandwidth of the transmission channel, the key data cannot be directly transmitted to the second terminal device. Therefore, referring to FIG. 3 , the key data can be encapsulated into M first data packets.

In addition, it is also possible to obtain non-key data in the interaction data, encapsulate the key data into multiple second data packets, and send the multiple second data packets to the second terminal device, so that all The second terminal device parses and displays the non-critical data.

In the case that there is no key data in the interaction data, the interaction data may be encapsulated into multiple third data packets, and the multiple third data packets may be sent to the second terminal device, so that the The second terminal device parses and displays the interaction data.

In step S102, encrypting N first data packets among the M first data packets, and sequentially sending the M first data packets to the second terminal device, wherein N is greater than or equal to 1, and less than M.

Wherein, the first data packets to be encrypted may be part of the M first data packets. Exemplarily, the encryption ratio K can be determined first according to the computing power p of the first terminal device and the quality parameter q of the data transmission link, and the computing power p of the first terminal device can be used to characterize the first terminal device The encryption speed, the quality parameter q of the data transmission link can be used to represent the packet loss rate, if the packet loss rate is too high, it may cause the loss of the first encrypted data packet, and then make the encryption meaningless. Take the screen projection scene as an example , the packet loss rate is extremely low, and the value of q is between 0.98-1. For example, K can be calculated according to the following formula: K=p*q; then according to the M and encryption ratio K, the encryption number N can be determined, for example, according to N is calculated by the following formula: N=M*K; finally, the first N first data packets among the plurality of first data packets are encrypted. Referring to FIG. 4 , after the key data is encapsulated into 4 first data packets, the first 3 first data packets are encrypted. It can be understood that Fig. 4 is only an example, and the general encryption ratio K is between 20% and 30%.

In a possible embodiment, the first data packet can be encrypted in the manner shown in Figure 5: the encryption identifier F, the encrypted information I and the first data packet are encrypted to obtain the encrypted first data packet, wherein the encryption identifier F is used by the second terminal device to determine the encrypted first data packet from the plurality of first data packets.

It can be understood that in the process of data interaction, the first terminal device will continue to obtain the interaction data according to the interaction control instruction, and judge whether there is key data in the interaction data, and if there is key data, then encapsulate the key data into multiple Part or all of the first data packet is encrypted and sent to the second terminal device, and multiple second data packets obtained by encapsulating non-critical data are directly sent to the second terminal device. If there is no key data, the interactive The multiple third data packets obtained after data encapsulation are sent to the second terminal device. The order of processing and sending the above interaction data may be determined according to the order of acquiring the interaction data.

In step S103, after receiving the encrypted information returned by the second terminal device, it is determined whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is encrypted by the second terminal device The first data packet is obtained by decrypting.

Wherein, the second terminal device continuously receives the interaction data sent by the first terminal device in the form of data packets during the data interaction process, and then sequentially processes the received interaction data, that is, sequentially processes the received data packets. Before processing a data packet, you can check whether the data packet has an encryption ID. If it does not have an encryption ID, then the data packet is the second data packet, the third data packet, or the first data packet without encryption processing. If it has an encryption ID , then the data packet is the encrypted first data packet.

After receiving a plurality of second data packets sent by the first terminal device, the plurality of second data packets may be analyzed and processed sequentially according to the receiving order to obtain the non-critical data, and display the non-critical data according to the way to display the non-key data. Exemplarily, if the non-key data is a picture, then the image can be displayed; if the non-key data is a video, then the video can be played.

After receiving the multiple third data packets sent by the first terminal device, the multiple third data packets may be parsed and processed sequentially according to the receiving order to obtain the interaction data, and according to the display mode of the interaction data, Display the interaction data. Exemplarily, if the interaction data is a screen, an image may be displayed; if the interaction data is a video, the video may be played.

After receiving a plurality of first data packets sent by the first terminal device, the first data packet with an encryption identifier among the plurality of first data packets may be determined as the encrypted first data packet, and then the The N first data packets that have been encrypted are decrypted to obtain the encrypted information and the decrypted first data packets, and then the plurality of first data packets are analyzed and processed sequentially according to the receiving order to obtain the key data, and display the key data according to the display method of the key data. For example, if the key data is a picture, the image can be displayed; if the key data is a video, the video can be played; at the same time, Send the encrypted information to the first terminal device.

When the first terminal device receives the encrypted information returned by the second terminal device within the preset time period, and the encrypted information passes the verification, it continues to send the interaction data, that is, continues to send the existence key in the form of data packets. Key data and non-key data in the interactive data of the data, and interactive data without key data; A terminal device receives the encrypted information returned by the second terminal device within a preset period of time, but the encrypted information fails to pass the verification), stop sending the interaction data, that is, stop sending the key in the interaction data with the key data Data and non-key data, and interactive data without key data. For example, in a screen projection scenario, the screen projection can be stopped and the screen projection connection with the second terminal device can be disconnected.

It can be understood that the first terminal device does not receive the encrypted information returned by the second terminal device within a preset time period, or the first terminal device receives the encrypted information returned by the second terminal device within a preset time period. The encrypted information returned by the device, but if the encrypted information fails to pass the verification, it can also generate prompt information, such as text prompt information displayed on the display screen, or audio prompt information played by the speaker.

The disclosure obtains the key data in the interaction data, and encapsulates the key data into M first data packets, and then encrypts the N first data packets in the M first data packets, and sends the key data sequentially. The M first data packets to the second terminal device, and finally receive the encrypted information returned by the second terminal device, and determine whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is determined by the second terminal device The second terminal device decrypts the encrypted first data packet to obtain it. Since the N first data packets in the M first data packets encapsulated by the key data in the interaction data are encrypted, after the M data packets are sent to the second terminal device, according to whether the second terminal device The encrypted information that can pass the verification is returned to determine whether the second terminal device has successfully decrypted the encrypted first data packet, and then can determine whether the data sent to the second terminal device is safe, and stop sending and interacting if it is not safe data, thereby avoiding data leakage and ensuring data security.

In the present disclosure, encryption processing is performed on parts of the multiple first data packets obtained by encapsulation, thereby reducing the computing load of the encryption processing of the first terminal device and the computing load of the decryption processing of the second terminal device, thereby avoiding the occurrence of Caton and cut-off problems. Moreover, the present disclosure further controls the subsequent data interaction of the first terminal device according to the second terminal device's decryption of the encrypted first data packet, that is, when the second terminal device successfully decrypts the encrypted first data packet Continue data interaction, and stop data interaction when the second terminal device fails to decrypt the encrypted first data packet, thereby preventing malicious applications in the second terminal device from being able to decrypt the encrypted first data packet package, but still can continue to obtain the user information leakage caused by the first unencrypted data package. Furthermore, the present disclosure encrypts the first N first data packets among the plurality of first data packets, which can prevent subsequent unencrypted data packets from being intercepted in the case of data interception by malicious applications, thereby ensuring data security to the greatest extent. .

In a second aspect, at least one embodiment of the present disclosure provides a data interaction method. Please refer to FIG. 6 , which shows a flow of the method, including step S601 and step S503.

Wherein, the method may be applied to the second terminal device. The second terminal device may be a television set, a vehicle-mounted terminal, and the like. The second terminal device can be the end point of the data in the data interaction scenario, that is, the side receiving the data. For example, in the scenario of projecting a screen from a smart phone to a TV, the smart phone is the data source and the TV is the data end point.

In step S601, M first data packets sent by the first terminal device are received, wherein the multiple first data packets are obtained by encapsulating key data in the interaction data by the first terminal device, and the M N first data packets in the first data packets are encrypted by the first terminal device, M is a natural number greater than 1, and N is greater than or equal to 1 and less than M.

In this step, operations such as acquiring, encapsulating, encrypting, and sending key data by the first terminal device have been described in detail in the embodiment of the first aspect, so details will not be repeated here.

In step S602, the encrypted N first data packets are decrypted to obtain encrypted information.

First, the first data packet with an encryption identifier among the M first data packets may be determined as the encrypted first data packet, and then, the encrypted first data packet is decrypted. After decryption, not only the decrypted first data packet is obtained, but also the encrypted information added by the first terminal device during the decryption process is obtained.

After decrypting the encrypted N first data packets, the M first data packets may be parsed sequentially according to the receiving order to obtain the key data, and according to the key data The display mode is to display the key data. Exemplarily, if the non-key data is a picture, then the image can be displayed; if the non-key data is a video, then the video can be played.

In step S603, the encrypted information is sent to the first terminal device, so that the first terminal device continues to send the interaction data.

In this step, the first terminal device receives and verifies the encrypted information and continues or stops sending interactive data according to the verification results, etc., which have been introduced in detail in the embodiment of the first aspect, so the details will not be repeated here. .

In addition, the second terminal device may also receive multiple second data packets sent by the first terminal device, wherein the multiple second data packets are obtained by encapsulating non-key data in the interaction data by the first terminal device ; and sequentially analyzing and processing the plurality of second data packets according to the receiving order to obtain the non-key data; and displaying the non-key data according to the display mode of the non-key data. Exemplarily, if the non-key data is a picture, then the image can be displayed; if the non-key data is a video, then the video can be played.

In addition, the second terminal device may also receive multiple third data packets sent by the first terminal device, wherein the multiple third data packets are obtained by the first terminal device encapsulating interaction data without key data ; and sequentially analyze and process the plurality of third data packets according to the receiving order to obtain the interaction data; and display the interaction data according to the display mode of the interaction data. Exemplarily, if the non-key data is a picture, then the image can be displayed; if the non-key data is a video, then the video can be played.

Refer to FIG. 7 , which shows the processing flow of terminal B as the second terminal device after receiving the interaction data. After terminal B receives the data, it first determines whether it needs to be decrypted; if it does not need to be decrypted, that is, the data is non-key data in the interactive data with key data, or interactive data without key data, then parse the data and display it; if necessary For decryption, the data is encrypted, and the decrypted data is analyzed and displayed. At the same time, the encrypted information I is obtained during the decryption process, and then the encrypted information I is sent to terminal A as the first terminal device. Terminal A determines whether the information I is correct. , if it is correct (that is, passed the verification), continue to send data, and if it is not correct (that is, fail to pass the verification), stop sending data.

Based on the display of the interaction data by the second terminal device, the user can operate on the display result of the interaction data, for example, operate on the screen projection interface displayed by the second terminal device; In the operation of displaying the results, an interaction control instruction is generated, and the interaction control instruction is sent to the first terminal device, so that the terminal device continues to return the interaction data.

The data interaction methods introduced in the above two aspects can be combined to obtain the following data interaction methods. In this data interaction method, the first terminal device continuously acquires interaction data according to an interaction control instruction (the interaction control instruction is generated based on the user's operation on the first terminal device or the second terminal device), and The interactive data is encapsulated and sent to the second terminal device, and the second terminal device decapsulates the interactive data after receiving it, and then displays it, such as displaying images and playing audio and video. There are key data in the above interaction data, and the key data involves user privacy or account information, so it needs to be encrypted for protection. Therefore, after encapsulating the key data, encrypt parts of the obtained multiple first data packets, and then send To the second terminal device, the second terminal device needs to first decrypt the encrypted first data packet received, then decapsulate it, and then display it. At the same time, the encrypted first data packet in the key data is also used as a security verification method in the data interaction process, that is, the first data packet adds encrypted information during the encryption process, and the second terminal device will obtain the encrypted information after decryption. information, and return the encrypted information to the first terminal device. Therefore, if the first terminal device receives the correct encrypted information, it means that the current interaction process is safe and data interaction can continue. If the first terminal device does not receive the correct encrypted information, then Indicates that the current interaction process is not safe, and data interaction can be stopped.

According to the third aspect of the embodiments of the present disclosure, a data interaction device is provided, which is applied to a first terminal device, and the first terminal performs screen projection interaction with a second terminal. Please refer to FIG. 8 , the device includes:

The first acquiring module 801 is configured to acquire key data in the interaction data, and encapsulate the key data into M first data packets, where M is a natural number greater than 1;

An encryption module 802, configured to encrypt N first data packets among the M first data packets, and send the M first data packets to the second terminal device in sequence, where N is greater than or equal to 1, and less than M;

The verification module 803 is configured to receive the encrypted information returned by the second terminal device, and determine whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is encrypted by the second terminal device The first data packet is decrypted to get.

In some embodiments of the present disclosure, a determination module is also included for:

Determine interaction data according to an interaction control instruction, acquire the interaction data, and determine whether key data exists in the interaction data, wherein the interaction control instruction is based on the user's understanding of the first terminal device or the second terminal device generated by the operation;

The first acquisition module is specifically used for:

Responding to key data being present in the interaction data, key data in the interaction data is acquired.

In some embodiments of the present disclosure, the determining module is configured to determine interaction data according to an interaction control instruction, and when acquiring the interaction data, is specifically configured to:

determining the interaction data and the application program to which the interaction data belongs according to the interaction control instruction;

Acquiring the interaction data from the application program to which the interaction data belongs.

In some embodiments of the present disclosure, when the determining module is configured to determine whether key data exists in the interaction data, it is specifically configured to:

determining whether there is data belonging to a preset key data list in the interaction data;

In response to the presence of data belonging to a preset key data list in the interaction data, determine that key data exists in the interaction data, and determine that among the interaction data, the data belonging to the preset key data list is key data;

In response to no data in the preset key data list exists in the interaction data, it is determined that no key data exists in the interaction data.

In some embodiments of the present disclosure, when the encryption module is used to encrypt the N first data packets among the M first data packets, it is specifically used for:

Determine the encryption number N according to the M and the encryption ratio;

Encrypting the first N first data packets among the plurality of first data packets.

In some embodiments of the present disclosure, a scaling module is also included for:

The encryption ratio is determined according to the computing power of the first terminal device and the quality parameters of the data transmission link.

In some embodiments of the present disclosure, when the encryption module is used to encrypt the N first data packets among the M first data packets, it is specifically used for:

Encrypting the encrypted identifier, the encrypted information, and the first data packet to obtain the encrypted first data packet, wherein the encrypted identifier is used by the second terminal device to determine the process from the plurality of first data packets The encrypted first data packet.

In some embodiments of the present disclosure, a second acquisition module is also included, configured to:

Acquiring non-key data in the interaction data, encapsulating the key data into multiple second data packets, and sending the multiple second data packets to the second terminal device, so that the second terminal The device parses and displays the non-critical data.

In some embodiments of the present disclosure, the interaction data includes video and/or audio.

According to the fourth aspect of the embodiments of the present disclosure, a data interaction device is provided, which is applied to a second terminal device. Please refer to FIG. 9 , the device includes:

The receiving module 901 is configured to receive M first data packets sent by the first terminal device, wherein the M first data packets are obtained by encapsulating key data in the interaction data by the first terminal device, the N first data packets in the M first data packets are encrypted by the first terminal device, M is a natural number greater than 1, and N is greater than or equal to 1 and less than M;

A decryption module 902, configured to decrypt the encrypted N first data packets to obtain encrypted information;

The sending module 903 is configured to send the encrypted information to the first terminal device, so that the first terminal device continues to send the interaction data.

In some embodiments of the present disclosure, an identification module is also included for:

Before decrypting the encrypted N first data packets to obtain encrypted information, determine the first data packet with an encryption identifier among the M first data packets as encrypted first packet.

In some embodiments of the present disclosure, a first display module is also included, for:

After decrypting the encrypted N first data packets, analyzing and processing the M first data packets sequentially according to the order of receipt, to obtain the key data;

The key data is displayed according to the display manner of the key data.

In some embodiments of the present disclosure, a first display module is also included, for:

receiving multiple second data packets sent by the first terminal device, wherein the multiple second data packets are obtained by encapsulating non-critical data in the interaction data by the first terminal device;

Analyzing and processing the plurality of second data packets in sequence according to the receiving order to obtain the non-critical data;

The non-key data is displayed according to the display manner of the non-key data.

In some embodiments of the present disclosure, a control module is also included for:

generating an interaction control instruction based on the user's operation on the display result of the interaction data;

sending the interaction control instruction to the first terminal device, so that the terminal device continues to return the interaction data.

Regarding the apparatus in the above embodiments, the specific manner in which each module executes operations has been described in detail in the embodiment of the method in the first aspect, and will not be described in detail here.

According to a fifth aspect of the embodiments of the present disclosure, please refer to FIG. 10 , which exemplarily shows a block diagram of an electronic device. For example, the apparatus 1000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.

10, device 1000 may include one or more of the following components: processing component 1002, memory 1004, power supply component 1006, multimedia component 1008, audio component 1010, input/output (I/O) interface 1012, sensor component 1014, and communication component 1016.

The processing component 1002 generally controls the overall operations of the device 1000, such as those associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 1002 may include one or more processors 1020 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 1002 may include one or more modules that facilitate interaction between processing component 1002 and other components. For example, processing component 1002 may include a multimedia module to facilitate interaction between multimedia component 1008 and processing component 1002 .

The memory 1004 is configured to store various types of data to support operations at the device 1000 . Examples of such data include instructions for any application or method operating on device 1000, contact data, phonebook data, messages, pictures, videos, and the like. The memory 1004 can be realized by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power component 1006 provides power to various components of device 1000 . Power components 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 1000 .

The multimedia component 1008 includes a screen that provides an output interface between the device 1000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or swipe action, but also detect duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 1008 includes a front camera and/or a rear camera. When the device 1000 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.

The audio component 1010 is configured to output and/or input audio signals. For example, the audio component 1010 includes a microphone (MIC), which is configured to receive external audio signals when the device 1000 is in operation modes, such as call mode, recording mode and voice recognition mode. Received audio signals may be further stored in memory 1004 or sent via communication component 1016 . In some embodiments, the audio component 1010 also includes a speaker for outputting audio signals.

The I/O interface 1012 provides an interface between the processing component 1002 and a peripheral interface module, which may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.

Sensor assembly 1014 includes one or more sensors for providing status assessments of various aspects of device 1000 . For example, the sensor component 1014 can detect the open/closed state of the device 1000, the relative positioning of components, such as the display and keypad of the device 1000, and the sensor component 1014 can also detect a change in the position of the device 1000 or a component of the device 1000 , the presence or absence of user contact with the device 1000 , the device 1000 orientation or acceleration/deceleration and the temperature change of the device 1000 . The sensor assembly 1014 may also include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 1014 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

The communication component 1016 is configured to facilitate wired or wireless communication between the apparatus 1000 and other devices. The device 1000 can access wireless networks based on communication standards, such as WiFi, 2G or 3G, 4G or 5G or a combination thereof. In an exemplary embodiment, the communication component 1016 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1016 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, apparatus 1000 may be programmed by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Realized by gate array (FPGA), controller, microcontroller, microprocessor or other electronic components, it is used to implement the power supply method of the above-mentioned electronic equipment.

In a sixth aspect, in an exemplary embodiment, the present disclosure also provides a non-transitory computer-readable storage medium including instructions, such as a memory 1004 including instructions, the instructions can be executed by the processor 1020 of the device 1000 to complete the above-mentioned A method of powering an electronic device. For example, the non-transitory computer readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It should be understood that the present disclosure is not limited to the precise constructions which have been described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (30)

1. A data interaction method, characterized in that it is applied to a first terminal device, and the first terminal performs screen projection interaction with a second terminal, and the method includes: Acquiring key data in the interaction data, and encapsulating the key data into M first data packets, where M is a natural number greater than 1; Encrypting N first data packets among the M first data packets, and sequentially sending the M first data packets to the second terminal device, where N is greater than or equal to 1 and less than M; receiving the encrypted information returned by the second terminal device, and determining whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is decrypted by the second terminal device to the encrypted first data packet get. 2. The data interaction method according to claim 1, further comprising: Determine interaction data according to an interaction control instruction, acquire the interaction data, and determine whether key data exists in the interaction data, wherein the interaction control instruction is based on the user's understanding of the first terminal device or the second terminal device generated by the operation; The acquisition of key data in the interaction data includes: Responding to key data being present in the interaction data, key data in the interaction data is acquired. 3. The data interaction method according to claim 2, wherein said determining the interaction data according to the interaction control instruction and obtaining the interaction data comprises: determining the interaction data and the application program to which the interaction data belongs according to the interaction control instruction; Acquiring the interaction data from the application program to which the interaction data belongs. 4. The data interaction method according to claim 2, wherein said determining whether key data exists in said interaction data comprises: determining whether there is data belonging to a preset key data list in the interaction data; In response to the presence of data belonging to a preset key data list in the interaction data, determine that key data exists in the interaction data, and determine that among the interaction data, the data belonging to the preset key data list is key data; In response to no data in the preset key data list exists in the interaction data, it is determined that no key data exists in the interaction data. 5. The data interaction method according to claim 1, wherein said encrypting the N first data packets in the M first data packets comprises: Determine N according to the M and the encryption ratio; Encrypting the first N first data packets among the M first data packets. 6. The data interaction method according to claim 5, further comprising: The encryption ratio is determined according to the computing power of the first terminal device and the quality parameters of the data transmission link. 7. The data interaction method according to claim 1, wherein said encrypting the N first data packets in the M first data packets comprises: Encrypting the encrypted identifier, the encrypted information, and the first data packet to obtain the encrypted first data packet, wherein the encrypted identifier is used by the second terminal device to determine the process from the plurality of first data packets The encrypted first data packet. 8. The data interaction method according to claim 1, further comprising: Acquiring non-key data in the interaction data, encapsulating the key data into multiple second data packets, and sending the multiple second data packets to the second terminal device, so that the second terminal The device parses and displays the non-critical data. 9. The data interaction method according to any one of claims 1 to 8, wherein the interaction data includes video and/or audio. 10. A data interaction method, characterized in that it is applied to a second terminal device, comprising: receiving M first data packets sent by the first terminal device, wherein the M first data packets are obtained by encapsulating key data in the interaction data by the first terminal device, and the M first data packets The N first data packets are encrypted by the first terminal device, M is a natural number greater than 1, and N is greater than or equal to 1 and less than M; Decrypting the encrypted N first data packets to obtain encrypted information; sending the encrypted information to the first terminal device, so that the first terminal device continues to send the interaction data. 11. The data interaction method according to claim 10, wherein, before decrypting the encrypted N first data packets to obtain encrypted information, the method further includes: Determining the first data packet with the encrypted identifier among the M first data packets as the encrypted first data packet. 12. The data interaction method according to claim 10, characterized in that, after decrypting the encrypted N first data packets, further comprising: Analyzing and processing the M first data packets sequentially according to the receiving order to obtain the key data; The key data is displayed according to the display manner of the key data. 13. The data interaction method according to claim 10, further comprising: receiving multiple second data packets sent by the first terminal device, wherein the multiple second data packets are obtained by encapsulating non-critical data in the interaction data by the first terminal device; Analyzing and processing the plurality of second data packets in sequence according to the receiving order to obtain the non-critical data; The non-key data is displayed according to the display manner of the non-key data. 14. The data interaction method according to claim 10, further comprising: generating an interaction control instruction based on the user's operation on the display result of the interaction data; sending the interaction control instruction to the first terminal device, so that the terminal device continues to return the interaction data. 15. A data interaction device, characterized in that it is applied to a first terminal device, and the first terminal performs screen projection interaction with a second terminal, and the device includes: The first acquisition module is configured to acquire key data in the interaction data, and encapsulate the key data into M first data packets, where M is a natural number greater than 1; An encryption module, configured to encrypt N first data packets among the M first data packets, and send the M first data packets to the second terminal device in sequence, where N is greater than or equal to 1 , and less than M; A verification module, configured to receive encrypted information returned by the second terminal device, and determine whether to continue sending the interaction data according to the encrypted information, wherein the encrypted information is encrypted by the second terminal device The first data packet is obtained by decrypting. 16. The data interaction device according to claim 15, further comprising a determination module for: Determine interaction data according to an interaction control instruction, acquire the interaction data, and determine whether key data exists in the interaction data, wherein the interaction control instruction is based on the user's understanding of the first terminal device or the second terminal device generated by the operation; The first acquisition module is specifically used for: In response to key data being present in the interaction data, key data in the interaction data is acquired. 17. The data interaction device according to claim 16, wherein the determination module is configured to determine the interaction data according to the interaction control instruction, and when acquiring the interaction data, is specifically used for: determining the interaction data and the application program to which the interaction data belongs according to the interaction control instruction; Acquiring the interaction data from the application program to which the interaction data belongs. 18. The data interaction device according to claim 16, wherein when the determination module is configured to determine whether key data exists in the interaction data, it is specifically used for: determining whether there is data belonging to a preset key data list in the interaction data; In response to the presence of data belonging to a preset key data list in the interaction data, determine that key data exists in the interaction data, and determine that among the interaction data, the data belonging to the preset key data list is key data; In response to no data in the preset key data list exists in the interaction data, it is determined that no key data exists in the interaction data. 19. The data interaction device according to claim 15, wherein when the encryption module is used to encrypt the N first data packets in the M first data packets, it is specifically used for: Determine N according to the M and the encryption ratio; Encrypting the first N first data packets among the M first data packets. 20. The data interaction device according to claim 19, further comprising a proportional module for: The encryption ratio is determined according to the computing power of the first terminal device and the quality parameters of the data transmission link. 21. The data interaction device according to claim 15, wherein when the encryption module is used to encrypt the N first data packets in the M first data packets, it is specifically used for: Encrypting the encrypted identifier, the encrypted information, and the first data packet to obtain the encrypted first data packet, wherein the encrypted identifier is used by the second terminal device to determine the process from the plurality of first data packets The encrypted first data packet. 22. The data interaction device according to claim 15, further comprising a second acquisition module for: Acquiring non-key data in the interaction data, encapsulating the key data into multiple second data packets, and sending the multiple second data packets to the second terminal device, so that the second terminal The device parses and displays the non-critical data. 23. The data interaction device according to any one of claims 15 to 22, wherein the interaction data includes video and/or audio. 24. A data interaction device, characterized in that it is applied to a second terminal device, comprising: A receiving module, configured to receive M first data packets sent by the first terminal device, wherein the M first data packets are obtained by encapsulating key data in the interaction data by the first terminal device, and the M N first data packets in the first data packets are encrypted by the first terminal device, M is a natural number greater than 1, and N is greater than or equal to 1 and less than M; A decryption module, configured to decrypt the encrypted N first data packets to obtain encrypted information; A sending module, configured to send the encrypted information to the first terminal device, so that the first terminal device continues to send the interaction data. 25. The data interaction device according to claim 24, further comprising an identification module for: Before decrypting the encrypted N first data packets to obtain encrypted information, determine the first data packet with an encryption identifier among the M first data packets as encrypted first packet. 26. The data interaction device according to claim 24, further comprising a first display module for: After decrypting the encrypted N first data packets, analyzing and processing the M first data packets sequentially according to the order of receipt, to obtain the key data; The key data is displayed according to the display manner of the key data. 27. The data interaction device according to claim 24, further comprising a first display module for: receiving multiple second data packets sent by the first terminal device, wherein the multiple second data packets are obtained by encapsulating non-critical data in the interaction data by the first terminal device; Analyzing and processing the plurality of second data packets in sequence according to the receiving order to obtain the non-critical data; The non-key data is displayed according to the display manner of the non-key data. 28. The data interaction device according to claim 24, further comprising a control module for: generating an interaction control instruction based on the user's operation on the display result of the interaction data; sending the interaction control instruction to the first terminal device, so that the terminal device continues to return the interaction data. 29. An electronic device, characterized in that the electronic device includes a memory and a processor, the memory is used to store computer instructions that can be run on the processor, and the processor is used to execute the computer instructions based on The data interaction method according to any one of claims 1 to 14. 30. A computer-readable storage medium, on which a computer program is stored, wherein, when the program is executed by a processor, the method according to any one of claims 1 to 14 is implemented.

Images