WO2023206235A1

WO2023206235A1 - Data communication method and apparatus, electronic device and data communication system

Info

Publication number: WO2023206235A1
Application number: PCT/CN2022/089903
Authority: WO
Inventors: 刘攀; 郑成; 乔光军; 豆子飞; 杨康
Original assignee: 北京小米移动软件有限公司
Priority date: 2022-04-28
Filing date: 2022-04-28
Publication date: 2023-11-02
Also published as: CN117581624A

Abstract

The present disclosure relates to the technical field of electronic communication, and in particular provides a data communication method and apparatus, an electronic device and a data communication system. A data communication method is applied to a first terminal and comprises: in response to the first terminal sending target data to a second terminal by means of first wireless communication, determining key data comprised in the target data on the basis of data features of the target data; and sending the key data to the second terminal by means of second wireless communication, wherein a delay during the second wireless communication is less than a delay during the first wireless communication. In embodiments of the present disclosure, the second wireless communication having a relatively low delay is used to assist the first wireless communication so as to realize data communication, so that the data communication effect is improved, and the stability and reliability of data transmission are ensured.

Description

Data communication method, device, electronic equipment and data communication system

Technical field

The present disclosure relates to the field of electronic communication technology, and specifically to a data communication method, device, electronic equipment and data communication system.

Background technique

With the development of wireless communication technology, most current types of electronic devices can establish wireless communication connections with external devices through wireless communication. Common wireless communication methods include WiFi (wireless fidelity), Bluetooth, and NFC. (Near Field Communication, near field communication), etc. However, in related technologies, wireless data communication between electronic devices and external devices is not effective, resulting in high delays or freezes in data communication.

Contents of the invention

In order to improve the wireless communication effect, embodiments of the present disclosure provide a data communication method, device, electronic equipment, data communication system and storage medium.

In a first aspect, embodiments of the present disclosure provide a data communication method, applied to a first terminal, and the method includes:

In response to the first terminal sending target data to the second terminal through the first wireless communication method, determining key data included in the target data based on data characteristics of the target data;

The key data is sent to the second terminal through a second wireless communication method; the delay of the second wireless communication method is smaller than that of the first wireless communication method.

In some implementations, the target data includes video stream data; determining key data included in the target data based on data characteristics of the target data includes:

Based on the image sequence characteristics of the video stream data, determine the frame image sequence of the video stream data;

Determine key frame images in the frame image sequence based on preset key frame rules;

The image data corresponding to the key frame image is determined as the key data.

In some embodiments, the target data includes control instruction data; and determining the key data included in the target data based on the data characteristics of the target data includes:

Based on the data characteristics of the target data, the control instruction data included in the target data is determined as the key data.

In some embodiments, the method described in the present disclosure further includes:

Non-critical data is sent to the second terminal through the first wireless communication method, where the non-critical data is data in the target data other than the critical data.

In the process of sending the target data to the second terminal through the first wireless communication method, a response signal corresponding to each sub-data of the target data is detected; the response signal indicates that the second terminal is successful. receiving a feedback signal of the sub-data;

In response to a response signal that the sub-data is not detected, the sub-data is sent to the second terminal through a second wireless communication method.

The first wireless communication method includes WiFi communication method, and the second wireless communication method includes UWB communication method.

In a second aspect, embodiments of the present disclosure provide a data communication device, applied to a first terminal, and the device includes:

A key data determination module configured to respond to the first terminal sending the target data to the second terminal through the first wireless communication method, and determine the key data included in the target data based on the data characteristics of the target data;

The sending module is configured to send the key data to the second terminal through a second wireless communication method; the delay of the second wireless communication method is less than the first wireless communication method.

In some implementations, the target data includes video stream data; the key data determination module is configured to:

In some implementations, the target data includes control instruction data; the key data determination module is configured to:

In some implementations, the sending module is configured as:

In some implementations, the first wireless communication method includes WiFi communication method, and the second wireless communication method includes UWB communication method.

In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

A first communication module, configured to establish a communicable connection in the first wireless communication mode with an external device;

a second communication module, configured to establish a communicable connection in the second wireless communication mode with an external device;

processor; and

A memory stores computer instructions for causing the processor to execute the method according to any implementation manner of the first aspect.

In a fourth aspect, embodiments of the present disclosure provide a data communication system, including:

The first terminal is an electronic device according to any implementation manner of the third aspect; and

The second terminal establishes a communicable connection with the first terminal through the first wireless communication method and the second wireless communication method.

In some implementations, the first terminal includes a mobile terminal, and the second terminal includes a virtual reality device.

In some embodiments, the first terminal includes an imaging device and the second terminal includes a mobile terminal.

In a fifth aspect, an embodiment of the present disclosure provides a storage medium that stores computer instructions, and the computer instructions are used to cause a computer to execute the method according to any embodiment of the first aspect.

The data communication method in the embodiment of the present disclosure includes: in response to the first terminal sending target data to the second terminal through the first wireless communication method, determining the key data included in the target data based on the data characteristics of the target data, and sending the target data to the second terminal through the second wireless communication method. The second terminal sends key data, and the delay of the second wireless communication method is smaller than that of the first wireless communication method. In the embodiment of the present disclosure, a second wireless communication method with lower delay is used to assist the first wireless communication method to achieve data communication, thereby improving the data communication effect and ensuring the stability and reliability of data transmission.

Description of the drawings

In order to more clearly explain the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings that need to be used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description The drawings illustrate some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1 is a schematic diagram of a data communications system in accordance with some embodiments of the present disclosure.

Figure 2 is a schematic diagram of a data communications system in accordance with some embodiments of the present disclosure.

Figure 3 is a flowchart of a data communication method according to some embodiments of the present disclosure.

Figure 4 is a structural block diagram of a data communication system according to some embodiments of the present disclosure.

Figure 5 is a flowchart of a data communication method according to some embodiments of the present disclosure.

Figure 6 is a flowchart of a data communication method according to some embodiments of the present disclosure.

Figure 7 is a structural block diagram of a data communication device according to some embodiments of the present disclosure.

Figure 8 is a structural block diagram of an electronic device according to some embodiments of the present disclosure.

Figure 9 is a structural block diagram of an electronic device according to some embodiments of the present disclosure.

Detailed ways

The technical solution of the present disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present disclosure, but not all of them. Based on the embodiments in this disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this disclosure. In addition, the technical features involved in different embodiments of the present disclosure described below can be combined with each other as long as they do not conflict with each other.

Currently, most electronic devices can establish wireless communication connections with other electronic devices through wireless communication to achieve wireless communication of data. For example, smartphones can establish wireless communication connections with wearable devices such as headphones and watches through Bluetooth connections; for example, smartphones can establish wireless communication connections with tablets, laptops and other devices through Wireless Fidelity connections. Communication connection.

In related technologies, when electronic devices communicate with external devices wirelessly, they often can only use the same communication method for data transmission. For example, a smartphone and an external device establish a wireless communication connection through a WiFi connection. When the mobile phone and the external device transmit data, relevant data is transmitted through the WiFi working frequency band, such as 2.4GHz.

However, the WiFi communication method has poor anti-interference ability. In scenarios with complex communication environments, the communication delay between electronic devices and external devices through WiFi is high, resulting in data transmission lags and even crashes in severe cases.

For example, in an example scenario, the external device is a virtual reality device worn by the user on the head, such as an AR (Augmented Reality, augmented reality) or VR (Virtual Reality, virtual reality) device. The virtual reality device establishes a communication connection with the smartphone through WiFi communication. The virtual reality device receives the image data sent by the smartphone and displays the virtual image on its own display screen. In scenarios with complex WiFi communication environments, WiFi channels are easily occupied by interfering signals, resulting in high image data transmission delays. As a result, the images viewed by users are significantly delayed or even stuck, resulting in poor user experience.

For example, in another example scenario, the external device is a small camera, and the camera establishes a communication connection with the smartphone through WiFi communication. The image data collected by the camera through the image sensor is sent to the smartphone frame by frame. After the smartphone processes the image data based on the imaging algorithm, it returns control data to the camera so that the camera can adjust the relevant parameters for imaging. In scenarios with complex WiFi communication environments, WiFi channels are easily occupied by interfering signals, resulting in high data transmission delays. As a result, the shooting images seen by users on the camera are significantly delayed or even stuck, resulting in a poor user experience.

It can be seen from the above examples that wireless communication systems in related technologies have high data communication delays, resulting in poor application effects and difficulty in meeting usage requirements.

Based on the deficiencies in the above related technologies, embodiments of the present disclosure provide a data communication method, device, electronic equipment, data communication system and storage medium, aiming to improve the wireless communication effect and meet the application needs of various scenarios.

In a first aspect, embodiments of the present disclosure provide a data communication method, which method can be applied to a first terminal. The first terminal can be any device type suitable for implementation, such as a mobile terminal such as a smart phone or a tablet computer. For example, Wearable devices such as smart watches and head-mounted devices; and terminal devices such as personal computers, are not limited by this disclosure.

It can be understood that the first terminal and the second terminal described in the embodiments of the present disclosure are only used to make a descriptive distinction between the two electronic devices, and do not specifically limit the difference in the types of the two electronic devices. For example, the same electronic device can be a "first terminal" when it is a data sender, and it can be a "second terminal" when it is a data receiver. This disclosure does not limit this.

Figure 1 shows an example scenario of the disclosed data communication system. As shown in Figure 1, the first terminal 100 is a mobile terminal, such as a smartphone; the second terminal 200 is a virtual reality device, such as AR glasses. In this example, the basic process of communication between the first terminal 100 and the second terminal 200 is: AR glasses collect pose data in real time and send the pose data to the smartphone; the smartphone performs the following operations based on the pose data and the image data of the virtual object. The imaging data is obtained through fusion processing, and the imaging data is sent to the AR glasses frame by frame; the AR glasses display virtual objects on the glasses in real time based on the imaging data.

Figure 2 shows another example scenario of the disclosed data communication system. As shown in Figure 2, the first terminal 100 is an imaging device, such as a camera; the second terminal 200 is a mobile terminal, such as a smartphone. In this example, the basic process of communication between the first terminal 100 and the second terminal 200 is: the camera collects image data in real time and sends the image data to the smartphone frame by frame; the smartphone analyzes the image data frame by frame based on the imaging algorithm (such as the 3A algorithm). The frames are processed to obtain the control instruction data, and the control instruction data is sent to the camera; the camera adjusts the camera parameters corresponding to each frame of image in real time based on the control instruction data, and displays the shooting image on the display screen in real time.

It can be understood that in the above two example scenarios, the smartphone can serve as either the first terminal or the second terminal, and this disclosure does not limit this.

In traditional technology, for the above example scenario, the first terminal 100 and the second terminal 200 can generally use WiFi communication to realize data interaction. This is because the video stream data often has a large amount of data, especially for high-resolution video stream data. , and WiFi communication has high data throughput, which can meet the needs of the above example scenarios.

However, WiFi communication has poor anti-interference ability and high latency. For example, in the scene shown in Figure 1, if the first terminal 100 uses WiFi communication to send image data frame by frame to the second terminal 200, if there is a lag, the virtual object on the AR glasses will not be able to follow the human body posture in real time, or even Completely stuck. For example, in the scene shown in Figure 2, if the first terminal 100 uses WiFi communication to send image data frame by frame to the second terminal 200, if there is a freeze, the picture presented on the camera will be greatly delayed, or even completely freeze. .

Therefore, in the embodiment of the present disclosure, when the first terminal 100 and the second terminal 200 perform data communication through the first wireless communication method, the second wireless communication method is used to assist the first wireless communication method to achieve low latency of key data. transmission to ensure the reliability of data communication in complex communication scenarios. The following description will be made with reference to the embodiment of FIG. 3 .

As shown in Figure 3, in some implementations, the data communication method of the present disclosure includes:

S310. In response to the first terminal sending the target data to the second terminal through the first wireless communication method, determine the key data included in the target data based on the data characteristics of the target data.

S320. Send key data to the second terminal through the second wireless communication method.

As shown in FIG. 4 , in some embodiments of the present disclosure, the first terminal 100 includes a first communication module 110 and a second communication module 120 , and the second terminal 200 includes a first communication module 210 and a second communication module 220 . The first terminal 100 establishes a first wireless communication connection with the first communication module 210 of the second terminal 200 through the first communication module 110 . The first terminal 100 establishes a second wireless communication connection with the second communication module 220 of the second terminal 200 through the second communication module 120.

In the embodiment of the present disclosure, the communication delay of the second wireless communication connection is smaller than the first wireless communication method.

For example, in one example, the first wireless communication connection may be a WiFi communication connection, and the second wireless communication connection may be an ultra-wideband UWB (Ultra Wideband) communication connection. WiFi communication has the advantage of high data throughput, but its anti-interference ability is poor. In scenarios with complex communication environments, data transmission delays are high. UWB (Ultra Wideband) is a near-field communication technology with an ultra-wide spectrum range. It has the advantages of low latency, low power consumption, and strong anti-interference ability. However, the UWB communication module data currently on the market The throughput and bandwidth are limited, making it difficult to implement in scenarios with large amounts of data such as video streaming. Therefore, in the example of the present disclosure, the second wireless communication method with low delay can be used to assist the first wireless communication method with higher delay in data transmission.

In the embodiment of the present disclosure, when the first terminal 100 sends the target data to the second terminal 200 through the first wireless communication method, the key data included in the target data can be determined based on the data characteristics of the target data.

Specifically, the target data refers to relevant data that the first terminal 100 desires to send to the second terminal 200, such as video stream data. The data characteristics of the target data refer to characteristic signals that can identify the target data type, such as timing signals of video stream data (frame start signal, frame end signal, etc.).

In the embodiment of the present disclosure, the target data is divided into key data and non-key data. Key data is a part of the target data with higher priority.

For example, in some embodiments, the target data takes video stream data as an example. The video stream data includes image data frame by frame. Some images in the video stream data can be defined as key frame images, and the image data corresponding to the key frame images is Key data, and the data corresponding to other non-key frame images is non-key data.

For example, in other embodiments, the target data is data containing control instructions. The control instruction data is used to control the device, and therefore has a higher priority than other non-control data. For example, in an example scenario, the target data sent by the mobile terminal to the smart home includes control instruction data and image data. The control instruction data is used to control the smart home, while the image data is used to present animation effects on the smart home. In this example, the control instruction data has a higher priority than the image data, so the control instruction data is critical data and the image data is non-critical data.

In the embodiment of the present disclosure, key data included in the target data can be determined based on the data characteristics of the target data. This disclosure will be described in detail below and will not be described in detail here.

It can be understood that the key data represents data with a higher priority, and the second wireless communication method is a communication method with a lower delay, so the key data can be sent using the second wireless communication method. That is, the first terminal 100 sends key data to the second terminal 200 through the second wireless communication method. In addition, for non-critical data, the first terminal 100 can send it to the second terminal 200 through the first wireless communication method.

For example, in the scene shown in Figure 1, the smartphone sends video stream data to the AR glasses. Some images in the video stream data can be used as key frame images. For example, every fifth frame image can be used as a key frame image. The corresponding image Data is key data. That is to say, in the process of sending video stream data frame by frame, the smartphone sends the key frame data of every 5 frames to the AR glasses using the UWB method with low latency, and sends other non-key frame data to the AR glasses using the WiFi method. AR glasses. In this way, even if the WiFi communication method is interfered with and freezes or even completely freezes, it can at least ensure that the key frame data can be transmitted reliably, and the AR effect viewed by the user can be maintained at basic fluency, improving the data communication effect.

From the above, it can be seen that in the embodiments of the present disclosure, the second wireless communication method with lower delay is used to assist the first wireless communication method to achieve data communication, improve the data communication effect, and ensure the stability and reliability of data transmission.

It is worth noting that in the embodiments of the present disclosure, there is no restriction on the specific types of the first wireless communication method and the second wireless communication method. They can be any wireless communication method suitable for implementation, as long as the communication of the second wireless communication method is ensured. It suffices that the delay is less than the first wireless communication method. For example, in some implementations, the first wireless communication method can be any one of WiFi, Bluetooth, UWB, and cellular networks, and the second wireless communication method can also be any one of WiFi, Bluetooth, UWB, and cellular networks, as long as It is sufficient to ensure that the communication delay of the second wireless communication method is smaller than the first wireless communication method.

In all the following embodiments of the present disclosure, the first wireless communication method is WiFi communication and the second wireless communication method is UWB communication as an example for description.

Based on the above, it can be seen that WiFi communication has the advantage of high data throughput, but is susceptible to interference and has high delay. UWB communication has the advantages of strong anti-interference ability and low delay, but the data throughput is low. Therefore, in the following embodiments of the present disclosure, UWB communication is used to assist WiFi communication, key data with a small amount of data is transmitted through UWB communication, and non-critical data with a large amount of data is transmitted using WiFi communication. This combines the advantages of both to ensure low-latency and highly reliable transmission of key data and is suitable for communication scenarios with large amounts of data.

In some embodiments, the target data takes video stream data as an example to describe the data communication method in the embodiments of the present disclosure.

As shown in Figure 5, in some implementations, according to the data communication method of the present disclosure, the process of determining key data in the target data includes:

S510. Based on the image sequence characteristics of the video stream data, determine the frame image sequence of the video stream data.

S520. Based on the preset key frame rules, determine the key frame images in the frame image sequence.

S530. Determine the image data corresponding to the key frame image as key data.

It can be understood that the video stream data includes frame image data arranged in time series, and each frame image corresponds to one piece of image data. In the embodiment of the present disclosure, the frame image sequence included in the video stream data can be determined by detecting image sequence features in the video stream data.

The image sequence feature represents the temporal characteristics of the frame image. For example, the image data of each frame image includes a frame start signal, a frame end signal, etc. These signals can reflect the temporal continuity of each frame image. Therefore, in the embodiment of the present disclosure, the image data of each frame of image can be divided by detecting the timing signal included in the image data of each frame of image, thereby determining the sequence of frame images included in the video stream data.

After the frame image sequence is obtained, some frame images can be determined as key frame images from the frame image sequence based on preset key frame rules.

The key frame rule can be a key frame extraction rule set according to specific scene requirements. For example, in one example, the key frame rule is "extract an image every n frames as a key frame." Therefore, each frame of the frame image sequence can be The images are counted. When the corresponding serial numbers of the images are 1, n, 2n, 3n..., these frame images are determined as key frame images. The image data corresponding to these key frame images is the key data. For frame images other than key frame images, they are non-key frame images, and their corresponding image data is non-key frame data.

Taking the communication scenario between a camera and a mobile phone shown in Figure 2 as an example, the video stream data collected by the camera in real time is the target data. The camera needs to send the video stream data to the mobile phone frame by frame through WiFi communication. When sending video stream data, the camera can determine the frame image sequence by detecting timing signals (such as frame start signals) in the video stream data, and then count the image data of the currently sent frame image in real time. When the value of the currently sent frame image conforms to the key frame rule, the current frame image is determined to be a key frame image, and its corresponding image data is the key data, so that the UWB communication method is used to send the image data of the frame image. On the contrary, when the value of the currently sent frame image does not comply with the key frame rules, it is determined that the current frame image is not a key frame image, that is, it is enough to keep sending in the WiFi communication mode.

As the current wireless communication environment deteriorates, the WiFi communication method is interfered with, and the data transmission of non-key frame images may be delayed or stuck. However, since the UWB communication method will not be interfered, at least the key frames can be guaranteed. Image data is sent to the mobile phone in real time. As a result, the video stream seen by the user can maintain basic smoothness and alleviate the problems of delays, freezes, or even complete freezes.

From the above, it can be seen that in the embodiments of the present disclosure, low-latency transmission of data of key frames of the video stream is achieved, thereby ensuring video fluency, improving the communication effect and real-time performance of video data, alleviating delays and stuck problems, and improving user experience.

In other embodiments, the target data takes transmission data including control instruction data as an example to describe the data communication method in the embodiments of the present disclosure. In some embodiments, the data communication method of the present disclosure example and the process of determining key data in the target data include:

Based on the data characteristics of the target data, the control instruction data included in the target data is determined as key data.

For example, in an example scenario, the first terminal 100 is a smartphone and the second terminal 200 is a smart home. The target data sent by the mobile phone to the smart home includes: control instruction data and image data. The control instruction data is data related to controlling the work of the smart home, while the image data is the animation effect data displayed on the smart home.

In this example scenario, real-time control of smart homes has a higher priority than animation effect display, that is, the transmission of control instruction data has higher delay requirements than the transmission of image data.

Therefore, in the embodiment of the present disclosure, when the mobile phone sends target data to the smart home through WiFi communication, the mobile phone can detect the data characteristics of the target data, such as detecting the instruction signal in the target data, and determine the detected control instruction data as the key data, thereby using UWB communication method to send the control instruction data to the smart home. For image data, just continue to send it via WiFi communication.

In the current deteriorating wireless communication environment, the WiFi communication method is interfered with, and image data transmission may be delayed or stuck. However, since the UWB communication method will not be interfered, it can at least ensure that the control command data is sent to in real time. Smart home, thereby realizing real-time control of smart home and alleviating the problems of delay, lag, and even control failure.

From the above, it can be seen that in the embodiments of the present disclosure, low-latency transmission of control command data is achieved, thereby ensuring real-time response to control commands, improving data communication effects, alleviating problems of delays, freezes, and even control failures, and improving user experience.

It is worth noting that the above two embodiments can also be combined. For example, in one example, the target data sent by the first terminal 100 includes both video stream data and control instruction data, so that the key frame image data and the control instruction data can be combined. The control command data are all determined as key data and sent using UWB communication method. Those skilled in the art can undoubtedly understand and fully implement it by referring to the foregoing, and this will not be described again in this disclosure.

In some data communication protocols, such as TCP/IP, I2C and other communication protocols, when the sender device sends data to the receiver device, the receiver device will return the response signal ACK (Acknowledge character) to the sender device after successfully receiving the data. , indicating that the sent data has been successfully received. The sender device can determine whether a certain data is successfully sent by detecting the response signal ACK. If the response signal is not received, the data needs to be sent to the receiver device again.

In the embodiment of the present disclosure, when the first terminal 100 sends data through the first wireless communication method, if a certain sub-data does not receive a response signal returned by the second terminal 200 after sending it, the second wireless communication method can be used to send the sub-data again. subdata. The following description will be made with reference to the embodiment of FIG. 6 .

As shown in Figure 6, in some implementations, the data communication method of the present disclosure also includes:

S610. In the process of sending the target data to the second terminal through the first wireless communication method, detect the response signal corresponding to each sub-data of the target data.

S620. In response to the response signal that the sub-data is not detected, send the sub-data to the second terminal through the second wireless communication method.

It can be understood that when the target data is sent, the sub-data are sent one by one in time sequence, that is, the target data includes multiple sub-data.

In this disclosed example, the first terminal 100 sends sub-data one by one to the second terminal 200 through WiFi communication. For each sub-data sending process, the second terminal 200 will send the sub-data to the first terminal 100 after successfully receiving the sub-data. A response signal ACK is returned, which indicates that the second terminal 200 successfully receives the feedback signal of the sub-data.

When the first terminal 100 does not receive the response signal, it means that the sub-data has not been sent successfully and needs to be sent again. Therefore, in the embodiment of the present disclosure, the UWB communication method can be used to send the sub-data again, and the WiFi communication method can continue to send the next sub-data. In this way, the WiFi data communication process can be kept uninterrupted and the communication efficiency can be improved. For data that fails to be sent via WiFi, UWB can be used to send it again to improve the success rate and further ensure the high reliability of communication.

It can be seen from the above that in the embodiments of the present disclosure, data that fails to be sent by the first wireless communication method is re-transmitted through the second wireless communication method, thereby improving data communication efficiency and reliability.

In the second aspect, embodiments of the present disclosure provide a data communication device, which can be applied to a first terminal. The first terminal can be any device type suitable for implementation, such as a mobile terminal such as a smart phone or a tablet computer. For example, Wearable devices such as smart watches and head-mounted devices; and terminal devices such as personal computers, are not limited by this disclosure.

As shown in Figure 7, in some implementations, the data communication device of the present disclosure includes:

The key data determination module 10 is configured to respond to the first terminal sending target data to the second terminal through the first wireless communication method, and determine the key data included in the target data based on the data characteristics of the target data;

The sending module 20 is configured to send the key data to the second terminal through a second wireless communication method; the time delay of the second wireless communication method is smaller than that of the first wireless communication method.

In some implementations, the target data includes video stream data; the key data determination module 10 is configured to:

In some embodiments, the target data includes control instruction data; the key data determination module 10 is configured to:

In some embodiments, the sending module 20 is configured to:

processor; and

Specifically, the electronic device may be the first terminal 100 described in any of the foregoing embodiments. Those skilled in the art can understand and fully implement it by referring to the foregoing embodiments, and will not be described again.

In some embodiments, the first communication module is a WiFi communication module and the second communication module is a UWB communication module as an example. Considering that some electronic devices do not have UWB communication modules, especially some older devices that were launched earlier, There is no built-in UWB communication module.

Therefore, as shown in FIG. 8 , in some embodiments, the second communication module can be configured as a plug-in structure, that is, the second communication module can be pluggably connected through the data interface on the electronic device. The electronic device of the present disclosure can also be implemented. Equipment and data communications methods.

In the example of FIG. 8 , the second communication module has an independent hardware structure, that is, it is installed separately from the electronic device. In some implementations, the second communication module can establish a communicable connection with the electronic device through a data interface on the electronic device. For example, in one example, the data interface of the electronic device is a USB-C data interface, so the second communication module can be provided with a USB-C data plug accordingly, that is, the two establish a data communication connection through the USB-C protocol.

In the embodiments of the disclosure, for the data communication process between the electronic device and the external device, reference may be made to the foregoing embodiments, which will not be described again in the disclosure.

It can be seen from the above that in the embodiments of the present disclosure, the plug-in second communication module is used to connect to the electronic device, so that the disclosed method can be implemented on, for example, a mobile terminal without a UWB module, thereby improving the scalability of the disclosed method.

For the specific structure and working principle of the data communication system, those skilled in the art can understand and fully implement it by referring to the foregoing embodiments, and will not be described again.

Figure 9 shows a structural block diagram of a mobile terminal in some embodiments of the present disclosure. The relevant principles of the mobile terminal and storage media in some embodiments of the present disclosure will be described below with reference to Figure 9 .

Referring to Figure 9, the mobile terminal 1800 may include one or more of the following components: a processing component 1802, a memory 1804, a power component 1806, a multimedia component 1808, an audio component 1810, an input/output (I/O) interface 1812, a sensor component 1816, and communications component 1818.

The processing component 1802 generally controls the overall operations of the mobile terminal 1800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. Processing component 1802 may include one or more processors 1820 to execute instructions. Additionally, processing component 1802 may include one or more modules that facilitate interaction between processing component 1802 and other components. For example, processing component 1802 may include a multimedia module to facilitate interaction between multimedia component 1808 and processing component 1802. As another example, the processing component 1802 can read executable instructions from the memory to implement mobile terminal related functions.

The memory 1804 is configured to store various types of data to support operations at the mobile terminal 1800 . Examples of these data include instructions for any application or method operating on the mobile terminal 1800, contact data, phonebook data, messages, pictures, videos, etc. Memory 1804 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

Power supply component 1806 provides power to various components of mobile terminal 1800. Power supply component 1806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to mobile terminal 1800.

Multimedia component 1808 includes a display screen that provides an output interface between the mobile terminal 1800 and the user. In some embodiments, multimedia component 1808 includes a front-facing camera and/or a rear-facing camera. When the mobile terminal 1800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

Audio component 1810 is configured to output and/or input audio signals. For example, the audio component 1810 includes a microphone (MIC) configured to receive external audio signals when the mobile terminal 1800 is in operating modes, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1804 or sent via communications component 1818 . In some embodiments, audio component 1810 includes a speaker for outputting audio signals.

The I/O interface 1812 provides an interface between the processing component 1802 and a peripheral interface module. The peripheral interface module may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

Sensor component 1816 includes one or more sensors for providing various aspects of status assessment for mobile terminal 1800 . For example, the sensor component 1816 can detect the open/closed state of the mobile terminal 1800 and the relative positioning of components, such as the display and keypad of the mobile terminal 1800. The sensor component 1816 can detect the mobile terminal 1800 or a component of the mobile terminal 1800. The position changes, the presence or absence of user contact with the mobile terminal 1800, the orientation or acceleration/deceleration of the mobile terminal 1800 and the temperature change of the mobile terminal 1800. Sensor component 1816 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor component 1816 may include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 1816 may include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1818 is configured to facilitate wired or wireless communication between the mobile terminal 1800 and other devices. The mobile terminal 1800 can access a wireless network based on communication standards, such as Wi-Fi, 2G, 3G, 4G, 5G or 6G, or a combination thereof. In one exemplary embodiment, communication component 1818 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communications component 1818 includes a near field communications (NFC) module to facilitate short-range communications. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the mobile terminal 1800 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation.

Obviously, the above-mentioned embodiments are only examples for clear explanation and are not limitations of the embodiments. For those of ordinary skill in the art, other different forms of changes or modifications can be made based on the above description. An exhaustive list of all implementations is neither necessary nor possible. The obvious changes or modifications derived therefrom are still within the protection scope of the present invention.

Claims

A data communication method, characterized in that it is applied to a first terminal, and the method includes:

In response to the first terminal sending target data to the second terminal through the first wireless communication method, determining key data included in the target data based on data characteristics of the target data;

The key data is sent to the second terminal through a second wireless communication method; the delay of the second wireless communication method is smaller than that of the first wireless communication method.
The method according to claim 1, wherein the target data includes video stream data; and determining the key data included in the target data based on the data characteristics of the target data includes:

Based on the image sequence characteristics of the video stream data, determine the frame image sequence of the video stream data;

Determine key frame images in the frame image sequence based on preset key frame rules;

The image data corresponding to the key frame image is determined as the key data.
The method according to claim 1 or 2, characterized in that the target data includes control instruction data; and determining the key data included in the target data based on the data characteristics of the target data includes:

Based on the data characteristics of the target data, the control instruction data included in the target data is determined as the key data.
The method according to claim 1, further comprising:

Non-critical data is sent to the second terminal through the first wireless communication method, where the non-critical data is data in the target data other than the critical data.
The method according to claim 1, further comprising:

In the process of sending the target data to the second terminal through the first wireless communication method, a response signal corresponding to each sub-data of the target data is detected; the response signal indicates that the second terminal is successful. receiving a feedback signal of the sub-data;

In response to a response signal that the sub-data is not detected, the sub-data is sent to the second terminal through a second wireless communication method.
The method according to claim 1, characterized in that:

The first wireless communication method includes WiFi communication method, and the second wireless communication method includes UWB communication method.
A data communication device, characterized in that it is applied to a first terminal, and the device includes:

A key data determination module configured to respond to the first terminal sending the target data to the second terminal through the first wireless communication method, and determine the key data included in the target data based on the data characteristics of the target data;

The sending module is configured to send the key data to the second terminal through a second wireless communication method; the delay of the second wireless communication method is less than the first wireless communication method.
An electronic device, characterized by including:

A first communication module, configured to establish a communicable connection in the first wireless communication mode with an external device;

a second communication module, configured to establish a communicable connection in the second wireless communication mode with an external device;

processor; and

A memory storing computer instructions for causing the processor to execute the method according to any one of claims 1 to 6.
A data communication system, characterized by including:

The first terminal is the electronic device according to claim 8; and

The second terminal establishes a communicable connection with the first terminal through the first wireless communication method and the second wireless communication method.
The data communication system according to claim 9, characterized in that:

The first terminal includes a mobile terminal, and the second terminal includes a virtual reality device; or the first terminal includes an imaging device, and the second terminal includes a mobile terminal.
A storage medium, characterized in that computer instructions are stored, and the computer instructions are used to cause a computer to execute the method according to any one of claims 1 to 6.