WO2020248233A1 - 数据处理方法、系统、移动平台、终端及存储介质 - Google Patents

数据处理方法、系统、移动平台、终端及存储介质 Download PDF

Info

Publication number
WO2020248233A1
WO2020248233A1 PCT/CN2019/091298 CN2019091298W WO2020248233A1 WO 2020248233 A1 WO2020248233 A1 WO 2020248233A1 CN 2019091298 W CN2019091298 W CN 2019091298W WO 2020248233 A1 WO2020248233 A1 WO 2020248233A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
data packet
mobile platform
data
digital communication
Prior art date
Application number
PCT/CN2019/091298
Other languages
English (en)
French (fr)
Inventor
刘怀宇
陈颖
吴一凡
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2019/091298 priority Critical patent/WO2020248233A1/zh
Priority to CN201980008437.0A priority patent/CN111684813A/zh
Publication of WO2020248233A1 publication Critical patent/WO2020248233A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B7/00Radio transmission systems, i.e. using radiation field
    • H04B7/14Relay systems
    • H04B7/15Active relay systems
    • H04B7/185Space-based or airborne stations; Stations for satellite systems
    • H04B7/18502Airborne stations
    • H04B7/18506Communications with or from aircraft, i.e. aeronautical mobile service
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/12Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1812Hybrid protocols; Hybrid automatic repeat request [HARQ]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Definitions

  • the present invention relates to the field of intelligent control, in particular to a data processing method, system, mobile platform, terminal and storage medium.
  • the traversing aircraft has the characteristics of fast flying speed, high flight flexibility and freedom from attitude restrictions. It is widely used in traversing events and video production. For example, in a traversing machine competition, the participating traversing machine can take first-person view (FPV) image data, and send the image data to the pilot or spectator's glasses equipment, and the glasses equipment can play the image data So that the pilots or spectators can understand the flight situation of the crossing plane.
  • FV first-person view
  • the glasses equipment can play the image data So that the pilots or spectators can understand the flight situation of the crossing plane.
  • the image data cannot be broadcast live.
  • the embodiments of the present invention provide a data processing method, system, mobile platform, equipment, and storage medium, which can improve the transmission quality of image data, and can realize live broadcast of image data.
  • an embodiment of the present invention provides a data processing method applied to a data processing system.
  • the data processing system includes a mobile platform, a first terminal, a second terminal, and a playback device, and the method includes:
  • the mobile platform sends a data packet including image data to the first terminal through a digital communication link;
  • the first terminal After receiving the data packet from the mobile platform, the first terminal sends the data packet to the second terminal;
  • the second terminal After receiving the data packet from the first terminal, the second terminal sends the data packet to the playback device;
  • the playback device After receiving the data packet from the second terminal, the playback device plays according to the data packet.
  • an embodiment of the present invention provides another data processing method applied to a mobile platform, and the method includes:
  • the data packet including image data is sent to the first terminal through the digital communication link, so that the first terminal sends the data packet to the second terminal, and the second terminal sends the data packet to Playing equipment, and the playing equipment plays according to the data packet.
  • an embodiment of the present invention provides yet another data processing method applied to a first terminal, and the method includes:
  • the data packet After receiving the data packet from the mobile platform, the data packet is sent to the second terminal, so that the second terminal sends the data packet to the playback device, and the playback device will The packet is played.
  • an embodiment of the present invention provides yet another data processing method applied to a second terminal, and the method includes:
  • the data packet is sent to a playback device, so that the playback device plays according to the data packet.
  • an embodiment of the present invention provides yet another data processing method, which is applied to a third terminal, and the method includes:
  • the third terminal does not send fourth response information to the mobile platform, and the fourth response information is used to instruct the third terminal to respond to the data packet Decoding failed.
  • an embodiment of the present invention provides yet another data processing method applied to a fourth terminal, and the method includes:
  • control instruction transmission time slot the control instruction is sent to the mobile platform through the digital communication link, so that the mobile platform executes the control instruction.
  • an embodiment of the present invention provides a data processing system.
  • the data processing system includes a mobile platform, a first terminal, a second terminal, and a playback device, wherein:
  • the mobile platform is configured to send a data packet including image data to the first terminal through a digital communication link;
  • the first terminal is configured to send the data packet to the second terminal after receiving the data packet from the mobile platform;
  • the second terminal is configured to send the data packet to the playback device after receiving the data packet from the first terminal;
  • the playback device is configured to play according to the data packet after receiving the data packet from the second terminal.
  • an embodiment of the present invention provides a mobile platform, the mobile platform comprising: a camera, a digital image transmission transceiver, a mobile device, a memory, and a processor, wherein:
  • the mobile device is used to control the movement of the mobile platform
  • the photographing device is used for photographing to obtain image data
  • the digital image transmission transceiver is used to send and receive information
  • the memory is used to store program instructions
  • the processor is configured to call program instructions stored in the memory to execute the following steps: send a data packet including image data to a first terminal through a digital communication link, so that the first terminal transmits the data packet Sent to a second terminal, the second terminal sends the data packet to a playback device, and the playback device plays the data packet according to the data packet.
  • an embodiment of the present invention provides a terminal, the terminal is a first terminal, a digital image transmission transceiver, a playback device, a memory, and a processor,
  • the digital image transmission transceiver is used to send and receive information
  • the playing device is used for playing according to the data packet
  • the memory is used to store program instructions
  • the processor is configured to call the program instructions stored in the memory to perform the following steps: receive a data packet including image data sent by a mobile platform through a digital communication link; after receiving the data packet from the mobile platform, The data packet is sent to the second terminal, so that the second terminal sends the data packet to a playback device, and the playback device plays the data packet according to the data packet.
  • an embodiment of the present invention provides another terminal, the terminal is a second terminal, and the terminal includes a memory and a processor,
  • the memory is used to store program instructions
  • the processor is configured to call program instructions stored in the memory to perform the following steps: receive a data packet including image data sent by the first terminal, and the data packet is sent by the mobile platform through a digital communication link to Of the first terminal; sending the data packet to a playback device, so that the playback device plays according to the data packet.
  • an embodiment of the present invention provides another terminal, the terminal is a third terminal, and the terminal includes a digital image transmission transceiver, a playback device, a memory, and a processor,
  • the digital image transmission transceiver is used to receive a data packet including image data sent by a mobile platform
  • the playback device is configured to play according to the data packet
  • the memory is used to store program instructions
  • the processor is configured to call the program instructions stored in the memory to perform the following steps: receiving a data packet including image data sent by a mobile platform through a digital communication link; wherein, the third terminal receives data from the mobile platform When the data packet is not received, the third response information is not sent to the mobile platform by the third terminal, and the third response information is used to indicate that the third terminal has not received all information from the mobile platform.
  • the data packet or, when the third terminal receives the data packet from the mobile platform and fails to decode the data packet, the fourth response information is not sent to the third terminal On a mobile platform, the fourth response information is used to indicate that the third terminal fails to decode the data packet.
  • an embodiment of the present invention provides yet another terminal, the terminal is a fourth terminal, and the terminal includes a digital flight control command transmitter, an interactive device, a memory, and a processor,
  • the interaction device is used to receive a control instruction input by a user
  • the digital flight control command transmitter is used to send the control instruction to a mobile platform
  • the memory is used to store program instructions
  • the processor is configured to call the program instructions stored in the memory to perform the following steps: receive the control instructions input by the user; in the control instruction transmission time slot, send the control instructions to the mobile platform through the digital communication link, So that the mobile platform executes the control instruction.
  • an embodiment of the present invention provides a computer-readable storage medium, including: the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it is used to perform steps such as:
  • the mobile platform may send a data packet including image data to the first terminal through the digital communication link, and after receiving the data packet from the mobile platform, the first terminal sends the data packet to the second terminal .
  • the mobile platform transmits data packets through the digital communication link, which can improve the transmission quality of image data and increase the transmission distance of image data.
  • the second terminal can send the data packet to the playback device, and the playback device can play the image data in the data packet, which can realize the live broadcast of the image data, so that the viewer can understand the movement of the mobile platform in real time through the image data.
  • Figure 1a is a schematic diagram of a network architecture of a data processing system provided by an embodiment of the present invention
  • Figure 1b is a schematic diagram of a downlink transmission time slot according to an embodiment of the present invention.
  • Figure 1c is a schematic diagram of a network architecture of a mobile platform control system provided by an embodiment of the present invention.
  • Figure 1d is a schematic diagram of a network architecture of another mobile platform control system provided by an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of a data processing method provided by an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of another data processing method provided by an embodiment of the present invention.
  • FIG. 4 is a schematic flowchart of yet another data processing method provided by an embodiment of the present invention.
  • Figure 5 is a schematic structural diagram of a mobile platform provided by an embodiment of the present invention.
  • Figure 6 is a schematic structural diagram of a terminal provided by an embodiment of the present invention.
  • Figure 7 is a schematic structural diagram of another terminal provided by an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of another terminal provided by an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of another terminal provided by an embodiment of the present invention.
  • FIG. 1a is a schematic diagram of a network architecture of a data processing system provided by an embodiment of the present invention.
  • the network architecture at least includes a mobile platform 10, a first terminal 20, a second terminal 30, and at least one playback device 40. Take three playback devices as an example in 1a.
  • the network architecture may further include a third terminal 50 and a fourth terminal 60.
  • the mobile platform 10 may include movable equipment such as drones or ground mobile robots.
  • the drones may be rotary-wing drones, such as quadrotor drones, hexarotor drones, and octorotor drones. It can be a fixed-wing drone.
  • the mobile platform 10 may include a power system, a pan-tilt, a camera 101, a digital image transmission transceiver 102, a mobile device 103, and so on.
  • the power system is used to provide mobile power for the mobile platform.
  • the power system includes one or more of propellers, motors, and ESCs.
  • the photographing device 101 is mounted on the main body of the mobile platform 10 via a pan-tilt, and is used for image capturing during the movement of the mobile platform 10 and also used for recording video during the movement of the mobile platform 10.
  • the photographing device 101 includes, but is not limited to, a multispectral imager, a hyperspectral imager, a visible light camera, an infrared camera, and the like.
  • the pan/tilt is a multi-axis transmission and stabilization system.
  • the pan/tilt motor compensates the shooting angle of the image capturing device by adjusting the rotation angle of the rotating shaft, and prevents or reduces the shaking of the imaging device by setting an appropriate buffer mechanism.
  • the digital image transmission transceiver 102 can refer to a device that transmits information (such as image data) through a digital communication link, that is, the digital image transmission transceiver 102 can be used for the mobile platform 10 to exchange information with other terminals, and the other terminals can include the first terminal 20.
  • the digital image transmission transceiver 102 may be used to send a data packet in which the photographing device 101 includes image data to the first terminal 20.
  • the mobile device 103 is used to control the movement of the mobile platform, that is, control the movement parameters of the mobile platform.
  • the movement parameters include movement speed, movement posture, movement direction, movement track, and so on.
  • the first terminal 20 may refer to the glasses device on the pilot end or other devices.
  • the glasses device may refer to glasses devices capable of playing videos, such as virtual reality (Virtual Reality, VR) or augmented reality (Augmented Reality, AR).
  • the spectacle equipment on the pilot end may refer to the spectacle equipment controlled by the pilot (ie, the contestant).
  • the first terminal 20 may include a digital image transmission transceiver 201 and a playback device 202.
  • the digital image transmission transceiver 201 may be used for the first terminal 20 to exchange information with the mobile platform 10 and the second terminal 30.
  • the digital image transmission transceiver 201 can be used to receive data packets sent by the mobile platform through the digital image transmission transceiver 102. After receiving the data packet from the mobile platform, the first terminal can send the data packet to the second terminal 30, and can play the data packet according to the data packet through the playback device 202 to present a picture taken by the mobile platform.
  • the second terminal 30 may refer to a transit device.
  • the second terminal 30 may include a set-top box, a repeater, a router, a switch, or other equipment.
  • the second terminal 30 may be used to send data packets to the playback device 40.
  • the second terminal 30 and the first terminal 20 are connected by wire.
  • the playback device 40 can be used to play the image data in the data packet.
  • the playback device 40 can specifically refer to a TV, a smart phone, a tablet computer, a laptop, a ground station, a live broadcast station, etc., which can play the image data in the data packet. device of.
  • the third terminal 50 may refer to the glasses device at the audience side or other devices.
  • the spectator-side spectacle equipment may refer to spectacle equipment controlled by the spectator.
  • the third terminal 50 may include a digital image transmission transceiver 501 and a playback device 502.
  • the digital image transmission transceiver 501 may be used to receive data packets sent by the mobile platform 10 through the digital image transmission transceiver.
  • the playing device 502 is used for playing according to the data packet to present the picture taken by the mobile platform.
  • the above-mentioned mobile platform 10 may be used to send continuous data packets to the first terminal 20 and the third terminal 50 respectively through the digital communication link in the current data transmission period.
  • the above-mentioned mobile platform 10 may receive response information fed back by the first terminal 20 for each data packet. Based on the received response information, the target data packet in the consecutive data packets is determined. In the current data transmission period, target data packets are sent to the first terminal 20 and the third terminal 50 through the digital communication link.
  • each data transmission period may include a downlink transmission time slot and an uplink transmission time slot.
  • the total number of data packets that can be transmitted in the downlink transmission time slot can be preset (for example, 10 data packets can be transmitted).
  • the downlink transmission time slot can be divided into normal time slots and redundant time slots in advance.
  • the normal time slot can be regarded as the time slot occupied by the transmission of multiple newly acquired consecutive data packets.
  • the redundant time slot can be regarded as the time slot occupied by the transmission of a preset number of target data packets.
  • the duration corresponding to the normal time slot may be greater than or equal to the duration corresponding to the redundant time slot, or the duration corresponding to the normal time slot may be less than the duration corresponding to the redundant time slot.
  • the downlink transmission time slot includes a normal time slot and a redundant time slot, and the duration of the normal time slot is greater than the duration of the redundant time slot.
  • the normal time slot can be regarded as a time slot occupied by the transmission of 6 consecutive data packets, and the 6 consecutive data packets can be marked as data packet 1 to data packet 6.
  • the redundant time slot can be regarded as the time slot occupied by the transmission of 4 target data packets, and the 4 target data packets can be marked as data packet 7 to data packet 10.
  • the mobile platform 10 sends 6 consecutive data packets including image data to the first terminal 20 and the third terminal 50 through the digital communication link.
  • the first terminal 20 and the third terminal 50 can receive 6 consecutive data packets from the mobile platform 10, and the first terminal 20 can send a response message to the mobile platform 10 for each data packet.
  • the mobile platform 10 can receive response information from the first terminal 20, determine the target data packet from the 6 consecutive data packets based on the response information, and send it to the first terminal 10 and the third terminal via the digital communication link in the redundant time slot. 50 send the target packet.
  • the number of data packets transmitted in the normal time slot and the redundant time slot can be respectively preset according to needs, and is not limited to the value in the above example.
  • the continuous data packets sent by the mobile platform 10 to the first terminal 20 and the third terminal 50 through the digital communication link in the current data transmission period may specifically refer to: the mobile platform 10 is in the current data transmission time slot In the normal time slot of, continuous data packets are respectively sent to the first terminal 20 and the third terminal 50 through the digital communication link.
  • the mobile platform 10 sends target data packets to the first terminal 20 and the third terminal 50 through the digital communication link, which may specifically refer to the redundant data transmission time slot of the mobile platform 10 in the current data transmission period.
  • target data packets are respectively sent to the first terminal 20 and the third terminal 50 through the digital communication link.
  • the first terminal 20 may feed back response information to the mobile platform 10 for each data packet. Specifically, each time the first terminal 20 receives a data packet, it may return a response message for the data packet to the mobile platform 10.
  • the response information can be used to characterize whether the data packet is successfully received or whether the data packet is successfully decoded.
  • the mobile platform 10 may also determine the target data packet among the above-mentioned continuous data packets based on the acquired response information.
  • the target data packet is the data packet to be resent to the first terminal 20 and the third terminal 50. That is, the target data packet transmitted in the redundant time slot of each data transmission cycle. Since the response information can be used to characterize whether the data packet is successfully received or whether the data packet is successfully decoded, the data packet corresponding to the response information used to characterize the data packet that fails to receive or fails to decode can be used as the target data packet. That is, the target data packet may refer to a data packet that has not been received or has failed to decode. After determining the target data packet, the mobile platform 10 may send the target data packet to the first terminal 20 and the third terminal 50 within the current data transmission period.
  • the mobile platform 10 can determine the target data packet that needs to be retransmitted according to the response information of the first terminal 20 to each data packet and perform the retransmission, so that when a certain data packet fails to be received or decoded, the first terminal 20 can receive the data packet again, which reduces the video freeze phenomenon of the first terminal 20 and improves the fluency of the screen display of the first terminal 20.
  • the mobile platform 10 may send the target data packet to the third terminal 50, which can reduce the video jam phenomenon of the third terminal 50 and improve the fluency of the screen display of the third terminal 50.
  • the above response information may be NAK (Negative Acknowledgment) or ACK (Acknowledgement).
  • NAK is used to confirm that a data packet has been received in digital communication, but the decoding of the data packet fails, or NAK is a characterization data packet in digital communication that has not been received.
  • ACK indicates that the data packet has been confirmed to be received and decoded successfully in data communication.
  • the NAK includes first response information or second response information, the first response information is used to indicate that the first terminal 20 has not received a data packet from the mobile platform 10, and the second response information is used to indicate that the first terminal 20 receives To the packet, but failed to decode the packet.
  • the mobile platform 10 may further determine the target data packet through the following steps:
  • the preset number is a preset number of data packets (ie, target data packets) that need to be retransmitted in each data transmission period. That is, the number of target data packets transmitted in the redundant time slot of each data transmission cycle.
  • the aforementioned preset number of data packets from the determined data packets whose response information is NAK is selected as the target data packets. For example, if the preset number is 4 and the number of data packets whose response information is NAK is also 4, then the four data packets whose response information is NAK can all be regarded as target data packets. If the number of NAK data packets is also 5, 4 data packets can be selected as the target data packets. Here, it can be selected randomly, or it can be selected according to other preset rules or order (for example, according to the order of sending time from early to late), and the selection method is not limited here.
  • the data packets that have failed to decode can be determined according to the response information of the first terminal 20, and these data packets can be retransmitted, reducing the video freeze of the first terminal 20 This phenomenon improves the fluency of the screen display of the first terminal 20.
  • the mobile platform 10 selects data packets whose response information is NAK as the target data packet, and selects the target number from the remaining data packets The data packet as the target data packet.
  • the target number is the difference between the preset number and the number of data packets whose response information is NAK.
  • the remaining data packets mentioned above may be data packets that have been sent in the current data transmission period and whose response information is not NAK. As an example, if there is only one data packet whose response information is NAK, then three data packets can be selected as the target data packets among the remaining data packets and resent. As a result, the video freeze phenomenon of the first terminal 20 is reduced, and the smoothness of the screen display of the first terminal 20 is improved, and the channel capacity of the current data transmission period can be fully utilized.
  • the operation of the mobile platform 10 to select the target data packet from the above-mentioned remaining data packets can be performed by the following steps: First, from the remaining data packets, it is determined that the data packet for which the corresponding response information is not received is not received. After that, from the data packets of the corresponding response information that have not been received, the data packets of the target number are selected as the target data packets according to the order of the number of transmissions from small to large.
  • the remaining data packets only include data packets for which the corresponding response information has not been received and data packets whose response information is ACK. If the response information corresponding to a certain data packet is ACK, it can usually be considered that the data packet is correct. Since the transmission of ACK has a certain time delay, the data packet that has not received the corresponding response information may be ACK or NAK. Therefore, by selecting the target data packet from the data packets for which the corresponding response information is not received, the data packet that fails to be decoded can be determined with a greater probability. In addition, because the greater the number of transmissions, the higher the probability of successful transmission. Therefore, by selecting from small to large, data packets with fewer transmission times can be selected preferentially, and data packets that have failed decoding can be determined with greater probability.
  • the at least two data packets are processed in the order of transmission time from first to last. Select. Therefore, when multiple data packets are sent with the same number of times, the earlier one can be selected first, so that the earlier data packet can be received as soon as possible.
  • the above-mentioned mobile platform 10 may also select a continuous preset number (for example, 4) data packets from the data packet corresponding to the NAK received for the first time as the target data packet.
  • a continuous preset number for example, 4
  • data packets from the data packet corresponding to the NAK received for the first time as the target data packet.
  • the mobile platform 10 sends continuous data packet 1, data packet 2, data packet 3, data packet 4, data packet 5, and data packet 6, the response information returned by each data packet in turn is NAK, NAK, ACK, ACK, ACK, ACK, the data packet corresponding to the NAK received for the first time is NAK.
  • data packet 1 can be used as the start data packet, and 4 consecutive data packets starting from data packet 1 (ie, data packet 1, data packet 2, data packet 3, and data packet 4) can be used as target data packets.
  • this method can more conveniently determine the target data packet and improve the data processing efficiency.
  • the above-mentioned first terminal 20 may also perform the following steps: for each received data packet, determine whether the data packet has been successfully received; if yes, discard the data packet; if not, store the data packet .
  • each data packet may have an identifier (such as a sequence number) for indicating and distinguishing the data packet.
  • the above-mentioned first terminal 20 can determine whether the data packet has been successfully received by matching the identifiers.
  • the aforementioned third terminal 50 may also determine whether the data packet is a historical data packet received in error for each received data packet; if not, discard the data packet; if so, use a hybrid automatic repeat request
  • the (Hybrid Automatic Repeat reQuest, HARQ) technology combines the data packet with the aforementioned historical data packet, and decodes the combined data packet.
  • HARQ is a technology formed by combining forward error correction coding (Forward Error Correction, FEC) and Automatic Repeat Request (ARQ).
  • FEC forward error correction coding
  • ARQ Automatic Repeat Request
  • FEC is a method to increase the credibility of data communication. In a one-way communication channel, once an error is found, its receiver will not have the right to request transmission. FEC is a method of using data to transmit redundant information. When an error occurs in the transmission, the receiver will be allowed to reconstruct the data.
  • ARQ is to recover the erroneous message by the receiver requesting the sender to retransmit the erroneous data message. It is one of the methods used to handle the errors caused by the channel in communication. It is sometimes called backward error correction (Backward Error Correction). Correction, BEC).
  • the third terminal 50 can correct errors in the corresponding historical data packets in a complementary deletion manner based on the currently received data packets, so as to obtain a combined error-free data packet.
  • HARQ supports the decoding of each data packet individually, or the combined decoding of a data packet with greater redundancy.
  • combining the data packet with the aforementioned historical data packet can correct errors in the historical data packet and improve the accuracy of the data packet.
  • the video freeze phenomenon of the first terminal 20 is reduced, and the smoothness of the screen display of the first terminal 20 is improved.
  • the fourth terminal 60 may refer to a terminal used to control the movement of the mobile platform, that is, the fourth terminal 60 may refer to a remote control device, and the fourth terminal 60 may specifically be a remote control, a smart phone, a tablet computer, or a laptop computer. And wearable devices (watches, bracelets) or other devices.
  • the fourth terminal 60 may include a digital flight control command transmitter 601 and an interactive device 602.
  • the interaction device 602 may specifically include other interaction devices such as a keyboard, keys, a joystick, and a wave wheel.
  • the fourth terminal 60 may detect a user's control operation through the interaction device 602, and generate a control instruction according to the control operation detected by the interaction device 602.
  • the digital flight control command transmitter 601 can refer to a device that transmits control instructions through a digital communication link, that is, the digital flight control command transmitter 601 can be used to send control instructions to the mobile platform 10, and the mobile platform 10 executes the control instructions.
  • the fourth terminal may directly communicate with the mobile platform, or the fourth terminal may also communicate with the mobile platform through the first terminal.
  • the fourth terminal communicates with the mobile platform through the first terminal, see FIG. 1c and FIG. 1d for a specific implementation manner.
  • the first terminal when the fourth terminal communicates with the mobile platform through the first terminal, the first terminal is configured to: receive the mobile associated data of the mobile platform from the mobile platform through the communication connection with the mobile platform and display the mobile associated data ; Receive control instructions from the fourth terminal through the communication connection between the fourth terminal corresponding to the first terminal, and send the control instructions to the mobile platform through the communication connection with the mobile platform.
  • the first terminal may communicate with the mobile platform through a wireless communication technology dedicated to communicating with the mobile platform.
  • the communication connection between the first terminal and the mobile platform may be a digital communication connection defined in a wireless communication technology dedicated to communicating with the mobile platform.
  • wireless communication technology may refer to wireless digital communication technology.
  • the communication connection between the first terminal and the fourth terminal may be a wired communication connection.
  • the first terminal communicates with the fourth terminal through USB technology.
  • the communication connection between the first terminal and the fourth terminal is a USB connection defined in the USB technology.
  • the fourth terminal does not need to establish a communication connection with the mobile platform, and the first terminal communicating with the fourth terminal sends a control instruction to the mobile platform to remotely control the mobile platform. Therefore, in the case that the fourth terminal does not need to be configured with devices required for communication with the mobile platform, the mobile platform is remotely controlled to save the cost of the fourth terminal.
  • the first terminal communicates with the mobile platform through a wireless communication technology dedicated to communicating with the mobile platform.
  • the first terminal is configured with radio frequency circuits, antennas and other devices required for communication using the wireless communication technology.
  • the fourth terminal does not need to be equipped with radio frequency circuits, antennas and other components required for communication using the wireless communication technology, saving the cost of the fourth terminal.
  • each first terminal when the number of first terminals in the mobile platform control system is multiple, each first terminal establishes a communication connection with the mobile platform.
  • each first terminal may correspond to one or more fourth terminals among all fourth terminals.
  • the first terminal when one first terminal corresponds to multiple fourth terminals among all fourth terminals, there is a communication connection between the first terminal and each fourth terminal of the multiple fourth terminals.
  • the first terminal sends the control instruction generated on the fourth terminal to the mobile platform to control the mobile platform. Perform remote control.
  • all the first terminals in the mobile platform control system include: the first terminal 1, the first terminal 2, and all the fourth terminals in the mobile platform control system include: the fourth terminal 1, the fourth terminal 2, and the fourth terminal 3. ,
  • the first terminal 1 has a communication connection with the fourth terminal 1 and the fourth terminal 2;
  • the first terminal 2 has a communication connection with the fourth terminal 3 and the fourth terminal 4.
  • the fourth terminal corresponding to the first terminal 1 includes: a fourth terminal 1 and a fourth terminal 2.
  • the fourth terminal corresponding to the first terminal 2 includes: a fourth terminal 3 and a fourth terminal 4.
  • the first terminal 1 When the remote controller of the mobile platform uses the fourth terminal 1 or the fourth terminal 2 to remotely control the mobile platform, the first terminal 1 will generate the control instruction generated on the fourth terminal 1 or the control instruction generated on the fourth terminal 2 Send to the mobile platform to remotely control the mobile platform.
  • the first terminal 2 When the remote controller of the mobile platform uses the fourth terminal 3 or the fourth terminal 4 to remotely control the mobile platform, the first terminal 2 will generate the control instruction generated on the fourth terminal 3 or the control instruction generated on the fourth terminal 4 Send to the mobile platform to remotely control the mobile platform.
  • multiple first terminals in all the first terminals may correspond to the same fourth terminal.
  • multiple remote controllers of the mobile platform use the same fourth terminal to remotely control the mobile platform in turn.
  • the first terminal used by each remote controller receives the mobile related data from the mobile platform and displays the mobile related data.
  • the fourth terminal when multiple first terminals in all the first terminals correspond to the same fourth terminal, when the fourth terminal is used to remotely control the mobile platform, the fourth terminal will generate data on the fourth terminal.
  • the control instruction is sent to the first terminal used by the current remote controller of the mobile platform, and the first terminal used by the current remote controller of the mobile platform sends the control instruction generated on the fourth terminal to the mobile platform to remotely control the mobile platform.
  • all first terminals include: the first terminal 1, the first terminal 2, the first terminal 3, and the first terminal 4, and all the fourth terminals include: the fourth terminal 1 and the fourth terminal 2.
  • the fourth terminal 1 has a communication connection with the first terminal 2 and the first terminal 1.
  • the fourth terminal 2 has a communication connection with the first terminal 3 and the first terminal 4.
  • Both the first terminal 1 and the first terminal 2 correspond to the fourth terminal 1. Both the first terminal 3 and the first terminal 4 correspond to the fourth terminal 2.
  • the fourth terminal 1 sends the control command generated on the fourth terminal 1 to the first terminal 1 or the first terminal used by the current remote controller of the mobile platform.
  • the first terminal 2, the first terminal 1 or the first terminal 2 used by the current remote controller of the mobile platform sends the control instruction generated on the fourth terminal 1 to the mobile platform to remotely control the mobile platform.
  • the fourth terminal 2 sends the control command generated on the fourth terminal 2 to the first terminal 3 or the first terminal used by the current remote controller of the mobile platform.
  • the first terminal 4, the first terminal 3 or the first terminal 4 used by the current remote controller of the mobile platform sends the control instruction generated on the fourth terminal 2 to the mobile platform to remotely control the mobile platform.
  • the mobile-related data of the mobile platform includes: data collected by the relevant sensors on the mobile platform during the movement of the mobile platform.
  • the movement-related data of the mobile platform includes but is not limited to: movement speed, movement direction, and mobile environment data packets.
  • the mobile environment data package can describe the surrounding environment of the mobile platform during the current movement.
  • the remote controller of the mobile platform can perform remote control operations on the fourth terminal.
  • the fourth terminal includes: a joystick.
  • the remote control operation performed by the remote control of the mobile platform on the fourth terminal may be the operation of the joystick by the remote control of the mobile platform.
  • the first terminal is configured to perform the following operations in each control instruction transmission time slot associated with the first terminal: to the first terminal through the communication connection between the fourth terminal corresponding to the first terminal A fourth terminal corresponding to a terminal sends a collection instruction corresponding to a control instruction to trigger the fourth terminal corresponding to the first terminal to collect a control instruction; through the communication connection between the fourth terminal corresponding to the first terminal The fourth terminal receives the control instruction, and sends the control instruction collected by the fourth terminal corresponding to the first terminal to the mobile platform through the communication connection with the mobile platform.
  • a time slot can be understood as a time period.
  • the control command transmission time slot may be a time slot used to send the control command to the mobile platform.
  • each control instruction transmission time slot associated with the first terminal may be: each control instruction transmission time in a remote control process in which the first terminal is used to remotely control the mobile platform Gap.
  • a first terminal is used to remotely control the mobile platform, that is, in the current remote control process, the first terminal is used to send the control instruction of the fourth terminal corresponding to the first terminal to the mobile platform to move The platform is remotely controlled.
  • Each control instruction transmission time slot in the current remote control process is each control instruction transmission time slot associated with the first terminal.
  • the duration of the control command transmission time slot is much shorter than the duration of the remote control operation that can generate the control command performed by the remote controller of the mobile platform on the fourth terminal.
  • the time length of the control command transmission time slot can be set to the millisecond level.
  • the time length of the control command transmission time slot is 5 ms
  • the remote control operation performed by the remote controller of the mobile platform on the fourth terminal corresponding to the first terminal is the shortest It is also a few seconds, that is, the operation time period of the remote control operation performed by the remote controller of the mobile platform on the fourth terminal corresponding to the first terminal is also a few seconds at the shortest.
  • the operation period of the remote control operation performed by the remote controller of the mobile platform on the fourth terminal corresponding to the first terminal includes: multiple control instruction transmission time slots.
  • Each control instruction transmission time slot of the plurality of control instruction transmission time slots is each control instruction transmission time slot associated with the first terminal.
  • the remote controller of the mobile platform performs a remote control operation on the fourth terminal corresponding to the first terminal.
  • the first terminal will trigger each control instruction transmission time slot associated with the first terminal during the operation period of the remote control operation.
  • the fourth terminal corresponding to the first terminal collects control instructions, and in each control instruction transmission time slot associated with the first terminal, the fourth terminal corresponding to the first terminal receives the control collected by the fourth terminal corresponding to the first terminal.
  • the instruction and the fourth terminal corresponding to the first terminal are sent to the mobile platform.
  • the first terminal completes the triggering of the fourth terminal corresponding to the first terminal to collect the control command and receives the first terminal from the fourth terminal corresponding to the first terminal within each control command transmission time slot associated with the first terminal. Operations such as the control instructions collected by the fourth terminal corresponding to the terminal, sending the fourth terminal corresponding to the first terminal to the mobile platform, etc.
  • the control command is transmitted to the mobile platform with an ultra-low delay, and the remote controller of the mobile platform remotely controls the mobile platform with an ultra-low delay.
  • the mobile-related data of the mobile platform includes: image data of the first-person main perspective collected by the mobile platform.
  • the first terminal may receive the image data of the first-person main perspective and play the image data of the first-person main perspective.
  • the remote controller of the mobile platform can remotely control the mobile platform according to the image data of the first-person main perspective, so as to remotely control the mobile platform from the perspective of the mobile platform.
  • each first terminal is a glasses device. There is a communication connection between the glasses device and the mobile platform. There is a communication connection between the glasses device and the fourth terminal.
  • the glasses device can receive mobile associated data from the mobile platform through the communication connection between the mobile platforms and display the received mobile associated data.
  • the glasses device receives control instructions from the fourth terminal through the communication connection between the fourth terminals and sends the control instructions to the mobile platform through the communication connection between the mobile platforms.
  • the remote control of the mobile platform wears the glasses device
  • the remote control of the mobile platform can understand the movement of the mobile platform according to the movement related data displayed by the glasses device.
  • the remote controller of the mobile platform can perform a remote control operation on the fourth terminal corresponding to the glasses device, and the fourth terminal sends the control instructions generated based on the remote control operation of the remote controller to the glasses device through the communication connection with the glasses device.
  • the glasses device sends the control instruction to the mobile platform through the communication connection with the mobile platform.
  • the mobile platform is remotely controlled.
  • each first terminal corresponds to a fourth terminal
  • the fourth terminal corresponding to each first terminal is different from the fourth terminal corresponding to other first terminals.
  • Figure 1c shows a schematic structural diagram of a mobile platform control system provided by an embodiment of the present application.
  • a first terminal a mobile platform, and a fourth terminal are shown.
  • the first terminal corresponds to a fourth terminal.
  • the communication connection 101 between the first terminal and the mobile platform may be a communication connection defined in a wireless communication technology dedicated to communication with the mobile platform.
  • the communication connection 102 between the first terminal and the fourth terminal may be a wired communication connection.
  • the first terminal communicates with the fourth terminal through USB technology.
  • the communication connection between the first terminal and the fourth terminal is a USB connection defined in the USB technology.
  • the first terminal is a glasses device.
  • the remote control of the mobile platform wears the glasses device.
  • the mobile platform collects image data from the first-person main perspective through the data packet sensor of the mobile platform during the movement.
  • the glasses device receives the image data of the first-person main view from the mobile platform through the communication connection 101 and plays the image data of the first-person main view.
  • the remote controller of the mobile platform plays the image data of the first person main perspective through the glasses device.
  • the remote controller of the mobile platform performs remote control operations on the fourth terminal.
  • the fourth terminal sends the control instruction generated based on the remote control operation of the remote controller of the mobile platform to the first glasses device through the communication connection 102.
  • the glasses device sends a control instruction to the mobile platform through the communication connection 101 to remotely control the mobile platform.
  • FIG. 1d shows another structural schematic diagram of a mobile platform control system provided by an embodiment of the present application.
  • FIG. 1d the first terminal 1, the fourth terminal 1, the mobile platform, the first terminal 2, and the fourth terminal 2 are shown.
  • Each first terminal corresponds to a fourth terminal, and the fourth terminal corresponding to each first terminal is different from the fourth terminal corresponding to other first terminals.
  • the first terminal 1 corresponds to the fourth terminal 1
  • the first terminal 2 corresponds to the fourth terminal 2.
  • the fourth terminal 1 and the fourth terminal 2 both include a processor, a memory, and a remote control component that can be operated by a remote controller of the mobile platform.
  • the remote control components may include but are not limited to: joysticks and buttons.
  • the first terminal 1 and the first terminal 2 each include a processor, a memory, and a display screen.
  • the first terminal 1 is configured to: receive the mobile associated data of the mobile platform from the mobile platform through the communication connection 201 and display the mobile associated data; receive from the fourth terminal 1 through the communication connection 202 generated by the remote control operation on the fourth terminal 1
  • the control instruction and the control instruction generated by the remote control operation on the fourth terminal 1 are sent to the mobile platform through the communication connection 201.
  • the first terminal 2 is configured to: receive the mobile associated data of the mobile platform from the mobile platform through the communication connection 203 and display the mobile associated data; receive from the fourth terminal 2 through the communication connection 204 generated by remote control operation on the fourth terminal 2 The control instruction and the control instruction generated by the remote control operation on the fourth terminal 2 are sent to the mobile platform through the communication connection 203.
  • the fourth terminal 1 and the fourth terminal 2 can take turns to remotely control the mobile platform.
  • the control command of any fourth terminal does not need to be forwarded to the mobile platform through other fourth terminals, reducing the transmission delay of the control command, and the fourth terminal
  • There is no need to establish a communication connection between 1 and the fourth terminal 2 and accordingly, there is no need to connect the fourth terminal 1 and the fourth terminal 2 through a transmission line, which reduces the complexity of the remote controller using the fourth terminal.
  • the fourth terminal 1 is used by a trainer who demonstrates the remote control method of the mobile platform, and the fourth terminal 2 is used by students who learn the remote control method of the mobile platform.
  • the instructor and the student remote control the mobile platform in turn can be called the coaching mode.
  • the control commands generated by the remote control operation on the fourth terminal 1 do not need to be forwarded to the mobile platform through the fourth terminal 2, and the control commands generated by the remote control operation on the fourth terminal 2 do not need to go through the fourth terminal 1. Forward to the mobile platform, thereby reducing the transmission delay of control commands.
  • the first terminal 1 is a first glasses device
  • the first terminal 2 is a second glasses device.
  • the instructor wears the first glasses device, and the students wear the second glasses device.
  • the instructor uses the first glasses device and the fourth terminal 1 to remotely control the mobile platform, and the student uses the second glasses device and the fourth terminal 2 to remotely control the mobile platform.
  • the mobile platform collects image data from the first-person main perspective through the data packet sensor of the mobile platform during the movement.
  • the first glasses device receives the image data of the first-person main view from the mobile platform through the communication connection 201 and plays the image data of the first-person main view.
  • the second glasses device receives the image data of the first-person main view from the mobile platform through the communication connection 203 and plays the image data of the first-person main view.
  • the instructor uses the first glasses device and the fourth terminal 1 to remotely control the mobile platform to demonstrate the remote control method of the mobile platform to the students.
  • the coach can play the image data of the first-person main perspective through the wearing of the first glasses device.
  • the coach performs remote control operations on the fourth terminal 1.
  • the fourth terminal 1 sends the control instruction generated based on the coach's remote control operation to the first glasses device through the communication connection 202.
  • the first glasses device sends a control instruction to the mobile platform through the communication connection 201 to remotely control the mobile platform.
  • the students can use the image data of the first-person main perspective displayed by the second glasses device to understand the movement of the mobile platform. process. Then, the student can use the second glasses device and the fourth terminal 2 to remotely control the mobile platform to learn the remote control method of the mobile platform demonstrated by the coach.
  • the students perform remote control operations on the fourth terminal 2.
  • the fourth terminal 2 sends the control instruction generated based on the remote control operation of the student to the second glasses device through the communication connection 204.
  • the second glasses device sends a control instruction generated based on the student's remote control operation to the mobile platform through the communication connection 203 to remotely control the mobile platform.
  • the network architecture can be used in scenes such as live events or video production in a traversing machine competition.
  • the following describes the application of the network architecture in a scene of a live competition in a traversing machine competition as an example.
  • the mobile platform 10 can be used for a traversing machine competition, that is, the mobile platform 10 can be a traversing machine.
  • the pilot that is, the contestant
  • the mobile platform 10 can transmit the data packet including the image data through the digital image transmission transceiver 102 Send to the first terminal 20.
  • the first terminal 20 can receive a data packet from the mobile platform 10 through the digital image transmission transceiver 201, and after receiving the data packet, the data packet can be sent to the second terminal 30.
  • the second terminal 30 can receive the data packet from the first terminal 20, and after receiving the data packet, can send the data packet to the playback device. After the playback device receives the data packet from the second terminal 30, it can play the image data in the data packet.
  • the mobile platform 10 transmits data packets through a digital image transmission transceiver, which can improve the transmission quality of image data and increase the distance of data packet transmission.
  • the image data can be broadcast live, so that viewers can understand the movement of the mobile platform in real time through the image data.
  • Figure 2 is a schematic flowchart of a data processing method provided by an embodiment of the present application. The method can be applied to the data processing system of Figure 1a. As shown in Figure 2, the data processing method may include the following steps .
  • S201 The mobile platform sends a data packet including image data to the first terminal through the digital communication link.
  • the mobile platform can obtain image data by shooting with a shooting device.
  • the pilot may send a shooting instruction to the mobile platform through the fourth terminal, and after receiving the shooting instruction, the mobile platform may control the shooting device to shoot to obtain image data.
  • the mobile platform After the mobile platform captures the image data, it can send the data packet including the image data to the first terminal through the digital communication link, that is, the mobile platform can send the data packet including the image data to the first terminal through the digital image transmission transceiver .
  • the digital communication link means that the sending end (such as a mobile platform) encodes and modulates the data packet to obtain the processed data packet (that is, the processed data packet is a digital signal), and then sends the processed data packet To the receiving end (such as the first terminal).
  • the data packet can be obtained based on the image data of the first-person main perspective, so that pilots or viewers can understand the movement of the mobile platform in real time through the image data.
  • the mobile platform may use a digital communication link to send a data packet including the at least one frame of image to the first terminal every time at least one frame of image is obtained, that is, the data packet includes one frame or Multi-frame images.
  • the above-mentioned mobile platform sending a data packet including image data to the first terminal through the digital communication link may specifically include: in the current data transmission period, the mobile platform sends continuous data to the first terminal through the digital communication link package.
  • the continuous data packet includes image data, that is, the continuous data packet includes image data continuously captured by the camera of the mobile platform.
  • the above-mentioned shooting device further includes a video recording function, that is, the mobile platform can perform video recording through the shooting device, and the mobile platform does not need to carry an additional video recording device, which can improve the convenience and quality of video recording.
  • the image data recorded by the camera can be sent to the terminal, and the terminal can play the recorded image data.
  • the photographing device may refer to a high-resolution photographing device, that is, the resolution of image data captured by the photographing device is greater than a preset resolution threshold.
  • the preset resolution threshold may be determined by the shooting performance of the shooting device.
  • the preset resolution threshold may be 720p*120fps, p means that the scanning format of the image data is progressive scanning, and 720p is a display format in which the image data reaches a resolution of 1280 ⁇ 720 under progressive scanning.
  • fps refers to the number of frames transmitted per second of image data, that is, 120fps means that image data is transmitted 120 frames per second.
  • the preset resolution threshold may also be greater than 720p*120fps, which is not limited in this embodiment of the application.
  • the first terminal may receive a data packet from the mobile platform, and after receiving the data packet, the data packet may be sent to the second terminal. That is, the first terminal can receive the data packet sent by the mobile platform through the digital image transmission transceiver, and send the data packet to the second terminal. Specifically, the first terminal may send the data packet to the second terminal through a wired communication connection or a wireless communication connection. Optionally, after receiving the data packet, the first terminal can play the image data in the data packet so that the pilot can understand the movement of the mobile platform in real time.
  • step S202 includes: if the data packet is received from the mobile platform and the data packet is successfully decoded, the first terminal may send the data packet to the second terminal through the digital communication link.
  • the data packet is received from the mobile platform and the data packet is successfully decoded, it indicates that no abnormality occurs during the process of encoding the data packet by the mobile platform or the process of transmitting the data packet by the mobile platform, then the first terminal The data packet can be sent to the second terminal through a digital communication link. In this way, invalid data packet transmission can be avoided and the utilization of bandwidth resources can be improved.
  • the mobile platform establishes a point-to-point digital communication connection with the first terminal.
  • the mobile platform may send a data packet including image data to the first terminal through the point-to-point digital communication connection.
  • the first terminal specifically receives the data packet from the mobile platform through the point-to-point digital communication connection.
  • the mobile platform may receive a point-to-point digital communication connection request sent by the first terminal, and establish a point-to-point digital communication connection with the first terminal according to the connection request.
  • a point-to-point digital communication connection may refer to a communication connection that transmits information through a digital communication link
  • the point-to-point digital communication connection may refer to an exclusive communication connection between the mobile platform and the first terminal, that is, only the mobile platform and the first terminal You can receive and send messages through this dedicated communication connection.
  • the point-to-point digital communication connection may specifically refer to a communication connection based on a communication protocol such as Wireless Fidelity (Wi-Fi) or Bluetooth.
  • the second terminal may receive the data packet from the first terminal, and after receiving the data packet, the data packet may be sent to the playback device so that the playback device can play the image data in the data packet.
  • the first terminal may send the data packet to the second terminal through a wired communication connection.
  • the second terminal can receive the data packet sent by the first terminal through the wired communication connection.
  • the wired communication connection may refer to a communication connection based on Universal Serial Bus (Universal Serial Bus, USB) or an asynchronous transmission standard interface protocol RS232.
  • the first terminal may encrypt the data packet to obtain an encrypted data packet, and send the encrypted data packet to the second terminal through the wired communication connection.
  • the second terminal can receive the encrypted data packet sent by the first terminal through the wired communication connection.
  • the first terminal may use a preset encryption method to encrypt the data packet to obtain an encrypted data packet.
  • the preset encryption method may include at least one of Message Digest Algorithm Version 5 (MD5), Data Encryption Standard (DES), Digital Signature Algorithm (DSA), etc., or It may be other encryption methods, which are not limited in the embodiment of this application.
  • the first terminal may send the encrypted data packet to the second terminal through the wired communication connection.
  • the second terminal can receive the encrypted data packet sent by the first terminal through the wired communication connection.
  • the second terminal may decrypt the encrypted data packet to obtain the decrypted data packet, and then transfer the decrypted data The packet is sent to the playback device.
  • the second terminal may directly send the encrypted data packet to the playback device .
  • the playback device After receiving the data packet from the second terminal, the playback device plays according to the data packet.
  • the playback device may receive the data packet from the second terminal. After receiving the data packet, the image data in the data packet can be played, so that the audience can understand the movement of the mobile platform in real time. Specifically, if the data packet received by the playback device is an encrypted data packet, the playback device can decrypt the encrypted data packet to obtain the decrypted data packet, and play the image in the decrypted data packet data. If the data packet received by the playback device is an unencrypted data packet, the playback device can directly play the image data in the data packet.
  • the playback device can broadcast the image data in the data packet, that is, every time the playback device receives a frame of image, it can play the frame of image.
  • the mobile platform may send the data packet to the third terminal through a digital communication link.
  • the third terminal may be an audience terminal.
  • the third terminal can receive the data packet sent by the mobile platform through the digital communication link. After the third terminal receives the data packet, it can play the image data in the data packet so that the viewer can understand the movement of the mobile platform in real time through the third terminal.
  • the mobile platform may broadcast the data packet to the third terminal through a digital communication link.
  • the third terminal can receive the data packet broadcast by the mobile platform through the digital communication link. In this way, the third terminal does not occupy uplink bandwidth resources, and the mobile platform can transmit data packets to more third terminals, which can improve the utilization rate of bandwidth resources.
  • the above-mentioned mobile platform sending the data packet to the third terminal via the digital communication link may specifically include: in the current data transmission period, the mobile platform sending continuous data packets to the third terminal via the digital communication link.
  • the above-mentioned mobile platform broadcasts the data packet to the third terminal through the digital communication link may specifically refer to: in the current data transmission period, the mobile platform broadcasts continuous data packets to the third terminal through the digital communication link. terminal.
  • the consecutive data packets here include image data.
  • the third terminal when the third terminal does not receive the data packet from the mobile platform, the third terminal does not send third response information to the mobile platform, and the third response information is used to instruct the third terminal to receive the data packet from the mobile platform.
  • the mobile platform did not receive the data packet. That is, the third terminal does not need to send the third response information to the mobile platform, so that the third terminal does not occupy uplink bandwidth resources, and the mobile platform can transmit data packets to more third terminals, which can improve the utilization of bandwidth resources.
  • the third terminal when the third terminal receives the data packet from the mobile platform and fails to decode the data packet, the third terminal does not send the fourth response information to the mobile platform, and the fourth response information It is used to indicate that the third terminal fails to decode the data packet. That is, the third terminal does not need to send the fourth response information to the mobile platform, so that the third terminal does not occupy uplink bandwidth resources, and the mobile platform can transmit data packets to more third terminals, which can improve the utilization of bandwidth resources.
  • the fourth terminal may receive the control instruction input by the user, and send the control instruction to the mobile platform through the digital communication link in the control instruction transmission time slot.
  • the mobile platform can receive the control instruction sent by the fourth terminal through the digital communication link, and after the mobile platform receives the control instruction sent by the fourth terminal, the control instruction can be executed.
  • the control instruction can refer to other instructions such as flight control instructions or video shooting instructions.
  • the user can input the control instructions in the fourth terminal through touch, voice, etc., and the fourth terminal can receive the control instructions input by the user.
  • the fourth terminal can send the control command to the mobile platform through the digital communication link in the control command transmission time slot, which can reduce the transmission time delay of the control command and realize full synchronization between the mobile platform and the fourth terminal .
  • the control command transmission time slot may be set by the fourth terminal or manually set by the user. For example, the control command transmission time slot may be 5 ms. If the fourth terminal receives the control command input by the user in the first ms, the fourth terminal may send the control command to the mobile platform through the digital communication link in the 6 ms.
  • the mobile platform can receive the control instruction from the fourth terminal, and execute the control instruction after receiving the control instruction.
  • the control command transmission time slot refer to the explanation of the control command transmission time slot in FIG. 1c.
  • the fourth terminal may send the control instruction to the first terminal through the digital communication link, and the first terminal receives the control instruction from the fourth terminal, and after receiving the control instruction, sends the control instruction to the mobile platform .
  • the mobile platform can receive the control instruction from the first terminal, and execute the control instruction after receiving the control instruction.
  • the mobile platform can send a data packet including image data to the first terminal through the digital communication link.
  • the first terminal can send the data packet to the second terminal. terminal.
  • the mobile platform transmits data packets through the digital communication link, which can improve the transmission quality of image data and increase the transmission distance of image data.
  • the second terminal can transmit the data packet to the playback device, and the playback device can play the image data in the data packet, which can realize the live broadcast of the image data, so that the viewer can understand the movement of the mobile platform in real time through the image data.
  • FIG. 3 is a schematic flowchart of another data processing method provided by an embodiment of the present application. This method can be applied to the data processing system of FIG. 1a. As shown in FIG. 3, the data processing method may include the following step.
  • the mobile platform sends a data packet including image data to the first terminal through the digital communication link.
  • the first terminal can receive a data packet from the mobile platform. If the first terminal receives the data packet, step S302 is executed; if the first terminal does not receive the data packet, steps S303 to S304 are executed.
  • step S301 please refer to the explanation of step S201 in FIG. 2 above, and the explanation of step S302 may refer to the explanation of step S202 in FIG. .
  • the first terminal may send first response information to the mobile platform through the digital communication link, and the first response information is used to instruct the first terminal to send the data from the mobile platform. The packet was not received.
  • the mobile platform If the mobile platform encounters a network abnormality during the transmission of the data packet, it will cause the first terminal to fail to receive the data packet from the mobile platform. Therefore, if the first terminal does not receive the data packet from the mobile platform, it can send the first response information to the mobile platform through the digital communication link, so that the mobile platform can retransmit the data packet, which can improve the reliability of data packet transmission.
  • the first terminal may send a piece of first response information to the mobile platform for each unreceived data packet among all the data packets through the digital communication link.
  • the first terminal may send a piece of response information to the mobile platform for each of all data packets through the digital communication link, and the response information may include ACK or NAK, where NAK may refer to the first response information.
  • NAK may refer to the first response information.
  • the mobile platform may resend the data packet to the first terminal through the digital communication link. Specifically, the mobile platform may receive the first response information sent by the first terminal through the digital communication link, and after receiving the first response information, it may determine according to the first response information that the first terminal has not received the data packet. The data packet can be re-sent to the first terminal through the digital communication link to improve the reliability of data packet transmission. Correspondingly, if the first terminal does not receive the re-sent data packet from the mobile platform, steps S303 and S304 are executed cyclically. Until the first terminal receives the re-sent data packet from the mobile platform and successfully decodes the re-sent data packet, step S302 is executed.
  • the mobile platform may re-send the data packet including all image data to the first terminal through the digital communication link, or the mobile platform may determine the target according to the first response information of the first terminal Data packet, the target data packet is re-sent to the first terminal through the digital communication link, that is, the mobile platform re-sends the target data packet to the first terminal through the digital communication link in the redundant time slot of the current data transmission cycle.
  • the method for determining the target data packet can refer to the description of the method for determining the target data packet in FIG. 1a, which is not repeated here.
  • the mobile platform may re-send the data packet including all image data to the first terminal and the third terminal through the digital communication link.
  • the mobile platform can determine the target data packet according to the first response information of the first terminal, and re-send the target data packet to the first terminal and the third terminal through the digital communication link, that is, the mobile platform's redundancy in the current data transmission cycle In the time slot, the target data packet is re-transmitted to the first terminal and the third terminal through the digital communication link.
  • the method for determining the target data packet can refer to the description of the method for determining the target data packet in FIG. 1a, which is not repeated here.
  • the second terminal After receiving the data packet from the first terminal, the second terminal sends the data packet to the playback device.
  • the playback device After receiving the data packet from the second terminal, the playback device plays according to the data packet.
  • step S305 can refer to the explanation of step S203 in FIG. 2 above
  • step S306 can refer to the explanation of step S204 in FIG. 2 above, and the repetition will not be repeated here. .
  • the mobile platform can send a data packet including image data to the first terminal through the digital communication link. If the first terminal does not receive the data packet from the mobile platform, it can send a first response to the mobile platform information. After the mobile platform receives the first response information, it can resend the data packet to the first terminal through the digital communication link, which can improve the reliability of data packet transmission and the transmission quality of image data. After the first terminal receives the data packet from the mobile platform and successfully decodes the data packet, it can send the data packet to the second terminal. Further, the second terminal can transmit the data packet to the playback device, the playback device can play the image data in the data packet, and can realize the live broadcast of the image data, so that the viewer can understand the movement of the mobile platform in real time through the image data.
  • FIG. 4 is a schematic flowchart of another data processing method provided by an embodiment of the present application.
  • the method can be applied to the data processing system of FIG. 1a.
  • the data processing method may include the following step.
  • S401 The mobile platform sends a data packet including image data to the first terminal through the digital communication link.
  • the first terminal can receive a data packet from the mobile platform, and after receiving the data packet, can decode the data packet. If the decoding is successful, perform step S402; if the decoding fails, perform steps S403 to S404.
  • Successful decoding means that the first terminal decodes the received data packet to obtain a complete data packet, and no abnormalities such as garbled codes occur during the decoding process.
  • Decoding failure means that the first terminal cannot obtain a complete data packet by decoding the received data packet, or abnormal conditions such as garbled codes occur during the decoding process.
  • step S401 please refer to the explanation of step S201 in Figure 2 above, and the explanation of step S402 can refer to the explanation of step S202 in Figure 2 above, and the repetition will not be repeated. .
  • the first terminal may send second response information to the mobile platform through the digital communication link, and the second response information is used to indicate the The first terminal failed to decode the data packet.
  • the first terminal fails to decode the data packet, it indicates that the mobile platform is in the process of encoding the data packet or the mobile platform is experiencing an abnormal situation in the process of transmitting the data packet. At this time, if the data packet is sent to the second terminal, the second terminal cannot successfully decode the data packet, and a lot of bandwidth resources are wasted. Therefore, if the data packet is received from the mobile platform and the decoding of the data packet fails, the first terminal can send the second response message to the mobile platform through the digital communication link, so that the mobile platform can retransmit the data packet . It can prevent the first terminal from transmitting invalid data packets to the second terminal, can improve the utilization rate of bandwidth resources, and improve the reliability of data packet transmission.
  • the first terminal may send a piece of second response information to the mobile platform for each data packet that fails to decode in all data packets through the digital communication link.
  • the first terminal may send a piece of response information to the mobile platform for each of all data packets through the digital communication link, and the response information may include ACK or NAK, where NAK may refer to second response information.
  • NAK may refer to second response information.
  • the mobile platform may resend the data packet to the first terminal through the digital communication link. Specifically, the mobile platform may receive the second response information sent by the first terminal through the digital communication link. After receiving the second response information, it can be determined according to the second response information that the first terminal has failed to decode the data packet, and the video can be re-sent to the first terminal through the digital communication link to improve the reliability of data packet transmission . Correspondingly, the first terminal can receive the data packet retransmitted by the mobile platform through the digital communication link.
  • the first terminal may decode the retransmitted data packet, and if the first terminal fails to decode the retransmitted data packet, steps S403 to S404 are executed cyclically. Until the first terminal successfully decodes the retransmitted data packet, step S402 is executed.
  • the mobile platform can resend a data packet including all image data to the first terminal through the digital communication link, or the mobile platform can determine the target data according to the second response information of the first terminal Packet, the target data packet is re-sent to the first terminal through the digital communication link, that is, the mobile platform re-sends the target data packet to the first terminal through the digital communication link in the redundant time slot of the current data transmission cycle.
  • the method for determining the target data packet can refer to the description of the method for determining the target data packet in FIG. 1a, which is not repeated here.
  • the mobile platform may re-send data packets including all image data to the first terminal and the third terminal through the digital communication link.
  • the mobile platform can determine the target data packet according to the second response information of the first terminal, and re-send the target data packet to the first terminal and the third terminal through the digital communication link, that is, the mobile platform's redundancy in the current data transmission cycle In the time slot, the target data packet is re-transmitted to the first terminal and the third terminal through the digital communication link.
  • the method for determining the target data packet can refer to the description of the method for determining the target data packet in FIG. 1a, which is not repeated here.
  • the second terminal After receiving the data packet from the first terminal, the second terminal sends the data packet to the playback device.
  • the playback device After receiving the data packet from the second terminal, the playback device plays according to the data packet.
  • step S405 for the explanation of step S405, please refer to the explanation of step S203 in FIG. 2 above, and the explanation of step S406 may refer to the explanation of step S204 in FIG. .
  • the mobile platform can send a data packet including image data to the first terminal through the digital communication link. If the first terminal receives the data packet from the mobile platform and fails to decode the data packet, it can The mobile platform sends the second response message. After receiving the second response information, the mobile platform can resend the data packet to the first terminal through the digital communication link, which can improve the reliability of data packet transmission and improve the transmission quality of image data. After the first terminal receives the data packet from the mobile platform and successfully decodes the data packet, it can send the data packet to the second terminal. Further, the second terminal can transmit the data packet to the playback device, and the playback device can play the image data in the data packet, which can realize the live broadcast of the image data, so that the viewer can understand the movement of the mobile platform in real time through the image data.
  • FIG. 5 is a schematic structural diagram of a mobile platform provided by an embodiment of the present invention.
  • the mobile platform includes: a memory 501, a processor 502, a camera 503, a digital image transmission transceiver 504, and a mobile device 505 .
  • the memory 501 may include a volatile memory (volatile memory); the memory 501 may also include a non-volatile memory (non-volatile memory); the memory 501 may also include a combination of the foregoing types of memories.
  • the processor 502 may be a central processing unit (CPU).
  • the processor 502 may further include a hardware chip.
  • the aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
  • the foregoing PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
  • the photographing device 503 is used for photographing to obtain image data.
  • the photographing device 503 is also used for video recording.
  • the digital image transmission transceiver 504 is used to send and receive information.
  • the digital image transmission transceiver 504 is used to send a data packet including image data to the first terminal, and is used to receive the first response information or the second response information sent by the first terminal.
  • the mobile device 505 is used to control the movement of the mobile platform.
  • the memory is used to store program instructions; the processor calls the program instructions stored in the memory to perform the following steps:
  • the data packet including image data is sent to the first terminal through the digital communication link, so that the first terminal sends the data packet to the second terminal, and the second terminal sends the data packet to the player Device, and the playback device performs playback according to the data packet.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • a point-to-point digital communication connection is established with the first terminal; a data packet including image data is sent to the first terminal through the point-to-point digital communication connection.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the resolution of the image data in the data packet is greater than a preset resolution threshold.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the data packet is sent to the third terminal through the digital communication link.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the mobile platform may send a data packet including image data to the first terminal through the digital communication link, so that the first terminal sends the data packet to the second terminal, and the second terminal transmits the data packet to the second terminal.
  • the data packet is sent to a playback device, and the playback device plays the data packet according to the data packet.
  • the mobile platform transmits data packets through the digital communication link, which can improve the transmission quality of image data.
  • FIG. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • the terminal is the first terminal in FIG. 1a.
  • the terminal includes: a memory 601, a processor 602, and a digital Video transmission transceiver 603 and playback device 604.
  • the memory 601 may include a volatile memory (volatile memory); the memory 601 may also include a non-volatile memory (non-volatile memory); the memory 601 may also include a combination of the foregoing types of memories.
  • the processor 602 may be a central processing unit (CPU).
  • the processor 602 may further include a hardware chip.
  • the aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
  • the foregoing PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
  • the digital image transmission transceiver 603 is used to send and receive information.
  • the digital image transmission transceiver 603 is used to receive a data packet including image data sent by a mobile platform, and is used to send and receive data packets from the mobile platform to the first terminal.
  • a response message is sent to the mobile platform.
  • the response information includes first response information or second response information.
  • the playing device 604 is used for playing the image data in the data packet.
  • the memory is used to store program instructions; the processor calls the program instructions stored in the memory to perform the following steps:
  • the data packet After receiving the data packet from the mobile platform, the data packet is sent to the second terminal, so that the second terminal sends the data packet to the playback device, and the playback device according to the data Package to play.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the data packet is sent to the second terminal.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the first response information is sent to the mobile platform through the digital communication link, and the first response information is used to instruct the first terminal to access the mobile platform from the mobile platform.
  • the data packet is not received; the data packet that the mobile platform resends through the digital communication link after receiving the response information is received.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the second response information is sent to the mobile platform through the digital communication link, and the second response information is used to indicate the The first terminal fails to decode the data packet; receiving the data packet retransmitted by the mobile platform through the digital communication link after receiving the first response information.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the data packet is sent to the second terminal through a wired communication connection.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • Encrypting the data packet to obtain an encrypted data packet sending the encrypted data packet to the second terminal through the wired communication connection.
  • the first terminal may receive the data packet sent by the mobile platform through the digital communication link. After receiving the data packet from the mobile platform, the data packet is sent to the second terminal, so that the second terminal sends the data packet to the playback device, and the playback device plays the image data in the data packet.
  • the first terminal receives the data packet transmitted by the mobile platform through the digital communication link, which can improve the transmission quality of the image data.
  • FIG. 7 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • the terminal is the second terminal in FIG. 1a.
  • the terminal includes a memory 701 and a processor 702.
  • the memory 701 may include a volatile memory (volatile memory); the memory 701 may also include a non-volatile memory (non-volatile memory); the memory 701 may also include a combination of the foregoing types of memories.
  • the processor 702 may be a central processing unit (CPU).
  • the processor 702 may further include a hardware chip.
  • the aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
  • the foregoing PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
  • the memory is used to store program instructions; the processor calls the program instructions stored in the memory to perform the following steps:
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the second terminal may receive the data packet sent by the first terminal, and send the data packet to the playback device, so that the playback device can play the image data in the data packet.
  • the data packet is sent to the playback device through the second terminal, so that the playback device can play the image data in the data packet, so that the image data can be broadcast live.
  • FIG. 8 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • the terminal is the third terminal in FIG. 1a.
  • the terminal includes a memory 801, a processor 802, and a digital map.
  • the memory 801 may include a volatile memory (volatile memory); the memory 801 may also include a non-volatile memory (non-volatile memory); the memory 801 may also include a combination of the foregoing types of memories.
  • the processor 802 may be a central processing unit (CPU).
  • the processor 802 may further include a hardware chip.
  • the aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
  • the foregoing PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
  • the digital image transmission transceiver 803 is used to receive data packets sent by the mobile platform.
  • the playing device 804 is configured to play according to the data packet.
  • the memory is used to store program instructions; the processor calls the program instructions stored in the memory to perform the following steps:
  • the third terminal does not send fourth response information to the mobile platform, and the fourth response information is used to instruct the third terminal to respond to the data packet Decoding failed.
  • the processor invokes the program instructions stored in the memory to perform the following steps:
  • the third terminal can receive the data packet sent by the mobile platform through the digital communication link, so that the third terminal can play the image data in the data packet, and the viewer can understand the movement of the mobile platform in real time through the image data.
  • the third terminal does not need to send response information to the mobile platform, that is, the third terminal does not occupy uplink bandwidth resources, so that the mobile platform can transmit data packets to more third terminals, which can improve the utilization of bandwidth resources.
  • FIG. 9 is a schematic structural diagram of a terminal provided by an embodiment of the present invention.
  • the terminal is the fourth terminal in FIG. 1a.
  • the terminal includes a memory 901, a processor 902, and a digital airplane. Control the command transmitter 903 and the interactive device 904.
  • the memory 901 may include a volatile memory (volatile memory); the memory 901 may also include a non-volatile memory (non-volatile memory); the memory 901 may also include a combination of the foregoing types of memories.
  • the processor 902 may be a central processing unit (CPU).
  • the processor 902 may further include a hardware chip.
  • the aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
  • the foregoing PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
  • the interaction device 904 is configured to receive a control instruction input by a user.
  • the digital flight control command transmitter 903 is used to send the control instruction to the mobile platform.
  • the memory is used to store program instructions; the processor calls the program instructions stored in the memory to perform the following steps: receiving control instructions input by the user; in the control instruction transmission time slot, through The digital communication link sends the control instruction to the mobile platform, so that the mobile platform executes the control instruction.
  • the fourth terminal sends a control instruction to the mobile platform through a digital communication link, which can reduce the transmission delay of the control instruction, and can achieve full synchronization between the mobile platform and the fourth terminal.
  • a computer-readable storage medium is also provided, and the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the embodiment of the present invention corresponding to FIGS. 2 to 4 is implemented.
  • the data processing method described in FIG. 5 can also implement the mobile platform of the invention embodiment described in FIG. 5 and the terminal of the invention embodiment described in FIG. 6 to FIG.
  • the computer-readable storage medium may be the internal storage unit of the mobile platform or terminal described in any of the foregoing embodiments, such as the hard disk or memory of the device.
  • the computer-readable storage medium may also be an external storage device of the vehicle control device, for example, a plug-in hard disk equipped on the device, a smart memory card (Smart Media Card, SMC), and a Secure Digital (SD) ) Card, Flash Card, etc.
  • the computer-readable storage medium may also include both an internal storage unit of the device and an external storage device.
  • the computer-readable storage medium is used to store the computer program and other programs and data required by the mobile platform or terminal.
  • the computer-readable storage medium can also be used to temporarily store data that has been output or will be output.
  • the program can be stored in a computer readable storage medium.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

Abstract

本发明实施例提供了一种数据处理方法、系统、移动平台、终端及存储介质,其中,方法包括:所述移动平台通过数字通信链路将包括图像数据的数据包发送至所述第一终端,所述第一终端将所述数据包发送至所述第二终端,所述第二终端从所述第一终端接收到所述数据包之后,将所述数据包发送至所述播放设备,所述播放设备从所述第二终端接收到所述数据包之后,根据所述数据包进行播放。通过本发明实施例,能够提高图像数据的传输质量,并能够实现对图像数据进行直播。

Description

数据处理方法、系统、移动平台、终端及存储介质 技术领域
本发明涉及智能控制领域,尤其涉及一种数据处理方法、系统、移动平台、终端及存储介质。
背景技术
穿越机具有飞行速度快、飞行灵活度高及不受姿态限制等特点,被广泛应用于穿越机赛事及视频制作等领域。例如,在穿越机竞赛中,参赛的穿越机可以拍摄第一人称主视角(First Person View,FPV)的图像数据,并将该图像数据发送至飞手或观众的眼镜设备,眼镜设备可以播放图像数据以便飞手或观众能够了解穿越机的飞行情况。但是,现有技术中由于图像数据的传输质量较差,导致不能对图像数据进行直播。
发明内容
本发明实施例提供了一种数据处理方法、系统、移动平台、设备及存储介质,可提高图像数据的传输质量,能够实现对图像数据进行直播。
第一方面,本发明实施例提供了一种数据处理方法,应用于数据处理系统,所述数据处理系统包括移动平台、第一终端、第二终端及播放设备,所述方法包括:
所述移动平台通过数字通信链路将包括图像数据的数据包发送至所述第一终端;
所述第一终端从所述移动平台接收到所述数据包之后,将所述数据包发送至所述第二终端;
所述第二终端从所述第一终端接收到所述数据包之后,将所述数据包发送至所述播放设备;
所述播放设备从所述第二终端接收到所述数据包之后,根据所述数据包进行播放。
第二方面,本发明实施例提供了另一种数据处理方法,应用于移动平台,所述方法包括:
通过数字通信链路将包括图像数据的数据包发送至第一终端,以使所述第一终端将所述数据包发送至第二终端,并由所述第二终端将所述数据包发送至播放设备,并由所述播放设备根据所述数据包进行播放。
第三方面,本发明实施例提供了又一种数据处理方法,应用于第一终端,所述方法包括:
接收移动平台通过数字通信链路发送的包括图像数据的数据包;
从所述移动平台接收到所述数据包之后,将所述数据包发送至第二终端,以使所述第二终端将所述数据包发送至播放设备,并由所述播放设备根据所述数据包进行播放。
第四方面,本发明实施例提供了又一种数据处理方法,应用于第二终端,所述方法包括:
接收第一终端发送的包括图像数据的数据包,所述数据包是由所述移动平台通过数字通信链路发送至所述第一终端的;
将所述数据包发送至播放设备,以使所述播放设备根据所述数据包进行播放。
第五方面,本发明实施例提供了又一种数据处理方法,应用于第三终端,所述方法包括:
接收移动平台通过数字通信链路发送的包括图像数据的数据包;其中,在所述第三终端从所述移动平台未接收到所述数据包时,所述第三终端不发送第三应答信息至所述移动平台,所述第三应答信息用于指示所述第三终端从所述移动平台未接收到所述数据包,或者,在所述第三终端从所述移动平台接收到所述数据包,且对所述数据包进行解码失败时,所述第三终端不发送第四应答信息至所述移动平台,所述第四应答信息用于指示所述第三终端对所述数据包解码失败。
第六方面,本发明实施例提供了又一种数据处理方法,应用于第四终端,所述方法包括:
接收用户输入的控制指令;
在控制指令传输时隙内,通过数字通信链路将所述控制指令发送至移动平台,以使所述移动平台执行所述控制指令。
第七方面,本发明实施例提供了一种数据处理系统,所述数据处理系统 包括移动平台、第一终端、第二终端及播放设备,其中,
所述移动平台,用于通过数字通信链路将包括图像数据的数据包发送至所述第一终端;
所述第一终端,用于从所述移动平台接收到所述数据包之后,将所述数据包发送至所述第二终端;
所述第二终端,用于从所述第一终端接收到所述数据包之后,将所述数据包发送至所述播放设备;
所述播放设备,用于从所述第二终端接收到所述数据包之后,根据所述数据包进行播放。
第八方面,本发明实施例提供了一种移动平台,所述移动平台包括:拍摄装置、数字图传收发机、移动装置、存储器及处理器,其中,
所述移动装置,用于控制所述移动平台移动;
所述拍摄装置,用于拍摄得到图像数据;
所述数字图传收发机,用于收发信息;
所述存储器,用于存储程序指令;
所述处理器,用于调用所述存储器存储的程序指令,执行如下步骤:通过数字通信链路将包括图像数据的数据包发送至第一终端,以使所述第一终端将所述数据包发送至第二终端,由所述第二终端将所述数据包发送至播放设备,并由所述播放设备根据所述数据包进行播放。
第九方面,本发明实施例提供了一种终端,所述终端为第一终端,数字图传收发机、播放装置、存储器及处理器,
所述数字图传收发机,用于收发信息;
所述播放装置,用于根据数据包进行播放;
所述存储器,用于存储程序指令;
所述处理器,用于调用所述存储器存储的程序指令,执行如下步骤:接收移动平台通过数字通信链路发送的包括图像数据的数据包;从所述移动平台接收到所述数据包之后,将所述数据包发送至第二终端,以使所述第二终端将所述数据包发送至播放设备,由所述播放设备根据所述数据包进行播放。
第十方面,本发明实施例提供了另一种终端,所述终端为第二终端,所述终端包括存储器及处理器,
所述存储器,用于存储程序指令;
所述处理器,用于调用所述存储器存储的程序指令,执行如下步骤:接收第一终端发送的包括图像数据的数据包,所述数据包是由所述移动平台通过数字通信链路发送至所述第一终端的;将所述数据包发送至播放设备,以使所述播放设备根据所述数据包进行播放。
第十一方面,本发明实施例提供了又一种终端,所述终端为第三终端,所述终端包括数字图传收发机、播放装置、存储器及处理器,
所述数字图传收发机,用于接收移动平台发送的包括图像数据的数据包;
所述播放装置,用于根据所述数据包进行播放;
所述存储器,用于存储程序指令;
所述处理器,用于调用所述存储器存储的程序指令,执行如下步骤:接收移动平台通过数字通信链路发送的包括图像数据的数据包;其中,在所述第三终端从所述移动平台未接收到所述数据包时,第三应答信息未被所述第三终端发送至所述移动平台,所述第三应答信息用于指示所述第三终端从所述移动平台未接收到所述数据包,或者,在所述第三终端从所述移动平台接收到所述数据包,且对所述数据包进行解码失败时,第四应答信息未被所述第三终端发送至所述移动平台,所述第四应答信息用于指示所述第三终端对所述数据包解码失败。
第十二方面,本发明实施例提供了又一种终端,所述终端为第四终端,所述终端包括数字飞控命令发射机、交互装置、存储器及处理器,
所述交互装置,用于接收用户输入的控制指令;
所述数字飞控命令发射机,用于向移动平台发送所述控制指令;
所述存储器,用于存储程序指令;
所述处理器,用于调用所述存储器存储的程序指令,执行如下步骤:接收用户输入的控制指令;在控制指令传输时隙内,通过数字通信链路将所述控制指令发送至移动平台,以使所述移动平台执行所述控制指令。
第十三方面,本发明实施例提供了一种计算机可读存储介质,包括:所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时用于执行如步骤:
通过数字通信链路将包括图像数据的数据包发送至所述第一终端;所述 第一终端从所述移动平台接收到所述数据包之后,将所述数据包发送至所述第二终端;所述第二终端从所述第一终端接收到所述数据包之后,将所述数据包发送至所述播放设备;所述播放设备从所述第二终端接收到所述数据包之后,根据所述数据包进行播放。
在本发明实施例中,移动平台可通过数字通信链路将包括图像数据的数据包发送至第一终端,第一终端从移动平台接收到该数据包之后,将该数据包发送至第二终端。移动平台通过数字通信链路传输数据包,可以提高图像数据的传输质量,并可提高图像数据的传输距离。并且,第二终端可将数据包发送至播放设备,播放设备可播放该数据包中的图像数据,能够实现对图像数据进行直播,以便观众可以通过该图像数据实时了解移动平台的移动情况。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1a是本发明实施例提供的一种数据处理系统的网络架构示意图;
图1b是本发明实施例提供的一种下行链路的传输时隙的示意图;
图1c是本发明实施例提供的一种移动平台控制系统的网络架构示意图;
图1d是本发明实施例提供的另一种移动平台控制系统的网络架构示意图;
图2是本发明实施例提供的一种数据处理方法的流程示意图;
图3是本发明实施例提供的另一种数据处理方法的流程示意图;
图4是本发明实施例提供的又一种数据处理方法的流程示意图;
图5是本发明实施例提供的一种移动平台的结构示意图;
图6是本发明实施例提供的一种终端的结构示意图;
图7是本发明实施例提供的另一种终端的结构示意图;
图8是本发明实施例提供的又一种终端的结构示意图;
图9是本发明实施例提供的又一种终端的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
为了更好理解本发明实施例提供的一种数据处理方法、移动平台及终端,下面先描述本发明实施例的网络构架。
请参见图1a,图1a是本发明实施例提供的一种数据处理系统的网络架构示意图,该网络架构至少包括移动平台10、第一终端20、第二终端30及至少一个播放设备40,图1a中以三个播放设备为例。可选的,该网络架构还可包括第三终端50和第四终端60。其中,移动平台10可以包括无人机或地面移动机器人等可移动设备,无人机可以是旋翼型无人机,例如四旋翼无人机、六旋翼无人机、八旋翼无人机,也可以是固定翼无人机。移动平台10可以包括动力系统、云台、拍摄装置101、数字图传收发机102及移动装置103等。动力系统用于为移动平台提供移动动力,动力系统包括螺旋桨、电机、电调中的一种或多种。拍摄装置101通过云台搭载于移动平台10的主体上,并用于在移动平台10的移动过程中进行图像拍摄,还用于在移动平台10的移动过程中进行录像。拍摄装置101包括但不限于多光谱成像仪、高光谱成像仪、可见光相机及红外相机等。云台为多轴传动及增稳系统,云台电机通过调整转动轴的转动角度来对图像拍摄装置的拍摄角度进行补偿,并通过设置适当的缓冲机构来防止或减小成像设备的抖动。数字图传收发机102可以是指以数字通信链路传输信息(如图像数据)的装置,即数字图传收发机102可用于移动平台10与其他终端进行交互信息,其他终端可以包括第一终端20、第三终端50及第四终端60中的一个或多个。例如,数字图传收发机102可用于向第一终端20发送拍摄装置101包括图像数据的数据包。移动装置103用于控制移动平台移动,即控制移动平台的移动参数,移动参数包括移动速度、移动姿态、移动方向及移动轨迹等等。
其中,第一终端20可以是指飞手端的眼镜设备或者为其他设备。该眼镜设备可以是指虚拟现实(Virtual Reality,VR)或增强现实(Augmented Reality, AR)等可以播放视频的眼镜设备。在穿越机竞赛中,飞手端的眼镜设备可以是指由飞手(即参赛选手)控制的眼镜设备。第一终端20可以包括数字图传收发机201及播放装置202,数字图传收发机201可以用于第一终端20与移动平台10、第二终端30交互信息。例如,数字图传收发机201可以用于接收移动平台通过数字图传收发机102发送的数据包。第一终端从移动平台中接收到数据包之后,可将该数据包发送至第二终端30,并可通过播放装置202根据该数据包进行播放,以呈现移动平台拍摄的画面。
其中,第二终端30可以是指中转设备。可选的,第二终端30可以包括机顶盒、中继器、路由器、交换机或其他设备。第二终端30可以用于向播放设备40发送数据包。可选的,第二终端30与第一终端20通过有线进行连接。
其中,播放设备40可以用于播放数据包中的图像数据,该播放设备40具体可以是指电视机、智能手机、平板电脑、笔记本电脑、地面站及直播站台等可以播放数据包中的图像数据的设备。
其中,第三终端50可以是指观众端的眼镜设备或者是其他设备。该观众端的眼镜设备可以是指由观众控制的眼镜设备。第三终端50可以包括数字图传收发机501及播放装置502,数字图传收发机501可以用于接收移动平台10通过数字图传收发机发送的数据包。播放装置502用于根据数据包进行播放,以呈现移动平台拍摄的画面。
在本实施例中,上述移动平台10可以用于在当前数据传输周期内,通过数字通信链路分别向第一终端20和第三终端50发送连续的数据包。并且上述移动平台10可接收第一终端20针对各数据包反馈的应答信息。基于所接收到的应答信息,确定连续的数据包中的目标数据包。在当前数据传输周期内,通过数字通信链路向第一终端20和第三终端50发送目标数据包。
在本实施例中,每一个数据传输周期可以包含下行链路的传输时隙和上行链路的传输时隙。其中,下行链路的传输时隙可传输的数据包的总数量可以预先设定(例如,可传输10个数据包)。此处,下行链路的传输时隙,可以被预先划分为正常时隙和冗余时隙。正常时隙可以视为传输新获取的连续的多个数据包所占用的时隙。冗余时隙可以视为传输预设数量的目标数据包所占用的时隙。正常时隙对应的时长可以大于或等于冗余时隙 对应的时长,或者,正常时隙对应的时长可以小于冗余时隙对应的时长。例如,如图1b所示,该下行链路的传输时隙包括正常时隙和冗余时隙,正常时隙对应的时长大于冗余时隙对应的时长。该正常时隙可以视为传输6个连续的数据包所占用的时隙,该6个连续的数据包可以标记为数据包1~数据包6。冗余时隙可以视为传输4个目标数据包所占用的时隙,该4个目标数据包可以标记为数据包7~数据包10。具体的,在正常时隙内,移动平台10通过数字通信链路向第一终端20和第三终端50发送6个连续的包括图像数据的数据包,相应地,第一终端20和第三终端50可以从移动平台10接收6个连续的数据包,并且第一终端20可以针对每个数据包向移动平台10发送一条应答信息。移动平台10可以从第一终端20接收应答信息,基于应答信息从6个连续地数据包中确定目标数据包,在冗余时隙内通过数字通信链路分别向第一终端10和第三终端50发送该目标数据包。需要说明的是,正常时隙、冗余时隙所传输的数据包的数量可以根据需要分别预先设定,不限于上述示例中的数值。
其中,上述移动平台10在当前数据传输周期内,通过数字通信链路分别向第一终端20和第三终端50所发送的连续的数据包具体可以是指:移动平台10在当前数据传输时隙的正常时隙内,通过数字通信链路分别向第一终端20和第三终端50发送连续的数据包。同理,上述移动平台10在当前数据传输周期内,通过数字通信链路分别向第一终端20和第三终端50发送目标数据包具体可以是指:移动平台10在当前数据传输时隙的冗余时隙内,通过数字通信链路分别向第一终端20和第三终端50发送目标数据包。
在本实施例中,第一终端20可以针对各数据包,向上述移动平台10反馈应答信息。具体地,第一终端20每接收到一个数据包后,可以向移动平台10返回一个针对该数据包的应答信息。应答信息可以用于表征该数据包是否被成功接收或者该数据包是否解码成功。
在本实施例中,移动平台10还可以基于所获取的应答信息,确定上述连续的数据包中的目标数据包。此处,目标数据包即为待重新发送给第一终端20和第三终端50的数据包。即,在每个数据传输周期的冗余时隙所传输的目标数据包。由于应答信息可以用于表征该数据包是否被成功接收 或者该数据包是否解码成功,因而,可以将用于表征接收失败或者解码失败的数据包的应答信息对应的数据包作为目标数据包。即目标数据包可以是指未被接收到或解码失败的数据包。在确定出目标数据包后,移动平台10可以在上述当前数据传输周期内,向上述第一终端20和上述第三终端50发送上述目标数据包。
由此,移动平台10能够根据第一终端20对各数据包的应答信息,确定出需要重新传输的目标数据包并进行再次传输,使得当某个数据包接收失败或解码失败时,第一终端20可再次接收到该数据包,减少了第一终端20的视频卡顿现象,提高了第一终端20画面显示的流畅性。
可选的,移动平台10可以将该目标数据包发送至第三终端50,可减少第三终端50的视频卡顿现象,提高了第三终端50画面显示的流畅性。
可选的,上述应答信息可以是NAK(Negative Acknowledgment,否定应答)或ACK(Acknowledgement,肯定应答)。其中,NAK为数字通信中用于确认数据包已接收到,但是对该数据包解码失败,或者NAK为数字通信中表征数据包未被接收到。ACK为数据通信中表征数据包已确认接收,且解码成功。例如,该NAK包括第一应答信息或第二应答信息,该第一应答信息用于指示第一终端20从移动平台10未接收到数据包,该第二应答信息用于指示第一终端20接收到该数据包,但对该数据包解码失败。
可选的,移动平台10可以进一步通过如下步骤确定目标数据包:
首先,确定应答信息为NAK的数据包的数量是否小于预设数量(例如4件)。此处,预设数量是预先设定的、在每个数据传输周期需要重传的数据包(即目标数据包)的数量。即,在每个数据传输周期的冗余时隙所传输的目标数据包的数量。
若否,从所确定的应答信息为NAK的数据包中,选取上述预设数量的数据包,作为目标数据包。例如,若预设数量为4,应答信息为NAK的数据包的数量也为4个,则可以将这4个应答信息为NAK的数据包均作为目标数据包。若NAK的数据包的数量也5个,则可以从中选取4个数据包作为目标数据包。此处,可以随机选取,也可以按照其他预设的规则或者顺序(例如按照发送时间有早到晚的顺序)进行选取,此处对选取方 式不作限定。由此,在采用数据数字图传方式进行数据传输时,能够根据第一终端20的应答信息确定出解码失败的数据包,对这些数据包进行重传,减少了第一终端20的视频卡顿现象,提高了第一终端20画面显示的流畅性。
可选的,上述移动平台10响应于确定应答信息为NAK的数据包的数量小于上述预设数量,选取应答信息为NAK的数据包作为目标数据包,以及,从其余数据包中,选取目标数量的数据包作为目标数据包。其中,上述目标数量为上述预设数量与上述应答信息为NAK的数据包的数量的差值。上述其余数据包,可以是当前数据传输周期内已发送且应答信息不为NAK的数据包。作为示例,若应答信息为NAK的数据包仅为1个,则可以在其余数据包中,选取3个数据包作为目标数据包,并进行重新发送。由此,不仅减少了第一终端20的视频卡顿现象,提高了第一终端20画面显示的流畅性,同时可以充分利用当前数据传输周期的信道容量。
可选的,移动平台10从上述其余数据包中选取目标数据包的操作,可以通过如下步骤执行:首先,从其余数据包中,确定未接收到对应的应答信息的数据包。之后,从上述未收到的对应的应答信息的数据包中,按照已发送次数从小到大的顺序,选取目标数量的数据包作为目标数据包。
此处,由于应答信息为NAK的数据包已被确定为目标数据包,因而,其余数据包中仅包含尚未接收到对应的应答信息的数据包以及应答信息为ACK的数据包。若某个数据包对应的应答信息为ACK,通常可认为该数据包无误。由于ACK的传输具有一定时延,因而未接收到对应的应答信息的数据包可能为ACK,也可能为NAK。由此,在未接收到对应的应答信息的数据包中选取目标数据包,可以更大概率地确定出解码失败的数据包。此外,由于发送次数越多,通常发送成功的概率越高。因而,通过从小到大的顺序进行选取,可以使发送次数较少的数据包被优先选取,可以更大概率地确定出解码失败的数据包。
可选的,响应于确定在上述未收到对应的应答信息的数据包中,存在发送次数相同的至少两个数据包,按照发送时间由先至后的顺序,对上述至少两个数据包进行选取。由此,可以在多个数据包发送次数相同时,优先选取较早发送的,以使较早发送的数据包可以被尽快接收。
可选的,上述移动平台10还可以从首次接收到的NAK所对应的数据包起,选取连续的预设数量(例如4个)的数据包,作为目标数据包。作为示例,移动平台10在发送连续的数据包1、数据包2、数据包3、数据包4、数据包5、数据包6之后,各数据包依次返回的应答信息为NAK、NAK、ACK、ACK、ACK、ACK,则首次接收到的NAK所对应的数据包为NAK。此时,可以将数据包1作为起始数据包,将该数据包1起的连续的4个数据包(即数据包1、数据包2、数据包3和数据包4)作为目标数据包。
由于实际应用中,通常在一个数据包发生错误后,其后的连续一个或多个数据包也会产生错误,因而,这种方式可以更便捷地确定出目标数据包,提高了数据处理效率。
可选的,上述第一终端20还可以执行如下步骤:对于所接收到的每一个数据包,确定该数据包是否已被成功接收过;若是,丢弃该数据包;若否,存储该数据包。此处,各数据包均可以具有一个用于指示和区分该数据包的标识(例如序号)。上述第一终端20可以通过标识的匹配,确定该数据包是否已被成功接收过。
可选的,上述第三终端50还可以对于所接收到的每一个数据包,确定该数据包是否为错误接收的历史数据包;若否,丢弃该数据包;若是,利用混合自动重传请求(Hybrid Automatic Repeat reQuest,HARQ)技术,将该数据包与上述历史数据包进行合并,并对合并后的数据包进行译码。
此处,HARQ是一种将前向纠错编码(Forward Error Correction,FEC)和自动重传请求(Automatic Repeat Request,ARQ)相结合而形成的技术。其中,FEC是一种增加数据通讯可信度的方法。在单向通讯信道中,一旦错误被发现,其接收器将无权再请求传输。FEC是利用数据进行传输冗余信息的方法,当传输中出现错误,将允许接收器再建数据。ARQ是通过接收方请求发送方重传出错的数据报文来恢复出错的报文,是通信中用于处理信道所带来差错的方法之一,有时也被称为后向纠错(Backward Error Correction,BEC)。通过HARQ技术,可以使第三终端50基于当前所接收到的数据包,采用互补删除方式,纠正对应的历史数据包中的错误,从而得到合并后的无误的数据包。HARQ支持对各个数据包既可以单独译码, 也支持对合成一个具有更大冗余信息的数据包包进行合并译码。
通过HARQ技术,将该数据包与上述历史数据包进行合并,可以纠正历史数据包中的错误,提高数据包的准确率。进而减少第一终端20的视频卡顿现象,提高了第一终端20画面显示的流畅性。
其中,第四终端60可以是指用于控制移动平台的移动的终端,即第四终端60可以是指遥控设备,第四终端60具体可以为遥控器、智能手机、平板电脑、膝上型电脑及穿戴式设备(手表、手环)或其他设备。第四终端60可以包括数字飞控命令发射机601和交互装置602。交互装置602具体可以包括键盘、按键、摇杆、波轮等其他交互装置。第四终端60可以通过交互装置602检测用户的控制操作,根据交互装置602检测到的控制操作生成控制指令。数字飞控命令发射机601可以是指以数字通信链路传输控制指令的装置,即数字飞控命令发射机601可以用于将控制指令发送至移动平台10,由移动平台10执行该控制指令。
需要说明的是,第四终端可以直接与移动平台进行通信,或者,第四终端还可以通过第一终端与移动平台进行通信。当第四终端通过第一终端与移动平台进行通信时,具体实现方式可以参见图1c和图1d。
可选的,当第四终端通过第一终端与移动平台进行通信时,第一终端被配置为:通过与移动平台之间的通信连接从移动平台接收移动平台的移动关联数据并且显示移动关联数据;通过与第一终端对应的第四终端之间的通信连接从该第四终端接收控制指令,以及通过与移动平台之间的通信连接将控制指令发送至移动平台。
其中,第一终端可以通过专门用于与移动平台进行通信的无线通信技术与移动平台进行通信。相应的,第一终端与移动平台之间的通信连接可以为专门用于与移动平台进行通信的无线通信技术中定义的数字通信连接。此处无线通信技术可以是指无线数字通信技术。
可选的,第一终端与第四终端之间的通信连接可以为有线通信连接。
例如,第一终端通过USB技术与第四终端进行通信。第一终端与第四终端之间的通信连接为USB技术中定义的USB连接。
在本申请中,第四终端无需与移动平台建立通信连接,由与第四终端进行通信的第一终端将控制指令发送至移动平台来对移动平台进行遥控。从而, 在第四终端中无需配置与移动平台进行通信所需的器件的情况下,对移动平台进行遥控,节省第四终端的成本。
例如,第一终端通过专门用于与移动平台进行通信的无线通信技术与移动平台进行通信。第一终端配置有利用该无线通信技术进行通信所需的射频电路、天线等器件。而第四终端则无需配置利用该无线通信技术进行通信所需的射频电路、天线等器件,节省第四终端的成本。
在本申请中,当移动平台控制系统中的第一终端的数量为多个时,每一个第一终端分别与移动平台建立通信连接。
在本申请中,当移动平台控制系统中的第一终端的数量和第四终端的数量均为多个时,每一个第一终端可以对应所有第四终端中的一个或多个第四终端。
相应的,当一个第一终端对应所有第四终端中的多个第四终端时,该第一终端与该多个第四终端中的每一个第四终端之间均具有通信连接。对于该多个第四终端中的每一个第四终端,当利用第四终端对移动平台进行遥控时,由该第一终端将在第四终端上生成的控制指令发送至移动平台来对移动平台进行遥控。
例如,移动平台控制系统中的所有第一终端包括:第一终端1、第一终端2,移动平台控制系统中的所有第四终端包括:第四终端1、第四终端2、第四终端3、第四终端4。第一终端1与第四终端1、第四终端2之间具有通信连接;第一终端2与第四终端3、第四终端4之间具有通信连接。
第一终端1对应的第四终端包括:第四终端1、第四终端2。第一终端2对应的第四终端包括:第四终端3、第四终端4。
当移动平台的遥控者利用第四终端1或第四终端2对移动平台进行遥控时,由第一终端1将在第四终端1上生成的控制指令或在第四终端2上生成的控制指令发送至移动平台来对移动平台进行遥控。
当移动平台的遥控者利用第四终端3或第四终端4对移动平台进行遥控时,由第一终端2将在第四终端3上生成的控制指令或在第四终端4上生成的控制指令发送至移动平台来对移动平台进行遥控。
在本申请中,当移动平台控制系统中的第一终端的数量和第四终端的数量均为多个时,所有第一终端中的多个第一终端可以对应同一个第四终端。 例如,移动平台的多个遥控者使用同一个第四终端对移动平台轮流进行遥控。每一个遥控者各自使用的第一终端从移动平台接收移动关联数据并且显示移动关联数据。
相应的,当所有第一终端中的多个第一终端对应同一个第四终端时,在利用该第四终端对移动平台进行遥控时,由该第四终端将在该第四终端上生成的控制指令发送至移动平台当前的遥控者使用的第一终端,由移动平台当前的遥控者使用的第一终端将在该第四终端上生成的控制指令发送至移动平台来对移动平台进行遥控。
例如,所有第一终端包括:第一终端1、第一终端2、第一终端3、第一终端4,所有第四终端包括:第四终端1、第四终端2。
第四终端1与第一终端2、第一终端1之间具有通信连接。第四终端2与第一终端3、第一终端4与之间具有通信连接。
第一终端1和第一终端2均与第四终端1相对应。第一终端3和第一终端4均与第四终端2相对应。
当移动平台当前的遥控者利用第四终端1对移动平台进行遥控时,由第四终端1将在第四终端1上生成的控制指令发送至移动平台当前的遥控者使用的第一终端1或第一终端2,由移动平台当前的遥控者使用的第一终端1或第一终端2将在第四终端1上生成的控制指令发送至移动平台来对移动平台进行遥控。
当移动平台当前的遥控者利用第四终端2对移动平台进行遥控时,由第四终端2将在第四终端2上生成的控制指令发送至移动平台当前的遥控者使用的第一终端3或第一终端4,由移动平台当前的遥控者使用的第一终端3或第一终端4将在第四终端2上生成的控制指令发送至移动平台来对移动平台进行遥控。
在本申请中,移动平台的移动关联数据包括:移动平台在移动过程中由移动平台上的相关的传感器采集的数据。
例如,移动平台的移动关联数据包括但不限于:移动速度、移动方向、移动环境数据包等。移动环境数据包可以描述移动平台在当前的移动过程中周围的环境。
在本申请中,移动平台的遥控者可以在第四终端上进行遥控操作。
例如,第四终端包括:摇杆。移动平台的遥控者在第四终端上进行遥控操作可以为移动平台的遥控者对摇杆进行的操作。
在一些实施例中,第一终端被配置为:在与第一终端相关联的每一个控制指令传输时隙内执行以下操作:通过与第一终端对应的第四终端之间的通信连接向第一终端对应的第四终端发送控制指令对应的采集指令,以触发第一终端对应的第四终端采集控制指令;通过与第一终端对应的第四终端之间的通信连接从第一终端对应的第四终端接收控制指令,以及通过与移动平台之间的通信连接将第一终端对应的第四终端采集的控制指令发送至移动平台。
在本申请中,时隙可以理解为一个时间段。控制指令传输时隙可以为用于将控制指令发送至移动平台的时隙。
在本申请中,对于每一个第一终端,与第一终端相关联的每一个控制指令传输时隙可以为:利用第一终端对移动平台进行遥控的一次遥控过程中的每一个控制指令传输时隙。
例如,当前的遥控过程中,利用一个第一终端去遥控移动平台,即当前的遥控过程中,利用该第一终端将该第一终端对应的第四终端的控制指令发送至移动平台以对移动平台进行遥控。当前的遥控过程中的每一个控制指令传输时隙为该与第一终端相关联的每一个控制指令传输时隙。
在本申请中,控制指令传输时隙的时长远小于移动平台的遥控者在第四终端上进行的可生成控制指令的遥控操作的时长。
例如,控制指令传输时隙的时长可以设置为毫秒级别,例如,控制指令传输时隙的时长为5ms,而移动平台的遥控者在第一终端对应的第四终端上进行的遥控操作的时长最短也为几秒,即移动平台的遥控者在第一终端对应的第四终端上进行的遥控操作的操作时间段的时长最短也为几秒。
相应的,移动平台的遥控者在第一终端对应的第四终端上进行的遥控操作的操作时间段包括:多个控制指令传输时隙。该多个控制指令传输时隙中的每一个控制指令传输时隙为与该第一终端相关联的每一个控制指令传输时隙。
移动平台的遥控者在第一终端对应的第四终端上进行遥控操作,第一终端会在遥控操作的操作时间段内的与第一终端相关联的每一个控制指令传输 时隙内,去触发第一终端对应的第四终端采集控制指令,在与第一终端相关联的每一个控制指令传输时隙内,从第一终端对应的第四终端接收第一终端对应的第四终端采集的控制指令以及将第一终端对应的第四终端发送至移动平台。
在本申请中,第一终端在与第一终端相关联的每一个控制指令传输时隙内完成触发第一终端对应的第四终端采集控制指令、从第一终端对应的第四终端接收第一终端对应的第四终端采集的控制指令、将第一终端对应的第四终端发送至移动平台等操作。从而,控制指令被以超低的延时传输至移动平台,移动平台的遥控者以超低的延时遥控移动平台。
在一些实施例中,移动平台的移动关联数据包括:移动平台采集的第一人称主视角的图像数据。第一终端可以接收第一人称主视角的图像数据并且播放第一人称主视角的图像数据。移动平台的遥控者可以根据看到的第一人称主视角的图像数据对移动平台进行遥控,从而,以移动平台的视角对移动平台进行遥控。
在一些实施例中,每一个第一终端均为眼镜设备。眼镜设备与移动平台之间具有通信连接。眼镜设备与第四终端之间具有通信连接。眼镜设备可以通过该移动平台之间的通信连接从该移动平台接收移动关联数据并且显示接收到的移动关联数据。眼镜设备通过该第四终端之间的通信连接从该第四终端接收控制指令以及通过该移动平台之间的通信连接将控制指令发送至该移动平台。
移动平台的遥控者佩戴眼镜设备时,移动平台的遥控者可以根据眼镜设备显示的移动关联数据,了解移动平台的移动情况。然后,移动平台的遥控者可以在眼镜设备对应的第四终端上进行遥控操作,第四终端通过与眼镜设备之间的通信连接将基于遥控者的遥控操作而生成的控制指令发送至眼镜设备,再由眼镜设备通过与移动平台之间的通信连接将控制指令发送至移动平台。从而,在眼镜设备无需与移动平台建立通信连接的情况下,对移动平台进行遥控。
在一些实施例中,每一个第一终端分别对应一个第四终端,每一个第一终端对应的第四终端与其他的第一终端对应的第四终端不同。
请参考图1c,其示出了本申请实施例提供的一移动平台控制系统的一个 结构示意图。
在图1c中,示出了一个第一终端、一个移动平台、一个第四终端。该第一终端与一个第四终端对应。
第一终端与移动平台之间具有通信连接,第一终端与第四终端之间具有通信连接。相应的,第一终端与移动平台之间的通信连接101可以为专门用于与移动平台进行通信的无线通信技术中定义的通信连接。第一终端与第四终端之间的通信连接102可以为有线通信连接。
例如,第一终端通过USB技术与第四终端进行通信。第一终端与第四终端之间的通信连接为USB技术中定义的USB连接。
以下举例说明利用移动平台控制系统对一个移动平台进行遥控的过程:
第一终端为眼镜设备。移动平台的遥控者佩戴该眼镜设备。该移动平台在移动过程中通过移动平台的数据包传感器采集第一人称主视角的图像数据。眼镜设备通过通信连接101从移动平台接收第一人称主视角的图像数据并且播放第一人称主视角的图像数据。移动平台的遥控者通过该眼镜设备播放第一人称主视角的图像数据。移动平台的遥控者在第四终端上进行遥控操作。第四终端将基于移动平台的遥控者的遥控操作而生成的控制指令通过通信连接102发送至第一眼镜设备。该眼镜设备将控制指令通过通信连接101发送至移动平台,以对移动平台进行遥控。
请参考图1d,其示出了本申请实施例提供的一种移动平台控制系统另一个结构示意图。
在图1d中,示出了第一终端1、第四终端1、移动平台、第一终端2、第四终端2。
每一个第一终端分别对应一个第四终端,每一个第一终端对应的第四终端与其他的第一终端对应的第四终端不同。第一终端1对应第四终端1,第一终端2对应第四终端2。
第四终端1、第四终端2均包括处理器、存储器、可被移动平台的遥控者操作的遥控部件。遥控部件可以包括但不限于:摇杆、按钮。第一终端1、第一终端2均包括处理器、存储器、显示屏。
第一终端1与移动平台之间具有通信连接201,第一终端1与第四终端1之间具有通信连接202。第一终端2与移动平台之间具有通信连接203,第一 终端2与第四终端2之间具有通信连接204。
第一终端1被配置为:通过通信连接201从移动平台接收移动平台的移动关联数据并且显示移动关联数据;通过通信连接202从第四终端1接收在第四终端1上进行遥控操作而生成的控制指令以及通过通信连接201将在第四终端1上进行遥控操作而生成的控制指令发送至移动平台。
第一终端2被配置为:通过通信连接203从移动平台接收移动平台的移动关联数据并且显示移动关联数据;通过通信连接204从第四终端2接收在第四终端2上进行遥控操作而生成的控制指令,以及通过通信连接203将在第四终端2上进行遥控操作而生成的控制指令发送至移动平台。
在本申请中,第四终端1和第四终端2可以轮流遥控移动平台。在第四终端1和第四终端2轮流遥控移动平台的过程中,任意一个第四终端的控制指令无需经过其他的第四终端转发至移动平台,降低控制指令的传输延时,并且第四终端1与第四终端2无需建立通信连接,相应的,无需通过传输线将第四终端1与第四终端2连接在一起,降低遥控者使用第四终端的复杂度。
例如,第四终端1由演示移动平台的遥控方式的教练使用,第四终端2由学习移动平台的遥控方式的学员使用。教练和学员轮流地遥控移动平台可以称之为教练模式。在教练模式下,在第四终端1上进行遥控操作而生成的控制指令无需经过第四终端2转发至移动平台,在第四终端2上进行遥控操作而生成的控制指令无需经过第四终端1转发至移动平台,从而,降低控制指令的传输延时。相应的,无需通过传输线将教练使用的第四终端1与学员使用的第四终端2连接在一起,降低遥控者使用第四终端的复杂度。
以下举例说明利用移动平台控制系统对一个移动平台进行遥控的过程:
第一终端1为第一眼镜设备,第一终端2为第二眼镜设备。教练佩戴第一眼镜设备,学员佩戴第二眼镜设备。教练利用第一眼镜设备和第四终端1来遥控移动平台,学员利用第二眼镜设备和第四终端2来遥控移动平台。
该移动平台在移动过程中通过移动平台的数据包传感器采集第一人称主视角的图像数据。
第一眼镜设备通过通信连接201从移动平台接收第一人称主视角的图像数据并且播放第一人称主视角的图像数据。第二眼镜设备通过通信连接203从移动平台接收第一人称主视角的图像数据并且播放第一人称主视角的图像 数据。
首先由教练利用第一眼镜设备和第四终端1对移动平台进行遥控,来向学员演示移动平台的遥控方式。教练可以通过佩戴的第一眼镜设备播放第一人称主视角的图像数据。教练在第四终端1上进行遥控操作。第四终端1将基于教练的遥控操作而生成的控制指令通过通信连接202发送至第一眼镜设备。第一眼镜设备将控制指令通过通信连接201发送至移动平台,以对移动平台进行遥控。
在教练利用第一眼镜设备和第四终端1对该移动平台进行遥控的时间段,学员可以在该段时间内通过第二眼镜设备显示的第一人称主视角的图像数据,以了解移动平台的移动过程。然后,可以由学员利用第二眼镜设备和第四终端2对该移动平台进行遥控,学习教练演示的移动平台的遥控方式。
学员在第四终端2上进行遥控操作。第四终端2将基于学员的遥控操作而生成的控制指令通过通信连接204发送至第二眼镜设备。第二眼镜设备通过通信连接203将基于学员的遥控操作而生成的控制指令发送至移动平台,以对移动平台进行遥控。
该网络架构可以用于穿越机竞赛中直播赛事或视频制作等场景中,下面以该网络架构应用于穿越机竞赛中直播赛事的场景中为例进行描述。该移动平台10可以用于穿越机竞赛,即该移动平台10可以是指穿越机。在穿越机竞赛中,飞手(即参赛选手)可以控制移动平台10通过拍摄装置101拍摄第一人称主视角的图像数据,移动平台10可以通过数字图传收发机102将包括该图像数据的数据包发送至第一终端20。第一终端20可通过数字图传收发机201从移动平台10接收数据包,当接收到数据包之后,可以将该数据包发送至第二终端30。第二终端30可从第一终端20接收该数据包,当接收到该数据包之后,可以将该数据包发送至播放设备。该播放设备从第二终端30接收到数据包之后,可以播放该数据包中的图像数据。移动平台10通过数字图传收发机传输数据包,可以提高图像数据的传输质量,并提高数据包传输的距离。并且,能够实现对该图像数据进行直播,以便观众可以通过该图像数据实时了解移动平台的移动情况。
请参见图2,图2是本申请实施例提供的一种数据处理方法流程示意图, 该方法可以应用于上述图1a的数据处理系统中,如图2所示,该数据处理方法可以包括如下步骤。
S201、移动平台通过数字通信链路将包括图像数据的数据包发送至第一终端。
本发明实施例中,移动平台可通过拍摄装置拍摄得到图像数据。例如,在移动平台移动的过程中,飞手可以通过第四终端向移动平台发送拍摄指令,移动平台接收到拍摄指令之后,可以控制拍摄装置进行拍摄得到图像数据。移动平台拍摄得到图像数据之后,可通过数字通信链路将包括该图像数据的数据包发送至第一终端,即移动平台可以通过数字图传收发机将包括图像数据的数据包发送至第一终端。数字通信链路是指发送端(如移动平台)将数据包进行编码、调制等处理,得到处理后的数据包(即该处理后的数据包为数字信号),将该处理后的数据包发送至接收端(如第一终端)。该数据包可以是根据第一人称主视角的图像数据得到的,这样飞手或观众可以通过该图像数据实时了解移动平台的移动情况。具体的,移动平台在拍摄图像的过程中,每拍摄得到至少一帧图像,可以采用数字通信链路将包括该至少一帧图像的数据包发送至第一终端,即数据包中包括一帧或多帧图像。
可选的,上述移动平台通过数字通信链路将包括图像数据的数据包发送至第一终端具体可以包括:在当前数据传输周期内,移动平台通过数字通信链路向第一终端发送连续的数据包。该连续的数据包包括图像数据,即该连续的数据包包括移动平台的拍摄装置连续拍摄得到图像数据。
在一个实施例中,上述拍摄装置还包括录像功能,即移动平台可通过拍摄装置进行录像,不需要移动平台额外携带录像装置,可提高视频录像的便捷性,并可提高视频录像的质量。在移动平台移动结束时,可将通过拍摄装置录像得到的图像数据发送至终端,由终端播放录像得到的图像数据。
其中,该拍摄装置可以是指高分辨率拍摄装置,即通过拍摄装置拍摄得到的图像数据的分辨率大于预设分辨率阈值。该预设分辨率阈值可以是拍摄装置的拍摄性能确定的。例如,该预设分辨率阈值可以为720p*120fps,p是指图像数据的扫描格式是逐行扫描,720p是一种在逐行扫描下图像数据达到1280×720的分辨率的显示格式。fps是指图像数据每秒被传输的帧数,即120fps是指图像数据每秒被传输120帧。当然,该预设分辨率阈值也可以大 于720p*120fps,本申请实施例不做限定。
S202、第一终端从移动平台接收到该数据包之后,将该数据包发送至第二终端。
本发明实施例中,第一终端可以从移动平台接收数据包,当接收到数据包后,可将该数据包发送至第二终端。即第一终端可通过数字图传收发机接收移动平台发送的数据包,并将该数据包发送至第二终端。具体的,第一终端可以通过有线通信连接或无线通信连接将该数据包发送至第二终端。可选的,第一终端接收到数据包之后,可以播放该数据包中的图像数据,以便飞手可以实时了解移动平台的移动情况。
可选的,步骤S202包括:若从该移动平台接收到该数据包,且对该数据包解码成功,则第一终端可通过数字通信链路将该数据包发送至该第二终端。
若从该移动平台接收到该数据包,且对该数据包解码成功,表明移动平台在对数据包进行编码的过程中或移动平台在传输数据包的过程中未出现异常情况,则第一终端可通过数字通信链路将该数据包发送至该第二终端。这样可避免无效的数据包传输,可提高带宽资源的利用率。
在一个实施例中,该移动平台与该第一终端建立点对点数字通信连接。该移动平台具体可通过该点对点数字通信连接将包括图像数据的数据包发送至该第一终端。相应地,第一终端具体通过该点对点数字通信连接从移动平台接收该数据包。例如,在移动平台发送数据包之前,移动平台可以接收第一终端发送的建立点对点数字通信连接请求,根据该连接请求与第一终端建立点对点数字通信连接。点对点数字通信连接可以是指以数字通信链路传输信息的通信连接,且该点对点数字通信连接可以是指移动平台与第一终端之间进行通信的专属通信连接,即只有移动平台和第一终端可通过该专属通信连接接收发信息。该点对点数字通信连接具体可以是指基于无线保真(Wireless Fidelity,Wi-Fi)或蓝牙等通信协议的通信连接。
S203、该第二终端从该第一终端接收到该数据包之后,将该数据包发送至播放设备。
本发明实施例中,第二终端可以从第一终端接收该数据包,当接收到数据包之后,可以将该数据包发送至播放设备,以便播放设备可以播放该数据包中的图像数据。
在一个实施例中,为了确保传输质量、降低数据处理系统复杂度,并提高数据处理系统的鲁棒性,第一终端可以通过有线通信连接将该数据包发送至该第二终端。相应地,第二终端可以接收第一终端通过有线通信连接发送的数据包。有线通信连接可以是指基于通用串行总线(Universal Serial Bus,USB)或异步传输标准接口协议RS232等的通信连接。
在一个实施例中,第一终端可对该数据包进行加密,得到加密后的数据包,通过该有线通信连接将该加密后的数据包发送至第二终端。相应地,第二终端可以接收第一终端通过有线通信连接发送的该加密后的数据包。
为了确保数据包传输的安全性,第一终端可以采用预设的加密方式对该数据包进行加密,得到加密后的数据包。预设的加密方式可以包括消息摘要算法第五版(Message Digest Algorithm,MD5)、数据加密标准(Data Encryption Standard,DES)、数字签名算法(Digital Signature Algorithm,DSA)等中的至少一种,或者可以是其他加密方式,本申请实施例不做限定。进一步,第一终端可通过该有线通信连接将该加密后的数据包发送至第二终端。相应地,第二终端可以接收第一终端通过有线通信连接发送的加密后的数据包。
可选的,如果第二终端从第一终端接收到的数据包为加密后的数据包,则第二终端可以对该加密后数据包进行解密,得到解密后的数据包,将解密后的数据包发送至播放设备。
可选的,为了提高数据包传输的安全性,如果第二终端从第一终端接收到的数据包为加密后的数据包,则第二终端可以直接将该加密后的数据包发送至播放设备。
S204、播放设备从该第二终端接收到该数据包之后,根据该数据包进行播放。
本发明实施例中,播放设备可以从该第二终端中接收该数据包。在接收到数据包之后,可以播放该数据包中的图像数据,以便观众可以实时了解移动平台的移动情况。具体的,若播放设备接收到的该数据包为加密后的数据包,则播放设备可对该加密后的数据包进行解密,得到解密后的数据包,播放该解密后的数据包中的图像数据。若播放设备接收到的数据包为未加密的数据包,则播放设备可直接播放该数据包中的图像数据。
在一个实施例中,该播放设备可以直播该数据包中的图像数据,即播放 设备每接收到一帧图像,可以播放该帧图像。
在一个实施例中,移动平台可以通过数字通信链路将该数据包发送至第三终端。第三终端可以是观众端。相应地,第三终端可以接收移动平台通过数字通信链路发送的数据包。第三终端接收到数据包之后,可以播放该数据包中的图像数据,以便观众可以通过第三终端实时了解移动平台的移动情况。具体的,移动平台可通过数字通信链路将该数据包广播至所述第三终端。相应地,第三终端可以接收该移动平台通过数字通信链路所广播的数据包。这样第三终端不占用上行带宽资源,移动平台可以向更多第三终端传输数据包,可以提高带宽资源的利用率。
可选的,上述移动平台通过数字通信链路将该数据包发送至第三终端具体可以包括:在当前数据传输周期内,移动平台通过数字通信链路将连续的数据包发送至第三终端。同理,上述移动平台通过数字通信链路将该数据包广播至该第三终端具体可以是指:在当前数据传输周期内,移动平台通过数字通信链路将连续的数据包广播至该第三终端。此处的连续的数据包包括图像数据。
在一个实例中,在该第三终端从该移动平台未接收到该数据包时,第三终端不发送第三应答信息至该移动平台,该第三应答信息用于指示该第三终端从该移动平台未接收到该数据包。即第三终端不需要向移动平台发送第三应答信息,这样第三终端不占用上行带宽资源,移动平台可以向更多第三终端传输数据包,可以提高带宽资源的利用率。
在另一个实例中,在该第三终端从该移动平台接收到该数据包,且对该数据包进行解码失败时,第三终端不发送第四应答信息至该移动平台,该第四应答信息用于指示该第三终端对该数据包解码失败。即第三终端不需要向移动平台发送第四应答信息,这样第三终端不占用上行带宽资源,移动平台可以向更多第三终端传输数据包,可以提高带宽资源的利用率。
在一个实施例中,第四终端可接收用户输入的控制指令,在控制指令传输时隙内,通过数字通信链路将该控制指令发送至该移动平台。相应地,该移动平台可接收该第四终端通过数字通信链路发送的该控制指令,在移动平台接收到该第四终端发送的控制指令后,可执行该控制指令。
该控制指令可以是指飞控指令或视频拍摄指令等其他指令,用户可以通 过触控、语音等方式在第四终端中输入控制指令,第四终端可以接收用户输入的控制指令。第四终端可在控制指令传输时隙内,通过数字通信链路将该控制指令发送至该移动平台,可降低控制指令的传输时延,并可实现移动平台与第四终端之间的全同步。该控制指令传输时隙内可以是指第四终端设置的,或用户手动设置。例如,该控制指令传输时隙可以为5ms,若第四终端在第1ms接收到用户输入的控制指令,则第四终端可在第6ms内通过数字通信链路将该控制指令发送至移动平台。相应地,该移动平台可从该第四终端接收该控制指令,在接收到该控制指令后,执行该控制指令。对该控制指令传输时隙的解释说明可以参见图1c中对控制指令传输时隙内的解释说明。
可选的,第四终端可以通过数字通信链路将该控制指令发送至第一终端,第一终端从第四终端接收该控制指令,接收到该控制指令后,将该控制指令发送至移动平台。相应地,移动平台可从第一终端接收该控制指令,接收到该控制指令后,执行该控制指令。
在本发明实施例中,移动平台可通过数字通信链路将包括图像数据的数据包发送至第一终端,第一终端从移动平台接收到该数据包之后,可将该数据包发送至第二终端。移动平台通过数字通信链路传输数据包,可以提高图像数据的传输质量,提高图像数据的传输距离。并且,第二终端可将数据包传输至播放设备,播放设备可播放该数据包中的图像数据,能够实现对图像数据进行直播,以便观众可以通过该图像数据实时了解移动平台的移动情况。
请参见图3,图3是本申请实施例提供的另一种数据处理方法流程示意图,该方法可以应用于上述图1a的数据处理系统中,如图3所示,该数据处理方法可以包括如下步骤。
S301、移动平台通过数字通信链路将包括图像数据的数据包发送至第一终端。相应地,第一终端可从移动平台接收数据包,若第一终端接收到该数据包,则执行步骤S302;若第一终端未接收到该数据包,则执行步骤S303~S304。
S302、第一终端从移动平台接收到该数据包之后,将该数据包发送至第二终端。
本发明实施例中,对步骤S301的解释说明可参考上述图2中对步骤S201 的解释说明,对步骤S302的解释说明可参考上述图2中对步骤S202的解释说,重复之处不再赘述。
S303、若从该移动平台未接收到该数据包,则第一终端可通过数字通信链路向该移动平台发送第一应答信息,该第一应答信息用于指示该第一终端从该移动平台未接收到该数据包。
若该移动平台在传输数据包的过程中出现网络异常等情况,会导致第一终端不能从该移动平台接收到数据包。因此,若第一终端从移动平台未接收到数据包,则可通过数字通信链路向该移动平台发送第一应答信息,以便移动平台可以重传数据包,可提高数据包传输的可靠性。
需要说明的是,第一终端可以通过数字通信链路针对所有数据包中每个未接收到的数据包向移动平台发送一条第一应答信息。或者,第一终端可以通过数字通信链路针对所有数据包中每个数据包向移动平台发送一条应答信息,该应答信息可以包括ACK或NAK,此处NAK可以是指第一应答信息。第一终端通过数字通信链路针对所有数据包中每个数据包向移动平台发送应答信息的具体实现方式可以参见图1a中相应的描述,在此不赘述。
S304、移动平台从第一终端接收到第一应答信息之后,可以通过数字通信链路重新向第一终端发送该数据包。具体的,移动平台可以接收该第一终端通过数字通信链路发送的第一应答信息,在接收到第一应答信息后,可根据第一应答信息确定第一终端未接收到数据包。并可通过数字通信链路重新向该第一终端发送该数据包,以提高数据包传输的可靠性。相应地,若第一终端从移动平台未接收到重新发送的数据包,则循环执行步骤S303和S304。直到第一终端从移动平台接收到重新发送的数据包,且对重新发送的数据包解码成功,则执行步骤S302。
可选的,在当前数据传输周期内,移动平台可以通过数字通信链路重新向第一终端发送包括所有图像数据的该数据包,或者,移动平台可以根据第一终端的第一应答信息确定目标数据包,通过数字通信链路重新向第一终端发送该目标数据包,即移动平台在当前数据传输周期的冗余时隙中,通过数字通信链路重新向第一终端发送该目标数据包。该目标数据包的确定方式可以参见图1a中对目标数据包确定方式的描述,在此不赘述。
可选的,在当前数据传输周期内,移动平台可以通过数字通信链路重新 向第一终端和第三终端发送包括所有图像数据的该数据包。或者,移动平台可以根据第一终端的第一应答信息确定目标数据包,通过数字通信链路重新向第一终端和第三终端发送该目标数据包,即移动平台在当前数据传输周期的冗余时隙中,通过数字通信链路重新向第一终端和第三终端发送该目标数据包。该目标数据包的确定方式可以参见图1a中对目标数据包确定方式的描述,在此不赘述。
S305、该第二终端从该第一终端接收到该数据包之后,将该数据包发送至播放设备。
S306、播放设备从该第二终端接收到该数据包之后,根据该数据包进行播放。
本发明实施例中,对步骤S305的解释说明可参考上述图2中对步骤S203的解释说明,对步骤S306的解释说明可参考上述图2中对步骤S204的解释说,重复之处不再赘述。
在本发明实施例中,移动平台可通过数字通信链路将包括图像数据的数据包发送至第一终端,若第一终端从移动平台未接收到数据包,则可以向移动平台发送第一应答信息。移动平台接收到第一应答信息后,可通过数字通信链路将数据包重新发送至第一终端,可提高数据包传输的可靠性,并可提高图像数据的传输质量。第一终端从移动平台接收到该数据包,且对数据包解码成功之后,可将该数据包发送至第二终端。进一步,第二终端可将数据包传输至播放设备,播放设备可播放数据包中的图像数据,能够实现对图像数据进行直播,以便观众可以通过该图像数据实时了解移动平台的移动情况。
请参见图4,图4是本申请实施例提供的又一种数据处理方法流程示意图,该方法可以应用于上述图1a的数据处理系统中,如图4所示,该数据处理方法可以包括如下步骤。
S401、移动平台通过数字通信链路将包括图像数据的数据包发送至第一终端。
S402、第一终端从移动平台接收到该数据包之后,且对该数据包解码成功,将该数据包发送至第二终端。
第一终端可从移动平台接收数据包,在接收到该数据包后,可对该数据 包进行解码。若解码成功,则执行步骤S402;若解码失败,则执行步骤S403~S404。解码成功是指第一终端对接收到的数据包进行解码能够得到完整的数据包,且在解码的过程中未出现乱码等异常情况。解码失败是指第一终端对接收到的数据包进行解码不能得到完整的数据包,或在解码的过程中出现乱码等异常情况。
本发明实施例中,对步骤S401的解释说明可参考上述图2中对步骤S201的解释说明,对步骤S402的解释说明可参考上述图2中对步骤S202的解释说,重复之处不再赘述。
S403、若从该移动平台接收到该数据包,且对该数据包解码失败,则第一终端可通过数字通信链路向该移动平台发送第二应答信息,该第二应答信息用于指示该第一终端对该数据包解码失败。
若第一终端对该数据包解码失败,则表明移动平台在对数据包进行编码的过程中或移动平台在传输数据包的过程中出现异常情况。这时如果将数据包发送至第二终端,第二终端也不能成功解码该数据包,并浪费大量带宽资源。因此,若从该移动平台接收到该数据包,且对该数据包解码失败,则第一终端可以可通过数字通信链路向该移动平台发送第二应答信息,以便移动平台可以重传数据包。并可避免第一终端向第二终端传输无效的数据包,可提高带宽资源的利用率,并提高数据包传输的可靠性。
需要说明的是,第一终端可以通过数字通信链路针对所有数据包中每个解码失败的数据包向移动平台发送一条第二应答信息。或者,第一终端可以通过数字通信链路针对所有数据包中每个数据包向移动平台发送一条应答信息,该应答信息可以包括ACK或NAK,此处NAK可以是指第二应答信息。第一终端通过数字通信链路针对所有数据包中每个数据包向移动平台发送应答信息的具体实现方式可以参见图1a中相应的描述,在此不赘述。
S404、移动平台从第一终端接收到第二应答信息之后,可以通过数字通信链路重新向第一终端发送该数据包。具体的,移动平台可以接收该第一终端通过数字通信链路发送的第二应答信息。在接收到第二应答信息后,可根据第二应答信息确定第一终端对数据包解码失败,并可通过数字通信链路重新向该第一终端发送该视频,以提高数据包传输的可靠性。相应地,第一终端可接收移动平台通过数字通信链路重新发送的该数据包。在接收到重新发 送的数据包之后,第一终端可对该重新发送的数据包进行解码,若第一终端对该重新发送的数据包解码失败,则循环执行步骤S403~S404。直到第一终端对重新发送的数据包解码成功,则执行步骤S402。
可选的,在当前数据传输周期内,移动平台可以通过数字通信链路重新向第一终端发送包括所有图像数据的数据包,或者,移动平台可以根据第一终端的第二应答信息确定目标数据包,通过数字通信链路重新向第一终端发送该目标数据包,即移动平台在当前数据传输周期的冗余时隙中,通过数字通信链路重新向第一终端发送该目标数据包。该目标数据包的确定方式可以参见图1a中对目标数据包确定方式的描述,在此不赘述。
可选的,在当前数据传输周期内,移动平台可以通过数字通信链路重新向第一终端和第三终端发送包括所有图像数据的数据包。或者,移动平台可以根据第一终端的第二应答信息确定目标数据包,通过数字通信链路重新向第一终端和第三终端发送该目标数据包,即移动平台在当前数据传输周期的冗余时隙中,通过数字通信链路重新向第一终端和第三终端发送该目标数据包。该目标数据包的确定方式可以参见图1a中对目标数据包确定方式的描述,在此不赘述。
S405、该第二终端从该第一终端接收到该数据包之后,将该数据包发送至播放设备。
S406、播放设备从该第二终端接收到该数据包之后,根据该数据包进行播放。
本发明实施例中,对步骤S405的解释说明可参考上述图2中对步骤S203的解释说明,对步骤S406的解释说明可参考上述图2中对步骤S204的解释说,重复之处不再赘述。
在本发明实施例中,移动平台可通过数字通信链路将包括图像数据的数据包发送至第一终端,若第一终端从移动平台接收到数据包,且对数据包解码失败,则可以向移动平台发送第二应答信息。移动平台接收到第二应答信息后,可通过数字通信链路将数据包重新发送至第一终端,可提高数据包传输的可靠性,并可提高图像数据的传输质量。第一终端从移动平台接收到该数据包,且对数据包解码成功之后,可将该数据包发送至第二终端。进一步,第二终端可将数据包传输至播放设备,播放设备可播放数据包中的图像数据, 能够实现对图像数据进行直播,以便观众可以通过该图像数据实时了解移动平台的移动情况。
请参见图5,图5是本发明实施例提供的移动平台的结构示意图,具体的,所述移动平台包括:存储器501、处理器502、拍摄装置503、数字图传收发机504及移动装置505。
所述存储器501可以包括易失性存储器(volatile memory);存储器501也可以包括非易失性存储器(non-volatile memory);存储器501还可以包括上述种类的存储器的组合。所述处理器502可以是中央处理器(central processing unit,CPU)。所述处理器502还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA)或其任意组合。
所述拍摄装置503,用于拍摄得到图像数据。可选的,所述拍摄装置503,还用于进行录像。所述数字图传收发机504,用于收发信息。例如,所述数字图传收发机504,用于向第一终端发送包括图像数据的数据包,并用于接收第一终端发送的第一应答信息或第二应答信息。所述移动装置505,用于控制所述移动平台移动。
在一个实施例中,所述存储器,用于存储程序指令;所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
通过数字通信链路将包括图像数据的数据包发送至第一终端,以使所述第一终端将所述数据包发送至第二终端,由所述第二终端将所述数据包发送至播放设备,并由所述播放设备根据所述数据包进行播放。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
与所述第一终端建立点对点数字通信连接;通过所述点对点数字通信连接将包括图像数据的数据包发送至所述第一终端。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收所述第一终端通过数字通信链路发送的第一应答信息,所述第一应答信息用于指示所述第一终端从所述移动平台未接收到所述数据包;通过数 字通信链路重新向所述第一终端发送所述数据包。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收所述第一终端通过数字通信链路发送的第二应答信息,所述第二应答信息用于指示所述第一终端对所述数据包解码失败;通过数字通信链路重新向所述第一终端发送所述数据包。
其中,所述数据包中的图像数据的分辨率大于预设分辨率阈值。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
通过数字通信链路将所述数据包发送至第三终端。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
通过数字通信链路将所述数据包广播至所述第三终端。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收第四终端通过数字通信链路发送的控制指令,所述控制指令由所述第四终端在控制指令传输时隙内所发送的;执行所述控制指令。
在本发明实施例中,移动平台可通过数字通信链路将包括图像数据的数据包发送至第一终端,以使该第一终端将该数据包发送至第二终端,由该第二终端将所述数据包发送至播放设备,并由该播放设备根据所述数据包进行播放。移动平台通过数字通信链路传输数据包,可以提高图像数据的传输质量。
请参见图6,图6是本发明实施例提供的一种终端的结构示意图,所述终端为图1a中的第一终端,具体的,所述终端包括:存储器601及、处理器602、数字图传收发机603及播放装置604。
所述存储器601可以包括易失性存储器(volatile memory);存储器601也可以包括非易失性存储器(non-volatile memory);存储器601还可以包括上述种类的存储器的组合。所述处理器602可以是中央处理器(central processing unit,CPU)。所述处理器602还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA)或其任意组合。
所述数字图传收发机603,用于收发信息,例如,所述数字图传收发机603,用于接收移动平台发送的包括图像数据的数据包,并用于在第一终端从移动平台中未接收到该数据包,或对该数据包解码失败时,向移动平台发送应答信息。该应答信息包括第一应答信息或第二应答信息。所述播放装置604,用于播放数据包中的图像数据。
在一个实施例中,所述存储器,用于存储程序指令;所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收移动平台通过数字通信链路发送的包括图像数据的数据包;
从所述移动平台接收到所述数据包之后,将所述数据包发送至第二终端,以使所述第二终端将所述数据包发送至播放设备,由所述播放设备根据所述数据包进行播放。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
与所述移动平台建立点对点数字通信连接;接收所述移动平台通过所述点对点数字通信连接发送的包括图像数据的数据包。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
若从所述移动平台接收到所述数据包,且对所述数据包解码成功,则将所述数据包发送至所述第二终端。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
若从所述移动平台未接收到所述数据包,则通过数字通信链路向所述移动平台发送第一应答信息,所述第一应答信息用于指示所述第一终端从所述移动平台未接收到所述数据包;接收所述移动平台在接收到所述应答信息之后,通过数字通信链路重新发送的所述数据包。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
若从所述移动平台接收到所述数据包,且对所述数据包解码失败,则通过数字通信链路向所述移动平台发送第二应答信息,所述第二应答信息用于指示所述第一终端对所述数据包解码失败;接收所述移动平台在接收到所述第一应答信息之后,通过数字通信链路重新发送的所述数据包。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
通过有线通信连接将所述数据包发送至所述第二终端。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
对所述数据包进行加密,得到加密后的数据包;通过所述有线通信连接将所述加密后的数据包发送至所述第二终端。
在本发明实施例中,第一终端可接收移动平台通过数字通信链路发送的数据包。从该移动平台接收到该数据包之后,将该数据包发送至第二终端,以使该第二终端将所述数据包发送至播放设备,由该播放设备播放该数据包中的图像数据。第一终端接收移动平台通过数字通信链路传输数据包,可以提高图像数据的传输质量。
请参见图7,图7是本发明实施例提供的一种终端的结构示意图,所述终端为图1a中的第二终端,具体的,所述终端包括:存储器701、处理器702。
所述存储器701可以包括易失性存储器(volatile memory);存储器701也可以包括非易失性存储器(non-volatile memory);存储器701还可以包括上述种类的存储器的组合。所述处理器702可以是中央处理器(central processing unit,CPU)。所述处理器702还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA)或其任意组合。
在一个实施例中,所述存储器,用于存储程序指令;所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收第一终端发送的包括图像数据的数据包,所述数据包是由所述移动平台通过数字通信链路发送至所述第一终端的;将所述数据包发送至播放设备,以使所述播放设备根据所述数据包进行播放。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收所述第一终端通过有线通信连接发送的所述数据包。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收所述第一终端通过所述有线通信连接发送的所述加密后的数据包,所述加密后的数据包是由所述第一终端对所述数据包进行加密得到的。
在本发明实施例中,第二终端可接收第一终端发送的数据包,将该数据包发送至播放设备,以使该播放设备播放该数据包中的图像数据。通过第二 终端将该数据包发送至播放设备,以便播放设备可以播放该数据包中的图像数据,能够实现对图像数据进行直播。
请参见图8,图8是本发明实施例提供的一种终端的结构示意图,所述终端为图1a中的第三终端,具体的,所述终端包括:存储器801、处理器802、数字图传收发机803及播放装置804。
所述存储器801可以包括易失性存储器(volatile memory);存储器801也可以包括非易失性存储器(non-volatile memory);存储器801还可以包括上述种类的存储器的组合。所述处理器802可以是中央处理器(central processing unit,CPU)。所述处理器802还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA)或其任意组合。
所述数字图传收发机803,用于接收移动平台发送的数据包。所述播放装置804,用于根据所述数据包进行播放。
在一个实施例中,所述存储器,用于存储程序指令;所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收移动平台通过数字通信链路发送的包括图像数据的数据包;其中,在所述第三终端从所述移动平台未接收到所述数据包时,所述第三终端不发送第三应答信息至所述移动平台,所述第三应答信息用于指示所述第三终端从所述移动平台未接收到所述数据包,或者,在所述第三终端从所述移动平台接收到所述数据包,且对所述数据包进行解码失败时,所述第三终端不发送第四应答信息至所述移动平台,所述第四应答信息用于指示所述第三终端对所述数据包解码失败。
可选的,所述处理器,调用所述存储器存储的程序指令,执行以下步骤:
接收所述移动平台通过数字通信链路所广播的数据包。
在本发明实施例中,第三终端可接收移动平台通过数字通信链路发送的数据包,以便第三终端可以播放该数据包中的图像数据,观众可通过该图像数据实时了解移动平台的移动情况。第三终端不需要向移动平台发送应答信 息,即第三终端不占用上行带宽资源,这样移动平台可以向更多第三终端传输数据包,可以提高带宽资源的利用率。
请参见图9,图9是本发明实施例提供的一种终端的结构示意图,所述终端为图1a中的第四终端,具体的,所述终端包括:存储器901、处理器902、数字飞控命令发射机903及交互装置904。
所述存储器901可以包括易失性存储器(volatile memory);存储器901也可以包括非易失性存储器(non-volatile memory);存储器901还可以包括上述种类的存储器的组合。所述处理器902可以是中央处理器(central processing unit,CPU)。所述处理器902还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA)或其任意组合。
所述交互装置904,用于接收用户输入的控制指令。所述数字飞控命令发射机903,用于向移动平台发送所述控制指令。
在一个实施例中,所述存储器,用于存储程序指令;所述处理器,调用所述存储器存储的程序指令,执行以下步骤:接收用户输入的控制指令;在控制指令传输时隙内,通过数字通信链路将所述控制指令发送至移动平台,以使所述移动平台执行所述控制指令。
在本发明实施例中,第四终端通过数字通信链路向移动平台发送控制指令,可降低控制指令的传输时延,可实现移动平台与第四终端之间的全同步。
在本发明实施例中还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现本发明图2-图4所对应实施例中描述的数据处理方法,也可实现图5所述发明实施例的移动平台及图6-图9所述发明实施例的终端,在此不赘述。
所述计算机可读存储介质可以是前述任一实施例所述的移动平台或终端的内部存储单元,例如设备的硬盘或内存。所述计算机可读存储介质也可以是所述车辆控制装置的外部存储设备,例如所述设备上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡, 闪存卡(Flash Card)等。进一步地,所述计算机可读存储介质还可以既包括所述设备的内部存储单元也包括外部存储设备。所述计算机可读存储介质用于存储所述计算机程序以及所述移动平台或终端所需的其他程序和数据。所述计算机可读存储介质还可以用于暂时地存储已经输出或者将要输出的数据。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,所述程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。以上所揭露的仅为本发明较佳实施例而已,当然不能以此来限定本发明之权利范围,因此依本发明权利要求所作的等同变化,仍属本发明所涵盖的范围。

Claims (44)

  1. 一种数据处理方法,其特征在于,应用于数据处理系统,所述数据处理系统包括移动平台、第一终端、第二终端及播放设备,所述方法包括:
    所述移动平台通过数字通信链路将包括图像数据的数据包发送至所述第一终端;
    所述第一终端从所述移动平台接收到所述数据包之后,将所述数据包发送至所述第二终端;
    所述第二终端从所述第一终端接收到所述数据包之后,将所述数据包发送至所述播放设备;
    所述播放设备从所述第二终端接收到所述数据包之后,根据所述数据包进行播放。
  2. 根据权利要求1所述的方法,其特征在于,所述移动平台通过数字通信链路将包括图像数据的数据包发送至所述第一终端之前,所述方法还包括:
    所述移动平台与所述第一终端建立点对点数字通信连接;
    所述移动平台通过数字通信链路将包括图像数据的数据包发送至所述第一终端,包括:
    所述移动平台通过所述点对点数字通信连接将包括图像数据的数据包发送至所述第一终端。
  3. 根据权利要求1或2所述的方法,其特征在于,所述第一终端从所述移动平台接收到所述数据包之后,将所述数据包发送至所述第二终端,包括:
    若所述第一终端从所述移动平台接收到所述数据包,且对所述数据包解码成功,则将所述数据包发送至所述第二终端。
  4. 根据权利要求1或2所述的方法,其特征在于,所述移动平台通过数字通信链路将包括图像数据的数据包发送至所述第一终端之后,所述方法还包括:
    若所述第一终端从所述移动平台未接收到所述数据包,则通过数字通信链路向所述移动平台发送第一应答信息,所述第一应答信息用于指示所述第 一终端从所述移动平台未接收到所述数据包;
    所述移动平台接收到所述第一应答信息之后,通过数字通信链路重新向所述第一终端发送所述数据包。
  5. 根据权利要求1或2所述的方法,其特征在于,所述移动平台通过数字通信链路将包括图像数据的数据包发送至所述第一终端之后,所述方法还包括:
    若所述第一终端从所述移动平台接收到所述数据包,且对所述数据包解码失败,则通过数字通信链路向所述移动平台发送第二应答信息,所述第二应答信息用于指示所述第一终端对所述数据包解码失败;
    所述移动平台接收到所述第二应答信息之后,通过数字通信链路重新向所述第一终端发送所述数据包。
  6. 根据权利要求1或2所述的方法,其特征在于,所述将所述数据包发送至所述第二终端,包括:
    所述第一终端通过有线通信连接将所述数据包发送至所述第二终端。
  7. 根据权利要求6所述的方法,其特征在于,所述第一终端通过有线通信连接将所述数据包发送至所述第二终端,包括:
    所述第一终端对所述数据包进行加密,得到加密后的数据包;
    所述第一终端通过所述有线通信连接将所述加密后的数据包发送至所述第二终端。
  8. 根据权利要求1或2所述的方法,其特征在于,所述数据包中的图像数据是通过所述移动平台的拍摄装置拍摄得到的,所述拍摄装置还用于进行录像。
  9. 根据权利要求1或2所述的方法,其特征在于,所述数据包中的图像数据的分辨率大于预设分辨率阈值。
  10. 根据权利要求1或2所述的方法,其特征在于,所述数据处理系统还包括第三终端,所述方法还包括:
    所述移动平台通过数字通信链路将所述数据包发送至所述第三终端。
  11. 根据权利要求10所述的方法,其特征在于,所述移动平台通过数字通信链路将所述数据包发送至所述第三终端,包括:
    所述移动平台通过数字通信链路将所述数据包广播至所述第三终端。
  12. 根据权利要求10所述的方法,其特征在于,在所述第三终端从所述移动平台未接收到所述数据包时,所述第三终端不发送第三应答信息至所述移动平台,所述第三应答信息用于指示所述第三终端从所述移动平台未接收到所述数据包。
  13. 根据权利要求10所述的方法,其特征在于,在所述第三终端从所述移动平台接收到所述数据包,且对所述数据包解码失败时,所述第三终端不发送第四应答信息至所述移动平台,所述第四应答信息用于指示所述第三终端对所述数据包解码失败。
  14. 根据权利要求1或2所述的方法,其特征在于,所述播放设备根据所述数据包进行播放,包括:
    所述播放设备根据所述数据包进行直播。
  15. 根据权利要求1或2所述的方法,其特征在于,所述数据处理系统还包括第四终端,所述方法还包括:
    所述第四终端接收用户输入的控制指令;
    所述第四终端在控制指令传输时隙内,通过数字通信链路将所述控制指令发送至所述移动平台;
    所述移动平台从所述第四终端接收到所述控制指令后,执行所述控制指令。
  16. 一种数据处理方法,其特征在于,应用于移动平台,所述方法包括:
    通过数字通信链路将包括图像数据的数据包发送至第一终端,以使所述第一终端将所述数据包发送至第二终端,并由所述第二终端将所述数据包发送至播放设备,并由所述播放设备根据所述数据包进行播放。
  17. 根据权利要求16所述的方法,其特征在于,所述通过数字通信链路将包括图像数据的数据包发送至所述第一终端之前,所述方法还包括:
    与所述第一终端建立点对点数字通信连接;
    所述通过数字通信链路将包括图像数据的数据包发送至所述第一终端,包括:
    通过所述点对点数字通信连接将包括图像数据的数据包发送至所述第一终端。
  18. 根据权利要求16或17所述的方法,其特征在于,所述通过数字通信链路将包括图像数据的数据包发送至所述第一终端之后,所述方法还包括:
    接收所述第一终端通过数字通信链路发送的第一应答信息,所述第一应答信息用于指示所述第一终端从所述移动平台未接收到所述数据包;
    通过数字通信链路重新向所述第一终端发送所述数据包。
  19. 根据权利要求16或17所述的方法,其特征在于,所述通过数字通信链路将包括图像数据的数据包发送至所述第一终端之后,所述方法还包括:
    接收所述第一终端通过数字通信链路发送的第二应答信息,所述第二应答信息用于指示所述第一终端对所述数据包解码失败;
    通过数字通信链路重新向所述第一终端发送所述数据包。
  20. 根据权利要求16或17所述的方法,其特征在于,所述数据包中的图像数据是通过所述移动平台的拍摄装置拍摄得到的;所述拍摄装置还用于进行录像。
  21. 根据权利要求16或17所述的方法,其特征在于,所述数据包中的图像数据的分辨率大于预设分辨率阈值。
  22. 根据权利要求16或17所述的方法,其特征在于,所述方法还包括:
    通过数字通信链路将所述数据包发送至第三终端。
  23. 根据权利要求22所述的方法,其特征在于,所述通过数字通信链路将所述数据包发送至第三终端,包括:
    通过数字通信链路将所述数据包广播至所述第三终端。
  24. 根据权利要求16或17所述的方法,其特征在于,所述方法还包括:
    接收第四终端通过数字通信链路发送的控制指令,所述控制指令由所述第四终端在控制指令传输时隙内所发送的;
    执行所述控制指令。
  25. 一种数据处理方法,其特征在于,应用于第一终端,所述方法包括:
    接收移动平台通过数字通信链路发送的包括图像数据的数据包;
    从所述移动平台接收到所述数据包之后,将所述数据包发送至第二终端,以使所述第二终端将所述数据包发送至播放设备,并由所述播放设备根据所述数据包进行播放。
  26. 根据权利要求25所述的方法,其特征在于,所述接收移动平台通过数字通信链路发送的包括图像数据的数据包之前,所述方法还包括:
    与所述移动平台建立点对点数字通信连接;
    所述接收移动平台通过数字通信链路发送的包括图像数据的数据包,包括:
    接收所述移动平台通过所述点对点数字通信连接发送的包括图像数据的数据包。
  27. 根据权利要求25或26所述的方法,其特征在于,所述从所述移动 平台接收到所述数据包之后,将所述数据包发送至所述第二终端,包括:
    若从所述移动平台接收到所述数据包,且对所述数据包解码成功,则将所述数据包发送至所述第二终端。
  28. 根据权利要求25或26所述的方法,其特征在于,所述接收移动平台通过数字通信链路发送的包括图像数据的数据包之后,所述方法还包括:
    若从所述移动平台未接收到所述数据包,则通过数字通信链路向所述移动平台发送第一应答信息,所述第一应答信息用于指示所述第一终端从所述移动平台未接收到所述数据包;
    接收所述移动平台在接收到所述应答信息之后,通过数字通信链路重新发送的所述数据包。
  29. 根据权利要求25或26所述的方法,其特征在于,所述接收移动平台通过数字通信链路发送的包括图像数据的数据包之后,所述方法还包括:
    若从所述移动平台接收到所述数据包,且对所述数据包解码失败,则通过数字通信链路向所述移动平台发送第二应答信息,所述第二应答信息用于指示所述第一终端对所述数据包解码失败;
    接收所述移动平台在接收到所述第一应答信息之后,通过数字通信链路重新发送的所述数据包。
  30. 根据权利要求25或26所述的方法,其特征在于,所述将所述数据包发送至所述第二终端,包括:
    通过有线通信连接将所述数据包发送至所述第二终端。
  31. 根据权利要求30所述的方法,其特征在于,所述通过有线通信连接将所述数据包发送至所述第二终端,包括:
    对所述数据包进行加密,得到加密后的数据包;
    通过所述有线通信连接将所述加密后的数据包发送至所述第二终端。
  32. 一种数据处理方法,其特征在于,应用于第二终端,所述方法包括:
    接收第一终端发送的包括图像数据的数据包,所述数据包是由移动平台通过数字通信链路发送至所述第一终端的;
    将所述数据包发送至播放设备,以使所述播放设备根据所述数据包进行播放。
  33. 根据权利要求32所述的方法,其特征在于,所述接收第一终端发送的包括图像数据的数据包,包括:
    接收所述第一终端通过有线通信连接发送的包括图像数据的数据包。
  34. 根据权利要求33所述的方法,其特征在于,所述接收所述第一终端通过有线通信连接发送的包括图像数据的数据包,包括:
    接收所述第一终端通过所述有线通信连接发送的所述加密后的包括图像数据的数据包,所述加密后的包括图像数据的数据包是由所述第一终端对所述包括图像数据的数据包进行加密得到的。
  35. 一种数据处理方法,其特征在于,应用于第三终端,所述方法包括:
    接收移动平台通过数字通信链路发送的包括图像数据的数据包;其中,在所述第三终端从所述移动平台未接收到所述数据包时,所述第三终端不发送第三应答信息至所述移动平台,所述第三应答信息用于指示所述第三终端从所述移动平台未接收到所述数据包,或者,在所述第三终端从所述移动平台接收到所述数据包,且对所述数据包进行解码失败时,所述第三终端不发送第四应答信息至所述移动平台,所述第四应答信息用于指示所述第三终端对所述数据包解码失败。
  36. 根据权利要求35所述的方法,其特征在于,所述接收移动平台通过数字通信链路发送的包括图像数据的数据包,包括:
    接收所述移动平台通过数字通信链路所广播的包括图像数据的数据包。
  37. 一种数据处理方法,其特征在于,应用于第四终端,所述方法包括:
    接收用户输入的控制指令;
    在控制指令传输时隙内,通过数字通信链路将所述控制指令发送至移动平台,以使所述移动平台执行所述控制指令。
  38. 一种数据处理系统,其特征在于,所述数据处理系统包括移动平台、第一终端、第二终端及播放设备,其中,所述移动平台、所述第一终端、所述第二终端及所述播放设备用于执行如权利要求1-15所述的数据处理方法。
  39. 一种移动平台,其特征在于,所述移动平台包括:拍摄装置、数字图传收发机、移动装置、存储器及处理器,其中,
    所述移动装置,用于控制所述移动平台移动;
    所述拍摄装置,用于拍摄得到图像数据;
    所述数字图传收发机,用于收发信息;
    所述存储器,用于存储程序指令;
    所述处理器,用于调用所述存储器存储的程序指令,执行如权利要求16-24所述的数据处理方法。
  40. 一种终端,其特征在于,所述终端包括数字图传收发机、播放装置、存储器及处理器,
    所述数字图传收发机,用于收发信息;
    所述播放装置,用于根据数据包进行播放;
    所述存储器,用于存储程序指令;
    所述处理器,用于调用所述存储器存储的程序指令,执行如权利要求25-31所述的数据处理方法。
  41. 一种终端,其特征在于,所述终端包括存储器及处理器,
    所述存储器,用于存储程序指令;
    所述处理器,用于调用所述存储器存储的程序指令,执行如权利要求32-34所述的数据处理方法。
  42. 一种终端,其特征在于,所述终端包括数字图传收发机、播放装置、 存储器及处理器,
    所述数字图传收发机,用于接收包括图像数据的数据包;
    所述播放装置,用于根据所述数据包进行播放;
    所述存储器,用于存储程序指令;
    所述处理器,用于调用所述存储器存储的程序指令,执行如权利要求35-36所述的数据处理方法。
  43. 一种终端,其特征在于,所述终端包括数字飞控命令发射机、交互装置、存储器及处理器,
    所述交互装置,用于接收用户输入的控制指令;
    所述数字飞控命令发射机,用于发送所述控制指令;
    所述存储器,用于存储程序指令;
    所述处理器,用于调用所述存储器存储的程序指令,执行如权利要求37所述的数据处理方法。
  44. 一种计算机可读存储介质,其特征在于,包括:所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时用于执行如权利要求1至37任一项所述数据处理方法。
PCT/CN2019/091298 2019-06-14 2019-06-14 数据处理方法、系统、移动平台、终端及存储介质 WO2020248233A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/091298 WO2020248233A1 (zh) 2019-06-14 2019-06-14 数据处理方法、系统、移动平台、终端及存储介质
CN201980008437.0A CN111684813A (zh) 2019-06-14 2019-06-14 数据处理方法、系统、移动平台、终端及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/091298 WO2020248233A1 (zh) 2019-06-14 2019-06-14 数据处理方法、系统、移动平台、终端及存储介质

Publications (1)

Publication Number Publication Date
WO2020248233A1 true WO2020248233A1 (zh) 2020-12-17

Family

ID=72433226

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/091298 WO2020248233A1 (zh) 2019-06-14 2019-06-14 数据处理方法、系统、移动平台、终端及存储介质

Country Status (2)

Country Link
CN (1) CN111684813A (zh)
WO (1) WO2020248233A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023178609A1 (zh) * 2022-03-24 2023-09-28 深圳市大疆创新科技有限公司 图像处理方法、系统、终端及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101268639A (zh) * 2005-07-22 2008-09-17 袋鼠传媒股份有限公司 用于增强观众参与现场体育赛事的体验的系统和方法
CN101686350A (zh) * 2008-09-22 2010-03-31 索尼株式会社 显示控制设备、显示控制方法以及程序
CN104640072A (zh) * 2015-02-04 2015-05-20 湖南简成信息技术有限公司 实时在线比赛方法及装置、观看比赛方法及装置和系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103490842B (zh) * 2013-09-26 2016-09-28 深圳市大疆创新科技有限公司 数据传输系统及方法
CN204314724U (zh) * 2014-07-26 2015-05-06 西安展翼航空科技有限公司 一种高速无人机遥控系统
WO2017145217A1 (ja) * 2016-02-22 2017-08-31 オリンパス株式会社 撮像端末、撮像システム、撮像方法、プログラムおよび撮像指示端末
WO2017185316A1 (zh) * 2016-04-29 2017-11-02 深圳市大疆创新科技有限公司 一种无人机第一视角飞行的控制方法及系统、智能眼镜
CN106603481A (zh) * 2016-07-22 2017-04-26 深圳曼塔智能科技有限公司 数据传输方法及装置
CN106375062A (zh) * 2016-08-29 2017-02-01 浙江华飞智能科技有限公司 一种遥控系统的控制方法及主设备
CN207283720U (zh) * 2017-05-09 2018-04-27 北京航天泰坦科技股份有限公司 一种基于卫星通信的无人机航拍视频图传系统
CN109120383B (zh) * 2017-06-26 2021-11-26 深圳市道通智能航空技术股份有限公司 无人机及其地面站、数据传输方法
CN109392152B (zh) * 2017-08-11 2023-06-09 华为技术有限公司 通信方法和通信装置
CN107733521A (zh) * 2017-10-31 2018-02-23 北京邮电大学 一种无人机数据传输方法、装置及系统
CN108495371B (zh) * 2018-03-28 2022-08-16 广州极飞科技股份有限公司 通信方法及系统、应用其的主设备和从设备以及无人机
CN208399999U (zh) * 2018-07-23 2019-01-18 河北冉冉无人机科技有限公司 基于数字通信的无人机远程控制系统
CN109861744A (zh) * 2019-03-20 2019-06-07 京信通信系统(中国)有限公司 数据回传方法、装置、终端、无人机和可读存储介质
CN109831662B (zh) * 2019-03-22 2021-10-08 芋头科技(杭州)有限公司 Ar眼镜屏幕的实时画面投射方法、装置及控制器和介质

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101268639A (zh) * 2005-07-22 2008-09-17 袋鼠传媒股份有限公司 用于增强观众参与现场体育赛事的体验的系统和方法
CN101686350A (zh) * 2008-09-22 2010-03-31 索尼株式会社 显示控制设备、显示控制方法以及程序
CN104640072A (zh) * 2015-02-04 2015-05-20 湖南简成信息技术有限公司 实时在线比赛方法及装置、观看比赛方法及装置和系统

Also Published As

Publication number Publication date
CN111684813A (zh) 2020-09-18

Similar Documents

Publication Publication Date Title
CN109996097B (zh) 一种投屏方法、系统及存储装置
US20210160480A1 (en) System and methods for feedback-based data transmission
KR101066768B1 (ko) 네트워크 통신용 시간인식 최선형 홀-필링 재시도 방법 및 시스템
CN105704580B (zh) 一种视频传输方法
US20040177377A1 (en) One to many transmission method and system to transmit real-time video and audio data on wireless local area network
US20100125768A1 (en) Error resilience in video communication by retransmission of packets of designated reference frames
WO2015127670A1 (zh) 一种数据重传的方法和装置
JP5553663B2 (ja) 映像送信装置、映像受信装置、映像伝送システム
WO2020248233A1 (zh) 数据处理方法、系统、移动平台、终端及存储介质
US9191696B2 (en) Reception device and program for reception device
WO2020248267A1 (zh) 数据传输系统、方法、发送端和计算机可读介质
JP2007502585A (ja) データ技術領域を送信する装置、システムおよび方法
KR20210141295A (ko) 엣지 컴퓨팅 서비스를 이용한 영상 컨텐츠 전송 방법 및 장치
KR101710011B1 (ko) 영상 데이터 전송 및 수신 방법 및 장치
US20180270507A1 (en) Method for encoding streams of video data based on groups of pictures (gop)
US20130339482A1 (en) Data transmitting system, and transmitting apparatus and receiving apparatus and program in data transmitting system
JP5682292B2 (ja) 映像配信装置及び映像配信方法
CN111602389B (zh) 码流的传输控制方法、设备及计算机可读存储介质
CN112954405A (zh) 数据包恢复方法、装置和系统
JP5947631B2 (ja) 受信装置及び受信装置用プログラム
WO2021134346A1 (zh) 一种反馈方法及装置
KR102145285B1 (ko) 실시간 영상과 고품질 영상을 함께 제공하기 위한 송수신장치
WO2023210705A1 (ja) 通信制御方法
WO2021146840A1 (zh) 一种通信方法、可移动平台、控制设备及通信系统
EP4138395A1 (en) Image content transmission method and apparatus using edge computing service

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19932570

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19932570

Country of ref document: EP

Kind code of ref document: A1