WO2020233462A1 - Communication method for unmanned vehicle, and unmanned vehicle - Google Patents

Communication method for unmanned vehicle, and unmanned vehicle Download PDF

Info

Publication number
WO2020233462A1
WO2020233462A1 PCT/CN2020/089932 CN2020089932W WO2020233462A1 WO 2020233462 A1 WO2020233462 A1 WO 2020233462A1 CN 2020089932 W CN2020089932 W CN 2020089932W WO 2020233462 A1 WO2020233462 A1 WO 2020233462A1
Authority
WO
WIPO (PCT)
Prior art keywords
communication channel
video data
remote control
control device
data
Prior art date
Application number
PCT/CN2020/089932
Other languages
French (fr)
Chinese (zh)
Inventor
鲍志强
Original Assignee
菜鸟智能物流控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 菜鸟智能物流控股有限公司 filed Critical 菜鸟智能物流控股有限公司
Publication of WO2020233462A1 publication Critical patent/WO2020233462A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • H04L43/0829Packet loss
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays
    • H04L43/0864Round trip delays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/004Diagnosis, testing or measuring for television systems or their details for digital television systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738Monitoring network characteristics, e.g. bandwidth, congestion level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/12Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • This application relates to the field of communication technology, in particular to an unmanned vehicle communication method and an unmanned vehicle.
  • parallel driving means that the unmanned vehicle collects the video of the road through the camera and uploads the collected video to the remote control device.
  • the user can remotely control the device and remotely control the unmanned vehicle based on the video.
  • the unmanned vehicle can establish a communication channel with the remote control device, and upload the collected video to the remote control device through the communication channel.
  • the driver can use the remote control device to transmit back according to the unmanned vehicle.
  • the embodiments of the present application are proposed to provide an unmanned vehicle communication method and an unmanned vehicle that overcome the above problems or at least partially solve the above problems.
  • an embodiment of the present application discloses an unmanned vehicle communication method, wherein the unmanned vehicle has a video capture device, and the method includes:
  • the unmanned vehicle has multiple network cards
  • the establishing multiple communication channels with the remote control device includes:
  • the preset webpage instant messaging WebRTC API is called, and the multiple network cards are used to respectively establish multiple communication channels with the remote control device.
  • using the video data to determine corresponding redundant video data for other communication channels except the target communication channel includes:
  • the video data is used to determine corresponding redundant video data for communication channels other than the target communication channel.
  • the use of the video data to determine corresponding redundant video data for other communication channels except the target communication channel includes:
  • video frames are selected as redundant video data according to a preset frame interval.
  • the determining the evaluation time point includes:
  • it also includes:
  • the amount of data received by the remote control device in each communication channel and the amount of data sent by each communication channel are used to calculate the transmission success rate of each communication channel.
  • the obtaining the data reception volume of the remote control device in each communication channel includes:
  • the determining the data transmission volume of each communication channel includes:
  • the calculation of the transmission success rate of each communication channel using the amount of data received by the remote control device in each communication channel and the amount of data sent in each communication includes:
  • the amount of data received by the remote control device on each communication channel between two adjacent evaluation time points and the amount of data sent by each communication channel between two adjacent evaluation time points are used to calculate Describe the transmission success rate of each communication channel.
  • the selecting a target communication channel from the multiple communication channels includes:
  • the communication channel with the highest transmission success rate determined after the previous evaluation time point is selected as the target communication channel after the current evaluation time point.
  • the embodiment of the application also discloses an unmanned vehicle, the unmanned vehicle has a video capture device, and the unmanned vehicle further includes:
  • Communication channel establishment module used to establish multiple communication channels with remote control equipment
  • a video data sending module configured to select a target communication channel from the multiple communication channels, and send the video data collected by the video acquisition device to the remote control device on the target communication channel;
  • the redundant video data determining module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after a communication problem is detected;
  • the redundant video data sending module is used to send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
  • the communication channel establishment module includes:
  • the communication channel establishment sub-module is used to call the preset webpage instant messaging WebRTC API, and use the multiple network cards to respectively establish multiple communication channels with the remote control device.
  • the redundant video data determining module includes:
  • the evaluation time point determination sub-module is used to determine the evaluation time point after a communication problem is detected
  • the redundant video data determining sub-module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after the evaluation time point.
  • the redundant video data determining submodule includes:
  • the redundant video data determining unit is configured to select video frames as redundant video data according to a preset frame interval among the video frames included in the video data for communication channels other than the target communication channel.
  • the evaluation time point determination sub-module includes:
  • the evaluation time point determining unit is used to determine the evaluation time point according to a preset time period.
  • it also includes:
  • a data receiving amount acquisition module configured to acquire the data receiving amount of the remote control device in each communication channel
  • the data transmission volume determination module is used to determine the data transmission volume of each communication channel
  • the transmission success rate calculation module is used to calculate the transmission success rate of each communication channel by using the data reception amount of each communication channel of the remote control device and the data transmission amount of each communication channel.
  • the data receiving amount acquisition module includes:
  • the data reception volume receiving submodule is used to receive the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
  • the data transmission amount determining module includes:
  • the data transmission volume determination sub-module is used to determine the data transmission volume of each communication channel between two adjacent evaluation time points.
  • the sending success rate calculation module includes:
  • the transmission success rate calculation sub-module is used to adopt the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points, and the data reception between two adjacent evaluation time points.
  • the data transmission quantity of the communication channel is calculated, and the transmission success rate of each communication channel is calculated.
  • the video data sending module includes:
  • the target communication channel selection sub-module is used to select the communication channel with the highest transmission success rate determined after the previous evaluation time point as the target communication channel after the current evaluation time point.
  • the embodiment of the application also discloses a device, including:
  • One or more processors are One or more processors.
  • One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the apparatus to perform one or more of the methods described above.
  • the embodiment of the present application also discloses one or more machine-readable media, on which instructions are stored, which, when executed by one or more processors, cause the processors to execute one or more of the methods described above.
  • the unmanned vehicle can establish multiple communication channels with the remote control device. Under normal communication conditions, the unmanned vehicle only sends video data to the remote control device at one target of the multiple communication channels. After the communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel.
  • the embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
  • FIG. 1 is a flowchart of the steps of Embodiment 1 of an unmanned vehicle communication method according to the present application;
  • Embodiment 2 is a flowchart of the steps of Embodiment 2 of an unmanned vehicle communication method of the present application;
  • Figure 3 is a schematic diagram of sending redundant video data in an embodiment of the present application.
  • Fig. 4 is a structural block diagram of an embodiment of an unmanned vehicle of the present application.
  • the unmanned vehicle in order to improve the safety of the unmanned vehicle, may establish multiple communication channels with the remote control device.
  • the unmanned vehicle will only send video data to the remote control device on one target communication channel; when the unmanned vehicle has communication problems, the unmanned vehicle will still send video data to the remote control device in the main channel , And at the same time send redundant video data to the remote control equipment on multiple communication channels other than the target channel. Even if the video data transmission of the target communication channel fails, the redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain the video data smoothly, avoiding the security problems caused by the loss of video data.
  • the specific implementation is described in detail below.
  • Embodiment 1 of an unmanned vehicle communication method there is shown a step flow chart of Embodiment 1 of an unmanned vehicle communication method according to the present application.
  • the unmanned vehicle may have a video capture device, and the method includes: specifically may include the following steps:
  • Step 101 Establish multiple communication channels with remote control equipment
  • the unmanned vehicle in the embodiments of the present application may refer to a vehicle that has no driver in the vehicle but can be driven remotely by the driver.
  • a remote control device for example, a PC or a console
  • the parallel driving scheme is suitable for unmanned vehicles such as unmanned vehicles in warehouse distribution logistics and mining vehicles.
  • the remote control device can simultaneously control multiple unmanned vehicles connected end to end to move in the warehouse.
  • the unmanned vehicle and the remote control device establish multiple communication channels at the same time.
  • the communication channel can keep alive through the heartbeat mechanism, and the communication quality of each communication channel can be evaluated in real time (for example, packet loss rate, round-trip time delay, etc.).
  • Step 102 Select a target communication channel from the multiple communication channels, and send the video data collected by the video capture device to the remote control device on the target communication channel;
  • an initial target communication channel can be selected from multiple communication channels; and then the video data can be sent to the remote control device on the initial target communication channel.
  • the target communication channel can be replaced according to the communication quality of each communication channel.
  • the method of selecting the initial target communication channel includes but is not limited to:
  • the communication channel that is first in the available state can be selected as the initial target communication channel.
  • the communication quality of each communication channel can be periodically evaluated, and the communication channel with the best communication quality is selected as the target communication channel.
  • Step 103 After detecting a communication problem, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel;
  • the video data is still sent on the target communication channel, and redundant video data is sent on other communication channels except the target communication channel to combat network problems.
  • the redundant video data may be part or all of the video data collected by the video collection device.
  • Step 104 Send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
  • each communication channel can send different redundant video data or the same redundant video data.
  • the unmanned vehicle can establish multiple communication channels with the remote control device. Under normal communication conditions, the unmanned vehicle only sends video data to the remote control device at one target of the multiple communication channels. After the communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel.
  • the embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
  • the unmanned vehicle may have a video capture device and multiple grids.
  • the method includes: The following steps:
  • Step 201 Call a preset webpage instant messaging WebRTC API, and use the multiple network cards to respectively establish multiple communication channels with the remote control device.
  • the unmanned vehicle and the remote control device may adopt a web real-time communication (Web Real-Time Communication) communication method.
  • WebRTC is an application programming interface API (Application Programming Interface) that supports web browsers for real-time voice or video conversations. It was open sourced on June 1, 2011 and included in the W3C recommended standard of the World Wide Web Consortium.
  • the native WebRTC can only use a single network card for data transmission at the same time.
  • many times there will be situations where a single card cannot run for example, mobile operators have good signals, and telecom operators have bad signals.
  • the native WebRTC solution when passing through this hidden danger area, it will cause about 1s of video disconnection (for example, switching from a telecommunication signal to a mobile signal).
  • this 1s has a great safety hazard.
  • the native WebRTC is rewritten so that WebRTC can support data transmission using multiple network cards at the same time, so that the unmanned vehicle can communicate with the remote control device through multiple network cards through multiple channels.
  • Different network cards can communicate in different wireless communication modes, including but not limited to WIFI, 2G, 3G, 4G, 5G, etc.
  • Step 202 Select a target communication channel from the multiple communication channels, and send the video data collected by the video capture device to the remote control device on the target communication channel.
  • Step 203 After detecting the communication problem, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel.
  • the step 203 may include the following sub-steps:
  • Sub-step S11 after detecting the communication problem, determine the evaluation time point
  • the evaluation time point may be determined according to a preset time period
  • the evaluation time point can be determined according to a preset time period through a timer.
  • the time period cannot be too long, too long will make the detection not real-time; the time period cannot be too short, too short will cause too much waste of resources.
  • the time period can be determined by a large amount of experimental data.
  • the time period can be 100-500 ms, preferably 300 ms.
  • Sub-step S12 after the evaluation time point, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel.
  • video frames may be selected as redundant video data at a preset frame interval.
  • the requirement for setting the frame interval is to make the redundant video data relatively smooth during playback, and the driver can still control the unmanned vehicle in real time based on the redundant video data.
  • the video data includes 30 frames of images
  • 10 frames of images can be selected at equal frame intervals, that is, 1 frame for every 3 frames of images is selected as redundant video data.
  • the unmanned vehicle establishes communication channels with the remote control device through the network card 1, the network card 2, and the network card 3, and selects the communication channel of the network card 1 as the target communication channel, and sends the video to the remote control device in the form of data packets on the target communication channel data pack.
  • the evaluation time point is determined according to the preset time period. After the evaluation time point, redundant video data packets are sent on the network card 2 and the network card 3.
  • Step 204 Send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
  • the unmanned vehicle can send video data to the remote control device on the target communication channel, and send redundant video data on each communication channel other than the target communication channel, thereby combating communication problems.
  • the communication quality of each communication channel can also be evaluated.
  • Step 205 Obtain the amount of data received by the remote control device in each communication channel.
  • the remote control device can count the data reception volume of the video data received in each communication channel. For example, the amount of data received may be 30 frames of pictures received.
  • the remote control device can send the data received statistics after the previous evaluation time point to the unmanned vehicle before the next evaluation time point, so that the unmanned vehicle can calculate the transmission success rate based on the data reception volume of the communication channel, so as to Select the target communication channel according to the sending success rate.
  • the step 205 may be: receiving data received by the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
  • Step 206 Determine the data transmission volume of each communication channel.
  • the amount of data sent can be how many frames of images are sent on the communication channel.
  • the step 206 may be: determining the data transmission volume of each communication channel between two adjacent evaluation time points.
  • Step 207 Calculate the transmission success rate of each communication channel by using the amount of data received by the remote control device in each communication channel and the amount of data sent by each communication channel.
  • the data reception volume of a certain communication channel can be divided by the data transmission volume in the communication channel to calculate the transmission success rate.
  • the step 207 may be: adopting the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points, and the amount of data received between two adjacent evaluation time points. Calculating the transmission success rate of each communication channel between the data transmission quantity of each communication channel.
  • the communication channel with the highest transmission success rate determined after the current evaluation time point can be selected as the target communication channel after the next evaluation time point.
  • the step 202 may specifically include: selecting the communication channel with the highest transmission success rate determined after the previous evaluation time point as the target communication channel after the current evaluation time point.
  • the unmanned vehicle can use multiple network cards to establish multiple communication channels with the remote control device in accordance with WebRTC.
  • the unmanned vehicle only sends the remote control device to one target of the multiple communication channels. Send video data.
  • the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel.
  • the embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
  • the communication channel establishment module 401 is used to establish multiple communication channels with remote control equipment
  • the video data sending module 402 is configured to select a target communication channel from the multiple communication channels, and send the video data collected by the video acquisition device to the remote control device on the target communication channel;
  • the redundant video data determining module 403 is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after a communication problem is detected;
  • the redundant video data sending module 404 is configured to send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
  • the communication channel establishing module 401 may include:
  • the communication channel establishment sub-module is used to call the preset webpage instant messaging WebRTC API, and use the multiple network cards to respectively establish multiple communication channels with the remote control device.
  • the redundant video data determining module 403 may include:
  • the evaluation time point determination sub-module is used to determine the evaluation time point after a communication problem is detected
  • the redundant video data determining sub-module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after the evaluation time point.
  • the redundant video data determining submodule may include:
  • the redundant video data determining unit is configured to select video frames as redundant video data according to a preset frame interval among the video frames included in the video data for communication channels other than the target communication channel.
  • the evaluation time point determination submodule may include:
  • the evaluation time point determining unit is used to determine the evaluation time point according to a preset time period.
  • the unmanned vehicle may further include:
  • a data receiving amount acquisition module configured to acquire the data receiving amount of the remote control device in each communication channel
  • the data transmission volume determination module is used to determine the data transmission volume of each communication channel
  • the transmission success rate calculation module is used to calculate the transmission success rate of each communication channel by using the data reception amount of each communication channel of the remote control device and the data transmission amount of each communication channel.
  • the data receiving amount acquisition module may include:
  • the data reception volume receiving submodule is used to receive the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
  • the data transmission amount determining module may include:
  • the data transmission volume determination sub-module is used to determine the data transmission volume of each communication channel between two adjacent evaluation time points.
  • the sending success rate calculation module may include:
  • the transmission success rate calculation sub-module is used to adopt the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points, and the data reception between two adjacent evaluation time points.
  • the data transmission quantity of the communication channel is calculated, and the transmission success rate of each communication channel is calculated.
  • the video data sending module may include:
  • the target communication channel selection sub-module is used to select the communication channel with the highest transmission success rate determined after the previous evaluation time point as the target communication channel after the current evaluation time point.
  • the unmanned vehicle can establish multiple communication channels with the remote control device. Under normal communication conditions, the unmanned vehicle only sends video data to the remote control device at one target of the multiple communication channels. After the communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel.
  • the embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
  • the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.
  • An embodiment of the present application also provides a device, including:
  • One or more processors are One or more processors.
  • One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the device to execute the method described in the embodiment of the present application.
  • the embodiments of the present application also provide one or more machine-readable media on which instructions are stored, which when executed by one or more processors, cause the processors to execute the methods described in the embodiments of the present application.
  • the embodiments of the embodiments of the present application may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing terminal equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the instruction device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

Abstract

Provided in the embodiments of the present application are a communication method for an unmanned vehicle and an unmanned vehicle, the method comprising: establishing a plurality of communication channels with a remote control device; selecting a target communication channel from the plurality of communication channels, and sending video data acquired by a video acquisition device to the remote control device over the target communication channel; after detecting a communication problem, using the video data to respectively determine corresponding redundant video data for the communication channels other than the target communication channel; and sending the corresponding redundant video data to the remote control device over a communication channel other than the target communication channel. By means of implementing a multi-channel cooperative transmission mechanism to combat communication problems, the embodiments of the present application enable redundant video data to be transmitted by means of other communication channels and the remote control device to smoothly acquire the video data even if the transmission of video data over a target communication channel fails, avoiding security problems produced by video data loss.

Description

一种无人车的通信方法和无人车An unmanned vehicle communication method and unmanned vehicle
本申请要求2019年05月21日递交的申请号为201910426232.6、发明名称为“一种无人车的通信方法和无人车”中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on May 21, 2019 with the application number 201910426232.6 and the invention title "A communication method for unmanned vehicles and unmanned vehicles", the entire content of which is incorporated into this application by reference .
技术领域Technical field
本申请涉及通信技术领域,特别是涉及一种无人车的通信方法和一种无人车。This application relates to the field of communication technology, in particular to an unmanned vehicle communication method and an unmanned vehicle.
背景技术Background technique
随着无人驾驶技术的发展,平行驾驶成为一种重要的方案。所谓平行驾驶是指无人车通过摄像头采集道路的视频,将采集到视频上传到远程控制设备,用户可以远程控制设备上,根据视频远程控制无人车。With the development of unmanned driving technology, parallel driving has become an important solution. The so-called parallel driving means that the unmanned vehicle collects the video of the road through the camera and uploads the collected video to the remote control device. The user can remotely control the device and remotely control the unmanned vehicle based on the video.
在目前的平行驾驶方案中,无人车可以与远程控制设备建立一条通信通道,通过通信通道将采集的视频上传到远程控制设备,驾驶员可以在远程控制设备上,根据无人车传输回来的视频控制无人车。In the current parallel driving scheme, the unmanned vehicle can establish a communication channel with the remote control device, and upload the collected video to the remote control device through the communication channel. The driver can use the remote control device to transmit back according to the unmanned vehicle. Video control unmanned vehicle.
然而在无人车行驶过程中,当无人车进入某些区域时,会出现通信故障的问题,会造成远程控制设备短时间无法接收到视频的问题。对于安全性要求极高的平行驾驶,视频的短暂断开都会影响驾驶员的控制,造成很大的安全问题。However, during the driving process of the unmanned vehicle, when the unmanned vehicle enters certain areas, the problem of communication failure will occur, which will cause the problem that the remote control device cannot receive the video for a short time. For parallel driving with extremely high safety requirements, the short disconnection of the video will affect the driver's control and cause great safety problems.
发明内容Summary of the invention
鉴于上述问题,提出了本申请实施例以便提供一种克服上述问题或者至少部分地解决上述问题的一种无人车的通信方法和一种无人车。In view of the above problems, the embodiments of the present application are proposed to provide an unmanned vehicle communication method and an unmanned vehicle that overcome the above problems or at least partially solve the above problems.
为了解决上述问题,本申请实施例公开了一种无人车的通信方法,其中,所述无人车具有视频采集设备,所述方法包括:In order to solve the above-mentioned problems, an embodiment of the present application discloses an unmanned vehicle communication method, wherein the unmanned vehicle has a video capture device, and the method includes:
建立与远程控制设备的多个通信通道;Establish multiple communication channels with remote control equipment;
从所述多个通信通道中选取一个目标通信通道,并在所述目标通信通道向所述远程控制设备发送所述视频采集设备采集的视频数据;Selecting a target communication channel from the plurality of communication channels, and sending the video data collected by the video capture device to the remote control device on the target communication channel;
在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据;After detecting the communication problem, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel;
在除所述目标通信通道之外的通信通道,向所述远程控制设备发送相应的冗余视频 数据。In communication channels other than the target communication channel, corresponding redundant video data is sent to the remote control device.
可选地,所述无人车具有多个网卡,所述建立与远程控制设备的多个通信通道,包括:Optionally, the unmanned vehicle has multiple network cards, and the establishing multiple communication channels with the remote control device includes:
调用预置的网页即时通信WebRTC API,采用所述多个网卡分别建立与远程控制设备的多个通信通道。The preset webpage instant messaging WebRTC API is called, and the multiple network cards are used to respectively establish multiple communication channels with the remote control device.
可选地,所述在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据,包括:Optionally, after detecting a communication problem, using the video data to determine corresponding redundant video data for other communication channels except the target communication channel includes:
在检测到通信问题后,确定评估时间点;After detecting communication problems, determine the time point for evaluation;
在所述评估时间点之后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据。After the evaluation time point, the video data is used to determine corresponding redundant video data for communication channels other than the target communication channel.
可选地,所述采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据,包括:Optionally, the use of the video data to determine corresponding redundant video data for other communication channels except the target communication channel includes:
对除所述目标通信通道之外的其它通信通道,在所述视频数据包括的视频帧中,按照预设帧间隔选取视频帧作为冗余视频数据。For communication channels other than the target communication channel, among the video frames included in the video data, video frames are selected as redundant video data according to a preset frame interval.
可选地,所述确定评估时间点,包括:Optionally, the determining the evaluation time point includes:
按照预设时间周期,确定评估时间点。Determine the evaluation time point according to the preset time period.
可选地,还包括:Optionally, it also includes:
获取所述远程控制设备在各个通信通道的数据接收量;Acquiring the amount of data received by the remote control device in each communication channel;
确定各个通信通道的数据发送量;Determine the data transmission volume of each communication channel;
采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The amount of data received by the remote control device in each communication channel and the amount of data sent by each communication channel are used to calculate the transmission success rate of each communication channel.
可选地,所述获取所述远程控制设备在各个通信通道的数据接收量,包括:Optionally, the obtaining the data reception volume of the remote control device in each communication channel includes:
接收所述远程控制设备发送的在相邻的两个评估时间点之间,所述远程控制设备在各个通信通道的数据接收量。Receive the amount of data received by the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
可选地,所述确定各个通信通道的数据发送量,包括:Optionally, the determining the data transmission volume of each communication channel includes:
确定在相邻的两个评估时间点之间,各个通信通道的数据发送量。Determine the data transmission volume of each communication channel between two adjacent evaluation time points.
可选地,所述采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信的数据发送数量,计算所述各个通信通道的发送成功率,包括:Optionally, the calculation of the transmission success rate of each communication channel using the amount of data received by the remote control device in each communication channel and the amount of data sent in each communication includes:
采用在相邻的两个评估时间点之间所述远程控制设备在各个通信通道的数据接收量,和在相邻的两个评估时间点之间所述各个通信通道的数据发送数量,计算所述各个 通信通道的发送成功率。The amount of data received by the remote control device on each communication channel between two adjacent evaluation time points and the amount of data sent by each communication channel between two adjacent evaluation time points are used to calculate Describe the transmission success rate of each communication channel.
可选地,所述从所述多个通信通道中选取一个目标通信通道,包括:Optionally, the selecting a target communication channel from the multiple communication channels includes:
将在前一个的评估时间点之后确定的发送成功率最高的通信通道,选取为当前的评估时间点之后的目标通信通道。The communication channel with the highest transmission success rate determined after the previous evaluation time point is selected as the target communication channel after the current evaluation time point.
本申请实施例还公开了一种无人车,所述无人车具有视频采集设备,所述无人车还包括:The embodiment of the application also discloses an unmanned vehicle, the unmanned vehicle has a video capture device, and the unmanned vehicle further includes:
通信通道建立模块,用于建立与远程控制设备的多个通信通道;Communication channel establishment module, used to establish multiple communication channels with remote control equipment;
视频数据发送模块,用于从所述多个通信通道中选取一个目标通信通道,并在所述目标通信通道向所述远程控制设备发送所述视频采集设备采集的视频数据;A video data sending module, configured to select a target communication channel from the multiple communication channels, and send the video data collected by the video acquisition device to the remote control device on the target communication channel;
冗余视频数据确定模块,用于在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据;The redundant video data determining module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after a communication problem is detected;
冗余视频数据发送模块,用于在除所述目标通信通道之外的通信通道,向所述远程控制设备发送相应的冗余视频数据。The redundant video data sending module is used to send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
可选地,所述通信通道建立模块包括:Optionally, the communication channel establishment module includes:
通信通道建立子模块,用于调用预置的网页即时通信WebRTC API,采用所述多个网卡分别建立与远程控制设备的多个通信通道。The communication channel establishment sub-module is used to call the preset webpage instant messaging WebRTC API, and use the multiple network cards to respectively establish multiple communication channels with the remote control device.
可选地,所述冗余视频数据确定模块包括:Optionally, the redundant video data determining module includes:
评估时间点确定子模块,用于在检测到通信问题后,确定评估时间点;The evaluation time point determination sub-module is used to determine the evaluation time point after a communication problem is detected;
冗余视频数据确定子模块,用于在所述评估时间点之后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据。The redundant video data determining sub-module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after the evaluation time point.
可选地,所述冗余视频数据确定子模块包括:Optionally, the redundant video data determining submodule includes:
冗余视频数据确定单元,用于对除所述目标通信通道之外的其它通信通道,在所述视频数据包括的视频帧中,按照预设帧间隔选取视频帧作为冗余视频数据。The redundant video data determining unit is configured to select video frames as redundant video data according to a preset frame interval among the video frames included in the video data for communication channels other than the target communication channel.
可选地,所述评估时间点确定子模块包括:Optionally, the evaluation time point determination sub-module includes:
评估时间点确定单元,用于按照预设时间周期,确定评估时间点。The evaluation time point determining unit is used to determine the evaluation time point according to a preset time period.
可选地,还包括:Optionally, it also includes:
数据接收量获取模块,用于获取所述远程控制设备在各个通信通道的数据接收量;A data receiving amount acquisition module, configured to acquire the data receiving amount of the remote control device in each communication channel;
数据发送量确定模块,用于确定各个通信通道的数据发送量;The data transmission volume determination module is used to determine the data transmission volume of each communication channel;
发送成功率计算模块,用于采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The transmission success rate calculation module is used to calculate the transmission success rate of each communication channel by using the data reception amount of each communication channel of the remote control device and the data transmission amount of each communication channel.
可选地,所述数据接收量获取模块包括:Optionally, the data receiving amount acquisition module includes:
数据接收量接收子模块,用于接收所述远程控制设备发送的在相邻的两个评估时间点之间,所述远程控制设备在各个通信通道的数据接收量。The data reception volume receiving submodule is used to receive the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
可选地,所述数据发送量确定模块包括:Optionally, the data transmission amount determining module includes:
数据发送量确定子模块,用于确定在相邻的两个评估时间点之间,各个通信通道的数据发送量。The data transmission volume determination sub-module is used to determine the data transmission volume of each communication channel between two adjacent evaluation time points.
可选地,所述发送成功率计算模块包括:Optionally, the sending success rate calculation module includes:
发送成功率计算子模块,用于采用在相邻的两个评估时间点之间所述远程控制设备在各个通信通道的数据接收量,和在相邻的两个评估时间点之间所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The transmission success rate calculation sub-module is used to adopt the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points, and the data reception between two adjacent evaluation time points. The data transmission quantity of the communication channel is calculated, and the transmission success rate of each communication channel is calculated.
可选地,所述视频数据发送模块包括:Optionally, the video data sending module includes:
目标通信通道选取子模块,用于将在前一个的评估时间点之后确定的发送成功率最高的通信通道,选取为当前的评估时间点之后的目标通信通道。The target communication channel selection sub-module is used to select the communication channel with the highest transmission success rate determined after the previous evaluation time point as the target communication channel after the current evaluation time point.
本申请实施例还公开了一种装置,包括:The embodiment of the application also discloses a device, including:
一个或多个处理器;和One or more processors; and
其上存储有指令的一个或多个机器可读介质,当由所述一个或多个处理器执行时,使得所述装置执行如上所述的一个或多个的方法。One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the apparatus to perform one or more of the methods described above.
本申请实施例还公开了一个或多个机器可读介质,其上存储有指令,当由一个或多个处理器执行时,使得所述处理器执行如上所述的一个或多个的方法。The embodiment of the present application also discloses one or more machine-readable media, on which instructions are stored, which, when executed by one or more processors, cause the processors to execute one or more of the methods described above.
本申请实施例包括以下优点:The embodiments of the application include the following advantages:
本申请实施例中,无人车可以与远程控制设备建立多个通信通道,在通信正常的情况下,无人车只在多个通信通道的一个目标向远程控制设备发送视频数据。在检测到通信问题后,在目标通信通道仍然继续发送视频数据,并且在除目标通信通道之外的通信通道分别发送冗余视频数据,本申请实施例通过实现一种多通道协同传输机制来对抗通信问题,即使目标通信通道的视频数据传输失败,仍能通过其他通信通道传输冗余视频数据,使得远程控制设备仍能流畅的获得视频数据,避免了由于视频数据丢失而产生的安全问题。In the embodiment of the present application, the unmanned vehicle can establish multiple communication channels with the remote control device. Under normal communication conditions, the unmanned vehicle only sends video data to the remote control device at one target of the multiple communication channels. After the communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel. The embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
附图说明Description of the drawings
图1是本申请的一种无人车的通信方法实施例一的步骤流程图;FIG. 1 is a flowchart of the steps of Embodiment 1 of an unmanned vehicle communication method according to the present application;
图2是本申请的一种无人车的通信方法实施例二的步骤流程图;2 is a flowchart of the steps of Embodiment 2 of an unmanned vehicle communication method of the present application;
图3是本申请实施例中发送冗余视频数据的示意图;Figure 3 is a schematic diagram of sending redundant video data in an embodiment of the present application;
图4是本申请的一种无人车实施例的结构框图。Fig. 4 is a structural block diagram of an embodiment of an unmanned vehicle of the present application.
具体实施方式Detailed ways
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本申请作进一步详细的说明。In order to make the above objectives, features, and advantages of the application more obvious and understandable, the application will be further described in detail below with reference to the drawings and specific implementations.
在本申请实施例中,为了提高无人车的安全性,无人车可以与远程控制设备建立多个通信通道。在无人车未出现通信问题时,无人车只在一个目标通信通道向远程控制设备发送视频数据;当无人车出现通信问题时,无人车仍然在主通道向远程控制设备发送视频数据,同时在目标通道之外的多个其他通信通道向远程控制设备发送冗余视频数据。即使目标通信通道的视频数据传输失败,仍能通过其他通信通道传输冗余视频数据,使得远程控制设备仍能流畅的获得视频数据,避免了由于视频数据丢失而产生的安全问题。下面对具体的实现方式进行详细介绍。In the embodiment of the present application, in order to improve the safety of the unmanned vehicle, the unmanned vehicle may establish multiple communication channels with the remote control device. When the unmanned vehicle has no communication problems, the unmanned vehicle will only send video data to the remote control device on one target communication channel; when the unmanned vehicle has communication problems, the unmanned vehicle will still send video data to the remote control device in the main channel , And at the same time send redundant video data to the remote control equipment on multiple communication channels other than the target channel. Even if the video data transmission of the target communication channel fails, the redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain the video data smoothly, avoiding the security problems caused by the loss of video data. The specific implementation is described in detail below.
参照图1,示出了本申请的一种无人车的通信方法实施例一的步骤流程图,所述无人车可以具有视频采集设备,所述方法包括:具体可以包括如下步骤:1, there is shown a step flow chart of Embodiment 1 of an unmanned vehicle communication method according to the present application. The unmanned vehicle may have a video capture device, and the method includes: specifically may include the following steps:
步骤101,建立与远程控制设备的多个通信通道;Step 101: Establish multiple communication channels with remote control equipment;
本申请实施例中的无人车可以是指没有驾驶员在车内驾驶,而可以由驾驶员远程驾驶的车辆。The unmanned vehicle in the embodiments of the present application may refer to a vehicle that has no driver in the vehicle but can be driven remotely by the driver.
在本申请实施例中,远程控制设备(例如,PC或者控制台)可以同时与多个无人车通信连接,同时控制多个无人车进行移动。目前,平行驾驶方案适用于仓配物流的无人车、矿山矿车等无人车上。例如,在仓配物流场景中,远程控制设备可以同时控制多个首尾相连的无人车在仓库内移动。In the embodiment of the present application, a remote control device (for example, a PC or a console) can communicate with multiple unmanned vehicles at the same time, and control multiple unmanned vehicles to move at the same time. At present, the parallel driving scheme is suitable for unmanned vehicles such as unmanned vehicles in warehouse distribution logistics and mining vehicles. For example, in the warehouse distribution logistics scenario, the remote control device can simultaneously control multiple unmanned vehicles connected end to end to move in the warehouse.
在远程控制设备控制无人车之前,无人车与远程控制设备同时建立多个通信通道。通信通道可以通过心跳机制保持存活alive,并且可以实时评估各个通信通道的通信质量(例如,丢包率、往返时延RTT(Round-Trip Time)延时等)。Before the remote control device controls the unmanned vehicle, the unmanned vehicle and the remote control device establish multiple communication channels at the same time. The communication channel can keep alive through the heartbeat mechanism, and the communication quality of each communication channel can be evaluated in real time (for example, packet loss rate, round-trip time delay, etc.).
步骤102,从所述多个通信通道中选取一个目标通信通道,并在所述目标通信通道向所述远程控制设备发送所述视频采集设备采集的视频数据;Step 102: Select a target communication channel from the multiple communication channels, and send the video data collected by the video capture device to the remote control device on the target communication channel;
在第一次发送视频数据之前,可以从多个通信通道中选取一个初始的目标通信通道; 然后在初始的目标通信通道向远程控制设备发送视频数据。在后续的发送过程中,可以根据各个通信通道的通信质量更换目标通信通道。Before sending video data for the first time, an initial target communication channel can be selected from multiple communication channels; and then the video data can be sent to the remote control device on the initial target communication channel. In the subsequent sending process, the target communication channel can be replaced according to the communication quality of each communication channel.
本申请实施例中,选取初始的目标通信通道的方式包括但不限于:In the embodiment of the present application, the method of selecting the initial target communication channel includes but is not limited to:
可以在无人车与远程控制设备建立通信通道时,将首先处于可用状态的通信通道选取为初始的目标通信通道。When the unmanned vehicle and the remote control device establish a communication channel, the communication channel that is first in the available state can be selected as the initial target communication channel.
可以在多个通信通道都处于可用状态后,任意选择一个初始的目标通信通道。You can arbitrarily select an initial target communication channel after multiple communication channels are available.
可以预先设定哪个通信通道为初始的目标通信通道,当目标通信通道建立完成后,就可以直接使用预先设定的目标通信通道。You can preset which communication channel is the initial target communication channel. After the target communication channel is established, you can directly use the preset target communication channel.
在后续的发送过程中,可以定时评估各个通信信道的通信质量,选择通信质量最好的通信信道作为目标通信信道。In the subsequent sending process, the communication quality of each communication channel can be periodically evaluated, and the communication channel with the best communication quality is selected as the target communication channel.
步骤103,在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据;Step 103: After detecting a communication problem, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel;
在通信过程中,可以根据通信通道的通信质量,确定是否出现通信问题。例如,当丢包率大于预设丢包率阈值时,则可以认为出现通信问题。又例如,当RTT时延大于预设时延阈值时,则可以认为出现通信问题。In the communication process, you can determine whether a communication problem occurs according to the communication quality of the communication channel. For example, when the packet loss rate is greater than the preset packet loss rate threshold, it can be considered that a communication problem has occurred. For another example, when the RTT delay is greater than the preset delay threshold, it can be considered that a communication problem has occurred.
当检测到通信问题后,仍然保持在目标通信通道发送视频数据,并且分别在除目标通信通道之外的其它通信通道发送冗余视频数据,以对抗网络问题。When a communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on other communication channels except the target communication channel to combat network problems.
在本申请实施例中,冗余视频数据可以是视频采集设备采集的视频数据的一部分或者全部。In the embodiment of the present application, the redundant video data may be part or all of the video data collected by the video collection device.
步骤104,在除所述目标通信通道之外的通信通道,向所述远程控制设备发送相应的冗余视频数据。Step 104: Send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
对于除目标通信通道之外的通信通道,每个通信通道可以发送不同的冗余视频数据,也可以发送相同的冗余视频数据。For communication channels other than the target communication channel, each communication channel can send different redundant video data or the same redundant video data.
本申请实施例中,无人车可以与远程控制设备建立多个通信通道,在通信正常的情况下,无人车只在多个通信通道的一个目标向远程控制设备发送视频数据。在检测到通信问题后,在目标通信通道仍然继续发送视频数据,并且在除目标通信通道之外的通信通道分别发送冗余视频数据,本申请实施例通过实现一种多通道协同传输机制来对抗通信问题,即使目标通信通道的视频数据传输失败,仍能通过其他通信通道传输冗余视频数据,使得远程控制设备仍能流畅的获得视频数据,避免了由于视频数据丢失而产生的安全问题。In the embodiment of the present application, the unmanned vehicle can establish multiple communication channels with the remote control device. Under normal communication conditions, the unmanned vehicle only sends video data to the remote control device at one target of the multiple communication channels. After the communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel. The embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
参照图2,示出了本申请的一种无人车的通信方法实施例二的步骤流程图,所述无人车可以具有视频采集设备和多个网格,所述方法包括:具体可以包括如下步骤:2, there is shown a flow chart of the second embodiment of an unmanned vehicle communication method according to the present application. The unmanned vehicle may have a video capture device and multiple grids. The method includes: The following steps:
步骤201,调用预置的网页即时通信WebRTC API,采用所述多个网卡分别建立与远程控制设备的多个通信通道。Step 201: Call a preset webpage instant messaging WebRTC API, and use the multiple network cards to respectively establish multiple communication channels with the remote control device.
平行驾驶需要实时性高的通信方式,在本申请实施例中,无人车与远程控制设备之间可以采用网页即时通信WebRTC(Web Real-Time Communication)的通信方式。WebRTC是支持网页浏览器进行实时语音对话或视频对话的应用程序编程接口API(Application Programming Interface),于2011年6月1日开源并被纳入万维网联盟的W3C推荐标准。Parallel driving requires a high-real-time communication method. In the embodiment of the present application, the unmanned vehicle and the remote control device may adopt a web real-time communication (Web Real-Time Communication) communication method. WebRTC is an application programming interface API (Application Programming Interface) that supports web browsers for real-time voice or video conversations. It was open sourced on June 1, 2011 and included in the W3C recommended standard of the World Wide Web Consortium.
原生的WebRTC在同一时刻只能使用单张网卡进行数据传输,然而在平行驾驶的过程中,很多时候会遇到单卡无法运行的情况(例如,移动运营商信号好,电信运营商信号不好的地区),在原生的WebRTC方案中,通过这种隐患区域时,会造成约1s左右的视频断开(例如,从电信信号切到移动信号),对于安全性要求极高的平行驾驶,这1s就有很大的安全隐患。对此,本申请实施例中,在原生的WebRTC中进行改写,使得WebRTC能够支持同一时刻使用多张网卡的进行数据传输,使得无人车能通过多张网卡与远程控制设备进行多通道通信。The native WebRTC can only use a single network card for data transmission at the same time. However, in the process of parallel driving, many times there will be situations where a single card cannot run (for example, mobile operators have good signals, and telecom operators have bad signals. In the native WebRTC solution, when passing through this hidden danger area, it will cause about 1s of video disconnection (for example, switching from a telecommunication signal to a mobile signal). For parallel driving with extremely high safety requirements, this 1s has a great safety hazard. In this regard, in the embodiment of the present application, the native WebRTC is rewritten so that WebRTC can support data transmission using multiple network cards at the same time, so that the unmanned vehicle can communicate with the remote control device through multiple network cards through multiple channels.
不同的网卡可以以不同的无线通信方式进行通信,无线通信方式包括但不限于WIFI、2G、3G、4G、5G等。Different network cards can communicate in different wireless communication modes, including but not limited to WIFI, 2G, 3G, 4G, 5G, etc.
步骤202,从所述多个通信通道中选取一个目标通信通道,并在所述目标通信通道向所述远程控制设备发送所述视频采集设备采集的视频数据。Step 202: Select a target communication channel from the multiple communication channels, and send the video data collected by the video capture device to the remote control device on the target communication channel.
步骤203,在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据。Step 203: After detecting the communication problem, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel.
在本申请实施例中,所述步骤203可以包括如下子步骤:In the embodiment of the present application, the step 203 may include the following sub-steps:
子步骤S11,在检测到通信问题后,确定评估时间点;Sub-step S11, after detecting the communication problem, determine the evaluation time point;
在本申请实施例中,评估时间点可以按照预设时间周期确定;In the embodiment of the present application, the evaluation time point may be determined according to a preset time period;
具体的,可以通过定时器按照预设时间周期确定评估时间点。Specifically, the evaluation time point can be determined according to a preset time period through a timer.
时间周期不能太长,太长就会使得检测不实时;时间周期也不能太短,太短会造成过多的资源浪费。在实际中,时间周期可以通过大量实验数据确定。在一种示例中,时间周期可以选用100-500ms,优选的可以选用300ms。The time period cannot be too long, too long will make the detection not real-time; the time period cannot be too short, too short will cause too much waste of resources. In practice, the time period can be determined by a large amount of experimental data. In an example, the time period can be 100-500 ms, preferably 300 ms.
子步骤S12,在所述评估时间点之后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据。Sub-step S12, after the evaluation time point, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel.
具体的,对除所述目标通信通道之外的其它通信通道,可以在所述视频数据包括的视频帧中,按照预设帧间隔选取视频帧作为冗余视频数据。Specifically, for communication channels other than the target communication channel, among the video frames included in the video data, video frames may be selected as redundant video data at a preset frame interval.
帧间隔的设置要求是,需要使得冗余视频数据在播放时仍然相对流畅,驾驶员仍然能根据冗余视频数据来实时控制无人车。The requirement for setting the frame interval is to make the redundant video data relatively smooth during playback, and the driver can still control the unmanned vehicle in real time based on the redundant video data.
例如,若视频数据包括30帧图像,则可以等帧间隔的选取10帧图像,即每3帧图像选取1帧作为冗余视频数据。For example, if the video data includes 30 frames of images, 10 frames of images can be selected at equal frame intervals, that is, 1 frame for every 3 frames of images is selected as redundant video data.
参照图3所示为本申请实施例中发送冗余视频数据的示意图。其中,无人车分别通过网卡1、网卡2、网卡3与远程控制设备建立通信通道,并且选择网卡1的通信通道作为目标通信通道,在目标通信通道以数据包的形式向远程控制设备发送视频数据包。在出现通信问题时,按照预设时间周期确定评估时间点。在评估时间点之后,在网卡2和网卡3发送冗余视频数据包。3 is a schematic diagram of sending redundant video data in an embodiment of the application. Among them, the unmanned vehicle establishes communication channels with the remote control device through the network card 1, the network card 2, and the network card 3, and selects the communication channel of the network card 1 as the target communication channel, and sends the video to the remote control device in the form of data packets on the target communication channel data pack. When communication problems occur, the evaluation time point is determined according to the preset time period. After the evaluation time point, redundant video data packets are sent on the network card 2 and the network card 3.
步骤204,在除所述目标通信通道之外的通信通道,向所述远程控制设备发送相应的冗余视频数据。Step 204: Send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
在本申请实施例中,无人车可以在目标通信通道向远程控制设备发送视频数据,在目标通信通道之外的各个通信通道发送冗余视频数据,从而对抗通信问题。另外,在各个通信通道都发送视频数据后,还可以对各个通信通道进行通信质量评估。In the embodiment of the present application, the unmanned vehicle can send video data to the remote control device on the target communication channel, and send redundant video data on each communication channel other than the target communication channel, thereby combating communication problems. In addition, after each communication channel has sent video data, the communication quality of each communication channel can also be evaluated.
步骤205,获取远程控制设备在各个通信通道的数据接收量。Step 205: Obtain the amount of data received by the remote control device in each communication channel.
远程控制设备可以统计在各个通信通道接收到的视频数据的数据接收量。例如,数据接收量可以为接收到30帧图片。The remote control device can count the data reception volume of the video data received in each communication channel. For example, the amount of data received may be 30 frames of pictures received.
远程控制设备可以将在前一个评估时间点之后统计的数据接收量,在下一个评估时间点之前发送给无人车,使得无人车可以根据通信通道的数据接收量,计算发送成功率,从而可以根据发送成功率选取目标通信通道。The remote control device can send the data received statistics after the previous evaluation time point to the unmanned vehicle before the next evaluation time point, so that the unmanned vehicle can calculate the transmission success rate based on the data reception volume of the communication channel, so as to Select the target communication channel according to the sending success rate.
在一种示例中,所述步骤205可以为:接收所述远程控制设备发送的在相邻的两个评估时间点之间,所述远程控制设备在各个通信通道的数据接收量。In an example, the step 205 may be: receiving data received by the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
步骤206,确定各个通信通道的数据发送量。Step 206: Determine the data transmission volume of each communication channel.
数据发送量可以为在通信通道发送了多少帧图像。The amount of data sent can be how many frames of images are sent on the communication channel.
在一种示例中,所述步骤206可以为:确定在相邻的两个评估时间点之间,各个通信通道的数据发送量。In an example, the step 206 may be: determining the data transmission volume of each communication channel between two adjacent evaluation time points.
步骤207,采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。Step 207: Calculate the transmission success rate of each communication channel by using the amount of data received by the remote control device in each communication channel and the amount of data sent by each communication channel.
具体的,可以将某个通信通道的数据接收量除以在该通信通道的数据发送量,从而计算发送成功率。Specifically, the data reception volume of a certain communication channel can be divided by the data transmission volume in the communication channel to calculate the transmission success rate.
在一种示例中,所述步骤207可以为:采用在相邻的两个评估时间点之间所述远程控制设备在各个通信通道的数据接收量,和在相邻的两个评估时间点之间所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。In an example, the step 207 may be: adopting the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points, and the amount of data received between two adjacent evaluation time points. Calculating the transmission success rate of each communication channel between the data transmission quantity of each communication channel.
当前的评估时间点之后确定的发送成功率最高的通信通道,可以被选取为下一个的评估时间点之后的目标通信通道。The communication channel with the highest transmission success rate determined after the current evaluation time point can be selected as the target communication channel after the next evaluation time point.
相应的,所述步骤202具体可以包括:将在前一个的评估时间点之后确定的发送成功率最高的通信通道,选取为当前的评估时间点之后的目标通信通道。Correspondingly, the step 202 may specifically include: selecting the communication channel with the highest transmission success rate determined after the previous evaluation time point as the target communication channel after the current evaluation time point.
本申请实施例中,无人车可以按照WebRTC,采用多个网卡与远程控制设备建立多个通信通道,在通信正常的情况下,无人车只在多个通信通道的一个目标向远程控制设备发送视频数据。在检测到通信问题后,在目标通信通道仍然继续发送视频数据,并且在除目标通信通道之外的通信通道分别发送冗余视频数据,本申请实施例通过实现一种多通道协同传输机制来对抗通信问题,即使目标通信通道的视频数据传输失败,仍能通过其他通信通道传输冗余视频数据,使得远程控制设备仍能流畅的获得视频数据,避免了由于视频数据丢失而产生的安全问题。In the embodiment of this application, the unmanned vehicle can use multiple network cards to establish multiple communication channels with the remote control device in accordance with WebRTC. Under normal communication conditions, the unmanned vehicle only sends the remote control device to one target of the multiple communication channels. Send video data. After the communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel. The embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请实施例并不受所描述的动作顺序的限制,因为依据本申请实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本申请实施例所必须的。It should be noted that for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present application are not limited by the described sequence of actions, because According to the embodiments of the present application, certain steps may be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of this application.
参照图4,示出了本申请的一种无人车实施例的结构框图,其中,所述无人车具有视频采集设备,所述无人车具体还可以包括如下模块:4, there is shown a structural block diagram of an embodiment of an unmanned vehicle of the present application, where the unmanned vehicle has a video capture device, and the unmanned vehicle may specifically include the following modules:
通信通道建立模块401,用于建立与远程控制设备的多个通信通道;The communication channel establishment module 401 is used to establish multiple communication channels with remote control equipment;
视频数据发送模块402,用于从所述多个通信通道中选取一个目标通信通道,并在所述目标通信通道向所述远程控制设备发送所述视频采集设备采集的视频数据;The video data sending module 402 is configured to select a target communication channel from the multiple communication channels, and send the video data collected by the video acquisition device to the remote control device on the target communication channel;
冗余视频数据确定模块403,用于在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据;The redundant video data determining module 403 is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after a communication problem is detected;
冗余视频数据发送模块404,用于在除所述目标通信通道之外的通信通道,向所述远程控制设备发送相应的冗余视频数据。The redundant video data sending module 404 is configured to send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
在本申请实施例中,所述通信通道建立模块401可以包括:In the embodiment of the present application, the communication channel establishing module 401 may include:
通信通道建立子模块,用于调用预置的网页即时通信WebRTC API,采用所述多个网卡分别建立与远程控制设备的多个通信通道。The communication channel establishment sub-module is used to call the preset webpage instant messaging WebRTC API, and use the multiple network cards to respectively establish multiple communication channels with the remote control device.
在本申请实施例中,所述冗余视频数据确定模块403可以包括:In the embodiment of the present application, the redundant video data determining module 403 may include:
评估时间点确定子模块,用于在检测到通信问题后,确定评估时间点;The evaluation time point determination sub-module is used to determine the evaluation time point after a communication problem is detected;
冗余视频数据确定子模块,用于在所述评估时间点之后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据。The redundant video data determining sub-module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after the evaluation time point.
在本申请实施例中,所述冗余视频数据确定子模块可以包括:In the embodiment of the present application, the redundant video data determining submodule may include:
冗余视频数据确定单元,用于对除所述目标通信通道之外的其它通信通道,在所述视频数据包括的视频帧中,按照预设帧间隔选取视频帧作为冗余视频数据。The redundant video data determining unit is configured to select video frames as redundant video data according to a preset frame interval among the video frames included in the video data for communication channels other than the target communication channel.
在本申请实施例中,所述评估时间点确定子模块可以包括:In the embodiment of the present application, the evaluation time point determination submodule may include:
评估时间点确定单元,用于按照预设时间周期,确定评估时间点。The evaluation time point determining unit is used to determine the evaluation time point according to a preset time period.
在本申请实施例中,所述的无人车还可以包括:In the embodiment of the present application, the unmanned vehicle may further include:
数据接收量获取模块,用于获取所述远程控制设备在各个通信通道的数据接收量;A data receiving amount acquisition module, configured to acquire the data receiving amount of the remote control device in each communication channel;
数据发送量确定模块,用于确定各个通信通道的数据发送量;The data transmission volume determination module is used to determine the data transmission volume of each communication channel;
发送成功率计算模块,用于采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The transmission success rate calculation module is used to calculate the transmission success rate of each communication channel by using the data reception amount of each communication channel of the remote control device and the data transmission amount of each communication channel.
在本申请实施例中,所述数据接收量获取模块可以包括:In the embodiment of the present application, the data receiving amount acquisition module may include:
数据接收量接收子模块,用于接收所述远程控制设备发送的在相邻的两个评估时间点之间,所述远程控制设备在各个通信通道的数据接收量。The data reception volume receiving submodule is used to receive the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
在本申请实施例中,所述数据发送量确定模块可以包括:In the embodiment of the present application, the data transmission amount determining module may include:
数据发送量确定子模块,用于确定在相邻的两个评估时间点之间,各个通信通道的数据发送量。The data transmission volume determination sub-module is used to determine the data transmission volume of each communication channel between two adjacent evaluation time points.
在本申请实施例中,所述发送成功率计算模块可以包括:In the embodiment of the present application, the sending success rate calculation module may include:
发送成功率计算子模块,用于采用在相邻的两个评估时间点之间所述远程控制设备在各个通信通道的数据接收量,和在相邻的两个评估时间点之间所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The transmission success rate calculation sub-module is used to adopt the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points, and the data reception between two adjacent evaluation time points. The data transmission quantity of the communication channel is calculated, and the transmission success rate of each communication channel is calculated.
在本申请实施例中,所述视频数据发送模块可以包括:In the embodiment of the present application, the video data sending module may include:
目标通信通道选取子模块,用于将在前一个的评估时间点之后确定的发送成功率最高的通信通道,选取为当前的评估时间点之后的目标通信通道。The target communication channel selection sub-module is used to select the communication channel with the highest transmission success rate determined after the previous evaluation time point as the target communication channel after the current evaluation time point.
本申请实施例中,无人车可以与远程控制设备建立多个通信通道,在通信正常的情况下,无人车只在多个通信通道的一个目标向远程控制设备发送视频数据。在检测到通信问题后,在目标通信通道仍然继续发送视频数据,并且在除目标通信通道之外的通信通道分别发送冗余视频数据,本申请实施例通过实现一种多通道协同传输机制来对抗通信问题,即使目标通信通道的视频数据传输失败,仍能通过其他通信通道传输冗余视频数据,使得远程控制设备仍能流畅的获得视频数据,避免了由于视频数据丢失而产生的安全问题。In the embodiment of the present application, the unmanned vehicle can establish multiple communication channels with the remote control device. Under normal communication conditions, the unmanned vehicle only sends video data to the remote control device at one target of the multiple communication channels. After the communication problem is detected, the video data is still sent on the target communication channel, and redundant video data is sent on the communication channels other than the target communication channel. The embodiment of the present application implements a multi-channel cooperative transmission mechanism to counteract Communication problems. Even if the video data transmission of the target communication channel fails, redundant video data can still be transmitted through other communication channels, so that the remote control device can still obtain video data smoothly, avoiding security problems caused by video data loss.
对于装置实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.
本申请实施例还提供了一种装置,包括:An embodiment of the present application also provides a device, including:
一个或多个处理器;和One or more processors; and
其上存储有指令的一个或多个机器可读介质,当由所述一个或多个处理器执行时,使得所述装置执行本申请实施例所述的方法。One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the device to execute the method described in the embodiment of the present application.
本申请实施例还提供了一个或多个机器可读介质,其上存储有指令,当由一个或多个处理器执行时,使得所述处理器执行本申请实施例所述的方法。The embodiments of the present application also provide one or more machine-readable media on which instructions are stored, which when executed by one or more processors, cause the processors to execute the methods described in the embodiments of the present application.
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。The various embodiments in this specification are described in a progressive manner. Each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other.
本领域内的技术人员应明白,本申请实施例的实施例可提供为方法、装置、或计算机程序产品。因此,本申请实施例可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the embodiments of the present application may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
本申请实施例是参照根据本申请实施例的方法、终端设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理终端设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方 框或多个方框中指定的功能的装置。The embodiments of this application are described with reference to the flowcharts and/or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processors of general-purpose computers, special-purpose computers, embedded processors, or other programmable data processing terminal equipment to generate a machine, so that instructions executed by the processor of the computer or other programmable data processing terminal equipment A device for realizing the functions specified in one flow or multiple flows in the flowchart and/or one block or multiple blocks in the block diagram is generated.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing terminal equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The instruction device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上,使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing terminal equipment, so that a series of operation steps are executed on the computer or other programmable terminal equipment to produce computer-implemented processing, so that the computer or other programmable terminal equipment The instructions executed above provide steps for implementing functions specified in one or more processes in the flowchart and/or one or more blocks in the block diagram.
尽管已描述了本申请实施例的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请实施例范围的所有变更和修改。Although the preferred embodiments of the embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。Finally, it should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities Or there is any such actual relationship or sequence between operations. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also those that are not explicitly listed. Other elements listed, or also include elements inherent to this process, method, article, or terminal device. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other same elements in the process, method, article or terminal device that includes the element.
以上对本申请所提供的一种无人车的通信方法和一种无人车,进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The above describes in detail an unmanned vehicle communication method and an unmanned vehicle provided in this application. Specific examples are used in this article to illustrate the principles and implementation of the application. The description of the above embodiments is only It is used to help understand the method and core idea of this application; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation and the scope of application. In summary, this The content of the description should not be construed as a limitation on this application.

Claims (22)

  1. 一种无人车的通信方法,其特征在于,所述无人车具有视频采集设备,所述方法包括:An unmanned vehicle communication method, characterized in that the unmanned vehicle has a video capture device, and the method includes:
    建立与远程控制设备的多个通信通道;Establish multiple communication channels with remote control equipment;
    从所述多个通信通道中选取一个目标通信通道,并在所述目标通信通道向所述远程控制设备发送所述视频采集设备采集的视频数据;Selecting a target communication channel from the plurality of communication channels, and sending the video data collected by the video capture device to the remote control device on the target communication channel;
    在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据;After detecting the communication problem, use the video data to determine corresponding redundant video data for other communication channels except the target communication channel;
    在除所述目标通信通道之外的通信通道,向所述远程控制设备发送相应的冗余视频数据。In a communication channel other than the target communication channel, corresponding redundant video data is sent to the remote control device.
  2. 根据权利要求1所述的方法,其特征在于,所述无人车具有多个网卡,所述建立与远程控制设备的多个通信通道,包括:The method according to claim 1, wherein the unmanned vehicle has multiple network cards, and the establishing multiple communication channels with a remote control device comprises:
    调用预置的网页即时通信WebRTC API,采用所述多个网卡分别建立与远程控制设备的多个通信通道。The preset webpage instant messaging WebRTC API is called, and the multiple network cards are used to respectively establish multiple communication channels with the remote control device.
  3. 根据权利要求1所述的方法,其特征在于,所述在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据,包括:The method according to claim 1, characterized in that, after detecting a communication problem, using the video data to determine corresponding redundant video data for other communication channels except the target communication channel, include:
    在检测到通信问题后,确定评估时间点;After detecting communication problems, determine the time point for evaluation;
    在所述评估时间点之后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据。After the evaluation time point, the video data is used to determine corresponding redundant video data for communication channels other than the target communication channel.
  4. 根据权利要求3所述的方法,其特征在于,所述采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据,包括:The method according to claim 3, wherein said using said video data to determine corresponding redundant video data for communication channels other than said target communication channel respectively comprises:
    对除所述目标通信通道之外的其它通信通道,在所述视频数据包括的视频帧中,按照预设帧间隔选取视频帧作为冗余视频数据。For communication channels other than the target communication channel, among the video frames included in the video data, video frames are selected as redundant video data according to a preset frame interval.
  5. 根据权利要求3所述的方法,其特征在于,所述确定评估时间点,包括:The method according to claim 3, wherein the determining the evaluation time point comprises:
    按照预设时间周期,确定评估时间点。Determine the evaluation time point according to the preset time period.
  6. 根据权利要求3所述的方法,其特征在于,还包括:The method according to claim 3, further comprising:
    获取所述远程控制设备在各个通信通道的数据接收量;Acquiring the amount of data received by the remote control device in each communication channel;
    确定各个通信通道的数据发送量;Determine the data transmission volume of each communication channel;
    采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信通道的数据 发送数量,计算所述各个通信通道的发送成功率。The amount of data received by the remote control device in each communication channel and the amount of data sent by each communication channel are used to calculate the transmission success rate of each communication channel.
  7. 根据权利要求6所述的方法,其特征在于,所述获取所述远程控制设备在各个通信通道的数据接收量,包括:The method according to claim 6, wherein said obtaining the data reception amount of the remote control device in each communication channel comprises:
    接收所述远程控制设备发送的在相邻的两个评估时间点之间,所述远程控制设备在各个通信通道的数据接收量。Receive the amount of data received by the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
  8. 根据权利要求7所述的方法,其特征在于,所述确定各个通信通道的数据发送量,包括:The method according to claim 7, wherein said determining the data transmission volume of each communication channel comprises:
    确定在相邻的两个评估时间点之间,各个通信通道的数据发送量。Determine the data transmission volume of each communication channel between two adjacent evaluation time points.
  9. 根据权利要求8所述的方法,其特征在于,所述采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信的数据发送数量,计算所述各个通信通道的发送成功率,包括:The method according to claim 8, wherein the calculation of the transmission success rate of each communication channel is performed by using the amount of data received by the remote control device in each communication channel and the amount of data sent by each communication. include:
    采用在相邻的两个评估时间点之间所述远程控制设备在各个通信通道的数据接收量,和在相邻的两个评估时间点之间所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The amount of data received by the remote control device on each communication channel between two adjacent evaluation time points and the amount of data sent by each communication channel between two adjacent evaluation time points are used to calculate Describe the transmission success rate of each communication channel.
  10. 根据权利要求6所述的方法,其特征在于,所述从所述多个通信通道中选取一个目标通信通道,包括:The method according to claim 6, wherein the selecting a target communication channel from the plurality of communication channels comprises:
    将在前一个的评估时间点之后确定的发送成功率最高的通信通道,选取为当前的评估时间点之后的目标通信通道。The communication channel with the highest transmission success rate determined after the previous evaluation time point is selected as the target communication channel after the current evaluation time point.
  11. 一种无人车,其特征在于,所述无人车具有视频采集设备,所述无人车还包括:An unmanned vehicle, characterized in that the unmanned vehicle has video capture equipment, and the unmanned vehicle further includes:
    通信通道建立模块,用于建立与远程控制设备的多个通信通道;Communication channel establishment module, used to establish multiple communication channels with remote control equipment;
    视频数据发送模块,用于从所述多个通信通道中选取一个目标通信通道,并在所述目标通信通道向所述远程控制设备发送所述视频采集设备采集的视频数据;A video data sending module, configured to select a target communication channel from the multiple communication channels, and send the video data collected by the video acquisition device to the remote control device on the target communication channel;
    冗余视频数据确定模块,用于在检测到通信问题后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据;The redundant video data determining module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after a communication problem is detected;
    冗余视频数据发送模块,用于在除所述目标通信通道之外的通信通道,向所述远程控制设备发送相应的冗余视频数据。The redundant video data sending module is used to send corresponding redundant video data to the remote control device on a communication channel other than the target communication channel.
  12. 根据权利要求11所述的无人车,其特征在于,所述通信通道建立模块包括:The unmanned vehicle according to claim 11, wherein the communication channel establishment module comprises:
    通信通道建立子模块,用于调用预置的网页即时通信WebRTC API,采用所述多个网卡分别建立与远程控制设备的多个通信通道。The communication channel establishment sub-module is used to call the preset webpage instant messaging WebRTC API, and use the multiple network cards to respectively establish multiple communication channels with the remote control device.
  13. 根据权利要求11所述的无人车,其特征在于,所述冗余视频数据确定模块包括:The unmanned vehicle according to claim 11, wherein the redundant video data determining module comprises:
    评估时间点确定子模块,用于在检测到通信问题后,确定评估时间点;The evaluation time point determination sub-module is used to determine the evaluation time point after a communication problem is detected;
    冗余视频数据确定子模块,用于在所述评估时间点之后,采用所述视频数据分别对除所述目标通信通道之外的其它通信通道,确定相应的冗余视频数据。The redundant video data determining sub-module is configured to use the video data to determine corresponding redundant video data for communication channels other than the target communication channel after the evaluation time point.
  14. 根据权利要求13所述的无人车,其特征在于,所述冗余视频数据确定子模块包括:The unmanned vehicle according to claim 13, wherein the redundant video data determining sub-module comprises:
    冗余视频数据确定单元,用于对除所述目标通信通道之外的其它通信通道,在所述视频数据包括的视频帧中,按照预设帧间隔选取视频帧作为冗余视频数据。The redundant video data determining unit is configured to select video frames as redundant video data according to a preset frame interval among the video frames included in the video data for communication channels other than the target communication channel.
  15. 根据权利要求13所述的无人车,其特征在于,所述评估时间点确定子模块包括:The unmanned vehicle according to claim 13, wherein the evaluation time point determination sub-module comprises:
    评估时间点确定单元,用于按照预设时间周期,确定评估时间点。The evaluation time point determining unit is used to determine the evaluation time point according to a preset time period.
  16. 根据权利要求13所述的无人车,其特征在于,还包括:The unmanned vehicle according to claim 13, further comprising:
    数据接收量获取模块,用于获取所述远程控制设备在各个通信通道的数据接收量;A data receiving amount acquisition module, configured to acquire the data receiving amount of the remote control device in each communication channel;
    数据发送量确定模块,用于确定各个通信通道的数据发送量;The data transmission volume determination module is used to determine the data transmission volume of each communication channel;
    发送成功率计算模块,用于采用所述远程控制设备在各个通信通道的数据接收量和所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The transmission success rate calculation module is used to calculate the transmission success rate of each communication channel by using the data reception amount of each communication channel of the remote control device and the data transmission amount of each communication channel.
  17. 根据权利要求16所述的无人车,其特征在于,所述数据接收量获取模块包括:The unmanned vehicle according to claim 16, wherein the data receiving amount acquisition module comprises:
    数据接收量接收子模块,用于接收所述远程控制设备发送的在相邻的两个评估时间点之间,所述远程控制设备在各个通信通道的数据接收量。The data reception volume receiving submodule is used to receive the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points sent by the remote control device.
  18. 根据权利要求17所述的无人车,其特征在于,所述数据发送量确定模块包括:The unmanned vehicle according to claim 17, wherein the data transmission amount determining module comprises:
    数据发送量确定子模块,用于确定在相邻的两个评估时间点之间,各个通信通道的数据发送量。The data transmission volume determination sub-module is used to determine the data transmission volume of each communication channel between two adjacent evaluation time points.
  19. 根据权利要求18所述的无人车,其特征在于,所述发送成功率计算模块包括:The unmanned vehicle of claim 18, wherein the sending success rate calculation module comprises:
    发送成功率计算子模块,用于采用在相邻的两个评估时间点之间所述远程控制设备在各个通信通道的数据接收量,和在相邻的两个评估时间点之间所述各个通信通道的数据发送数量,计算所述各个通信通道的发送成功率。The transmission success rate calculation sub-module is used to adopt the data reception volume of the remote control device in each communication channel between two adjacent evaluation time points, and the data reception between two adjacent evaluation time points. The data transmission quantity of the communication channel is calculated, and the transmission success rate of each communication channel is calculated.
  20. 根据权利要求16所述的无人车,其特征在于,所述视频数据发送模块包括:The unmanned vehicle according to claim 16, wherein the video data sending module comprises:
    目标通信通道选取子模块,用于将在前一个的评估时间点之后确定的发送成功率最高的通信通道,选取为当前的评估时间点之后的目标通信通道。The target communication channel selection sub-module is used to select the communication channel with the highest transmission success rate determined after the previous evaluation time point as the target communication channel after the current evaluation time point.
  21. 一种装置,其特征在于,包括:A device, characterized in that it comprises:
    一个或多个处理器;和One or more processors; and
    其上存储有指令的一个或多个机器可读介质,当由所述一个或多个处理器执行时,使得所述装置执行如权利要求1-10所述的一个或多个的方法。One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the device to perform one or more of the methods according to claims 1-10.
  22. 一个或多个机器可读介质,其上存储有指令,当由一个或多个处理器执行时,使得所述处理器执行如权利要求1-10所述的一个或多个的方法。One or more machine-readable media having instructions stored thereon, when executed by one or more processors, cause the processors to perform one or more of the methods according to claims 1-10.
PCT/CN2020/089932 2019-05-21 2020-05-13 Communication method for unmanned vehicle, and unmanned vehicle WO2020233462A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910426232.6A CN110247955A (en) 2019-05-21 2019-05-21 Unmanned vehicle communication method and unmanned vehicle
CN201910426232.6 2019-05-21

Publications (1)

Publication Number Publication Date
WO2020233462A1 true WO2020233462A1 (en) 2020-11-26

Family

ID=67884580

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/089932 WO2020233462A1 (en) 2019-05-21 2020-05-13 Communication method for unmanned vehicle, and unmanned vehicle

Country Status (2)

Country Link
CN (1) CN110247955A (en)
WO (1) WO2020233462A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110247955A (en) * 2019-05-21 2019-09-17 菜鸟智能物流控股有限公司 Unmanned vehicle communication method and unmanned vehicle
CN111064552B (en) * 2019-11-22 2023-05-30 科大讯飞股份有限公司 Intelligent device control method and device, electronic device and storage medium
CN114584809A (en) * 2020-12-02 2022-06-03 华为技术有限公司 Data transmission method and system and electronic equipment
CN112622931A (en) * 2020-12-22 2021-04-09 北京百度网讯科技有限公司 Abnormity processing method in parallel driving, automatic driving vehicle and cloud driving cabin
CN113703441B (en) * 2021-08-04 2023-03-10 北京三快在线科技有限公司 Control method, device and system of unmanned equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105472477A (en) * 2015-12-08 2016-04-06 广州华多网络科技有限公司 Data transmission method, device and equipment
US20160119075A1 (en) * 2014-10-24 2016-04-28 Ciena Corporation Flexible ethernet and multi link gearbox mapping procedure to optical transport network
CN109587052A (en) * 2019-01-30 2019-04-05 展讯通信(上海)有限公司 A kind of multilink data transmission method and device
CN109600388A (en) * 2019-01-03 2019-04-09 腾讯科技(深圳)有限公司 Data transmission method, device, computer-readable medium and electronic equipment
CN110247955A (en) * 2019-05-21 2019-09-17 菜鸟智能物流控股有限公司 Unmanned vehicle communication method and unmanned vehicle

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090278941A1 (en) * 2008-05-10 2009-11-12 Mark Hilton Smith Multi-channel streaming device and related method
CN101662455A (en) * 2008-08-29 2010-03-03 深圳华为通信技术有限公司 Method and device for data transmission
CN102118300B (en) * 2009-12-31 2014-03-12 华为软件技术有限公司 Method and device for transmitting data streams in multiple channels
CN202003205U (en) * 2011-02-23 2011-10-05 上海远动科技有限公司 Integrating multichannel redundant structure data acquisition device
CN103685144A (en) * 2012-08-31 2014-03-26 中兴通讯股份有限公司 Media stream transmission method and device
CN104980259A (en) * 2014-04-08 2015-10-14 江苏卓易信息科技股份有限公司 Method and device for multilink data transmission
CN104410509B (en) * 2014-10-16 2018-01-05 宁波菊风系统软件有限公司 A kind of multi-path data transmission method based on quality evaluation
CN104661050B (en) * 2015-02-13 2018-05-01 海信集团有限公司 A kind of streaming media data transmission method, apparatus and system
CN105704580B (en) * 2016-01-21 2018-09-11 深圳比特新技术有限公司 A kind of video transmission method
CN106658644B (en) * 2016-12-09 2020-08-04 广州华多网络科技有限公司 Communication network routing method and device
CN108769726B (en) * 2018-06-14 2022-05-31 腾讯科技(深圳)有限公司 Multimedia data pushing method and device, storage medium and equipment
CN108933833A (en) * 2018-07-17 2018-12-04 同济大学 A kind of unmanned plane control system and connection method for building up based on WebRTC
CN109167703B (en) * 2018-08-29 2021-06-01 百度在线网络技术(北京)有限公司 Unmanned vehicle data monitoring method, device, equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160119075A1 (en) * 2014-10-24 2016-04-28 Ciena Corporation Flexible ethernet and multi link gearbox mapping procedure to optical transport network
CN105472477A (en) * 2015-12-08 2016-04-06 广州华多网络科技有限公司 Data transmission method, device and equipment
CN109600388A (en) * 2019-01-03 2019-04-09 腾讯科技(深圳)有限公司 Data transmission method, device, computer-readable medium and electronic equipment
CN109587052A (en) * 2019-01-30 2019-04-05 展讯通信(上海)有限公司 A kind of multilink data transmission method and device
CN110247955A (en) * 2019-05-21 2019-09-17 菜鸟智能物流控股有限公司 Unmanned vehicle communication method and unmanned vehicle

Also Published As

Publication number Publication date
CN110247955A (en) 2019-09-17

Similar Documents

Publication Publication Date Title
WO2020233462A1 (en) Communication method for unmanned vehicle, and unmanned vehicle
EP3842919A1 (en) Method, apparartus and system for controlling projection screen
CN106304203B (en) Data transmission method and device
RU2015126358A (en) AUDIO VIDEO COMMUNICATION THROUGH INTERMEDIATE SERVER WITH REDUCED DELAY
CN106331613B (en) Communication method and system based on unmanned aerial vehicle
CN104735470A (en) Streaming media data transmission method and device
CN104125429A (en) Video data transmission adjusting method and device
CN104427286B (en) A kind of method and system carrying out video calling
US20200169774A1 (en) Control method and device
US9654996B2 (en) Method and device for monitoring radio link
EP2942918A1 (en) Method and device for transmitting streaming media data
CN109428864B (en) Method and device for improving quality of nginx-rtmp pull flow service
US10671336B2 (en) Method and device for controlling screen sharing among plurality of terminals, and recording medium
US9538132B2 (en) Methods, devices, and systems for controlling audio and video transmission
CN108924485B (en) Client real-time video stream interrupt processing method and system and monitoring system
JP2016506206A (en) Retransmission and frame synchronization for error control
CN105025294A (en) Video transmission control device and method
CN103780869B (en) Method for dynamically adjusting video transmission efficiency in video session
CN110460801A (en) The method and device of data forwarding between a kind of media server
CN112866390B (en) Data transmission method, device, terminal equipment and storage medium
CN111615137B (en) Wireless network state detection method and related equipment thereof
CN106454538B (en) Real-time bullet screen interaction method
CN109618240A (en) Wireless Multi-Channel adaptive equilibrium method for real-time audio and video transmission
CN105007500A (en) Video transmission method and device
CN113766267B (en) Multi-path video live broadcast method, system, equipment and storage medium based on unmanned aerial vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20808860

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20808860

Country of ref document: EP

Kind code of ref document: A1