WO2023040984A1 - 基于无人机的多路视频直播方法、系统、设备及存储介质 - Google Patents

基于无人机的多路视频直播方法、系统、设备及存储介质 Download PDF

Info

Publication number
WO2023040984A1
WO2023040984A1 PCT/CN2022/119124 CN2022119124W WO2023040984A1 WO 2023040984 A1 WO2023040984 A1 WO 2023040984A1 CN 2022119124 W CN2022119124 W CN 2022119124W WO 2023040984 A1 WO2023040984 A1 WO 2023040984A1
Authority
WO
WIPO (PCT)
Prior art keywords
webrtc
channel
user terminal
target
video data
Prior art date
Application number
PCT/CN2022/119124
Other languages
English (en)
French (fr)
Inventor
冯银华
冷杰
Original Assignee
深圳市道通智能航空技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市道通智能航空技术股份有限公司 filed Critical 深圳市道通智能航空技术股份有限公司
Publication of WO2023040984A1 publication Critical patent/WO2023040984A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25816—Management of client data involving client authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA

Definitions

  • the present invention relates to the technical field of UAV data transmission, in particular to a UAV-based multi-channel video live broadcast method, system, equipment and storage medium.
  • the present invention provides a UAV-based multi-channel video live broadcast method, system, equipment and storage medium, to provide WebRtc room with the help of WebRtc protocol to simultaneously acquire multi-channel man-machine video data for real-time live broadcast, which can meet multiple Real-time live broadcast requirements for teams and multiple drones.
  • the present invention provides a multi-channel video live broadcast method based on drones, the method comprising:
  • the multi-channel UAV video data is sent to the user terminal in real time based on the WebRtc interface, so that the user terminal displays multiple live images according to the multi-channel UAV video data.
  • the establishing the first connection based on the WebRtc interface with the multiple target devices according to the connection requests of the multiple target devices includes:
  • the method before receiving the connection requests of the multiple target devices, the method further includes:
  • the multi-channel UAV video data after sending the multi-channel UAV video data to the user terminal in real time based on the WebRtc interface, it also includes:
  • the method further includes:
  • the method further includes:
  • the multi-channel UAV video data after sending the multi-channel UAV video data to the user terminal in real time based on the WebRtc interface, it also includes:
  • the embodiment of the present invention also provides a multi-channel video live broadcast system based on drones, including:
  • a connection establishment module configured to establish a first connection based on the WebRtc interface with the plurality of target devices according to the connection requests of the plurality of target devices, and establish a second connection based on the WebRtc interface with the user terminal according to the login request of the user terminal,
  • the first connection is used to connect the plurality of target devices to a target WebRtc room
  • the second connection is used to connect the user terminal to the target WebRtc room
  • Video data acquisition module for obtaining the multi-channel unmanned aerial vehicle video data that described multiple target devices send in real time based on WebRtc interface
  • the video data sending module is used to send the multi-channel UAV video data to the user terminal in real time based on the WebRtc interface, so that the user terminal displays multiple live images according to the multi-channel UAV video data.
  • the present invention provides a computer device, including a memory and a processor, the memory stores a computer program that can run on the processor, and when the processor executes the computer program, any one of the present invention is implemented.
  • the multi-channel video live broadcast method based on the drone provided in the embodiment.
  • the present invention provides a computer-readable storage medium, the storage medium stores a computer program, the computer program includes program instructions, and when the program instructions are executed, the program instructions provided in any embodiment of the present invention are implemented.
  • UAV-based multi-channel video live broadcast method UAV-based multi-channel video live broadcast method.
  • the UAV-based multi-channel video live broadcast method adds multiple target devices and user terminals to the corresponding The target WebRtc room, with the help of the target WebRtc room, realizes the real-time transmission of multi-channel UAV video data of multiple target devices to the user terminal, so as to realize a one-to-many live broadcast picture transmission scheme. Based on this method, it can support simultaneous viewing of multiple channels on the same server. Real-time video, and can realize parallel multi-room real-time live broadcast according to the WebRtc room, which increases the function of the UAV system and has a wider range of applications.
  • Fig. 1 is a flow chart of a multi-channel video live broadcast method based on a drone provided in Embodiment 1 of the present invention
  • Fig. 2 is a sub-flowchart of the multi-channel video live broadcast method based on drones provided by Embodiment 1 of the present invention
  • Fig. 3 is a flow chart of the multi-channel video live broadcast method based on drones provided by Embodiment 2 of the present invention.
  • FIG. 4 is a flow chart of a multi-channel video live broadcast method based on a drone provided in Embodiment 2 of the present invention
  • Fig. 5 is a flow chart of a multi-channel video live broadcast method based on a drone provided by Embodiment 2 of the present invention
  • Fig. 6 is a sub-flowchart of the multi-channel video live broadcast method based on drones provided by Embodiment 2 of the present invention.
  • FIG. 7 is a schematic structural diagram of a multi-channel video live broadcast system based on a drone provided by Embodiment 3 of the present invention.
  • FIG. 8 is a schematic structural diagram of a computer device provided by Embodiment 4 of the present invention.
  • first”, “second”, etc. may be used herein to describe various directions, actions, steps or elements, etc., but these directions, actions, steps or elements are not limited by these terms. These terms are only used to distinguish a first direction, action, step or element from another direction, action, step or element.
  • a first use case could be termed a second use case, and, similarly, a second use case could be termed a first use case, without departing from the scope of the present invention.
  • Both the first use case and the second use case are use cases, but they are not the same use case.
  • the terms “first”, “second”, etc. should not be interpreted as indicating or implying relative importance or implying the number of indicated technical features.
  • features defined as “first” and “second” may explicitly or implicitly include a combination of one or more features.
  • “plurality” means at least two, such as two, three, etc., unless otherwise specifically defined. It should be noted that when a part is said to be “fixed” to another part, it can be directly on the other part or there can be an intermediate part. When a section is said to be “connected” to another section, it may be directly connected to the other section or there may be intervening sections at the same time.
  • the terms “vertical”, “horizontal”, “left”, “right” and similar expressions are for the purpose of illustration only and do not represent the only embodiment.
  • the present embodiment provides a multi-channel video live broadcast method based on drones, which can be applied to a drone system, which includes a drone, a user terminal and a server, wherein: the drone is Controlled by remote control equipment or self-contained program control device, it is an unmanned aircraft with mission load; the terminal is an electronic device connected to a server, usually using a mobile phone, a tablet, and a PC; the server is a WebRtc server, which is used to establish a WebRtc Room for the WebRtc interface.
  • the UAV-based multi-channel video live broadcast method provided in this embodiment can be specifically executed by a user terminal or a server, or can be completed by interaction between a user terminal and a server.
  • a server is taken as an example for specific description. As shown in Figure 1, the method includes the following steps:
  • the target device refers to the device used to return UAV video data, and usually each target device returns one UAV video data.
  • the target device is usually a remote control ground station, a drone nest, or a mobile terminal that can connect to the server through wired and/or wireless connections, and in some special cases can also send drone video data by itself.
  • Drone (requires WIFI module). More specifically, in this embodiment, by default, parameters such as the format, definition, and size of one path of UAV video data returned by each target device are the same initially.
  • the connection request is sent by the target device to the server, which is used to call the corresponding WebRtc interface to establish the connection between the target device and the server.
  • the user terminal is a terminal device used for live broadcast display, usually a mobile phone, a tablet, and a PC.
  • the login request is sent by the user terminal. Based on the special situation of using the WebRtc interface in the present embodiment, the login request represents the relevant information sent when the user terminal logs in to the server by means of a web program.
  • WebRTC Web Real-Time Communications
  • WebRTC interface refers to the interface used to establish the data transmission channel among the interfaces provided by WebRTC, mainly including the RTCPeerConnection interface and the RTCDataChannel interface.
  • the first connection actually represents the communication relationship between the server and the target device, indicating that a data transmission channel has been established between the two.
  • the second connection represents the communication relationship between the server and the user terminal.
  • a room is a built-in concept of the WebRTC server.
  • the WebRTC server uses the room to realize specific multi-object data interaction.
  • the target WebRtc room is a room provided by the WebRTC server for multiple target devices and user terminals. UAV video data transmission, its data transmission is limited to the target WebRtc room. It can be understood that the WebRTC server can provide one or more WebRtc rooms to meet the real-time tasks of multi-team collaboration.
  • connection request includes a room number and a room password.
  • step S110 according to the connection requests of multiple target devices, the first connection based on the WebRtc interface is established with the multiple target devices.
  • the process includes steps S111-112:
  • S111 Receive connection requests from the plurality of target devices, and verify whether the room number and room password in the connection request correspond to the target WebRtc room.
  • the software installed on the target device obtains the room number and room password of the server through the private protocol, sends a connection request including the room number and room password to the server, and the server verifies its room number and room password Whether it is legal, and the room password and room number correspond to the same WebRtc room, if it is legal and the room number and room password can be matched, then add the target device to the corresponding WebRtc room through the WebRtc interface (establish the first connection).
  • step S100 (not shown) of establishing the WebRtc room should be included before step S110:
  • WebRtc room is served by WebRtc server
  • the UAV can join the target WebRtc room through the interface provided by WebRtc independently or with the help of an external device (such as a remote control ground station), and similarly, the user terminal can join the target WebRtc room through the interface provided by WebRtc.
  • an external device such as a remote control ground station
  • the multi-channel UAV video data is the video data collected by multiple UAVs, which is pushed to the WebRtc server in real time through the streaming interface provided by WebRtc (that is, the WebRtc interface).
  • the multiple target devices transmit the UAV video data collected by their corresponding UAVs to the WebRtc server through the WebRtc interface in real time, and the WebRtc server receives multiple UAV video data in real time.
  • Road drone video data After multiple target devices join the target WebRtc room, the multiple target devices transmit the UAV video data collected by their corresponding UAVs to the WebRtc server through the WebRtc interface in real time, and the WebRtc server receives multiple UAV video data in real time. Road drone video data.
  • the target WebRtc room in this embodiment is used to realize the UAV video data transmission between multiple target devices in the room and the user terminal: the server receives the multi-channel unmanned video data sent by multiple target devices in the target room After receiving the drone video data, the multi-channel drone video data is sent to the user terminal in the target room in real time through the WebRtc interface. After receiving the multi-channel drone video data, the user terminal synchronously displays it through a display unit such as a display screen , Real-time multi-channel live broadcast can be realized.
  • a display unit such as a display screen
  • the WebRTC server can provide multiple WebRtc rooms, such as room 1 and room 2, room 1 is connected to target device A, target device B and user terminal I, and room 2 is connected to Target device C, target device D, and user terminal II, then target device A and target device B return to the WebRTC server in real time.
  • the two-way UAV video data is finally received and displayed by user terminal I, and target device C and target device D
  • the two-way UAV video data returned to the WebRTC server in real time is finally received and displayed by the user terminal II.
  • target device A, target device B and user terminal I can represent the equipment used by the first team to perform corresponding tasks
  • target device C, target device D and user terminal II can represent the equipment used by the second team to perform corresponding tasks
  • the equipment that is, with the help of this method, the multi-team and multi-UAV multi-channel live broadcast is realized, which makes the function of the UAV system more abundant and the application range wider.
  • the UAV-based multi-channel video live broadcast method provided in this embodiment, first, multiple target devices and user terminals are added to the corresponding target WebRtc room according to the connection request of multiple target devices and the login request of the user terminal.
  • the room realizes the real-time transmission of multi-channel UAV video data of multiple target devices to the user terminal to realize a one-to-many live image transmission solution. Based on this method, it can support simultaneous viewing of multiple real-time videos on the same server, and it can The room realizes parallel multi-room real-time live broadcast, which increases the functions of the UAV system and has a wider range of applications.
  • Embodiment 2 provides a UAV-based multi-channel video live broadcast method, which can be implemented on the basis of Embodiment 1, and provides specific supplements or examples for some of the content in Embodiment 1, such as providing according to user
  • the process of viewing the single-channel live video through the command of the terminal includes:
  • the UAV-based multi-channel video live broadcast method provided in this embodiment includes:
  • S240 Generate a first resolution adjustment instruction according to the single-channel video viewing instruction sent by the user terminal, where the single-channel video viewing instruction is used to specify to view a live image of the first target device.
  • the single-channel video viewing instruction is used to determine that the user needs to watch a live video of a certain channel alone, and is generated according to the user's selection operation of multiple live images based on the user terminal.
  • the multi-channel UAV video data has been displayed through the user terminal, but in practical applications, due to the limited bandwidth of the current server and the large amount of data in the multi-channel video, it is inevitable that each channel video cannot provide enough Clear live broadcast images, and users may have a need to view high-definition live broadcast images at any time, so this embodiment further provides a method for performing single-channel live broadcast according to user needs.
  • the user terminal can obtain the user's operation and generate corresponding instructions according to the user's operation. For example, the user can select a live video of a certain video in the multi-channel live video to view, and the user terminal can generate an instruction corresponding to the video according to the selection operation.
  • the single-channel video viewing instruction and send the single-channel video viewing instruction to the server.
  • the server After receiving the single-channel video viewing instruction, the server analyzes it to determine the target device corresponding to the single-channel video viewing instruction, that is, the first The target device further determines that the user needs to watch the live video of the first target device alone, and generates a corresponding first resolution adjustment instruction, and the first resolution adjustment instruction is used to instruct the first target device to transmit video data with higher definition.
  • the server sends the first resolution adjustment instruction to the first target device, and the first target device adjusts the transmitted UAV video data according to the first resolution adjustment instruction.
  • the improvement of the resolution parameters during encoding and decoding can improve the clarity of the final live image.
  • steps S260-270 are also included:
  • the first threshold is a preset value, and is used to judge whether the server currently needs to reduce the resolution of the live images of other videos when the user views the live images of a single video.
  • the second resolution adjustment instruction is opposite to the first resolution adjustment instruction, and is used to reduce the definition of the live image of the corresponding video, so that when the user views the live image of a single video, the resolution of the live image of other videos can be guaranteed.
  • the single-channel video viewed by the user is broadcast live with low latency.
  • a specific example is used to illustrate this solution: For example, the current server bandwidth supports a maximum of 32 channels of live video (the live image of each channel is the default resolution), and when the user views a single video, it is assumed that the resolution of the single video increases and then increases.
  • the large amount of data is equivalent to the data volume of 8-channel default video live broadcasting, and the first threshold can be set to 24.
  • the first threshold can be set to 24.
  • the user is viewing the single-channel video of the first target device, if there are currently 16 channels of video live (connected 16 target devices), there is no need to adjust other channels of video. If there are currently 26 channels of video live, you need to send a second resolution adjustment command to the other 25 target devices except the first target device, so that other channels
  • the 25 target devices reduce the image resolution of the corresponding UAV video data according to the second resolution adjustment instruction, thereby reducing the overall data volume of the multi-channel video.
  • the UAV-based multi-channel video live broadcast method provided in this embodiment, after step S250, also includes steps S280-290:
  • the target position viewing instruction is used to determine the target position on the live screen that the user needs to view. It is generated according to the user's selection operation of the target position on the live screen, and includes information such as the coordinates and size of the target position in the live screen (for example, on the live screen The abscissa x, ordinate y, width width and height height).
  • the area adjustment instruction is used to instruct the corresponding target device (that is, the first target device) to collect high-definition images of the real area corresponding to the target position.
  • This embodiment is mainly used to solve the situation that the user still has insufficient clarity when viewing the live picture of a single-channel video (such as flying too high, zooming too much, etc.), and the target position viewing instruction is based on the single-channel video at this time.
  • the first target device After the user terminal sends out the command to view the target position, the first target device performs high-definition encoding on the target position when returning the UAV video data, so that the user terminal can display the target position with higher definition Live screen.
  • the multi-channel video live broadcast method based on drones includes:
  • the second threshold is similar to the first threshold, and is a preset value, which is used to determine whether the server currently needs to reduce the definition of live video images of all links when the target device is connected to the server.
  • the number of connections of the target device is greater than or equal to the second threshold, it means that the data transmission pressure of the server is high and it is necessary to reduce the definition of the live broadcast image to ensure low delay of the live broadcast.
  • the server After determining that the number of connections of the target device is greater than or equal to the second threshold, the server generates a third resolution adjustment instruction for reducing the definition of the live image (which can reduce the amount of transmitted data) to ease the pressure on data transmission, and adjusts the third resolution
  • the instruction is sent to each target device connected to the server.
  • the target device After receiving the third resolution adjustment instruction, the target device reduces the amount of transmitted data by reducing the image resolution and/or transmission bit rate of the video data of the drone.
  • This embodiment further provides the live broadcast adjustment process when the user needs to view a single-channel video, the live broadcast adjustment process when the user needs to view the target area, and the live broadcast adjustment process when there are too many connected target devices, which can ensure low live broadcast delay. Meet the different needs of users, enrich the live broadcast function of the UAV system, and meet more operational needs.
  • FIG. 7 is a schematic structural diagram of a UAV-based multi-channel video live broadcast system 400 provided in Embodiment 3 of the present invention. As shown in FIG. 7 , the system 400 includes:
  • the connection establishment module 410 is configured to establish a first connection based on the WebRtc interface with the plurality of target devices according to the connection requests of the plurality of target devices, and establish a second connection based on the WebRtc interface with the user terminal according to the login request of the user terminal , the first connection is used to connect the plurality of target devices to the target WebRtc room, and the second connection is used to connect the user terminal to the target WebRtc room;
  • Video data acquisition module 420 for real-time acquisition of the multi-channel UAV video data sent by the multiple target devices based on the WebRtc interface;
  • the video data sending module 430 is used to send the multi-channel UAV video data to the user terminal in real time based on the WebRtc interface, so that the user terminal displays multi-channel live images according to the multi-channel UAV video data .
  • connection establishment module 410 is specifically configured to:
  • the system 400 also includes:
  • the room establishment module is used to establish one or more WebRtc rooms and configure the room numbers and room passwords corresponding to the WebRtc rooms.
  • it also includes a first resolution adjustment module, configured to: after sending the multi-channel UAV video data to the user terminal in real time based on the WebRtc interface, according to the user terminal sending
  • the single-channel video viewing instruction generates the first resolution adjustment instruction, and the single-channel video viewing instruction is used to specify to view the live image of the first target device;
  • the first resolution adjustment instruction is sent to the first target device, so that the first target device increases the image resolution of the corresponding UAV video data according to the first adjustment instruction.
  • a second resolution adjustment module is also included, for:
  • a local encoding module is also included for:
  • an area adjustment instruction is generated according to the target position viewing instruction sent by the user terminal;
  • a third resolution adjustment module is also included, configured to:
  • the number of connections of the target device is detected to determine whether the number of connections is greater than or equal to a second threshold
  • This embodiment provides a multi-channel video live broadcast system based on drones.
  • multiple target devices and user terminals are added to the corresponding target WebRtc room.
  • the WebRtc room realizes the real-time transmission of multi-channel UAV video data of multiple target devices to the user terminal to realize a one-to-many live image transmission solution. Based on this method, it can support simultaneous viewing of multiple real-time videos on the same server, and can be based
  • the WebRtc room realizes parallel multi-room real-time live broadcast, increases the function of the drone system, and has a wider range of applications.
  • FIG. 8 is a schematic structural diagram of a computer device 500 that can implement a multi-channel video live broadcast method based on a drone provided by Embodiment 4 of the present invention.
  • the device includes a memory 510 and a processor 520.
  • the number of processors 520 may be one or more.
  • One processor 520 is taken as an example in FIG. 8 ; the memory 510 and processor 520 in the device may be connected through a bus or in other ways, and a bus connection is taken as an example in FIG. 8 .
  • the memory 510 can be used to store software programs, computer-executable programs and modules, such as the program instructions/modules corresponding to the multi-channel video live broadcast method based on drones in the embodiment of the present invention (for example, The connection establishment module 410, the video data acquisition module 420, and the video data transmission module 430) in the multi-channel video live broadcast system based on the drone.
  • the processor 520 runs the software programs, instructions and modules stored in the memory 510 to execute various functional applications and data processing of the second page guidance module based on the two-dimensional code, that is, to realize the above-mentioned UAV-based Multi-channel video live broadcast method.
  • the processor 520 is configured to run a computer executable program stored in the memory 510, so as to realize the following steps: Step S110, establish the first WebRtc interface-based connection with the multiple target devices according to the connection requests of the multiple target devices A connection, establishing a second connection based on the WebRtc interface with the user terminal according to the login request of the user terminal, the first connection is used to connect the multiple target devices to the target WebRtc room, and the second connection is used for Connect the user terminal to the target WebRtc room; step S120, obtain the multi-channel UAV video data sent by the multiple target devices in real time based on the WebRtc interface; The human-machine video data is sent to the user terminal, so that the user terminal displays multiple channels of live images according to the multiple channels of drone video data.
  • the UAV-based multi-channel video live broadcast system provided by the embodiment of the present invention is not limited to the method operation described above, and can also perform the UAV-based video broadcasting system provided by any embodiment of the present invention. Related operations in the multi-channel video live broadcast method.
  • the memory 510 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the terminal, and the like.
  • the memory 510 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices.
  • the memory 510 may further include memory located remotely from the processor 520, and these remote memories may be connected to the device through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Embodiment 5 of the present invention also provides a storage medium including computer-executable instructions.
  • Human-machine multi-channel video live broadcast methods include:
  • the multi-channel UAV video data is sent to the user terminal in real time based on the WebRtc interface, so that the user terminal displays multiple live images according to the multi-channel UAV video data.
  • the computer-executable instructions are not limited to the method operations described above, and can also execute the UAV-based drone provided by any embodiment of the present invention. Related operations in the multi-channel video live broadcast method.
  • the present invention can be realized by means of software and necessary general-purpose hardware, and of course can also be realized by hardware, but in many cases the former is a better implementation Way.
  • the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a floppy disk of a computer , read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), flash memory (FLASH), hard disk or optical disc, etc., including several instructions to make a computer device (which can be a personal computer) , equipment, or network equipment, etc.) execute the methods described in various embodiments of the present invention.
  • a computer-readable storage medium such as a floppy disk of a computer , read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), flash memory (FLASH), hard disk or optical disc, etc.
  • the units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, each function
  • the specific names of the units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Graphics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例公开了一种基于无人机的多路视频直播方法、系统、设备及存储介质。该方法包括：根据多个目标设备的连接请求与多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与用户终端建立基于WebRtc接口的第二连接，通过第一连接和第二连接将多个目标设备和用户终端连接至目标WebRtc房间；基于WebRtc接口实时获取多个目标设备发送的多路无人机视频数据；基于WebRtc接口实时将多路无人机视频数据发送至用户终端。本发明实施例实现了多个目标设备的多路无人机视频数据实时传输至用户终端，实现一对多的直播画面传输方案，支持在同一服务器同时观看多路实时视频，且能够根据WebRtc房间实现并行的多房间实时直播，增加了无人机系统的功能，应用范围更广。

Description

基于无人机的多路视频直播方法、系统、设备及存储介质
本申请要求于2021年9月15日提交中国专利局、申请号为2021110811898、申请名称为“基于无人机的多路视频直播方法、系统、设备及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及无人机数据传输技术领域，尤其涉及一种基于无人机的多路视频直播方法、系统、设备及存储介质。
背景技术
随着无人机技术的发展，其应用场景越来越广泛，在电力巡线、交通救援以及海关边防等场景中发挥了巨大作用，而应用场景的扩展对无人机的性能提出了更高的要求，例如针对需要无人机实时传输直播画面的任务，目前无人机领域中只能同一时间在同一服务器观看一路视频流，对于多团队、多无人机协作的任务难以提供实时丰富的直播画面。
发明内容
有鉴于此，本发明提供了一种基于无人机的多路视频直播方法、系统、设备及存储介质，以借助WebRtc协议提供WebRtc房间实现同时获取多路人机视频数据进行实时直播，能够满足多团队、多无人机的实时直播需求。
为解决上述技术问题，本发明采用以下技术方案：
第一方面，本发明提供了一种基于无人机的多路视频直播方法，该方法包括：
根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间；
基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据；
基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
可选的，在一些实施例中，所述根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，包括：
接收所述多个目标设备的连接请求，验证所述连接请求中的房间号和房间密码是否对应所述目标WebRtc房间；
若是，则与对应的目标设备建立基于WebRtc接口的第一连接。
可选的，在一些实施例中，接收所述多个目标设备的连接请求之前，还包括：
建立一个或多个WebRtc房间并配置与WebRtc房间对应的房间号和房间密码。
可选的，在一些实施例中，基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端之后，还包括：
根据所述用户终端发送的单路视频查看指令生成第一分辨率调整指令，所述单路视频查看指令用于指定查看第一目标设备的直播画面；
将所述第一分辨率调整指令发送至所述第一目标设备，以使所述第一目标设备根据所述第一调整指令增加对应的无人机视频数据的图像分辨率。
可选的，在一些实施例中，所述根据所述用户终端发送的单路视频查看指令生成第一分辨率调整指令之后，还包括：
检测目标设备的连接数量，判断所述连接数量是否大于等于第一阈值；
若是，则生成第二分辨率调整指令，并向所述多个目标设备中除所述第一目标设备外的其他目标设备发送所述第二分辨率调整指令，以使所述其他目标设备根据所述第二分辨率调整指令降低对应的无人机视频数据的图像分辨率。
可选的，在一些实施例中，所述将所述第一分辨率调整指令发送至所述第一目标设备之后，还包括：
根据所述用户终端发送的目标位置查看指令生成区域调整指令；
将所述区域调整指令发送至所述第一目标设备，以使所述第一目标设备根据所述区域调整指令对对应的无人机视频数据的目标位置进行高清编码。
可选的，在一些实施例中，所述基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端之后，还包括：
检测目标设备的连接数量，判断所述连接数量是否大于等于第二阈值；
若是，则向所述多个目标设备发送第三分辨率调整指令，以使所述多个目标设备降低所述多路无人机视频数据的图像分辨率和/或传输码率。
第二方面，本发明实施例还提供了一种基于无人机的多路视频直播系统，包括：
连接建立模块，用于根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立 基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间；
视频数据获取模块，用于基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据；
视频数据发送模块，用于基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
第三方面，本发明提供了一种计算机设备，包括存储器和处理器，所述存储器上存储有可在处理器运行的计算机程序，所述处理器执行所述计算机程序时实现如本发明任一实施例提供的的基于无人机的多路视频直播方法。
第四方面，本发明提供了一种计算机可读存储介质，所述存储介质存储有计算机程序，所述计算机程序包括程序指令，所述程序指令当被执行时实现如本发明任一实施例提供的的基于无人机的多路视频直播方法。
同现有技术相比，本发明实施例提供的基于无人机的多路视频直播方法，根据多个目标设备的连接请求和用户终端的登录请求将多个目标设备和用户终端加入到对应的目标WebRtc房间，借助目标WebRtc房间实现多个目标设备的多路无人机视频数据实时传输至用户终端，以实现一对多的直播画面传输方案，基于该方法能够支持在同一服务器同时观看多路实时视频，且能够根据WebRtc房间实现并行的多房间实时直播，增加了无人机系统的功能，应用范围更广。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施 例或现有技术描述中所需要使用的附图作简单的介绍，显而易见的，下面描述中的附图仅仅是本申请的部分实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。
图1是本发明实施例一提供的一种基于无人机的多路视频直播方法的流程图；
图2是本发明实施例一提供的基于无人机的多路视频直播方法的子流程图；
图3是本发明实施例二提供的基于无人机的多路视频直播方法的流程图；
图4是本发明实施例二提供的基于无人机的多路视频直播方法的流程图；
图5是本发明实施例二提供的基于无人机的多路视频直播方法的流程图；
图6是本发明实施例二提供的基于无人机的多路视频直播方法的子流程图；
图7是本发明实施例三提供的一种基于无人机的多路视频直播系统的结构示意图；
图8是本发明实施例四提供的一种计算机设备的结构示意图。
具体实施方式
下面结合本申请实施例中的附图，对本申请实施中的技术方案进行清楚、完整的描述。可以理解的是，此处所描述的具体实施例仅仅是本申请一部分实施例，而不是全部的实施例，仅用于解释本申请，而非对本申请的限定。另外还需要说明的是，基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
除非另有定义，本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本文中在本发明的说明书中使用的术语 只是为了描述具体的实施方式的目的，不是旨在于限制本发明。本文所使用的术语“和/或”包括一个或多个相关的所列项目的任意的和所有的组合。
此外，术语“第一”、“第二”等可在本文中用于描述各种方向、动作、步骤或元件等，但这些方向、动作、步骤或元件不受这些术语限制。这些术语仅用于将第一个方向、动作、步骤或元件与另一个方向、动作、步骤或元件区分。举例来说，在不脱离本发明的范围的情况下，可以将第一用例称为第二用例，且类似地，可将第二用例称为第一用例。第一用例和第二用例两者都是用例，但其不是同一用例。术语“第一”、“第二”等而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者多个特征的组合。在本发明的描述中，“多个”的含义是至少两个，例如两个，三个等，除非另有明确具体的限定。需要说明的是，当一个部被称为“固定于”另一个部，它可以直接在另一个部上也可以存在居中的部。当一个部被认为是“连接”到另一个部，它可以是直接连接到另一个部或者可能同时存在居中部。本文所使用的术语“垂直的”、“水平的”、“左”、“右”以及类似的表述，只是为了说明的目的，并不表示是唯一的实施方式。
在更加详细地讨论示例性实施例之前应当提到的是，一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各步骤描述成顺序的处理，但是其中的许多步骤可以被并行地、并发地或者同时实施。此外，各步骤的顺序可以被重新安排。当其操作完成时处理可以被终止，但是还可以具有未包括在附图中的附加步骤。处理可以对应于方法、函数、规程、子例程、子程序等等。
实施例一
参见图1，本实施例提供了一种基于无人机的多路视频直播方法，该方法可以应用于无人机系统，该系统包括无人机、用户终端和服务器，其中：无人机为由遥控设备或自备程序控制装置操纵，带任务载荷的不载人航空器；用于终端为与服务器连接的电子设备，通常采用手机、平板以及PC等设备；服务器为WebRtc服务器，用于建立基于WebRtc接口的WebRtc房间。本实施例提供的基于无人机的多路视频直播方法具体可以由用户终端或服务器执行，也可以由用户终端和服务器之间交互完成，本实施例中以服务器为例进行具体说明。如图1所示，该方法包括以下步骤：
S110、根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间。
目标设备表示用于返回无人机视频数据的设备，通常每个目标设备返回一路无人机视频数据。具体的，目标设备通常为遥控器地面站、无人机巢乃是移动终端等能够与服务器通过有线和/或无线连接的设备，在一些特殊情况下还可是能够自行发送无人机视频数据的无人机(需要具备WIFI模块)。更具体的，在本实施例中，默认初始时每个目标设备返回的一路无人机视频数据其格式、清晰度和大小等参数都是相同的。连接请求由目标设备向服务器发出，用于调用相应的WebRtc接口建立目标设备和服务器之间的连接。
用户终端为用于进行直播显示的终端设备，通常为手机、平板和PC等设备。登录请求由用户终端发出，基于本实施例中采用WebRtc接口的特殊情况，登录 请求表示用户终端借助web程序登录服务器时发送的相关信息。
WebRTC(Web Real-Time Communications)是一项实时通讯技术，它允许网络应用或者站点，在不借助中间媒介的情况下，建立浏览器之间点对点(Peer-to-Peer)的连接，实现视频流和(或)音频流或者其他任意数据的传输。WebRTC功能的使用都通过接口进行，此处所指的WebRTC接口表示WebRTC提供的接口中用于建立数据传输通道的接口，主要包括RTCPeerConnection接口和RTCDataChannel接口。第一连接实际代表的是服务器与目标设备间的通信关系，表示二者间建立有数据传输通道，相对应的的，第二连接代表的是服务器与用户终端间的通信关系。
房间是WebRTC服务器内置的概念，WebRTC服务器借助房间实现特定的多对象间数据交互，具体到本实施例中，目标WebRtc房间是WebRTC服务器提供的一个房间，用于多个目标设备和用户终端间进行无人机视频数据传输，其数据传输仅限于目标WebRtc房间内。可以理解的是，WebRTC服务器能够提供一个或多个WebRtc房间，以满足多团队协作的实时任务。
在一些具体实施例中，连接请求中包括房间号和房间密码，如图2所示，步骤S110中根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接的过程包括步骤S111-112：
S111、接收所述多个目标设备的连接请求，验证所述连接请求中的房间号和房间密码是否对应所述目标WebRtc房间。
S112、若是，则与对应的目标设备建立基于WebRtc接口的第一连接。
目标设备在需要进行推流直播时，通过安装在目标设备的软件借助私有协议获取服务器端的房间号和房间密码，向服务器发送包括房间号和房间密码的 连接请求，服务器验证其房间号和房间密码是否合法，且房间密码和房间号对应同一个WebRtc房间，若合法且房间号和房间密码能够对应上，则将目标设备通过WebRtc接口加入到对应的WebRtc房间(建立第一连接)。
可以理解的是，用户终端在登录服务器时，其原理与步骤S111-112类似，在验证用户的登录请求与目标WebRtc房间一致时，将用户终端通过WebRtc接口加入到对应的WebRtc房间(建立第二连接)。
可以理解的是，WebRtc房间是预先建立在WebRtc服务器中的，因此在一些实施例中，步骤S110之前应当还包括建立WebRtc房间的步骤S100(图未示)：
S100、建立一个或多个WebRtc房间并配置与WebRtc房间对应的房间号和房间密码。
WebRtc房间由WebRtc服务器
具体的，无人机能够独立或借助外部设备(例如遥控器地面站)通过WebRtc提供的接口加入目标WebRtc房间，同理用户终端能够通过WebRtc提供的接口加入目标WebRtc房间。
S120、基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据。
多路无人机视频数据为多个无人机采集的视频数据，其通过WebRtc提供的推流接口(也即WebRtc接口)实时推送到WebRtc服务器。
具体的，本实施例中多个目标设备在加入目标WebRtc房间后，多个目标设备实时将各自对应的无人机采集的无人机视频数据通过WebRtc接口向WebRtc服务器传输，WebRtc服务器实时接收多路无人机视频数据。
S130、基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终 端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
前文已经提及，本实施例中目标WebRtc房间用于实现房间内多个目标设备和用户终端间的无人机视频数据传输：服务器在接收到目标房间内多个目标设备发送的多路无人机视频数据后，通过WebRtc接口实时将多路无人机视频数据发送到目标房间内的用户终端，用户终端在接收到多路无人机视频数据后将其通过显示单元如显示屏进行同步显示，即可实现实时多路直播。
为了便于理解，以一个具体示例说明本实施例的方案：WebRTC服务器能够提供多个WebRtc房间，例如房间1和房间2，房间1连接了目标设备A、目标设备B和用户终端Ⅰ，房间2连接了目标设备C、目标设备D和用户终端Ⅱ，则目标设备A和目标设备B实时返回到WebRTC服务器的两路无人机视频数据最终由用户终端Ⅰ接收并显示，目标设备C和目标设备D实时返回到WebRTC服务器的两路无人机视频数据最终由用户终端Ⅱ接收并显示。在实际应用时，目标设备A、目标设备B和用户终端Ⅰ能够代表第一团队执行相应任务时使用的设备，目标设备C、目标设备D和用户终端Ⅱ能够代表第二团队执行相应任务时使用的设备，即借助本方法实现了多团队、多无人机的多路直播，使得无人机系统的功能更丰富，应用范围更广。
本实施例提供的基于无人机的多路视频直播方法，首先根据多个目标设备的连接请求和用户终端的登录请求将多个目标设备和用户终端加入到对应的目标WebRtc房间，借助目标WebRtc房间实现多个目标设备的多路无人机视频数据实时传输至用户终端，以实现一对多的直播画面传输方案，基于该方法能够支持在同一服务器同时观看多路实时视频，且能够根据WebRtc房间实现并行的多房间实时直播，增加了无人机系统的功能，应用范围更广。
实施例二
实施例二提供了一种基于无人机的多路视频直播方法，其可以在实施例一的基础上实现，对实施例一中的部分内容进行了具体的补充或举例，例如提供了根据用户终端的指令查看单路直播画面的过程，具体包括：
如图3所示，本实施例提供的基于无人机的多路视频直播方法包括：
S210、根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间。
S220、基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据。
S230、基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
S240、根据所述用户终端发送的单路视频查看指令生成第一分辨率调整指令，所述单路视频查看指令用于指定查看第一目标设备的直播画面。
单路视频查看指令用于确定用户需要单独观看某一路视频的直播画面，其根据用户基于用户终端对多路直播画面的选择操作生成。步骤S230中已经将多路无人机视频数据通过用户终端进行显示，而在实际应用中，由于目前服务器的带宽有限，而多路视频的数据量较大，具体到每一路视频必然不能提供足够清晰的直播画面，而用户随时可能有查看高清直播画面的需求，因此本实施例中进一步提供了根据用户需求进行单路直播的方法。
具体的，用户终端能够获取用户的操作并根据用户的操作生成相应的指令， 例如用户能够选择多路直播画面中某一路视频的直播画面进行查看，用户终端根据该选择操作生成与该路视频对应的单路视频查看指令，并将单路视频查看指令发送到服务器，服务器接收到单路视频查看指令后，对其进行解析，以确定单路视频查看指令所对应的目标设备，也即第一目标设备，进而确定用户需要单独观看第一目标设备的直播画面，生成相应的第一分辨率调整指令，第一分辨率调整指令用于指示第一目标设备传输清晰度更高的视频数据。
S250、将所述第一分辨率调整指令发送至所述第一目标设备，以使所述第一目标设备根据所述第一调整指令增加对应的无人机视频数据的图像分辨率。
服务器将第一分辨率调整指令发送到第一目标设备，第一目标设备根据第一分辨率调整指令对传输的无人机视频数据进行调整，具体而言，能够通过提高视频传输码率以及提高编解码时对分辨率参数的提高实现提高最终的直播画面清晰度。
可以理解的是，在增加了某一路无人机视频数据的图像分辨率之后，而服务器的整体带宽未变化，单路视频的直播画面清晰度提高必然带来该路传输的数据量变大，若总体数据量(多路直播视频总的数据量)太大必然导致直播延迟增加，因此在一些实施例中此时会降低其他路视频的直播画面的图像分辨率，而在一些实施例中，进一步考虑了当前直播的链路数量，以确定是否有必要对其他路视频的直播画面进行分辨率，具体的，如图4所示，在步骤S240之后，还包括步骤S260-270：
S260、检测目标设备的连接数量，判断所述连接数量是否大于等于第一阈值。
S270、若是，则生成第二分辨率调整指令，并向所述多个目标设备中除所 述第一目标设备外的其他目标设备发送所述第二分辨率调整指令，以使所述其他目标设备根据所述第二分辨率调整指令降低对应的无人机视频数据的图像分辨率。
第一阈值是一个预先设置好的数值，用于在用户查看单路视频的直播图像时，判断服务器当前是否需要降低其他路视频的直播图像分辨率。第二分辨率调整指令与第一分辨率调整指令作用相反，用于降低对应视频的直播画面清晰度，以在用户查看单路视频的直播画面时，通过降低其他路视频直播画面的清晰度保证用户查看的单路视频以低延迟直播。以一个具体示例进行说明本方案：例如当前服务器带宽最大支持32路视频直播(每一路视频的直播画面都是默认清晰度)，用户在查看单路视频时，假设单路视频清晰度提高后增大的数据量相当于8路默认清晰度的视频直播数据量，则可以设置第一阈值为24，用户在查看第一目标设备的单路视频时，若当前有16路视频在直播(连接了16个目标设备)，则无需对其他路视频进行调整，若当前有26路视频在直播，则需要对除了第一目标设备外的其他25个目标设备发送第二分辨率调整指令，以使其他25个目标设备根据第二分辨率调整指令降低对应的无人机视频数据的图像分辨率，从而降低多路视频整体的数据量。
更具体的，在一些实施例中，用户在借助用户终端查看直播画面时，存在对特殊地点进行查看需求，例如单路视频的直播画面依然不够清晰，因此进一步提供了通过选取直播画面中目标位置进行查看的过程，具体如图5所示，在本实施例提供的基于无人机的多路视频直播方法在步骤S250之后，还包括步骤S280-290：
S280、根据所述用户终端发送的目标位置查看指令生成区域调整指令。
S290、将所述区域调整指令发送至所述第一目标设备，以使所述第一目标设备根据所述区域调整指令对对应的无人机视频数据的目标位置进行高清编码。
目标位置查看指令用于确定用户需要查看直播画面上的目标位置，其根据用户对直播画面上的目标位置选取操作生成，包括目标位置在直播画面中的坐标、大小等信息(例如在直播画面上的横坐标x,纵坐标y,宽度width和高度height)。区域调整指令用于指示对应的目标设备(即第一目标设备)对与目标位置对应的真实区域进行高清图像采集。本实施例主要用于解决用户在查看单路视频的直播画面时还是存在清晰度不够的情况(例如飞得过高、变焦倍数过大等原因)，此时目标位置查看指令是基于单路视频的直播画面生成的，用户终端发出目标位置查看指令后，第一目标设备在返回无人机视频数据时对目标位置进行提高清晰度的高清编码，以使用户终端显示目标位置清晰度更高的直播画面。
更具体的，在一些实施例中，考虑到服务器的带宽有限，在不断有目标设备通过WebRtc接口连接至服务器进行直播退流时，实时监控连接的目标设备数量进而调整每一路视频的直播画面清晰度，以避免影响直播的实时性，具体的，如图6所示，本实施例提供的基于无人机的多路视频直播方法包括：
S310、根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间。
S320、基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据。
S330、基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
S340、检测目标设备的连接数量，判断所述连接数量是否大于等于第二阈值。
第二阈值与第一阈值类似，是一个预先设置好的数值，用于在目标设备连接至服务器时，判断服务器当前是否需要降低所有链路视频直播画面的清晰度。当目标设备的连接数量大于等于第二阈值时，表示服务器的数据传输压力大需要通过降低直播画面的清晰度保证直播的低延迟。
S350、若是，则向所述多个目标设备发送第三分辨率调整指令，以使所述多个目标设备降低所述多路无人机视频数据的图像分辨率和/或传输码率。
在确定目标设备的连接数量大于等于第二阈值后，服务器生成用于降低直播画面清晰度(能够减少传输的数据量)缓解数据传输压力的第三分辨率调整指令，并将第三分辨率调整指令发送至与服务器连接的每一个目标设备，目标设备接收到第三分辨率调整指令后，通过降低无人机视频数据的图像分辨率和/或传输码率的方式降低传输的数据量。
本实施例进一步提供了用户需要查看单路视频时的直播调整过程、用户需要查看目标区域时的直播调整过程以及连接的目标设备过多时的直播调整过程，能够在保证直播延迟低的情况下，满足用户的不同需求，丰富了无人机系统的直播功能，能够满足更多作业需求。
实施例三
图7为本发明实施例三提供的一种基于无人机的多路视频直播系统400的结构示意图，如图7所述，该系统400包括：
连接建立模块410，用于根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间；
视频数据获取模块420，用于基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据；
视频数据发送模块430，用于基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
可选的，在一些实施例中，连接建立模块410具体用于：
接收所述多个目标设备的连接请求，验证所述连接请求中的房间号和房间密码是否对应所述目标WebRtc房间；
若是，则与对应的目标设备建立基于WebRtc接口的第一连接。
可选的，在一些实施例中，该系统400还包括：
房间建立模块，用于建立一个或多个WebRtc房间并配置与WebRtc房间对应的房间号和房间密码。
可选的，在一些实施例中，还包括第一分辨率调整模块，用于：基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端之后，根据所述用户终端发送的单路视频查看指令生成第一分辨率调整指令，所述单路视频查看指令用于指定查看第一目标设备的直播画面；
将所述第一分辨率调整指令发送至所述第一目标设备，以使所述第一目标 设备根据所述第一调整指令增加对应的无人机视频数据的图像分辨率。
可选的，在一些实施例中，还包括第二分辨率调整模块，用于：
所述根据所述用户终端发送的单路视频查看指令生成第一分辨率调整指令之后，检测目标设备的连接数量，判断所述连接数量是否大于等于第一阈值；
若是，则生成第二分辨率调整指令，并向所述多个目标设备中除所述第一目标设备外的其他目标设备发送所述第二分辨率调整指令，以使所述其他目标设备根据所述第二分辨率调整指令降低对应的无人机视频数据的图像分辨率。
可选的，在一些实施例中，还包括局部编码模块，用于：
所述将所述第一分辨率调整指令发送至所述第一目标设备之后，根据所述用户终端发送的目标位置查看指令生成区域调整指令；
将所述区域调整指令发送至所述第一目标设备，以使所述第一目标设备根据所述区域调整指令对对应的无人机视频数据的目标位置进行高清编码。
可选的，在一些实施例中，还包括第三分辨率调整模块，用于：
所述基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端之后，检测目标设备的连接数量，判断所述连接数量是否大于等于第二阈值；
若是，则向所述多个目标设备发送第三分辨率调整指令，以使所述多个目标设备降低所述多路无人机视频数据的图像分辨率和/或传输码率。
本实施例提供了一种基于无人机的多路视频直播系统，根据多个目标设备的连接请求和用户终端的登录请求将多个目标设备和用户终端加入到对应的目标WebRtc房间，借助目标WebRtc房间实现多个目标设备的多路无人机视频数据实时传输至用户终端，以实现一对多的直播画面传输方案，基于该方法能够支持在同一服务器同时观看多路实时视频，且能够根据WebRtc房间实现并行的 多房间实时直播，增加了无人机系统的功能，应用范围更广。
实施例四
图8为本发明实施例四提供的一种可以实现基于无人机的多路视频直播方法的计算机设备500的结构示意图，如图8所示，该设备包括存储器510、处理器520，设备中处理器520的数量可以是一个或多个，图8中以一个处理器520为例；设备中的存储器510、处理器520可以通过总线或其他方式连接，图8中以通过总线连接为例。
存储器510作为一种计算机可读存储介质，可用于存储软件程序、计算机可执行程序以及模块，如本发明实施例中的基于无人机的多路视频直播方法对应的程序指令/模块(例如，基于无人机的多路视频直播系统中的连接建立模块410、视频数据获取模块420、视频数据发送模块430)。处理器520通过运行存储在存储器510中的软件程序、指令以及模块，从而执行基于二维码的页面引导第二页面引导模块的各种功能应用以及数据处理，即实现上述的基于无人机的多路视频直播方法。
其中，所述处理器520用于运行存储在存储器510中的计算机可执行程序，以实现如下步骤：步骤S110、根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间；步骤S120、基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据；步骤S130、基于WebRtc接口实时将所述多路无人机视频数据 发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
当然,本发明实施例所提供的一种基于无人机的多路视频直播系统,该系统不限于如上所述的方法操作,还可以执行本发明实施例任意实施例所提供的基于无人机的多路视频直播方法中的相关操作。
存储器510可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序；存储数据区可存储根据终端的使用所创建的数据等。此外，存储器510可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中，存储器510可进一步包括相对于处理器520远程设置的存储器，这些远程存储器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
实施例五
本发明实施例五还提供一种包括计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行一种基于无人机的多路视频直播方法，该基于无人机的多路视频直播方法包括：
根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间；
基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据；
基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
当然，本发明实施例所提供的一种包括计算机可执行指令的存储介质,其计算机可执行指令不限于如上所述的方法操作，还可以执行本发明任意实施例所提供的基于无人机的多路视频直播方法中的相关操作。
通过以上关于实施方式的描述，所述领域的技术人员可以清楚地了解到，本发明可借助软件及必需的通用硬件来实现，当然也可以通过硬件实现，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，设备，或者网络设备等)执行本发明各个实施例所述的方法。
值得注意的是，上述授权系统的实施例中，所包括的各个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限制本发明的保护范围。
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例， 而本发明的范围由所附的权利要求范围决定。

Claims (10)

  1. 一种基于无人机的多路视频直播方法，其特征在于，包括：
    根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间；
    基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据；
    基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
  2. 根据权利要求1所述的基于无人机的多路视频直播方法，其特征在于，所述根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，包括：
    接收所述多个目标设备的连接请求，验证所述连接请求中的房间号和房间密码是否对应所述目标WebRtc房间；
    若是，则与对应的目标设备建立基于WebRtc接口的第一连接。
  3. 根据权利要求2所述的基于无人机的多路视频直播方法，其特征在于，接收所述多个目标设备的连接请求之前，还包括：
    建立一个或多个WebRtc房间并配置与WebRtc房间对应的房间号和房间密码。
  4. 根据权利要求1所述的基于无人机的多路视频直播方法，其特征在于，基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端之后，还包括：
    根据所述用户终端发送的单路视频查看指令生成第一分辨率调整指令，所 述单路视频查看指令用于指定查看第一目标设备的直播画面；
    将所述第一分辨率调整指令发送至所述第一目标设备，以使所述第一目标设备根据所述第一分辨率调整指令增加对应的无人机视频数据的图像分辨率。
  5. 根据权利要求4所述的基于无人机的多路视频直播方法，其特征在于，所述根据所述用户终端发送的单路视频查看指令生成第一分辨率调整指令之后，还包括：
    检测目标设备的连接数量，判断所述连接数量是否大于等于第一阈值；
    若是，则生成第二分辨率调整指令，并向所述多个目标设备中除所述第一目标设备外的其他目标设备发送所述第二分辨率调整指令，以使所述其他目标设备根据所述第二分辨率调整指令降低对应的无人机视频数据的图像分辨率。
  6. 根据权利要求4所述的基于无人机的多路视频直播方法，其特征在于，所述将所述第一分辨率调整指令发送至所述第一目标设备之后，还包括：
    根据所述用户终端发送的目标位置查看指令生成区域调整指令；
    将所述区域调整指令发送至所述第一目标设备，以使所述第一目标设备根据所述区域调整指令对对应的无人机视频数据的目标位置进行高清编码。
  7. 根据权利要求1所述的基于无人机的多路视频直播方法，其特征在于，所述基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端之后，还包括：
    检测目标设备的连接数量，判断所述连接数量是否大于等于第二阈值；
    若是，则向所述多个目标设备发送第三分辨率调整指令，以使所述多个目标设备降低所述多路无人机视频数据的图像分辨率和/或传输码率。
  8. 一种基于无人机的多路视频直播系统，其特征在于，包括：
    连接建立模块，用于根据多个目标设备的连接请求与所述多个目标设备建立基于WebRtc接口的第一连接，根据用户终端的登录请求与所述用户终端建立基于WebRtc接口的第二连接，所述第一连接用于将所述多个目标设备连接至目标WebRtc房间，所述第二连接用于将所述用户终端连接至所述目标WebRtc房间；
    视频数据获取模块，用于基于WebRtc接口实时获取所述多个目标设备发送的多路无人机视频数据；
    视频数据发送模块，用于基于WebRtc接口实时将所述多路无人机视频数据发送至所述用户终端，以使所述用户终端根据所述多路无人机视频数据显示多路直播画面。
  9. 一种计算机设备，其特征在于，包括存储器和处理器，所述存储器上存储有可在处理器运行的计算机程序，所述处理器执行所述计算机程序时实现如权利要求1-7任意一项所述的基于无人机的多路视频直播方法。
  10. 一种计算机可读存储介质，其特征在于，所述存储介质存储有计算机程序，所述计算机程序包括程序指令，所述程序指令当被执行时，实现如权利要求1-7任意一项所述的基于无人机的多路视频直播方法。
PCT/CN2022/119124 2021-09-15 2022-09-15 基于无人机的多路视频直播方法、系统、设备及存储介质 WO2023040984A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111081189.8A CN113766267B (zh) 2021-09-15 2021-09-15 基于无人机的多路视频直播方法、系统、设备及存储介质
CN202111081189.8 2021-09-15

Publications (1)

Publication Number Publication Date
WO2023040984A1 true WO2023040984A1 (zh) 2023-03-23

Family

ID=78795724

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/119124 WO2023040984A1 (zh) 2021-09-15 2022-09-15 基于无人机的多路视频直播方法、系统、设备及存储介质

Country Status (2)

Country Link
CN (1) CN113766267B (zh)
WO (1) WO2023040984A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113766267B (zh) * 2021-09-15 2023-10-24 深圳市道通智能航空技术股份有限公司 基于无人机的多路视频直播方法、系统、设备及存储介质

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744231A (zh) * 2016-03-18 2016-07-06 普宙飞行器科技（深圳）有限公司 无人机移动直播方法及无人机移动直播系统
US20170316639A1 (en) * 2016-04-27 2017-11-02 Bally Gaming, Inc. System, method and apparatus for virtual reality gaming with selectable viewpoints and context-sensitive wager interfaces
CN107465935A (zh) * 2016-06-06 2017-12-12 中兴通讯股份有限公司 一种视频直播方法、用户设备及无人机遥控器
CN108933833A (zh) * 2018-07-17 2018-12-04 同济大学 一种基于WebRTC的无人机操控系统及连接建立方法
CN109951718A (zh) * 2019-04-11 2019-06-28 李蕴梅 一种通过5g和vr技术可360度全景实时拍摄直播的方法
US10666941B1 (en) * 2016-04-06 2020-05-26 Ambarella International Lp Low bitrate encoding of panoramic video to support live streaming over a wireless peer-to-peer connection
CN111225228A (zh) * 2020-01-15 2020-06-02 北京拙河科技有限公司 一种视频直播方法、装置、设备和介质
CN111565194A (zh) * 2020-05-18 2020-08-21 刘安东 基于WebRTC远程控制无人车的控制方法
CN111866410A (zh) * 2020-08-04 2020-10-30 中航华东光电有限公司 可接收多路光纤sdi信号的显示器处理系统
CN111954010A (zh) * 2020-08-04 2020-11-17 山东金东数字创意股份有限公司 基于window平台在5G环境下的全景实时转播系统和方法
CN112437076A (zh) * 2020-11-18 2021-03-02 广州供电局有限公司 一种电网视频直播平台以及电网视频直播方法
CN113766267A (zh) * 2021-09-15 2021-12-07 深圳市道通智能航空技术股份有限公司 基于无人机的多路视频直播方法、系统、设备及存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017114834A1 (en) * 2015-12-29 2017-07-06 Koninklijke Philips N.V. System, controller and method using virtual reality device for robotic surgery
JP6448573B2 (ja) * 2016-03-11 2019-01-09 株式会社東芝 データロガー及びログシステム
CN107018386A (zh) * 2017-06-08 2017-08-04 柳州智视科技有限公司 一种视频流多分辨率观测系统
WO2019084959A1 (zh) * 2017-11-06 2019-05-09 深圳市大疆创新科技有限公司 无人机的移动终端和云端平台的交互方法及装置
US10695911B2 (en) * 2018-01-12 2020-06-30 Futurewei Technologies, Inc. Robot navigation and object tracking
US10890921B2 (en) * 2018-05-31 2021-01-12 Carla R. Gillett Robot and drone array
CN115580709A (zh) * 2018-10-26 2023-01-06 深圳市道通智能航空技术股份有限公司 航拍相机的图像处理方法、图像处理系统及无人机
CN110582006A (zh) * 2019-09-10 2019-12-17 南京清豆华创科技有限公司 适用于多人互动的直播方法及装置、设备、存储介质
CN113037616B (zh) * 2021-03-31 2022-11-04 中国工商银行股份有限公司 用于协同控制多台机器人的交互方法和装置
CN113099204B (zh) * 2021-04-13 2022-12-13 北京航空航天大学青岛研究院 一种基于vr头戴显示设备的远程实景增强现实方法

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744231A (zh) * 2016-03-18 2016-07-06 普宙飞行器科技（深圳）有限公司 无人机移动直播方法及无人机移动直播系统
US10666941B1 (en) * 2016-04-06 2020-05-26 Ambarella International Lp Low bitrate encoding of panoramic video to support live streaming over a wireless peer-to-peer connection
US20170316639A1 (en) * 2016-04-27 2017-11-02 Bally Gaming, Inc. System, method and apparatus for virtual reality gaming with selectable viewpoints and context-sensitive wager interfaces
CN107465935A (zh) * 2016-06-06 2017-12-12 中兴通讯股份有限公司 一种视频直播方法、用户设备及无人机遥控器
CN108933833A (zh) * 2018-07-17 2018-12-04 同济大学 一种基于WebRTC的无人机操控系统及连接建立方法
CN109951718A (zh) * 2019-04-11 2019-06-28 李蕴梅 一种通过5g和vr技术可360度全景实时拍摄直播的方法
CN111225228A (zh) * 2020-01-15 2020-06-02 北京拙河科技有限公司 一种视频直播方法、装置、设备和介质
CN111565194A (zh) * 2020-05-18 2020-08-21 刘安东 基于WebRTC远程控制无人车的控制方法
CN111866410A (zh) * 2020-08-04 2020-10-30 中航华东光电有限公司 可接收多路光纤sdi信号的显示器处理系统
CN111954010A (zh) * 2020-08-04 2020-11-17 山东金东数字创意股份有限公司 基于window平台在5G环境下的全景实时转播系统和方法
CN112437076A (zh) * 2020-11-18 2021-03-02 广州供电局有限公司 一种电网视频直播平台以及电网视频直播方法
CN113766267A (zh) * 2021-09-15 2021-12-07 深圳市道通智能航空技术股份有限公司 基于无人机的多路视频直播方法、系统、设备及存储介质

Also Published As

Publication number Publication date
CN113766267A (zh) 2021-12-07
CN113766267B (zh) 2023-10-24

Similar Documents

Publication Publication Date Title
US20210105419A1 (en) Intelligent display with smart video streams
WO2018095174A1 (zh) 直播间视频流合成控制方法、装置及终端设备
US10277865B2 (en) Data transmission method and system, and related devices
CN109640029B (zh) 一种视频流上墙展示的方法和装置
US9118729B2 (en) Method for sharing resource of a videoconference using a video conferencing system
US10560725B2 (en) Aggregated region-based reduced bandwidth video streaming
EP3926917A1 (en) Data transmission method, device and computer storage medium
CN103634683A (zh) 对智能电视进行截屏的方法及装置
WO2018177169A1 (zh) 直播互动系统、方法、装置及计算机可读存储介质
WO2023040984A1 (zh) 基于无人机的多路视频直播方法、系统、设备及存储介质
US20240155182A1 (en) Method and apparatus for preview decoding for joint video production
US20200329083A1 (en) Video conference transmission method and apparatus, and mcu
US10666351B2 (en) Methods and systems for live video broadcasting from a remote location based on an overlay of audio
US10764535B1 (en) Facial tracking during video calls using remote control input
CN105007500A (zh) 一种视频传输方法及装置
KR20140004448A (ko) 영상 제공 방법 및 장치
CN116248644A (zh) 一种基于WebRTC推流技术的优化方法
KR102168948B1 (ko) 모바일 영상 관제 시스템 및 그 동작 방법
US10863233B2 (en) Wireliss docking system for audio-video
US9912985B2 (en) Content distribution
US11949565B2 (en) System, apparatus, and associated methodology for restricting communication bandwidths for communications through a relay device
CN118259820A (zh) 一种启用白板绘制的方法及相关装置
CN114979692A (zh) 音视频拉流模式的切换方法、装置、系统和存储介质
CN117812524A (zh) 显示设备、播放设备和数据传输方法
CN116193191A (zh) 多路投屏方法、多路投屏装置及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22869352

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE