WO2022104638A1 - 图传数据的处理方法、图传设备、终端设备及存储介质 - Google Patents

图传数据的处理方法、图传设备、终端设备及存储介质 Download PDF

Info

Publication number
WO2022104638A1
WO2022104638A1 PCT/CN2020/130078 CN2020130078W WO2022104638A1 WO 2022104638 A1 WO2022104638 A1 WO 2022104638A1 CN 2020130078 W CN2020130078 W CN 2020130078W WO 2022104638 A1 WO2022104638 A1 WO 2022104638A1
Authority
WO
WIPO (PCT)
Prior art keywords
image transmission
transmission data
data
terminal device
transmission device
Prior art date
Application number
PCT/CN2020/130078
Other languages
English (en)
French (fr)
Inventor
王建民
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2020/130078 priority Critical patent/WO2022104638A1/zh
Publication of WO2022104638A1 publication Critical patent/WO2022104638A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working

Definitions

  • the present application relates to the field of electronic technologies, and in particular, to a method for processing image transmission data, an image transmission device, a terminal device, and a storage medium.
  • Aerial photography through mobile platforms can break through space constraints and show different perspectives. These mobile platforms can be drones, unmanned vehicles, etc. Wait.
  • the movable platform often transmits the images captured by the movable platform to the ground image transmission equipment in real time and stably through the image transmission module. Users can view the captured images through the LCD (Liquid Crystal Display) screen of the image transmission equipment; image transmission equipment It is also possible to connect an external terminal device to transmit the shooting image to the terminal device. The user can view the shooting image through the terminal device, and can also edit and store the shooting image through the terminal device. Therefore, how to improve the transmission efficiency and transmission stability between the image transmission device and the terminal device has become a hot issue in current research.
  • Embodiments of the present application provide a method for processing image transmission data, an image transmission device, a terminal device, and a storage medium, which can effectively improve the transmission efficiency and transmission stability of image transmission data.
  • an embodiment of the present application provides a method for processing image transmission data.
  • the method for processing image transmission data is applied to an image transmission device, and the image transmission device is communicatively connected to a terminal device.
  • the image transmission data processing method includes:
  • image transmission data which is the video data acquired by the mobile platform and transmitted to the image transmission device
  • the image transmission data is processed to obtain the target image transmission data; wherein, the processed target image transmission data conforms to the video playback standard protocol;
  • an embodiment of the present application provides a method for processing image transmission data.
  • the method for processing image transmission data is applied to a terminal device, and the terminal device is communicatively connected to the image transmission device.
  • the processing method for image transmission data includes:
  • the target image transmission data is obtained after the image transmission device processes the image transmission data sent by the movable platform, and the target image transmission data conforms to the video playback standard protocol;
  • an embodiment of the present application provides an image transmission device, where the image transmission device is communicatively connected to a terminal device, the image transmission device includes a processor and a memory, and the memory and the processor are connected to each other, wherein:
  • a memory for storing a computer program, the computer program including program instructions
  • the processor when calling program instructions, is used to execute:
  • image transmission data which is the video data acquired by the mobile platform and transmitted to the image transmission device
  • the image transmission data is processed to obtain the target image transmission data; wherein, the processed target image transmission data conforms to the video playback standard protocol;
  • the embodiment of the present application provides a kind of terminal equipment, the terminal equipment is connected with the image transmission equipment for communication, and the terminal equipment includes a processor and a memory, and the memory and the processor are connected to each other, wherein:
  • a memory for storing a computer program, the computer program including program instructions
  • the processor when calling program instructions, is used to execute:
  • the target image transmission data is obtained after the image transmission device processes the image transmission data sent by the movable platform, and the target image transmission data conforms to the video playback standard protocol;
  • an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the image transmission data processing method described in the first aspect above is implemented .
  • an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the image transmission data processing method described in the second aspect above is implemented .
  • the image transmission device is connected in communication with the terminal device, and after the image transmission device obtains the image transmission data from the movable platform, it processes the image transmission data to obtain the target image transmission data, and the processed target image transmission data In line with the video transmission standard protocol, the image transmission device transmits the target image transmission data to the terminal device.
  • the embodiment of the present application can effectively improve the transmission efficiency and transmission stability of the image transmission data by establishing a communication connection between the image transmission device and the terminal device, and processing the image transmission data to obtain the target image transmission data conforming to the video transmission standard protocol. .
  • FIG. 1 is a schematic diagram of the architecture of a processing system for image transmission data provided by an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a method for processing image transmission data provided by an embodiment of the present application
  • FIG. 3 is a schematic diagram of a user interface of an image transmission device provided by an embodiment of the present application.
  • FIG. 4 is a schematic flowchart of another image transmission data processing method provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a user interface of a terminal device provided by an embodiment of the present application.
  • FIG. 6 is a schematic flowchart of another method for processing image transmission data provided by an embodiment of the present application.
  • FIG. 7 is a schematic flowchart of another method for processing image transmission data provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of an apparatus for processing image transmission data provided by an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of another image transmission data processing apparatus provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of an image transmission device provided by an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of a terminal device provided by an embodiment of the present application.
  • Movable platforms can refer to drones, unmanned cars, unmanned vehicles, unmanned ships, robots, and so on.
  • Image transmission equipment may refer to a remote controller used to control a movable platform, a ground station used for data interaction with the movable platform, an image transmission box used to transmit image transmission data, etc.; image transmission equipment usually has strong
  • the processor unit can play, store, edit and so on the image transmission data captured by the movable platform.
  • the image transmission data may refer to the video data captured by the movable platform, for example, the image transmission data is the aerial video data captured by the drone.
  • the embodiment of the present application provides a processing solution for the image transmission data.
  • the processing scheme includes four types of transmission through UVC (USB Video Class, Universal Serial Bus video class) device transmission, APP (Application, application) streaming, dedicated software transmission, HDMI (High Definition Multimedia Interface, high-definition multimedia interface) custom streaming
  • UVC USB Video Class, Universal Serial Bus video class
  • APP Application, application
  • dedicated software transmission dedicated software transmission
  • HDMI High Definition Multimedia Interface, high-definition multimedia interface
  • the terminal devices may include but are not limited to smart phones, tablet computers, notebook computers, desktop computers, and other devices that can be used to play, store, and edit image transmission data in real time.
  • the following will introduce the four methods of UVC device transmission, APP push streaming, dedicated software transmission, and HDMI custom streaming:
  • the UVC device may refer to an image transmission device that conforms to the video playback standard protocol.
  • a communication connection is established between the image transmission device and the terminal device through the USB (Universal Serial Bus, Universal Serial Bus) data line.
  • the image transmission device receives the image transmission from the mobile platform.
  • the data is processed, and the processed target image transmission data conforms to the video playback standard protocol.
  • the image transmission device transmits the processed target image transmission data to the terminal device through the USB data line, so that the terminal device can parse and play the target image transmission data.
  • the process of transmitting the target image transmission data from the image transmission device to the terminal device depends on the USB data cable and does not depend on the network signal, which can effectively improve the transmission efficiency and transmission stability of the image transmission data.
  • Push streaming based on the built-in APP of the image transmission device This method is mainly used in the field of live broadcast, combining the image transmission data captured by the mobile platform with the live broadcast, which can bring better viewing and experience to the live broadcast field.
  • This method is based on the live streaming function of the built-in APP of the image transmission device. Users can select a third-party live streaming platform through the built-in APP of the image transmission device, and fill in the network streaming address of the third-party live streaming platform in the APP.
  • the software of the corresponding third-party live broadcast platform needs to be installed in the terminal device, and the image transmission data can be played in real time through the software of the third-party live broadcast platform.
  • the uplink rate during live broadcast needs to be greater than 1M/s (megabytes per second).
  • the special software built in the terminal device can be developed based on the SDK (Software Development Kit, software development kit) of the mobile platform manufacturer.
  • the terminal device and the image transmission device establish a communication connection through a USB data cable, and the image transmission device uses the USB data to establish a communication connection.
  • the image transmission data is transmitted to the special software of the terminal device through the line, and the image transmission data is played in real time through the special software of the terminal device. In this way, it is necessary to develop special software for the terminal device based on the SDK of the mobile platform manufacturer.
  • Customized push stream based on third-party HDMI interface encoder This method can also be applied to the field of live broadcast.
  • This method is based on a third-party HDMI interface encoder to customize the push stream. It is necessary to use an HDMI video cable to connect the HDMI port on the image transmission device and the HDMI port on the third-party HDMI interface encoder.
  • the video transmission device needs to support HDMI video signal output. Users can select the third-party live broadcast platform in the APP of the third-party HDMI interface encoder, and fill in the network push stream address in the APP of the third-party HDMI interface encoder.
  • the software of the corresponding third-party live broadcast platform needs to be installed in the terminal device, and the image transmission data can be played in real time through the software of the third-party live broadcast platform.
  • the image transmission device needs to add an HDMI standard interface to support HDMI video signal output, the image transmission device also needs to be configured with a third-party HDMI interface encoder, and network streaming requires stable network signal quality.
  • the above four methods can realize the image transmission device to transmit the image transmission data to the terminal device for real-time video output.
  • the image transmission device can use the USB data cable to send the target The image transmission data is transmitted to the terminal device; in the second method, under the condition of ensuring stable network signal quality, the image transmission device pushes the live streaming of the image transmission data to the terminal device based on the built-in APP; in the third method , through the development of special software, the image transmission device transmits the image transmission data to the special software of the terminal device; in the fourth method, under the condition of ensuring the stable network signal quality, the image transmission device uses the HDMI video cable and third-party HDMI The interface encoder pushes the image transmission data to the terminal device.
  • the image transmission device may include a user interface
  • the user interface of the image transmission device may include a transmission mode list
  • the transmission mode list may include the above four transmission mode options, namely UVC device transmission options, APP push streaming options, dedicated software transmission options, HDMI custom streaming options;
  • the image transmission device can respond to the user's selection of each transmission mode option, and transmit the image transmission data to the terminal device through the selected transmission mode; In this way, the user of the image transmission device can more clearly understand the data transmission function possessed by the image transmission device, and can select a corresponding data transmission mode.
  • the image transmission device when the image transmission device detects that the transmission method selected by the user cannot be implemented, it can output prompt information to the user; for example, the transmission method selected by the user is the HDMI custom streaming method, when the image transmission device detects that the HDMI video is not currently connected.
  • the video transmission device When the video transmission device is connected, the video transmission device outputs the prompt message "Please connect the HDMI video cable" to the user through the user interface; for another example, if the transmission mode selected by the user is the APP push streaming method, when the video transmission device detects that the network is not currently connected, the video transmission The device outputs a prompt message "The network connection is unavailable, please connect to the Internet" to the user through the user interface.
  • the prompt information the user of the image transmission device can be guided to select an appropriate image transmission data transmission mode.
  • the image transmission device can set priorities for the four transmission modes of image transmission data.
  • the image transmission device can transmit data according to each transmission mode.
  • the priority order of the mode determines the selected transmission mode. For example, if the priority of the UVC device transmission method is higher than the priority of the APP streaming method, the image transmission device can preferentially select the UVC device transmission method; when the UVC device transmission method cannot be implemented, for example, the image transmission device and the terminal If the USB data cable is not connected between the devices, or the image transmission device has not been set as a UVC device, the image transmission device can determine the selected transmission mode as the APP push streaming method according to the priority order. In this way, the choice of image transmission data transmission method is more intelligent.
  • the image transmission device may further determine a transmission mode suitable for the transmission conditions according to the transmission conditions satisfied by the image transmission device. For example, when the image transmission device detects that the network signal to which the image transmission device is connected is strong and the network quality is relatively stable, the image transmission device can determine that the transmission method is the APP push streaming method; when the image transmission device detects that the image transmission device A communication connection is established with the terminal device through a USB data line, and the image transmission device can determine that the transmission mode is the UVC device transmission mode. In this way, the choice of image transmission data transmission method is more intelligent.
  • FIG. 1 is a schematic structural diagram of a system for processing image transmission data provided by an embodiment of the present application.
  • the movable platform is an unmanned aerial vehicle as an example for description.
  • the image transmission data processing system may include an image transmission device 101 , a terminal device 102 , a movable platform 103 and a USB data line 104 .
  • a communication connection can be established between the image transmission device 101 and the terminal device 102 through the USB data line 104;
  • the movable platform 103 obtains the image transmission data, it can transmit the image transmission data to the image transmission device 101 through the image transmission module;
  • the image transmission device 101 can process the image transmission data, so that the processed image transmission data conforms to the video playback standard protocol;
  • the image transmission device 101 transmits the processed target image transmission data to the terminal device 102, and the terminal device 102 can parse and play, store, edit and so on the target image transmission data.
  • the video playback standard protocol may include a UVC protocol, which is a protocol standard defined for a USB video capture device.
  • Mainstream operating systems such as Windows XP SP2 operating system and subsequent version operating systems released later than Windows XP SP2 operating system, Linux 2.4.6 operating system and subsequent operating systems released later than Linux 2.4.6 operating system, MacOS 10.5 operating system and subsequent versions of operating systems released later than MacOS 10.5 operating system, etc.
  • Mainstream operating systems such as Windows XP SP2 operating system and subsequent version operating systems released later than Windows XP SP2 operating system, Linux 2.4.6 operating system and subsequent operating systems released later than Linux 2.4.6 operating system, MacOS 10.5 operating system and subsequent versions of operating systems released later than MacOS 10.5 operating system, etc.
  • have built-in UVC drivers terminal devices with UVC drivers installed can support UVC protocol, and can receive, parse and play UVC-compliant The target of the protocol to transmit data.
  • the terminal device 102 has a built-in UVC driver.
  • USB is a serial port bus standard and also a technical specification of an input interface and an output interface; in the embodiment of the present application, the USB data line 104 can be used to realize the connection and data transmission between the image transmission device 101 and the terminal device 102 .
  • the image transmission data processing system provided by the embodiments of the present application is to more clearly describe the technical solutions of the embodiments of the present application, and does not constitute a limitation on the technical solutions provided by the embodiments of the present application.
  • Personnel know that, with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
  • FIG. 2 is a schematic flowchart of a method for processing image transmission data provided by an embodiment of the present application.
  • the method for processing image transmission data provided by an embodiment of the present application may be executed by an image transmission device, and the image transmission device and the terminal A communication connection is established between the devices through a USB data cable, and the image transmission data processing method may include the following steps S201 to S203:
  • Step S201 acquiring image transmission data.
  • the image transmission data can refer to the video data captured by the movable platform.
  • the image transmission data is the aerial video data captured by the drone, and the image transmission data is sent to the mobile platform through the built-in image transmission module of the movable platform after shooting. image transmission equipment.
  • the image transmission data can be composed of n frames of image transmission code stream data.
  • n frames of image transmission code stream data transmitted by the mobile platform are received, m frames of image transmission code stream data can be stored in the code stream queue, where n is Positive integer, m is a positive integer less than or equal to n. That is to say, the image transmission device may store all or part of the received image transmission code stream data in the code stream queue.
  • Step S202 processing the image transmission data to obtain target image transmission data.
  • the image transmission device is a device that conforms to the video playback standard protocol (that is, the UVC protocol). Before processing the image transmission data, the connection mode of the image transmission device can be configured as UVC mode.
  • the target image transmission data that conforms to the video playback standard protocol can be transmitted between the terminal device and the image transmission device. There are two ways to configure the connection mode of the image transmission device to UVC mode:
  • the image transmission device may include a user interface, and the user using the image transmission device can operate the image transmission device through the user interface of the image transmission device; the user interface of the image transmission device displays a list of connection modes and a list of connection modes. Multiple connection mode options can be included in the multiple connection mode options, including the UVC mode option.
  • FIG. 3 is a schematic diagram of a user interface of an image transmission device provided by an embodiment of the present application.
  • the image transmission device includes a user interface 30
  • the user interface 30 of the image transmission device includes a connection mode list 301
  • the UVC mode Option 302 ie, USB video class mode option 302
  • the UVC mode Option 302 is any connection mode option in connection mode list 301 .
  • the image transmission device may configure the connection mode of the image transmission device to the UVC mode in response to the selection of the UVC mode option. As shown in FIG. 3 , after the user using the image transmission device clicks the UVC mode option 302 in the user interface 30 of the image transmission device, the image transmission device configures the connection mode of the image transmission device in response to the selection operation on the UVC mode option 302 for UVC mode.
  • the image transmission device when the image transmission device receives the image transmission data sent by the movable platform, it can automatically configure the connection mode of the image transmission device to UVC mode.
  • the descriptor used to indicate that the image transmission device is in UVC mode can be sent to The terminal device, so that the terminal device can automatically identify the image transmission device according to the descriptor, and load or install the corresponding UVC driver for the image transmission device according to the descriptor.
  • the target image transmission data that conforms to the video playback standard protocol can be transmitted between them.
  • the descriptor indicating that the image transmission device is in UVC mode may include, but is not limited to, at least one of the following: a configuration descriptor, a device descriptor, etc.; the device descriptor may include a PID (Product ID, product identification code) of the image transmission device , VID (Vender ID, vendor identification code) of the video transmission device, device version number of the video transmission device, etc.
  • the acquired image transmission data can be processed, and the processed target image transmission data conforms to the video playback standard protocol.
  • m frames of image transmission code stream data may be acquired from the code stream queue, and the m frames of image transmission code stream data may be decoded to obtain m frames of image transmission images.
  • the image transmission code stream data is obtained by encoding the image transmission image, and the image transmission image is the original video data that has not been encoded.
  • the image transmission image is the original video data in YUV (an original video data format) format
  • the image transmission code The stream data is the encoded image transmission screen
  • the image transmission code stream data is the encoded code stream data in the MJPEG (Motion Joint Photographic Experts Group, a video compression format) format.
  • the video data header corresponding to the video playback standard protocol (such as the UVC video data label) can be added to each frame of the m-frame image transmission image. header) to obtain m frames of target image transmission images, and encapsulate m frames of target image transmission images to obtain target image transmission data, and each frame of target image transmission images conforms to the standard protocol for video playback.
  • the step of processing image transmission data may be triggered by a transmission request (such as a UVC request) sent by the terminal device, that is, the step of acquiring m frames of image transmission code stream data from the code stream queue may be a transmission sent by the terminal device. triggered by the request.
  • a transmission request such as a UVC request
  • the terminal device When receiving a transmission request sent by the terminal device, it responds to the transmission request and triggers the processing of the image transmission data, that is, triggers the acquisition of m frames of image transmission code stream data from the code stream queue, and processes the m frames of image transmission code stream data. to be processed.
  • the image transmission data attributes may include The frame rate of the image transmission data or the resolution of the image transmission data, etc.
  • the frame rates supported by the image transmission device include 30FPS (Fra mes Per Second, the number of frames transmitted per second) and 60FPS.
  • an attribute setting request eg, a SET (setting) request
  • the target image transmission data attribute may include target frame rate or target resolution, and so on.
  • Step S203 transmitting the target image transmission data to the terminal device.
  • a communication connection is established between the image transmission device and the terminal device through a USB data cable, and the connection mode of the image transmission device can be set to UVC mode through a user interface trigger, and the image transmission device can also be set to UVC mode after receiving the image transmission from the movable platform. After data, the connection mode of the image transmission device is automatically set to UVC mode.
  • the UVC mode can be set in a variety of ways and is more intelligent; after the connection mode of the image transmission device is set to UVC mode, the target image transmission that conforms to the video playback standard protocol can be The data is transmitted to the terminal device, and the process of transferring the target image transmission data from the image transmission device to the terminal device depends on the USB data cable and does not depend on the network signal, which can effectively improve the transmission efficiency and transmission stability of the image transmission data.
  • FIG. 4 is a schematic flowchart of another image transmission data processing method provided by an embodiment of the present application.
  • the image transmission data processing method provided by the embodiment of the present application may be executed by a terminal device.
  • a communication connection is established between devices through a USB data cable, and the image transmission data processing method may include the following steps S401 to S402:
  • Step S401 receiving the target image transmission data sent by the image transmission device.
  • the terminal device has a built-in UVC driver, which can receive the target image transmission data sent by the image transmission device through the UVC driver.
  • the target image transmission data is obtained after the image transmission device processes the image transmission data sent by the movable platform.
  • the image transmission data conforms to the video playback standard protocol.
  • a descriptor acquisition request can be sent to the image transmission device, and the descriptor returned by the image transmission device in response to the descriptor acquisition request to indicate that the image transmission device is in UVC mode, and according to the indication that the image transmission device is in UVC mode
  • the descriptor identifies the video transmission device.
  • the terminal device may include a user interface, and the user interface of the terminal device may include a play option.
  • a transmission request may be generated in response to the trigger operation of the play option, and the generated The transmission request is sent to the image transmission device; after the image transmission device responds to the transmission request and processes the image transmission data, it sends the processed target image transmission data to the terminal device.
  • FIG. 5 is a schematic diagram of a user interface of a terminal device provided by an embodiment of the present application.
  • the user interface 50 of the terminal device includes a play option 501.
  • the play option 501 is triggered by the user of the terminal device (for example, the terminal When the user of the device clicks on the play option 501)
  • a transmission request is generated in response to the triggering operation on the play option 501.
  • the image transmission data attributes supported by the image transmission device may include the frame rate of the image transmission data and the resolution of the image transmission data.
  • An attribute acquisition request (eg, GET request) may be sent to the image transmission device to acquire image transmission data attributes supported by the image transmission device. It is also possible to send an attribute setting request (such as a SET request) to the image transmission device, and the attribute setting request carries the target image transmission data attribute of the image transmission data requested by the terminal device, and receives the attribute setting request returned by the image transmission device.
  • the target image transmission data of the target image transmission data attribute may be sent to the image transmission device to acquire image transmission data attributes supported by the image transmission device.
  • an attribute setting request (such as a SET request) to the image transmission device, and the attribute setting request carries the target image transmission data attribute of the image transmission data requested by the terminal device, and receives the attribute setting request returned by the image transmission device.
  • the target image transmission data of the target image transmission data attribute may include the frame rate of the image transmission data and the resolution of the image transmission data
  • Step S402 parse and play the target image transmission data.
  • the target image transmission data can be transmitted to the video player (eg, video playback software) of the terminal device through a standard video playback protocol, and the video player of the terminal device parses and plays the target image transmission data. Further, it is also possible to send a control request to the image transmission device in response to the control operation on the target image transmission data, so that the image transmission device responds to the control request and controls the transmission of the target image transmission data; for example, the user of the terminal device clicks The pause playback option of the video player generates a pause playback operation. In response to the pause playback operation for the target image transmission data, a control request is sent to the image transmission device, so that the image transmission device suspends the transmission of the target image transmission data in response to the control request.
  • the video player eg, video playback software
  • a communication connection is established between the terminal device and the image transmission device through a USB data cable, and the terminal device receives the target image transmission data sent by the image transmission device and conforms to the video playback standard protocol, and parses and plays the target image transmission data;
  • the process of the device receiving the target image transmission data sent by the image transmission device depends on the USB data cable and does not depend on the network signal, which can effectively improve the transmission efficiency and transmission stability of the image transmission data.
  • FIG. 6 is a schematic flowchart of another image transmission data processing method provided by an embodiment of the present application.
  • the image transmission data processing method provided by the embodiment of the present application may be executed interactively by an image transmission device and a terminal device.
  • a communication connection is established between the image transmission device and the terminal device through a USB data cable, and the image transmission data processing method may include the following steps S601 to S604:
  • Step S601 the image transmission device acquires image transmission data.
  • FIG. 7 is a schematic flowchart of another image transmission data processing method provided by an embodiment of the present application.
  • the image transmission data is transmitted from the image transmission module of the movable platform to the ground image transmission module of the image transmission device. of.
  • the image transmission data can be composed of n frames of image transmission code stream data.
  • the ground image transmission module of the image transmission device When the ground image transmission module of the image transmission device receives n frames of image transmission code stream data transmitted by the image transmission module of the mobile platform, it can create a receiving thread and pass The receiving thread receives n frames of image transmission code stream data transmitted by the ground image transmission module, and stores m frames of image transmission code stream data in the n frames of image transmission code stream data into the code stream queue through the receiving thread, where n is a positive integer, m is a positive integer less than or equal to n.
  • Step S602 the image transmission device processes the image transmission data to obtain target image transmission data.
  • the image transmission device After the image transmission device acquires the image transmission data, it can process the acquired image transmission data, and the processed target image transmission data conforms to the video playback standard protocol. Specifically, as shown in FIG. 7 , the image transmission device can create a working thread, obtain m frames of image transmission code stream data from the code stream queue through the working thread, and decode the m frames of image transmission code stream data through the working thread, Get m frames of image transmission screen. After the image transmission device decodes the m-frame image transmission code stream data through the working thread to obtain the m-frame image transmission image, the working thread can add the video corresponding to the video playback standard protocol to each frame of the m-frame image transmission image through the working thread.
  • the data header is used to obtain m frames of target image transmission pictures, and the m frames of target image transmission pictures are encapsulated by working threads to obtain target image transmission data. Each frame of target image transmission pictures conforms to the standard video playback protocol.
  • the image transmission device can also create a control thread, and the image transmission device receives and responds to requests through the control thread.
  • the image transmission device can receive an attribute acquisition request sent by the terminal device through the control thread, respond to the attribute acquisition request through the control thread, and return the image transmission data attributes supported by the image transmission device to the terminal device through the control thread.
  • the image transmission device can receive the attribute setting request sent by the terminal device through the control thread, respond to the attribute setting request through the control thread, and trigger the worker thread through the control thread to request the attribute setting request to satisfy the target image transmission data attribute.
  • the target image transmission data is transmitted to the terminal device.
  • the image transmission device receives the transmission request sent by the terminal device through the control thread, responds to the transmission request through the control thread, and triggers the working thread to process the image transmission data through the control thread, that is, triggering the working thread through the control thread from the code stream.
  • Step S603 the image transmission device transmits the target image transmission data to the terminal device.
  • the image transmission device transfers the processed target image transmission data to the universal serial bus video class driver (ie UVC driver) of the terminal device by means of DMA (Direct Memory Access, direct memory access) through the working thread.
  • UVC driver universal serial bus video class driver
  • DMA Direct Memory Access, direct memory access
  • Step S604 the terminal device parses and plays the target image transmission data.
  • the UVC driver of the terminal device transmits the target image transmission data to the application layer player (ie, the above-mentioned video player) through the standard video playback protocol, and the application layer player of the terminal device parses and plays the target image transmission data.
  • the application layer player ie, the above-mentioned video player
  • a communication connection is established between the image transmission device and the terminal device through a USB data line, the image transmission device receives image transmission data sent by the image transmission module of the movable platform through the ground image transmission module, and receives the ground map through the receiving thread.
  • the n frames of image transmission code stream data sent by the transmission module, and the m frames of image transmission code stream data in the n frames of image transmission code stream data are stored in the code stream queue through the receiving thread;
  • the processed target image transmission data conforms to the video playback standard protocol.
  • the image transmission device transmits the processed target image transmission data to the UVC driver of the terminal device through the working thread, and the UVC driver of the terminal device passes the video playback standard.
  • the target image transmission data is transmitted to the application layer player of the terminal device, and the application layer player of the terminal device can parse and play the target image transmission data.
  • the process of the target image transmission data being transmitted from the image transmission device to the terminal device relies on the USB data cable instead of the network signal, which can effectively improve the transmission efficiency and transmission stability of the image transmission data.
  • FIG. 8 is a schematic structural diagram of an apparatus for processing image transmission data provided by an embodiment of the present application.
  • the apparatus for processing image transmission data provided by an embodiment of the present application may be deployed in an image transmission device, and the image transmission data
  • the processing device 80 may include:
  • the acquisition module 801 is used to acquire image transmission data, which is video data acquired by the mobile platform and transmitted to the image transmission device;
  • the processing module 802 is configured to process the image transmission data to obtain target image transmission data; wherein, the processed target image transmission data conforms to the video playback standard protocol;
  • the transmission module 803 is used for transmitting the target image transmission data to the terminal device.
  • the image transmission device is communicatively connected to the terminal device through a universal serial bus data line
  • the video playback standard protocol includes a universal serial bus video-like UVC protocol.
  • the image transmission device is a device conforming to a video playback standard protocol; the processing module 802 is further configured to:
  • the image transmission device includes a user interface, and the user interface of the image transmission device displays a connection mode list; the connection mode list includes multiple connection mode options, and the multiple connection mode options include UVC mode options; the processing module 802, specifically for:
  • the connection mode of the image transmission device is configured as the UVC mode.
  • processing module 802 is specifically configured to:
  • processing module 802 is further configured to:
  • a descriptor for indicating that the image transmission device is in the UVC mode is sent to the terminal device, so that the terminal device identifies the image transmission device according to the descriptor.
  • the descriptors include configuration descriptors or device descriptors.
  • the image transmission data includes n frames of image transmission code stream data, where n is a positive integer; the acquiring module 801 is specifically used for:
  • the m frames of image transmission code stream data are stored in the code stream queue through the receiving thread, where m is a positive integer less than or equal to n.
  • processing module 802 is specifically configured to:
  • the video data header corresponding to the video playback standard protocol is added to each frame of the image transmission image in the m-frame image transmission image by the working thread, and the m-frame target image transmission image is obtained; the target image transmission image conforms to the video playback standard protocol;
  • the target image transmission data is obtained by encapsulating m frames of the target image transmission picture through the working thread.
  • the transmission module 803 is further configured to:
  • the control thread responds to the transmission request, triggering and executing the step of acquiring m-frame image transmission code stream data from the code stream queue through the worker thread.
  • the transmission module 803 is further configured to:
  • the image transmission data attributes supported by the image transmission device are returned to the terminal device by responding to the attribute data acquisition request through the control thread;
  • the image transmission data attribute includes the frame rate of the image transmission data or the resolution of the image transmission data.
  • the transmission module 803 is further configured to:
  • the attribute setting request sent by the terminal device through the control thread, and the attribute setting request carries the target image transmission data attribute of the image transmission data requested by the terminal device;
  • the target image transmission data corresponding to the attribute of the target image transmission data is transmitted to the terminal device by responding to the attribute setting request through the control thread.
  • the image transmission device includes any one of a remote controller for controlling the movable platform, a ground station for data interaction with the movable platform, and an image transmission box for transmitting image transmission data.
  • the acquisition module 801 of the image transmission data processing apparatus 80 may be used to acquire image transmission data, which is video data acquired by the mobile platform and transmitted to the image transmission device; the image transmission data processing apparatus 80
  • the processing module 802 of the image transmission data can be used to process the image transmission data to obtain the target image transmission data; wherein, the processed target image transmission data conforms to the video playback standard protocol; the transmission module 803 of the image transmission data processing device 80 can be used to The target image transmission data is transmitted to the terminal device.
  • FIG. 9 is a schematic structural diagram of another image transmission data processing apparatus provided by an embodiment of the present application.
  • the image transmission data processing apparatus provided by the embodiment of the present application may be deployed in a terminal device.
  • the image transmission data The processing device 90 may include:
  • the receiving module 901 is used for receiving the target image transmission data sent by the image transmission device, the target image transmission data is obtained after the image transmission device processes the image transmission data sent by the movable platform, and the target image transmission data conforms to the video playback standard protocol;
  • the processing module 902 is used for parsing and playing the target image transmission data.
  • the terminal device is communicatively connected to the image transmission device through a universal serial bus data line
  • the video playback standard protocol includes a universal serial bus video-like UVC protocol.
  • the image transmission device is a device conforming to a video playback standard protocol; the receiving module 901 is further used for:
  • the descriptors include configuration descriptors or device descriptors.
  • the terminal device includes a user interface, and the user interface of the terminal device displays playback options; the processing module 902 is further configured to:
  • a transmission request is generated, and the transmission request is sent to the image transmission device, so that the image transmission device responds to the transmission request and processes the image transmission data before sending it to the terminal device.
  • the receiving module 901 is further configured to:
  • the image transmission data attribute includes the frame rate of the image transmission data or the resolution of the image transmission data.
  • the receiving module 901 is specifically used for:
  • the receiving module 901 of the image transmission data processing apparatus 90 may be configured to receive target image transmission data sent by an image transmission device, where the target image transmission data is the image transmission device processing image transmission data sent by a mobile platform Then, the target image transmission data conforms to the video playback standard protocol; the processing module 902 of the image transmission data processing apparatus 90 can be used to parse and play the target image transmission data.
  • the transmission efficiency and transmission stability of image transmission data can be effectively improved.
  • FIG. 10 is a schematic structural diagram of an image transmission device provided by an embodiment of the present application.
  • the image transmission device 100 described in the embodiments of this application includes: a processor 1001 and a memory 1002 .
  • the above-mentioned processor 1001 and memory 1002 are connected by a bus.
  • the above-mentioned processor 1001 can be a central processing unit (Central Processing Unit, CPU), and the processor 1001 can also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the above-mentioned memory 1002 may include read-only memory and random access memory, and provides program instructions and data to the processor 1001 .
  • a portion of memory 1002 may also include non-volatile random access memory.
  • the processor 1001 invokes the program instructions, it is used to execute:
  • image transmission data which is the video data acquired by the mobile platform and transmitted to the image transmission device
  • the image transmission data is processed to obtain the target image transmission data; wherein, the processed target image transmission data conforms to the video playback standard protocol;
  • the image transmission device is communicatively connected to the terminal device through a universal serial bus data line
  • the video playback standard protocol includes a universal serial bus video-like UVC protocol.
  • the image transmission device is a device conforming to a video playback standard protocol; the processor 1001 is further configured to:
  • the image transmission device includes a user interface, and the user interface of the image transmission device displays a connection mode list; the connection mode list includes multiple connection mode options, and the multiple connection mode options include UVC mode options; the processor 1001, specifically for:
  • the connection mode of the image transmission device is configured as the UVC mode.
  • the processor 1001 is specifically configured to:
  • the processor 1001 is further configured to:
  • a descriptor for indicating that the image transmission device is in the UVC mode is sent to the terminal device, so that the terminal device identifies the image transmission device according to the descriptor.
  • the descriptors include configuration descriptors or device descriptors.
  • the image transmission data includes n frames of image transmission code stream data, where n is a positive integer; the processor 1001 is specifically used for:
  • the m frames of image transmission code stream data are stored in the code stream queue through the receiving thread, where m is a positive integer less than or equal to n.
  • the processor 1001 is specifically configured to:
  • the target image transmission data is obtained by encapsulating m frames of the target image transmission picture through the working thread.
  • the processor 1001 is further configured to:
  • the control thread responds to the transmission request, triggering and executing the step of acquiring m-frame image transmission code stream data from the code stream queue through the worker thread.
  • the processor 1001 is further configured to:
  • the image transmission data attributes supported by the image transmission device are returned to the terminal device by responding to the attribute data acquisition request through the control thread;
  • the image transmission data attribute includes the frame rate of the image transmission data or the resolution of the image transmission data.
  • the processor 1001 is further configured to:
  • the attribute setting request sent by the terminal device through the control thread, and the attribute setting request carries the target image transmission data attribute of the image transmission data requested by the terminal device;
  • the target image transmission data corresponding to the attribute of the target image transmission data is transmitted to the terminal device by responding to the attribute setting request through the control thread.
  • the image transmission device includes any one of a remote controller for controlling the movable platform, a ground station for data interaction with the movable platform, and an image transmission box for transmitting image transmission data.
  • the processor 1001 and the memory 1002 described in the embodiments of the present application may execute the corresponding steps of the image transmission device in the image transmission data processing method provided by the embodiment shown in FIG. 2 or FIG. 6 , and may also execute the steps in FIG. 8 .
  • the implementation manner of the described image transmission data processing apparatus 80 will not be repeated here.
  • the processor 1001 of the image transmission device 100 may be configured to acquire image transmission data, process the image transmission data, obtain target image transmission data, and transmit the target image transmission data to the terminal device.
  • the image transmission data is the video data acquired by the mobile platform and transmitted to the image transmission device, and the processed target image transmission data conforms to the video playback standard protocol.
  • FIG. 11 is a schematic structural diagram of a terminal device provided by an embodiment of the present application.
  • the terminal device 110 described in the embodiments of this application includes: a processor 1101 and a memory 1102 .
  • the above-mentioned processor 1101 and memory 1102 are connected by a bus.
  • the above-mentioned processor 1101 may be a central processing unit (Central Processing Unit, CPU), and the processor 1101 may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the above-described memory 1102 may include read-only memory and random access memory, and provides program instructions and data to the processor 1101. A portion of memory 1102 may also include non-volatile random access memory. Wherein, when the processor 1101 invokes the program instructions, it is used to execute:
  • the target image transmission data is obtained after the image transmission device processes the image transmission data sent by the movable platform, and the target image transmission data conforms to the video playback standard protocol;
  • the terminal device is communicatively connected to the image transmission device through a universal serial bus data line
  • the video playback standard protocol includes a universal serial bus video-like UVC protocol.
  • the image transmission device is a device conforming to a video playback standard protocol; the processor 1101 is further configured to:
  • the descriptors include configuration descriptors or device descriptors.
  • the terminal device includes a user interface, and the user interface of the terminal device displays playback options; the processor 1101 is further configured to:
  • a transmission request is generated, and the transmission request is sent to the image transmission device, so that the image transmission device responds to the transmission request and processes the image transmission data before sending it to the terminal device.
  • the processor 1101 is further configured to:
  • the image transmission data attribute includes the frame rate of the image transmission data or the resolution of the image transmission data.
  • the processor 1101 is specifically configured to:
  • the processor 1101 and the memory 1102 described in the embodiments of the present application may execute the corresponding steps of the image transmission device in the image transmission data processing method provided in the embodiment shown in FIG. 4 or FIG. 6 , and may also execute the steps shown in FIG. 9 .
  • the implementation of the described image transmission data processing apparatus 90 will not be repeated here.
  • the processor 1101 of the terminal device 110 may be configured to receive the target image transmission data sent by the image transmission device, and parse and play the target image transmission data.
  • the target image transmission data is obtained after the image transmission device processes the image transmission data sent by the movable platform, and the target image transmission data conforms to the video playback standard protocol.
  • Embodiments of the present application further provide a computer-readable storage medium, where program instructions are stored in the computer-readable storage medium, and when the program instructions are executed, the program instructions may include the image transmission device in the corresponding embodiment of FIG. 2 or FIG. 6 . Some or all of the steps performed.
  • Embodiments of the present application further provide a computer-readable storage medium, where program instructions are stored in the computer-readable storage medium, and when the program instructions are executed, the program instructions may include execution by the terminal device in the embodiment corresponding to FIG. 4 or FIG. 6 . some or all of the steps.
  • the computer-readable storage medium may include: a flash disk, a read-only memory (Read-Only Memory, ROM), a random access device (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

一种图传数据的处理方法、图传设备、终端设备及存储介质,其中,图传设备与终端设备通信连接,该图传数据的处理方法包括:获取图传数据(S201),图传数据是可移动平台获取并传输至图传设备的视频数据;对图传数据进行处理,得到目标图传数据(S202);其中,处理后的目标图传数据符合视频播放标准协议;将目标图传数据传输至终端设备(S203)。能够有效提升图传数据的传输效率与传输稳定性。

Description

图传数据的处理方法、图传设备、终端设备及存储介质 技术领域
本申请涉及电子技术领域,尤其涉及一种图传数据的处理方法、图传设备、终端设备及存储介质。
背景技术
目前,可移动平台已经广泛应用于航拍影像、电力巡检等垂直领域,通过可移动平台进行航拍能够突破空间限制,展示不同的视角,这些可移动平台可以是无人机、无人驾驶汽车等等。可移动平台往往通过图传模块将可移动平台拍摄到的画面实时稳定地传输至地面图传设备,用户可以通过图传设备的LCD(Liquid Crystal Display,液晶显示器)屏幕观看拍摄画面;图传设备还可以外接终端设备,将拍摄画面传输至终端设备中,用户可以通过终端设备观看拍摄画面,还可以通过终端设备对拍摄画面进行编辑与存储。因此,如何提升图传设备与终端设备之间的传输效率与传输稳定性成为当前研究的热点问题。
发明内容
本申请实施例提供了一种图传数据的处理方法、图传设备、终端设备及存储介质,能够有效提升图传数据的传输效率与传输稳定性。
第一方面,本申请实施例提供了一种图传数据的处理方法,该图传数据的处理方法应用于图传设备,图传设备与终端设备通信连接,该图传数据的处理方法包括:
获取图传数据,图传数据是可移动平台获取并传输至图传设备的视频数据;
对图传数据进行处理,得到目标图传数据;其中,处理后的目标图传数据符合视频播放标准协议;
将目标图传数据传输至终端设备。
第二方面,本申请实施例提供了一种图传数据的处理方法,该图传数据的处理方法应用于终端设备,终端设备与图传设备通信连接,该图传数据的处理方法包括:
接收图传设备发送的目标图传数据,目标图传数据是图传设备对可移动平台发送的图传数据进行处理后得到的,目标图传数据符合视频播放标准协议;
解析并播放目标图传数据。
第三方面,本申请实施例提供了一种图传设备,图传设备与终端设备通信连接,该图传设备包括处理器和存储器,存储器和处理器相互连接,其中:
存储器,用于存储计算机程序,计算机程序包括程序指令;
处理器,调用程序指令时用于执行:
获取图传数据,图传数据是可移动平台获取并传输至图传设备的视频数据;
对图传数据进行处理,得到目标图传数据;其中,处理后的目标图传数据符合视频播放标准协议;
将目标图传数据传输至终端设备。
第四方面,本申请实施例提供了一种终端设备,终端设备与图传设备通信连接,该终 端设备包括处理器和存储器,存储器和处理器相互连接,其中:
存储器,用于存储计算机程序,计算机程序包括程序指令;
处理器,调用程序指令时用于执行:
接收图传设备发送的目标图传数据,目标图传数据是图传设备对可移动平台发送的图传数据进行处理后得到的,目标图传数据符合视频播放标准协议;
解析并播放目标图传数据。
第五方面,本申请实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,计算机程序被处理器执行时实现上述第一方面所述的图传数据的处理方法。
第六方面,本申请实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,计算机程序被处理器执行时实现上述第二方面所述的图传数据的处理方法。
本申请实施例中,图传设备与终端设备通信连接,图传设备从可移动平台中获取到图传数据后,对图传数据进行处理,得到目标图传数据,处理后的目标图传数据符合视频传输标准协议,图传设备将目标图传数据传输至终端设备。本申请实施例通过在图传设备与终端设备之间建立通信连接,并对图传数据进行处理得到符合视频传输标准协议的目标图传数据,能够有效提升图传数据的传输效率与传输稳定性。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的一种图传数据的处理系统的架构示意图;
图2是本申请实施例提供的一种图传数据的处理方法的流程示意图;
图3是本申请实施例提供的一种图传设备的用户界面的示意图;
图4是本申请实施例提供的另一种图传数据的处理方法的流程示意图;
图5是本申请实施例提供的一种终端设备的用户界面的示意图;
图6是本申请实施例提供的另一种图传数据的处理方法的流程示意图;
图7是本申请实施例提供的另一种图传数据的处理方法的流程示意图;
图8是本申请实施例提供的一种图传数据的处理装置的结构示意图;
图9是本申请实施例提供的另一种图传数据的处理装置的结构示意图;
图10是本申请实施例提供的一种图传设备的结构示意图;
图11是本申请实施例提供的一种终端设备的结构示意图。
具体实施方式
高端消费的可移动平台或者行业用途的可移动平台解决方案中,往往配备有一体化的图传设备,能够为用户提供更好的可移动平台使用体验以及更专业的作业平台。可移动平 台可以是指无人机、无人驾驶汽车、无人车、无人船、机器人等等。图传设备可以是指用于控制可移动平台的遥控器、用于与可移动平台进行数据交互的地面站、用于传输图传数据的图传盒子等等;图传设备通常具备较强的处理器单元,可以对可移动平台拍摄到的图传数据进行播放、存储、编辑等等。图传数据可以是指可移动平台拍摄得到的视频数据,例如图传数据是无人机拍摄得到的航拍视频数据。
为了提高用户对图传数据的观看体验,提高对图传数据的存储空间,为图传数据提供更丰富的编辑功能,本申请实施例提供一种图传数据的处理方案,该图传数据的处理方案通过UVC(USB Video Class,通用串行总线视频类)设备传输、APP(Application,应用程序)推流、专用软件传输、HDMI(High Definition Multimedia Interface,高清多媒体接口)自定义推流四种方式,将图传设备中的图传数据传输至终端设备中,以便于图传数据在终端设备中进行实时播放、存储、编辑等。其中,终端设备可以包括但不限于智能手机、平板电脑、笔记本电脑、台式计算机等可以用于对图传数据进行实时播放、存储、编辑的设备。下面将对UVC设备传输、APP推流、专用软件传输、HDMI自定义推流四种方式进行详细介绍:
(1)将图传设备设置为UVC设备后传输图传数据至终端设备。UVC设备可以是指符合视频播放标准协议的图传设备。图传设备与终端设备之间通过USB(Universal Serial Bus,通用串行总线)数据线建立通信连接,将图传设备设置为UVC设备后,图传设备对接收到的可移动平台拍摄的图传数据进行处理,处理后的目标图传数据符合视频播放标准协议,图传设备通过USB数据线将处理后的目标图传数据传输至终端设备中,从而终端设备可以解析并播放目标图传数据。目标图传数据从图传设备传输至终端设备的过程依赖于USB数据线,不依赖于网络信号,能够有效提升图传数据的传输效率与传输稳定性。
(2)基于图传设备内置的APP推流。该方式主要应用于直播领域,将可移动平台拍摄得到的图传数据与直播相结合,可以为直播领域带来更好的观赏性和体验感。该方式基于图传设备内置的APP的直播推流功能,用户可以通过图传设备内置的APP选择第三方直播平台,在APP中填写第三方直播平台的网络推流地址。终端设备中需要安装相应的第三方直播平台的软件,并通过该第三方直播平台的软件实时播放图传数据。在这种方式中,为了达到更好的直播观赏性,需要确保直播现场网络信号的稳定性;例如可以通过4G(the 4th Generation Mobile Communication Technology,第四代移动通信机制)无线网卡、5G(5th Generation Mobile Networks,第五代移动通信技术)无线网卡、有线网络或WiFi(无线上网)热点进行直播,并且直播时的上行速率需要大于1M/s(兆每秒)。
(3)图传设备传输图传数据至终端设备的专用软件。终端设备内置的专用软件可以是基于可移动平台厂商的SDK(Software Development Kit,软件开发工具包)开发的,终端设备与图传设备之间通过USB数据线建立通信连接,图传设备通过USB数据线将图传数据传输至终端设备的专用软件中,并通过终端设备的专用软件实时播放图传数据。在这种方式中,需要基于可移动平台厂商的SDK开发终端设备的专用软件。
(4)基于第三方HDMI接口编码器自定义推流。该方式同样可以应用于直播领域,该方式基于第三方HDMI接口编码器自定义推流,需要使用HDMI视频线将图传设备上的HDMI端口和第三方HDMI接口编码器上的HDMI端口进行连接,图传设备需要支持HDMI 视频信号输出。用户可以在第三方HDMI接口编码器的APP里选择第三方直播平台,在第三方HDMI接口编码器的APP中填写网络推流地址。终端设备中需要安装相应的第三方直播平台的软件,并通过该第三方直播平台的软件实时播放图传数据。在这种实现方式中,图传设备需要增加HDMI标准接口,支持HDMI视频信号输出,图传设备还需要配置第三方HDMI接口编码器,并且网络推流要求网络信号质量稳定。
以上四种方式均能实现图传设备将图传数据传输至终端设备进行实时视频输出,在第一种方式中,将图传设备设置为UVC设备后,图传设备可以通过USB数据线将目标图传数据传输至终端设备;在第二种方式中,在确保网络信号质量稳定的情况下,图传设备基于内置的APP将图传数据直播推流至终端设备中;在第三种方式中,通过开发专用软件,图传设备将图传数据传输至终端设备的专用软件中;在第四种方式中,在确保网络信号质量稳定的情况下,图传设备通过HDMI视频线以及第三方HDMI接口编码器将图传数据推流至终端设备中。
当存在图传设备与终端设备之间的图传数据传输需求时,可以从以上四种方式中选择任意一种方式进行传输。在一种实现方式中,图传设备可以包括用户界面,图传设备的用户界面中可以包括传输方式列表,传输方式列表中可以包括以上四种传输方式选项,即UVC设备传输选项、APP推流选项、专用软件传输选项、HDMI自定义推流选项;图传设备可以响应于图传设备的用户对各个传输方式选项的选择操作,并通过选择的传输方式将图传数据传输至终端设备;通过这种方式,图传设备的用户能够更清楚地了解图传设备所具备的数据传输功能,并可以对相应的数据传输方式进行选择。另外,当图传设备检测到用户选择的传输方式无法实现时,可以向用户输出提示信息;例如,用户选择的传输方式为HDMI自定义推流方式,当图传设备检测到当前未连接HDMI视频线时,图传设备通过用户界面向用户输出提示信息“请连接HDMI视频线”;又如,用户选择的传输方式为APP推流方式,当图传设备检测到当前未连接网络时,图传设备通过用户界面向用户输出提示信息“网络连接不可用,请连接互联网”。通过提示信息,能够引导图传设备的用户选择合适的图传数据传输方式。
在另一种实现方式中,图传设备可以为图传数据的四种传输方式设置优先级,当存在图传设备与终端设备之间的图传数据传输需求时,图传设备可以按照各个传输方式的优先级顺序,确定选择的传输方式。举例来说,若UVC设备传输方式的优先级高于APP推流方式的优先级,那么图传设备可以优先选择UVC设备传输方式;当UVC设备传输方式无法实现时,例如,图传设备与终端设备之间未连接USB数据线,或者图传设备尚未设置为UVC设备,那么图传设备可以按照优先级顺序确定选择的传输方式为APP推流方式。通过这种方式,图传数据传输方式的选择更加智能化。
在另一种实现方式中,图传设备还可以根据图传设备满足的传输条件,确定与传输条件相适应的传输方式。举例来说,当图传设备检测到图传设备所连接到的网络信号较强,网络质量较稳定,那么图传设备可以确定传输方式为APP推流方式;当图传设备检测到图传设备与终端设备之间通过USB数据线建立通信连接,图传设备可以确定传输方式为UVC设备传输方式。通过这种方式,图传数据传输方式的选择更加智能化。
为了更好的理解本申请实施例提供的一种图传数据的处理方法、图传设备、终端设备及存储介质,下面首先对本申请实施例适用的图传数据的处理系统进行描述。
请参见图1,图1是本申请实施例提供的一种图传数据的处理系统的架构示意图。本申请实施例中以可移动平台是无人机为例进行说明。如图1所示,该图传数据的处理系统可以包括:图传设备101、终端设备102,可移动平台103和USB数据线104。在由图传设备101、终端设备102,可移动平台103和USB数据线104组成的图传设备的处理系统中,图传设备101与终端设备102之间可以通过USB数据线104建立通信连接;可移动平台103获取到图传数据后,可以通过图传模块将图传数据传输至图传设备101;图传设备101可以对图传数据进行处理,使得处理后的图传数据符合视频播放标准协议;图传设备101将处理后的目标图传数据传输至终端设备102,终端设备102可以解析并对目标图传数据进行播放、存储、编辑等等。
其中,视频播放标准协议可以包括UVC协议,UVC协议是一种为USB视频捕获设备定义的协议标准。主流的操作系统(例如Windows XP SP2操作系统以及发布时间晚于Windows XP SP2操作系统的后续版本操作系统,Linux 2.4.6操作系统以及发布时间晚于Linux 2.4.6操作系统的后续版本操作系统,MacOS 10.5操作系统以及发布时间晚于MacOS10.5操作系统的后续版本操作系统等等)中均内置有UVC驱动,安装有UVC驱动的终端设备即可支持UVC协议,可以接收、解析并播放符合UVC协议的目标图传数据。本申请实施例中,终端设备102中内置有UVC驱动。
USB是一种串口总线标准,也是一种输入接口、输出接口的技术规范;本申请实施例中USB数据线104可以用于实现图传设备101与终端设备102之间的连接与数据传输。
可以理解的是,本申请实施例提供的图传数据的处理系统是为了更加清楚的说明本申请实施例的技术方案,并不构成对于本申请实施例提供的技术方案的限定,本领域普通技术人员可知,随着系统架构的演变和新业务场景的出现,本申请实施例提供的技术方案对于类似的技术问题,同样适用。
再参见图2,图2是本申请实施例提供的一种图传数据的处理方法的流程示意图,本申请实施例提供的图传数据的处理方法可以由图传设备执行,图传设备与终端设备之间通过USB数据线建立通信连接,该图传数据的处理方法可以包括以下步骤S201至步骤S203:
步骤S201,获取图传数据。
图传数据可以是指可移动平台拍摄得到的视频数据,例如图传数据是无人机拍摄得到的航拍视频数据,图传数据是可移动平台拍摄后通过可移动平台内置的图传模块发送至图传设备的。
图传数据可以由n帧图传码流数据组成,当接收到可移动平台传输的n帧的图传码流数据时,可以将m帧图传码流数据存储至码流队列中,n为正整数,m为小于或等于n的正整数。也就是说,图传设备可以将接收到的图传码流数据中的全部或者部分图传码流数据存储至码流队列中。
步骤S202,对图传数据进行处理,得到目标图传数据。
图传设备是符合视频播放标准协议(即UVC协议)的设备,在对图传数据进行处理之前可以将图传设备的连接模式配置为UVC模式,图传设备的连接模式配置为UVC模式后, 终端设备与图传设备之间可以传输符合视频播放标准协议的目标图传数据。将图传设备的连接模式配置为UVC模式的方式可以包括以下两种:
第一种方式,图传设备中可以包括用户界面,使用该图传设备的用户可以通过图传设备的用户界面操作图传设备;图传设备的用户界面中显示有连接模式列表,连接模式列表中可以包括多个连接模式选项,多个连接模式选项中包括UVC模式选项。如图3所示,图3是本申请实施例提供的一种图传设备的用户界面的示意图,图传设备包括用户界面30,图传设备的用户界面30中包括连接模式列表301,UVC模式选项302(即通用串行总线视频类模式选项302)是连接模式列表301中的任一个连接模式选项。图传设备可以响应于对UVC模式选项的选中操作,将图传设备的连接模式配置为UVC模式。如图3所示,使用图传设备的用户点击图传设备的用户界面30中的UVC模式选项302后,图传设备响应于对UVC模式选项302的选中操作,将图传设备的连接模式配置为UVC模式。
第二种方式,当图传设备接收到可移动平台发送的图传数据时,可自动将图传设备的连接模式配置为UVC模式。
在将图传设备的连接模式配置为UVC模式之后,当接收到终端设备发送的描述符获取请求时,响应于描述符获取请求,可以将用于指示图传设备处于UVC模式的描述符发送至终端设备,从而终端设备可以根据该描述符自动识别图传设备,并根据描述符为图传设备加载或安装相应的UVC驱动,终端设备对图传设备识别成功后,终端设备与图传设备之间可以传输符合视频播放标准协议的目标图传数据。其中,指示图传设备处于UVC模式的描述符可以包括但不限于以下至少一种:配置描述符、设备描述符等等;设备描述符可以包括图传设备的PID(Product ID,产品识别码)、图传设备的VID(Vender ID,供应商识别码)、图传设备的设备版本号等等。
在获取到图传数据之后,可以对获取到的图传数据进行处理,处理得到的目标图传数据符合视频播放标准协议。具体地,可以从码流队列中获取m帧图传码流数据,并对m帧图传码流数据进行解码,得到m帧图传画面。图传码流数据是对图传画面进行编码得到的,图传画面是未进行编码的原始视频数据,例如图传画面是YUV(一种原始视频数据格式)格式的原始视频数据,图传码流数据是编码后的图传画面,例如图传码流数据是MJPEG(Motion Joint Photographic Experts Group,一种视频压缩格式)格式的编码码流数据。对m帧图传码流数据进行解码得到m帧图传画面之后,可以在m帧图传画面的每一帧图传画面中添加视频播放标准协议对应的视频数据标头(例如UVC视频数据标头),得到m帧目标图传画面,并对m帧目标图传画面进行封装,得到目标图传数据,每一帧目标图传画面都符合视频播放标准协议。
对图传数据进行处理的步骤是可以是由终端设备发送的传输请求(例如UVC请求)触发的,即从码流队列中获取m帧图传码流数据的步骤可以是由终端设备发送的传输请求触发的。当接收到终端设备发送的传输请求时,响应该传输请求,并触发对图传数据进行处理,即触发从码流队列中获取m帧图传码流数据,并对m帧图传码流数据进行处理。
当接收到终端设备发送的属性获取请求(例如GET(获取)请求)时,响应该属性获取请求,并将图传设备支持的图传数据属性返回至终端设备;其中,图传数据属性可以包括图传数据的帧率或图传数据的分辨率等等。例如,图传设备支持的帧率包括30FPS(Fra mes Per Second,每秒传输帧数)、60FPS。当接收到终端设备发送的属性设置请求(例如SET(设置)请求)时,响应该属性设置请求,并将属性设置请求所请求的满足目标图传数据属性的目标图传数据传输至终端设备。例如,目标图传数据属性可以包括目标帧率或目标分辨率等等。
步骤S203,将目标图传数据传输至终端设备。
本申请实施例中,图传设备与终端设备之间通过USB数据线建立通信连接,可以通过用户界面触发将图传设备的连接模式设置为UVC模式,还可以在接收到可移动平台的图传数据后自动将图传设备的连接模式设置为UVC模式,UVC模式的设置方式丰富多样,更加智能;将图传设备的连接模式设置为UVC模式之后,可以将符合视频播放标准协议的目标图传数据传输至终端设备,目标图传数据从图传设备传输至终端设备的过程依赖于USB数据线,不依赖于网络信号,能够有效提升图传数据的传输效率与传输稳定性。
请参见图4,图4是本申请实施例提供的另一种图传数据的处理方法的流程示意图,本申请实施例提供的图传数据的处理方法可以由终端设备执行,终端设备与图传设备之间通过USB数据线建立通信连接,该图传数据的处理方法可以包括以下步骤S401至步骤S402:
步骤S401,接收图传设备发送的目标图传数据。
具体地,终端设备中内置有UVC驱动,可以通过UVC驱动接收图传设备发送的目标图传数据,目标图传数据是图传设备对可移动平台发送的图传数据进行处理后得到的,目标图传数据符合视频播放标准协议。图传数据的具体处理过程可参见图2所示实施例的描述。
在接收图传设备发送的目标图传数据之前,需要识别图传设备是否为符合视频播放标准协议的设备,当图传设备为符合视频播放标准协议的设备时,才能接收到图传设备发送的目标图传数据。具体地,可以向图传设备发送描述符获取请求,并接收图传设备响应描述符获取请求后返回的用于指示图传设备处于UVC模式的描述符,并根据指示图传设备处于UVC模式的描述符识别图传设备。
终端设备可以包括用户界面,终端设备的用户界面中可以包括播放选项,当终端设备的用户界面中的播放选项被触发时,可以响应于对播放选项的触发操作,生成传输请求,并将生成的传输请求发送至图传设备;图传设备响应于传输请求并对图传数据进行处理后,将处理得到的目标图传数据发送至终端设备。如图5所示,图5是本申请实施例提供的一种终端设备的用户界面的示意图,终端设备的用户界面50中包括播放选项501,当播放选项501被终端设备的用户触发(例如终端设备的用户点击该播放选项501)时,响应于对播放选项501的触发操作,生成传输请求。
图传设备支持的图传数据属性可以包括图传数据的帧率和图传数据的分辨率。可以向图传设备发送属性获取请求(例如GET请求)以获取图传设备支持的图传数据属性。还可以向图传设备发送属性设置请求(例如SET请求),属性设置请求中携带终端设备所请求的图传数据的目标图传数据属性,并接收图传设备返回的属性设置请求所请求的满足目标图传数据属性的目标图传数据。
步骤S402,解析并播放目标图传数据。
具体地,可以通过视频播放标准协议将目标图传数据传输给终端设备的视频播放器(例如视频播放软件),终端设备的视频播放器解析并播放目标图传数据。进一步地,还可以响应于对目标图传数据的控制操作,向图传设备发送控制请求,以使图传设备响应控制请求,对目标图传数据的传输进行控制;例如,终端设备的用户点击视频播放器的暂停播放选项产生暂停播放操作,响应于对目标图传数据的暂停播放操作,向图传设备发送控制请求,以使图传设备响应该控制请求,暂停传输目标图传数据。
本申请实施例中,终端设备与图传设备之间通过USB数据线建立通信连接,终端设备接收图传设备发送的符合视频播放标准协议的目标图传数据,解析并播放目标图传数据;终端设备接收图传设备发送的目标图传数据的过程依赖于USB数据线,不依赖于网络信号,能够有效提升图传数据的传输效率与传输稳定性。
请参见图6,图6是本申请实施例提供的另一种图传数据的处理方法的流程示意图,本申请实施例提供的图传数据的处理方法可以由图传设备与终端设备交互执行,图传设备与终端设备之间通过USB数据线建立通信连接,该图传数据的处理方法可以包括以下步骤S601至步骤S604:
步骤S601,图传设备获取图传数据。
如图7所示,图7是本申请实施例提供的另一种图传数据的处理方法的流程示意图,图传数据是由可移动平台的图传模块传输至图传设备的地面图传模块的。图传数据可以由n帧图传码流数据组成,当图传设备的地面图传模块接收到可移动平台的图传模块传输的n帧图传码流数据时,可以创建接收线程,并通过接收线程接收地面图传模块传输的n帧图传码流数据,并通过接收线程将n帧图传码流数据中的m帧图传码流数据存储至码流队列中,n为正整数,m为小于或等于n的正整数。
步骤S602,图传设备对图传数据进行处理,得到目标图传数据。
在图传设备获取到图传数据之后,可以对获取到的图传数据进行处理,处理得到的目标图传数据符合视频播放标准协议。具体地,如图7所示,图传设备可以创建工作线程,并通过工作线程从码流队列中获取m帧图传码流数据,并通过工作线程对m帧图传码流数据进行解码,得到m帧图传画面。图传设备通过工作线程对m帧图传码流数据进行解码得到m帧图传画面之后,可以通过工作线程在m帧图传画面的每一帧图传画面中添加视频播放标准协议对应的视频数据标头,得到m帧目标图传画面,并通过工作线程对m帧目标图传画面进行封装,得到目标图传数据,每一帧目标图传画面都符合视频播放标准协议。
图传设备还可以创建控制线程,图传设备通过控制线程接收并响应请求。例如,图传设备可以通过控制线程接收终端设备发送的属性获取请求,通过控制线程响应该属性获取请求,并通过控制线程将图传设备支持的图传数据属性返回至终端设备。又如,图传设备可以通过控制线程接收终端设备发送的属性设置请求,并通过控制线程响应该属性设置请求,并通过控制线程触发工作线程将属性设置请求所请求的满足目标图传数据属性的目标图传数据传输至终端设备。还如,图传设备通过控制线程接收终端设备发送的传输请求,并通过控制线程响应该传输请求,并通过控制线程触发工作线程对图传数据进行处理,即 通过控制线程触发工作线程从码流队列中获取m帧图传码流数据,并对m帧图传码流数据进行处理。
步骤S603,图传设备将目标图传数据传输至终端设备。
如图7所示,图传设备通过工作线程将处理得到的目标图传数据以DMA(Direct Memory Access,直接存储器访问)的方式传输至终端设备的通用串行总线视频类驱动(即UVC驱动)。
步骤S604,终端设备解析并播放目标图传数据。
如图7所示,终端设备的UVC驱动通过视频播放标准协议将目标图传数据传输至应用层播放器(即上述视频播放器),终端设备的应用层播放器解析并播放目标图传数据。
本申请实施例中,图传设备与终端设备之间通过USB数据线建立通信连接,图传设备通过地面图传模块接收可移动平台的图传模块发送的图传数据,通过接收线程接收地面图传模块发送的n帧图传码流数据,并通过接收线程将n帧图传码流数据中的m帧图传码流数据存储至码流队列中;图传设备通过工作线程对图传数据进行处理,处理后的目标图传数据符合视频播放标准协议,图传设备通过工作线程将处理后的目标图传数据传输至终端设备的UVC驱动中,终端设备的UVC驱动通过视频播放标准协将目标图传数据传输至终端设备的应用层播放器,终端设备的应用层播放器可以解析并播放目标图传数据。通过该图传数据的处理方案,目标图传数据的从图传设备传输至终端设备的过程依赖于USB数据线,不依赖于网络信号,能够有效提升图传数据的传输效率与传输稳定性。
请参见图8,图8是本申请实施例提供的一种图传数据的处理装置的结构示意图,本申请实施例提供的图传数据的处理装置可以部署于图传设备中,该图传数据的处理装置80可以包括:
获取模块801,用于获取图传数据,图传数据是可移动平台获取并传输至图传设备的视频数据;
处理模块802,用于对图传数据进行处理,得到目标图传数据;其中,处理后的目标图传数据符合视频播放标准协议;
传输模块803,用于将目标图传数据传输至终端设备。
在一种实现方式中,图传设备通过通用串行总线数据线与终端设备通信连接,视频播放标准协议包括通用串行总线视频类UVC协议。
在一种实现方式中,图传设备是符合视频播放标准协议的设备;处理模块802,还用于:
将图传设备的连接模式配置为UVC模式。
在一种实现方式中,图传设备包括用户界面,图传设备的用户界面中显示有连接模式列表;连接模式列表中包括多个连接模式选项,多个连接模式选项包括UVC模式选项;处理模块802,具体用于:
响应于对UVC模式选项的选中操作,将图传设备的连接模式配置为UVC模式。
在一种实现方式中,处理模块802,具体用于:
当接收到由可移动平台发送的图传数据时,将图传设备的连接模式配置为UVC模式。
在一种实现方式中,处理模块802,还用于:
接收终端设备发送的描述符获取请求;
响应描述符获取请求,将用于指示图传设备处于UVC模式的描述符发送至终端设备,以使终端设备根据描述符识别图传设备。
在一种实现方式中,描述符包括配置描述符或设备描述符。
在一种实现方式中,图传数据包括n帧图传码流数据,n为正整数;获取模块801,具体用于:
创建接收线程;
通过接收线程接收可移动平台传输的n帧图传码流数据;
通过接收线程将m帧图传码流数据存储至码流队列中,m为小于或者等于n的正整数。
在一种实现方式中,处理模块802,具体用于:
创建工作线程;
通过工作线程从码流队列中获取m帧图传码流数据;
通过工作线程对m帧图传码流数据进行解码,得到m帧图传画面;
通过工作线程在m帧图传画面中的每帧图传画面中添加视频播放标准协议对应的视频数据标头,得到m帧目标图传画面;目标图传画面符合视频播放标准协议;
通过工作线程对m帧目标图传画面进行封装,得到目标图传数据。
在一种实现方式中,传输模块803,还用于:
创建控制线程;
通过控制线程接收终端设备发送的传输请求,传输请求是当在终端设备的用户界面上存在触发操作时终端设备产生的;
通过控制线程响应传输请求,触发执行通过工作线程从码流队列中获取m帧图传码流数据的步骤。
在一种实现方式中,传输模块803,还用于:
创建控制线程;
通过控制线程接收终端设备发送的属性获取请求;
通过控制线程响应属性数据获取请求,将图传设备支持的图传数据属性返回至终端设备;
其中,图传数据属性包括图传数据的帧率或图传数据的分辨率。
在一种实现方式中,传输模块803,还用于:
通过控制线程接收终端设备发送的属性设置请求,属性设置请求中携带终端设备所请求的图传数据的目标图传数据属性;
通过控制线程响应属性设置请求,将目标图传数据属性对应的目标图传数据传输至终端设备。
在一种实现方式中,图传设备包括用于控制可移动平台的遥控器、用于与可移动平台进行数据交互的地面站、用于传输图传数据的图传盒子中的任一个设备。
本申请实施例中,图传数据的处理装置80的获取模块801可以用于获取图传数据,图传数据是可移动平台获取并传输至图传设备的视频数据;图传数据的处理装置80的处理模 块802可以用于对图传数据进行处理,得到目标图传数据;其中,处理后的目标图传数据符合视频播放标准协议;图传数据的处理装置80的传输模块803可以用于将目标图传数据传输至终端设备。通过本申请实施例,能够有效提升图传数据的传输效率与传输稳定性。
请参见图9,图9是本申请实施例提供的另一种图传数据的处理装置的结构示意图,本申请实施例提供的图传数据的处理装置可以部署于终端设备中,该图传数据的处理装置90可以包括:
接收模块901,用于接收图传设备发送的目标图传数据,目标图传数据是图传设备对可移动平台发送的图传数据进行处理后得到的,目标图传数据符合视频播放标准协议;
处理模块902,用于解析并播放目标图传数据。
在一种实现方式中,终端设备通过通用串行总线数据线与图传设备通信连接,视频播放标准协议包括通用串行总线视频类UVC协议。
在一种实现方式中,图传设备是符合视频播放标准协议的设备;接收模块901,还用于:
向图传设备发送描述符获取请求;
接收图传设备返回的用于指示图传设备处于UVC模式的描述符,并根据描述符识别图传设备。
在一种实现方式中,描述符包括配置描述符或设备描述符。
在一种实现方式中,终端设备包括用户界面,终端设备的用户界面中显示有播放选项;处理模块902,还用于:
响应于对播放选项的触发操作,生成传输请求,并向图传设备发送传输请求,以使图传设备响应传输请求并对图传数据进行处理后发送至终端设备。
在一种实现方式中,接收模块901,还用于:
向图传设备发送属性获取请求;
接收图传设备返回的图传设备支持的图传数据属性;
其中,图传数据属性包括图传数据的帧率或图传数据的分辨率。
在一种实现方式中,接收模块901,具体用于:
向图传设备发送属性设置请求,属性设置请求中携带终端设备所请求的图传数据的目标图传数据属性;
接收图传设备返回的目标图传数据属性对应的目标图传数据。
本申请实施例中,图传数据的处理装置90的接收模块901可以用于接收图传设备发送的目标图传数据,目标图传数据是图传设备对可移动平台发送的图传数据进行处理后得到的,目标图传数据符合视频播放标准协议;图传数据的处理装置90的处理模块902可以用于解析并播放目标图传数据。通过本申请实施例,能够有效提升图传数据的传输效率与传输稳定性。
请参见图10,图10是本申请实施例提供的一种图传设备的结构示意图。本申请实施例中所描述的图传设备100,包括:处理器1001和存储器1002。上述处理器1001和存储 器1002通过总线连接。
上述处理器1001可以是中央处理单元(Central Processing Unit,CPU),该处理器1001还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Progra mmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
上述存储器1002可以包括只读存储器和随机存取存储器,并向处理器1001提供程序指令和数据。存储器1002的一部分还可以包括非易失性随机存取存储器。其中,处理器1001调用程序指令时用于执行:
获取图传数据,图传数据是可移动平台获取并传输至图传设备的视频数据;
对图传数据进行处理,得到目标图传数据;其中,处理后的目标图传数据符合视频播放标准协议;
将目标图传数据传输至终端设备。
在一种实现方式中,图传设备通过通用串行总线数据线与终端设备通信连接,视频播放标准协议包括通用串行总线视频类UVC协议。
在一种实现方式中,图传设备是符合视频播放标准协议的设备;处理器1001,还用于:
将图传设备的连接模式配置为UVC模式。
在一种实现方式中,图传设备包括用户界面,图传设备的用户界面中显示有连接模式列表;连接模式列表中包括多个连接模式选项,多个连接模式选项包括UVC模式选项;处理器1001,具体用于:
响应于对UVC模式选项的选中操作,将图传设备的连接模式配置为UVC模式。
在一种实现方式中,处理器1001,具体用于:
当接收到由可移动平台发送的图传数据时,将图传设备的连接模式配置为UVC模式。
在一种实现方式中,处理器1001,还用于:
接收终端设备发送的描述符获取请求;
响应描述符获取请求,将用于指示图传设备处于UVC模式的描述符发送至终端设备,以使终端设备根据描述符识别图传设备。
在一种实现方式中,描述符包括配置描述符或设备描述符。
在一种实现方式中,图传数据包括n帧图传码流数据,n为正整数;处理器1001,具体用于:
创建接收线程;
通过接收线程接收可移动平台传输的n帧图传码流数据;
通过接收线程将m帧图传码流数据存储至码流队列中,m为小于或者等于n的正整数。
在一种实现方式中,处理器1001,具体用于:
创建工作线程;
通过工作线程从码流队列中获取m帧图传码流数据;
通过工作线程对m帧图传码流数据进行解码,得到m帧图传画面;
通过工作线程在m帧图传画面中的每帧图传画面中添加视频播放标准协议对应的视频 数据标头,得到m帧目标图传画面;目标图传画面符合视频播放标准协议;
通过工作线程对m帧目标图传画面进行封装,得到目标图传数据。
在一种实现方式中,处理器1001,还用于:
创建控制线程;
通过控制线程接收终端设备发送的传输请求,传输请求是当在终端设备的用户界面上存在触发操作时终端设备产生的;
通过控制线程响应传输请求,触发执行通过工作线程从码流队列中获取m帧图传码流数据的步骤。
在一种实现方式中,处理器1001,还用于:
创建控制线程;
通过控制线程接收终端设备发送的属性获取请求;
通过控制线程响应属性数据获取请求,将图传设备支持的图传数据属性返回至终端设备;
其中,图传数据属性包括图传数据的帧率或图传数据的分辨率。
在一种实现方式中,处理器1001,还用于:
通过控制线程接收终端设备发送的属性设置请求,属性设置请求中携带终端设备所请求的图传数据的目标图传数据属性;
通过控制线程响应属性设置请求,将目标图传数据属性对应的目标图传数据传输至终端设备。
在一种实现方式中,图传设备包括用于控制可移动平台的遥控器、用于与可移动平台进行数据交互的地面站、用于传输图传数据的图传盒子中的任一个设备。
具体实现中,本申请实施例中所描述的处理器1001和存储器1002可执行图2或图6所示实施例提供的图传数据的处理方法中图传设备的相应步骤,也可执行图8所描述的图传数据的处理装置80的实现方式,在此不再赘述。
本申请实施例中,图传设备100的处理器1001可以用于获取图传数据,并对图传数据进行处理,得到目标图传数据,并将目标图传数据传输至终端设备。其中,图传数据是可移动平台获取并传输至图传设备的视频数据,处理后的目标图传数据符合视频播放标准协议。通过本申请实施例,能够有效提升图传数据的传输效率与传输稳定性。
请参见图11,图11是本申请实施例提供的一种终端设备的结构示意图。本申请实施例中所描述的终端设备110,包括:处理器1101和存储器1102。上述处理器1101和存储器1102通过总线连接。
上述处理器1101可以是中央处理单元(Central Processing Unit,CPU),该处理器1101还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Progra mmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
上述存储器1102可以包括只读存储器和随机存取存储器,并向处理器1101提供程序 指令和数据。存储器1102的一部分还可以包括非易失性随机存取存储器。其中,处理器1101调用程序指令时用于执行:
接收图传设备发送的目标图传数据,目标图传数据是图传设备对可移动平台发送的图传数据进行处理后得到的,目标图传数据符合视频播放标准协议;
解析并播放目标图传数据。
在一种实现方式中,终端设备通过通用串行总线数据线与图传设备通信连接,视频播放标准协议包括通用串行总线视频类UVC协议。
在一种实现方式中,图传设备是符合视频播放标准协议的设备;处理器1101,还用于:
向图传设备发送描述符获取请求;
接收图传设备返回的用于指示图传设备处于UVC模式的描述符,并根据描述符识别图传设备。
在一种实现方式中,描述符包括配置描述符或设备描述符。
在一种实现方式中,终端设备包括用户界面,终端设备的用户界面中显示有播放选项;处理器1101,还用于:
响应于对播放选项的触发操作,生成传输请求,并向图传设备发送传输请求,以使图传设备响应传输请求并对图传数据进行处理后发送至终端设备。
在一种实现方式中,处理器1101,还用于:
向图传设备发送属性获取请求;
接收图传设备返回的图传设备支持的图传数据属性;
其中,图传数据属性包括图传数据的帧率或图传数据的分辨率。
在一种实现方式中,处理器1101,具体用于:
向图传设备发送属性设置请求,属性设置请求中携带终端设备所请求的图传数据的目标图传数据属性;
接收图传设备返回的目标图传数据属性对应的目标图传数据。
具体实现中,本申请实施例中所描述的处理器1101和存储器1102可执行图4或图6所示实施例提供的图传数据的处理方法中图传设备的相应步骤,也可执行图9所描述的图传数据的处理装置90的实现方式,在此不再赘述。
本申请实施例中,终端设备110的处理器1101可以用于接收图传设备发送的目标图传数据,解析并播放目标图传数据。其中,目标图传数据是图传设备对可移动平台发送的图传数据进行处理后得到的,目标图传数据符合视频播放标准协议。通过本申请实施例,能够有效提升图传数据的传输效率与传输稳定性。
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质中存储有程序指令,该程序指令被执行时可包括如图2或图6对应实施例中的图传设备所执行的部分或全部步骤。
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质中存储有程序指令,该程序指令被执行时可包括如图4或图6对应实施例中的终端设备所执行的部分或全部步骤。
其中,计算机可读存储介质可以包括:闪存盘、只读存储器(Read-Only Memory,R OM)、随机存取器(Random Access Memory,RAM)、磁盘或光盘等。
需要说明的是,对于前述的各个方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某一些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例为本申请的部分实施例,所涉及的动作和模块并不一定是本申请所必须的。
以上对本申请实施例所提供的一种图传数据的处理方法、图传设备、终端设备及存储介质进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (42)

  1. 一种图传数据的处理方法,其特征在于,所述方法应用于图传设备,所述图传设备与终端设备通信连接,所述方法包括:
    获取图传数据,所述图传数据是可移动平台获取并传输至所述图传设备的视频数据;
    对所述图传数据进行处理,得到目标图传数据;其中,处理后的所述目标图传数据符合视频播放标准协议;
    将所述目标图传数据传输至所述终端设备。
  2. 如权利要求1所述的方法,其特征在于,所述图传设备通过通用串行总线数据线与所述终端设备通信连接,所述视频播放标准协议包括通用串行总线视频类UVC协议。
  3. 如权利要求2所述的方法,其特征在于,所述图传设备是符合所述视频播放标准协议的设备;所述对所述图传数据进行处理,得到目标图传数据之前,所述方法还包括:
    将所述图传设备的连接模式配置为UVC模式。
  4. 如权利要求3所述的方法,其特征在于,所述图传设备包括用户界面,所述图传设备的用户界面中显示有连接模式列表;所述连接模式列表中包括多个连接模式选项,所述多个连接模式选项包括UVC模式选项;
    所述将所述图传设备的连接模式配置为UVC模式,包括:
    响应于对所述UVC模式选项的选中操作,将所述图传设备的连接模式配置为所述UVC模式。
  5. 如权利要求3所述的方法,其特征在于,所述将所述图传设备的连接模式配置为UVC模式,包括:
    当接收到由所述可移动平台发送的图传数据时,将所述图传设备的连接模式配置为所述UVC模式。
  6. 如权利要求3所述的方法,其特征在于,所述将所述图传设备的连接模式配置为UVC模式之后,所述方法还包括:
    接收所述终端设备发送的描述符获取请求;
    响应所述描述符获取请求,将用于指示所述图传设备处于所述UVC模式的描述符发送至所述终端设备,以使所述终端设备根据所述描述符识别所述图传设备。
  7. 如权利要求6所述的方法,其特征在于,所述描述符包括配置描述符或设备描述符。
  8. 如权利要求1所述的方法,其特征在于,所述图传数据包括n帧图传码流数据,n为正整数;所述获取图传数据,包括:
    创建接收线程;
    通过所述接收线程接收所述可移动平台传输的n帧图传码流数据;
    通过所述接收线程将m帧图传码流数据存储至码流队列中,m为小于或者等于n的正整数。
  9. 如权利要求8所述的方法,其特征在于,所述对所述图传数据进行处理,得到目标图传数据,包括:
    创建工作线程;
    通过所述工作线程从所述码流队列中获取所述m帧图传码流数据;
    通过所述工作线程对所述m帧图传码流数据进行解码,得到m帧图传画面;
    通过所述工作线程在所述m帧图传画面中的每帧图传画面中添加所述视频播放标准协议对应的视频数据标头,得到m帧目标图传画面;所述目标图传画面符合所述视频播放标准协议;
    通过所述工作线程对所述m帧目标图传画面进行封装,得到所述目标图传数据。
  10. 如权利要求9所述的方法,其特征在于,所述方法还包括:
    创建控制线程;
    通过所述控制线程接收所述终端设备发送的传输请求,所述传输请求是当在所述终端设备的用户界面上存在触发操作时所述终端设备产生的;
    通过所述控制线程响应所述传输请求,触发执行所述通过所述工作线程从所述码流队列中获取所述m帧图传码流数据的步骤。
  11. 如权利要求1所述的方法,其特征在于,所述方法还包括:
    创建控制线程;
    通过所述控制线程接收所述终端设备发送的属性获取请求;
    通过所述控制线程响应所述属性数据获取请求,将所述图传设备支持的图传数据属性返回至所述终端设备;
    其中,所述图传数据属性包括所述图传数据的帧率或所述图传数据的分辨率。
  12. 如权利要求11所述的方法,其特征在于,所述方法还包括:
    通过所述控制线程接收所述终端设备发送的属性设置请求,所述属性设置请求中携带所述终端设备所请求的图传数据的目标图传数据属性;
    通过所述控制线程响应所述属性设置请求,将所述目标图传数据属性对应的目标图传数据传输至所述终端设备。
  13. 如权利要求1所述的方法,其特征在于,所述图传设备包括用于控制所述可移动平台的遥控器、用于与所述可移动平台进行数据交互的地面站、用于传输所述图传数据的图传盒子中的任一个设备。
  14. 一种图传数据的处理方法,其特征在于,所述方法应用于终端设备,所述终端设备与图传设备通信连接,所述方法包括:
    接收所述图传设备发送的目标图传数据,所述目标图传数据是所述图传设备对可移动平台发送的图传数据进行处理后得到的,所述目标图传数据符合视频播放标准协议;
    解析并播放所述目标图传数据。
  15. 如权利要求14所述的方法,其特征在于,所述终端设备通过通用串行总线数据线与所述图传设备通信连接,所述视频播放标准协议包括通用串行总线视频类UVC协议。
  16. 如权利要求15所述的方法,其特征在于,所述图传设备是符合所述视频播放标准协议的设备;所述方法还包括:
    向所述图传设备发送描述符获取请求;
    接收所述图传设备返回的用于指示所述图传设备处于UVC模式的描述符,并根据所述描述符识别所述图传设备。
  17. 如权利要求16所述的方法,其特征在于,所述描述符包括配置描述符或设备描述符。
  18. 如权利要求14所述的方法,其特征在于,所述终端设备包括用户界面,所述终端设备的用户界面中显示有播放选项;所述方法还包括:
    响应于对所述播放选项的触发操作,生成传输请求,并向所述图传设备发送所述传输请求,以使所述图传设备响应所述传输请求并对所述图传数据进行处理后发送至所述终端设备。
  19. 如权利要求14所述的方法,其特征在于,所述方法还包括:
    向所述图传设备发送属性获取请求;
    接收所述图传设备返回的所述图传设备支持的图传数据属性;
    其中,所述图传数据属性包括所述图传数据的帧率或所述图传数据的分辨率。
  20. 如权利要求19所述的方法,其特征在于,所述接收所述图传设备发送的目标图传数据,包括:
    向所述图传设备发送属性设置请求,所述属性设置请求中携带所述终端设备所请求的图传数据的目标图传数据属性;
    接收所述图传设备返回的所述目标图传数据属性对应的所述目标图传数据。
  21. 一种图传设备,其特征在于,所述图传设备与终端设备通信连接,所述图传设备包括:处理器和存储器,所述存储器和所述处理器相互连接,其中:
    所述存储器,用于存储计算机程序,所述计算机程序包括程序指令;
    所述处理器调用所述程序指令时,用于执行:
    获取图传数据,所述图传数据是可移动平台获取并传输至所述图传设备的视频数据;
    对所述图传数据进行处理,得到目标图传数据;其中,处理后的所述目标图传数据符合视频播放标准协议;
    将所述目标图传数据传输至所述终端设备。
  22. 如权利要求21所述的设备,其特征在于,所述图传设备通过通用串行总线数据线与所述终端设备通信连接,所述视频播放标准协议包括通用串行总线视频类UVC协议。
  23. 如权利要求22所述的设备,其特征在于,所述图传设备是符合所述视频播放标准协议的设备;所述处理器在对所述图传数据进行处理,得到目标图传数据之前,还用于执行如下步骤:
    将所述图传设备的连接模式配置为UVC模式。
  24. 如权利要求23所述的设备,其特征在于,所述图传设备还包括用户界面,所述图传设备的用户界面中显示有连接模式列表;所述连接模式列表中包括多个连接模式选项,所述多个连接模式选项包括UVC模式选项;
    所述处理器在将所述图传设备的连接模式配置为UVC模式时,具体用于执行如下步骤:
    响应于对所述UVC模式选项的选中操作,将所述图传设备的连接模式配置为所述UVC模式。
  25. 如权利要求23所述的设备,其特征在于,所述处理器在将所述图传设备的连接模式配置为UVC模式时,具体用于执行如下步骤:
    当接收到由所述可移动平台发送的图传数据时,将所述图传设备的连接模式配置为所述UVC模式。
  26. 如权利要求23所述的设备,其特征在于,所述处理器在将所述图传设备的连接模式配置为UVC模式之后,还用于执行如下步骤:
    接收所述终端设备发送的描述符获取请求;
    响应所述描述符获取请求,将用于指示所述图传设备处于所述UVC模式的描述符发送至所述终端设备,以使所述终端设备根据所述描述符识别所述图传设备。
  27. 如权利要求26所述的设备,其特征在于,所述描述符包括配置描述符或设备描述符。
  28. 如权利要求21所述的设备,其特征在于,所述图传数据包括n帧图传码流数据,n为正整数;所述处理器在获取图传数据时,具体用于执行如下步骤:
    创建接收线程;
    通过所述接收线程接收所述可移动平台传输的n帧图传码流数据;
    通过所述接收线程将m帧图传码流数据存储至码流队列中,m为小于或者等于n的正整数。
  29. 如权利要求28所述的设备,其特征在于,所述处理器对所述图传数据进行处理,得到目标图传数据时,具体用于执行如下步骤:
    创建工作线程;
    通过所述工作线程从所述码流队列中获取所述m帧图传码流数据;
    通过所述工作线程对所述m帧图传码流数据进行解码,得到m帧图传画面;
    通过所述工作线程在所述m帧图传画面中的每帧图传画面中添加所述视频播放标准协议对应的视频数据标头,得到m帧目标图传画面;所述目标图传画面符合所述视频播放标准协议;
    通过所述工作线程对所述m帧目标图传画面进行封装,得到所述目标图传数据。
  30. 如权利要求29所述的设备,其特征在于,所述处理器还用于执行如下步骤:
    创建控制线程;
    通过所述控制线程接收所述终端设备发送的传输请求,所述传输请求是当在所述终端设备的用户界面上存在触发操作时所述终端设备产生的;
    通过所述控制线程响应所述传输请求,触发执行所述通过所述工作线程从所述码流队列中获取所述m帧图传码流数据的步骤。
  31. 如权利要求21所述的设备,其特征在于,所述处理器还用于执行如下步骤:
    创建控制线程;
    通过所述控制线程接收所述终端设备发送的属性获取请求;
    通过所述控制线程响应所述属性数据获取请求,将所述图传设备支持的图传数据属性返回至所述终端设备;
    其中,所述图传数据属性包括所述图传数据的帧率或所述图传数据的分辨率。
  32. 如权利要求31所述的设备,其特征在于,所述处理器还用于执行如下步骤:
    通过所述控制线程接收所述终端设备发送的属性设置请求,所述属性设置请求中携带所述终端设备所请求的图传数据的目标图传数据属性;
    通过所述控制线程响应所述属性设置请求,将所述目标图传数据属性对应的目标图传数据传输至所述终端设备。
  33. 如权利要求21所述的设备,其特征在于,所述图传设备包括用于控制所述可移动平台的遥控器、用于与所述可移动平台进行数据交互的地面站、用于传输所述图传数据的图传盒子中的任一个设备。
  34. 一种终端设备,其特征在于,所述终端设备与图传设备通信连接,所述终端设备包括:处理器和存储器,所述存储器和所述处理器相互连接,其中:
    所述存储器,用于存储计算机程序,所述计算机程序包括程序指令;
    所述处理器调用所述程序指令时,用于执行:
    接收所述图传设备发送的目标图传数据,所述目标图传数据是所述图传设备对可移动平台发送的图传数据进行处理后得到的,所述目标图传数据符合视频播放标准协议;
    解析并播放所述目标图传数据。
  35. 如权利要求34所述的设备,其特征在于,所述终端设备通过通用串行总线数据线与所述图传设备通信连接,所述视频播放标准协议包括通用串行总线视频类UVC协议。
  36. 如权利要求35所述的设备,其特征在于,所述图传设备是符合所述视频播放标准协议的设备;所述处理器还用于执行如下步骤:
    向所述图传设备发送描述符获取请求;
    接收所述图传设备返回的用于指示所述图传设备处于UVC模式的描述符,并根据所述描述符识别所述图传设备。
  37. 如权利要求36所述的设备,其特征在于,所述描述符包括配置描述符或设备描述符。
  38. 如权利要求34所述的设备,其特征在于,所述终端设备还包括用户界面,所述终端设备的用户界面中显示有播放选项;所述处理器还用于执行如下步骤:
    响应于对所述播放选项的触发操作,生成传输请求,并向所述图传设备发送所述传输请求,以使所述图传设备响应所述传输请求并对所述图传数据进行处理后发送至所述终端设备。
  39. 如权利要求34所述的设备,其特征在于,所述处理器还用于执行如下步骤:
    向所述图传设备发送属性获取请求;
    接收所述图传设备返回的所述图传设备支持的图传数据属性;
    其中,所述图传数据属性包括所述图传数据的帧率或所述图传数据的分辨率。
  40. 如权利要求39所述的设备,其特征在于,所述处理器在接收所述图传设备发送的目标图传数据时,具体用于执行如下步骤:
    向所述图传设备发送属性设置请求,所述属性设置请求中携带所述终端设备所请求的图传数据的目标图传数据属性;
    接收所述图传设备返回的所述目标图传数据属性对应的所述目标图传数据。
  41. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序在被执行时,实现如权利要求1至13任一项所述的图传数据的处理方法。
  42. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序在被执行时,实现如权利要求14至20任一项所述的图传数据的处理方法。
PCT/CN2020/130078 2020-11-19 2020-11-19 图传数据的处理方法、图传设备、终端设备及存储介质 WO2022104638A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/130078 WO2022104638A1 (zh) 2020-11-19 2020-11-19 图传数据的处理方法、图传设备、终端设备及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/130078 WO2022104638A1 (zh) 2020-11-19 2020-11-19 图传数据的处理方法、图传设备、终端设备及存储介质

Publications (1)

Publication Number Publication Date
WO2022104638A1 true WO2022104638A1 (zh) 2022-05-27

Family

ID=81708138

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/130078 WO2022104638A1 (zh) 2020-11-19 2020-11-19 图传数据的处理方法、图传设备、终端设备及存储介质

Country Status (1)

Country Link
WO (1) WO2022104638A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023240508A1 (zh) * 2022-06-15 2023-12-21 深圳市大疆创新科技有限公司 控制方法、装置、图传设备及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160014442A1 (en) * 2007-12-04 2016-01-14 Vixs Systems, Inc. Dongle device with video encoding and methods for use therewith
CN109327685A (zh) * 2018-11-28 2019-02-12 深圳市看见智能科技有限公司 智能眼镜电路、眼镜及移动监控系统
CN110505441A (zh) * 2018-05-18 2019-11-26 华为技术有限公司 一种可视通信的方法、装置和系统
CN111212258A (zh) * 2016-01-26 2020-05-29 Qsc公司 使用互联网协议的外围总线视频通信

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160014442A1 (en) * 2007-12-04 2016-01-14 Vixs Systems, Inc. Dongle device with video encoding and methods for use therewith
CN111212258A (zh) * 2016-01-26 2020-05-29 Qsc公司 使用互联网协议的外围总线视频通信
CN110505441A (zh) * 2018-05-18 2019-11-26 华为技术有限公司 一种可视通信的方法、装置和系统
CN109327685A (zh) * 2018-11-28 2019-02-12 深圳市看见智能科技有限公司 智能眼镜电路、眼镜及移动监控系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023240508A1 (zh) * 2022-06-15 2023-12-21 深圳市大疆创新科技有限公司 控制方法、装置、图传设备及系统

Similar Documents

Publication Publication Date Title
KR101467430B1 (ko) 클라우드 컴퓨팅 기반 어플리케이션 제공 방법 및 시스템
US9300754B2 (en) Information processing system, information processing apparatus, information processing method, and program
WO2015176648A1 (zh) 将智能终端上的数据传输至电视终端的方法、装置
US11418567B2 (en) Media data transmission method, client, and server
WO2021168649A1 (zh) 多功能接收设备和会议系统
US20220182687A1 (en) Method for providing and method for acquiring immersive media, apparatus, device, and storage medium
KR20150026947A (ko) 디스플레이 포워딩 기능에 대한 호환성 통지를 이용하는 컨텐트 공유 방법 및 연관 디바이스
CN114040232B (zh) 投屏系统、方法、电子设备和存储介质
WO2022104638A1 (zh) 图传数据的处理方法、图传设备、终端设备及存储介质
CN113873279A (zh) 视频数据解码方法、系统和存储介质
CN100446458C (zh) 基于闪联协议的电视机无线上网的实现方法
CN112714341B (zh) 信息获取方法、云化机顶盒系统、实体机顶盒及存储介质
KR101710011B1 (ko) 영상 데이터 전송 및 수신 방법 및 장치
CN111083527A (zh) 应用的视频播放方法、装置、存储介质及电子设备
CN114501091B (zh) 远程驾驶画面的生成方法、装置及电子设备
CN112804471A (zh) 一种视频会议方法、会议终端、服务器及存储介质
CN115865884A (zh) 一种网络摄像头数据访问装置、方法、网络摄像头和介质
CN115278323A (zh) 一种显示设备、智能设备和数据处理方法
WO2021217467A1 (zh) 一种智能摄像头的测试方法及装置
KR20220136068A (ko) 미디어 제공 서버, 트리거 영역을 통해 다른 컨텐츠로 전환하는 방법 및 컴퓨터 프로그램
Ji et al. A smart Android based remote monitoring system
CN106851134B (zh) 传输图像数据的方法、装置及系统
CN115599326A (zh) 信息同屏方法、发送端、接收端及计算机可读存储介质
CN107094266A (zh) 音视频资源共享的方法、装置、系统及网络网关
US9544350B2 (en) RUI system, RUI server, RUI terminal apparatus and controlling method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20961929

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20961929

Country of ref document: EP

Kind code of ref document: A1