WO2023272702A1 - Procédé et appareil de transmission de données pour miracast, dispositif et support de stockage - Google Patents

Procédé et appareil de transmission de données pour miracast, dispositif et support de stockage Download PDF

Info

Publication number
WO2023272702A1
WO2023272702A1 PCT/CN2021/104106 CN2021104106W WO2023272702A1 WO 2023272702 A1 WO2023272702 A1 WO 2023272702A1 CN 2021104106 W CN2021104106 W CN 2021104106W WO 2023272702 A1 WO2023272702 A1 WO 2023272702A1
Authority
WO
WIPO (PCT)
Prior art keywords
quic
wfd
receiving end
receiving
protocol
Prior art date
Application number
PCT/CN2021/104106
Other languages
English (en)
Chinese (zh)
Inventor
岳培锋
许天国
卢刘明
刘飞
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to CN202180096103.0A priority Critical patent/CN117083867A/zh
Priority to PCT/CN2021/104106 priority patent/WO2023272702A1/fr
Publication of WO2023272702A1 publication Critical patent/WO2023272702A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless

Definitions

  • the present application relates to the field of mobile communication, and in particular to a data transmission method, device, equipment and storage medium for wireless screen projection.
  • WFD Wi-Fi Display, Wireless Fidelity Display
  • Wi-Fi Direct Wi-Fi Direct
  • the WFD device discovers the other party's WFD device through Wi-Fi Direct (Wi-Fi Direct), then establishes a connection, and transmits audio and video data through Wi-Fi.
  • Wi-Fi Direct Wi-Fi Direct
  • the WFD device that sends audio and video data is called the source (Source)
  • the WFD device that receives audio and video data is called the sink (Sink).
  • TCP Transmission Control Protocol
  • UDP User Datagram Protocol
  • RTSP Real Time Streaming Protocol, real-time streaming protocol
  • RTP Real Time Streaming Protocol
  • the rate of data transmission by TCP is relatively slow and the efficiency is low; the security and reliability of data transmission by UDP are relatively low.
  • Embodiments of the present application provide a data transmission method, device, device, and storage medium for wireless screen projection, which can improve data transmission efficiency on the premise of ensuring the security and reliability of wireless screen projection transmission. Described technical scheme is as follows:
  • a data transmission method for wireless screen projection is provided, which is applied to a wireless fidelity display (WFD) source end for wireless screen projection (Miracast) transmission, and the method includes:
  • a data transmission method for wireless screen projection is provided, which is applied to a wireless fidelity display (WFD) source end for wireless screen projection (Miracast) transmission, and the method includes:
  • At least one of the audio data and video data transmitted by the wireless screen projection transmission is sent to the WFD receiving end through the third QUIC stream.
  • a data transmission method for wireless screen projection is provided, which is applied to a wireless fidelity display (WFD) receiving end for wireless screen projection (Miracast) transmission, and the method includes:
  • the first QUIC flow is created by the WFD source based on the QUIC connection;
  • a data transmission method for wireless screen projection is provided, which is applied to a wireless fidelity display (WFD) receiving end for wireless screen projection (Miracast) transmission, and the method includes:
  • the third QUIC stream is based on the QUIC connection of the WFD source Created.
  • a data transmission device for wireless screen projection which is used to realize a wireless fidelity display (WFD) source end for wireless screen projection (Miracast) transmission, and the device includes:
  • the first QUIC module is used to establish a QUIC connection with the WFD receiving end;
  • the first QUIC module is configured to create a first QUIC stream based on the QUIC connection, and perform RTSP negotiation with the WFD receiving end through the first QUIC stream to create an RTSP session;
  • the first QUIC module is configured to create a second QUIC stream based on the QUIC connection in response to receiving the play request sent by the WFD receiving end through the RTSP session, and send it to the WFD receiving end through the second QUIC stream At least one of audio data and video data transmitted by the wireless screen projection.
  • a data transmission device for wireless screen projection which is used to realize a wireless fidelity display (WFD) source end for wireless screen projection (Miracast) transmission, and the device includes:
  • the first TCP module is used to perform RTSP negotiation with the WFD receiving end through the TCP protocol to create an RTSP session;
  • a first QUIC module configured to establish a QUIC connection with the WFD receiving end, and create a third QUIC stream based on the QUIC connection;
  • the first QUIC module is configured to send the audio data and video transmitted by the wireless screen projection to the WFD receiving end through the third QUIC stream in response to receiving the play request sent by the WFD receiving end through the RSTP session at least one of the data.
  • a data transmission device for wireless projection which is used to realize a wireless fidelity display (WFD) receiving end for wireless projection (Miracast) transmission, and the device includes:
  • the second QUIC module is used to establish a QUIC connection with the WFD source
  • the second QUIC module is used to perform RTSP negotiation with the WFD source end through the first QUIC flow to create an RTSP session, and the first QUIC flow is created by the WFD source end based on the QUIC connection;
  • the second QUIC module is used to send a playback request to the WFD source through the RTSP session;
  • the second QUIC module is configured to receive at least one of the audio data and video data transmitted by the wireless projection screen sent by the WFD source through a second QUIC stream, the second QUIC stream is the WFD source Created based on the QUIC connection.
  • a data transmission device for wireless projection which is used to realize a wireless fidelity display (WFD) receiving end for wireless projection (Miracast) transmission, and the device includes:
  • the second TCP module is used to carry out RTSP negotiation with the WFD source end through the TCP protocol to create an RTSP session;
  • the second QUIC module is used to establish a QUIC connection with the WFD source
  • the second TCP module is used to send a playback request to the WFD source through the RTSP session;
  • the second QUIC module is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through a third QUIC stream, the third QUIC stream is the WFD
  • the origin is created based on the QUIC connection.
  • a terminal device includes: a processor and a transceiver connected to the processor; wherein,
  • the transceiver is used to establish a QUIC connection with the WFD receiving end;
  • the processor is configured to create a first QUIC stream based on the QUIC connection, and perform RTSP negotiation with the WFD receiving end through the first QUIC stream to create an RTSP session;
  • the processor is configured to create a second QUIC stream based on the QUIC connection in response to receiving the play request sent by the WFD receiver through the RTSP session;
  • the transceiver is configured to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the second QUIC stream.
  • a terminal device includes: a processor and a transceiver connected to the processor; wherein,
  • the transceiver is used to carry out RTSP negotiation with the WFD receiving end through the TCP protocol to create an RTSP session;
  • the transceiver is configured to establish a QUIC connection with the WFD receiving end
  • the processor is configured to create a third QUIC stream based on the QUIC connection
  • the transceiver is configured to send the audio data and video transmitted by the wireless screen projection to the WFD receiving end through the third QUIC stream in response to receiving the play request sent by the WFD receiving end through the RSTP session at least one of the data.
  • a terminal device includes: a processor and a transceiver connected to the processor; wherein,
  • the transceiver is used to establish a QUIC connection with the WFD source
  • the transceiver is configured to perform RTSP negotiation with the WFD source end through a first QUIC flow to create an RTSP session, and the first QUIC flow is created by the WFD source end based on the QUIC connection;
  • the transceiver is configured to send a playback request to the WFD source through the RTSP session;
  • the transceiver is configured to receive at least one of the audio data and video data transmitted by the wireless projection screen sent by the WFD source through a second QUIC stream, the second QUIC stream is the WFD source Created based on the QUIC connection.
  • a terminal device includes: a processor and a transceiver connected to the processor; wherein,
  • the transceiver is used to carry out RTSP negotiation with the WFD source end through the TCP protocol to create an RTSP session;
  • the transceiver is configured to establish a QUIC connection with the WFD source
  • the transceiver is configured to send a playback request to the WFD source through the RTSP session;
  • the transceiver is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through a third QUIC stream, the third QUIC stream being the WFD
  • the origin is created based on the QUIC connection.
  • a computer-readable storage medium wherein executable instructions are stored in the readable storage medium, and the executable instructions are loaded and executed by a processor to implement the use described in the above aspect.
  • Data transmission method for wireless screen projection is provided, wherein executable instructions are stored in the readable storage medium, and the executable instructions are loaded and executed by a processor to implement the use described in the above aspect.
  • a chip the chip includes a programmable logic circuit and/or program instructions, and when the chip is run on a computer device, it is used to implement the method described in the above aspect A data transmission method for wireless screen projection.
  • a computer program product is provided.
  • the computer program product When the computer program product is run on a processor of a computer device, the computer device executes the data transmission method for wireless screen projection described in the above aspects.
  • the audio and video data transmission of the wireless projection screen transmission is carried out through the QUIC protocol, while ensuring the stability of the connection and transmission between the source and the receiver, reducing dropped calls and freezes, reducing transmission time, and improving transmission efficiency. .
  • FIG. 1 is a schematic diagram of a system architecture provided by an exemplary embodiment of the present application
  • Fig. 2 is a flow chart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application
  • Fig. 3 is a flow chart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application
  • Fig. 4 is a flow chart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application
  • FIG. 5 is a schematic diagram of a Miracast architecture for a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application
  • Fig. 6 is a flow chart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 7 is a schematic diagram of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 8 is a schematic diagram of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • FIG. 9 is a flow chart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • FIG. 10 is a flow chart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 11 is a flow chart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 12 is a flowchart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 13 is a flowchart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 14 is a flowchart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 15 is a flowchart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 16 is a flowchart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 17 is a flowchart of a data transmission method for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 18 is a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 19 is a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 20 is a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 21 is a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • Fig. 22 is a schematic structural diagram of a communication device provided by an exemplary embodiment of the present application.
  • first, second, third, etc. may be used in the present disclosure to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the present disclosure, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word “if” as used herein may be interpreted as “at” or “when” or “in response to a determination.”
  • WDF Wi-Fi Display, Wireless Fidelity Display
  • Wi-Fi Alliance Wi-Fi Alliance
  • Wireless display standard electronic products supporting this standard can share pictures, audio and video and other pictures wirelessly.
  • Mobile phone/mobile PC Personal Computer, personal computer
  • TV/monitor will be able to realize wireless connection.
  • WFD is a wireless projection technology based on Wi-Fi technology. First discover the other device through Wi-Fi Direct, then establish a connection, and transmit audio and video data through Wi-Fi.
  • Miracast wireless screen projection
  • Wi-Fi Alliance Wi-Fi Alliance's certification name for devices that support the Wi-Fi Display function.
  • Devices certified by Miracast will maintain support and compatibility with the Wi-Fi Display function to the greatest extent.
  • TCP It is a connection-oriented, reliable, byte stream-based transport layer communication protocol, defined by RFC (Request For Comments, draft for comments) 793 of IETF (The Internet Engineering Task Force, Internet Engineering Task Force) .
  • UDP It is a connectionless transport layer protocol in the OSI (Open System Interconnection) reference model, providing transaction-oriented simple and unreliable information transmission services.
  • IETF RFC 768 is the official specification of UDP.
  • the UDP protocol like the TCP protocol, is used to process data packets. In the OSI model, both are located at the transport layer, which is the upper layer of the IP (Internet Protocol, Internet Protocol) protocol.
  • IP Internet Protocol, Internet Protocol
  • UDP has the disadvantages of not providing data packet grouping, assembling and sorting of data packets, that is to say, after the message is sent, it is impossible to know whether it has arrived safely and completely.
  • UDP is used to support network applications that need to transfer data between computers. Numerous client/server network applications, including network video conferencing systems, need to use the UDP protocol.
  • QUIC Quick UDP Internet Connection, Fast UDP Internet Connection
  • TCP/IP protocol family is the foundation of the Internet.
  • the transport layer protocols include TCP and UDP protocols. Compared with the TCP protocol, UDP is lighter, but has much fewer error checks. This means that UDP tends to be more efficient (doesn't communicate with the server frequently to see if packets are delivered or in order), but is not as reliable as TCP.
  • applications such as games, streaming media, and VoIP use UDP, while most applications such as web pages, emails, and remote logins use TCP.
  • QUIC is a good solution to the various needs faced by the transport layer and application layer today, including handling more connections, security, and low latency.
  • QUIC integrates the features of protocols including TCP, TLS (Transport Layer Security), HTTP/2 (Hypertext Transfer Protocol/2, version 2 of Hypertext Transfer Protocol), but is based on UDP transmission.
  • TCP Transmission Control Protocol
  • TLS Transport Layer Security
  • HTTP/2 Hypertext Transfer Protocol/2, version 2 of Hypertext Transfer Protocol
  • One of the main goals of QUIC is to reduce the connection delay.
  • 1RTT Red-Trip Time, round-trip time
  • the client can cache the encrypted authentication information locally, and realize a 0-RTT connection establishment delay when establishing a connection with the server again.
  • QUIC also multiplexes the multiplexing function (Multiplexing) of the HTTP/2 protocol, but because QUIC is based on UDP, it avoids the Head-of-Line Blocking problem of HTTP/2. Because QUIC is based on UDP and runs in the user domain instead of the system kernel, the QUIC protocol can be updated and deployed quickly, thus solving the difficulty of deploying and updating the TCP protocol.
  • RTSP Real Time Streaming Protocol, real-time streaming protocol
  • RFC 2326 an application layer protocol in the TCP/IP protocol system
  • the protocol defines how one-to-many applications can efficiently transmit multimedia data over IP networks.
  • RTSP is structurally located on top of RTP (Real-time Transport Protocol, Real-time Transport Protocol) and RTCP (RTP Control Protocol, RTP Control Protocol), which uses TCP or UDP to complete data transmission.
  • HTTP requests are sent by the client and the server responds; when using RTSP, both the client and the server can send requests, that is, RTSP can be bidirectional.
  • RTSP is a multimedia streaming protocol used to control audio or video, and allows multiple simultaneous streaming requirements to be controlled.
  • the network communication protocol used for transmission is not within the scope of its definition.
  • the server can choose to use TCP or UDP to transmit the stream.
  • Streaming content, its syntax and operation are similar to HTTP 1.1, but it does not particularly emphasize time synchronization, so it is more tolerant to network delays.
  • the aforementioned Multicast allows multiple streams at the same time, in addition to reducing the network usage of the server, it also supports multi-party video conferencing (Video Conference).
  • the cache function ⁇ Cache> of the proxy server ⁇ Proxy> is also applicable to RTSP, and because RTSP has a redirection function, the server that provides the service can be switched according to the actual load situation, so as to Avoid excessive load concentration on the same server and cause delays.
  • RTP It is a network transmission protocol, which was announced in RFC 1889 by the Multimedia Transmission Working Group of IETF in 1996.
  • the International Telecommunication Union ITU-T also released its own RTP document as H.225.0, but it was later canceled when the IETF published a stable standard RFC about it. It is specified as an Internet standard in RFC 3550 (the older version of this document is RFC 1889).
  • RFC 3551 (STD 65, older version was RFC 1890) details audio and video conferencing using minimal controls.
  • the RTP protocol specifies a standard packet format for delivering audio and video over the Internet. It was originally designed as a multicast protocol, but has since been used in many unicast applications.
  • the RTP protocol is often used in streaming media systems (with the RTSP protocol), video conferencing and push to talk (Push to Talk) systems (with H.323 or SIP (Session Initiation Protocol, Session Initiation Protocol)), making it a standard in the IP telephony industry technical foundation.
  • the RTP protocol is used together with the RTP Control Protocol (RTCP), and it is built on top of the UDP protocol.
  • P2P Peer to Peer, peer-to-peer network
  • Peer-to-peer computer network is a distributed application architecture that distributes tasks and workloads among peers (Peer), and is formed by the peer-to-peer computing model at the application layer A form of networking or networking.
  • Peer has the meaning of "peer, partner, peer” in English. Therefore, literally, P2P can be understood as peer-to-peer computing or peer-to-peer network.
  • Peer-to-peer networking or Peer-to-peer computing can be defined as For: network participants share some of their hardware resources (processing capacity, storage capacity, network connection capacity, printers, etc.), these shared resources provide services and content through the network, and can be directly accessed by other peer nodes (Peer) without going through an intermediate entity. Participants in this network are not only providers of resources, services and content (Server, or “server”), but also acquirers of resources, services and content (Client, or "client”).
  • a wireless AP is a bridge between a wireless network and a wired network, and is the core device for building a wireless local area network (WLAN). It mainly provides mutual access between wireless workstations and wired LANs, so that wireless workstations within the coverage of the AP signal can communicate with each other through it. Without APs, it is basically impossible to build a truly accessible Internet.
  • WLAN Wireless Local Area Network
  • An AP in a WLAN is equivalent to the role of a transmitting base station in a mobile communication network.
  • an AP is equivalent to a hub of a wired network. It can connect various wireless clients.
  • the network card used by the wireless client is a wireless network card, and the transmission medium is air (electromagnetic waves).
  • AP is an indispensable device in the basic mode of wireless local area network.
  • wireless network card without using AP can form a wireless local area network in point-to-point mode, but such a wireless local area network is somewhat special, and it is only suitable for temporary wireless connections .
  • a wireless AP is a communication bridge between a wireless network and a wired network.
  • the wireless AP Since the coverage of the wireless AP is a circular area that spreads out, the wireless AP should be placed in the center of the wireless network as much as possible, and the straight-line distance between each wireless client and the wireless AP should not exceed 30 meters. Avoid communication failure caused by excessive communication signal attenuation.
  • Fig. 1 shows a block diagram of a wireless screen projection system provided by an exemplary embodiment of the present application.
  • the wireless screen projection system may include a source end 101 and a receiver end 102 .
  • the source terminal 101 transmits the audio and video data to the receiving terminal 102, and the receiving terminal 102 displays or plays them.
  • the audio and video data mentioned in the embodiments of the present application include: at least one of audio data and video data.
  • the source end 101 may also be called a WFD source end, a source device, a Source end or a QUIC client (Client).
  • the source end 101 is a computer device, for example, the source end 101 may be at least one of a mobile phone, a computer, a tablet computer, a notebook computer, a TV, and an intelligent robot.
  • the receiving end 102 may also be called a WFD receiving end, a receiving device, a Sink end or a QUIC server (Sever).
  • the receiving end 102 is a computer device, for example, the receiving end 102 may be at least one of a mobile phone, a computer, a tablet computer, a notebook computer, a TV, a projector, and an intelligent robot.
  • the source end 101 and the sink end 102 establish a data link connection through P2P or AP.
  • FIG. 2 shows a flowchart of a data transmission method for wireless screen projection provided by an embodiment of the present application, and the method can be applied to the system architecture shown in FIG. 1 .
  • the method includes the following steps.
  • step 201 the source end establishes a QUIC connection with the receiver end.
  • the source end and the receiving end establish a data link connection by means of P2P; or, the source end and the receiving end establish a data link connection by means of an AP.
  • FIG. 3 a flow chart of a method for establishing a data link connection between a source end and a receiving end is provided, and the method includes steps 2001 to 2005:
  • Step 2001 the source end receives a user command (User command).
  • Step 2002 the source end and the receiver end perform Miracast Device Discovery.
  • Step 2003 the source end and the receiver end perform Miracast Service Discovery (oprional) (optional).
  • Step 2004 the source end and the receiver end perform wireless projection screen connection setup (Miracast Connection Setup).
  • Step 2005 the source end and the receiver end perform wireless direct connection or option setup (Wi-Fi Direct or option Setup).
  • step 201 includes steps 2011 to 2016:
  • the source initiates a QUIC connection, and negotiates a secret key with the receiver to establish a QUIC connection.
  • 1RTT is required to obtain relevant information to complete the handshake.
  • CHLO inchoate
  • Client Hello packet client Hello packet
  • Step 2012 the receiving end sends a REJ packet to the source end after receiving the CHLO, and the REJ packet contains information required by the source end, for example, token (token) and server (service) certificate.
  • token token
  • server service
  • Step 2013, the source end sends a complete CHLO packet to the receiver end, and the complete CHLO packet includes the token and certificate of the source end.
  • Step 2014 the source end sends an encryption request to the receiver end.
  • Step 2015 the receiving end sends a SHLO packet (or "Service Hello packet (server Hello packet)", "SHLO” for short) to the source end, and the SHLO packet includes the token and certificate of the receiving end.
  • SHLO packet or "Service Hello packet (server Hello packet)", "SHLO” for short
  • Step 2016, the receiver sends an encrypted response to the source.
  • step 202 the source end creates a first QUIC stream based on the QUIC connection, and the source end and the receiver end perform RTSP negotiation through the first QUIC stream to create an RTSP session.
  • the source and the receiver After the QUIC connection is established, the source and the receiver perform RTSP negotiation and RTSP session creation through the QUIC protocol.
  • the source creates the first QUIC stream, and performs RTSP negotiation with the receiving end through the first QUIC stream to create an RTSP session; the receiving end performs RTSP negotiation with the source through the first QUIC stream to create an RTSP session, and the first QUIC stream is the source created by the end.
  • the RTSP message field of the RTSP negotiation includes the QUIC protocol field.
  • a module of the QUIC protocol 103 is added to the transport layer in the standard Miracast architecture.
  • the RTP negotiation message field is increased from ("RTP/AVP/UDP; unicast;"/"RTP/AVP/TCP; unicast;”) in the original Miracast standard to ("RTP/AVP/UDP; unicast;"/ "RTP/AVP/TCP;unicast;"/"RTP/AVP/QUIC;unicast;”).
  • the source creates a first QUIC stream (QUIC stream1), and completes the process of performing RTSP negotiation as shown in Figure 6 to create an RTSP session through the first QUIC stream.
  • step 202 includes steps 2021 to 2026 .
  • Step 2021 the source and the receiver transmit RTSP M1Messages (RSTP M1 messages).
  • the source initiates an RTSP OPTIONS M1 command to confirm the RTSP method request supported by the receiver.
  • the Request (request) and Response (response) of the M1 command are as follows:
  • Step 2022 the source and the receiver transmit RTSP M2Messages.
  • the receiving end After the receiving end replies to the M1 command, the receiving end initiates an RTSP OPTIONS M2 command to confirm the RTSP method request supported by the source end.
  • the Request and Response of the M2 command are as follows:
  • Step 2023 the source end and the receiver end transmit RTSP M3Messages.
  • the source end After the source end replies to the M2 command, the source end will initiate the GET_PARAMETER M3 (obtain parameter M3) command to query the attributes and capabilities of the receiving end.
  • the list of attributes to be queried is at the end of the request.
  • the Request and Response of the M3 command are as follows:
  • the receiving end replies with the M3 command, notifying the source end of the attributes and capabilities it supports.
  • the more important attributes include: the RTP port number wfd_client_rtp_ports used to transmit streaming media; the supported audio (audio) and video (video) codec formats wfd_audio_codecs, wfd_video_formats, etc.
  • wfd_audio_codecs LPCM 00000002 00,AAC 00000001 00 ⁇ r ⁇ n
  • wfd_client_rtp_ports:RTP/AVP/QUIC can be understood as setting the RTP session in wfd_client_rtp_ports
  • the transport layer protocol is the QUIC protocol.
  • Step 2024 the source and the receiver transmit RTSP M4Messages.
  • the source end will initiate the SET_PARAMETER M4 (set parameter M4) command to finally set the best parameter set in this RTSP session (the codec type supported by both the sending and receiving parties, etc.).
  • the Request and Response of the M4 command are as follows:
  • wfd_client_rtp_ports:RTP/AVP/QUIC can be understood as setting the RTP session in wfd_client_rtp_ports
  • the transport layer protocol is the QUIC protocol.
  • Step 2025 the source and the receiver transmit RTSP M5Messages.
  • the source end initiates a SET_PARAMETER M5 (setting parameter M5) request, and the wfd_trigger_method parameter triggers the receiving end to send SETUP (establishment), PLAY (play), PAUSE (pause), TEARDOWN (disconnect) and other requests to the source end.
  • the SETUP trigger request is set in the following M5Request.
  • the receiving end replies normally, indicating that it has received the SETUP trigger request.
  • Step 2026 the source end and the receiver end transmit RTSP M6Messages.
  • the receiver should actively send the SETUP M6 request at this time:
  • Transport:RTP/AVP/QUIC can be understood as setting the transport layer protocol of the RTP session in Transport as QUIC protocol.
  • the source will complete the creation of the RTSP session and return the Session ID (session identifier):
  • Step 203 the receiver sends a play request to the source through the RTSP session.
  • step 203 includes step 2031 .
  • step 2031 is executed, and the receiving end sends a playback request to the source end through the RTSP session.
  • Step 2031 the source end and the receiver end transmit RTSP M7Messages.
  • the receiving end will send a PLAY M7 (play M7) request to notify the source end to start sending streaming media data.
  • the Request and Response of the M7 command are as follows:
  • Step 204 the source end responds to receiving the playback request sent by the receiving end through the RTSP session, and creates a second QUIC stream based on the QUIC connection; the source end and the receiving end transmit the audio data and video transmitted by wireless projection through the second QUIC stream at least one of the data.
  • the source and receiver transmit AV TS (audio and video data stream).
  • the RTSP negotiation between the source end and the receiver end and the creation process of the RTSP session are completed.
  • the source creates quic stream 2 (the second QUIC stream) to send an RTP packet to the receiver, and the RTP packet contains audio and video data.
  • the source end packs at least one of the audio data and video data transmitted by the wireless screen projection into a QUIC packet; sends the QUIC packet to the receiving end through the second QUIC stream, and the QUIC packet includes at least one of the audio data and the video data kind.
  • the source end passes Video content (video content) 501, Game content (game content) 502, UI Content (interface content) 503 to display surface (display plane) 505 through Compoistion (rendering) module 504; It is 2 roads: one road is displayed on the LCD (main screen) 507 through the display controller (display control) module 506; the other road is the Miracast data path, and the Display capture (screen capture) module 508 obtains the display information on the screen and then passes Encode (encoding) module 509 after outputting the bit (bit) stream 510 after video encoding to MPEG (Moving Picture Experts Group, moving picture experts group)-2TS (Transport Stream, transport stream) mux (multiplexing) module 513, PCM (Pulse Code Modulation, pulse code modulation) audio (audio) 511 is packed 512 with MPEG-2 and is input to MPEG-2TS mux module 513.
  • MPEG Motion Picture Experts Group, moving picture experts group
  • -2TS Transport Stream, transport stream
  • Audio and video data flow enters RTP transport (RTP transmission) module 514 to be packaged into RTP package after being packaged into TS flow, and RTP package is packaged into QUIC package through QUIC transport (QUIC transmission) module 515, then QUIC package is sent to Receiving end.
  • RTP transport RTP transmission
  • QUIC transport QUIC transmission
  • both the source end 101 and the receiving end 102 integrate the QUIC protocol 103 module, wherein the QUIC protocol 103 module packs and receives RTSP 402 and RTP 403 data as quic packets; RTSP 402 and RTP 403 data pass the UDP protocol for encapsulation.
  • the source end switches the connection mode of the data link with the receiving end; in response to the successful switching, continues to send at least one of audio data and video data transmitted by wireless screen projection to the receiving end through the second QUIC stream.
  • the source initiates a QUIC connection to the receiving end, including initial connection and reconnection; the receiving end monitors the connection request of the source end and establishes a connection with it, and can send data to the source end; a QUIC session identifier (ID ), the source can reconnect to the network within the keep-alive timeout of the QUIC session identifier when switching the access point.
  • ID QUIC session identifier
  • the method provided in this embodiment by adding the QUIC protocol in the transport layer, transmits the audio and video data for wireless screen projection transmission through the QUIC protocol, and at the same time ensures the stability of the connection and transmission between the source end and the receiving end, reducing the Lines and freezes, reducing transmission time and improving transmission efficiency.
  • the method shown in FIG. 2 may be implemented as an exemplary embodiment shown in FIG. 9 .
  • FIG. 9 shows a flowchart of a data transmission method for wireless screen projection provided by an embodiment of the present application, and the method can be applied to the system architecture shown in FIG. 1 .
  • the user issues a wireless screen projection command
  • the source and receiver respond to the wireless screen projection command, execute steps 2001 to 2005 as shown in Figure 3, and establish a data link between the source and the receiver through P2P or AP. Connection.
  • the source end and the receiving end perform steps 2011 to 2016 as shown in FIG. 4 to establish a QUIC connection between the source end and the receiving end.
  • the source end and the receiving end execute steps 2021 to 2026 shown in FIG. 6 through the first QUIC flow, and perform RSTP negotiation to create an RSTP session.
  • the source end and the receiving end execute step 2031 shown in FIG. 6 through the first QUIC flow to trigger the transmission of audio and video data streams.
  • step 2041 is executed, and the source end transmits the audio and video data stream to the receiving end through the second QUIC stream.
  • step 205 may also be executed to transmit an RSTP control instruction through the first QUIC stream to control wireless screen projection.
  • the RSTP control instructions include at least one of M5 instructions, M7 instructions, M8 instructions, M9 instructions, and M10 instructions.
  • miracast R2 dynamic RTP transmission is partially supported to switch between UDP and TCP. Based on this, the embodiment of the present application also provides a method for switching between UDP, TCP, and QUIC protocols.
  • Switch to TCP may be called M8 instruction).
  • Step 205 includes step 2051 to step 2054 .
  • Step 2051 In response to receiving the first user switching instruction, the source end sends a first RSTP parameter setting instruction to the receiving end.
  • the first user switching instruction is used to switch the transmission protocol to the TCP protocol.
  • step 501 is included before step 2051, and the source end transmits at least one of the audio data and video data (audio and video data streams) of the wireless screen projection through the QUIC stream ).
  • step 502 to step 503 are executed.
  • Step 502 the source end sends a request for an RSTP M4 instruction (the first RSTP parameter setting instruction) to the receiving end.
  • the user When using the QUIC protocol for wireless screen projection, the user sends the first user switching command to the source, and the RTSP M4Messages are initiated by the source with the SET_PARAMETER M4 command to switch the transmission protocol to TCP.
  • Step 503 the receiver sends a response to the RSTPM4 command to the source.
  • Step 2052 the receiving end sends a first creation request to the source end in response to receiving the first RSTP parameter setting instruction sent by the source end.
  • the first creation request is used to request to modify the transmission protocol of the RSTP session to the TCP protocol.
  • step 2052 includes step 504 .
  • Step 504 the receiving end sends a request for the RSTP M6 command (the first creation request) to the source end.
  • the receiver actively sends a SETUP M6 request:
  • Step 2053 the source end switches the transmission protocol to the TCP protocol in response to receiving the first creation request sent by the receiving end.
  • step 2053 includes step 505 .
  • Step 505 the source sends a response to the RSTP M6 command to the receiver.
  • the source end will complete the switching of the TCP protocol, and then respond to the M6 request of the receiving end:
  • Step 2054 the source end and the receiver end transmit at least one of audio data and video data transmitted by wireless screen projection through the TCP protocol.
  • step 2054 includes step 506 .
  • Step 506 the source end sends the audio and video data stream to the receiving end through the TCP stream. At this time, the RTP transmission completes the switching of the TCP protocol.
  • Step 205 includes step 2055 to step 2058 .
  • Step 2055 In response to receiving the second user switching instruction, the source end sends a second RSTP parameter setting instruction to the receiving end.
  • the second user switching instruction is used to switch the transmission protocol to the UDP protocol.
  • step 601 is included before step 2055, the source end transmits at least one of the audio data and video data (audio and video data streams) of the wireless screen projection through the TCP stream ).
  • Step 602 the source end sends a request for an RSTP M4 instruction (the second RSTP parameter setting instruction) to the receiving end.
  • the user When using the TCP protocol for wireless screen projection, the user sends a second user switch command to the source, and the RTSP M4Messages are initiated by the source with the SET_PARAMETER M4 command to switch the transmission protocol to UDP.
  • Step 603 the receiver sends a response to the RSTP M4 command to the source.
  • Step 2056 the receiving end sends a second creation request to the source end in response to receiving the second RSTP parameter setting instruction sent by the source end.
  • the second creation request is used to request to modify the transmission protocol of the RSTP session to the UDP protocol.
  • step 2056 includes step 604 .
  • Step 604 the receiving end sends a request for the RSTP M6 command (the second creation request) to the source end.
  • the receiver actively sends a SETUP M6 request:
  • Step 2057 the source end switches the transmission protocol to the UDP protocol in response to receiving the second creation request sent by the receiving end.
  • step 2057 includes step 605 .
  • the source sends a response to the RSTP M6 command to the receiver.
  • the source end will complete the switching of the UDP protocol, and then respond to the M6 request of the receiving end:
  • Step 2058 the source end and the receiver end transmit at least one of audio data and video data transmitted by wireless screen projection through the UDP protocol.
  • step 2058 includes step 606 .
  • Step 606 the source end sends the audio and video data stream to the receiving end through the UDP stream. At this time, the RTP transmission completes the switching of the UDP protocol.
  • Switch to QUIC may be called M10 instruction).
  • Step 205 includes step 2059 to step 2062 .
  • Step 2059 In response to receiving the third user switching instruction, the source end sends a third RSTP parameter setting instruction to the receiving end.
  • the third user switching instruction is used to switch the transmission protocol to the QUIC protocol.
  • step 701 is included before step 2059, the source end transmits at least one of the audio data and video data (audio and video data streams) of the wireless screen projection through UDP stream ).
  • Step 702 the source end sends a request for the RSTP M4 instruction (the third RSTP parameter setting instruction) to the receiving end.
  • the user When using the UDP protocol for wireless screen projection, the user sends a third user switching command to the source, and the RTSP M4Messages are initiated by the source with the SET_PARAMETER M4 command to switch the transmission protocol to QUIC.
  • Step 703 the receiver sends a response to the RSTP M4 command to the source.
  • Step 2060 the receiving end sends a third creation request to the source end in response to receiving the third RSTP parameter setting instruction sent by the source end.
  • the third creation request is used to request to modify the transmission protocol of the RSTP session to the QUIC protocol.
  • step 2060 includes step 704 .
  • Step 704 the receiving end sends a request for the RSTP M6 command (the third creation request) to the source end.
  • the receiver actively sends a SETUP M6 request:
  • Step 2061 the source end switches the transmission protocol to the QUIC protocol in response to receiving the third creation request sent by the receiving end.
  • step 2061 includes step 705 .
  • Step 705 the source sends a response to the RSTP M6 command to the receiver.
  • the source end will complete the switching of the QUIC protocol, and then respond to the M6 request of the receiving end:
  • Step 2062 the source end and the receiver end transmit at least one of audio data and video data transmitted by wireless screen projection through the QUIC protocol.
  • step 2062 includes step 706 .
  • Step 706 the source end sends the audio and video data stream to the receiving end through the QUIC stream.
  • the RTP transmission completes the switching of the QUIC protocol.
  • any switch among TCP, UDP, and QUIC can be realized by using the above method.
  • the above-mentioned embodiments shown in Figure 11, Figure 13, and Figure 15 are only illustrated by switching from QUIC to TCP, from TCP to UDP, and from UDP to QUIC. Based on the same method, switching from UDP to QUIC can also be realized.
  • FIG. 16 shows a flowchart of a data transmission method for wireless screen projection provided by an embodiment of the present application, and the method can be applied to the system architecture shown in FIG. 1 .
  • the method includes the following steps.
  • step 301 the source end and the receiver end conduct RTSP negotiation through the TCP protocol to create an RTSP session.
  • the source end and the receiving end establish a data link connection through P2P; or, the source end and the receiving end establish a data link connection through AP.
  • connection method of the data link reference may be made to the above description of the exemplary embodiment shown in FIG. 3 .
  • the source performs RTSP negotiation with the receiving end through the TCP protocol to create an RTSP session; the receiving end performs RTSP negotiation with the source end through the TCP protocol to create an RTSP session.
  • the RTSP message field of the RTSP negotiation includes the QUIC protocol field.
  • a module of the QUIC protocol 103 is added to the transport layer in the standard Miracast architecture.
  • the RTP negotiation message field is increased from ("RTP/AVP/UDP; unicast;"/"RTP/AVP/TCP; unicast;”) in the original Miracast standard to ("RTP/AVP/UDP; unicast;"/ "RTP/AVP/TCP;unicast;"/"RTP/AVP/QUIC;unicast;”).
  • Step 301 includes: executing steps 2021 to 2026 through the TCP protocol.
  • the explanation of step 2021 to step 2026 can refer to the above.
  • step 2021 to step 2026 After the above-mentioned instruction interaction from step 2021 to step 2026, the RTSP negotiation and the establishment of the RTSP session are completed.
  • Step 302 the source end establishes a QUIC connection with the receiver end.
  • step 302 is performed before step 203, and the order of step 302 and step 301 may be arbitrary, for example, step 302 may be performed first, and then step 301 may be performed.
  • the sequence of step 302 and steps 2021 to 2026 may be arbitrary, for example, step 302 may be performed after any of steps 2021 to 2026 .
  • step 302 includes steps 2011 to 2016 : the explanation of steps 2011 to 2016 can refer to the above.
  • Step 303 the source creates a third QUIC stream based on the QUIC connection.
  • the source creates a third QUIC stream for transmitting RTP data.
  • Step 304 the receiver sends a play request to the source through the RTSP session.
  • step 304 includes step 2031 .
  • step 2031 is executed, and the receiving end sends a playback request to the source end through the RTSP session.
  • Step 2031 the source end and the receiver end transmit RTSP M7Messages.
  • the explanation of step 2031 can refer to the above.
  • step 305 the source end receives at least one of audio data and video data transmitted by wireless screen projection through the third QUIC stream in response to receiving the play request sent by the receiver through the RTSP session.
  • the source and receiver transmit AV TS (audio and video data stream).
  • the source end packs at least one of the audio data and video data transmitted by the wireless screen projection into a QUIC packet; sends the QUIC packet to the receiving end through the second QUIC stream, and the QUIC packet includes at least one of the audio data and the video data kind.
  • the source end passes Video content (video content) 501, Game content (game content) 502, UI Content (interface content) 503 to display surface (display plane) 505 through Compoistion (rendering) module 504; It is 2 roads: one road is displayed on the LCD (main screen) 507 through the display controller (display control) module 506; the other road is the Miracast data path, and the Display capture (screen capture) module 508 obtains the display information on the screen and then passes Encode (encoding) module 509 after outputting the bit (bit) stream 510 after video encoding to MPEG (Moving Picture Experts Group, moving picture experts group)-2TS (Transport Stream, transport stream) mux (multiplexing) module 513, PCM (Pulse Code Modulation, pulse code modulation) audio (audio) 511 is packed 512 with MPEG-2 and is input to MPEG-2TS mux module 513.
  • MPEG Motion Picture Experts Group, moving picture experts group
  • -2TS Transport Stream, transport stream
  • Audio and video data flow enters RTP transport (RTP transmission) module 514 to be packaged into RTP package after being packaged into TS flow, and RTP package is packaged into QUIC package through QUIC transport (QUIC transmission) module 515, then QUIC package is sent to Receiving end.
  • RTP transport RTP transmission
  • QUIC transport QUIC transmission
  • both the source end 101 and the receiving end 102 integrate the QUIC protocol 103 module, wherein the QUIC protocol 103 module packs and receives RTSP 402 and RTP 403 data as quic packets; RTSP 402 and RTP 403 data pass the UDP protocol for encapsulation.
  • the source end switches the connection mode of the data link with the receiving end; in response to the successful switching, continues to send at least one of audio data and video data transmitted by wireless screen projection to the receiving end through the third QUIC stream.
  • the source initiates a QUIC connection to the receiving end, including initial connection and reconnection; the receiving end monitors the connection request of the source end and establishes a connection with it, and can send data to the source end; a QUIC session identifier (ID ), the source can reconnect to the network within the keep-alive timeout of the QUIC session identifier when switching the access point.
  • ID QUIC session identifier
  • the method provided in this embodiment by adding the QUIC protocol in the transport layer, transmits the audio and video data for wireless screen projection transmission through the QUIC protocol, and at the same time ensures the stability of the connection and transmission between the source end and the receiving end, reducing the Lines and freezes, reducing transmission time and improving transmission efficiency.
  • the method shown in FIG. 16 may be implemented as the exemplary embodiment shown in FIG. 17 .
  • FIG. 17 shows a flowchart of a data transmission method for wireless screen projection provided by an embodiment of the present application, and the method can be applied to the system architecture shown in FIG. 1 .
  • the user issues a wireless screen projection command
  • the source and receiver respond to the wireless screen projection command, execute steps 2001 to 2005 as shown in Figure 3, and establish a data link between the source and the receiver through P2P or AP. Connection.
  • the source end and the receiving end perform RSTP negotiation through the TCP protocol as shown in steps 2021 to 2026 in FIG. 6 to create an RSTP session.
  • the source end and the receiving end perform steps 2011 to 2016 as shown in FIG. 4 to establish a QUIC connection between the source end and the receiving end.
  • the source end and the receiving end receive the play request through the TCP protocol, execute step 2031 shown in FIG. 6, and trigger the transmission of the audio and video data stream.
  • step 3041 is executed, and the source end transmits the audio and video data stream to the receiving end through the third QUIC stream.
  • step 305 may also be executed to transmit the RSTP control command through the TCP protocol to control the wireless screen projection.
  • miracast R2 dynamic RTP transmission is partially supported to switch between UDP and TCP. Based on this, the embodiment of the present application also provides a method for switching between UDP, TCP, and QUIC protocols.
  • the method provided by the embodiment of this application through the Miracast screen projection method based on QUIC technology, can ensure stable connection and transmission at the same time, reduce dropped calls and stuttering, and can also save network ports and connection data volume, and improve data quality. safety.
  • the method provided in this embodiment can well solve the mosaic phenomenon in the case of packet loss; compared with TCP, the buffering ratio and the number of buffering times are significantly improved.
  • the method provided in this embodiment can seamlessly perform port switching in terms of access node switching.
  • the method provided by this embodiment reduces the number of ports used and the possibility of being attacked, and at the same time uses the QUIC encryption method for data exchange.
  • the data transmission method for wireless screen projection provided by the embodiment of this application is also applicable to other screen sharing transmission protocols, such as DLNA protocol, Airplay protocol, and private screen projection protocols, all of which can use the
  • the data transmission method of wireless screen projection is extended by the QUIC protocol at the transport layer.
  • Fig. 18 shows a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • the device is used to implement a wireless fidelity display WFD source end for wireless screen projection Miracast transmission.
  • the device includes :
  • the first QUIC module 803 is used to establish a QUIC connection with the WFD receiving end;
  • the first QUIC module 803 is configured to create a first QUIC stream based on the QUIC connection, and perform RTSP negotiation with the WFD receiving end through the first QUIC stream to create an RTSP session;
  • the first QUIC module 803 is configured to, in response to receiving the play request sent by the WFD receiving end through the RTSP session, create a second QUIC stream based on the QUIC connection, and flow to the WFD receiving end through the second QUIC Sending at least one of audio data and video data transmitted by the wireless screen projection.
  • the RTSP message field of the RTSP negotiation includes a QUIC protocol field.
  • the device further includes:
  • the first data link module 801 is configured to establish a data link connection with the WFD receiving end through a peer-to-peer network P2P mode;
  • the first data link module 801 is configured to establish the data link connection with the WFD receiving end through a wireless access point AP.
  • the device further includes:
  • the first data link module 801 is configured to switch the connection mode of the data link with the WFD receiving end;
  • the first QUIC module 803 is configured to continue to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the second QUIC stream in response to the handover being successful.
  • the device further includes:
  • the first QUIC module 803 is configured to package at least one of the audio data and video data transmitted by the wireless screen projection into a QUIC package;
  • the first QUIC module 803 is configured to send the QUIC packet to the WFD receiving end through the second QUIC stream, where the QUIC packet includes at least one of the audio data and the video data.
  • the device further includes:
  • the first transmission module 802 is configured to send a first RSTP parameter setting instruction to the WFD receiving end in response to receiving the first user switching instruction;
  • the first transmission module 802 is configured to switch the transmission protocol to the TCP protocol in response to receiving the first creation request sent by the WFD receiving end, the first creation request is that the WFD receiving end responds to the first RSTP Sent after the parameter setting command;
  • the first TCP module 804 is configured to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the TCP protocol.
  • the device further includes:
  • the first transmission module 802 is configured to send a second RSTP parameter setting instruction to the WFD receiving end in response to receiving the second user switching instruction;
  • the first transmission module 802 is configured to switch the transmission protocol to the UDP protocol in response to receiving a second creation request sent by the WFD receiving end, and the second creation request is that the WFD receiving end responds to the second RSTP Sent after the parameter setting command;
  • the first UDP module 805 is configured to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the UDP protocol.
  • the device further includes:
  • the first transmission module 802 is configured to send a third RSTP parameter setting instruction to the WFD receiving end in response to receiving a third user switching instruction;
  • the first transmission module 802 is configured to switch the transmission protocol to the QUIC protocol in response to receiving a third creation request sent by the WFD receiving end, and the third creation request is that the WFD receiving end responds to the first 3. Sent after the RSTP parameter setting command;
  • the first QUIC module 803 is configured to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the QUIC protocol.
  • FIG. 19 shows a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • the device is used to implement a wireless fidelity display WFD source end for wireless screen projection Miracast transmission.
  • the device includes :
  • the first TCP module 804 is used to perform RTSP negotiation with the WFD receiving end through the TCP protocol to create an RTSP session;
  • the first QUIC module 803 is configured to establish a QUIC connection with the WFD receiving end, and create a third QUIC stream based on the QUIC connection;
  • the first QUIC module 803 is configured to, in response to receiving the play request sent by the WFD receiving end through the RSTP session, send the audio data and the audio data transmitted by the wireless screen projection to the WFD receiving end through the third QUIC stream at least one of video data.
  • the RTSP message field of the RTSP negotiation includes a QUIC protocol field.
  • the device further includes:
  • the first data link module 801 is configured to establish a data link connection with the WFD receiving end through a peer-to-peer network P2P mode;
  • the first data link module 801 is configured to establish the data link connection with the WFD receiving end through a wireless access point AP.
  • the device further includes:
  • the first data link module 801 is configured to switch the connection mode of the data link with the WFD receiving end;
  • the first QUIC module 803 is configured to continue to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the third QUIC stream in response to the handover being successful.
  • the device further includes:
  • the first QUIC module 803 is configured to package at least one of the audio data and video data transmitted by the wireless screen projection into a QUIC package;
  • the first QUIC module 803 is configured to send the QUIC packet to the WFD receiving end through the third QUIC stream, where the QUIC packet includes at least one of the audio data and the video data.
  • the device further includes:
  • the first transmission module 802 is configured to send a first RSTP parameter setting instruction to the WFD receiving end in response to receiving the first user switching instruction;
  • the first transmission module 802 is configured to switch the transmission protocol to the TCP protocol in response to receiving the first creation request sent by the WFD receiving end, the first creation request is that the WFD receiving end responds to the first RSTP Sent after the parameter setting command;
  • the first TCP module 804 is configured to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the TCP protocol.
  • the device further includes:
  • the first transmission module 802 is configured to send a second RSTP parameter setting instruction to the WFD receiving end in response to receiving the second user switching instruction;
  • the first transmission module 802 is configured to switch the transmission protocol to the UDP protocol in response to receiving a second creation request sent by the WFD receiving end, and the second creation request is that the WFD receiving end responds to the second RSTP Sent after the parameter setting command;
  • the first UDP module 805 is configured to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the UDP protocol.
  • the device further includes:
  • the first transmission module 802 is configured to send a third RSTP parameter setting instruction to the WFD receiving end in response to receiving a third user switching instruction;
  • the first transmission module 802 is configured to switch the transmission protocol to the QUIC protocol in response to receiving a third creation request sent by the WFD receiving end, and the third creation request is that the WFD receiving end responds to the first 3. Sent after the RSTP parameter setting command;
  • the first QUIC module 803 is configured to send at least one of the audio data and video data transmitted by the wireless screen projection to the WFD receiving end through the QUIC protocol.
  • Fig. 20 shows a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • the device is used to implement a wireless fidelity display WFD receiving end for wireless screen projection Miracast transmission.
  • the device includes :
  • the second QUIC module 903 is used to establish a QUIC connection with the WFD source
  • the second QUIC module 903 is configured to perform RTSP negotiation with the WFD source end through the first QUIC flow to create an RTSP session, and the first QUIC flow is created by the WFD source end based on the QUIC connection;
  • the second QUIC module 903 is configured to send a playback request to the WFD source through the RTSP session;
  • the second QUIC module 903 is configured to receive at least one of the audio data and video data transmitted by the wireless projection screen sent by the WFD source through a second QUIC stream, the second QUIC stream being the WFD source The end is created based on the QUIC connection.
  • the RTSP message field of the RTSP negotiation includes a QUIC protocol field.
  • the device further includes:
  • the second data link module 901 is configured to establish a data link connection with the WFD source through a peer-to-peer network P2P mode;
  • the second data link module 901 is configured to establish the data link connection with the WFD source through a wireless access point AP.
  • the device further includes:
  • the second data link module 901 is configured to switch the connection mode of the data link with the WFD source
  • the second QUIC module 903 is configured to continue to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the second QUIC stream in response to the handover being successful.
  • the second QUIC module 903 is configured to receive the QUIC packet sent by the WFD source through the second QUIC stream, and the QUIC packet includes the at least one of audio data and video data;
  • the second QUIC module 903 is configured to unpack the QUIC packet into at least one of the audio data and video data.
  • the device further includes:
  • the second transmission module 902 is configured to send a first creation request to the WFD source in response to receiving the first RSTP parameter setting instruction sent by the WFD source, and the first RSTP parameter setting instruction is the WFD Sent by the source in response to receiving the first user switching instruction, the first creation request is used to request the WFD source to switch the transmission protocol to the TCP protocol;
  • the second TCP module 904 is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the TCP protocol.
  • the device further includes:
  • the second transmission module 902 is configured to send a second creation request to the WFD source in response to receiving a second RSTP parameter setting instruction sent by the WFD source, and the second RSTP parameter setting instruction is the WFD sent by the source in response to receiving a second user switching instruction, the second creation request is used to request the WFD source to switch the transmission protocol to the UDP protocol;
  • the second UDP module 905 is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the UDP protocol.
  • the device further includes:
  • the second transmission module 902 is configured to send a third creation request to the WFD source end in response to receiving a third RSTP parameter setting instruction sent by the WFD source end, the third RSTP parameter setting instruction being the WFD sent by the source in response to receiving a third user switching instruction, the third creation request is used to request the WFD source to switch the transmission protocol to the QUIC protocol;
  • the second QUIC module 903 is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the QUIC protocol.
  • Fig. 21 shows a structural block diagram of a data transmission device for wireless screen projection provided by an exemplary embodiment of the present application.
  • the device is used to implement a wireless fidelity display WFD receiving end for wireless screen projection Miracast transmission.
  • the device includes :
  • the second TCP module 904 is used to perform RTSP negotiation with the WFD source end through the TCP protocol to create an RTSP session;
  • the second QUIC module 903 is configured to establish a QUIC connection with the WFD source
  • the second TCP module 904 is configured to send a playback request to the WFD source through the RTSP session;
  • the second QUIC module 903 is configured to receive at least one of the audio data and video data transmitted by the wireless projection screen sent by the WFD source through a third QUIC stream, the third QUIC stream is the The WFD source is created based on the QUIC connection.
  • the RTSP message field of the RTSP negotiation includes a QUIC protocol field.
  • the device further includes:
  • the second data link module 901 is configured to establish a data link connection with the WFD source through a peer-to-peer network P2P mode;
  • the second data link module 901 is configured to establish the data link connection with the WFD source through a wireless access point AP.
  • the device further includes:
  • the second data link module 901 is configured to switch the connection mode of the data link with the WFD source
  • the second QUIC module 903 is configured to continue to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the third QUIC stream in response to the handover being successful.
  • the second QUIC module 903 is configured to receive the QUIC packet sent by the WFD source through the third QUIC stream, and the QUIC packet includes the at least one of audio data and video data;
  • the second QUIC module 903 is configured to unpack the QUIC packet into at least one of the audio data and video data.
  • the device further includes:
  • the second transmission module 902 is configured to send a first creation request to the WFD source in response to receiving the first RSTP parameter setting instruction sent by the WFD source, and the first RSTP parameter setting instruction is the WFD Sent by the source in response to receiving the first user switching instruction, the first creation request is used to request the WFD source to switch the transmission protocol to the TCP protocol;
  • the second TCP module 904 is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the TCP protocol.
  • the device further includes:
  • the second transmission module 902 is configured to send a second creation request to the WFD source in response to receiving a second RSTP parameter setting instruction sent by the WFD source, and the second RSTP parameter setting instruction is the WFD sent by the source in response to receiving a second user switching instruction, the second creation request is used to request the WFD source to switch the transmission protocol to the UDP protocol;
  • the second UDP module 905 is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the UDP protocol.
  • the device further includes:
  • the second transmission module 902 is configured to send a third creation request to the WFD source end in response to receiving a third RSTP parameter setting instruction sent by the WFD source end, the third RSTP parameter setting instruction being the WFD sent by the source in response to receiving a third user switching instruction, the third creation request is used to request the WFD source to switch the transmission protocol to the QUIC protocol;
  • the second QUIC module 903 is configured to receive at least one of the audio data and video data transmitted by the wireless screen projection sent by the WFD source through the QUIC protocol.
  • FIG. 22 shows a schematic structural diagram of a communication device (terminal device or network device) provided by an exemplary embodiment of the present application.
  • the communication device includes: a processor 1001 , a receiver 1002 , a transmitter 1003 , a memory 1004 and a bus 1005 .
  • the processor 1001 includes one or more processing cores, and the processor 101 executes various functional applications and information processing by running software programs and modules.
  • the receiver 1002 and the transmitter 1003 can be realized as a communication component, and the communication component can be a communication chip.
  • the memory 1004 is connected to the processor 1001 through a bus 1005 .
  • the memory 1004 may be used to store at least one instruction, and the processor 1001 is used to execute the at least one instruction, so as to implement various steps in the foregoing method embodiments.
  • volatile or non-volatile storage devices include but not limited to: magnetic disk or optical disk, electrically erasable and programmable Electrically-Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Static Random Access Memory (SRAM), Read-Only Memory (Read-Only Memory, ROM), magnetic memory, flash memory, programmable read-only memory (Programmable Read-Only Memory, PROM).
  • EEPROM Electrically-Erasable Programmable Read Only Memory
  • EPROM Erasable Programmable Read Only Memory
  • SRAM Static Random Access Memory
  • Read-Only Memory Read-Only Memory
  • PROM Programmable Read-Only Memory
  • the processor and the transceiver in the communication device involved in the embodiment of the present application can perform the steps performed by the terminal device in any of the above-mentioned methods, which will not be repeated here. .
  • the communication device when the communication device is implemented as a terminal device,
  • the processor is configured to determine a target transmission resource in a resource selection process; and process the target transmission resource by using a re-evaluation and/or preemption process based on partial monitoring.
  • a computer-readable storage medium stores at least one instruction, at least one program, a code set or an instruction set, the at least one instruction, the At least one segment of program, the code set or instruction set is loaded and executed by the processor to implement the data transmission method for wireless screen projection performed by the communication device provided by the above method embodiments.
  • a chip the chip includes a programmable logic circuit and/or program instructions, and when the chip is run on a computer device, it is used to implement the wireless The data transmission method of screen projection.
  • a computer program product is also provided.
  • the computer program product is run on a processor of a computer device, the computer device is made to execute the data transmission method for wireless screen projection described in the above aspect.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

La présente demande se rapporte au domaine des communications mobiles et concerne un procédé et un appareil de transmission de données pour miracast, ainsi qu'un dispositif et un support de stockage. Le procédé est appliqué à une source d'affichage de fidélité sans fil (WFD) dans une transmission miracast et consiste à : établir une connexion QUIC avec un récepteur WFD ; créer un premier de QUIC d'après la connexion QUIC, puis effectuer une négociation RTSP avec le récepteur WFD au moyen du premier flux QUIC pour créer une session RTSP ; et en réponse à la réception, au moyen de la session RTSP, d'une demande de lecture envoyée par le récepteur WFD, créer un second flux QUIC d'après la connexion QUIC, puis envoyer, au récepteur WFD au moyen du second flux QUIC, les données audio et/ou les données vidéo dans la transmission miracast. Le procédé peut améliorer l'efficacité de transmission des données tout en garantissant la sécurité et la fiabilité de la transmission miracast.
PCT/CN2021/104106 2021-07-01 2021-07-01 Procédé et appareil de transmission de données pour miracast, dispositif et support de stockage WO2023272702A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180096103.0A CN117083867A (zh) 2021-07-01 2021-07-01 用于无线投屏的数据传输方法、装置、设备及存储介质
PCT/CN2021/104106 WO2023272702A1 (fr) 2021-07-01 2021-07-01 Procédé et appareil de transmission de données pour miracast, dispositif et support de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/104106 WO2023272702A1 (fr) 2021-07-01 2021-07-01 Procédé et appareil de transmission de données pour miracast, dispositif et support de stockage

Publications (1)

Publication Number Publication Date
WO2023272702A1 true WO2023272702A1 (fr) 2023-01-05

Family

ID=84692216

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/104106 WO2023272702A1 (fr) 2021-07-01 2021-07-01 Procédé et appareil de transmission de données pour miracast, dispositif et support de stockage

Country Status (2)

Country Link
CN (1) CN117083867A (fr)
WO (1) WO2023272702A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106453287A (zh) * 2016-09-28 2017-02-22 北京金山安全软件有限公司 一种多媒体数据的传输方法、客户端及服务器
US20170374412A1 (en) * 2014-12-11 2017-12-28 Lg Electronics Inc. Method and apparatus for outputting supplementary content from wfd
CN109996097A (zh) * 2019-03-12 2019-07-09 广州虎牙信息科技有限公司 一种投屏方法、系统及存储装置
CN110086578A (zh) * 2018-01-25 2019-08-02 华为技术有限公司 数据传输方法、装置和系统
CN110740300A (zh) * 2019-11-01 2020-01-31 普联技术有限公司 多媒体数据的传输方法、系统、客户端及视频监控设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170374412A1 (en) * 2014-12-11 2017-12-28 Lg Electronics Inc. Method and apparatus for outputting supplementary content from wfd
CN106453287A (zh) * 2016-09-28 2017-02-22 北京金山安全软件有限公司 一种多媒体数据的传输方法、客户端及服务器
CN110086578A (zh) * 2018-01-25 2019-08-02 华为技术有限公司 数据传输方法、装置和系统
CN109996097A (zh) * 2019-03-12 2019-07-09 广州虎牙信息科技有限公司 一种投屏方法、系统及存储装置
CN110740300A (zh) * 2019-11-01 2020-01-31 普联技术有限公司 多媒体数据的传输方法、系统、客户端及视频监控设备

Also Published As

Publication number Publication date
CN117083867A (zh) 2023-11-17

Similar Documents

Publication Publication Date Title
JP6279512B2 (ja) 適応ビデオ通信用システム及び方法
EP3078182B1 (fr) Partage sans fil de données multimédia à partir de sources multiples vers un réceptacle unique
AU2013207642B2 (en) Wireless communication system for offline participation in a display session
US20110196973A1 (en) Method and apparatus for inter-device session continuity (idsc) of multi media streams
JP4778048B2 (ja) サービス・エンドポイントに対して実質的に透過的な方法でネットワーク・サービスを利用するための方法および装置
WO2009129718A1 (fr) Procédé, équipement et système pour mettre en œuvre un partage de fichier dans une conférence audio/vidéo
CN111479121A (zh) 一种基于流媒体服务器的直播方法及系统
CN101674228B (zh) 实现流媒体通信的方法、装置及系统
JP6983218B2 (ja) データグラムベースのトランスポート層を介したカプセル化メディアトラフィックの効率的転送
US20130232232A1 (en) System and methods for resilient media streaming
WO2019184262A1 (fr) Procédé de traversée de traduction d'adresse de réseau de données multimédias de multiples types, terminal et système
CN107969165A (zh) 快速接入电信隧道克隆
US20230269280A1 (en) Communication method, communication apparatus, and communication system
Shacham et al. The virtual device: Expanding wireless communication services through service discovery and session mobility
US8457136B2 (en) Method, apparatus, and computer program product for reducing session setup latency
WO2019129125A1 (fr) Procédé et système d'interaction entre des lunettes intelligentes et un dispositif intelligent, et support de stockage
WO2023272702A1 (fr) Procédé et appareil de transmission de données pour miracast, dispositif et support de stockage
JP5243336B2 (ja) 通信システム、通信端末、通信方法、および通信プログラム
EP4391611A1 (fr) Procédé et appareil de transmission d'informations
WO2015192288A1 (fr) Procédé, terminal et système pour établir une connexion de communication
WO2024032102A1 (fr) Procédé et appareil de transmission de données, dispositif, support de stockage et produit-programme informatique
CN112653925B (zh) 媒体播放的跨设备转移方法、系统、设备及存储介质
CN117411991A (zh) 基于无流量网络的视频通话方法
Isomura et al. Extension of Service Migration Method for Video on Demand Service
KR20100122481A (ko) 콘텐츠를 원격 위치들에 스트리밍하기 위한 시스템과 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21947653

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202180096103.0

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE