WO2021027610A1 - 一种切换通信协议的方法、装置和系统 - Google Patents

一种切换通信协议的方法、装置和系统 Download PDF

Info

Publication number
WO2021027610A1
WO2021027610A1 PCT/CN2020/106631 CN2020106631W WO2021027610A1 WO 2021027610 A1 WO2021027610 A1 WO 2021027610A1 CN 2020106631 W CN2020106631 W CN 2020106631W WO 2021027610 A1 WO2021027610 A1 WO 2021027610A1
Authority
WO
WIPO (PCT)
Prior art keywords
protocol
application
media file
opened
communicate
Prior art date
Application number
PCT/CN2020/106631
Other languages
English (en)
French (fr)
Inventor
宋丽成
刘晓蕾
汪碧海
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP20852498.3A priority Critical patent/EP4013003A4/en
Publication of WO2021027610A1 publication Critical patent/WO2021027610A1/zh
Priority to US17/667,912 priority patent/US12120162B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/04—Protocols specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/08—Protocols for interworking; Protocol conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/11—Allocation or use of connection identifiers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/02—Hierarchically pre-organised networks, e.g. paging networks, cellular networks, WLAN [Wireless Local Area Network] or WLL [Wireless Local Loop]
    • H04W84/10—Small scale networks; Flat hierarchical networks
    • H04W84/12—WLAN [Wireless Local Area Networks]

Definitions

  • the present invention relates to the field of communication, and in particular to a method, device and system for switching communication protocols.
  • two short-distance terminals can be interconnected and communicated based on multiple technologies. For example, based on Wi-Fi direct connection technology, there is no need for the two terminals to be in the same wireless local area network (Wireless LAN, WLAN). Miracast is the more common one.
  • Technology such as WLAN-based technical communication, requires the two terminals to be in the same wireless local area network.
  • the more common one is the Digital Living Network Alliance (DLNA) technology, referred to as DLNA technology.
  • DLNA Digital Living Network Alliance
  • DLNA Digital Living Network Alliance
  • DLNA Digital Living Network Alliance
  • DLNA Digital Living Network Alliance
  • DLNA Digital Living Network Alliance
  • This process requires the user to operate a certain terminal to trigger the sending of the switching instruction, that is, the switching process is completed by the terminal according to the user's operation, which makes the switching efficiency relatively low, the operation is inconvenient, and also affects the user experience.
  • a smart TV and a mobile phone are interconnected, so that content displayed on the screen of the mobile phone or media files (such as high-definition videos or pictures or audio) stored in the mobile phone are put on the smart TV for playback.
  • mirroring can be used, that is, the display content of the mobile phone screen can be projected on the smart TV screen in real time, or the media files in the mobile phone can be directly transferred to the smart TV, and the smart TV can directly play these media files.
  • the mirror image projection uses Miracast technology, and the media file itself uses DLNA technology. Smart TVs do not support simultaneous screen projection using multiple protocols.
  • the present application provides a method, device and device for switching communication protocols, which are triggered by the start of an application or the change of screen content to switch the communication protocol between two devices, especially the communication protocol used for screen projection, Without user control, switching efficiency is improved, and user experience is improved.
  • this application describes a method for switching communication protocols.
  • the method includes: a first device and a second device communicate through a first protocol to project the screen of the first device to the second device.
  • the first device switches to using a second protocol to communicate with the second device to communicate with the second device.
  • the device projects the display interface of the first application or the media file, and the first application is used to manage or play the media file.
  • Both the first protocol and the second protocol can be a set of protocols or one protocol.
  • the first protocol is based on Miracast technology
  • the second protocol is based on the technology of Digital Living Network Alliance DLNA.
  • the first device and the second device may both be terminals.
  • the first device is a mobile phone
  • the second device is a terminal with a larger screen with an operating system, such as a smart TV, a smart screen, or a smart large screen.
  • an operating system such as a smart TV, a smart screen, or a smart large screen.
  • the switching of the first device to use the second protocol to communicate with the second device is triggered by the first application or the second application that opens the media file.
  • the first device switches to using the second protocol to communicate with the first device.
  • the second device communication includes: when the software development kit (SDK) used for screen projection in the first device detects that the first application is opened or the media file stored in the first device is opened, the first device A device switches to use the second protocol to communicate with the second device.
  • SDK software development kit
  • the display interface of the first application or the media file is One device projects a full screen to the second device. That is to say, the display interface of the first application or the media file is directly delivered to the second device in full screen using the switched protocol, without the need for a user to input instructions or the second device first displays according to the screen of the first device and then It is more convenient to adjust the display effect, and it is easier to achieve a better projection effect.
  • the first device maintains a device list corresponding to the second protocol, and the device list includes identifiers of devices that can communicate with the first device through the second protocol.
  • the first device switches to using the second protocol to communicate with the second device, including:
  • the first device queries the device list corresponding to the second protocol; when the UDID of the second device is queried Next, the first device switches to using the second protocol to communicate with the second device; if the UDID of the second device is not queried, the first device sends instructions to the second device To instruct the second device to switch the protocol, the first device receives the UDID of the second device, and the UDID of the second device is transmitted through the second protocol.
  • the second device can directly cooperate, and if the second device does not support the second protocol, then The first device cannot directly find the second device in the list corresponding to the second protocol, and the first device sends the pointing information to the second device, so that the second device makes corresponding preparations and uses the second protocol to send the UDID.
  • the second device can establish the protocol stack of the second protocol based on the end-to-end technology, or move the protocol stack of the second protocol to the protocol stack of the end-to-end technology, so that the second device can use the second protocol to send UDID. In this way, the second device can establish a connection based on the second protocol based on the connection of the first protocol, which simplifies the connection establishment process, is more convenient and saves time.
  • the method further includes: the first device recognizes the second device through a near field communication NFC technology.
  • the first device may recognize the NFC tag of the second device to identify the second device.
  • the first device can recognize the second device more conveniently, which is convenient to use and easy to grasp.
  • the user can touch the NFC tag of the second device with the first device.
  • the method further includes: after the first device identifies the second device, receiving a unique device identifier UDID of the second device, and the UDID is transmitted through the first protocol. This is a step in the device discovery process between the first device and the second device. In this way, the second device registers its UDID in the device list corresponding to the first protocol in the first device.
  • the method further includes: when the first application on the first device is closed or the media file stored by the first device is closed, the first device switches back to using the first device.
  • a protocol to communicate with the second device If the first protocol implements mirrored screen projection, the second protocol can make the media files on the source side achieve better screen projection effects, and then switch back to the first protocol to save the communication resources between the source side and the sink side. Save the power of the two terminals, and realize the communication protocol that is reasonably distributed and used according to the content of the screen.
  • the present application also describes a method for switching communication protocols.
  • the method includes a second device communicating with a first device through a first protocol to project the screen of the first device on the second device;
  • the second device receives the first instruction transmitted by the first device through the first protocol, and establishes a protocol stack of the second protocol based on the end-to-end P2P technology according to the first instruction, the first instruction Used to instruct the second device to switch to the second protocol;
  • the second device communicates with the first device through the second protocol to display the media file or application of the first device on the second device interface.
  • the second device can switch the communication protocol based on the instruction of the first device, instead of detecting the network environment to determine whether to switch the protocol as in the prior art. In this way, the switching of the protocol is more timely and can meet the requirements in time.
  • the display effect required for projection is more timely and can meet the requirements in time.
  • the second device cooperates with the first device to implement the methods of the first aspect and the second aspect, so the specific implementation and technical effects can refer to the first aspect.
  • the media file or the application interface is displayed in full screen on the second device.
  • the method further includes: the second device monitors the first device on the channel corresponding to the second protocol Broadcast; in the case of listening to the broadcast, the second device sends the unique device identifier UDID of the second device to the first device through the second protocol.
  • the method further includes: the second device receives a second instruction sent by the first device through the second protocol; the second device switches back to using the second instruction based on the second instruction
  • the first protocol communicates with the first device.
  • this application describes a system for switching communication protocols.
  • the system includes a first device and a second device.
  • the first device is the first device in any implementation manner of the first aspect and the second aspect
  • the second device is the second device in any implementation manner of the first aspect and the second aspect.
  • this application describes a device for switching communication protocols.
  • the device is located in a first device, the first device runs a first application, and the device includes: a communication module for the first device and The second device communicates through the first protocol to project the screen of the first device to the second device; the protocol switching module is used to open the first application or the media file stored in the first device
  • the first application uses For managing or playing media files.
  • the device described in the fourth aspect can execute the method described in the foregoing first aspect.
  • this application describes a device for switching communication protocols.
  • the device is located in a second device.
  • the device includes a first communication module and a projection module.
  • the first communication module is used to communicate with the first device through a first protocol to Use the projection module to project the screen of the first device on the second device; a protocol switching module for receiving the first instruction transmitted by the first device through the first protocol, and according to the first An instruction to establish a protocol stack of the second protocol based on the end-to-end P2P technology, the first instruction is used to instruct the second device to switch to the second protocol; the second communication module is used to communicate with the second protocol through the second protocol The first device communicates to use the projection module to display the media file or application interface of the first device on the second device.
  • the device described in the fifth aspect can cooperate with the first device to perform the method described in the foregoing first aspect, or can perform the method described in the foregoing second aspect.
  • the device described in the fifth aspect can cooperate with the first device to perform the method described in the foregoing first aspect, or can perform the method described in the foregoing second aspect.
  • an embodiment of the present invention records a device.
  • the device includes a processing circuit, a communication interface, and a storage medium.
  • the storage medium stores instructions.
  • the communication interface is used to send and receive information with other devices.
  • an embodiment of the present invention records a device.
  • the device includes a processing circuit, a communication interface, and a storage medium.
  • the storage medium stores instructions.
  • the communication interface is used to send and receive information with other devices.
  • a computer program product stores program code for storing a method that can implement any of the various implementation manners in the first aspect, or for storing a program code that can implement the second aspect The program code of any one of the various implementation methods in the
  • a computer-readable storage medium including instructions, which when run on a computer, cause the computer to execute any one of the methods in the first aspect, or the second aspect Any one of the various implementation methods in the.
  • FIG. 1 is a screen projection scene provided by an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a method for switching communication protocols provided by an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of another method for switching communication protocols provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a device for switching communication protocols provided by an embodiment of the present invention (corresponding to the first device);
  • FIG. 5 is a schematic diagram of another device for switching communication protocols provided by an embodiment of the present invention.
  • the embodiments of the present invention provide a method, device, and system for switching communication protocols.
  • the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
  • a and/or B Represents A and B, or A or B.
  • the short-distance data exchange means that the distance can be communicated through wireless signals.
  • this application refers to the device that sends data, that is, the source end of the data as the source end, and the receiving end or display end of the data as the sink end.
  • the mobile phone is the source terminal and the smart TV is the sink terminal. Since the smart TV has a short-distance data interaction function, the mobile phone and the smart TV can communicate directly.
  • An example scenario can also be that a terminal for display (such as a TV) is connected to a terminal for control (such as a set-top box or TV box), and the mobile phone uses the set-top box or TV box to put screen content or media files to the user. On the terminal displayed. At this time, the mobile phone is the source side, and the set-top box or TV box is the sink side.
  • the connection between the mobile phone and the smart TV or TV box may be an end-to-end (peer-to-peer (p2p)) connection, or may be connected through a router or wireless access point in a home or a community.
  • Fig. 1 illustrates that the first terminal casts a screen to the second terminal.
  • the first terminal may be a mobile phone
  • the second terminal may be a smart TV, a smart large screen, and other terminals with a relatively large screen.
  • the server may include a storage server or a computing server.
  • the terminal may also be referred to as User Equipment (User Equipment, referred to as "UE” for short).
  • UE User Equipment
  • the terminal of this application is capable of supporting at least two short-range wireless communication technologies.
  • Common short-range wireless communication technologies include protocols described by IEEE 802.11, wireless personal network (Wireless Personal Area Network, WPAN), Bluetooth (Blueteeth), Zig Bee and so on.
  • the terminal may be a mobile phone (or called a "cellular" phone) or a computer with a mobile nature.
  • the terminal can also be a portable, pocket-sized, handheld, built-in computer or vehicle-mounted mobile device, such as a mobile phone, a tablet computer, a notebook computer, a palm computer, a smart wearable device (such as a smart watch or bracelet, smart glasses), and a smart voice Devices (such as smart speakers, etc.), smart TVs, network access devices (such as access points, set-top boxes, TV boxes), etc., mobile Internet devices (English: mobile internet device, abbreviated as: MID), vehicle equipment, augmented reality (augmented) reality, AR)/virtual reality (virtual reality, VR) devices, desktops, laptops, handheld notebook computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (personal digital assistants) , PDA) and other devices, the embodiments of this application do not impose any restriction on the specific form of the electronic device.
  • MID mobile internet device
  • This application uses communication between two terminals as an example for description.
  • a device can be indicated by a unique device identifier (UDID).
  • the UDID can uniquely indicate a device. In other words, multiple devices communicating on the network have different UDIDs.
  • This application does not limit the form and generation method of the UDID. For example, it may be the number of the IOS device that comes with the device when it leaves the factory, and for example, a unique identifier is assigned to the terminal connected to the network through a certain algorithm.
  • a communication method between an application and a module in the operating system where the application is located is to send broadcast, that is, in this case, broadcast is a communication method between processes.
  • a device can send broadcast information through a channel. This broadcast information is used to transmit information to other devices within the propagation range of the broadcast information that can receive the broadcast information.
  • DLNA Low-power Bluetooth
  • DLNA Low-power Bluetooth
  • the technologies and protocols included therein are all currently widely used technologies and protocols.
  • the technology used by the device to connect to the wireless network is 802.11a/b/g/n, and the protocol is IPv4 or IPv6; media transmission uses the HTTP protocol; device discovery, control, and media management use Intel’s UPnP technology.
  • the protocol switching scenario described in this application does not limit the type of protocol or technology, nor does it limit the protocol used must be a widely used standard protocol, as long as the process of protocol or technology switching is involved in the communication process. can.
  • the switching can be a set of protocols switching to another set of protocols, such as the scenario of switching between Miracast technology and DLNA technology described above, or a set of protocols switching to a certain protocol or a certain protocol switching to a certain group
  • the protocol for example, can be a switch between a certain proprietary protocol and the protocol used by Miracast technology, or between a certain protocol and another protocol.
  • this application does not limit the technologies, protocols, and scenarios used in short-distance wireless communication scenarios, for example, it may be a short-distance wired protocol, or some long-distance protocols and scenarios.
  • a mobile phone or an in-vehicle device remotely delivers content to a TV at home, or a TV communicates with a terminal at a long distance, there is also a protocol switching requirement, and the method and system described in this application may also be applicable.
  • the second device can be regarded as the sink end, and the first device can be regarded as the source end.
  • the second device uses the first protocol to monitor and discovers the device discovery instruction based on the first protocol broadcast by the first device.
  • the second device reports the UDID of the second device to the first device through the first protocol, and the first device uses the first The protocol casts a screen to the second device.
  • the application on the first device triggers the switching of the projection protocol, for example, the application is opened or a certain media file is opened through the application.
  • the first device queries the list of devices matching the second protocol maintained in the first device (the first device already has a protocol stack of the second protocol), and the UDID of the second device is not matched in the list, that is, the matching fails . This shows that the second device cannot use the second protocol.
  • the first device notifies the second device to switch to the protocol stack using the second protocol.
  • the second device creates a second protocol stack on the second device through the end-to-end (peer to peer, P2P) technology, and passes the second device Protocol monitoring is used to discover the device discovery instruction based on the second protocol broadcast by the first device, and the second device reports the UDID of the second device to the first device through the second protocol.
  • the UDID of the second device can be included in the device list corresponding to the second protocol of the first device.
  • the first device queries the list of devices that match the second protocol maintained in the first device (the first device already has the first device). Protocol stack of the second protocol), the UDID of the second device is matched in the list, that is, the match is successful, and the first device uses the second protocol to project the media file in the first device to the second device.
  • the first protocol may be a set of protocols based on Miracast technology
  • the second protocol may be a set of protocols based on DNLA technology.
  • the device discovers that the UDID of the Sink side is registered on the Source side, so that the Source side can use the first protocol to cast a screen on the Sink side.
  • the application triggers the Source side.
  • the Source side searches for the UDID of the Sink side in the device list of the protocol to be switched (such as the second protocol), and uses the second protocol to establish a connection for screen projection to complete the protocol switching.
  • This process does not require the Source side Or the user control and operation protocol switching process of the sink side, the user does not need to care about the difference between the projection protocol and each protocol, the mobile phone can automatically switch the protocol without perception according to the user's current browsing status, such as pictures/videos, which can be on the large screen Display high-definition effect clarity, improve the visual experience of the screen; at the same time, in the scene where the mobile phone and the large screen are not in the same local area network, it can also realize automatic and non-perceptual switching, without the user's instruction and control equipment for protocol switching (for example, the Instruction or control can include opening the system application for transmission control, selecting a new connection method to establish a connection using a new protocol or technology, or clicking an icon related to the screen projection in the application to trigger the application switching protocol), and After the Source side detects the running status of the application, it switches the protocol based on the device discovery on the Source side, so that users can directly enjoy the results of the protocol switching without controlling the protocol switching, and do not need to care about what protocol to
  • a scenario where the method described in this application is applicable is a terminal with a smaller volume (referred to as the first terminal, which may be a mobile phone or smart wearable device, etc.) and another terminal with an operating system with a larger screen (referred to as the first terminal)
  • the second terminal which can be a smart TV or a smart screen, etc.
  • the user uses the NFC function of the first terminal to mirror the screen content of the first terminal to the second terminal using the Miracast protocol suite.
  • the user opens the component for controlling the NFC function of the first terminal (for example, clicks on the icon indicating the NFC function on the screen of the first terminal)
  • the user moves the first terminal close or touches the NFC tag of the second terminal or the user pulls down the first terminal.
  • the screen of a terminal so that the first terminal can discover the second terminal through NFC technology, and further use Miracast technology for mirroring screen projection.
  • the user clicks on a picture on the first terminal the picture will be displayed on the second terminal in full screen through DLNA, that is, the user switches the screen content (such as the picture is clicked), Triggered a switch to the projection protocol.
  • the user operates the Source terminal (such as a terminal with a large screen, referred to as a large screen in Figure 3) to cast a screen.
  • the user uses the first gesture (the following pull gesture) to operate the screen cast of the mobile phone.
  • the sink side (such as a mobile phone) uses two sets of protocols (for example, the protocol corresponding to Miracast technology and the protocol of DLNA technology) to monitor the corresponding channel.
  • the sink side monitors the broadcast information sent from the Source side
  • the sink side sends
  • the source side reports the unique device identifier UDID of the sink side.
  • the channel corresponding to which protocol monitors the broadcast information will use the corresponding channel of the protocol to report the UDID, and if the UDID of the sink side is identified on the channels corresponding to the two sets of protocols, each will be reported.
  • the large screen in Figure 3 reports the UDID on the channel corresponding to Miracast.
  • the source side caches the UDID reported by the sink side, and the source side can use the peer-to-peer (p2p) protocol among these protocols (the first protocol, for example, a set corresponding to the Miracast protocol) to place the source side screen on Sink side.
  • the Source side recognizes that there are the same devices in different protocols based on the UDID (that is, the Sink side), and based on this, it realizes the switching of users of different protocols on the same device without operation.
  • Alt in FIG. 3 represents an optional or possible implementation of a step, that is, there are two or more possible implementations for this step. Multiple implementations of a step are framed by solid lines, and each implementation is divided by dashed lines. For example, two such steps are indicated in Figure 3.
  • One is how the Source side recognizes the condition of protocol switching. The figure indicates two implementation methods, namely active recognition and passive recognition.
  • Another step is how to switch the protocol when the source and sink network types are different, that is, when the Source and Sink belong to the same LAN and the Source and Sink belong to different LANs, how to do the protocol Switch.
  • an application on the Source side when an application on the Source side is running, for example, when the user views media files such as pictures or videos or audio, the application actively calls the Application Programming Interface (API) for screen projection or sends broadcast notifications to the Source side.
  • the projection management center a module in the operating system, specifically a process or thread
  • This method can be called “passive identification”.
  • SDK Software Development Kit
  • this application is an application that requires screen projection, or an application related to multimedia files or files, such as terminal system applications, including but not limited to at least one of gallery, video, music, and even a document viewer.
  • terminal system applications including but not limited to at least one of gallery, video, music, and even a document viewer.
  • the first application and the second application mentioned above are often stored on the source side.
  • it can also be applications such as YouTube and NetEase Cloud Music.
  • the Source side queries whether there is a UDID indicating the sink side in the device discovery list corresponding to another set of protocols (the second protocol, such as a set of protocols based on DLNA technology) on the Source side. If it exists, Then directly use the second protocol for screen projection (that is, the Source and Sink are considered to belong to the same local area network); if it does not exist (that is, the Source and Sink are considered to belong to different LANs), the Source prepares the second protocol based on the p2p protocol The protocol stack, and through the instructions in the first protocol, notify the sink to prepare the protocol stack of the second protocol based on the p2p protocol, so that the source file is projected to the source using the second protocol.
  • the second protocol such as a set of protocols based on DLNA technology
  • the application informs the screen projection management center to switch back to the first protocol to continue the screen projection by calling the screen projection interface or sending a broadcast (that is, a kind of instruction).
  • the Source end has a sub-process to identify the device, that is, the Source end is based on the UDID sent by the Sink end during the first protocol communication, and the device corresponding to the second protocol is found Find the sink end in the list. This process can identify the same device based on UDID in different protocols.
  • the sink terminal uses the protocol available on the sink terminal to send the UDID to the source terminal.
  • the available protocols include at least the first protocol, so the sink terminal uses the first protocol to cast the screen.
  • the second protocol of the sink is also available, the source receives the UDID of the sink through the first protocol and the second protocol respectively.
  • the Source side switches the projection protocol based on the application information, the Source side can identify the same device in different protocols through the UDID, and the Source side switches to the second protocol. If the first protocol is a set of protocols based on Miracast and the second protocol is a set of protocols based on DLNA, then this also shows that the Source and Sink belong to the same LAN.
  • the second protocol on the sink side is not a usable protocol during the device discovery process, when the source side switches the projection protocol based on the information of the application, it cannot match the sink side in the device list corresponding to the second protocol.
  • UDID that is, the same device cannot be found in another protocol. This shows that the sink side needs to do configuration related to the second protocol. If the first protocol is a set of protocols based on Miracast and the second protocol is a set of protocols based on DLNA, then this also shows that the Source and Sink do not belong to the same LAN.
  • the Source end can notify the Sink end through instructions so that the Sink end can establish the protocol stack of the second protocol based on the p2p technology, or switch the protocol stack of the second protocol to P2P. Then, it also goes through the device discovery process based on the second protocol, which includes the sink end listening to the source end broadcast on the channel corresponding to the second protocol, and sending the sink end UDID to the source end. In this way, after the Source end also recognizes the UDID of the Sink end under the second protocol, it performs the non-perceptual switching of the projection protocol.
  • the projected application interface or media file is displayed on the sink side in full screen, so that the advantages of the switched protocol can be fully utilized to achieve a better projection effect without the need for users Manually adjust to full screen, more convenient.
  • the device discovers that the UDID of the Sink side is registered on the Source side, so that the Source side can use the first protocol to cast screens on the Sink side.
  • the application triggers the Source side to switch casting.
  • the protocol used by the screen the Source side searches for the UDID of the Sink side in the device list of the protocol to be switched (such as the second protocol), and uses the second protocol to establish a connection to cast the screen to complete the protocol switching.
  • This process does not require the Source side or Sink
  • the user control and operation protocol switching process of the terminal the user does not need to care about the difference between the projection protocol and each protocol, the mobile phone can automatically switch the protocol without perception according to the user's current browsing status, such as pictures/videos, and can display HD on the large screen.
  • the clarity of the effect enhance the visual experience of the screen; at the same time, in the scene where the mobile phone and the large screen are not in the same local area network, it can also realize automatic and non-perceptual switching, without the need for the user to instruct and control the device to switch the protocol (for example, the instruction or Control can include opening the system application for transmission control, selecting a new connection method to establish a connection using a new protocol or technology, or clicking an icon related to the projection in the application to trigger the application switching protocol), but Source After the terminal detects the running status of the application, it switches the protocol based on the device discovery on the Source side, so that the user can directly enjoy the result of the protocol switching without controlling the protocol switching, without worrying about when to use which protocol, and without knowing The performance of each protocol is different, but the Source side switches the projection protocol according to the content or application currently browsed by the user. Even when the Source and Sink are not in the same local area network, it can switch the projection protocol without user configuration.
  • the instruction or Control can include opening the system application for transmission control, selecting
  • the Sink end can be notified to disconnect using the second protocol to cast the screen, and the Source end uses the first protocol to cast again. Screen. If the first protocol implements mirrored screen projection, the second protocol can make the media files on the source side achieve better screen projection effects, and then switch back to the first protocol to save the communication resources between the source side and the sink side. Save the power of the two terminals, and realize the communication protocol that is reasonably distributed and used according to the content of the screen.
  • the technical solution of the present invention can be applied to various screen projection scenarios. Take the scenario of “browsing pictures” as an example.
  • a terminal with a small screen such as a mobile phone
  • another terminal with a larger screen such as a TV or a display
  • the user operates a terminal with a smaller screen to enter the gallery application and opens a picture.
  • the gallery application notifies a module or thread in the operating system of the terminal with a smaller screen to switch the protocol used for projection by calling the projection interface or sending instructions.
  • the module or thread is used to control the protocol switching of the screen projection.
  • this module or thread may be the screen projection center.
  • the terminal with the larger screen is notified by an instruction to switch the projection protocol.
  • the protocol will be switched directly. If they are not in the same local area network, the two terminals need to be interconnected in the same local area network with p2p technology, and a connection based on the switched protocol is established between the two terminals. In this way, the switched protocol can be used to display high-definition pictures on terminals with larger screens.
  • the sink side can control the content resources of the source side when mirroring the screen, for example, switch the video being played to the next segment, or switch the projected picture, that is, the content of the screen is changed, but
  • the protocol used for projection has not changed, such as Miracast technology. Since the sink side only displays the pictures or videos displayed on the source side when mirroring the screen, the display effect of the screen projection depends on the processing capability of the source side.
  • the Source side often has limited ability to process videos or pictures, but the Sink side has better processing capabilities.
  • the projected screen is a high-definition picture or high-definition video (such as 1080P, Blu-ray and other formats)
  • the use of mirroring technology may not achieve the playback effect that best matches the format of the content to be played, and there is no more reasonable use of processing resources.
  • Play content for processing (such as decoding and playback). It is used at this time.
  • the protocol before switching corresponds to Miracast technology
  • the protocol after switching is based on DLNA technology
  • the user can open high-definition media files or open the For media file-related applications
  • the media files that need to be projected are first transmitted to the sink terminal through a connection based on DLNA technology, and then decoded and played on the sink terminal, so that the high-definition display effect is reflected on the source terminal, and the sink terminal is used reasonably.
  • the Source side switches the protocol used for projection based on the user's current browsing situation (such as the running status of the foreground application), and the user does not need to operate this process.
  • the protocol switching process also does not require user configuration and operation, and does not require the user to open connection-related application operations.
  • the switching of screen connection is seamless, the screen projection does not need to be cut off and restarted, and it can be directly changed from one projection content to another, avoiding a black screen. In this way, the user experience of the screen switching process is improved.
  • the device 400 is located in a first device, and the first device runs a first application.
  • the device 400 includes: a communication module 401 for the first device.
  • the device and the second device communicate through the first protocol to project the screen of the first device to the second device; the protocol switching module 402 is used to switch when the first application is opened or the media file stored in the first device is opened.
  • the first device switches to using the second protocol to communicate with the second device to project the display interface or media file of the first application to the second device, and the first application is used to manage or play the media file.
  • the protocol switching module 402 is configured to switch the first device to use the second protocol to communicate with the second device based on an instruction triggered by the first application or the second application that opens the media file.
  • the protocol switching module 402 is configured to switch the first device to use the second protocol to communicate with the second device when it is detected that the first application is opened or the media file stored by the first device is opened.
  • the protocol switching module 402 is used to project the display interface or media file of the first application in full screen to the first application when the first application on the first device is opened or the media file stored in the first device is opened. Two equipment.
  • the first device of the protocol switching module 402 maintains a device list corresponding to the second protocol.
  • the device list includes the identifiers of devices that can communicate with the first device through the second protocol.
  • the protocol switching module 402 is used to When the first application on a device is opened or the media file stored by the first device is opened, the first device queries the device list corresponding to the second protocol; when the UDID of the second device is queried, the first device switches to Use the second protocol to communicate with the second device; when the UDID of the second device is not queried, the first device sends instruction information to the second device to instruct the second device to switch the protocol, and the first device receives the second device’s UDID, the UDID of the second device is transmitted through the second protocol.
  • the device 400 further includes an identification module 403, which is used to identify the second device through the near field communication NFC technology.
  • the communication module 401 is further configured to receive the unique device identifier UDID of the second device after the first device recognizes the second device, and the UDID is transmitted through the first protocol.
  • the protocol switching module 402 is further configured to switch back to using the first protocol to communicate with the second device when the first application on the first device is closed or the media file stored by the first device is closed.
  • the foregoing device can implement any of the foregoing methods and the parts executed by the first device in various implementation modes.
  • the foregoing device may also be the first device. Therefore, for other specific implementations of the device, refer to the description of the first device in the foregoing embodiment. , I won’t repeat it here.
  • this application also describes another device for switching communication protocols.
  • the device is located in the second device described above.
  • the device includes a first communication module and a projection module.
  • the first communication module is used for Communicate with the first device through the first protocol to use the projection module to project the screen of the first device on the second device;
  • the protocol switching module is used to receive the first instruction transmitted by the first device through the first protocol, and according to the first Instruction, based on the end-to-end P2P technology to establish the protocol stack of the second protocol, the first instruction is used to instruct the second device to switch to the second protocol;
  • the second communication module is used to communicate with the first device through the second protocol to use
  • the projection module displays the media file or application interface of the first device on the second device.
  • the above-mentioned device can implement any of the foregoing methods and the parts executed by the second device in various implementation modes.
  • the above-mentioned device may also be the second device. Therefore, for other specific implementations of the device, refer to the description of the second device in the foregoing embodiment. I will not repeat them here.
  • this application also describes a system that includes the first device (Source end) in any of the foregoing implementation manners, and the second device (Sink end) in any of the foregoing implementation manners.
  • the first device may be a mobile phone or a smart wearable device
  • the second device may be a display screen, a smart TV, a smart screen, or a smart large screen and other devices with an operating system and display hardware.
  • FIG. 5 is a schematic structural diagram of a computer system provided in this application.
  • the computer system can be understood as an implementation of the aforementioned first device or second device.
  • the computer system may be a smart phone, smart TV, smart large screen, smart wearable device, etc.
  • the computer system includes a communication module 510, a sensor 520, a user input module 530, an output module 540, a processor 550, an audio and video input module 560, a memory 570, and a power supply 580.
  • the communication module 510 includes a module that enables communication between the computer system and a communication system or other computer systems.
  • the communication module 510 may also include one or more of a wired network interface, a broadcast receiving module, a mobile communication module, a wireless Internet module, a local area communication module, and a location (or positioning) information module.
  • the first communication module and the second communication module in the device described above can be implemented by the communication module 510.
  • the sensor 520 may sense the current state of the system, such as open/closed state, position, contact with the user, direction, and acceleration/deceleration, and the sensor 520 may generate a sensing signal for controlling the operation of the system.
  • the user input module 530 is used to receive inputted digital information, character information, or contact touch operation/non-contact gestures, and receive signal input related to user settings and function control of the system.
  • the user input module 530 includes a touch panel and/or other input devices.
  • the output module 540 includes a display panel for displaying information input by the user, information provided to the user, or various menu interfaces of the system.
  • the display panel may be configured in the form of a liquid crystal display (LCD) or an organic light-emitting diode (OLED).
  • the touch panel can cover the display panel to form a touch display screen.
  • the output module 540 may also include an audio output module, an alarm, a haptic module, and so on.
  • the projected screen in this application can be cast on the output module 540.
  • the audio and video input module 560 is used to input audio signals or video signals.
  • the audio and video input module 560 may include a camera and a microphone.
  • the computer system may also include an audio and video output module for outputting audio signals or video signals.
  • the power supply 580 may receive external power and internal power under the control of the processor 550, and provide power required for the operation of various components of the computer system.
  • the processor 550 may indicate one or more processors.
  • the processor 550 may include one or more central processing units, or include a central processing unit and a graphics processor, or include an application processor and a coprocessor. (For example, micro control unit or neural network processor).
  • the processor 550 includes multiple processors, the multiple processors may be integrated on the same chip, or each may be an independent chip.
  • a processor may include one or more physical cores, where the physical core is the smallest processing unit.
  • the memory 570 stores computer programs (or called computer-readable instructions), and the computer programs include an operating system program 572, an application program 571, and the like.
  • Typical operating systems such as Microsoft’s Windows, Apple’s MacOS, etc. are used in desktop or notebook systems; another example is based on the development of Google Android Systems, etc., systems for mobile terminals, etc.
  • the memory 570 may be one or more of the following types: flash memory, hard disk type memory, micro multimedia card type memory, card type memory (such as SD or XD memory), random access memory (random access memory) , RAM), static random access memory (static RAM, SRAM), read-only memory (read only memory, ROM), electrically erasable programmable read-only memory (electrically erasable programmable read-only memory, EEPROM), programmable Read-only memory (programmable ROM, PROM), magnetic memory, magnetic disk or optical disk.
  • the storage 570 can also be a network storage device on the Internet, and the system can perform operations such as updating or reading the storage 570 on the Internet.
  • the processor 550 is configured to read the computer program in the memory 570, and then execute the method defined by the computer program.
  • the various methods for switching communication protocols provided in this application can be implemented in an application program, or in an operating system, or implemented together by an application program and an operating system.
  • the steps related to the sending and receiving of information require the cooperation of the communication module 510.
  • the steps involving screen projection require the cooperation of the output module 540.
  • the memory 570 also stores other data 573 in addition to the computer program, such as a device list corresponding to the first protocol stored by the first device in this application, a device list corresponding to the second protocol, and so on.
  • connection relationship of each module in FIG. 5 is only an example, and the method provided in any embodiment of the present application can also be applied to terminal devices of other connection modes, for example, all modules are connected through a bus.
  • the division of each module is only a logical division, and does not mean that the hardware must be separated. Each module may not be necessary in some embodiments of the present application.
  • the structure of FIG. 5 can realize the device described above.
  • the protocol switching modules in the first device and the second device may be respectively implemented by reading the computer programs in the memory 570 by the processor 550 in the two structures shown in FIG. 5.
  • Another embodiment of the present application also records a chip.
  • a chip can be placed in the first device or the second device described above to execute the method described in this application.
  • the program can be stored in a computer readable storage.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.
  • this application also provides storage media, computer program products, computer programs, etc., related to the methods provided in this application, which are used to store computer-readable instructions that, when executed by one or more processors, realize the present invention. Any device discovery method provided by the application. For specific implementation, refer to the foregoing embodiment.
  • the device embodiments described above are merely illustrative.
  • the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in One place, or it can be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the connection relationship between the modules indicates that they have a communication connection between them, which can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art can understand and implement it without creative work.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephone Function (AREA)

Abstract

本申请记载一种切换通信协议的方法，该方法中，第一设备和第二设备通过第一协议通信，以将所述第一设备的屏幕向第二设备投映，在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，以向所述第二设备投映所述第一应用的显示界面或者所述媒体文件，所述第一应用用于管理或者播放媒体文件。这样，无需用户控制，提升了切换效率，改善了用户体验。

Description

一种切换通信协议的方法、装置和系统 技术领域
本发明涉及通信领域，尤其涉及一种切换通信协议的方法、装置和系统。
背景技术
目前，短距离的两个终端可以基于多种技术互连和通信，例如，基于Wi-Fi直连技术通信，无需这两个终端处于同一无线局域网(Wireless LAN,WLAN)，比较常见的有Miracast技术，再例如基于WLAN的技术通信，则需要这两个终端处于同一无线局域网，比较常见的有数字生活网络联盟(Digital Living Network Alliance，DLNA)的技术，简称DLNA技术。在终端的使用过程中，不同场景下往往使用不同的技术通信，因此涉及通信技术的切换，具体的，可以是从一组通信协议切换到另一组通信协议，或者从一个通信协议切换到另一个通信协议。这个过程需要用户操作某个终端以触发切换指令的发送，即切换过程是终端按照用户的操作完成的，这使得切换效率比较低，操作不方便，也会影响用户体验。
举例来说，智能电视和手机互连，以将手机的屏幕显示的内容或者手机中存储的媒体文件(如高清视频或者图片或者音频)投放在该智能电视上播放。这其中可使用镜像投屏，即将手机屏幕的显示内容实时投影到智能电视的屏幕上，也可以直接将手机中的媒体文件传输给智能电视，由智能电视直接播放这些媒体文件。镜像投屏使用的是Miracast技术，而播放媒体文件本身使用的是DLNA技术。智能电视不支持同时使用多个协议投屏，因此，在通过镜像投屏将其他终端的屏幕投放在智能电视上时，若需要使用DLNA技术查看高清图片或者视频等媒体文件，就需要手机切换为基于DLNA技术连接智能电视，再基于此连接投映这些媒体文件，这个过程需要用户操作手机，例如点开投屏应用，点击列表中该智能电视的标识，以切换到另一连接。另一种方式是用户控制智能电视，使智能电视向手机发送切换指令，手机基于切换指令将切换后要投屏的数据向智能电视传输，其中，用户通过操作智能电视上的按钮，或者智能电视的遥控器或者机顶盒，或者手机上用于控制智能电视的应用，来实现上述过程。可见，现有技术中，需要用户的控制来完成对连接技术的切换，切换效率不高，影响用户体验。
发明内容
有鉴于此，本申请提供了一种切换通信协议方法、装置和设备，由应用的启动或者投屏内容的变更为触发，切换两个设备间通信协议，尤其是用于投屏的通信协议，而无需用户控制，提升了切换效率，改善了用户体验。
下面通过不同的方面介绍该方法以及应用该方法的装置等。以下各个方面的实现方式和有益效果可以互相参考。
第一方面，本申请描述了一种切换通信协议的方法，该方法包括：第一设备和第二设备通过第一协议通信，以将所述第一设备的屏幕向第二设备投映，在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，以向所述第二设备投映所述第一应用的显示界面或者所述媒体文件，所述第一应用用于管理或者播放媒体文件。
第一协议和第二协议都可以是一组协议，或者一个协议。例如，所述第一协议基于Miracast技术，所述第二协议基于数字生活网络联盟DLNA的技术。
第一设备和第二设备可以都是终端，例如，第一设备是手机，第二设备是具有操作系统的屏幕较大的终端，如智能电视，智慧屏幕或智能大屏等。这样，第一设备与第二设备之间的协议切换是基于第一设备上运行的与媒体文件有关的应用触发的，而不是用户控制，提升了切换效率，改善了用户体验。
其中，触发方式可以有两种，即主动触发和被动触发。
一种实现方式下，所述第一设备切换到使用第二协议与所述第二设备通信是由所述第一应用或者打开所述媒体文件的第二应用触发的。
一种实现方式下，所述在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，包括：所述第一设备中用于投屏的软件开发工具包(SDK)检测到所述第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信。
一种实现方式下，在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一应用的显示界面或者所述媒体文件被所述第一设备全屏投映到所述第二设备。也就是说，所述第一应用的显示界面或者所述媒体文件直接使用切换后的协议全屏投放到该第二设备，而无需用户输入指令或者第二设备先按照第一设备的屏幕显示然后再调整显示的效果，更加方便，也能更简便地实现较好的投映效果。
一种实现方式下，所述第一设备维护有所述第二协议对应的设备列表，所述设备列表包括可与所述第一设备通过第二协议通信的设备的标识，所述在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，包括：在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备查询所述第二协议对应的设备列表；在查询到所述第二设备的UDID的情况下，所述第一设备切换到使用第二协议与所述第二设备通信；在未查询到所述第二设备的UDID的情况下，所述第一设备向所述第二设备发送指示信息，以指示所述第二设备切换协议，所述第一设备接收所述第二设备的UDID,所述第二设备的UDID是通过所述第二协议传输的。
也就是说，如果第二设备上都支持第一协议和第二协议，由第一设备切换到第二协议通信，第二设备可以直接配合，而如果第二设备上不支持第二协议，则第一设备无法直接在第二协议对应的列表中发现第二设备，第一设备就向第二设备发送指信息，使第二设备做好相应的准备并使用第二协议发送UDID。其中，第二设备可基于端到端技术建立第二协议的协议栈，或者将第二协议的协议栈迁至端到端技术的协议栈上，这样，第二设备就可以使用第二协议发送UDID。这样，第二设备可以基于第一协议的连接建立基于第二协议的连接，简化了连接建立过程，更加方便，也更加省时。
一种实现方式下，所述方法还包括：所述第一设备通过近场通信NFC技术，识别所述第二设备。例如，可以是所述第一设备识别所述第二设备的NFC标签，以识别所述第二设备。这样能更方便地使第一设备识别第二设备，使用方便，易于掌握，例如用户用第一设备碰一下第二设备的NFC标签即可。
一种实现方式下，所述方法还包括:所述第一设备识别所述第二设备后，接收所述第二设备的唯一设备标识符UDID，所述UDID通过所述第一协议传输。这是第一设备与第二设备在设备发现过程中的步骤，第二设备通过这种方式将自己的UDID注册在第一设备中与第一协议对应的设备列表中。
一种实现方式下，所述方法还包括：在所述第一设备上的第一应用被关闭或者所述第一设备存储的媒体文件被关闭时，所述第一设备切回使用所述第一协议与所述第二设备通信。如果第一协议实现的是镜像投屏，第二协议可以让Source端的媒体文件取得更好的投屏效果，而再切换回第一协议，则可节省Source端和Sink端之间的通信资源，节约两个终端的电量，实现按投屏内容合理分配使用的通信协议。
第二方面，本申请还描述了一种切换通信协议的方法，该方法包括第二设备通过第一协议与第一设备通信，以在所述第二设备上投映所述第一设备的屏幕；所述第二设备接收所述第一设备通过所述第一协议传输的第一指令，以及根据所述第一指令，基于端到端P2P技术建立第二协议的协议栈，所述第一指令用于指示所述第二设备切换到第二协议；所述第二设备通过第二协议与所述第一设备通信，以在所述第二设备上显示所述第一设备的媒体文件或者应用界面。
这样，第二设备可以基于第一设备的指令进行通信协议的切换，而不是如现有技术一般，只能检测网络环境来判断是否要切换协议，这样，对协议的切换更加及时，能及时满足投屏 所需的显示效果。
应理解，第二设备与第一设备配合实现第一方面和第二方面的方法，因此具体实现方式和技术效果可参照第一方面。
一种实现方式下，所述媒体文件或者所述应用界面在所述第二设备上全屏显示。
一种实现方式下，所述第二设备建立所述第二协议的协议栈后，所述方法还包括：所述第二设备在所述第二协议对应的信道上监听所述第一设备的广播；在监听到所述广播的情况下，所述第二设备通过所述第二协议向所述第一设备发送所述第二设备的唯一设备标识符UDID。
一种实现方式下，所述方法还包括：所述第二设备接收所述第一设备通过所述第二协议发送的第二指令；所述第二设备基于所述第二指令切回使用所述第一协议与所述第一设备通信。
第三方面，本申请描述一种切换通信协议的系统，所述系统包括第一设备和第二设备。其中，第一设备是第一方面和第二方面中，任一种实现方式中的第一设备，第二设备是第一方面和第二方面中，任一种实现方式中的第二设备。
第四方面，本申请描述一种切换通信协议的装置，所述装置位于第一设备，所述第一设备运行有第一应用，所述装置包括：通信模块，用于所述第一设备和第二设备通过第一协议通信，以将所述第一设备的屏幕向第二设备投映；协议切换模块，用于在所述第一应用被打开或者所述第一设备存储的媒体文件被打开时，将所述第一设备切换到使用第二协议与所述第二设备通信，以向所述第二设备投映所述第一应用的显示界面或者所述媒体文件，所述第一应用用于管理或者播放媒体文件。
第四方面描述的装置可以执行前述第一方面描述的方法，具体说明和技术效果可参考第一方面的描述。
第五方面，本申请描述切换通信协议的装置，所述装置位于第二设备，该装置包括第一通信模块和投映模块，该第一通信模块用于通过第一协议与第一设备通信，以使用所述投映模块在所述第二设备上投映所述第一设备的屏幕；协议切换模块，用于接收所述第一设备通过所述第一协议传输的第一指令，以及根据所述第一指令，基于端到端P2P技术建立第二协议的协议栈，所述第一指令用于指示所述第二设备切换到第二协议；第二通信模块，用于通过第二协议与所述第一设备通信，以使用所述投映模块在所述第二设备上显示所述第一设备的媒体文件或者应用界面。
第五方面描述的装置可以配合第一设备执行前述第一方面描述的方法，或者可以执行前述第二方面描述的方法，具体说明和技术效果可参考第一方面和第二方面的描述。
第六方面，本发明实施例记载一种设备，该设备包括处理电路、通信接口和存储介质，所述存储介质中存储有指令，所述通信接口用于与其他设备收发信息，所述处理器用于运行所述存储介质中的指令，在所述通信接口的配合下，以实现第一方面及第一方面各种实现方式描述的方法。
第七方面，本发明实施例记载一种设备，该设备包括处理电路、通信接口和存储介质，所述存储介质中存储有指令，所述通信接口用于与其他设备收发信息，所述处理器用于运行所述存储介质中的指令，在所述通信接口的配合下，以实现第二方面及第二方面各种实现方式描述的方法。
第八方面，提供一种计算机程序产品，所述计算机程序产品中存储有用于存储可以实现第一方面中各种实现方式中任意一种的方法的程序代码，或者用于存储可以实现第二方面中各种实现方式中任意一种的方法的程序代码。
第九方面，提供一种计算机可读存储介质，包括指令，当所述指令在计算机上运行时，使得所述计算机执行第一方面中各种实现方式中任意一种的方法，或者第二方面中各种实现方式中任意一种的方法。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明实施例提供的一种投屏场景；
图2为本发明实施例提供的一种切换通信协议的方法的示意图；
图3为本发明实施例提供的又一种切换通信协议的方法的示意图；
图4为本发明实施例提供的一种切换通信协议的装置的示意图(对应第一设备)；
图5为本发明实施例提供的又一种切换通信协议的装置的示意图。
具体实施方式
本发明实施例提供了一种切换通信协议的方法、装置和系统，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
下面解释本申请出现的一些名词。
A和/或B：表示A和B,或者A或B。
本申请描述的方法可用于两个或多个设备短距离进行数据交互的场景。其中，短距离的数据交互是指，该距离可通过无线信号进行通信。为便于描述，本申请将发送数据的设备，即数据的源端称为source端，数据的接收端或者显示端称为sink端。例如背景技术举例的场景中，手机为source端，智能电视为sink端，由于智能电视自带短距离数据交互功能，手机和智能电视可以直接进行通信。背景技术举例的场景还可以是，一个用于显示的终端(例如电视)连接一个用于控制的终端(例如机顶盒或者电视盒子)，手机通过机顶盒或者电视盒子，将屏幕内容或者媒体文件投放到用于显示的终端。这时，手机为source端，机顶盒或者电视盒子为sink端。其中，手机与智能电视或者电视盒子之间可以是端到端(peer to peer简p2p)的连接，也可以是通过家庭或者小区中的路由器或者无线接入点连接。
图1示意了第一终端向第二终端投屏，其中第一终端可以是手机，第二终端可以是智能电视，智慧大屏等屏幕比较大的终端。
需要说明的是，本实施例提供的方案可以应用于终端设备或者服务器设备等。服务器可以包括存储服务器或计算服务器等。
其中终端也可称之为用户设备(User Equipment，简称为“UE”)。本申请的终端有能力支持至少两种短距离的无线通信技术。常见的短距离无线通信技术有IEEE 802.11描述的协议，无线个人网络(Wireless Personal Area Network,WPAN)、蓝牙(Blueteeth)，Zig Bee等等。
例如终端可以是移动电话(或称为“蜂窝”电话)、或具有移动性质的计算机。终端还可以是便携式、袖珍式、手持式、计算机内置的或者车载的移动装置，如手机、平板电脑、笔记本电脑、掌上电脑、智能穿戴设备(如智能手表或手环、智能眼镜)，智能语音设备(例如智能音箱等)、智能电视，网络接入设备(如接入点、机顶盒、电视盒子)等，移动互联网设备(英文：mobile internet device，简称：MID)、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、桌面型、膝上型、手持型笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)等设备，本申请实施例对电子设备的具体形态不作任何限制。
本申请以两个终端之间的通信为例进行说明。
一个设备可以用一个唯一设备标识符(Unique Device Identifier,UDID)来指示。该UDID可以唯一地指示一个设备。也就是说，在网络中通信的多个设备，各自的UDID是不同的。本申请不限定UDID的形式和生成方式，例如，可以是设备出厂自带的，如IOS设备的号码，再例如通过某种算法给网络中接入的终端分配唯一的标识。
本申请中，应用与该应用所在的操作系统中的模块之间的一种通信方式为发送广播，也 就是说，这个情况下，广播是进程间的一种通信方式。另一种情况下，一个设备可以通过信道发送广播信息，这个广播信息是为了向该广播信息的传播范围内，能够接受到该广播信息的其他设备传输信息。
在使用Miracast技术或者DLNA技术实现短距离通信的过程中，都要使用一组协议。这是由于整个通信过程包括多个子流程，不同的子流使用当前已知的协议。以DLNA技术为例，其中包括的技术和协议都是当前应用很广泛的技术和协议。具体的，DLNA技术中，设备连入无线网络使用的技术为802.11a/b/g/n,协议为IPv4,或者IPv6；媒体传输使用HTTP协议；设备的发现、控制和媒体管理使用了英特尔的UPnP技术。而本申请描述到的协议切换的场景，并不限制协议或者技术的类型，也不限定使用的协议一定要是应用很广泛的标准协议，只要在通信过程中涉及到协议或者技术的切换的过程即可。该切换可以是一组协议切换到另一组协议，例如前文描述的Miracast技术和DLNA技术之间的切换的场景，也可以是一组协议切换到某个协议或者某个协议切换到某一组协议，例如可以是某私有协议与Miracast技术所用的协议之间的切换，还可以是某个协议和另一个协议之间的切换。另外，本申请也不限定使用的技术、协议和场景在短距离无线通信场景下，比如，可以是短距离有线的协议，也可以是某些远距的协议和场景。具体来说，一个手机或者车载设备远距离投放内容到家里的电视上，或者电视与远距离的一个终端通信，也有协议的切换需求，也可能适用本申请描述的方法和系统。
下面，结合图2，描述协议切换方法的一种实现方式。第二设备可视为Sink端，第一设备可视为Source端。
第二设备使用第一协议监听，从而发现第一设备广播的基于第一协议的设备发现指令，第二设备通过第一协议向第一设备上报该第二设备的UDID,第一设备使用第一协议向该第二设备投屏。
第一设备上的应用触发对投屏协议的切换，例如应用被打开或者通过应用打开某媒体文件。第一设备查询第一设备中维护的匹配第二协议的设备的列表(第一设备中已有第二协议的协议栈)，在该列表中未匹配到该第二设备的UDID，即匹配失败。这说明第二设备还不能使用第二协议。
则第一设备通知第二设备切换到使用第二协议的协议栈，第二设备基于此，通过端到端(peer to peer,P2P)技术在第二设备创建第二协议栈，并通过第二协议监听，从而发现第一设备广播的基于第二协议的设备发现指令，第二设备通过第二协议向第一设备上报该第二设备的UDID。这样该第二设备的UDID即可包括在第一设备的第二协议对应的设备列表中，第一设备查询第一设备中维护的匹配第二协议的设备的列表(第一设备中已有第二协议的协议栈)，在该列表中匹配到该第二设备的UDID，即匹配成功，第一设备通过第二协议，将第一设备中的媒体文件投屏到第二设备。
其中，第一协议可以是基于Miracast技术的一组协议，第二协议可以是基于DNLA技术的一组协议。
这样，通过上述过程，经过设备发现，Sink端的UDID注册在Source端，从而Source端可使用第一协议在Sink端投屏，Source端在某个与媒体相关的应用打开后，该应用触发Source端切换投屏使用的协议，Source端在将切换的协议(如第二协议)的设备列表中查找Sink端的UDID，以及使用第二协议建立连接以投屏，完成协议的切换，这个过程无需Source端或者Sink端的用户控制和操作协议切换过程，用户无需关心投屏协议和各个协议之间的差别，手机可以根据用户当前的浏览状态，自动无感知切换协议，比如图片/视频，可以在大屏端显示高清的效果晰度，提升投屏的视觉体验；同时在手机和大屏不在同一个局域网的场景下，也可以实现自动无感知的切换，无需用户指示和控制设备进行协议的切换(例如该指示或者控制可包括打开用于传输控制的系统应用，选择新的连接方式，从而使用新的协议或技术建立连接，或者在应用中点击与投屏相关的图标，以触发应用切换协议)，而是Source端检测到应用的运行情况后基于Source端上的设备发现情况进行协议的切换，这样用户就可以 直接享受协议切换的结果而不需控制协议切换，无需关心在什么时候要使用什么协议，无需知晓各个协议在性能上的差别，而是Source端根据用户当前浏览的内容或者应用切换投屏协议。甚至Source端可在Source端和Sink端不在同一个局域网的情况下，也能实现无需用户配置地切换投屏协议。
本申请描述的方法的适用的一种场景是，一个体积较小的终端(简称第一终端，可以是手机或者智能穿戴设备等)与另一屏幕较大的带有操作系统的终端(简称第二终端，可以是智能电视或者智慧屏等)交互，以将手机的显示内容或者保存的媒体文件投屏在该终端。用户通过第一终端的NFC功能，将第一终端的屏幕内容使用Miracast的协议族镜像投影到第二终端。具体的，用户打开第一终端的用于控制NFC功能的组件(例如点击第一终端屏幕上指示NFC功能的图标)后，将第一终端凑近或者触碰第二终端的NFC标签或者用户下拉第一终端的屏幕，这样第一终端能通过NFC技术发现该第二终端，从而进一步使用Miracast技术做镜像投屏。在镜像投屏过程中，如果用户在第一终端上点开一张图片，则图片将通过DLNA全屏显示在第二终端上，也就是说，用户切换投屏内容(如图片被点开)，触发了对投屏协议的切换。
为了实现切换投屏内容时也切换协议，且切换协议的过程无需用户控制，本申请记载了一种切换协议的方法。下面结合图3进行描述。图3中，每个步骤之后的括号表示执行该步骤对应调用的接口。
用户操作Source端(如大屏的终端，图3中简称大屏)投屏，例如用户使用第一手势(如下拉手势)操作手机的屏幕投屏。
Sink端(如手机)使用两组协议(例如对应Miracast技术的协议和DLNA技术的协议)中各自的设备发现协议监听相应的信道，当Sink端监听到来自Source端发送的广播信息，Sink端向Source端上报Sink端的唯一设备标识符UDID。其中，哪个协议对应的信道监听到广播信息，就使用该协议相应的信道上报UDID，如果在该两组协议对应的信道上都识别出了Sink端的UDID，则各自上报。图3中大屏在Miracast对应的信道上上报UDID。
Source端缓存Sink端上报的UDID，Source端就可以使用这些协议中的基于端到端(peer to peer,p2p)的协议(第一协议，例如Miracast协议对应的一组)将Source端的屏幕投放在Sink端。也就是说，Source端基于UDID识别出在不同的协议中有相同的设备(即Sink端)，基于此来实现同一设备上的不同协议的用户无需操作的切换。
图3中的alt表示一个步骤可选或者可能的实现，也就是说，该步骤有两种或两种以上可能的实现方式。一个步骤的多种实现方式用实线框框在一起，每种实现方式之间以虚线分割。例如图3中指示了2个这样的步骤，一个是Source端如何识别协议切换的条件，图中指示了两种实现方式，即主动识别和被动识别。另一个步骤是当Source端和Sink端的组网类型不同的情况下，如何做协议的切换，即Source端和Sink端归属于同一局域网和Source端和Sink端归属于不同局域网时，要如何做协议的切换。
其中，Source端的某个应用在运行时，例如当用户查看图片或者视频或者音频这些媒体文件时，该应用主动调用用于投屏的应用程序接口(Application Programming Interface，API)或者发送广播通知Source端的投屏管理中心(是操作系统中的一个模块，具体可以是一个进程或者线程)，从而切换协议。这个方式可称为“被动识别”。或者，Source端的用于投屏的软件开发工具包(Software Development Kit,SDK)监控或者查看Source端的应用运行情况，当发现某个应用在运行时，例如当用户查看图片或者视频或者音频这些媒体文件时，开始切换协议。这个方式可称为“主动识别”。其中，这个应用是有投屏需要的应用，或者是与多媒体文件或者文件有关的应用，例如终端的系统应用，包括但不限于图库、视频、音乐甚至是文档查看器中的至少一种，再例如前文提及的第一应用和第二应用。另外，需要在Sink端播放的每天文件往往存储在Source端。另一种场景下，也可以是如YouTube，网易云音乐等应用。
具体的，Source端在切换DLNA协议过程中，查询Source端的另一组协议(第二协议，例如基于DLNA技术的一组协议)对应的设备发现列表中，是否有指示Sink端的UDID，如果存在，则直接使用第二协议投屏(即可认为Source端和Sink端属于同一局域网)；如果不存在(即可认为Source端和Sink端属于不同局域网)，则Source端基于p2p协议准备第二协议的协议栈，以及通过第一协议中的指令，通知Sink端基于p2p协议准备第二协议的协议栈，从而使用第二协议将Source端的文件投屏到Source端。Source端的上述应用退出时，该应用通过调用投屏接口或者发送广播(即一种指令)通知投屏管理中心切回第一协议继续投屏。需理解的是，上述切换协议过程的两种实现中，Source端都有识别设备的子过程，也就是Source端基于在第一协议通信时Sink端发送的UDID，在第二协议对应的设备发现列表里查找该Sink端。这个过程可以在不同的协议中，基于UDID，识别出同一设备。
这样，Sink端在设备发现过程中，使用该Sink端可用的协议发送UDID到Source端，可用的协议至少包括第一协议，故Sink端使用第一协议投屏。如果在设备发现过程中，Sink端的第二协议也是可用的协议，则Source端分别通过第一协议和第二协议接收到Sink端的UDID。Source端基于应用的信息进行投屏协议的切换时，Source端可通过UDID在不同的协议中都识别出同一设备，Source端切换到第二协议。如果第一协议是基于Miracast的一组协议，第二协议是基于DLNA的一组协议，那么这也说明Source端和Sink端属于同一局域网。
另一方面，如果在设备发现过程中，Sink端的第二协议不是可用的协议，Source端基于应用的信息进行投屏协议的切换时，就无法在第二协议对应的设备列表中匹配到Sink端的UDID，即无法在另一个协议中发现同一设备。这就说明Sink端需要做与第二协议相关的配置。如果第一协议是基于Miracast的一组协议，第二协议是基于DLNA的一组协议，那么这也说明Source端和Sink端不属于同一局域网。Source端可通过指令通知Sink端，以便Sink端基于p2p技术建立第二协议的协议栈，或者将第二协议的协议栈切换到P2P上。然后，同样经过基于第二协议的设备发现过程，其中包括Sink端在第二协议对应的信道上监听Source端的广播，以及将Sink端的UDID发送给Source端。这样，Source端在第二协议下同样识别到Sink端的UDID后，进行投屏协议的无感知切换。
一种实现方式下，投屏协议切换后，被投映的应用界面或者媒体文件以全屏在Sink端显示，这样，能充分发挥切换后的协议的优势，达到较好的投屏效果，且无需用户手动调整到全屏，更加方便。
通过上述过程，经过设备发现，Sink端的UDID注册在Source端，从而Source端可使用第一协议在Sink端投屏，Source端在某个与媒体相关的应用打开后，该应用触发Source端切换投屏使用的协议，Source端在将切换的协议(如第二协议)的设备列表中查找Sink端的UDID，以及使用第二协议建立连接以投屏，完成协议的切换，这个过程无需Source端或者Sink端的用户控制和操作协议切换过程，用户无需关心投屏协议和各个协议之间的差别，手机可以根据用户当前的浏览状态，自动无感知切换协议，比如图片/视频，可以在大屏端显示高清的效果晰度，提升投屏的视觉体验；同时在手机和大屏不在同一个局域网的场景下，也可以实现自动无感知的切换，无需用户指示和控制设备进行协议的切换(例如该指示或者控制可包括打开用于传输控制的系统应用，选择新的连接方式，从而使用新的协议或技术建立连接，或者在应用中点击与投屏相关的图标，以触发应用切换协议)，而是Source端检测到应用的运行情况后基于Source端上的设备发现情况进行协议的切换，这样用户就可以直接享受协议切换的结果而不需控制协议切换，无需关心在什么时候要使用什么协议，无需知晓各个协议在性能上的差别，而是Source端根据用户当前浏览的内容或者应用切换投屏协议。甚至Source端可在Source端和Sink端不在同一个局域网的情况下，也能实现无需用户配置地切换投屏协议。
另外，当Source端再次感知到协议切换的条件或者事件，例如当用户退出应用，或者退出对媒体文件的浏览，可通知Sink端断开使用第二协议投屏，Source端再次使用第一协议投屏。如果第一协议实现的是镜像投屏，第二协议可以让Source端的媒体文件取得更好的投 屏效果，而再切换回第一协议，则可节省Source端和Sink端之间的通信资源，节约两个终端的电量，实现按投屏内容合理分配使用的通信协议。
本发明的技术方案可应用于各种投屏场景。以“浏览图片”的场景为例，当一个屏幕较小的终端投屏(例如手机)到另一个屏幕较大的终端(例如电视或者显示屏)时，默认以镜像投屏的方式展示，当用户操作屏幕较小的终端进入图库应用，打开一张图片，则该图库应用通过调用投屏接口或者发送指令，通知屏幕较小的终端的操作系统中的一个模块或者线程切换投屏使用的协议。其中，该模块或者线程用于控制投屏的协议切换，例如这个模块或者线程可以是投屏中心。该模块或者线程切换协议后，通过指令通知屏幕较大的终端切换投屏协议。其中如果这两个终端在同一局域网，则直接切换协议，如果不在同一局域网，需要借助p2p技术使这两个终端互联在同一局域网，并在两个终端之间建立基于切换后的协议的连接，这样才能使用切换后的协议，在屏幕较大的终端显示高清的图片。
现有技术中，Sink端在镜像投屏时可以控制Source端投屏的内容资源，比如将正在播放的视频切换到下一段，或者切换投屏的图片，也就是投屏的内容发生变化，但投屏使用的协议并未变化，例如使用Miracast技术。由于镜像投屏时Sink端只是将Source端显示的图片或者视频显示出来，因此投屏的显示效果依赖Source端的处理能力。Source端往往处理视频或者图片能力有限，但是Sink端却有更好的处理的能力。这样，如果投屏的是高清图片或高清视频(例如1080P，蓝光等格式)，使用镜像投屏技术就很可能无法达到与播放内容的格式最匹配的播放效果，没有更合理地使用处理资源对播放内容进行处理(例如解码和播放)。这时使用，因此，本申请描述的方法中，若切换前的协议是与Miracast技术对应的，而切换后的协议是基于DLNA技术的，就可以在投屏时用户打开高清的媒体文件或者打开与媒体文件相关的应用时，将需要投屏的媒体文件通过基于DLNA技术的连接，先传输到Sink端，再在Sink端解码以及播放，从而在Source端体现高清显示效果，合理利用了Sink端的处理资源。Source端基于用户当前浏览的情况(如前台应用的运行情况)切换投屏使用的协议，而用户无需操作这一过程。进一步的，当用户退出对高清的媒体文件的查看时，Source端再切回镜像投屏，该协议切换过程同样无需用户配置和操作，无需用户打开与连接有关的应用操作，并且上述过程中投屏连接的切换是无缝的，投屏无需切断再重启，可以从一个投屏内容直接变换到另一个内容，避免黑屏。这样，投屏切换过程的用户体验得到提升。
下面参考图4，描述本申请提供的一种切换通信协议的装置400，该装置400位于第一设备，该第一设备运行有第一应用，该装置400包括：通信模块401，用于第一设备和第二设备通过第一协议通信，以将第一设备的屏幕向第二设备投映；协议切换模块402，用于在第一应用被打开或者第一设备存储的媒体文件被打开时，将第一设备切换到使用第二协议与第二设备通信，以向第二设备投映第一应用的显示界面或者媒体文件，第一应用用于管理或者播放媒体文件。
一种实现方式下，该协议切换模块402用于基于第一应用或者打开媒体文件的第二应用触发的指令，将第一设备切换到使用第二协议与第二设备通信。
一种实现方式下，该协议切换模块402用于在检测到第一应用被打开或者第一设备存储的媒体文件被打开时，第一设备切换到使用第二协议与第二设备通信。
一种实现方式下，该协议切换模块402用于在第一设备上的第一应用被打开或者第一设备存储的媒体文件被打开时，将第一应用的显示界面或者媒体文件全屏投映到第二设备。
一种实现方式下，该协议切换模块402第一设备维护有第二协议对应的设备列表，设备列表包括可与第一设备通过第二协议通信的设备的标识，协议切换模块402用于在第一设备上的第一应用被打开或者第一设备存储的媒体文件被打开时，第一设备查询第二协议对应的设备列表；在查询到第二设备的UDID的情况下，第一设备切换到使用第二协议与第二设备通信；在未查询到第二设备的UDID的情况下，第一设备向第二设备发送指示信息，以指示第二设备切换协议，第一设备接收第二设备的UDID,第二设备的UDID是通过第二协议传输的。
一种实现方式下，该装置400还包括识别模块403，该识别模块403用于通过近场通信 NFC技术，识别第二设备。
一种实现方式下，该通信模块401还用于在第一设备识别第二设备后，接收第二设备的唯一设备标识符UDID，UDID通过第一协议传输。
一种实现方式下，该协议切换模块402还用于在第一设备上的第一应用被关闭或者第一设备存储的媒体文件被关闭时，切回使用第一协议与第二设备通信。
上述装置可以实现前文的任一种方法及各种实现方式中第一设备执行的部分，上述装置还可以就是第一设备，因此该装置其它具体实现可参考前述实施例中对第一设备的描述，在此不再赘述。
另一方面，本申请也描述另一种切换通信协议的装置，该装置位于前文的第二设备，一种实现方式下，该装置包括第一通信模块和投映模块，该第一通信模块用于通过第一协议与第一设备通信，以使用投映模块在第二设备上投映第一设备的屏幕；协议切换模块，用于接收第一设备通过第一协议传输的第一指令，以及根据第一指令，基于端到端P2P技术建立第二协议的协议栈，第一指令用于指示第二设备切换到第二协议；第二通信模块，用于通过第二协议与第一设备通信，以使用投映模块在第二设备上显示第一设备的媒体文件或者应用界面。
上述装置可以实现前文的任一种方法及各种实现方式第二设备执行的部分，上述装置还可以就是第二设备，因此该装置其它具体实现可参考前述实施例中对第二设备的描述，在此不再赘述。
另外，本申请也记载一种系统，该系统中包括前述的任一实现方式中的第一设备(Source端)，和前述的任一实现方式中的第二设备(Sink端)。例如第一设备可以是手机或者智能穿戴设备，第二设备可以是显示屏，智能电视、智慧屏或者智能大屏等带有操作系统和显示硬件的设备。
请参考图5，为本申请提供的一种计算机系统的结构示意图。该计算机系统可以了解为前述第一设备或者第二设备的一种实现。具体的，该计算机系统可以为智能手机、智能电视、智慧大屏，智能穿戴设备等。如图所示，该计算机系统包括通信模块510、传感器520、用户输入模块530、输出模块540、处理器550、音视频输入模块560、存储器570以及电源580。
通信模块510包括能使该计算机系统与通信系统或其他计算机系统之间进行通信的模块。例如，通信模块510还可以包括有线网络接口、广播接收模块、移动通信模块、无线因特网模块、局域通信模块和位置(或定位)信息模块等其中的一个或多个。也就是说，前文中描述的装置中的第一通信模块和第二通信模块就可以由该通信模块510实现。这多种模块均在现有技术中有多种实现，本实施例不再一一描述。
传感器520可以感测系统的当前状态，诸如打开/闭合状态、位置、与用户是否有接触、方向、和加速/减速，并且传感器520可以生成用于控制系统的操作的感测信号。
用户输入模块530，用于接收输入的数字信息、字符信息或接触式触摸操作/非接触式手势，以及接收与系统的用户设置以及功能控制有关的信号输入等。用户输入模块530包括触控面板和/或其他输入设备。
输出模块540包括显示面板，用于显示由用户输入的信息、提供给用户的信息或系统的各种菜单界面等。可选的，可以采用液晶显示器(liquid crystal display，LCD)或有机发光二极管(organic light-emitting diode,OLED)等形式来配置显示面板。在其他一些实施例中，触控面板可覆盖显示面板上，形成触摸显示屏。另外，输出模块540还可以包括音频输出模块、告警器以及触觉模块等。例如，本申请中投屏就可以投在该输出模块540上。
音视频输入模块560，用于输入音频信号或视频信号。音视频输入模块560可以包括摄像头和麦克风。另外，该计算机系统还可以包括音视频输出模块，用于输出音频信号或视频信号。
电源580可以在处理器550的控制下接收外部电力和内部电力，并且提供该计算机系统的各个组件的操作所需的电力。
处理器550可以指示一个或多个处理器，例如，处理器550可以包括一个或多个中央处理器，或者包括一个中央处理器和一个图形处理器，或者包括一个应用处理器和一个协处理器(例如微控制单元或神经网络处理器)。当处理器550包括多个处理器时，这多个处理器可以集成在同一块芯片上，也可以各自为独立的芯片。一个处理器可以包括一个或多个物理核，其中物理核为最小的处理单元。
存储器570存储计算机程序(或称计算机可读指令)，该计算机程序包括操作系统程序572和应用程序571等。典型的操作系统如微软公司的Windows，苹果公司的MacOS等用于台式机或笔记本的系统；又如谷歌公司开发的基于
Figure PCTCN2020106631-appb-000001
的安卓
Figure PCTCN2020106631-appb-000002
系统等用于移动终端的系统等。
存储器570可以是以下类型中的一种或多种：闪速(flash)存储器、硬盘类型存储器、微型多媒体卡型存储器、卡式存储器(例如SD或XD存储器)、随机存取存储器(random access memory,RAM)、静态随机存取存储器(static RAM,SRAM)、只读存储器(read only memory,ROM)、电可擦除可编程只读存储器(electrically erasable programmable read-only memory，EEPROM)、可编程只读存储器(programmable ROM,PROM)、磁存储器、磁盘或光盘。在其他一些实施例中，存储器570也可以是因特网上的网络存储设备，系统可以对在因特网上的存储器570执行更新或读取等操作
处理器550用于读取存储器570中的计算机程序，然后执行计算机程序定义的方法。本申请提供的切换通信协议的各种方法可以实现在应用程序中，也可以实现在操作系统中，或者由应用程序和操作系统共同实现，当然，涉及信息的收发的步骤需要通信模块510配合，涉及投屏的步骤需要输出模块540的配合。
存储器570还存储有除计算机程序之外的其他数据573，例如本申请中第一设备存储的与第一协议对应的设备列表，以及与第二协议对应的设备列表等等。
图5中各个模块的连接关系仅为一种示例，本申请任意实施例提供的方法也可以应用在其它连接方式的终端设备中，例如所有模块通过总线连接。各个模块的划分仅是逻辑上的划分，并不代表硬件上一定是分开的。各个模块在本申请的一些实施例中未必是必要的。
另外，图5的结构可以实现前文描述的装置。例如第一设备和第二设备中的协议切换模块可以分别由两个图5所示的结构中的由处理器550读取存储器570中的计算机程序来实现。
本申请的另一个实施例还记载一种芯片。这种芯片可以放置在上文所述的第一设备或者第二设备，用于执行本申请中描述的方法。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件(例如处理器)来完成，所述的程序可存储于一计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(Random Access Memory，RAM)等。
另外，本申请还提供与本申请提供的方法相关的存储介质、计算机程序产品、计算机程序等，用于存储计算机可读指令，该计算机可读指令在被一个或多个处理器执行时实现本申请提供的任意一种设备发现方法。具体实现可参考前述实施例。
需要说明的是，前述实施例中提出模块或单元的划分仅作为一种示例性的示出，所描述的各个模块的功能仅是举例说明，本申请并不以此为限。本领域普通技术人员可以根据需求合并其中两个或更多模块的功能，或者将一个模块的功能拆分从而获得更多更细粒度的模块，以及其他变形方式。
以上描述的各个实施例之间相同或相似的部分可相互参考。本申请中的“多个”若无特殊说明，指两个或两个以上，或“至少两个”。本申请中的“A/B”包括三种情况：“A”、“B”和“A和B”。本申请中“第一”、“第二”、或“第三”等仅为了区分表述，没有限定顺序的意思；再者，由于没有限定顺序，所以没有第一，也可以有第二或第三。
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的模块可以是或 者也可以不是物理上分开的，作为模块显示的部件可以是或者也可以不是物理模块，即可以位于一个地方，或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。另外，本申请提供的装置实施例附图中，模块之间的连接关系表示它们之间具有通信连接，具体可以实现为一条或多条通信总线或信号线。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。
以上所述，仅为本申请的一些具体实施方式，但本申请的保护范围并不局限于此。

Claims (32)

  1. 一种切换通信协议的方法，其特征在于，所述方法包括：
    第一设备和第二设备通过第一协议通信，以将所述第一设备的屏幕向第二设备投映，
    在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，以向所述第二设备投映所述第一应用的显示界面或者所述媒体文件，所述第一应用用于管理或者播放媒体文件。
  2. 根据权利要求1所述的方法，其特征在于，所述第一设备切换到使用第二协议与所述第二设备通信是由所述第一应用或者打开所述媒体文件的第二应用触发的。
  3. 根据权利要求1所述的方法，其特征在于，所述在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，包括：
    所述第一设备中用于投屏的软件开发工具包(SDK)检测到所述第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信。
  4. 根据权利要求1到3任一所述的方法，其特征在于，在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一应用的显示界面或者所述媒体文件被所述第一设备全屏投映到所述第二设备。
  5. 根据权利要求1所述的方法，其特征在于，所述第一设备维护有所述第二协议对应的设备列表，所述设备列表包括可与所述第一设备通过第二协议通信的设备的标识，所述在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，包括：
    在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备查询所述第二协议对应的设备列表；
    在查询到所述第二设备的UDID的情况下，所述第一设备切换到使用第二协议与所述第二设备通信；
    在未查询到所述第二设备的UDID的情况下，所述第一设备向所述第二设备发送指示信息，以指示所述第二设备切换协议，所述第一设备接收所述第二设备的UDID,所述第二设备的UDID是通过所述第二协议传输的。
  6. 根据权利要求1到5任一所述的方法，其特征在于，所述方法还包括：
    所述第一设备通过近场通信NFC技术，识别所述第二设备。
  7. 根据权利要求6所述的方法，其特征在于，所述第一设备通过近场通信NFC技术，发现所述第二设备，包括：
    所述第一设备识别所述第二设备的NFC标签，以识别所述第二设备。
  8. 根据权利要求1到7任一所述的方法，其特征在于，所述方法还包括：
    所述第一设备识别所述第二设备后，接收所述第二设备的唯一设备标识符UDID，所述UDID通过所述第一协议传输。
  9. 根据权利要求1到8任一所述的方法，其特征在于，所述方法还包括：
    在所述第一设备上的第一应用被关闭或者所述第一设备存储的媒体文件被关闭时，所述第一设备切回使用所述第一协议与所述第二设备通信。
  10. 根据权利要求1到9任一所述的方法，其特征在于，所述第一协议基于Miracast技术，所述第二协议基于数字生活网络联盟DLNA的技术。
  11. 一种切换通信协议的装置，其特征在于，所述装置位于第一设备，所述第一设备运行有第一应用，所述装置包括：
    通信模块，用于所述第一设备和第二设备通过第一协议通信，以将所述第一设备的屏幕向第二设备投映；
    协议切换模块，用于在所述第一应用被打开或者所述第一设备存储的媒体文件被打开时，将所述第一设备切换到使用第二协议与所述第二设备通信，以向所述第二设备投映所述第一 应用的显示界面或者所述媒体文件，所述第一应用用于管理或者播放媒体文件。
  12. 根据权利要求11所述的装置，其特征在于，所述协议切换模块用于基于所述第一应用或者打开所述媒体文件的第二应用触发的指令，将所述第一设备切换到使用第二协议与所述第二设备通信。
  13. 根据权利要求11所述的装置，其特征在于，所述协议切换模块用于在检测到所述第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信。
  14. 根据权利要求11到13任一所述的装置，其特征在于，所述协议切换模块用于在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，将所述第一应用的显示界面或者所述媒体文件全屏投映到所述第二设备。
  15. 根据权利要求11所述的装置，其特征在于，所述第一设备维护有所述第二协议对应的设备列表，所述设备列表包括可与所述第一设备通过第二协议通信的设备的标识，所述协议切换模块用于在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备查询所述第二协议对应的设备列表；在查询到所述第二设备的UDID的情况下，所述第一设备切换到使用第二协议与所述第二设备通信；在未查询到所述第二设备的UDID的情况下，所述第一设备向所述第二设备发送指示信息，以指示所述第二设备切换协议，所述第一设备接收所述第二设备的UDID,所述第二设备的UDID是通过所述第二协议传输的。
  16. 根据权利要求11到15任一所述的装置，其特征在于，所述装置还包括识别模块，所述识别模块用于通过近场通信NFC技术，识别所述第二设备。
  17. 根据权利要求11到16任一所述的装置，其特征在于，所述通信模块还用于在所述第一设备识别所述第二设备后，接收所述第二设备的唯一设备标识符UDID，所述UDID通过所述第一协议传输。
  18. 根据权利要求11到17任一所述的装置，其特征在于，所述协议切换模块还用于在所述第一设备上的第一应用被关闭或者所述第一设备存储的媒体文件被关闭时，切回使用所述第一协议与所述第二设备通信。
  19. 一种切换通信协议的方法，其特征在于，所述方法包括：
    第二设备通过第一协议与第一设备通信，以在所述第二设备上投映所述第一设备的屏幕；
    所述第二设备接收所述第一设备通过所述第一协议传输的第一指令，以及根据所述第一指令，基于端到端P2P技术建立第二协议的协议栈，所述第一指令用于指示所述第二设备切换到第二协议；
    所述第二设备通过第二协议与所述第一设备通信，以在所述第二设备上显示所述第一设备的媒体文件或者应用界面。
  20. 根据权利要求19所述的方法，其特征在于，所述媒体文件或者所述应用界面在所述第二设备上全屏显示。
  21. 根据权利要求19或20任一所述的方法，其特征在于，所述第二设备建立所述第二协议的协议栈后，所述方法还包括：
    所述第二设备在所述第二协议对应的信道上监听所述第一设备的广播；
    在监听到所述广播的情况下，所述第二设备通过所述第二协议向所述第一设备发送所述第二设备的唯一设备标识符UDID。
  22. 根据权利要求19到21任一所述的方法，其特征在于，所述方法还包括：
    所述第二设备接收所述第一设备通过所述第二协议发送的第二指令；
    所述第二设备基于所述第二指令切回使用所述第一协议与所述第一设备通信。
  23. 根据权利要求19到22任一所述的方法，其特征在于，所述第一协议基于Miracast技术，所述第二协议基于数字生活网络联盟DLNA的技术。
  24. 一种切换通信协议的系统，其特征在于，所述系统包括第一设备和第二设备，所述第一设备用于与第二设备通过第一协议通信，以将所述第一设备的屏幕向第二设备投映，所述 第二设备用于显示所述第一设备的屏幕；
    所述第一设备还用于在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第一设备切换到使用第二协议与所述第二设备通信，以向所述第二设备投映所述第一应用的显示界面或者所述媒体文件，所述第一应用用于管理或者播放媒体文件；
    所述第二设备用于显示所述第一应用的显示界面或者所述媒体文件。
  25. 根据权利要求24所述的系统，其特征在于，所述第一设备用于基于所述第一应用或者打开所述媒体文件的第二应用，触发切换到使用所述第二协议。
  26. 根据权利要求24或25所述的系统，其特征在于，在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，所述第二设备用于全屏显示所述第一应用的显示界面或者所述媒体文件。
  27. 根据权利要求24-26任一权要所述的系统，其特征在于，所述第一设备用于维护所述第二协议对应的设备列表，所述设备列表包括可与所述第一设备通过第二协议通信的设备的标识，以及在所述第一设备上的第一应用被打开或者所述第一设备存储的媒体文件被打开时，查询所述第二协议对应的设备列表；在查询到所述第二设备的UDID的情况下，切换到使用第二协议与所述第二设备通信；在未查询到所述第二设备的UDID的情况下，向所述第二设备发送指示信息，以指示所述第二设备切换协议，所述第一设备接收所述第二设备的UDID,所述第二设备的UDID是通过所述第二协议传输的。
  28. 根据权利要求24到27任一所述的系统，其特征在于，所述第二设备还用于分别使用所述第一协议和所述第二协议向所述第二设备发送所述第二设备的唯一设备标识符UDID。
  29. 一种计算机设备，其特征在于，包括处理电路、存储介质和通信接口，所述存储介质中存储有指令，所述通信接口用于与其他设备收发信息，所述处理器用于运行所述存储介质中的指令，在所述通信接口的配合下，实现如权利要求1-10任意一项所述的方法。
  30. 一种计算机设备，其特征在于，包括处理电路、存储介质和通信接口，其中所述存储介质用于存储计算机可读指令，所述处理器用于运行所述存储介质中的指令，在所述通信接口的配合下，实现如权利要求19-23任意一项所述的方法。
  31. 一种计算机存储介质，其特征在于，所述计算机存储介质用于存储计算机可读指令，当所述计算机可读指令被一个或多个处理器执行时实现如权利要求1-10或者权利要求19-23任意一项所述的方法。
  32. 一种计算机程序产品，其特征在于，所述计算机程序产品用于存储计算机可读指令，当所述计算机可读指令被一个或多个处理器执行时实现如权利要求1-10权利要求19-23任意一项所述的方法。
PCT/CN2020/106631 2019-08-09 2020-08-03 一种切换通信协议的方法、装置和系统 WO2021027610A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20852498.3A EP4013003A4 (en) 2019-08-09 2020-08-03 COMMUNICATION PROTOCOL SWITCHING METHOD, APPARATUS AND SYSTEM
US17/667,912 US12120162B2 (en) 2019-08-09 2022-02-09 Communication protocol switching method, apparatus, and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910736647.3A CN112350981B (zh) 2019-08-09 2019-08-09 一种切换通信协议的方法、装置和系统
CN201910736647.3 2019-08-09

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/667,912 Continuation US12120162B2 (en) 2019-08-09 2022-02-09 Communication protocol switching method, apparatus, and system

Publications (1)

Publication Number Publication Date
WO2021027610A1 true WO2021027610A1 (zh) 2021-02-18

Family

ID=74367686

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/106631 WO2021027610A1 (zh) 2019-08-09 2020-08-03 一种切换通信协议的方法、装置和系统

Country Status (4)

Country Link
US (1) US12120162B2 (zh)
EP (1) EP4013003A4 (zh)
CN (2) CN115396521A (zh)
WO (1) WO2021027610A1 (zh)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111629371B (zh) * 2020-05-06 2021-09-03 上海幻电信息科技有限公司 投屏方法和系统
CN113194445A (zh) * 2021-04-15 2021-07-30 厦门亿联网络技术股份有限公司 一种连接方法及装置
CN115278612A (zh) * 2021-04-30 2022-11-01 华为技术有限公司 一种投音方法及计算机可读存储介质
CN115460445B (zh) * 2021-06-09 2024-03-22 荣耀终端有限公司 电子设备的投屏方法和电子设备
CN113542839B (zh) * 2021-06-09 2022-10-18 荣耀终端有限公司 电子设备的投屏方法和电子设备
CN113438527A (zh) * 2021-06-25 2021-09-24 北京奇艺世纪科技有限公司 一种视频投屏方法、装置、设备和存储介质
CN113810760B (zh) * 2021-08-17 2023-04-21 荣耀终端有限公司 控制投屏的方法、电子设备及计算机可读存储介质
CN114995732B (zh) * 2021-09-06 2024-04-23 荣耀终端有限公司 一种投屏方法、电子设备以及存储介质
CN114257678A (zh) * 2022-03-02 2022-03-29 深圳中科智能技术有限公司 一种手机数据互通方法和系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103618941A (zh) * 2013-12-13 2014-03-05 深圳市特纳电子有限公司 一种基于多屏互动的交互式系统及方法
US20150095510A1 (en) * 2013-09-30 2015-04-02 Cavium, Inc. Protocol Switching over Multi-Network Interface
CN107801064A (zh) * 2016-09-05 2018-03-13 中国移动通信集团公司 一种多屏互动系统的自修复的方法及装置
CN108200215A (zh) * 2014-11-11 2018-06-22 海信集团有限公司 一种多媒体分享方法

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10805861B2 (en) * 2013-05-08 2020-10-13 Cellcontrol, Inc. Context-aware mobile device management
US10268530B2 (en) * 2013-05-08 2019-04-23 Cellcontrol, Inc. Managing functions on an iOS-based mobile device using ANCS notifications
WO2014182971A2 (en) * 2013-05-08 2014-11-13 Obdedge, Llc Driver identification and data collection systems for use with mobile communication devices in vehicles
KR101829843B1 (ko) * 2014-02-06 2018-03-29 엘지전자 주식회사 와이파이 디스플레이 서비스 수행 방법 및 이를 위한 장치
CN105208434A (zh) * 2014-06-11 2015-12-30 阿里巴巴集团控股有限公司 媒体投影方法、媒体投影设备、控制终端以及云端服务器
US20160188279A1 (en) * 2014-12-27 2016-06-30 Intel Corporation Mode-switch protocol and mechanism for hybrid wireless display system with screencasting and native graphics throwing
CN105354002B (zh) * 2015-10-29 2018-06-19 四川奇迹云科技有限公司 一种实现多屏间视频无缝切换的系统及方法
CN105681881A (zh) 2015-11-06 2016-06-15 乐视移动智能信息技术（北京）有限公司 一种基于移动终端的多媒体数据发送方法及移动终端
CN105760127A (zh) * 2016-02-19 2016-07-13 浙江吉利控股集团有限公司 一种传屏方法、传屏装置及移动终端
CN106502604A (zh) 2016-09-28 2017-03-15 北京小米移动软件有限公司 投屏切换方法及装置
CN106488207A (zh) * 2016-11-23 2017-03-08 努比亚技术有限公司 一种基于dlna协议的多屏投影方法及终端
CN106454299A (zh) * 2016-11-29 2017-02-22 努比亚技术有限公司 一种终端之间的屏幕投影方法及装置、终端
CN106658366B (zh) * 2016-11-30 2020-05-22 建荣半导体（深圳）有限公司 蓝牙工作模式的切换方法、装置及蓝牙芯片、电子设备
CN107608647A (zh) * 2017-09-12 2018-01-19 威创集团股份有限公司 一种投屏方法、系统、服务器及计算机可读存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150095510A1 (en) * 2013-09-30 2015-04-02 Cavium, Inc. Protocol Switching over Multi-Network Interface
CN103618941A (zh) * 2013-12-13 2014-03-05 深圳市特纳电子有限公司 一种基于多屏互动的交互式系统及方法
CN108200215A (zh) * 2014-11-11 2018-06-22 海信集团有限公司 一种多媒体分享方法
CN107801064A (zh) * 2016-09-05 2018-03-13 中国移动通信集团公司 一种多屏互动系统的自修复的方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4013003A4 *

Also Published As

Publication number Publication date
CN115396521A (zh) 2022-11-25
EP4013003A4 (en) 2022-09-07
US20220239718A1 (en) 2022-07-28
CN112350981A (zh) 2021-02-09
EP4013003A1 (en) 2022-06-15
US12120162B2 (en) 2024-10-15
CN112350981B (zh) 2022-07-29

Similar Documents

Publication Publication Date Title
WO2021027610A1 (zh) 一种切换通信协议的方法、装置和系统
WO2021018008A1 (zh) 一种投屏方法与电子设备
US10659200B2 (en) Companion application for activity cooperation
US9436650B2 (en) Mobile device, display device and method for controlling the same
US11134113B2 (en) User interface content state synchronization across devices
JP6228676B2 (ja) 接続状態プロンプティング方法および装置
US20130318158A1 (en) User interface content state synchronization across devices
US8966138B2 (en) Communication between a host device and an accessory using multiple-endpoint identification
EP2719156B1 (en) Techniques for facilitating interoperation between an accessory and multiple devices
WO2021175214A1 (zh) 一种投屏连接控制方法及电子设备
WO2022127661A1 (zh) 应用共享方法、电子设备和存储介质
CN106303679B (zh) 媒体播放控制方法及媒体播放客户端
US11750673B2 (en) User interface content state synchronization across devices
US12028300B2 (en) Method, apparatus, and system for sending pictures after thumbnail selections
WO2024045985A1 (zh) 屏幕控制方法、屏幕控制装置、电子设备、程序及介质
CN116029746B (zh) 数据处理方法及相关装置
US11758594B2 (en) Communication apparatus, method of controlling the same, and storage medium
KR20120105318A (ko) 프레젠테이션 데이터 공유 방법 및 이를 이용하는 이동 단말기
WO2022042592A1 (zh) 投屏方法、装置、电子设备及计算机可读介质
CN114995732A (zh) 一种投屏方法、电子设备以及存储介质
TW201344459A (zh) 電子裝置間的連線建立方法及系統
WO2024051336A1 (zh) 内容协同方法、装置、系统、存储介质及电子设备
WO2016070372A1 (zh) 用于在移动设备和web终端之间进行同步显示的方法
WO2016070371A1 (zh) 移动终端和web终端之间互连及流传输和流媒体播放的方法
CN115102942A (zh) 显示系统及其遥控方法、装置、设备、存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20852498

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020852498

Country of ref document: EP

Effective date: 20220308