CN115834936A - Multi-device screen projection or content connection method, electronic device and device - Google Patents

Multi-device screen projection or content connection method, electronic device and device Download PDF

Info

Publication number
CN115834936A
CN115834936A CN202111101585.2A CN202111101585A CN115834936A CN 115834936 A CN115834936 A CN 115834936A CN 202111101585 A CN202111101585 A CN 202111101585A CN 115834936 A CN115834936 A CN 115834936A
Authority
CN
China
Prior art keywords
electronic device
screen projection
screen
information
electronic equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111101585.2A
Other languages
Chinese (zh)
Inventor
王先峰
胡诗尧
张华翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202111101585.2A priority Critical patent/CN115834936A/en
Priority to PCT/CN2022/111509 priority patent/WO2023040524A1/en
Publication of CN115834936A publication Critical patent/CN115834936A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the application discloses a screen projection continuing method which is applied to a system comprising a mobile terminal, a first electronic device and a second electronic device. The method comprises the steps that the mobile terminal establishes first screen projection connection with first electronic equipment and sends first screen projection information to the first electronic equipment, so that the first electronic equipment displays first screen projection content according to the first screen projection information; the second electronic equipment acquires a trigger event of continuous screen projection, wherein the trigger event of continuous screen projection is used for triggering the second electronic equipment to perform continuous screen projection; the second electronic device finds the first electronic device which is projecting the screen, and obtains the first screen projecting information from the first electronic device, so that the second electronic device displays the first screen projecting content according to the first screen projecting information. Multi-device screen projection or content connection can be realized.

Description

Multi-device screen projection or content connection method, electronic device and device
Technical Field
The embodiment of the application relates to the technical field of communication, in particular to a multi-device screen projection or content connection method, an electronic device and a computer-readable storage medium.
Background
Along with the development of intelligent house, the intelligent audio-visual equipment that the house used is abundant various, and the terminal equipment that is used for playing content or operation content wherein is more and more diversified, and wherein the video broadcast that realizes between many terminal equipment through throwing the screen becomes user's common mode. In addition, when a user switches an activity scene at home, switching between screen projection or content connection and screen projection control among multiple terminal devices corresponding to multiple activity scenes is required, so that the effect of screen projection or content connection of multiple terminal devices is achieved through one screen projection operation. At present, corresponding to switching of screen projection or content connection and screen projection control, when switching a screen projection of a terminal device, multiple complex steps of disconnecting a current screen projection control connection, identifying the current screen projection or content, acquiring a state of the screen projection or content, rescanning and establishing screen projection control, reacquiring the screen projection or content and the like need to be performed, power consumption, operation duration and the like of each terminal device are not optimized, and poor user experience is brought to a certain degree.
Disclosure of Invention
The embodiment of the application provides a screen projection or content connection method, an electronic device and a computer readable storage medium.
In a first aspect, an embodiment of the present application provides a screen projection continuation method, which is applied to a system including a mobile terminal, a first electronic device, and a second electronic device, where the method includes that the mobile terminal establishes a first screen projection connection with the first electronic device, and sends first screen projection information to the first electronic device, so that the first electronic device displays first screen projection content according to the first screen projection information; the second electronic equipment acquires a trigger event of continuous screen projection, wherein the trigger event of continuous screen projection is used for triggering the second electronic equipment to perform continuous screen projection; the second electronic device finds the first electronic device which is projecting the screen, and obtains the first screen projecting information from the first electronic device, so that the second electronic device displays the first screen projecting content according to the first screen projecting information. By adopting the screen-throwing connection method of the embodiment of the application, the second electronic equipment can automatically or according to the operation of a user to trigger the continuous screen throwing, automatically discover the first electronic equipment throwing the screen, and automatically acquire screen-throwing information from the first electronic equipment, so that the automatic continuous screen throwing is realized, the screen-throwing information does not need to be acquired through a mobile terminal, and the process of automatic continuous screen throwing is simplified; in addition, the user does not need to operate the mobile terminal to realize the automatic continuous screen projection of the second electronic device, and great convenience is brought to the user.
According to the first aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and the finding, by the second electronic device, of the first electronic device that is being subjected to screen projection includes: the first electronic equipment broadcasts a first message in the local area network, so that the second electronic equipment determines that the first electronic equipment is a screen-casting equipment according to the first message; therefore, the first electronic equipment realizes that the second electronic equipment discovers the first electronic equipment which is shooting the screen in an active notification mode. In one possible implementation, the first message may include on-screen information. Based on the design, the first electronic device actively broadcasts the screen projection information, and the second electronic device determines that the first electronic device is the screen projection device, so that the second electronic device does not need to perform relevant discovery operations, discovery processes are simplified, and efficiency is improved.
Or the second electronic equipment broadcasts a second message in the local area network; the first electronic equipment responds to the second message and sends a third message to the second electronic equipment, so that the second electronic equipment determines that the first electronic equipment is a screen-casting equipment according to the third message; in this way, the second electronic device realizes that the second electronic device finds the first electronic device which is shooting the screen in a mode of inquiry finding. In one possible implementation, the second message may include a discovery request; the third message may include a presence notification. Based on the design, the second electronic device can discover the first electronic device which is shooting through an active notification mode or a query discovery mode, and communication can be established quickly.
According to the first aspect, in a possible implementation manner, the acquiring, by the second electronic device, the first screen projection information from the first electronic device includes: the second electronic equipment sends a screen projection information acquisition request; the first electronic equipment responds to the screen projection information acquisition request and sends the first screen projection information to the second electronic equipment, so that the second electronic equipment acquires the first screen projection information; or the first electronic device carries the first screen projection information in the first message or the third message, so that the second electronic device obtains the first screen projection information. In a possible implementation manner, the second message may include a screen-projection information obtaining request, or the screen-projection information obtaining request may be a message different from the second message. Based on the design, the second electronic device can acquire the first screen projection information from the first electronic device in multiple modes, and screen projection information does not need to be acquired again through the mobile terminal, so that the communication process among multiple terminal devices is simplified, and the screen projection continuing efficiency is improved.
According to the first aspect, in a possible implementation manner, the trigger event of the successive screen shots includes one or more of the following items: the second electronic device is started; the second electronic equipment detects that the user enters a detection range; the second electronic equipment acquires other detection or sensing equipment and detects that the user enters the detection range; the second electronic equipment acquires other equipment with a wireless positioning function and detects that the mobile terminal enters the detection range; the second electronic device determining that a user has an intent to view the second electronic device; the second electronic device determining that a user enters a room in which the second electronic device is installed; and the second electronic equipment receives an indication message for indicating the second electronic equipment to continuously cast a screen. Based on the design, the mode of triggering the continuous screen projection can comprise various modes such as active triggering or passive triggering, and the like, wherein a user can continuously project the screen of the second electronic device in a passive triggering mode according to personal wishes, so that user selection and operation are provided; the second electronic device can detect the behaviors or postures of the user in an active triggering mode, and the screen is automatically continuously projected, so that the user can automatically continuously project the screen according to the dynamic state of the user without operating, and the user experience is improved.
According to the first aspect, in a possible implementation manner, the first screen projection information includes first screen projection resource information and first screen projection status information, and the first electronic device displays first screen projection content according to the first screen projection information, including: the first electronic equipment acquires the first screen projection content from a server according to the first screen projection resource information, so that the first electronic equipment displays the first screen projection content in a screen projection state indicated by the first screen projection state information; the second electronic device displays the first screen projection content according to the first screen projection information, and the method comprises the following steps: and the second electronic equipment acquires the first screen projection content from a server according to the first screen projection resource information, so that the second electronic equipment displays the first screen projection content in a screen projection state indicated by the first screen projection state information. Based on the design, the first electronic device and the second electronic device can acquire the screen projection content based on the DLNA implementation mode, and the second electronic device does not need to acquire the first screen projection content from the mobile terminal, so that the communication flow is simplified, and the communication efficiency is improved; in addition, the second electronic equipment can automatically acquire the first screen projection content from the server according to the first screen projection resource information without operating the mobile terminal, the first electronic equipment and the second electronic equipment by a user, so that convenience is brought to the user; moreover, the second electronic device displays the first screen projection content in the first screen projection state, so that the second electronic device and the first electronic device can have better continuity when continuing to project the screen, a user does not need to operate again to continuously watch the first screen projection content, and excellent user experience is provided.
According to the first aspect, in a possible implementation manner, the first screen projection resource information includes a uniform resource identifier URI, the first screen projection state information includes one or more of a play progress, a play volume, and a play state, and the play state includes one or more of play, pause, double speed, full screen, and split screen. Based on the design, the second electronic device can correspondingly continue to screen the first screen projection content according to the specific screen projection state, so that a user can obtain better continuous experience when the electronic device is switched to continue browsing or watching the first screen projection content.
According to the first aspect, in a possible implementation manner, the terminal device obtains networking information of the second electronic device; and the terminal equipment disconnects the first screen projection connection with the first electronic equipment, and establishes a second screen projection connection with the second electronic equipment according to the networking information. Based on the design, after the second electronic device realizes screen projection connection, the screen projection control link between the mobile terminal and the first electronic device can be transferred to the second electronic device, and a new screen projection control link is established between the mobile terminal and the second electronic device, so that a user can control screen projection contents displayed by the second electronic device through the mobile terminal, or the user can directly operate the second electronic device to control the displayed screen projection contents, thereby providing multiple control modes for the user and improving user experience.
According to the first aspect, in a possible implementation manner, after the terminal device establishes the second screen-casting connection with the second electronic device, the method further includes: and the second electronic equipment sends the second screen projection information to the first electronic equipment, wherein the second screen projection information is different from the first screen projection information. In one possible implementation manner, the second screen projection information may include: second screen projection resource information different from the first screen projection resource information, and/or second screen projection state information different from the first screen projection state information. Based on the design, after the screen projection control link is transferred to the second electronic device, the second electronic device can synchronize the screen projection information to the first electronic device or to the mobile terminal; when the second screen projection information is triggered by the mobile terminal, the second electronic device can synchronize the screen projection information to the first electronic device only, so that screen projection state synchronization among the multiple terminal devices is kept, and browsing and watching continuity of a user among the multiple terminal devices is provided.
According to the first aspect, in a possible implementation manner, the first electronic device sends second screen projection information to the second electronic device, where the second screen projection information is different from the first screen projection information. Based on such a design, after the second electronic device realizes the screen projection continuation, the mobile terminal may maintain the screen projection control link with the first electronic device, the mobile terminal updates the screen projection content, or the first electronic device updates the screen projection content, and the first electronic device synchronizes to the second electronic device, so that the screen projection state synchronization among the multiple terminal devices is maintained, and the continuity of browsing and viewing among the multiple terminal devices by the user is provided.
According to the first aspect, in a possible implementation manner, the displaying, by the second electronic device, the first screen projection content according to the first screen projection information includes: and the second electronic equipment sends out an inquiry message for judging whether to perform continuous screen projection, and displays the first screen projection content according to the first screen projection information under the condition of receiving a positive response responding to the inquiry message. Based on the design, the second electronic device can determine whether to display the first screen projection content through interaction with the user, actively inquire the user by the second electronic device, and the user can select whether to continue screen projection by operating the electronic device according to the will, so that the real-time participation sense of the user is provided, more selection spaces of the user are provided, and the participation degree and experience of the user are improved.
In a possible implementation manner, the first screen projection information includes the first screen projection content according to the first aspect. In a possible implementation manner, when a mirror image screen projection manner is adopted among the multiple terminal devices, the first screen projection information may include first screen projection content, and the mobile terminal may directly provide the screen projection content to the first electronic device and the second electronic device. Based on the design, the first electronic device and the second electronic device can acquire the screen projection content based on the implementation mode of the mirror image data stream without extracting the screen projection content from the server, so that the communication flow is simplified, and the communication efficiency is improved.
In a second aspect, an embodiment of the present application further provides a screen projection continuation method, which is applied to a first electronic device, and the method includes: the first electronic equipment establishes first screen projection connection with the mobile terminal and acquires first screen projection information from the mobile terminal, so that the first electronic equipment displays first screen projection content according to the first screen projection information; the first electronic equipment provides the first screen projection information to second electronic equipment, and the first screen projection information is used for displaying the first screen projection content by the second electronic equipment.
With reference to the second aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and before the first electronic device provides the first screen projection information to the second electronic device, the method further includes: the first electronic equipment broadcasts a first message in the local area network, wherein the first message carries indication information that the first electronic equipment is throwing a screen;
the first electronic device provides the first screen projection information to a second electronic device, and the method comprises the following steps: and the first electronic equipment responds to a screen projection information acquisition request sent by the second electronic equipment and sends the first screen projection information to the second electronic equipment.
With reference to the second aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and the first electronic device provides the first screen projection information to the second electronic device, including: and the first electronic equipment broadcasts the first screen projection information in the local area network.
With reference to the second aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and before the first electronic device provides the first screen projection information to the second electronic device, the method further includes: and the first electronic equipment receives a second message broadcast by the second electronic equipment in the local area network.
With reference to the second aspect, in a possible implementation manner, the first screen projection information includes first screen projection resource information and first screen projection status information, and the first electronic device displays first screen projection content according to the first screen projection information, including: the first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the first electronic device displays the first screen projection content in a screen projection state indicated by the first screen projection state information.
With reference to the second aspect, in a possible implementation manner, the first screen projection resource information includes a uniform resource identifier URI, the first screen projection state information includes one or more of a play progress, a play volume, and a play state, and the play state includes one or more of play, pause, double speed, full screen, and split screen.
With reference to the second aspect, in a possible implementation manner, the method further includes: and the first electronic equipment acquires networking information of the second electronic equipment and sends the networking information to the terminal equipment.
With reference to the second aspect, in a possible implementation manner, the method further includes: the first electronic device sends second screen projection information to the second electronic device, wherein the second screen projection information is different from the first screen projection information.
With reference to the second aspect, in one possible implementation manner, the first screen projection information includes first screen projection content.
In a third aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, and the processor is configured to implement the screen-projection continuation method as described above when executing a computer program stored in the memory.
In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the screen-projection continuation method as described above.
In a fifth aspect, an embodiment of the present application further provides a screen projection continuation method applied to a second electronic device, where the method includes: the second electronic equipment acquires a trigger event of continuous screen projection, wherein the trigger event of continuous screen projection is used for triggering the second electronic equipment to perform continuous screen projection; the second electronic device discovers the first electronic device which is throwing the screen; the second electronic equipment acquires first screen projection information from the first electronic equipment, so that the second electronic equipment displays first screen projection content according to the first screen projection information.
With reference to the fifth aspect, in a possible implementation manner, the second electronic device, the mobile terminal, and the first electronic device are in the same local area network, and the discovering, by the second electronic device, of the first electronic device that is being subjected to screen projection includes: the second electronic equipment acquires a first message broadcasted by the first electronic equipment in the local area network, so that the second electronic equipment determines that the first electronic equipment is a screen-casting equipment according to the first message; or the second electronic device broadcasts a second message in the local area network, and acquires a third message sent by the first electronic device in response to the second message, so that the second electronic device determines that the first electronic device is a device which is throwing a screen according to the third message.
With reference to the fifth aspect, in a possible implementation manner, the acquiring, by the second electronic device, the first screen projection information from the first electronic device includes: the second electronic equipment sends a screen-projecting information acquisition request; the second electronic equipment receives the first screen projection information sent to the second electronic equipment by the first electronic equipment in response to the screen projection information acquisition request; or the second electronic device obtains the first screen projection information from the first message carrying the first screen projection information; or the second electronic device obtains the first screen projection information from the third message carrying the first screen projection information.
With reference to the fifth aspect, in one possible implementation manner, the trigger event of successive screen shots includes one or more of the following: the second electronic device is started; the second electronic equipment detects that the user enters a detection range; the second electronic equipment acquires other detection or sensing equipment and detects that the user enters the detection range; the second electronic equipment acquires other equipment with a wireless positioning function and detects that the mobile terminal enters the detection range; the second electronic device determining that a user has an intent to view the second electronic device; the second electronic device determining that a user enters a room in which the second electronic device is installed; and the second electronic equipment receives an indication message for indicating the second electronic equipment to continuously cast a screen.
With reference to the fifth aspect, in a possible implementation manner, the first screen projection information includes first screen projection resource information and first screen projection status information, and the second electronic device displays the first screen projection content according to the first screen projection information, including: and the second electronic equipment acquires the first screen projection content from a server according to the first screen projection resource information, so that the second electronic equipment displays the first screen projection content in a screen projection state prompted by the first screen projection state information.
With reference to the fifth aspect, in a possible implementation manner, the first screen projection resource information includes a uniform resource identifier URI, the first screen projection state information includes one or more of a play progress, a play volume, and a play state, and the play state includes one or more of play, pause, double speed, full screen, and split screen.
With reference to the fifth aspect, in a possible implementation manner, the method further includes: the second electronic equipment sends networking information of the second electronic equipment to the first electronic equipment; the second electronic equipment and the terminal equipment establish second screen projection connection; and the second electronic equipment acquires second screen projection information different from the first screen projection information from the terminal equipment through the second screen projection connection, so that the second electronic equipment displays second screen projection content according to the second screen projection information.
With reference to the fifth aspect, in a possible implementation manner, the method further includes: and the second electronic equipment sends the second screen projection information to the first electronic equipment.
With reference to the fifth aspect, in a possible implementation manner, the method further includes: and the second electronic equipment acquires second screen projection information sent by the first electronic equipment, wherein the second screen projection information is different from the first screen projection information.
With reference to the fifth aspect, in a possible implementation manner, the displaying, by the second electronic device, the first screen projection content according to the first screen projection information includes: and the second electronic equipment sends out an inquiry message for judging whether to perform continuous screen projection, and displays the first screen projection content according to the first screen projection information under the condition of receiving a positive response responding to the inquiry message.
With reference to the fifth aspect, in one possible implementation manner, the first screen projection information includes the first screen projection content.
In a sixth aspect, an embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the processor is configured to implement the screen-projection continuation method when executing a computer program stored in the memory.
In a seventh aspect, embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the screen projection continuation method as described above.
In addition, the technical effects brought by any one of the possible design manners in the second aspect to the seventh aspect can be referred to the technical effects brought by different design manners in the association of the screen projection continuation method, and are not described herein again.
In an eighth aspect, an embodiment of the present application further provides a content connection method, which is applied in a system including a first electronic device and a second electronic device, and the method includes: the first electronic equipment operates and displays first content; the second electronic device obtains a content connection triggering event, wherein the content connection triggering event is used for triggering the second electronic device to perform content connection; the second electronic device finds the first electronic device running the first content, and obtains first running information from the first electronic device, so that the second electronic device runs and displays the first content according to the first running information. In one possible implementation manner, the first content executed by the first electronic device may include an Application program (APP). By adopting the screen-casting continuing method of the embodiment of the application, the second electronic equipment can automatically trigger content continuation according to user operation, automatically discover the first electronic equipment running the first content, and automatically acquire running information from the first electronic equipment, so that automatic content continuation is realized, continuity of browsing or watching the first content by a user is provided, and user experience is improved; in addition, the user also can realize the automatic content connection of the second electronic equipment without operation, thereby greatly facilitating the user.
With reference to the eighth aspect, in a possible implementation manner, the first electronic device and the second electronic device are in the same local area network, and the discovering, by the second electronic device, of the first electronic device running first content includes: the first electronic device broadcasts a first message in the local area network, so that the second electronic device determines that the first electronic device is a device running first content according to the first message; in this way, the first electronic device realizes that the second electronic device discovers the first electronic device running the first content in an active notification manner. In one possible implementation, the first message may include running information. Based on the design, the first electronic device actively broadcasts the running information, and the second electronic device determines that the first electronic device is the device running the first content, so that the second electronic device does not need to perform related discovery operations, discovery processes are simplified, and efficiency is improved.
Or the second electronic equipment broadcasts a second message in the local area network; the first electronic device sends a third message to the second electronic device in response to the second message, so that the second electronic device determines that the first electronic device is a device running the first content according to the third message; in this way, the second electronic device realizes that the second electronic device discovers the first electronic device running the first content by means of query discovery. In one possible implementation, the second message may include a discovery request; the third message may include a presence notification. Based on the design, the second electronic device can discover the first electronic device running the first content in an active notification mode or a query discovery mode, and can quickly establish communication.
With reference to the eighth aspect, in a possible implementation manner, the acquiring, by the second electronic device, the first operation information from the first electronic device includes: the second electronic equipment sends an operation information acquisition request; the first electronic device responds to the operation information acquisition request and sends the first operation information to the second electronic device, so that the second electronic device acquires the first operation information; or, the first electronic device carries the first operation information in the first message or the third message, so that the second electronic device obtains the first operation information. Based on the design, the second electronic device can acquire the first operation information from the first electronic device in multiple modes, and the operation information is acquired without the operation of a user, so that the operation process of the user is simplified, and the user experience is improved.
With reference to the eighth aspect, in a possible implementation manner, the triggering event of content continuation includes one or more of the following: the second electronic device is started; the second electronic equipment detects that the user enters a detection range; the second electronic equipment acquires other detection or sensing equipment and detects that the user enters the detection range; the second electronic equipment acquires other equipment with a wireless positioning function and detects that the mobile terminal enters the detection range; the second electronic device determining that a user has an intent to view the second electronic device; the second electronic device determining that a user enters a room in which the second electronic device is installed; and the second electronic equipment receives an indication message for indicating the second electronic equipment to carry out content connection. Based on the design, the content connection triggering mode can include various modes such as active triggering or passive triggering, and the like, wherein a user can enable the second electronic device to perform content connection through the passive triggering mode according to personal wishes, and user selection and operation are provided; the second electronic device can also detect the behavior or posture of the user and the like in an active triggering mode to automatically perform content connection, so that the user can automatically perform screen connection and screen projection according to the user dynamic state without operation, and the user experience is improved.
With reference to the eighth aspect, in a possible implementation manner, the first operation information includes the first content information, a first display interface, and first operation state information, and the operating and displaying the first content by the second electronic device according to the first operation information includes: and the second electronic equipment runs the first content corresponding to the first content information in the running state indicated by the first running state information according to the first content information and the first running state information, and displays a first display interface corresponding to the first content. Based on the design, the second electronic device can correspondingly continue to operate the first content according to the specific operation state of the first content in the first electronic device, so that the second electronic device and the first electronic device have better continuity when the content is continued, a user does not need to operate again to continue browsing or watching the first content, and excellent user experience is provided.
With reference to the eighth aspect, in a possible implementation manner, the first content information includes an application program that runs, the first display interface includes an interface of the application program, and the first running state information includes a running state of the application program. Based on such a design, the second electronic device may correspondingly continue to operate the first content in the specific operation state of the first electronic device according to the first content, so that the second electronic device realizes content continuation at least in the operation application, the interface of the application, and the operation state of the application.
With reference to the eighth aspect, in a possible implementation manner, after the second electronic device operates and displays the first content according to the first operation information, the first electronic device continues to operate and display the first content; or the first electronic equipment stops running and displays the first content. Based on the design, after the second electronic device performs content connection, the first electronic device can continue or stop running the first content, so as to provide selective operation among multiple devices for a user.
Drawings
Fig. 1 is an architecture diagram of an application environment of a screen projection continuation method according to an embodiment of the present application.
Fig. 2 is a flowchart of a screen projection continuation method according to an embodiment of the present application.
Fig. 3 is a schematic view of an application scenario of a screen projection continuation method according to an embodiment of the present application.
Fig. 4 is a schematic view of an interface of an electronic device according to an embodiment of the present disclosure.
Fig. 5 is a schematic application scenario diagram of a screen projection continuation method according to another embodiment of the present application.
Fig. 6 is a schematic view of an application scenario of screen projection control transfer of a screen projection continuation method according to an embodiment of the present application.
Fig. 7 is a schematic view of an application scenario of synchronous screen projection information of a screen projection continuation method according to an embodiment of the present application.
Fig. 8 is a flowchart of a content connection method according to an embodiment of the present application.
Fig. 9 is a schematic diagram of an electronic device according to an embodiment of the present application.
Description of the main elements
First space 12
Second space 14
Mobile terminal 20
First electronic device 30
Second electronic device 40
Display interface 42
Dialog box 44
First icon 46
Second icon 48
Server 50
Electronic device 60
Memory 61
Processor 62
Display module 63
Communication module 64
Computer program 65
The following detailed description will further illustrate the present application in conjunction with the above-described figures.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The term "and/or" in the present application is an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The symbol "/" herein denotes an association of or, e.g., a/B denotes a or B.
In the embodiments of the present application, the terms "first", "second", and the like are used only for distinguishing different objects, and are not intended to indicate or imply relative importance, nor order to indicate or imply order. For example, a first application, a second application, etc. is used to distinguish between different applications and not to describe a particular order of applications, and a feature defined as "first", "second", etc. may explicitly or implicitly include one or more of that feature.
In the description of the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or illustrations. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present relevant concepts in a concrete fashion.
Please refer to fig. 1, which is a schematic diagram of an application environment architecture of a screen-projection continuation method according to an embodiment of the present application.
The screen projection continuing method can be applied to an environment formed by a plurality of terminal devices. For example, as shown in FIG. 1, which is a plan view of a home, may include a plurality of spaced-apart spaces/rooms, e.g., a first space 12 and a second space 14. In some embodiments, the first space 12 may be, but is not limited to, a living room, and the second space 14 may be, but is not limited to, a bedroom, it being understood that the home environment further includes more spaced-apart spaces, such as balconies, kitchens, toilets, and the like, which are not listed here.
The screen projection continuing method can be based on a Digital Living Network Alliance (DLNA) screen projection technology and is applied among a plurality of terminal devices. In some embodiments, the plurality of terminal devices includes at least the mobile terminal 20, the first electronic device 30, and the second electronic device 40. The mobile terminal 20 may be, but is not limited to, a smart phone, a tablet computer, a handheld computer, a Personal Digital Assistant (PDA), a game machine, a smart wearable device, or other mobile electronic devices with wireless communication function. The first electronic device 30 and the second electronic device 40 may be, but not limited to, a Television, an Internet Protocol Television (IPTV), a video player, a display, a smart Television, a large screen device, a tablet computer, or other electronic devices with a video playing function. In some embodiments, the first electronic device 30 can be placed in the first space 12, and the second electronic device 40 can be placed in the second space 14. It is understood that the first electronic device 30 and the second electronic device 40 may have larger display screens than the mobile terminal 20, providing a better visual experience for the user.
In some embodiments, the mobile terminal 20, the first electronic device 30 and the second electronic device 40 can communicate with each other through a Network, such as a Local Area Network (LAN), and can also communicate with a server 50 through the Network. The network may be, but is not limited to, a combination of one or more of WiFi, fiber optic, or cellular data transmission. In some embodiments, the server 50 may be, but is not limited to, a cloud database, providing for querying and retrieving resources or data.
In some embodiments, in order to implement the screen-casting connection, that is, after the mobile terminal 20 establishes the screen-casting connection with the first electronic device 30, the mobile terminal 20 provides the screen-casting content or provides the screen-casting resource information, the first electronic device 30 displays or plays the screen-casting content corresponding to the screen-casting content or the screen-casting resource information, and switches to the second electronic device 40 to continuously display or play the screen-casting content corresponding to the screen-casting content or the screen-casting resource information, a user needs to first disconnect the screen-casting connection between the mobile terminal 20 and the first electronic device 30, then re-search the screen-casting content and position the screen-casting content progress through the mobile terminal 20, then re-scan the connectable terminal device through the mobile terminal 20, select the screen-casting connection with the second electronic device 40 by the mobile terminal 20, finally provide the screen-casting content or the screen-casting resource information through the mobile terminal 20, and display or play the screen-casting content corresponding to the screen-casting resource information by the second electronic device 40, so as to complete the screen-casting connection. The mobile terminal 20, the first electronic device 30 and the second electronic device 40 may be different terminal devices. The implementation mode of the screen projection continuing method is complex in operation flow, power consumption of each terminal device and operation flow duration are not optimized enough, and user experience is not good.
In view of this, in the present embodiment, a screen-casting continuing method is provided, in which a mobile terminal 20 establishes a first screen-casting connection with a first electronic device 30, and sends first screen-casting information to the first electronic device 30, so that the first electronic device 30 displays first screen-casting content according to the first screen-casting information; the method comprises the steps that a second electronic device 40 obtains a trigger event of continuous screen projection, wherein the trigger event of continuous screen projection is used for triggering the second electronic device 40 to perform continuous screen projection; the second electronic device 40 finds the first electronic device 30 which is throwing the screen, and acquires the first screen throwing information from the first electronic device 30, so that the second electronic device 40 displays the first screen throwing content according to the first screen throwing information, continuous screen throwing among a plurality of terminal devices is achieved, a user can switch continuous screen throwing among the plurality of terminal devices, the screen throwing is conveniently controlled by the user under the condition of scene switching, the screen throwing information is synchronously thrown among the plurality of terminal devices, the playing of the screen throwing content is automatically continued, and better viewing experience of the user is provided.
Next, a screen projection continuation method provided in an embodiment of the present application is described in detail with reference to the drawings.
Please refer to fig. 2, which is a flowchart illustrating a screen-casting continuation method according to an embodiment of the present application. Illustratively, the screen-casting continuing method may include the following steps.
Step S211: the mobile terminal 20 establishes a first screen-casting connection with the first electronic device 30.
In some embodiments, the mobile terminal 20 provides first screen projection information to the first electronic device 30, where the first screen projection information may include first screen projection resource information, the first electronic device 30 may obtain screen projection content according to the first screen projection resource information and may display the screen projection content, and the mobile terminal 20 may control the screen projection content of the first electronic device 30. For example, when a user browses content in the first space 12 using the mobile terminal 20, for example, plays video content, the mobile terminal 20 provides first screen projection resource information corresponding to screen projection content, the first electronic device 30 obtains the screen projection content according to the first screen projection resource information and displays or plays the screen projection content, for example, the mobile terminal 20 provides the first screen projection resource information corresponding to video content, and the first electronic device 30 obtains the video content according to the first screen projection resource information and plays the video content, thereby obtaining better visual experience. In another embodiment, the screen shot content is not limited to playing video content, but may also be playing audio content or other displayable browsing content.
In some embodiments, the mobile terminal 20 may establish a screen-casting connection with the first electronic device 30 through DLNA, the mobile terminal 20 may send first screen-casting Resource information to the first electronic device 30, where the first screen-casting Resource information at least includes a network address of the broadcast content, for example, a Uniform Resource Identifier (URI) address, and the first electronic device 30 may obtain the broadcast content from the server 50 according to the network address, so that the first electronic device 30 and the mobile terminal 20 may synchronously display the broadcast content (i.e., screen-casting content), or the mobile terminal 20 stops displaying the broadcast content after the first electronic device 30 starts displaying the broadcast content. Optionally, the mobile terminal 20 may perform a screen projection control on the first electronic device 30, for example, the mobile terminal 20 may perform a screen projection control on the screen projection content of the first electronic device 30, such as playing, pausing, stopping, fast forwarding/rewinding, adjusting the volume, displaying in a full screen, displaying in a split screen, adjusting the display scale, and the like. Therefore, the user can conveniently remotely control the screen-projected content of the first electronic device 30 through the mobile terminal 20 which is convenient to carry and operate, so as to obtain better operation experience. In some embodiments, the first screen projection resource information may further include first screen projection state information for carrying the screen projection control information generated by the mobile terminal 20, so that the first electronic device 30 displays the playing content according to the first screen projection state information. In some embodiments, the screen projection Control may be implemented by a Control link established through a Simple Object Access Protocol (SOAP) connected by a Transmission Control Protocol (TCP) based on DLNA.
In addition, the first electronic device 30 may also directly obtain user operations to implement control of screen-shot content, such as playing, pausing, stopping, fast forwarding/rewinding, adjusting volume, full-screen display, split-screen display, adjusting display scale, and the like. In some embodiments, the user may directly operate the first electronic device 30 to control the screen-shot content, for example, operate a display interface of the first electronic device 30 or operate a remote controller associated with the first electronic device 30.
Step S212: and triggering screen projection connection.
In some embodiments, when the user moves from the first space 12 where the first electronic device 30 is located to another space, such as the second space 14 where the second electronic device 40 is located, the second electronic device 40 acquires the trigger event. The triggering event may include, but is not limited to, any one or more of the following: the second electronic device 40 is started, the second electronic device 40 detects that the user enters the detection range, the device with a detection or sensing function detects that the user enters the detection range, the device with a wireless positioning function detects that the mobile terminal 20 enters the detection range, the second electronic device 40 determines that the user has an intention to watch the second electronic device 40, the second electronic device 40 determines that the user enters a room (such as the second space 14) in which the second electronic device 40 is installed, and the second electronic device 40 receives an indication message indicating that the second electronic device 40 performs continuous screen projection.
In some embodiments, when a user activates the second electronic device 40 by switching a power supply or the like, the second electronic device 40 detects a trigger event for a screen-shot sequence; or, when the camera or the sensor element equipped in the second electronic device 40 detects that the user enters the detection range (for example, the shooting range of the camera, or the sensor element detects that the user enters the range of the second space 14), the second electronic device 40 detects a trigger event continuing to screen; or, when a device with a detection or sensing function, such as an infrared sensor, a photoelectric sensor, a thermal detector, a camera device, a millimeter wave radar, etc., detects that a user enters a detection range (e.g., a range of the second space 14), it is a trigger event; alternatively, the triggering event is a detection event when the device with a wireless positioning function, such as an indoor wireless base station, a wireless positioning tag, etc., detects that the user carries the mobile terminal 20 into a detection range (e.g., the second space 14 range), where the wireless positioning function can position the mobile terminal 20 by a positioning technology, such as an Ultra Wide Band (UWB) positioning technology; still alternatively, when the user intention recognition model or algorithm determines that the user currently has an intention to view the second electronic device 40 according to input information (e.g., an image or video captured by a camera, sensor data, etc.), it is a trigger event for continuing to screen-cast; or, the second electronic device 40 or another electronic device is installed with a map application, and when the user enters a room (such as the second space 14) where the second electronic device 40 is installed with the mobile terminal 20, the second electronic device 40 or another electronic device may identify that the location of the mobile terminal 20 is in the second space 14 as a trigger event; or, the user actively triggers the operation of continuous screen projection through the interface of the second electronic device 40 to form an indication message for the second electronic device 40, and the second electronic device 40 receives the indication message for continuous screen projection as a trigger event.
In some embodiments, the device with detection or sensing function or the device with wireless positioning function sends a trigger event to the second electronic device 40, and the second electronic device 40 acquires the trigger event of the screen projection continuation and can then perform the screen projection continuation in response to the trigger event. The manner of the trigger event for triggering the screen-casting connection is multiple, and a user may actively trigger the screen-casting connection by starting the second electronic device 40, or a camera or a sensor element equipped in the second electronic device 40 detects that the user enters a detection range to trigger the screen-casting connection, or a device with a detection or sensing function detects that the user enters the detection range to trigger the screen-casting connection, or a device with a wireless positioning function detects that the mobile terminal 20 enters the detection range to trigger the screen-casting connection, or the second electronic device 40 determines that the user has an intention to watch the second electronic device 40, or the second electronic device 40 determines that the user enters a room equipped with the second electronic device 40, so that the user may automatically perform the screen-casting connection without any operation, thereby providing convenience for the user. In other embodiments, the trigger event may also include other triggering manners, which are not listed here. In some embodiments, when the user enters the bedroom (the second space 14) from the living room (the first space 12), and wants to continue to play the screen-shot content played by the large screen (the first electronic device 30) of the living room through the large screen (the second electronic device 40) of the bedroom, the screen-shot succession may be triggered, so that the user continues to watch the same screen-shot content through the large screen of the bedroom after entering the bedroom, and the user may obtain a better viewing experience.
Optionally, in some embodiments, the trigger condition is, for example, when the second electronic device 40 detects that the second electronic device 40 is activated, the second electronic device 40 detects that the user enters the detection range, a device with a detection or sensing function detects that the user enters the detection range, or/and a device with a wireless positioning function detects that the mobile terminal 20 enters the detection range, one or more of the trigger conditions are combined to serve as a trigger condition for screen projection continuation.
Please refer to fig. 3, which is a schematic view of an application scenario of a screen-projection continuation method according to an embodiment of the present application. The mobile terminal 20 establishes a screen-projecting connection with the first electronic device 30, establishes a control link, provides resource information of screen-projecting contents by the mobile terminal 20, and acquires the resource information of the screen-projecting contents by the first electronic device 30, acquires the screen-projecting contents from the server 50 according to the resource information of the screen-projecting contents, and displays or plays the screen-projecting contents. When the mobile terminal 20 moves to the space corresponding to the second electronic device 40 and triggers the screen projection connection, a new screen projection connection can be established between the mobile terminal 20 and the second electronic device 40, and the screen projection connection can be performed by the second electronic device 40.
Step S213: the device is being projected.
In some embodiments, the discovery of the on-screen device may include active notification and query discovery.
The active notification manner may be that the first electronic device 30 receiving the screen projection broadcasts the screen projection information thereof through the local area network. In some embodiments, the first electronic device 30 may extend the preset message field, for example, extend the message field being subjected to screen projection through an underlying Discovery Protocol of DLNA, such as Simple Service Discovery Protocol (SSDP), and broadcast the information being subjected to screen projection on the local area network. Other electronic devices, such as the second electronic device 40, which acquire the trigger event, receive the screen-projection information broadcast by the first electronic device 30 to know that the first electronic device 30 is projecting the screen. In some embodiments, the message after expanding the message field being screened may be:
NOTIFY*HTTP/1.1
HOST:239.255.255.250:1900
CACHE-CONTROL:max-age=seconds until advertisement expires
LOCATION:URL for UPnP description for root device
NT:search target
NTS:ssdp:alive
USN:advertisement UUID
ISPLAYING:YES/NO
wherein, the HOST can reserve the message field of the multicast address and the port for the protocol; the CACHE-CONTROL can be a message field for setting the survival time of the notification message; the LOCATION may be a message field representing a URL address containing a root device description; NT may be a message field indicating the type of service; the NTS may be a message field indicating the presence of a notification message; the USN can be a unified service name representing different services and mark message fields of the same type of service capability; the isPLAYING field may be an expanded message field that is being screened, and when the isPLAYING field is YES, it may indicate that the device is currently screening, and when the isPLAYING field is NO, it may indicate that the device is not currently screening.
The query discovery mode may be that the second electronic device 40 acquiring the trigger event discovers whether there is a device on screen in the local area network. In some embodiments, the second electronic device 40 may extend a preset message field, for example, a message field of a screen being dropped, through a bottom layer discovery protocol of DLNA, such as SSDP, and broadcast a discovery request in a local area network to discover the device of the screen being dropped, where there is a device of the screen being dropped, for example, the first electronic device 30, the device of the screen being dropped (for example, the first electronic device 30) sends a presence notification to a broadcast address, that is, the second electronic device 40, and the second electronic device 40 obtains the presence notification to know that the first electronic device 30 is dropping the screen. In some embodiments, the message after expanding the message field being screened may be:
M-SEARCH*HTTP/1.1
HOST:239.255.255.250:1900
MAN:ssdp:discover
MX:seconds to delay response
ST:search target
ISPLAYING:YES/NO
wherein, HOST is a message field which is set as a protocol reserved multicast address and port; MAN is a message field for setting the type of protocol query; MX is the message field for setting the longest waiting time for equipment to respond; ST is a message field with the same content and meaning as the corresponding field of the query request; the isPLAYING field may be an expanded message field that is being screened, and when the isPLAYING field is YES, it may indicate that the device is currently screening, and when the isPLAYING field is NO, it may indicate that the device is not currently screening.
The second electronic device 40 and the first electronic device 30 can discover the device being shot by an active notification mode or a query discovery mode, and can quickly establish communication.
Step S214: and interacting first screen projection information.
In some embodiments, the first electronic device 30 may send first screen projection information to the second electronic device 40. In some embodiments, the first screen projection information may further include first screen projection resource information and first screen projection state information, and the first screen projection state information may include, but is not limited to, a play progress, a play volume, and a play state (which may include, but is not limited to, play, pause, multiple, full screen, split screen), and the like. In addition, the first electronic device 30 may also send networking information of the first electronic device 30, such as an IP address and a network port, to the second electronic device 40 at the same time. In some embodiments, the first electronic device 30 may transmit the screen projection information by extending a resume protocol message field of the DLNA, for example, extending a message field corresponding to a network address, a playing progress, a playing volume, a playing status, and the like of the screen projection content. The first electronic device 30 interacts the first screen projection information with the second electronic device 40, so that the second electronic device 40 can obtain the first screen projection resource information (which can correspondingly obtain screen projection content) and the first screen projection state information (which can correspondingly obtain the current screen projection state of the first electronic device 30), and does not need to obtain the screen projection content again and identify the current state of the screen projection content through the mobile terminal 20, thereby simplifying the communication process among the multiple terminal devices and improving the screen projection continuing efficiency.
In some embodiments, when the active notification mode finds that the device is being projected, the second electronic device 40 may request current projection information from the first electronic device 30, and the first electronic device 30 may transmit the projection information to the second electronic device 40 in response to the request. The message that the second electronic device 40 requests the first electronic device 30 for the screen-casting information may be:
GET/ContinuePlay.xml HTTP/1.1
Accept:text/xml,application/xml
User-Agent:Mozilla/4.0(compatible;UPnP/1.0;Windows NT/5.1)
Host:192.168.1.1:2800
Connection:Keep-Alive
Cache-Control:no-cache
Pragma:no-cache
the sending, by the first electronic device 30, the message of the screen projection information to the second electronic device 40 in response to the request may be:
HTTP/1.1 200OK
Server:Unknown/0.0UPnP/1.0Conexant-EmWeb/R6_1_0
Connection:close Content-Type:text/xml
Expires:Thu,01Jan 1970 00:00:00GMT
Cache-Control:no-cache Pragma:no-cache
<s:Envelope>
<s:Body>
<u:ContinuePlay>
< ContinueURI > resume video Link Address </ContinueURI >
ContinueSeek 'progress of resuming video' >
< ContinueVolume > volume of continuous playing video >
< continueState > resume state including but not limited to Play, pause, multiple, full screen, split screen </continueState >
</u:ContinuePlay>
</s:Body></s:Envelope>
In some embodiments, when the screen-casting device is found through the query discovery manner, the first electronic device 30 may add a message of screen-casting information to the presence notification sent to the second electronic device 40, where the message of screen-casting information may be:
HTTP/1.1 200OK
CACHE-CONTROL:max-age=seconds until advertisement expires
DATE:when reponse was generated
EXT:
LOCATION:URL for UPnP description for root device
SERVER:OS/Version UPNP/1.0product/version
ST:search target
USN:advertisement UUID
ContinueURI: continuous playing video link address
ContinueSeek: continuous video progress
ContinueVolume: volume of continuous playing video
ContinueState: resume state including, but not limited to, play, pause, multiple, full screen, split screen
In some embodiments, when the screen-projection device is found through the active notification, the first electronic device 30 broadcasts the screen-projection information in a message that the first electronic device is projecting the screen through the local area network. In some embodiments, the first electronic device 30 may extend a message field of the screen-casting information through a bottom layer Discovery Protocol of DLNA, such as Simple Service Discovery Protocol (SSDP), and broadcast the screen-casting message and the screen-casting information on the local area network. Other electronic devices, such as the second electronic device 40, which acquire the trigger event receive the screen-projecting message and the screen-projecting information broadcast by the first electronic device 30, and may acquire the screen-projecting information while knowing that the first electronic device 30 is projecting the screen.
Step S215: and (5) screen projection and connection.
In some embodiments, the second electronic device 40 may start a screen-casting splice according to the screen-casting information received from the first electronic device 30. In some embodiments, the second electronic device 40 may obtain the screen-projected content from the server 50 according to the network address of the screen-projected content in the screen-projected information, and continue to play the screen-projected content according to the screen-projected state information in the screen-projected information, such as the play progress, the play volume, and the play state (which may include, but is not limited to, play, pause, multiple, full screen, split screen), and the like. Therefore, the second electronic device 40 and the first electronic device 30 synchronously play the same screen-shot content at the same playing progress, playing volume and playing state. In some embodiments, the second electronic device 40 may display or play the screen-projected content according to the screen-projected resource information corresponding to the screen-projected content acquired from the first electronic device 30 and the current state of the screen-projected content, so that the second electronic device 40 may continue the display or play state of the screen-projected content of the first electronic device 30 without the mobile terminal 20 recognizing the screen-projected information of the screen-projected content and feeding the screen-projected information back to the second electronic device 40, thereby simplifying a communication process between multiple terminal devices and improving screen-projected continuation efficiency.
In some embodiments, after the second electronic device 40 triggers a screen-casting connection and finds a screen-casting device, it further queries the user whether a screen-casting connection is present. In some embodiments, referring to fig. 4, the second electronic device 40 displays a dialog box 44 through the display interface 42 to inquire whether to screen for a connection and receive the operation of the user. When receiving a positive operation of the user, for example, detecting an operation of the user on the first icon 46 in the dialog box 44, the second electronic device 40 immediately performs a screen-casting connection; when a negative operation of the user is received, for example, the user operation on the second icon 48 in the dialog box 44 is detected, the second electronic device 40 does not perform a screen-casting connection. In some embodiments, the first icon 46 is a positive icon and the second icon 48 is a negative icon.
Optionally, in some embodiments, please refer to fig. 5 together, the first electronic device 30 and the second electronic device 40 may also adopt other manners for interacting screen projection information, for example, the first electronic device 30 may transmit a mirror image screen projection data stream to the second electronic device 40, that is, a mirror image screen projection is established between the first electronic device 30 and the second electronic device 40, then the second electronic device 40 and the first electronic device 30 synchronously display or play screen projection content, and the second electronic device 40 does not need to obtain screen projection content from the server 50, so that the screen projection connection procedure is simplified, and the efficiency is improved.
Optionally, in some embodiments, please refer to fig. 5 together, the first electronic device 30 and the second electronic device 40 may also adopt other manners for interacting screen projection information, for example, the first electronic device 30 may transmit a mirror image screen projection data stream to the second electronic device 40, that is, a mirror image screen projection connection is established between the first electronic device 30 and the second electronic device 40, and the mobile terminal 20 and the first electronic device 30 may also be a mirror image screen projection connection, so that the mobile terminal 20 may transmit the mirror image screen projection data stream to the first electronic device 30, and the first electronic device 30 may transmit the mirror image screen projection data stream to the second electronic device 40. That is, the screen-shot content of the second electronic device 40 can be provided by the mobile terminal 20 without acquiring the screen-shot content from the server 50, simplifying the screen-shot connection procedure and improving efficiency.
Step S216: and feeding back the projected screen continuation.
In some embodiments, the second electronic device 40 may send the information of the screen-shot continuation and the networking information of the second electronic device to the first electronic device 30 to inform that the first electronic device 30 has completed the screen-shot continuation. In some embodiments, the networking information of the second electronic device 40 may include, but is not limited to, an IP address and a network port of the second electronic device 40.
Step S217: the control transfer is notified.
The first electronic device 30 may send a control transfer notification to the mobile terminal 20. In some embodiments, the control transfer notification sent by the first electronic device 30 includes the screen-shot continuation information of the second electronic device 40 and the networking information of the second electronic device. The networking information of the second electronic device 40 may include, but is not limited to, an IP address and a network port of the second electronic device 40. Since the second electronic device 40 has established communication with the first electronic device 30, and the first electronic device 30 has established communication with the mobile terminal 20, the second electronic device 40 may forward networking information of the second electronic device 40 to the mobile terminal 20 through the first electronic device 30, so that the mobile terminal 20 may acquire the networking information of the second electronic device 40, and then the mobile terminal 20 may establish communication with the second electronic device 40 according to the networking information of the second electronic device 40.
Step S218: screen projection control is reestablished to complete the control transfer.
In some embodiments, the mobile terminal 20 establishes a second screen-casting connection with the second electronic device 40 according to the received networking information of the second electronic device 40, and at the same time, the mobile terminal 20 may disconnect the first screen-casting connection with the first electronic device 30. In some embodiments, the screen-projection connection may be a Control link established by Simple Object Access Protocol (SOAP) of a Transmission Control Protocol (TCP) connection based on DLNA. Thus, the user can control (e.g., play, pause, stop, fast forward/rewind, adjust volume, full screen display, split screen display, adjust display scale) the screen-projected content of the second electronic device 40 via the mobile terminal 20. Therefore, the user can conveniently remotely control the screen-projected content of the second electronic device 40 through the mobile terminal 20 which is convenient to carry and operate, so as to obtain better operation experience.
Fig. 6 is a schematic view of an application scenario of screen projection control transfer of the screen projection continuation method according to an embodiment of the present application. The mobile terminal 20 is disconnected from the first screen projection control of the first electronic device 30, and the mobile terminal 20 establishes a second screen projection control connection with the second electronic device 40.
In addition, the second electronic device 40 may also directly obtain user operations to implement control of screen-shot content, such as playing, pausing, stopping, fast forwarding/rewinding, adjusting volume, full-screen display, split-screen display, adjusting display scale, and the like. In some embodiments, the user may directly operate the second electronic device 40 to control the screen-shot content, for example, operate a display interface of the second electronic device 40 or operate a remote controller associated with the second electronic device 40.
Optionally, in some embodiments, after the mobile terminal 20 and the second electronic device 40 can establish the second screen-projection control connection and disconnect the first screen-projection control connection from the first electronic device 30, the user may also turn off the first electronic device 30, or the first electronic device 30 may also turn off automatically, and at this time, the screen-projection content is only displayed or played through the second electronic device 40. It is understood that when the user moves from the living room to the bedroom, the screen shot content can be viewed only through the second electronic device 40 located in the bedroom, the first electronic device 30 located in the living room is no longer needed for viewing, and the first electronic device 30 can be turned off to save power.
Optionally, in some embodiments, the first screen-casting connection between the mobile terminal 20 and the first electronic device 30 may not be transferred, that is, the mobile terminal 20 and the second electronic device 40 do not need to establish the second screen-casting connection, then the mobile terminal 20 maintains the control link with the first electronic device 30, and the first electronic device 30 receives the control information of the mobile terminal 20 and forwards the control information to the second electronic device 40, so as to achieve the purpose of controlling the second electronic device 40. Thus, steps S216-S218 can be omitted, so that the screen projection connection step is simplified and the efficiency is improved.
Optionally, in some embodiments, please refer to fig. 5, when the first electronic device 30 and the second electronic device 40 are mirrored to project screens, the screen projecting control between the mobile terminal 20 and the first electronic device 30 may not be transferred, that is, the mobile terminal 20 and the second electronic device 40 do not need to establish the screen projecting connection, and steps S216 to S218 may be omitted, so as to simplify the screen projecting connection step and improve the efficiency.
Optionally, in some embodiments, when a screen is projected between the first electronic device 30 and the second electronic device 40 in a mirror image manner, the mobile terminal 20 may establish a second screen projection control connection with the second electronic device 40 and disconnect the first screen projection control connection from the first electronic device 30, so as to implement the transfer of the screen projection control link and implement the screen projection control on the second electronic device 40 by the mobile terminal 20.
Step S219: and synchronously projecting screen information.
In some embodiments, when the mobile terminal 20 and the second electronic device 40 can establish the second screen projection control connection and disconnect the first screen projection control connection from the first electronic device 30, and the first electronic device 30 is not turned off and continues to play screen projection content, the second electronic device 40 and the first electronic device 30 establish information synchronization. In some embodiments, when the second electronic device 40 detects that the user operates the screen-shot content, or when the mobile terminal 20 detects that the user operates the screen-shot content and the second electronic device 40 obtains the operation of the screen-shot content detected by the mobile terminal 20, for example, change a playing status (play/pause), change a playing progress, adjust a playing volume, adjust a playing multiple, adjust a display scale, and the like, the second electronic device 40 may notify the first electronic device 30 and the mobile terminal 20 of the information of the change of the screen-shot content status. Therefore, the second electronic device 40 can synchronously project screen information to the mobile terminal 20 and the first electronic device 30 in real time, and the synchronism of the multiple terminal devices is maintained. In some embodiments, the second electronic device 40 may Notify the first electronic device 30 and the mobile terminal 20 of the change of the state of the screen-shot content based on a Notification (Notify) manner of a General Event Notification Architecture (GENA) protocol.
In some embodiments, the second electronic device 40 that establishes the screen-projection control connection with the mobile terminal 20 serves as a main screen device, and other terminal devices, such as the first electronic device 30, serve as secondary screen devices. And when the information of the main screen equipment is changed, automatically notifying the auxiliary screen equipment, thereby realizing screen projection information synchronization of the multi-terminal equipment. It can be understood that the first electronic device 30 and the second electronic device 40 disposed in different spaces synchronously play the screen-casting content, so that a plurality of users in different spaces can watch the screen-casting content through the first electronic device 30 and the second electronic device 40 respectively, thereby facilitating watching by a plurality of people at the same time.
Fig. 7 is a schematic view of an application scenario of synchronous screen projection information of the screen projection continuation method according to an embodiment of the present application. The mobile terminal 20 establishes a screen-projecting control connection with the second electronic device 40, the second electronic device 40 serves as a main screen device, the first electronic device 30 serves as an auxiliary screen device, and when information of the second electronic device 40 changes, the second electronic device 40 automatically notifies the first electronic device 30, so that screen-projecting information synchronization between the second electronic device 40 and the first electronic device 30 is realized.
Alternatively, in some embodiments, after the mobile terminal 20 and the second electronic device 40 can establish the screen-casting control connection and disconnect the screen-casting control connection from the first electronic device 30, and the first electronic device 30 is turned off, the second electronic device 40 can only synchronously cast screen information to the mobile terminal 20.
Optionally, in some embodiments, the user may set in advance whether the second electronic device 40 synchronously casts the screen through the mobile terminal 20 or the second electronic device 40, and when the second electronic device 40 is set to asynchronously cast the screen, the step S219 may omit not to execute the step. If the step S219 is not executed and the first electronic device 30 is not turned off, the first electronic device 30 may continue to display or play the screen projection content according to the screen projection information last acquired by the first electronic device 30 before the mobile terminal 20 disconnects the screen projection control connection with the first electronic device 30.
Step S220: and responding to the synchronous screen projection information.
Optionally, in some embodiments, the first electronic device 30 may be responsive to synchronized screen projection information received from the second electronic device 40. For example, the second electronic device 40 changes the playing status (pause) and synchronizes the screen-casting information to the first electronic device 30 and the mobile terminal 20, and the first electronic device 30 pauses the playing of the screen-casting content in response to the screen-casting information. Thereby, the first electronic device 30 and the second electronic device 40 keep playing synchronously. Optionally, in another embodiment, the first electronic device 30 may not respond to the synchronized screen projection information received from the second electronic device 40. For example, the second electronic device 40 changes the playing state (pause) and synchronizes the screen-shot information to the first electronic device 30 and the mobile terminal 20, and the first electronic device 30 does not respond to the screen-shot information and continues to play the screen-shot content. Therefore, the first electronic device 30 and the second electronic device 40 respectively play, and the viewing requirements of users in different spaces can be respectively adapted. It is understood that the mobile terminal 20 or the first electronic device 30 may preset whether to respond to the synchronous screen-casting information. It is to be understood that, when the mobile terminal 20 or the first electronic device 30 is preset to not respond to the synchronous screen-casting information, step S220 may be omitted.
The screen-casting continuing method provides screen-casting continuing among the plurality of terminal devices, so that a user can switch screen-casting continuing among the plurality of terminal devices, the user can conveniently control screen-casting under the condition of scene switching, screen-casting information is synchronously cast among the plurality of terminal devices, screen-casting content is automatically continued to be played, and better impression experience is provided for the user. Meanwhile, a plurality of complex steps of searching the screen-casting content again, positioning the playing progress and casting the screen again are omitted, and convenient and fast screen-casting continuing experience is provided.
The main steps of the screen-throwing connection method of the embodiment of the present application are compared with those of the current screen-throwing connection method as shown in table 1
Figure BDA0003271134140000171
Compared with the current screen projection and connection method, the screen projection and connection method greatly simplifies the screen projection and connection process, saves a plurality of tedious processes and operations of searching screen projection contents, positioning screen projection content progress, re-projecting screens and the like of the mobile terminal, simplifies the communication process among multiple terminal devices, improves screen projection and connection efficiency, and simultaneously provides better experience for users.
Please refer to fig. 8, which is a flowchart illustrating a content connection method between multiple devices according to an embodiment of the present application. Illustratively, the synchronous display method may include the following steps.
In step S811, the first electronic device 30 runs the content.
In some embodiments, the first electronic device 30 may run an Application program (APP) and display an APP interface. The first electronic device 30 may receive user operations through the APP interface and implement control of the APP. It can be understood that the APP interface may include a plurality of pages, and the APP interface may implement switching of the plurality of pages when receiving the user operation. In some embodiments, a user may browse and operate the APP through the first electronic device 30 in the first space 12, for example, control of the APP may be achieved through the APP interface or a remote controller paired with the first electronic device 30. In addition, the first electronic device 30 may also interact APP information with the server 50, for example, push content or web content of the interactive APP.
Step S812, content continuation is triggered.
In some embodiments, when the user moves from the first space 12 where the first electronic device 30 is located to another space, such as the second space 14 where the second electronic device 40 is located, the second electronic device 40 obtains the content continuation trigger event. The content continuation triggering event may include, but is not limited to, any one or more of the following: the second electronic device 40 is started, the second electronic device 40 detects that the user enters the detection range, the device with a detection or sensing function detects that the user enters the detection range, or the device with a wireless positioning function detects that the mobile terminal 20 enters the detection range, the second electronic device 40 determines that the user has an intention to watch the second electronic device 40, the second electronic device 40 determines that the user enters a room (such as the second space 14) in which the second electronic device 40 is installed, and the second electronic device 40 receives an indication message indicating that the second electronic device 40 performs continuous screen projection. The content continuation trigger event is implemented with reference to the aforementioned step S212.
In step S813, a device running the APP is found.
In some embodiments, discovering devices that are running APPs may include active notification and query discovery approaches. The active notification manner may be that the first electronic device 30 running the APP broadcasts the running APP information through the lan. The query discovery manner may be that the second electronic device 40 acquiring the trigger event discovers whether there is a device running the APP in the local area network. The active notification and query discovery method can be implemented with reference to the aforementioned step S213.
Step S814, interacting the operation information.
In some embodiments, the first electronic device 30 may send its operational information to the second electronic device 40. The operation information may include, but is not limited to, the APP in which the first electronic device 30 is operating, the currently displayed APP interface, the operation state, and the like. In some embodiments, the first electronic device 30 may transmit the operation information by extending a content connectivity protocol message field of the DLNA, for example, extending a corresponding message field of an running APP, a currently displayed APP interface, and the like.
In some embodiments, the message fields of the extended DLNA content concatenation may include:
ContinueAPP: application names to be continued
APPContent: continuing to apply the currently running content (e.g. interface, running status, etc.)
It is understood that the rest of the message information of the interworking information may refer to the message field of the foregoing step S214.
In some embodiments, when the active notification mode finds that the device is operating, the second electronic device 40 may request current operation information from the first electronic device 30, and the first electronic device 30 may transmit the operation information to the second electronic device 40 in response to the request. In some embodiments, when the running device is found through the query discovery mode, the first electronic device may add a message of the running information in the presence notification sent to the second electronic device 40.
In step S815, the content continues to run.
In some embodiments, second electronic device 40 may begin continued operation based on the operation information received from first electronic device 30. In some embodiments, the second electronic device 40 may continue to operate the same APP according to the running APP in the running information, and may continue to display the same APP according to the currently displayed APP interface in the running information. Therefore, the user can continue to browse and operate the running APP and the displaying APP interface of the first electronic device 30 through the second electronic device 40 in the second space 14, the use of the user is facilitated, and the user experience is improved.
In some embodiments, the second electronic device 40 may receive user operations through the APP interface and implement control of the APP. It can be understood that the APP interface may include a plurality of pages, and the APP interface may implement switching of the plurality of pages when receiving the user operation. In some embodiments, the user may browse and operate the APP through the second electronic device 40 in the second space 14, for example, the APP may be controlled through the APP interface or a remote controller paired with the second electronic device 40. In addition, the second electronic device 40 may also interact APP information with the server 50, for example, push content or web content of the interactive APP.
In some embodiments, after the second electronic device 40 continues to run the APP, the first electronic device 30 may still continue to run the APP and display the APP interface, and may receive operations of other users through the APP interface. In some embodiments, after second electronic device 40 continues to run APP, first electronic device 30 may be turned off to conserve power.
In the method for content connection among multiple devices, when a user runs an APP and displays an APP interface through the first electronic device 30 in the first space 12 and the user switches from one space to another space, for example, from the first space 12 to the second space 14, the second electronic device 40 may automatically run and display the same APP and APP interface as the first electronic device 30 of the previous user in the first space 12, so that the user may obtain a better usage continuity experience.
Please refer to fig. 9, which is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure, wherein the structure of the electronic device is suitable for the first electronic device 30 and the second electronic device 40. In one embodiment, the electronic device 60 may include at least a memory 61, at least one processor 62, a display module 63, and a communication module 64.
Those skilled in the art will appreciate that the configuration of the electronic device 60 shown in fig. 3 is not limiting of the embodiments of the present application and that the electronic device 60 may include more or less hardware or software than shown, or a different arrangement of components. It should be noted that the electronic device 60 is only an example, and other existing or future electronic products, such as those that can be adapted to the present application, should also be included in the scope of the present application.
In some embodiments, the electronic device 60 includes a terminal capable of automatically performing numerical calculation and/or information processing according to preset or stored instructions, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded device, and the like.
In some embodiments, the memory 61 is used to store program codes and various data. The Memory 61 may include a Read-Only Memory (ROM), a Random Access Memory (RAM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an electronically Erasable rewritable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or other optical Disc Memory, a magnetic disk Memory, a tape Memory, or any other medium readable by a computer that can be used to carry or store data.
In some embodiments, the at least one processor 62 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or may be composed of a plurality of integrated circuits packaged with the same function or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The at least one processor 62 is a Control Unit (Control Unit) of the first electronic device, and executes various functions of the electronic device 60 and processes data, for example, a function of executing data processing, by executing or executing programs or modules stored in the memory 61 and calling data stored in the memory 61.
The integrated unit implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a terminal, or a network device) or a processor (processor) to execute parts of the methods according to the embodiments of the present application.
The memory 61 has stored therein a computer program 65, such as program code, and the at least one processor 62 may call the program code stored in the memory 61 to perform the associated functions. In one embodiment of the present application, the memory 61 stores a plurality of instructions that are executed by the at least one processor 62 to implement a screen projection continuation method.
The display module 63 is used for displaying screen projection content and providing an operation interface. In some embodiments, the display module 63 detects the operation of the user through the operation interface, and executes an instruction corresponding to the operation, for example, a dialog box is displayed to inquire whether to perform a screen-shot continuation, and receives the operation of the user. In some embodiments, the display module 63 can be, but is not limited to, a touch screen and a display screen for receiving commands through a remote controller.
The communication module 64 is used for establishing communication connection with other terminal devices and implementing data interaction. In some embodiments, the communication module 64 may be connected to a network and interact with other terminal devices via the network.
The present application further provides a computer-readable storage medium, in which a computer program is stored, and the computer program is used for implementing the steps of any one of the screen-casting connection methods described above when the computer program is executed by a processor.
In the foregoing embodiments, the DLNA screen projection protocol is described as an example, and those skilled in the art should understand that the screen projection protocol is not limited to the DLNA technology, and as the technology evolves, a screen projection protocol appearing in the future, if applicable to the present application, does not exceed the coverage range of the embodiments of the present application, and thus, the present application shall also belong to the protection range of the present application.
In the embodiments of the present application, functional modules of an electronic device or a server may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.
It will be evident to those skilled in the art that the application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. Therefore, appropriate changes and modifications to the above embodiments are intended to be included within the scope of the present invention as claimed, and within the spirit and scope of the present invention.

Claims (42)

1. A screen projection and connection method is applied to a system comprising a mobile terminal, a first electronic device and a second electronic device, and is characterized by comprising the following steps:
the mobile terminal establishes a first screen projection connection with the first electronic equipment and sends first screen projection information to the first electronic equipment, so that the first electronic equipment displays first screen projection content according to the first screen projection information;
the second electronic equipment acquires a trigger event of continuous screen projection, wherein the trigger event of continuous screen projection is used for triggering the second electronic equipment to continuously project the screen;
the second electronic device finds the first electronic device which is projecting the screen, and obtains the first screen projecting information from the first electronic device, so that the second electronic device displays the first screen projecting content according to the first screen projecting information.
2. The method of claim 1, wherein the mobile terminal, the first electronic device, and the second electronic device are in a same local area network,
the second electronic device discovering the first electronic device that is throwing the screen, comprising:
the first electronic equipment broadcasts a first message in the local area network, so that the second electronic equipment determines that the first electronic equipment is a screen-casting equipment according to the first message;
alternatively, the first and second electrodes may be,
the second electronic equipment broadcasts a second message in the local area network; and the first electronic equipment responds to the second message and sends a third message to the second electronic equipment, so that the second electronic equipment determines that the first electronic equipment is a screen-casting equipment according to the third message.
3. The method of claim 2,
the second electronic device obtains the first screen projection information from the first electronic device, and the method comprises the following steps:
the second electronic equipment sends a screen projection information acquisition request; the first electronic equipment responds to the screen projection information acquisition request and sends the first screen projection information to the second electronic equipment, so that the second electronic equipment acquires the first screen projection information;
alternatively, the first and second electrodes may be,
the first electronic equipment carries the first screen projection information in the first message or the third message, so that the second electronic equipment acquires the first screen projection information.
4. The method according to any one of claims 1-3, wherein the trigger event for successive screenshots comprises one or more of:
the second electronic device is started;
the second electronic equipment detects that the user enters a detection range;
the second electronic equipment acquires other detection or sensing equipment and detects that the user enters the detection range;
the second electronic equipment acquires other equipment with a wireless positioning function and detects that the mobile terminal enters the detection range;
the second electronic device determining that a user has an intent to view the second electronic device;
the second electronic device determining that a user enters a room in which the second electronic device is installed;
and the second electronic equipment receives an indication message for indicating the second electronic equipment to continuously cast a screen.
5. The method of any of claims 1-4, wherein the first screen projection information comprises first screen projection resource information and first screen projection status information,
the first electronic equipment displays first screen projection content according to the first screen projection information, and the method comprises the following steps:
the first electronic equipment acquires the first screen projection content from a server according to the first screen projection resource information, so that the first screen projection content is displayed in a screen projection state indicated by the first electronic equipment information;
the second electronic device displays the first screen projection content according to the first screen projection information, and the method comprises the following steps:
and the second electronic equipment acquires the first screen projection content from a server according to the first screen projection resource information, so that the second electronic equipment displays the first screen projection content in a screen projection state indicated by the first screen projection state information.
6. The method of claim 5, wherein the first screen projection resource information comprises a Uniform Resource Identifier (URI), and wherein the first screen projection state information comprises one or more of a play progress, a play volume, and a play state, and wherein the play state comprises one or more of a play, a pause, a double speed, a full screen, and a split screen.
7. The method according to any one of claims 1-6, further comprising:
the terminal equipment acquires networking information of the second electronic equipment;
and the terminal equipment disconnects the first screen projection connection with the first electronic equipment, and establishes a second screen projection connection with the second electronic equipment according to the networking information.
8. The method of claim 7, wherein after the terminal device establishes the second screen-casting connection with the second electronic device, the method further comprises:
and the second electronic equipment sends the second screen projection information to the first electronic equipment, wherein the second screen projection information is different from the first screen projection information.
9. The method according to any one of claims 1-6, further comprising:
the first electronic equipment sends second screen projection information to the second electronic equipment, wherein the second screen projection information is different from the first screen projection information.
10. The method of any of claims 1-9, wherein the second electronic device displays the first screen shot content according to the first screen shot information, comprising:
and the second electronic equipment sends out an inquiry message for judging whether to perform continuous screen projection, and displays the first screen projection content according to the first screen projection information under the condition of receiving a positive response responding to the inquiry message.
11. The method of any of claims 1-4, wherein the first screen shot information comprises the first screen shot content.
12. A screen projection continuing method is applied to first electronic equipment and is characterized by comprising the following steps:
the first electronic equipment establishes first screen projection connection with the mobile terminal and acquires first screen projection information from the mobile terminal, so that the first electronic equipment displays first screen projection content according to the first screen projection information;
the first electronic equipment provides the first screen projection information to second electronic equipment, and the first screen projection information is used for displaying the first screen projection content by the second electronic equipment.
13. The method of claim 12, wherein the mobile terminal, the first electronic device, and the second electronic device are in a same local area network,
before the first electronic device provides the first screen projection information to a second electronic device, the method further comprises:
the first electronic equipment broadcasts a first message in the local area network, wherein the first message carries indication information that the first electronic equipment is throwing a screen;
the first electronic device provides the first screen projection information to a second electronic device, and the method comprises the following steps:
and the first electronic equipment responds to a screen projection information acquisition request sent by the second electronic equipment and sends the first screen projection information to the second electronic equipment.
14. The method of claim 12, wherein the mobile terminal, the first electronic device, and the second electronic device are in a same local area network,
the first electronic device provides the first screen projection information to a second electronic device, and the method comprises the following steps:
and the first electronic equipment broadcasts the first screen projection information in the local area network.
15. The method of claim 12, wherein the mobile terminal, the first electronic device, and the second electronic device are in a same local area network,
before the first electronic device provides the first screen projection information to a second electronic device, the method further comprises:
and the first electronic equipment receives a second message broadcast by the second electronic equipment in the local area network.
16. The method of any of claims 12-15, wherein the first screen projection information includes first screen projection resource information and first screen projection status information,
the first electronic equipment displays first screen projection content according to the first screen projection information, and the method comprises the following steps:
the first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the first electronic device displays the first screen projection content in a screen projection state indicated by the first screen projection state information.
17. The method of claim 16, wherein the first screen-casting resource information comprises a Uniform Resource Identifier (URI), and wherein the first screen-casting state information comprises one or more of a play progress, a play volume, and a play state, and wherein the play state comprises one or more of a play, a pause, a double speed, a full screen, and a split screen.
18. The method according to any one of claims 12-17, further comprising:
and the first electronic equipment acquires networking information of the second electronic equipment and sends the networking information to the terminal equipment.
19. The method according to any one of claims 12-17, further comprising:
the first electronic device sends second screen projection information to the second electronic device, wherein the second screen projection information is different from the first screen projection information.
20. The method of any of claims 12-15, wherein the first screen shot information comprises the first screen shot content.
21. An electronic device, comprising a memory and a processor, wherein the processor is configured to implement the screen-casting continuation method according to any one of claims 12 to 20 when executing a computer program stored in the memory.
22. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a screen-casting continuation method according to any one of claims 12 to 20.
23. A screen projection continuing method is applied to a second electronic device, and is characterized by comprising the following steps:
the second electronic equipment acquires a trigger event of continuous screen projection, wherein the trigger event of continuous screen projection is used for triggering the second electronic equipment to perform continuous screen projection;
the second electronic device discovers the first electronic device which is throwing the screen;
the second electronic equipment acquires first screen projection information from the first electronic equipment, so that the second electronic equipment displays first screen projection content according to the first screen projection information.
24. The method of claim 23, wherein the second electronic device, the mobile terminal, and the first electronic device are in a same local area network,
the second electronic device discovering the first electronic device that is throwing the screen, comprising:
the second electronic equipment acquires a first message broadcasted by the first electronic equipment in the local area network, so that the second electronic equipment determines that the first electronic equipment is a screen-casting equipment according to the first message;
alternatively, the first and second electrodes may be,
the second electronic device broadcasts a second message in the local area network, and acquires a third message sent by the first electronic device in response to the second message, so that the second electronic device determines that the first electronic device is a device which is throwing a screen according to the third message.
25. The method of claim 24,
the second electronic device obtains the first screen projection information from the first electronic device, and the method comprises the following steps:
the second electronic equipment sends a screen projection information acquisition request; the second electronic equipment receives the first screen projection information sent to the second electronic equipment by the first electronic equipment in response to the screen projection information acquisition request;
alternatively, the first and second electrodes may be,
the second electronic equipment acquires the first screen projection information from the first message carrying the first screen projection information;
alternatively, the first and second electrodes may be,
and the second electronic equipment acquires the first screen projection information from the third message carrying the first screen projection information.
26. The method of any one of claims 23-25, wherein the trigger event for successive screen shots includes one or more of:
the second electronic device is started;
the second electronic equipment detects that the user enters a detection range;
the second electronic equipment acquires other detection or sensing equipment and detects that the user enters the detection range;
the second electronic equipment acquires other equipment with a wireless positioning function and detects that the mobile terminal enters the detection range;
the second electronic device determining that a user has an intent to view the second electronic device;
the second electronic device determining that a user enters a room in which the second electronic device is installed;
and the second electronic equipment receives an indication message for indicating the second electronic equipment to continuously cast a screen.
27. The method of any of claims 23-26, wherein the first screen projection information includes first screen projection resource information and first screen projection status information,
the second electronic device displays the first screen projection content according to the first screen projection information, and the method comprises the following steps:
and the second electronic equipment acquires the first screen projection content from a server according to the first screen projection resource information, so that the second electronic equipment displays the first screen projection content in a screen projection state indicated by the first screen projection state information.
28. The method of claim 27, wherein the first screen projection resource information comprises a Uniform Resource Identifier (URI), and wherein the first screen projection state information comprises one or more of a play progress, a play volume, and a play state, and wherein the play state comprises one or more of a play, a pause, a double speed, a full screen, and a split screen.
29. The method according to any one of claims 23-28, further comprising:
the second electronic equipment sends networking information of the second electronic equipment to the first electronic equipment;
the second electronic equipment and the terminal equipment establish second screen projection connection;
and the second electronic equipment acquires second screen projection information different from the first screen projection information from the terminal equipment through the second screen projection connection, so that the second electronic equipment displays second screen projection content according to the second screen projection information.
30. The method of claim 29, further comprising:
and the second electronic equipment sends the second screen projection information to the first electronic equipment.
31. The method according to any one of claims 23-28, further comprising:
the second electronic device obtains second screen projection information sent by the first electronic device, wherein the second screen projection information is different from the first screen projection information.
32. The method of any of claims 23-31, wherein the second electronic device displays the first screen shot content according to the first screen shot information, comprising:
and the second electronic equipment sends out an inquiry message of whether continuous screen projection is carried out or not, and under the condition of receiving a positive response responding to the inquiry message, the second electronic equipment displays the first screen projection content according to the first screen projection information.
33. The method of any of claims 23-26, wherein the first screen shot information comprises the first screen shot content.
34. An electronic device, comprising a memory and a processor, wherein the processor is configured to implement the screen projection continuation method according to any one of claims 23 to 33 when executing a computer program stored in the memory.
35. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a screen-shot continuation method according to any one of claims 23 to 33.
36. A content connection method applied to a system including a first electronic device and a second electronic device, the method comprising:
the first electronic equipment operates and displays first content;
the second electronic equipment acquires a content connection triggering event, wherein the content connection triggering event is used for triggering the second electronic equipment to carry out content connection;
the second electronic device finds the first electronic device running the first content, and obtains first running information from the first electronic device, so that the second electronic device runs and displays the first content according to the first running information.
37. The method of claim 36, wherein the first electronic device and the second electronic device are in a same local area network,
the second electronic device discovering the first electronic device that is running first content, comprising:
the first electronic device broadcasts a first message in the local area network, so that the second electronic device determines that the first electronic device is a device running first content according to the first message;
alternatively, the first and second electrodes may be,
the second electronic equipment broadcasts a second message in the local area network; and the first electronic equipment responds to the second message and sends a third message to the second electronic equipment, so that the second electronic equipment determines that the first electronic equipment is the equipment which runs the first content according to the third message.
38. The method of claim 37,
the second electronic device obtains first operation information from the first electronic device, including:
the second electronic equipment sends an operation information acquisition request; the first electronic device responds to the operation information acquisition request and sends the first operation information to the second electronic device, so that the second electronic device acquires the first operation information;
alternatively, the first and second electrodes may be,
the first electronic device carries the first operation information in the first message or the third message, so that the second electronic device obtains the first operation information.
39. The method according to any of claims 36-38, wherein the triggering event for content continuation comprises one or more of:
the second electronic device is started;
the second electronic equipment detects that the user enters a detection range;
the second electronic equipment acquires other detection or sensing equipment and detects that the user enters the detection range;
the second electronic equipment acquires other equipment with a wireless positioning function and detects that the mobile terminal enters the detection range;
the second electronic device determining that a user has an intent to view the second electronic device;
the second electronic device determining that a user enters a room in which the second electronic device is installed;
and the second electronic equipment receives an indication message for indicating the second electronic equipment to carry out content connection.
40. The method of any of claims 36-39, wherein the first operational information comprises the first content information, a first display interface, and first operational state information,
the second electronic device operates and displays the first content according to the first operation information, and the method comprises the following steps:
and the second electronic equipment runs the first content corresponding to the first content information in the running state indicated by the first running state information according to the first content information and the first running state information, and displays a first display interface corresponding to the first content.
41. The method of claim 40, wherein the first content information comprises a running application, wherein the first display interface comprises an interface of the application, and wherein the first running state information comprises a running state of the application.
42. The method according to any of claims 36-40, wherein after the second electronic device operates and displays the first content according to the first operation information,
the first electronic equipment continues to operate and displays the first content;
alternatively, the first and second electrodes may be,
the first electronic device stops running and displays the first content.
CN202111101585.2A 2021-09-18 2021-09-18 Multi-device screen projection or content connection method, electronic device and device Pending CN115834936A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202111101585.2A CN115834936A (en) 2021-09-18 2021-09-18 Multi-device screen projection or content connection method, electronic device and device
PCT/CN2022/111509 WO2023040524A1 (en) 2021-09-18 2022-09-01 Multi-device screen projection or content continuation method, electronic devices and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111101585.2A CN115834936A (en) 2021-09-18 2021-09-18 Multi-device screen projection or content connection method, electronic device and device

Publications (1)

Publication Number Publication Date
CN115834936A true CN115834936A (en) 2023-03-21

Family

ID=85515362

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111101585.2A Pending CN115834936A (en) 2021-09-18 2021-09-18 Multi-device screen projection or content connection method, electronic device and device

Country Status (2)

Country Link
CN (1) CN115834936A (en)
WO (1) WO2023040524A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116708890A (en) * 2023-05-31 2023-09-05 珠海格力电器股份有限公司 Image display method, device, equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101644598B1 (en) * 2010-02-12 2016-08-02 삼성전자주식회사 Method to control video system including the plurality of display apparatuses
US11081086B2 (en) * 2017-10-26 2021-08-03 Huawei Technologies Co., Ltd. Display method and apparatus
CN112714214B (en) * 2019-10-24 2022-05-10 华为终端有限公司 Content connection method, equipment, system, GUI and computer readable storage medium
CN112258086A (en) * 2020-11-13 2021-01-22 Oppo广东移动通信有限公司 Cross-device task relay method and device, cloud platform and storage medium
CN113207035A (en) * 2021-04-16 2021-08-03 乐视致新信息技术(武汉)有限公司 Video screen projection method, device, equipment and computer readable storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116708890A (en) * 2023-05-31 2023-09-05 珠海格力电器股份有限公司 Image display method, device, equipment and storage medium

Also Published As

Publication number Publication date
WO2023040524A1 (en) 2023-03-23

Similar Documents

Publication Publication Date Title
CN108092861B (en) Configuration method for realizing equipment linkage, equipment linkage control method and device
CN108520746B (en) Method and device for controlling intelligent equipment through voice and storage medium
JP6423445B2 (en) Multimedia data reproduction method, apparatus and system
EP3455720B1 (en) Led design language for visual affordance of voice user interfaces
US20150128194A1 (en) Method and mobile terminal for switching playback device
CN105607499B (en) Device packets method and device
EP3799404B1 (en) Device capable of notifying operation state change thereof through network and communication method of the device
EP2905967A1 (en) Method for switching playing device, and mobile terminal
US11012260B2 (en) Methods, systems, and devices for managing client devices using a virtual anchor manager
EP4013003A1 (en) Communication protocol switching method, apparatus and system
US8612636B2 (en) Method and apparatus for generating or using interaction activity information
US20150195323A1 (en) Method and apparatus for reproducing content in multimedia data providing system
TW201110067A (en) Methods and apparatus for a universal device controller using peer to peer communication
CN106303679B (en) Media playing control method and media playing client
US10353561B2 (en) Method and apparatus for generating or using interaction activity information
CN113014972B (en) Screen projection method, device and system
CN111726661B (en) Program push playing method, display equipment, mobile terminal and system
CN114189729A (en) Data relay playing method and intelligent device
CN113590059A (en) Screen projection method and mobile terminal
US20150095956A1 (en) Electronic device, computer program product, and information control method
WO2023040524A1 (en) Multi-device screen projection or content continuation method, electronic devices and apparatus
WO2024017113A1 (en) Data synchronization method and apparatus, and electronic device
CN113596100A (en) Communication transfer method, computer equipment and storage medium
CN113467262A (en) Method for controlling intelligent household electrical appliance
CN103747350A (en) Method and system for interaction among terminal devices

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination