CN106803989B - Multi-screen interaction method and device and terminal equipment - Google Patents

Multi-screen interaction method and device and terminal equipment Download PDF

Info

Publication number
CN106803989B
CN106803989B CN201710091966.4A CN201710091966A CN106803989B CN 106803989 B CN106803989 B CN 106803989B CN 201710091966 A CN201710091966 A CN 201710091966A CN 106803989 B CN106803989 B CN 106803989B
Authority
CN
China
Prior art keywords
interface
shared
mode
media
screen sharing
Prior art date
Application number
CN201710091966.4A
Other languages
Chinese (zh)
Other versions
CN106803989A (en
Inventor
江秀萍
朱海峰
郭帅生
王蕴泽
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201310242946.4A priority Critical patent/CN103338139B/en
Priority to CN201710091966.4A priority patent/CN106803989B/en
Publication of CN106803989A publication Critical patent/CN106803989A/en
Application granted granted Critical
Publication of CN106803989B publication Critical patent/CN106803989B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. local area networks [LAN], wide area networks [WAN]
    • H04L12/2803Home automation networks
    • H04L12/2807Exchanging configuration information on appliance services in a home automation network
    • H04L12/281Exchanging configuration information on appliance services in a home automation network indicating a format for calling an appliance service function in a home automation network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. local area networks [LAN], wide area networks [WAN]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network-specific arrangements or communication protocols supporting networked applications
    • H04L67/10Network-specific arrangements or communication protocols supporting networked applications in which an application is distributed across nodes in the network
    • H04L67/1095Network-specific arrangements or communication protocols supporting networked applications in which an application is distributed across nodes in the network for supporting replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes or user terminals or syncML
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. local area networks [LAN], wide area networks [WAN]
    • H04L12/2803Home automation networks
    • H04L2012/2847Home automation networks characterised by the type of home appliance used
    • H04L2012/2849Audio/video appliances

Abstract

The embodiment of the invention provides a multi-screen interaction method and device and a multi-screen interaction terminal. The multi-screen interaction method comprises the following steps: determining whether the interface to be shared currently is a video interface; if yes, multi-screen sharing is carried out with opposite-end equipment in a digital living network alliance mode; otherwise, multi-screen sharing is carried out with the opposite terminal equipment in a mirror image mode. The method and the device can determine the current playing scene, and adaptively adopt a digital living network alliance mode or a mirror mode to carry out multi-screen sharing with opposite-end equipment.

Description

Multi-screen interaction method and device and terminal equipment

Technical Field

The embodiment of the invention relates to a communication technology, in particular to a multi-screen interaction method, a multi-screen interaction device and terminal equipment.

Background

With the development of network communication technology and multimedia technology, people have wider application to intelligent terminals such as smart televisions, smart phones and tablet computers, and hope that pictures and multimedia contents can be shared on different intelligent terminals to realize multi-screen interaction among different intelligent terminals. For example, a movie on a mobile phone can be switched to a television to be played, and content on a tablet computer can be projected onto the television.

Apple's airport adopts digital living network alliance (DIGITAL LIVING network alliance, DLNA for short) technology or mirror image technology to realize sharing multimedia content and picture on different intelligent terminals. For example, when the mirror image technology is used to push the content played by the mobile phone to the television, people can see the same content as the content played by the mobile phone at the television end, however, due to the defects of low playing quality and the like existing in the mirror image technology, people cannot obtain a good playing effect at the television end when the mobile phone end pushes the played multimedia content to the television. When the DLNA technology is used for pushing multimedia contents played by a mobile phone to a television, people can obtain a better playing effect at the television end, however, the DLNA technology has the problem that network resources occupy more resources.

Disclosure of Invention

The embodiment of the invention provides a multi-screen interaction method, a multi-screen interaction device and terminal equipment, which can automatically determine a current playing scene, and adaptively switch to a DLNA mode or a mirror image mode to perform multi-screen sharing with opposite terminal equipment.

In a first aspect, an embodiment of the present invention provides a multi-screen interaction method, including:

determining whether the interface to be shared currently is a media interface;

if yes, multi-screen sharing is carried out with opposite-end equipment in a digital living network alliance mode;

otherwise, multi-screen sharing is carried out with the opposite terminal equipment in a mirror image mode.

In a first possible implementation manner of the first aspect, the determining whether the interface to be currently shared is a media interface includes:

acquiring a current application state of a media application;

and determining whether the current interface to be shared is a media interface or not according to the current application state.

According to a first possible implementation manner of the first aspect, in a second possible implementation manner, the obtaining a current application state of a media application includes:

after communication connection is established with the opposite terminal equipment, the current application state of the media application is obtained;

alternatively, the first and second electrodes may be,

after opening a media file to be shared, acquiring a current application state of the media application.

According to a second possible implementation manner of the first aspect, in a third possible implementation manner, after the opening the media file to be shared, the method further includes:

determining whether a communication connection exists with the opposite terminal equipment;

and if so, executing the step of acquiring the current application state of the media application.

According to any one of the first to third possible implementation manners of the first aspect, in a fourth possible implementation manner, the obtaining a current application state of the media application includes:

acquiring an interface reference value in a processing process;

determining whether the current interface to be shared is a media interface according to the current application state includes:

and determining whether the interface to be shared currently is a media interface or not according to the interface reference value.

According to the first aspect and any one of the first to fourth possible implementation manners of the first aspect, in a fifth possible implementation manner, before performing multi-screen sharing with a peer device in a digital living network alliance manner if yes, the method further includes:

determining whether the peer device supports the digital living network alliance mode;

and if so, executing the step of performing multi-screen sharing with the opposite terminal equipment by adopting the digital living network alliance mode.

In a second aspect, an embodiment of the present invention provides a multi-screen interaction apparatus, including:

the media interface determining module is used for determining whether the interface to be shared currently is a media interface;

the first multi-screen sharing module is used for carrying out multi-screen sharing with opposite-end equipment in a digital living network alliance mode if the first multi-screen sharing module is used for carrying out multi-screen sharing with the opposite-end equipment in the digital living network alliance mode;

and the second multi-screen sharing module is used for carrying out multi-screen sharing with the opposite terminal equipment in a mirror image mode if the first multi-screen sharing module is not used.

In a first possible implementation manner of the second aspect, the media interface determining module includes:

an application state acquiring unit, configured to acquire a current application state of the media application;

and the media interface determining unit is used for determining whether the interface to be shared currently is a media interface according to the current application state.

According to a first possible implementation manner of the second aspect, in a second possible implementation manner, the application state obtaining unit is specifically configured to obtain a current application state of the media application after establishing a communication connection with the peer device;

alternatively, the first and second electrodes may be,

the method and the device are particularly used for acquiring the current application state of the media application after the media file to be shared is opened.

According to a second possible implementation manner of the second aspect, in a third possible implementation manner, the method further includes:

the communication connection determining module is used for determining whether communication connection exists between the communication connection determining module and the opposite terminal equipment after the media file to be shared is opened;

if the current application state exists, the application state acquiring unit executes the step of acquiring the current application state of the media application.

According to any one of the first to third possible implementation manners of the second aspect, in a fourth possible implementation manner, the application state obtaining unit is specifically configured to obtain an interface reference value in a processing process;

the media interface determining unit is specifically configured to determine whether the interface to be shared currently is a media interface according to the interface reference value.

According to the second aspect and any one of the first to fourth possible implementation manners of the second aspect, in a fifth possible implementation manner, the method further includes:

a digital living network alliance capability determining module, configured to determine whether the peer device supports the digital living network alliance mode;

and if so, the first multi-screen sharing module executes the step of carrying out multi-screen sharing with the opposite terminal equipment by adopting the digital living network alliance mode.

In a third aspect, an embodiment of the present invention provides a terminal device, including: a processor and a communication module, the processor to: determining whether the interface to be shared currently is a media interface;

the communication module is used for: if yes, multi-screen sharing is carried out with opposite-end equipment in a digital living network alliance mode; otherwise, multi-screen sharing is carried out with the opposite terminal equipment in a mirror image mode.

In a first possible implementation manner of the third aspect, the processor is specifically configured to:

acquiring a current application state of a media application;

and determining whether the current interface to be shared is a media interface or not according to the current application state.

According to the multi-screen interaction method, the multi-screen interaction device and the terminal equipment, whether the interface to be shared currently is a media interface is determined, if the interface to be shared is the media interface, multi-screen sharing is performed with opposite terminal equipment in a DLNA mode, and otherwise, multi-screen sharing is performed with the opposite terminal equipment in a mirror image mode. The problem that the picture playing quality of the opposite terminal equipment is low when a mirror image technology is used in the prior art is solved, the problem that unnecessary network resources are wasted when non-media content played by a mobile phone is pushed to the opposite terminal equipment by using a DLNA technology is solved, the current playing scene can be determined, and the DLNA mode or the mirror image mode is adopted in a self-adaptive mode to carry out multi-screen sharing with the opposite terminal equipment.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a flowchart of a multi-screen interaction method according to an embodiment of the present invention;

FIG. 2 is a flowchart of a multi-screen interaction method according to a second embodiment of the present invention;

fig. 3 is a flowchart of a multi-screen interaction method according to a third embodiment of the present invention;

fig. 4 is a flowchart of a multi-screen interaction method according to a fourth embodiment of the present invention;

fig. 5 is a flowchart of a multi-screen interaction method according to a fifth embodiment of the present invention;

fig. 6 is a schematic structural diagram of a multi-screen interaction device according to a sixth embodiment of the invention;

fig. 7 is a schematic structural diagram of a multi-screen interaction device according to a seventh embodiment of the invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 1 is a flowchart of a multi-screen interaction method according to an embodiment of the present invention. The method of the embodiment is suitable for the situation that the current application scene can be automatically determined according to the current playing interface, so that the optimal multi-screen sharing mode with opposite-end equipment is selected. The method is performed by a multi-screen sharing apparatus configured in a terminal, which is typically implemented in hardware and/or software. The method of the embodiment comprises the following steps:

step 110, determining whether the interface to be shared is a media interface.

As more and more users apply the multi-screen interaction function of the multi-screen interaction terminal, the demand of the users for the multi-screen interaction terminal to share more multimedia interfaces is increasing, and it is expected that the users can see a good playing effect when sharing the media interfaces. This step is to determine whether the interface to be shared currently is a media interface, for example, when the current playing scene is playing multimedia content, the interface to be shared currently is determined to be a media interface, and step 120 is performed.

And 120, if yes, performing multi-screen sharing with the opposite terminal equipment in a DLNA mode.

And when the current interface to be shared is a media interface, performing multi-screen sharing with the opposite terminal equipment in a DLNA (digital living network alliance) mode. When the DLNA mode is adopted, the multimedia content is transmitted to the opposite terminal equipment for playing, so that a good playing effect can be seen at the opposite terminal equipment side.

And step 130, otherwise, performing multi-screen sharing with the opposite terminal equipment in a mirror image mode.

And when the interface to be shared is not the media interface, performing multi-screen sharing with the opposite terminal equipment in a mirror image mode. When the mirror image mode is adopted, the current playing interface is subjected to screenshot, and the screenshot is transmitted to the opposite terminal device to be played. When the interface to be shared is not a media interface, the influence of the mirror image transmission on the playing effect is not obvious, so that the playing effect is not influenced, and more network resources are not occupied.

Specifically, what manner to perform multi-screen sharing with the opposite-end device is determined according to whether the current interface to be shared is a media interface, and when the current interface to be shared is the media interface, the DLNA manner is used to perform multi-screen sharing with the opposite-end device, otherwise, the mirror image manner is used to perform multi-screen sharing with the opposite-end device. It should be noted that, the DLNA mode or the mirror mode may be automatically switched according to whether the current interface to be shared is a media interface. For example, when the current interface to be shared is a media interface and multi-screen sharing is performed with the opposite-end device by using a DLNA method, if the current interface to be shared is changed to a non-media interface, multi-screen sharing is performed with the opposite-end device by automatically switching to a mirror image method.

In the multi-screen interaction method provided by this embodiment, whether the interface to be shared currently is a media interface is determined, and if the interface to be shared currently is the media interface, a DLNA mode is selected to perform multi-screen sharing with the peer device, otherwise, a mirror image mode is adopted to perform multi-screen sharing with the peer device. The method and the device can determine the current playing scene, and adaptively perform multi-screen sharing with the opposite terminal equipment in a DLNA (digital living network alliance) mode or a mirror image mode.

The present embodiment is further optimized based on the first embodiment, and fig. 2 is a flowchart of a multi-screen interaction method according to a second embodiment of the present invention. Referring to fig. 2, the method of the present embodiment may include:

step 210, obtaining a current application state of the media application.

The current application state of the media application can be acquired after the communication connection with the opposite terminal equipment is established; or, after opening the media file to be shared, acquiring the current application state of the media application. After opening the media file to be shared, the method may further include: determining whether a communication connection exists with opposite terminal equipment; and if so, executing the step of acquiring the current application state of the media application.

And step 220, determining whether the interface to be shared is a media interface according to the current application state.

And 230, if yes, performing multi-screen sharing with the opposite terminal equipment in a DLNA mode.

And step 240, otherwise, performing multi-screen sharing with the opposite terminal equipment in a mirror image mode.

Before step 230, may further include: determining whether the opposite terminal equipment supports a DLNA mode; and if so, executing the step of performing multi-screen sharing with the opposite terminal equipment by adopting a DLNA (digital living network alliance) mode.

In the multi-screen interaction method provided by this embodiment, the current application state of the media application is obtained, whether the interface to be shared currently is a media interface is determined according to the current application state, and a DLNA mode is selected for multi-screen sharing with the peer device when the interface is the media interface, otherwise, a mirror image mode is adopted for multi-screen sharing with the peer device. The method and the device can determine whether the current interface to be shared is the media interface according to the current application state of the media application, and adaptively adopt a DLNA mode or a mirror image mode to carry out multi-screen sharing with the opposite terminal equipment.

The present embodiment is further optimized based on the second embodiment, and fig. 3 is a flowchart of a multi-screen interaction method provided by a third embodiment of the present invention. Referring to fig. 3, the method of the present embodiment may include:

and step 310, acquiring an interface reference value in the processing process.

The interface reference values in the process can be "NOPLAYING", "MUSIC", "VIDEO" and "IMAGE".

And step 320, determining whether the interface to be shared is a media interface or not according to the interface reference value.

When the interface reference value is "NOT PLAYING", the interface to be shared currently is a non-media playing interface, when the interface reference value is "MUSIC", the interface to be shared currently is a MUSIC media playing interface, when the interface reference value is "VIDEO", the interface to be shared currently is a VIDEO media playing interface, and when the interface reference value is "IMAGE", the interface to be shared currently is a picture media playing interface.

And 330, if yes, performing multi-screen sharing with opposite-end equipment by adopting a DLNA (digital living network alliance) mode.

And if the interface reference value is 'MUSIC', 'VIDEO' or 'IMAGE', performing multi-screen sharing with opposite-end equipment by adopting a DLNA mode.

And 340, otherwise, performing multi-screen sharing with the opposite terminal equipment in a mirror image mode.

In the multi-screen interaction method provided by this embodiment, an interface reference value in a process is processed, whether an interface to be shared currently is a media interface is determined according to the interface reference value, a DLNA mode is selected for multi-screen sharing with an opposite terminal device when the interface is the media interface, and otherwise, a mirror image mode is adopted for multi-screen sharing with the opposite terminal device. The method and the device can determine whether the interface to be shared currently is a media interface according to the interface reference value in the processing process, so that multi-screen sharing can be carried out with opposite-end equipment in a self-adaptive DLNA (digital Living network alliance) mode or a mirror image mode.

To further introduce the multi-screen interaction method provided by each of the above embodiments, the following describes the multi-screen interaction method with reference to two application scenarios, respectively, where the first application scenario is: in a multi-screen sharing process when a multi-screen interaction function is initially started and a communication connection is established with an opposite terminal device, a second application scenario is as follows: and after the media file is opened, performing a multi-screen sharing process with the opposite terminal equipment.

For a first application scenario, a multi-screen interaction method in the application scenario is described with reference to fig. 4. Fig. 4 is a flowchart of a multi-screen interaction method according to a fourth embodiment of the present invention. Referring to fig. 4, the method of the present embodiment may include:

and step 410, activating a multi-screen interaction function and establishing communication connection with opposite-end equipment.

In the media application, a multi-screen interaction function can be activated through a multi-screen interaction 'AirSharing' icon of the applications such as 'Gallery', 'Music', and the like; and activating a multi-screen interaction function in the non-media application by clicking an icon corresponding to the tool box 'ToolBox'.

And step 420, recording that the current equipment and the opposite terminal equipment are in a communication connection state.

And step 430, acquiring an interface reference value in the processing process.

And step 440, determining whether the interface to be shared is a media interface according to the interface reference value. If yes, go to step 450; otherwise, step 460 is performed.

And step 450, determining whether the opposite terminal equipment supports the DLNA mode. If so, go to step 470, otherwise, go to step 460.

And 460, activating a mirror image mode, and performing multi-screen sharing with opposite-end equipment by adopting the mirror image mode.

For example, in step 460, the pictures and sounds of the multi-screen interactive terminal can be projected onto the peer device through the "wifi display" technology.

And 470, activating a DLNA mode of the multi-screen interaction function, and performing multi-screen sharing with the opposite terminal equipment by adopting the DLNA mode.

In the multi-screen interaction method provided by this embodiment, whether the interface to be shared currently is a media interface is determined according to the interface reference value, and whether the opposite-end device supports a DLNA mode is further determined when the interface is the media interface, so that the DLNA mode or the mirror mode is adaptively adopted to perform multi-screen sharing with the opposite-end device.

For a second application scenario, a multi-screen interaction method in the application scenario is described with reference to fig. 5. Fig. 5 is a flowchart of a multi-screen interaction method according to a fifth embodiment of the present invention. Referring to fig. 5, the method of the present embodiment may include:

step 510, open a media file.

And step 520, injecting the current interface to be shared into the multi-screen sharing service.

And step 530, judging whether the equipment is in a communication connection state with the opposite terminal. If yes, go to step 540; otherwise, step 550 is performed.

And 540, determining whether the opposite terminal equipment supports the DLNA mode. If so, go to step 560, otherwise, go to step 570.

And step 550, executing common playing on the multi-screen interactive terminal.

And step 560, activating a DLNA mode of the multi-screen interaction function, and performing multi-screen sharing with the opposite terminal equipment by adopting the DLNA mode.

And 570, activating a mirror image mode, and performing multi-screen sharing with opposite-end equipment by adopting the mirror image mode.

In the multi-screen interaction method provided by this embodiment, after the media file is opened, it is first determined whether the opposite device is in a communication connection state, and then it is determined whether the opposite device supports a DLNA mode, so that a DLNA mode or a mirror mode is selected to perform multi-screen sharing with the opposite device. The multi-screen sharing with the opposite terminal equipment is realized by adopting a DLNA mode or a mirror mode in a self-adaptive manner according to whether the opposite terminal equipment supports the DLNA mode or not.

Fig. 6 is a schematic structural diagram of a multi-screen interaction device according to a sixth embodiment of the invention. The device of the embodiment is suitable for the situation that multi-screen sharing can be carried out with opposite-end equipment in a self-adaptive DLNA mode or a mirror image mode according to the current playing scene. The means are typically implemented in hardware and/or software. Referring to fig. 6, the multi-screen interaction device includes the following modules: a media interface determination module 610, a first multi-screen sharing module 620, and a second multi-screen sharing module 630.

The media interface determining module 610 is configured to determine whether an interface to be shared currently is a media interface; the first multi-screen sharing module 620 is configured to, if yes, perform multi-screen sharing with the peer device in a DLNA manner; the second multi-screen sharing module 630 is configured to perform multi-screen sharing with the peer device in a mirror image manner if the second multi-screen sharing module is not used.

Further, the apparatus may further include: the DLNA capacity determining module is used for determining whether the opposite terminal equipment supports the DLNA mode or not before the DLNA mode and the opposite terminal equipment are subjected to multi-screen sharing if the DLNA capacity determining module is used; and if so, the first multi-screen sharing module executes the step of performing multi-screen sharing with the opposite terminal equipment in a DLNA (digital living network alliance) mode.

In the multi-screen interaction device provided by this embodiment, whether the current interface to be shared is a media interface is determined, and if the current interface to be shared is the media interface, a DLNA mode is selected to perform multi-screen sharing with the peer device, otherwise, a mirror image mode is adopted to perform multi-screen sharing with the peer device. The method and the device can determine the current playing scene, and adaptively perform multi-screen sharing with the opposite terminal equipment in a DLNA (digital living network alliance) mode or a mirror image mode.

Fig. 7 is a schematic structural diagram of a multi-screen interaction device according to a seventh embodiment of the invention. Referring to fig. 7, on the basis of the sixth embodiment, the media interface determining module 610 specifically includes the following units: an application status acquisition unit 611 and a media interface determination unit 612.

The application state acquiring unit 611 is configured to acquire a current application state of the media application; the media interface determining unit 612 is configured to determine whether the interface to be shared is a media interface according to the current application state.

The application state obtaining unit 611 is specifically configured to obtain a current application state of the media application after establishing a communication connection with the peer device; or, specifically, after opening a media file to be shared, the current application state of the media application is acquired.

It should be noted here that the apparatus may further include: the communication connection determining module is used for determining whether communication connection exists between the communication connection determining module and the opposite terminal equipment after the media file to be shared is opened; if the current application state exists, the application state acquiring unit executes the step of acquiring the current application state of the media application.

Specifically, the application state obtaining unit 611 is specifically configured to obtain an interface reference value in a processing process; the media interface determining unit 612 is specifically configured to determine whether the interface to be shared currently is a media interface according to the interface reference value.

The multi-screen interaction device provided in this embodiment determines, by obtaining a current application state of a media application, whether an interface to be shared currently is a media interface according to the current application state, and selects a DLNA mode to perform multi-screen sharing with an opposite terminal device when the interface is the media interface, otherwise, performs multi-screen sharing with the opposite terminal device in a mirror image mode. The method and the device can determine whether the current interface to be shared is the media interface according to the current application state of the media application, and adaptively adopt a DLNA mode or a mirror image mode to carry out multi-screen sharing with the opposite terminal equipment.

It should be noted that the embodiment of the present invention further provides a terminal device, where the terminal device may be an intelligent terminal such as a smart phone, a smart television, a tablet computer, and the like. The terminal equipment comprises a processor and a communication module, wherein the processor is used for determining whether the interface to be shared currently is a media interface; the communication module is used for performing multi-screen sharing with the opposite terminal equipment in a DLNA (digital Living network alliance) mode if the communication module is used; otherwise, multi-screen sharing is carried out with the opposite terminal equipment in a mirror image mode. The processor is specifically configured to obtain a current application state of the media application; and determining whether the interface to be shared is a media interface or not according to the current application state. The communication module may be a WiFi chip.

The terminal device provided in this embodiment selects a DLNA mode to perform multi-screen sharing with the peer device when the current interface to be shared is a media interface by determining whether the current interface to be shared is the media interface, and otherwise, performs multi-screen sharing with the peer device by using a mirror image mode. The method and the device can determine the current playing scene, and adaptively perform multi-screen sharing with the opposite terminal equipment in a DLNA (digital living network alliance) mode or a mirror image mode.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (6)

1. A multi-screen interaction method is characterized by comprising the following steps:
determining that the interface to be shared currently is a non-media interface;
responding to the fact that the interface to be shared is a non-media interface, and performing multi-screen sharing with opposite-end equipment in a mirror image mode;
determining the current interface to be shared as a video interface;
responding to the fact that the interface to be shared is a video interface, and switching to a digital living network alliance mode to carry out multi-screen sharing with opposite-end equipment;
the determining that the current interface to be shared is a video interface includes:
acquiring an interface reference value of a current interface to be shared, wherein the interface reference value is 'video';
and determining the current interface to be shared as a video interface.
2. The method of claim 1,
after communication connection is established with the opposite terminal equipment, the interface reference value is obtained;
alternatively, the first and second electrodes may be,
and after opening the video file to be shared, acquiring the interface reference value.
3. The method of claim 2, wherein after opening the video file to be shared, further comprising:
determining whether a communication connection exists with the opposite terminal equipment;
and if so, executing the step of acquiring the interface reference value.
4. The method according to any one of claims 1 to 3, wherein before switching to the digital living network alliance mode for multi-screen sharing with a peer device, the method further comprises:
determining whether the peer device supports the digital living network alliance mode;
and if so, executing the step of performing multi-screen sharing with the opposite terminal equipment by adopting the digital living network alliance mode.
5. An electronic device, characterized in that the electronic device comprises: a processor and a memory; the memory is coupled with the processor; the memory for storing computer program code; the computer program code comprising computer instructions which, when executed by the processor, cause the electronic device to perform the method of any of claims 1-4.
6. A computer storage medium comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform the method of any of claims 1-4.
CN201710091966.4A 2013-06-18 2013-06-18 Multi-screen interaction method and device and terminal equipment CN106803989B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201310242946.4A CN103338139B (en) 2013-06-18 2013-06-18 Multi-screen interaction method, device and terminal device
CN201710091966.4A CN106803989B (en) 2013-06-18 2013-06-18 Multi-screen interaction method and device and terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710091966.4A CN106803989B (en) 2013-06-18 2013-06-18 Multi-screen interaction method and device and terminal equipment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201310242946.4A Division CN103338139B (en) 2013-06-18 2013-06-18 Multi-screen interaction method, device and terminal device

Publications (2)

Publication Number Publication Date
CN106803989A CN106803989A (en) 2017-06-06
CN106803989B true CN106803989B (en) 2020-03-27

Family

ID=49246241

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201310242946.4A CN103338139B (en) 2013-06-18 2013-06-18 Multi-screen interaction method, device and terminal device
CN201710091965.XA CN106936671A (en) 2013-06-18 2013-06-18 Multi-screen interaction method, device and terminal device
CN201710091966.4A CN106803989B (en) 2013-06-18 2013-06-18 Multi-screen interaction method and device and terminal equipment

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CN201310242946.4A CN103338139B (en) 2013-06-18 2013-06-18 Multi-screen interaction method, device and terminal device
CN201710091965.XA CN106936671A (en) 2013-06-18 2013-06-18 Multi-screen interaction method, device and terminal device

Country Status (4)

Country Link
EP (1) EP2854342A1 (en)
KR (1) KR20150119936A (en)
CN (3) CN103338139B (en)
WO (1) WO2014201792A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103338139B (en) * 2013-06-18 2017-03-08 华为技术有限公司 Multi-screen interaction method, device and terminal device
CN103561315B (en) * 2013-10-21 2018-05-04 华为技术有限公司 The method, apparatus and system of a kind of multi-screen interactive
CN103618941B (en) * 2013-12-13 2017-02-01 惠州市特纳电子有限公司 Multi-screen interaction-based interactive system and method
CN103942021B (en) * 2014-03-24 2018-08-14 华为技术有限公司 Content presenting method, the method for pushing and intelligent terminal of content presentation mode
CN104317620B (en) * 2014-10-24 2018-08-10 中兴通讯股份有限公司 The application management method and device shared based on multi-screen
CN104486655A (en) * 2014-12-18 2015-04-01 天翼视讯传媒有限公司 System and method for dynamically invoking television bar based on mobile phone terminal with 4G network or WiFi
CN105791351A (en) * 2014-12-23 2016-07-20 深圳Tcl数字技术有限公司 DLNA technology-based screen push implementation method and system
CN104852984B (en) * 2015-05-28 2018-09-18 惠州Tcl移动通信有限公司 Data transmission method and system between intelligent terminal based on multi-screen interactive
CN105120447B (en) * 2015-07-10 2019-04-12 百度在线网络技术(北京)有限公司 A kind of terminal connection method and device
CN109660842A (en) * 2018-11-14 2019-04-19 华为技术有限公司 A kind of method and electronic equipment playing multi-medium data

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102739779A (en) * 2012-06-04 2012-10-17 Tcl集团股份有限公司 DLNA (Digital Living Network Alliance)-based digital family interaction method and system and corresponding device

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8827811B2 (en) * 2009-06-30 2014-09-09 Lg Electronics Inc. Mobile terminal capable of providing multiplayer game and operating method of the mobile terminal
JP5623111B2 (en) * 2010-04-01 2014-11-12 船井電機株式会社 Portable information processing device
US8669970B2 (en) * 2011-01-27 2014-03-11 Apple Inc. Master synchronization for multiple displays
CN102638443B (en) * 2011-02-15 2017-07-21 中兴通讯股份有限公司 Streaming media resource shared method, system and the equipment with DLNA functions
US9712573B2 (en) * 2011-09-13 2017-07-18 Qualcomm Incorporated Synchronized wireless display devices
CN102325144B (en) * 2011-09-29 2014-07-30 Tcl集团股份有限公司 Method and system for interconnection between media equipment and multimedia equipment
CN102364957A (en) * 2011-10-11 2012-02-29 Tcl集团股份有限公司 Method, device and equipment for playing internet videos
US9436650B2 (en) * 2011-11-25 2016-09-06 Lg Electronics Inc. Mobile device, display device and method for controlling the same
CN102854717B (en) * 2012-08-20 2015-01-07 3M中国有限公司 Projector, electronic equipment and using methods on projector
CN102802048B (en) * 2012-08-24 2015-08-05 乐视致新电子科技(天津)有限公司 A kind of Multi-screen interaction system and method
CN103001959B (en) * 2012-11-29 2015-04-15 东软集团股份有限公司 Method and system for discovering devices among households
US9716737B2 (en) * 2013-05-08 2017-07-25 Qualcomm Incorporated Video streaming in a wireless communication system
CN103338139B (en) * 2013-06-18 2017-03-08 华为技术有限公司 Multi-screen interaction method, device and terminal device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102739779A (en) * 2012-06-04 2012-10-17 Tcl集团股份有限公司 DLNA (Digital Living Network Alliance)-based digital family interaction method and system and corresponding device

Also Published As

Publication number Publication date
CN106803989A (en) 2017-06-06
EP2854342A4 (en) 2015-04-01
EP2854342A1 (en) 2015-04-01
CN103338139B (en) 2017-03-08
CN106936671A (en) 2017-07-07
WO2014201792A1 (en) 2014-12-24
KR20150119936A (en) 2015-10-26
CN103338139A (en) 2013-10-02

Similar Documents

Publication Publication Date Title
US20200213409A1 (en) Systems and methods for transferring application state between devices based on gestural input
US10284644B2 (en) Information processing and content transmission for multi-display
EP3021556B1 (en) Transmission method and device for media stream in video conference
CN106416180B (en) Use the interaction detecting and resloving in the ABR network of client interaction
CN108319415B (en) Screen locking method and mobile terminal
KR101924163B1 (en) Methods, systems, and media for managing output of an hdmi source
RU2623803C2 (en) Method and device for connection
CN103596065B (en) Device orient capabilities exchange signaling and the server adaptation of content of multimedia
JP6199379B2 (en) System and method for persistent wireless docking
EP2652912B1 (en) Content sharing between a universal plug and play device and a wide area network device
KR101906834B1 (en) Device and method for selecting resource of application in wireless terminal
US10529384B2 (en) Video recording method and apparatus for mobile terminal
JP2016524873A (en) Method and system for using a Wi-Fi display transport mechanism for performing voice and data communications
TWI488489B (en) Data interaction method between digital tv receiving terminal and mobile terminal, and apparatus and system of the same
EP3014903B1 (en) Seamless call transitions with pre-escalation participation confirmation
RU2599385C2 (en) Method and device for video communication
US20150350723A1 (en) Video Communication Method, Home Terminal, and Home Server
EP3089466A1 (en) Method and device for same-screen interaction
US9456398B2 (en) Auto-discovery of home and out-of-franchise networks
JP2016537914A (en) Dynamic and automatic control of latency buffering for audio / video streaming
KR101424374B1 (en) Gateway device for extending ims services to reach local networks and devices communicating thereon
EP2391150A2 (en) Information processing apparatus, information processing method, and information processing program
CN102547443B (en) Resource sharing and interaction realizing method of multi-terminal system
US20150179143A1 (en) Remote rendering for efficient use of wireless bandwidth for wireless docking
CN103166941B (en) A kind of method and device of data sharing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant