CN115705221A

CN115705221A - Display device and content relay method

Info

Publication number: CN115705221A
Application number: CN202111442366.0A
Authority: CN
Inventors: 贾亚洲; 付延松
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-08-05
Filing date: 2021-11-30
Publication date: 2023-02-17
Also published as: CN115706815A; CN115706814A; CN115706823A; CN115705222A; CN115842939A; CN115706824A

Abstract

The application provides a display device and a content relay method. The display device may search for the reachable terminal device that supports the target relay capability according to the application data of the first application, thereby searching for a terminal device that can perform a capability corresponding to the application data. And the searched equipment information of the accessible terminal equipment is displayed by controlling the display, so that the user can specify the target terminal equipment. And when the target terminal device is detected to support the preset protocol channel, sending a relay request to the target terminal device based on the preset protocol channel so as to enable the target terminal device to execute the corresponding operation of the application data. The display equipment can realize content relay through the control of a protocol channel preset by a user, and is not limited to a wide area network, so that the user experience is improved.

Description

Display device and content relay method

The present application claims the priority of chinese patent application entitled "content service relay method for terminal device and terminal device" filed on 5/8/2021, and the priority of chinese patent application entitled "chinese patent office, application number 202110896120.4, and the priority of chinese patent application entitled" display device "filed on 18/9/2021, which are incorporated herein by reference in their entireties.

Technical Field

The present application relates to the field of display device technologies, and in particular, to a display device and a content relay method.

Background

The display devices, such as an intelligent television, a refrigerator smart screen, an intelligent sound box, etc., can provide playing pictures, such as audio, video, pictures, etc., for the user, such as an internet video program, a live television program, and in addition, can also provide various applications and service contents, such as an internet game, AI fitness, online education, etc., for the user.

Along with the development of intelligent terminal products and the improvement of people's family life standard, more and more families possess many domestic intelligent terminal equipment, can communicate each other between these terminal equipment, can also communicate with the terminal equipment outside the scene based on wide area network. Different terminal devices can achieve screen projection when communicating, for example, video playing service on the smart television can be relayed to the display screen of the refrigerator, and video playing service on the display screen of the refrigerator can also be relayed to the smart television. However, the current screen projection function can only realize the cross-terminal control function of the video and cannot realize the control except for the video service, so that the content service relay function is developed. The content service relay function may relay content being presented in one terminal device to another terminal device for continued presentation, the content being presented including but not limited to music, video, speech, text, pictures, etc.

However, in the current content service relay scenario, two terminal devices are connected to the same wan to implement the content service relay function. Once the network is disconnected, the relay function of the content service is unavailable, and the experience of the user is poor.

Disclosure of Invention

The invention provides a display device and a content relay method. The problem that in the related art, two terminal devices are required to be connected to the same wide area network to achieve the content service relay function, and the experience of a user is poor is solved.

In a first aspect, the present application provides a display device comprising a display and a controller. Wherein the controller is configured to perform the steps of:

searching for an available terminal device supporting target relay capacity according to application data of a first application, wherein the first application is an application running in the foreground of the display device, and the target relay capacity refers to the capacity of continuously executing the application data of the first application; controlling a display to display the searched equipment information of the accessible terminal equipment so that a user can specify the target terminal equipment from the accessible terminal equipment supporting the target relay capacity; when it is detected that the target terminal device supports a preset protocol channel, a relay request is sent to the target terminal device based on the preset protocol channel to request the target terminal device to execute the corresponding operation of the application data, wherein the relay request carries the application data.

In some implementations, the controller is further configured to: in the step of controlling the display to display the searched device information of the accessible terminal device is performed,

if at least one available terminal device is searched, controlling a display to display a relay button control, wherein the relay button control is used for triggering a content relay process; and responding to the touch operation of the user on the relay button control, and controlling a display to display a relay terminal equipment list, wherein the relay terminal equipment list comprises all searched equipment information of the relay terminal equipment.

In some implementations, the controller is further configured to: in the step of performing a search for a reachable terminal device supporting the target relay capability based on application data of the first application,

searching a first terminal device supporting the target relay capability according to the local area network protocol channel, and searching a second terminal device supporting the target relay capability according to the wide area network protocol channel; and integrating the device information of the first terminal device and the device information of the second terminal device to obtain the device information of all the relay terminal devices, wherein the device information comprises the device ID of the relay terminal devices and all the protocol channels supported by the relay terminal devices.

In some implementations, the display device further includes a local area network service center configured to be in communication connection with a terminal device in the same local area network as the display device.

The controller is further configured to: in the step of performing a search for a first terminal device supporting the target relay capability according to the local area network protocol tunnel,

sending a target relay capacity parameter to the local area network service center so that the local area network service center searches for a first terminal device supporting the target relay capacity, wherein the target relay capacity parameter is a parameter corresponding to the target relay capacity; and receiving a first terminal equipment list sent by the local area network service center, wherein the first terminal equipment list comprises all first terminal equipment supporting the target relay capability and equipment information of each first terminal equipment.

In some implementations, the controller is further configured to: prior to performing the step of searching for a first terminal device supporting the target relay capability according to the local area network protocol tunnel,

when the starting of the display equipment is detected, controlling the local area network service center to send a relay capacity acquisition request to the terminal equipment in the same local area network with the display equipment, so that the local area network service center receives the relay capacity information and the equipment information sent by the terminal equipment; the relay capability information includes all applications installed in the terminal device and relay capability parameters of each application, and the device information includes a device ID of the terminal device and all protocol channels supported by the terminal device.

when the display equipment is detected to be started, traversing all applications installed in the display equipment, and acquiring relay capability parameters of all the applications; sending the relay capacity parameters of all the applications and the display equipment information to the local area network service center so that the local area network service center sends the relay capacity parameters of all the applications and the display equipment information to the terminal equipment when receiving a relay capacity acquisition request sent by the terminal equipment; the display device information includes a device ID of the display device and all protocol channels supported by the display device.

In some implementations, the controller is further configured to: in the step of performing a search for a second terminal device supporting the target relay capability according to the wide area network protocol tunnel,

sending a terminal equipment query request to a server so that the server searches for terminal equipment which is in the same wide area network with the display equipment and supports the target relay capacity; the terminal equipment query request carries a target relay capacity parameter, and the target relay capacity parameter is a parameter corresponding to the target relay capacity; and receiving a second terminal device list sent by the server, wherein the second terminal device list comprises all second terminal devices supporting the target relay capability and device information of each second terminal device.

In some implementations, the preset protocol channel is a local area network protocol channel. The controller is further configured to:

when detecting that the target terminal equipment does not support a local area network protocol channel, determining the protocol channel supported by the target terminal equipment; and sending a relay request to the target terminal equipment based on the supported protocol channel so as to request the target terminal equipment to execute the corresponding operation of the application data.

In some implementations, the controller is further configured to: after the step of sending the relay request to the target terminal device based on the preset protocol channel is executed,

and receiving a relay result sent by the target terminal device, wherein the relay result is fed back after the target terminal device executes corresponding operation according to the application data, and the relay result is used for indicating that the target terminal device starts to execute corresponding operation according to the application data.

In a second aspect, the present application provides a content relay method, applied to a display device, including:

searching for an available terminal device supporting a target relay capability according to application data of a first application, wherein the first application is an application running in a foreground of the display device, and the target relay capability refers to the capability of continuously executing the application data of the first application; controlling a display to display the searched device information of the accessible terminal device, so that a user can specify a target terminal device from the accessible terminal devices supporting the target relay capability; when the target terminal device is detected to support a preset protocol channel, a relay request is sent to the target terminal device based on the preset protocol channel so as to request the target terminal device to execute the corresponding operation of the application data, wherein the relay request carries the application data.

According to the technical scheme, the display device and the content relay method are provided, and the terminal device capable of receiving the target relay capability can be searched according to the application data of the first application, so that the terminal device capable of executing the capability corresponding to the application data can be searched. And the searched equipment information of the accessible terminal equipment is displayed by controlling the display, so that the user can specify the target terminal equipment. When the target terminal device is detected to support the preset protocol channel, the relay request is sent to the target terminal device based on the preset protocol channel, so that the target terminal device executes the corresponding operation of the application data. The display equipment can realize content relay through the control of a protocol channel preset by a user, and is not limited to a wide area network, so that the user experience is improved.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

FIG. 1 is a schematic diagram of an application scenario illustrated in accordance with some embodiments of the present application;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;

FIG. 5 illustrates a block diagram of a software configuration of a common relay component in some embodiments;

fig. 6 illustrates a block diagram of a terminal device content service relay system in some embodiments;

fig. 7 illustrates a relay flow diagram in some embodiments;

FIG. 8 illustrates a user interface of a display device in some embodiments;

fig. 9A illustrates a flow diagram for a display device to obtain a push-side device from a wide area network in some embodiments;

FIG. 9B illustrates a flow diagram for the display device to obtain the push-side device from the wide area network in some embodiments;

FIG. 9C is a schematic diagram that illustrates a protocol channel interface in some embodiments;

FIG. 10A is a schematic diagram that illustrates a display displaying a prompt message in some embodiments;

FIG. 10B illustrates a diagram that shows a relay button control in a display in some embodiments;

FIG. 10C is a diagram that illustrates a display control area in a display in some embodiments;

FIG. 11 illustrates a schematic diagram of a display showing a list of available terminal devices in the display in some embodiments;

FIG. 12A shows a schematic user interface diagram of a display device in some embodiments;

FIG. 12B shows a schematic user interface diagram of a display device in some embodiments;

FIG. 12C shows a user interface diagram of a display device in some embodiments;

FIG. 13 shows a user interface schematic of a display device in some embodiments;

FIG. 14 illustrates a push scenario diagram in some embodiments;

FIG. 15 illustrates a flow diagram that shows a display device determining a protocol channel in some embodiments;

FIG. 16 shows a schematic user interface diagram of a display device in some embodiments;

FIG. 17 illustrates a push scenario diagram in some embodiments;

FIG. 18 illustrates a push scenario diagram in some embodiments;

FIG. 19 shows a push scenario diagram in some embodiments;

fig. 20 illustrates a flow diagram of one embodiment of a content relay method.

Detailed Description

To make the objects, embodiments and advantages of the present application clearer, the following is a clear and complete description of exemplary embodiments of the present application with reference to the attached drawings in exemplary embodiments of the present application, and it is apparent that the exemplary embodiments described are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without making any inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment. It should be noted that the brief descriptions of the terms in the present application are only for convenience of understanding of the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the foregoing drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily intended to limit the order or sequence in which they are presented unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," as well as any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to all of the elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.

In a scenario to which the embodiment of the present application is applied, there may be a plurality of terminal devices and a server capable of communicating with the terminal devices, where the terminal devices include, but are not limited to, a display device having a data transceiving and processing function and an image display function and/or a sound output function, such as a television, a smart television, a laser projection device, a display (monitor), an electronic whiteboard (electronic whiteboard), an electronic desktop (electronic table), and the like.

Fig. 1 is a schematic view of an application scenario shown in the present application according to some embodiments, where in the scenario shown in fig. 1, the application scenario includes a display device 200, a mobile terminal 300, a refrigerator smart screen 400, a smart box 500, a sound box device 600, and a server 700.

Based on the internet of everything technology, communication connection can be established among a plurality of terminal devices in the above scenario. The communication protocols for realizing the above-mentioned everything interconnection can include a local area network protocol, a wide area network protocol, and a short-range wireless communication protocol without network limitation. The local area network protocol includes, but is not limited to, HSP communication protocol, the wide area network protocol includes, but is not limited to, AIOT protocol, and the short-range wireless communication protocol includes, but is not limited to, bluetooth transmission protocol and infrared transmission protocol. Based on the difference of the foregoing communication protocol types, the communication protocol channels of the terminal device may be divided into local area network protocol channels based on a local area network, wide area network protocol channels based on a wide area network, and other protocol channels. Other protocol channels include bluetooth protocol channels, infrared protocol channels, etc. Each protocol channel may support multiple communication protocols. The terminal device in the above scenario may support one or more of the aforementioned protocol channels.

The terminal device can establish a communication connection with the server to perform information interaction with the server, for example, various contents and interaction information are provided for the terminal device. The terminal device may be allowed to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. Server 700 may be a cluster or a plurality of clusters, and may include one or more types of servers.

It should be noted that, in the similar scenario shown in fig. 1, other terminal devices may also be included, including but not limited to a touch-control integrated device, a projection device, a tablet computer, a notebook computer, an intelligent cooking device, and the aforementioned external devices related to various terminal devices, such as a keyboard, a mouse, and a game pad. The number of the terminal devices of the same type may be one or more. For example, multiple display devices 200 may be present in a scene at the same time.

In some embodiments, different terminal devices may be controlled mutually, or may be controlled by the control apparatus 100 for a specific terminal device. For example, the user may operate the display apparatus 200 through the control device 100 or the mobile terminal 300. As another example, the user may operate the smart box 500 or the smart screen 400 of the refrigerator through the mobile terminal 300, and/or operate the sound box device 600 or the like through the operation of the display device 200 or the mobile terminal 300.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the terminal device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication methods, and interacts with the terminal device through wireless or wired methods. The user can input user instructions through keys on the remote controller, voice input, control panel input and the like to control the terminal equipment.

In some embodiments, other terminal devices are controlled using applications running on the mobile terminal 300.

In some embodiments, each terminal device may also be controlled by a manner other than controlling apparatus 100 or other terminal devices, for example, the voice instruction control of the user may be directly received by a module configured inside the device for acquiring a voice instruction, or may be received by a voice control device provided outside the device.

Fig. 2 shows a block configuration diagram of the control device 100 according to some embodiments. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

Fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments. As shown in fig. 3, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, and first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through wired or wireless reception and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect signals of an external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A common presentation form of a User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

Fig. 4 illustrates a schematic software configuration diagram in the display device 200 according to some embodiments, as shown in fig. 4, the system is divided into four layers, which are, from top to bottom, an Application (Application) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android run time) and system library layer (abbreviated as "system run library layer"), and a kernel layer. The inner core layer comprises at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

In some embodiments, a common relay component and at least one content application are configured in an operating system of the terminal device. A content application refers to an application that can provide content or render content, such as a camera application, a picture resource application, a picture viewing application, a video call application, a video playing application, an audio call application, an audio resource application, a mapping application, a reading application, and so forth. The content includes pictures, audio (including call audio, audio files, and live audio streams), video (including call video, video files, and live video streams), text, geographical location information, navigation information, and the like. Presenting content includes displaying pictures, geographical location information or navigation information and text, playing video files, video call pictures and live room pictures, playing audio files, call sounds and live room sounds, etc. The public relay component is used for pushing the content presented by any one content application to the external terminal equipment so as to continue playing on the external terminal equipment; and the server is also used for receiving the content and the playing information thereof pushed by the public relay assembly on the external terminal equipment and continuing playing the content through the content with the capability of playing the content.

In some embodiments, any one content application can push content to other terminal devices capable of establishing communication connection through the common relay component, so that the function of pushing the content does not need to be configured on each content application. Any content application can receive the push of other terminal equipment to a certain content through the public relay component so as to carry out capacity continuation on the content, so that the function of receiving the push of the content does not need to be configured on each content application. In the foregoing content pushing, receiving and resuming process, the public relay component on the pushing end device (receiving end device) is responsible for communicating with the public relay component on the receiving end device (pushing end device) to complete the foregoing content pushing, receiving and resuming process.

For convenience of description, the above-mentioned processes of content pushing, receiving and capability continuing executed by the pushing end device and the receiving end device are referred to as a relay process. The push end device is a terminal device initiating content push, and the receiving end device is a content push target, or a terminal device receiving the content and connecting the push end device to continue playing the content. Based on the data flow direction, the relationship between the push end device and the receiving end device may be described as that the push end device pushes a certain content to the receiving end device, and the receiving end device performs relay playing on the content pushed by the push end device. It should be understood that the terminal device related to the present application may at least serve as a receiving terminal device, and relay play content pushed by other terminal devices, such as a song pushed by a mobile phone via an intelligent sound box device. The terminal equipment can serve as receiving end equipment, and meanwhile can serve as pushing end equipment to push contents outwards, if the current song is pushed to the smart sound box by the mobile phone to continue playing, the video program pushed by the smart television is received by the mobile phone to continue playing.

In some embodiments, the capability continuation includes, but is not limited to, at least one of an alarm setting, a picture quality sound quality parameter setting, a file review, etc., of a resume (e.g., a video resume, an audio resume, etc.) of the media asset.

Fig. 5 illustrates a block diagram of a software configuration of a common relay component in some embodiments. As shown in fig. 5, the public relay assembly includes an interaction hub module, a state management module, an interface display module, a protocol processing module, and a logic control module.

The interaction center module is used for interacting content application on the home terminal equipment. And the interaction center module is internally provided with an SDK for each application program to call, and each application program interacts with the interaction center module by calling the SDK. For example, when the user triggers an operation for transferring the current content to a specified terminal device for continuous playing in the content application, the content application notifies the interaction hub module to send by calling the SDK, so that the common relay component responds to the operation of the user. For another example, the interaction center module feeds back various types of state information in the content pushing process to the corresponding content application program.

And the state management module is used for managing various types of state information generated in the interaction process with other terminal equipment, such as state information representing the success or failure of pushing, state information representing abnormal conditions, various types of notification messages and the like. Management includes, but is not limited to, classification information, discrimination information to perform corresponding processing according to the discrimination result, information forwarding, and the like.

And the interface display module is used for displaying interface elements related to the relay flow in the user interface, such as a window object, a tab, a state information prompt box and various operable buttons.

The protocol processing module is used for selecting a protocol channel through which interaction with other terminal equipment is carried out according to a preset rule, for example, selecting one of a local area network protocol channel and a wide area network protocol channel, so that the terminal equipment carries out information interaction with other terminal equipment through the channel selected by the protocol processing module.

And the logic processing module is used for executing various logic controls involved in the relay flow, such as logic control in a certain working mode and logic control in the case of multi-device interaction.

In some embodiments, the functional modules of the common relay component are deployed at the application layer. In other embodiments, the functional modules of the common relay component may be deployed across layers, for example, the interaction hub module and the interface presentation module are deployed at an application layer, and the other modules are deployed at other layers. This is not a limitation of the present application. It should be noted that, in order to implement the content relay function, the common relay component may include more or fewer modules, and is not limited to the software composition and architecture shown in fig. 5. Based on the functions of the public relay assembly related to the embodiment of the application, other components and structural assemblies designed by the embodiment of the application all belong to the protection scope of the application.

Fig. 6 shows a schematic diagram of a framework of a terminal device content service relay system in some embodiments, where there may be N terminal devices in the system, and data transfer between the terminal devices may be performed through a server, or data transmission and reception between the terminal devices may be directly performed. When the terminal device presents a certain content, the related information of the content can be pushed to the terminal device appointed by the user in response to the user control, so that the terminal device appointed by the user can continuously play the content according to the related information of the content. The terminal device initiating content push may be referred to as a push terminal device, and the terminal device receiving content push and relaying continuous play may be referred to as a receive terminal device. All the terminal devices can be used as push terminal devices, namely, terminal devices initiating relay, so that the content which is being presented by the terminal devices is sent to other terminal devices. The terminal device may also be used as a receiving terminal device, that is, a relaying terminal device, to receive the content being presented by other terminal devices. The terminal equipment can realize the functions through the built-in public relay assembly.

It should be noted that the push-end device and the receiving-end device may be display devices having both an image display function and an audio output function, such as a television, a smart phone, a tablet computer, a smart screen of a refrigerator, or may be devices having only an audio output function but no image display function, such as a sound box device and a radio. Therefore, the push-end device can not only push the presented picture content to other terminal devices, but also push audio content, text content and the like to other terminal devices. Specifically, the push end device may obtain application data corresponding to an application program that is running by itself, and send the application data to the receiving end device, and further, the receiving end device may execute an operation corresponding to the application data, thereby implementing a relay function. For example, the present embodiment describes that presentation content of a push end device is used as a relay object.

In the embodiment of the present application, a display device is taken as a push terminal device, and other terminal devices are taken as receiving terminal devices, which are described as an example, that is, the display device relays content being presented by itself to the other terminal devices.

In some embodiments, the common relay assembly is activated after the display device is activated.

And after the public relay component is started, the relay capacity of all content applications in the system is scanned according to the standard interface of the operating system. The relay capability refers to the capability of continuously executing application data corresponding operations of the content application. When content is being presented in a display device, baton capability refers to the ability of an application to continue presenting the content, such as the type of content that can be presented, the manner of presentation, and so forth. Taking a media application as an example, the content presentation capability may be the capability of playing a video file, including parameters of the playable video file. For the receiving end device, when it receives the request of pushing the content from the pushing end device, the receiving end device continues to play the content through the application program with relay capability conforming to the content. Exemplarily, if the relay content is a video, the receiving end device needs to continue playing the video through a video playing application on the receiving end device; if the relay content is a text, the receiving device needs to continue to display the text through a text application (such as a notepad) on the receiving device.

In some embodiments, the relay capabilities may have different levels, such as primary capabilities, secondary capabilities. In view of the actual functionality of the content application, the true relay capability of the content application may be described by one level of relay capability or a combination of multiple levels of capability. It should be understood that the relay capabilities of each application may be customized according to its actual functionality. The embodiment of the present application does not limit the data form of the relay capability and the data content thereof. It should be noted that the relay capability applied on the terminal device determines which contents the terminal device can relay to play. That is, the relay capability applied on a terminal device determines the ability of the terminal device to relay other device content. For example, when a certain terminal device does not have an application for playing a certain content in a relay manner, the terminal device cannot play the content in the relay manner, and thus cannot become a target receiving device of the content.

In some embodiments, after the public relay component scans the relay capabilities of each application program, the relay capability data may be uploaded to the cloud server, so that the cloud server may query the relay capabilities of each application program on the designated terminal device. For example, when the cloud server receives an inquiry request sent by the first terminal device for inquiring the relay capability of the second terminal device, relay capability data uploaded in advance by the second terminal device may be returned to the first terminal device in response to the inquiry request. Therefore, the first terminal device can know the relay capability of the second terminal device through the cloud server, and whether the second terminal device can be used as a receiving terminal device of a certain content or not is judged according to the relay capability.

In other embodiments, after the common relay component scans the relay capabilities of the respective application programs, the relay capability data may be stored in a locally stored designated path, so that the controller may acquire the relay capability data in the designated path.

In some embodiments, when the display device presents a certain content presented by a certain content application, the public relay component may search, according to the relay capability of the content application, for the terminal device matching the relay capability to obtain a device information list, where the device information list is the device information of the optional receiving end device. The user specifies the target push terminal device based on the device information list, and the public relay component can communicate with the target push terminal device based on a certain communication protocol channel to request the target push terminal device to relay and play the content. And the public relay component on the target push terminal equipment responds to the request, starts the content application with the relay capability and continues to play the content through the content application with the relay capability.

It is noted that in a more specific implementation of the above embodiment, the content application on the push-side device needs to interact with the common relay component in response to a user operation. The common relay component may perform certain operations in response to the interaction information sent by the content application. In addition, because the common relay component has a function of presenting an interface object independent of the content application, the user can directly interact with the common relay component through the interface object provided by the common relay component to directly control the common relay component to perform certain operations. In other words, in a more specific implementation of the above embodiment, the common relay component on the push-side device may perform certain operations in response to user input.

For convenience of description, in the following embodiments, a content that a user desires to push is referred to as a target content, a relay capability of an application that provides the target content on a push end device is referred to as a target relay capability, and an application that supports the target relay capability on a target receiving end device is referred to as a target application. In addition, the public relay assembly on the push end device can be referred to as the push end relay assembly for short, and the public relay assembly on the receiving end device can be referred to as the receiving end relay assembly for short. It is to be understood that the foregoing definitional designations are provided to facilitate explanation and distinction between concepts. In some embodiments, the description may use other names, so that the content of the context of a certain name is needed to be combined when the substance characterized by the name is clear.

Fig. 7 illustrates a relay flow diagram in some embodiments.

The user may control the display device, and control the display device to implement the related function by starting a certain application program installed in the display device, for example, the user may control the display device to present target content provided by a certain content application.

The target content may be any content presented by a content application. It should be understood that the type of targeted content provided by different content applications may or may not be the same. The same content application may also provide different types of content. For example, for a media application, the content presented by the media application is mostly video content, picture content or audio content. For reading applications, the content presented by the reading applications is mostly text content.

Figure 8 illustrates a user interface of a display device in some embodiments. As shown in fig. 8, the media application interface is displayed on the display device in a full screen, and the media application interface has a video playing window in which a certain video content provided by the media application is being played.

In some embodiments, the controller may obtain application data for a certain content application when it is detected that the foreground of the display device is running the content application. The application data may include a target relay capability parameter of the content application, where the target relay capability parameter is a parameter corresponding to the target relay capability of the content application, and the target relay capability is a capability of continuously executing the application data of the content application, and may also be considered as a relay capability of the content application providing the target content. Further, the controller may send the target relay capacity to the common relay component, i.e., send the relay capacity parameter of the content application to the common relay component.

In alternative implementations, the controller may send the target relay capacity to the common relay component when the content application interface satisfies a preset condition. For example, when the target content is played in a full screen mode, the content application interface is considered to meet the preset condition. In other implementations, the controller may also send the target relay capacity to the common relay assembly when other conditions are met. For example, when the content application receives a particular user input, the controller transmits the target relay capability to the common relay component. The present application is not limited thereto.

In some embodiments, the common relay component on the display device may search for reachable terminal devices that support the target relay capability, resulting in a list of device information.

In some embodiments, after receiving the target relay capability corresponding to the content application, the common relay component on the display device starts to search for the terminal device supporting the target relay capability to obtain the device information list. The device information list is composed of device information of selectable sink devices. It should be understood that the common relay component search result can be divided into two cases, one is that at least one optional receiving end device is searched, and the other is that the optional receiving end device is not searched. If the optional receiving end equipment is searched, the current scene meets the preset content pushing condition, and if the optional receiving end equipment is not searched, the current scene does not meet the content pushing condition.

It should be noted that in the content service relay scenario in the related art, two terminal devices are required to be connected to the same wan to implement the content service relay function, and the related art only considers the protocol channel of the wan and does not consider other protocol channels. Once the network is disconnected, the relay function of the content service is not available, and the experience of the user is poor. Under the condition of combining the WAN protocol channels, other communication protocols, such as a LAN communication protocol, are also considered, so that the feasibility of the content service relay function is improved, and the user experience is improved.

In some embodiments, the public relay component on the display device may send a device query request to the cloud server based on a wide area network communication protocol channel, where the device query request includes the display device information identifier and the target relay capability. The display device information identifier may be an account identifier logged in the display device, such as an account identifier of a logged-in content application. After receiving the device query request, the cloud searches for a terminal device in the same wide area network as the display device according to the display device information identifier, where the terminal device may be a terminal device associated with the display device, for example, a terminal device that logs in the same account as the display device; after finding out the terminal devices associated with the display device, the cloud determines the terminal devices supporting the matching of the target relay capacity, namely the terminal devices supporting the target relay capacity, according to the relay capacity data uploaded by the terminal devices. For example, when the relay capability of the application on a certain terminal device matches the target relay capability, the terminal device is determined as the terminal device matching the target relay capability. And if the cloud finds at least one terminal device matched with the target relay capacity, generating a device information list containing the at least one terminal device, and feeding back the device information list to the display device. The device information list may include all terminal devices that support the target relay capability and device information of each terminal device, and the device information may include a device ID and all protocol channels supported by the terminal device. And if the cloud end does not find the terminal equipment matched with the target relay capacity, feeding back an equipment information list with empty content to the display equipment, or returning a corresponding notification message to the display equipment. Fig. 9A illustrates a flow diagram for a display device to obtain a push-side device from a wide area network in some embodiments.

In some embodiments, the common relay component on the display device may further determine the optional push-side device based on a local area network communication protocol channel.

Specifically, the display device may include a local area network service center, and the local area network service center may be in communication connection with all terminal devices in the same local area network as the display device through a local area network protocol channel.

The public relay component of the display device can send a device query request to a local area network service center in the local computer, wherein the device query request comprises target relay capacity. The local area network service center can search the terminal equipment supporting the target relay capability in the local area network through the equipment query request. Fig. 9B illustrates a flow diagram for the display device to obtain the push-side device from the wide area network in some embodiments.

Specifically, the local area network service center may perform communication connection with all terminal devices in the local area network, and send a capability query message to all terminal devices, where the capability query message carries the target relay capability. When receiving the capability query message, other terminal devices may traverse all the applications installed in the terminal devices, and if there is an application that can support the target relay capability, the terminal device may support the target relay capability. The terminal device may return a response message indicating that it supports the target relay capability, and the response message may also carry device information of the terminal device, including the device ID and all protocol channels supported by the terminal device. The local area network service center can count all the received equipment information to obtain an equipment information list which comprises all the terminal equipment supporting the target relay capacity and the equipment information of each terminal equipment, and can feed back the equipment information list to the public relay assembly of the display equipment.

In some embodiments, besides the display device, all other terminal devices may also include a lan service center, and the lan service center is the same as the lan service center of the display device. All the local area network service centers can be in communication connection.

When the display device is turned on, the local area network service center of the display device is also started and starts to work. The local area network service center of the display equipment can automatically discover all local area network service centers in the local area network and automatically establish communication connection with all the local area network service centers. At this time, in the local area network, the local area network service center of the display device and the local area network service centers of all other terminal devices can be all in communication connection with each other to form a local area network service center system.

The lan service center of the display device may send the relay capability acquisition request to all other lan service centers. When the local area network service center of other terminal device receives the relay capability acquiring request, the terminal device may traverse all the application programs installed by itself, and acquire the relay capability supported by each application program, that is, the relay capability parameter of each application. The terminal device can count the application programs and the relay capability parameters of each application program to form relay capability information. Meanwhile, the terminal device can send the relay capability information and the device information of the terminal device to the local area network service center of the display device through the local area network service center. Therefore, the local area network service center of the display device obtains the relay capability information and the device information of all other terminal devices, and can count the information to form a terminal device information base.

When the public relay assembly of the display device sends a device query request to the local area network service center in the local computer, the local area network service center can automatically search all the terminal devices supporting the target relay capability in the terminal device information base to obtain a device information list, wherein the device information list comprises all the terminal devices supporting the target relay capability and the device information of each terminal device, and meanwhile, the device information list can be fed back to the public relay assembly of the display device.

In some embodiments, after the display device is turned on, the controller may traverse all applications installed in the display device and obtain the relay capabilities of all applications, i.e., the relay capability parameters of all application programs. Further, the controller may count the application programs of the controller and the relay capability parameters of each application program to form relay capability information. Meanwhile, the display device can send the relay capability information of the display device and the display device information to a local area network service center of the local device, wherein the display device information comprises a device ID of the display device and all protocol channels supported by the display device. At this time, the lan service center stores relay capability information of the display device and display device information.

When the lan service center of the other terminal device sends the relay capability acquisition request to the lan service center of the display device, the lan service center of the display device may send the relay capability information of the display device and the display device information to the lan service center of the terminal device.

In some embodiments, the display device and the terminal device may directly acquire the relay capability information of the terminal device after detecting the power-on, and store the relay capability information in respective local area network service centers. Meanwhile, all local area network service centers can directly establish communication connection and send the relay capability information stored by the local area network service centers to all other local area network service centers, so that the display equipment and each terminal equipment can store the relay capability information of all the equipment, and subsequent relay operation is facilitated.

In some embodiments, the display device and the terminal device may also upload the relay capability information and the device information to the cloud server, so that other devices can know the relay capability of the device through the cloud server.

In some embodiments, the common relay component on the display device may further open a short-range communication protocol channel, such as bluetooth, and receive the relay capability data sent by the nearby terminal devices based on the short-range communication protocol channel, so as to determine the terminal device supporting the target relay capability from the nearby terminal devices.

In some embodiments, the common relay component may select one or more of a local area network protocol channel, a wide area network protocol channel, and a near field communication protocol channel and search for terminal devices that support the target relay capability based on the selected communication protocol channel. By selecting the appropriate protocol channel to search the equipment, the searched equipment information can be ensured to be more comprehensive, more choices are provided for users, the communication resources of the equipment can be more reasonably utilized, the execution speed of the content relay process between the equipment is increased, and the user experience is improved.

In other embodiments, the user may preset a protocol channel for communicating with the sink device. And the public relay component searches the terminal equipment supporting the target relay capability based on a communication protocol channel preset by the user. For example, if the communication protocol channel set by the user is a local area network protocol channel, the terminal device searched by the common relay component is a terminal device in the same local area network as the display device. Figure 9C illustrates a schematic diagram of a protocol channel interface in some embodiments. The user can control the display device to display the protocol channel interface through the preset operation, the protocol channel interface includes all protocol channels supported by the display device, including: a local area network protocol channel, a wide area network protocol channel, an infrared protocol channel and a Bluetooth protocol channel. The user can select one of the protocol channels as the relay operation of the display device.

In some embodiments, the public relay component of the display device may search for the first terminal device supporting the target relay capability through the cloud server according to a lan protocol channel. And searching a second terminal device supporting the target relay capability through a local area network service center according to the wide area network protocol channel. Specifically, the cloud server and the local area network service center can respectively feed back the device information lists meeting the conditions to the public relay assembly.

In some embodiments, the device information includes device identification and communication protocol information supported by the device. Some terminal devices support communication protocols that can be categorized into one or more of lan protocol channels, wan protocol channels, and nfc protocol channels. For example, some terminal devices may communicate with the push-end device through a local area network protocol channel, and may also communicate with the push-end device through a near field communication protocol channel. And for some terminal devices, the terminal devices can only communicate with the push terminal device through the wide area network protocol channel.

The public relay assembly can integrate the equipment information of all the terminal equipment supporting the target relay capability, arrange the equipment information of the same terminal equipment obtained through different protocol channels according to the unique identification in the equipment information to obtain the equipment information of all the relay terminal equipment, form a final equipment information list and display the final equipment information list to a user, and avoid presenting repeated equipment information. An exemplary integration result is as follows:

the terminal device A: support AIOT (Wide area network) \\ local area network \ Bluetooth;

and a terminal device B: local area network/Bluetooth is supported;

and a terminal device C: bluetooth is supported.

In some embodiments, when the common relay component on the display device searches for a terminal device, the common relay component presents a prompt message on the current interface for prompting the user that the device is currently being searched. As shown in fig. 10A, a prompt message with the content "searching for an executable device" is displayed on the play screen.

In some embodiments, the common relay component of the display device may feed back a search result to the controller, where the search result indicates whether there is an optional receiving end device, that is, a relay terminal device.

The controller may generate a relay prompt if there are baton terminal devices. The relay prompt is used for prompting that other terminal equipment capable of executing corresponding operation of the application data of the first application currently running on the display equipment exists in the user. Further, the user can input a relay instruction according to the relay prompt and select the target terminal device for relay. The display device receives a relay instruction input by a user and generates a relay request, wherein the relay request carries application data of a first application. And the display equipment sends the relay request to the target terminal equipment. And the target terminal equipment executes the corresponding operation of the application data of the first application according to the relay request. If the relay terminal equipment does not exist, the relay prompt is not generated, namely, the relay operation is not carried out.

In some embodiments, if there are batonable terminal devices, the controller may cause a relay button control to be displayed in the display, the relay button control being for triggering a content relay process. Fig. 10B illustrates a schematic diagram that shows a relay button control in a display in some embodiments.

In some embodiments, if there is a relay terminal device, the controller may cause the relay button control not to be displayed in the display, and the user may control the control to be called out in a different area through a certain operation or a combination of a plurality of operations. The control area is centrally provided with user operable controls, including relay button controls, and the user triggers the terminal device to execute corresponding operations by operating a certain control. If the relay terminal equipment does not exist, when the user calls out the control area, the relay terminal equipment is not included in the control area.

In further implementations, a common relay component on the display device feeds back search results to the content application, the search results characterizing whether there is a receiver device that can be trusted. And the content application determines whether to display an interface object for triggering the relay flow when the user calls out the control area according to the meaning represented by the search result.

In some implementation manners, when the content application judges that the relay terminal equipment exists according to the search result, the interface object used for triggering the relay flow is directly displayed on the application interface, and the interface object is displayed in the control area without calling out the control area by the user operation.

As shown in fig. 10C, at least one of a "relay" control, a "playlist" control, a "definition" control, and a "recommended functions" control is included in the control area, but is not limited thereto. The user can trigger the display device to execute corresponding operation by operating a certain control. For example, when the user selects the "playlist" control, the display device will display a list of albums. It is worth noting that the user can input the content relay operation by operating the relay control to trigger the display device to execute the operation of pushing the current program to other terminal devices to continue playing. When the media application receives an operation of the user on the relay control, the media application sends the relay operation to the common relay component. Of course, the user may also input the content relay operation in other manners, such as using a voice control function of the display device, inputting the content relay operation through a voice password, or inputting the content relay operation through a designated key or a combination of keys on the control device.

In some embodiments, when the user touches the relay button control, a list of accessible terminal devices may be presented in the display, where the list of accessible terminal devices includes all of the relay terminal device options.

As shown in fig. 11, the accessible terminal device list includes a plurality of selectable device options, such as "second floor living room tv", "first floor kitchen refrigerator", "second floor sound box", "first floor living room tv", and the like. At this time, the user can specify the target terminal device by inputting a selection operation for a certain option in the list. For example, when the user selects "second floor living room television", a device named "second floor living room television" is designated as a target terminal device by the user.

In some embodiments, the page displaying the list of available terminal devices may also display some additional user guidance options and guidance information. For example, in the list page of the accessible terminal devices shown in fig. 11, the user can operate "? The control is triggered to enter a relay function introduction page, and the relay function introduction page is at least used for displaying introduction information of the relay function, such as a relay operation mode. In addition, guidance information indicating that "the order is adjusted by pressing the confirmation key and the menu key" is displayed on the list page of the accessible terminal device shown in fig. 11. The guiding information is used for reminding the user, and under the condition of selecting a certain equipment option, the relay process can be triggered by operating a confirmation key on the remote controller, and the display sequence of the equipment options in the accessible terminal equipment list can be adjusted by operating a menu key on the remote controller. In addition, a switch button for "original device continues playing" is also displayed on the list page of the connectable terminal device shown in fig. 11, and when the switch button is turned on by a user operation, the content is pushed to the receiving device by the common relay component, and then the content continues to be played by the home device. When the user operates to turn off the switch button, after the public relay assembly pushes the content to the receiving end device, the content application on the local end device can exit to finish playing the content. Or, when the user operates to turn off the switch button, if the relay of the receiving end device fails, the user may continue playing the content on the local end device by selecting, or end playing the content.

In some embodiments, after detecting a selection operation of the target terminal device input by the user, the controller may acquire playing information of target content presented in a content application being executed by the display device, that is, application data of the content application, and may transmit the playing information of the target content to the common relay component.

The playing information of the target content is used for enabling an application on the receiving terminal device to continue to present the target content according to the playing information. For example, when the target content is multimedia content, the playing information thereof should include at least a playing source address, a playing progress, and the like, and based on the playing information, the application on the receiving end device is sufficient to continue playing the multimedia content. For another example, when the target content is navigation information, the playing information thereof should at least include user position information and planned path information, and based on the playing information, the map application on the receiving end device is sufficient to continue to navigate for the user. It should be understood that, depending on the content application, the parameters included in the corresponding playing information may be the same or different. The playing information of a certain content application on the display device should be able to be parsed and recognized by at least one content application on the receiving end device to continue to present the target content.

In other embodiments, the user may instruct the common relay component to search for terminal devices that support the target relay capability through a voice control function while the content application presents the target content. For example, referring to fig. 12A, after waking up the voice application, the user speaks "look up the relay device", and the voice application determines the user input device search instruction by parsing the semantics of the voice data. The device search instruction is sent to the public relay component and the user is replied to "good, inquiring" on the interface. And the public relay component responds to a device search instruction sent by the voice application, searches the terminal devices supporting the target relay capability and obtains a list of the available terminal devices.

Next, the public relay component sends the searched reachable terminal device list to the voice application, reads the specific content of the reachable terminal device list aloud through the voice application, and displays the reachable terminal device list on the interface in text, as shown in fig. 12B. After obtaining the list of the accessible terminal devices, the user can designate a target terminal device through a voice control function and instruct a display device to execute a relay flow. For example, the user speaks "relay to second floor living room television", the voice application determines that the target terminal device designated by the user is the terminal device named "second floor living room television" by analyzing the semantic meaning of the voice data, and the voice application sends the device information of the target display device to the public relay component and replies "good, relaying" to the user, as shown in fig. 12C. And after receiving the target receiving end information, the public relay assembly requests the content application for the playing information of the target content and executes the subsequent steps.

In addition, the user may also trigger some links in the relay flow through operation modes such as a touch gesture, an air gesture, and the like, which is not described herein again.

In some embodiments, the common relay component on the display device sends a relay request to the target terminal device, where the relay request is also referred to as a call request, and the call request includes target relay capability and playing information of target content.

In some embodiments, after receiving a selection operation of a user on a target terminal device, a common relay component on the display device calls the target terminal device after waiting for a preset time. A common relay component on the display device displays a prompt message on the interface during the waiting period. During the display period or the waiting period of the prompting message, the user can cancel the pushing through some operation, or can instruct the pushing immediately through some operation. And if the public relay component receives a cancel instruction input by a user during the display period or the waiting period of the prompt message, executing the step of canceling the push.

In other embodiments, after the common relay component on the display device receives the selection operation of the user on the target terminal device, the prompt message is displayed on the current interface while the call to the target terminal device is executed. During the display of the prompting message or within a preset time, the user can cancel the pushing through some operation. And if the display equipment receives a cancel instruction input by a user during the display period of the prompt message or within the preset time, executing a step of canceling the push. For example, if the target terminal device is not called upon receiving the input cancel instruction, the call is blocked. And if the target terminal equipment is called when the input canceling instruction is received, transmitting a canceling request to the target terminal equipment so as to enable the target terminal equipment to interrupt related operations.

Illustratively, the user can input the cancel instruction through any key operation. The user may indicate immediate push by specifying a key.

In some embodiments, after the common relay component on the display device receives a selection operation of a user on a target display device, a countdown is performed while the prompt message is displayed, and the countdown duration may be a waiting duration before a call or a display duration of the prompt message. And displaying an interface element on the interface showing the countdown progress to expose a visual cue of the countdown progress to the user.

Fig. 13 is an application interface displayed on the display device after the user selects "second floor living room tv" as the target terminal device in fig. 11. As shown in fig. 13, a prompt message indicating that "the tv is about to be pushed to the second floor living room for playing, stop by pressing any key, and immediately relay by pressing the enter key" is displayed on the interface, and a visual prompt "3" indicating a countdown progress is displayed on one side of the prompt message.

In some embodiments, after receiving a cancel instruction input by a user, the common relay component on the display device displays a corresponding cancel notification on the interface, and sends a cancel request to the target terminal device. And after receiving the cancellation request, the public relay component on the target terminal equipment displays a corresponding cancellation notice on an interface of the target terminal equipment. Figure 14 illustrates a push scenario diagram in some embodiments. As shown in fig. 14, a notification message with the content "push cancelled" is displayed on the interface of the display device, and a notification message with the content "push cancelled for the bedroom television" is displayed on the interface of the target terminal device.

It should be noted that the public relay components on the display device and the target terminal device may broadcast a message by invoking a voice application, including but not limited to the notification message "push cancelled", "bedroom television push cancelled" described above.

In some embodiments, the common relay component may need to select a target communication protocol channel, and call the target terminal device based on the target communication protocol channel. The target communication protocol channel may be one or more of a local area network protocol channel, a wide area network protocol channel, and a near field communication protocol channel.

In some embodiments, the user may specify the communication protocol channels, taking into account that different communication protocol channels have different characteristics. For example, the user may specify a lan protocol channel in consideration that a network disconnection or other factors may affect the relay process under the wan.

Specifically, when the public relay component on the display device sends the relay request to the target terminal device, it may first detect whether the target terminal device supports a preset protocol channel, for example, a local area network protocol channel. When it is detected that the target terminal device supports the lan protocol channel, a relay request may be sent to the target terminal device based on the lan protocol channel to request the target terminal device to execute the application data corresponding operation. The relay request carries target relay capability and playing information of target content, namely application data. When the target terminal device does not support the local area network protocol channel, the protocol channel supported by the target terminal device can be determined. And sending a relay request to the target terminal equipment based on the supported protocol channel so as to request the target terminal equipment to execute the corresponding operation of the application data. FIG. 15 illustrates a flow diagram for a display device to determine a protocol channel in some embodiments.

In some embodiments, the rules for determining the target communication protocol channel may be designed according to characteristics of various types of communication protocol channels. As is known, the local area network protocol channel and the wide area network protocol channel have the characteristics of unlimited transmission distance, strong anti-interference capability, high transmission rate (the larger the bandwidth is, the higher the transmission rate is), and the like; short-distance communication transmission protocols, such as bluetooth protocol and infrared protocol, have short transmission distance, and for infrared protocol, directionality and no obstacle are also required. In some exemplary embodiments, when the target terminal device supports both the local area network protocol tunnel and the wide area network protocol tunnel, the local area network protocol tunnel may be determined as the target communication protocol tunnel since the local area network response time rate is better than the wide area network. When the target terminal equipment simultaneously supports a local area network protocol channel, a wide area network protocol channel and a Bluetooth protocol channel, if the known transmission distance is long, such as exceeding 10 meters, the local area network protocol channel or the wide area network protocol channel is determined as a target communication protocol channel; and if the known transmission distance is close, such as not exceeding 2 meters, the Bluetooth signal is strong, and the network signal is weak, determining the Bluetooth protocol channel as a target communication protocol channel. When the target terminal device supports both the bluetooth protocol channel and the infrared protocol channel, the bluetooth protocol channel is preferentially determined as the target communication protocol channel because the infrared protocol is generally transmission with an instructive property, and the supported data volume is small and the anti-interference capability is weak.

In some embodiments, the common relay component on the target terminal device calls the target terminal device simultaneously according to each communication protocol channel supported by the target terminal device. The target terminal device receives the call requests sent by the target terminal device based on different protocol channels in sequence. And the target terminal equipment processes the call request received for the first time and performs subsequent interaction with the target terminal equipment based on a communication protocol corresponding to the call request received for the first time. When the target terminal device receives the same call request sent by the same target terminal device based on other protocol channels in the follow-up process, the call requests are discarded.

In some embodiments, after determining the communication protocol channel, the common relay component of the display device may send a call request to the target terminal device. The common relay component on the target terminal device responds to the call request sent by the display device and starts a target application supporting the target relay capability.

In some embodiments, when only one target application supporting the target relay capability is available on the target terminal device, then the common relay component directly launches the application. When the target terminal device has a plurality of target applications supporting the target relay capability, the public relay component starts a preset default application, or starts a target application with the highest priority level according to the preset priority level of each target application, or displays an application list consisting of the plurality of target applications in an interface to prompt a user to designate a certain target application, so as to start the target application designated by the user.

In some embodiments, after the public relay component on the target terminal device receives the call request of the display device, the public relay component starts the support target application after waiting for a preset time. And the public relay assembly on the target terminal equipment displays a prompt message during waiting. During the display period or the waiting period of the prompting message, the user can cancel the relay through some operation, or can instruct the relay immediately through some operation. And if the target terminal equipment receives a cancellation instruction input by a user during the display period or the waiting time of the prompt message, executing a step of cancelling the relay.

In other embodiments, the common relay component on the target terminal device displays a prompt message on the interface while the target application is located in response to the call request. During the display period of the prompting message or within the preset time, the user can cancel the relay through some operation. And if a cancel instruction input by a user is received during the display period of the prompt message or within a preset time, executing a step of canceling the relay. For example, if the support target application is not started or the target application does not start playing the target program when the input cancel instruction is received, the start or the stop of the playing is prevented and the display device is notified. If the target application has started playing the target program upon receiving the input cancel instruction, the playing is ended and the display device is notified.

In some embodiments, after the public relay component on the target terminal device receives the call request sent by the display device, the countdown is performed while the prompt message is displayed, and the countdown duration may be a waiting duration before the call or a display duration of the prompt message. And displaying an interface element on the interface showing the countdown progress to expose a visual cue of the countdown progress to the user.

Fig. 16 is a user interface displayed by the destination terminal device after the user selects "second floor living room tv" as the destination terminal device in fig. 11. As shown in fig. 16, a prompt message indicating that "the bedroom television content is about to be relayed, stop by pressing any key, and immediately relay by pressing the confirmation key" is displayed on the user interface, and a visual prompt "5" of the countdown progress is displayed on one side of the prompt message.

In some embodiments, after receiving a cancel instruction input by a user, the common relay component on the target terminal device displays a corresponding cancel notification on an interface of the target terminal device, and synchronizes the relay status to the display device. And after the public relay assembly on the display device receives the relay state sent by the target terminal device, displaying a corresponding cancellation notice on the display. Fig. 17 illustrates a relay scenario diagram in some embodiments. Wherein, a notification message with the content of 'relay cancelled' is displayed on the interface of the target terminal equipment. And a notification message with the content of 'the opposite terminal has stopped relay' is displayed on the display of the display device.

In some embodiments, the common relay component on the target terminal device sends the playback information of the target content to the target application. Further, the target application on the target terminal device continues to play the target content according to the play information of the target content. The target application on the target terminal device can also feed back the playing state information to the public relay component. And the public relay assembly on the target terminal equipment sends the playing state information to the display equipment.

In some embodiments, the play status indicates a successful or failed play, i.e., a relay success or a relay failure. And if the target application on the target terminal equipment successfully continues playing the target content, the target application feeds back playing state information indicating successful playing to the receiving end relay assembly. If the target application on the target terminal equipment fails to continue playing the target content, the target application feeds back playing state information indicating successful playing to the receiving end relay assembly.

In some embodiments, the receiving-end relay assembly displays a corresponding prompt message on an interface of the target terminal device according to the received play status information. And the public relay assembly of the display equipment receives the playing state information and presents corresponding prompt information according to the playing state information.

In some embodiments, after receiving the play status information sent by the target terminal device, the common relay component instructs the content application to end playing the target content or instructs the content application to continue playing the target content according to the play status information and the on-off state of the "original device continue playing" button. For example, no matter the playing status information reveals that the target terminal device succeeds or fails in playing the target content, as long as the "original device continues playing" button is turned on, the content application is instructed to continue playing the target content. If the playing state information reveals that the target terminal equipment fails to play the target content, if the button of 'original equipment continues to play' is turned on, the content application is instructed to continue to play the target content, and if the button of 'original equipment continues to play' is turned off, the content application is instructed to finish playing the target content.

Fig. 18 illustrates a relay scenario diagram in some embodiments. The display device interface and the target terminal device interface in fig. 18 are specifically interfaces displayed after the target application successfully resumes playing the target content. In fig. 18, a prompt message indicating that the relay bedroom television content has been played is displayed on the interface of the target terminal device, and a prompt message indicating that the relay bedroom television content has been pushed to the second floor living room television for playing is displayed on the interface of the display device.

Fig. 19 illustrates a relay scenario diagram in some embodiments. The target terminal device interface and the display device interface in fig. 19 are specifically interfaces displayed after the target application fails to resume playing the target content. In fig. 19, a prompt message indicating that the content is "relay failure" is displayed on the interface of the target terminal device, and a prompt message indicating that the content is "relay failure" is displayed on the interface of the display device.

It should be noted that the relay flow related to the embodiment of the present application is not limited to the flow shown in fig. 7, and the UI interface style displayed in the process of the relay flow executed by the display device and the target terminal device is not limited to the style shown in the above embodiment. Based on the core idea of the technical solution of the present application, a person skilled in the art can obtain a variety of different embodiments without creative work, and these embodiments all belong to the protection scope of the present application.

An embodiment of the present application further provides a content relay method, which is applied to a display device, as shown in fig. 20, and includes:

step 2001, searching for an available terminal device supporting a target relay capability according to application data of a first application, where the first application is an application running in a foreground of a display device, and the target relay capability refers to a capability of continuing to execute the application data of the first application.

And step 2002, controlling the display to display the searched equipment information of the accessible terminal equipment so as to enable a user to specify the target terminal equipment from the accessible terminal equipment supporting the target relay capacity.

Step 2003, when it is detected that the target terminal device supports the preset protocol channel, sending a relay request to the target terminal device based on the preset protocol channel to request the target terminal device to execute the corresponding operation of the application data, wherein the relay request carries the application data.

The same and similar parts in the embodiments in this specification may be referred to one another, and are not described herein again.

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be substantially or partially embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, or the like, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the method of the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display;

a controller configured to:

searching for an available terminal device supporting a target relay capability according to application data of a first application, wherein the first application is an application running in a foreground of the display device, and the target relay capability refers to the capability of continuously executing the application data of the first application;

controlling a display to display the searched device information of the accessible terminal device, so that a user can specify a target terminal device from the accessible terminal devices supporting the target relay capability;

when it is detected that the target terminal device supports a preset protocol channel, a relay request is sent to the target terminal device based on the preset protocol channel to request the target terminal device to execute the corresponding operation of the application data, wherein the relay request carries the application data.

2. The display device of claim 1, wherein the controller is further configured to:

in the step of controlling the display to display the searched device information of the accessible terminal device is performed,

if at least one relay terminal device which can be connected is searched, controlling a display to display a relay button control, wherein the relay button control is used for triggering a content relay process;

and responding to the touch operation of the user on the relay button control, and controlling a display to display a relay terminal equipment list, wherein the relay terminal equipment list comprises all searched equipment information of the relay terminal equipment.

3. The display device of claim 1, wherein the controller is further configured to:

in the step of performing a search for a reachable terminal device that supports the target relay capability based on the application data of the first application,

searching a first terminal device supporting target relay capacity according to a local area network protocol channel, and searching a second terminal device supporting the target relay capacity according to a wide area network protocol channel;

and integrating the device information of the first terminal device and the device information of the second terminal device to obtain the device information of all the relay terminal devices, wherein the device information comprises the device ID of the relay terminal devices and all the protocol channels supported by the relay terminal devices.

4. The display device according to claim 3, further comprising:

the local area network service center is configured to be in communication connection with the terminal equipment in the same local area network with the display equipment;

the controller is further configured to:

in the step of performing a search for a first terminal device supporting the target relay capability according to the local area network protocol tunnel,

sending a target relay capacity parameter to the local area network service center so that the local area network service center searches for a first terminal device supporting the target relay capacity, wherein the target relay capacity parameter is a parameter corresponding to the target relay capacity;

and receiving a first terminal equipment list sent by the local area network service center, wherein the first terminal equipment list comprises all first terminal equipment supporting the target relay capability and equipment information of each first terminal equipment.

5. The display device according to claim 4, wherein the controller is further configured to:

prior to performing the step of searching for a first terminal device supporting the target relay capability according to the local area network protocol tunnel,

when the starting of the display equipment is detected, controlling the local area network service center to send a relay capacity acquisition request to the terminal equipment in the same local area network with the display equipment, so that the local area network service center receives the relay capacity information and the equipment information sent by the terminal equipment;

the relay capability information includes all applications installed in the terminal device and relay capability parameters of each application, and the device information includes a device ID of the terminal device and all protocol channels supported by the terminal device.

6. The display device of claim 5, wherein the controller is further configured to:

when the display equipment is detected to be started, traversing all applications installed in the display equipment, and acquiring relay capability parameters of all the applications;

sending the relay capacity parameters of all the applications and the display equipment information to the local area network service center so that the local area network service center sends the relay capacity parameters of all the applications and the display equipment information to the terminal equipment when receiving a relay capacity acquisition request sent by the terminal equipment;

the display device information includes a device ID of the display device and all protocol channels supported by the display device.

7. The display device according to claim 3, wherein the controller is further configured to:

in the step of performing a search for a second terminal device supporting the target relay capability according to the wide area network protocol tunnel,

sending a terminal equipment query request to a server so that the server searches for terminal equipment which is in the same wide area network with the display equipment and supports the target relay capacity; the terminal equipment query request carries a target relay capacity parameter, and the target relay capacity parameter is a parameter corresponding to the target relay capacity;

and receiving a second terminal equipment list sent by the server, wherein the second terminal equipment list comprises all second terminal equipment supporting the target relay capacity and equipment information of each second terminal equipment.

8. The display device according to claim 1, wherein the preset protocol channel is a local area network protocol channel; the controller is further configured to:

when detecting that the target terminal equipment does not support a local area network protocol channel, determining the protocol channel supported by the target terminal equipment;

and sending a relay request to the target terminal equipment based on the supported protocol channel so as to request the target terminal equipment to execute the corresponding operation of the application data.

9. The display device of claim 1, wherein the controller is further configured to:

after the step of sending the relay request to the target terminal device based on the preset protocol channel is executed,

10. A content relay method is applied to a display device and is characterized by comprising the following steps:

searching for an available terminal device supporting target relay capacity according to application data of a first application, wherein the first application is an application running in the foreground of the display device, and the target relay capacity refers to the capacity of continuously executing the application data of the first application;