CN115705220A - Content service relay method of terminal equipment and terminal equipment - Google Patents

Abstract

The embodiment provides a content service relay method of a terminal device and the terminal device. The foreground of the terminal device of this embodiment is running the first application. And then the controller of the terminal equipment searches the relay terminal equipment according to the application data of the first application. Namely, the terminal device can execute the corresponding operation of the application data. And if the relay terminal equipment exists, generating a relay prompt. So that the relay operation according to the input instruction relay generates a relay instruction. And after receiving the relay instruction, the controller generates a relay request carrying application data according to the relay instruction. The controller sends the relay request to the accessible terminal device, and the accessible terminal device executes application data corresponding operation according to the relay request. If the relay terminal equipment does not exist, the relay prompt is not generated. According to the method and the device, the content service can be randomly relayed on different terminal devices, so that the use experience of a user is improved.

Description

Content service relay method of terminal equipment and terminal equipment

The present application claims priority of chinese patent application entitled "content service relay method for terminal device and terminal device" filed by chinese patent office on 5/8/5/2021, application number 202110896120.4, which is incorporated herein by reference in its entirety.

Technical Field

The present application relates to the field of terminal device technologies, and in particular, to a content service relay method for a terminal device and a terminal device.

Background

Along with the development of intelligent terminal products and the improvement of the living standard of people's families, more and more families possess many domestic intelligent terminal equipment.

At present, intelligent terminal devices in families generally respectively complete respective tasks. For example, a video playing application is installed on the smart television, and a user can play videos on the smart television through the video playing application. The sound box is provided with an audio playing application, and a user can play audio on the sound box through the audio playing application.

However, the current intelligent terminal devices cannot support any content service relay. For example, a service of a video call application on a mobile phone cannot be randomly relayed to a smart television. Therefore, it is desirable to provide an intelligent terminal device capable of supporting arbitrary content service relay to improve the user experience.

Disclosure of Invention

The application provides a voice control method of a terminal device, the terminal device and a server, which are used for solving the problem that the current intelligent terminal device cannot support any content service relay, so that the user experience is poor.

In a first aspect, this embodiment provides a terminal device, including:

a controller configured to:

searching for a relay terminal device according to application data of a first application, wherein the first application is an application running in a foreground of the terminal device, and the relay terminal device is a terminal device capable of executing corresponding operation of the application data;

when the available terminal equipment exists in the same local area network, a relay prompt is generated so that a relay instruction is generated according to the input relay operation for indicating relay, the relay operation is input by a user according to the relay prompt, a relay request is generated according to the relay instruction, and the relay request is used for being sent to the available terminal equipment so that the available terminal equipment executes the corresponding operation of the application data according to the application data carried by the relay request;

and when the relay terminal equipment does not exist in the same local area network, the relay prompt is not generated.

In a second aspect, this embodiment provides a content service relay method for a terminal device, where the method is applied to a controller of the terminal device, and includes:

searching for a relay terminal device according to application data of a first application, wherein the first application is an application running in a foreground of the terminal device, and the relay terminal device is a terminal device capable of executing corresponding operation of the application data;

when the receiving terminal equipment exists in the same local area network, a relay prompt is generated so as to generate a relay instruction according to the relay operation of the input instruction relay, the relay operation is input by a user according to the relay prompt, a relay request is generated according to the relay instruction, and the relay request is used for being sent to the receiving terminal equipment so as to enable the receiving terminal equipment to execute corresponding operation of the application data according to the application data carried by the relay request;

and when the relay terminal equipment does not exist in the same local area network, the relay prompt is not generated.

The embodiment provides a content service relay method of a terminal device and the terminal device. First the foreground of the terminal device is running the first application. And then the controller of the terminal equipment searches the relay terminal equipment according to the application data of the first application. Namely, the terminal device can execute the corresponding operation of the application data. And if the relay terminal equipment exists, generating a relay prompt. So that the relay operation according to the input instruction relay generates a relay instruction. And after receiving the relay instruction, the controller generates a relay request carrying application data according to the relay instruction. The controller sends the relay request to the accessible terminal device, and the accessible terminal device executes application data corresponding operation according to the relay request. And if no relay terminal equipment exists, not generating a relay prompt. According to the method and the device, the content service can be randomly relayed on different terminal devices, so that the use experience of a user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required in the embodiments will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;

FIG. 5 illustrates an icon control interface display of an application in display device 200, in accordance with some embodiments;

fig. 6 illustrates a terminal device content service relay system framework diagram in accordance with some embodiments;

FIG. 7 illustrates a content service relay application scenario diagram in accordance with some embodiments;

FIG. 8 illustrates a content service relay terminal device user interface diagram in accordance with some embodiments;

FIG. 9 illustrates yet another content service relay application scenario diagram, in accordance with some embodiments;

FIG. 10 illustrates yet another content service relay application scenario diagram, in accordance with some embodiments;

FIG. 11 illustrates yet another content service relay terminal device user interface diagram in accordance with some embodiments;

fig. 12 illustrates a content service relay method signaling diagram for a terminal device in accordance with some embodiments;

fig. 13 illustrates a content service relay method flowchart for a terminal device, in accordance with some embodiments;

fig. 14 illustrates a diagram of an internal overall structure of a local area network of a content service relay, in accordance with some embodiments;

FIG. 15 illustrates a signaling diagram of component interaction during capability registration of a content service relay in accordance with some embodiments;

fig. 16 illustrates a diagram of component interaction signaling in acquiring a relay terminal device for a content service relay in accordance with some embodiments;

fig. 17 illustrates a signaling diagram of component interactions during video baton playback of a content service baton, in accordance with some embodiments.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user may operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal 300A, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 to obtain the voice command, or may be received through a voice control apparatus provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, software steps executed by one step execution agent may migrate to another step execution agent in data communication therewith for execution as needed. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, document, image, etc., or performing an operation of a program corresponding to the icon.

In some embodiments, the controller includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphic Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g., comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and other video processing according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

In some embodiments, the user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A common presentation form of a User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical keys on the body of the display device, or the like).

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) layer and a system library layer (referred to as a "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (Window) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; a Location Manager (Location Manager) for providing access to the system Location service to the system service or application; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the display device may directly enter the interface of the preset vod program after being activated, and the interface of the vod program may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where the content displayed in the content display area may change according to the change of the selected control in the navigation bar. The programs in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can also be further displayed after the application control in the navigation bar is selected.

In some embodiments, the display device may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface and a live tv interface, and after a user selects a different signal source, the display may display content obtained from the different signal source.

Along with the development of intelligent terminal products and the improvement of the living standard of people, more and more families have multiple household intelligent terminal devices.

At present, intelligent terminal devices existing in families generally respectively complete respective tasks. For example, a video playing application is installed on the smart television, and a user can play a video on the smart television through the video playing application. The sound box is provided with an audio playing application, and a user can play audio on the sound box through the audio playing application.

However, the current intelligent terminal devices cannot support any content service relay. For example, the service of the video call application on the mobile phone cannot be randomly relayed to the smart television. Therefore, it is desirable to provide an intelligent terminal device capable of supporting arbitrary content service relay, so as to improve the user experience.

In order to solve the above problem, the present application provides a terminal device content service relay system, such as a frame diagram of the terminal device content service relay system shown in fig. 6. The system comprises at least two terminal devices 100. The terminal devices 100 are connected through lan communication. The terminal devices 100 may relay data through the server, or may directly transmit and receive data between the terminal devices. The present application takes the direct data transmission and reception between terminal devices as an example for the explanation of the scheme. In the content service relay system of the present application, all the terminal devices 100 may serve as both the originating relay terminal device and the relay terminal device.

In some embodiments, the foreground of a terminal device (i.e., the initiating relay terminal device) in the system is running the first application, and at the same time, the reachable terminal device is searched according to the application data of the first application. The accessible terminal device is a terminal device capable of executing corresponding operation of application data of the first application. And if the relay terminal equipment exists, generating a relay prompt. The relay prompt is used for prompting that other terminal equipment capable of executing the corresponding operation of the application data of the first application exists in the same local area network.

Further, the user can input a relay instruction according to the relay prompt. And initiating a relay terminal device to receive a relay instruction input by a user and generate a relay request, wherein the relay request carries application data of the first application. And the initiating relay terminal equipment sends the relay request to the searched reachable terminal equipment. The accessible terminal equipment executes the application data corresponding operation of the first application according to the relay request.

If the relay terminal equipment does not exist, the relay prompt is not generated, namely, the relay operation is not carried out.

In some embodiments, the terminal devices all store device capability parameters of other terminal devices within the same local area network. Here, the device capability parameter is an application-related parameter installed in the terminal device. For example, if a video playing application is installed in the display device, the device capability parameter is the video playing capability. And the sound box is provided with an audio playing application, and the equipment capability parameter is the audio playing capability. And if the video call application is installed on the tablet personal computer, the corresponding equipment capacity parameter is the video call capacity.

The capability registration request may be a capability registration request automatically sent to other terminal devices after the terminal device is powered on, where the capability registration request carries device capability parameters of the terminal device. And other terminal equipment stores the equipment capability parameters of the terminal equipment according to the capability registration request. Each terminal device stores the device capability parameters of other terminal devices in the local area network.

For example, the same local area network includes three devices, namely, terminal devices a, B, and C, and after the capability registration process, the device capability parameters (B1, B2.. Bn) of the terminal device B and the device capability parameters (C1, C2.. Cn) of the terminal device C are stored in the terminal device a. The terminal device B stores device capability parameters (A1, a2.. An) of the terminal device a and device capability parameters (C1, C2.. Cn) of the terminal device C. The terminal device C stores device capability parameters (A1, a2.. An) of the terminal device a and device capability parameters (B1, B2.. Bn) of the terminal device B.

When the A1 application on the terminal device A runs in the foreground, searching the device capability parameter matched with the application data of the A1 application according to the application data of the A application. I.e. to find other device capability parameters matching the device capability parameter A1. And when other equipment capability parameters matched with the equipment capability parameter A1 are found, correspondingly matching the equipment to the accessible terminal equipment. If other device capability parameters matched with the device capability parameter A1 are not found, the terminal device which can be connected is not matched. For example, when the device capability parameters A1 and B1 match, the terminal device B determines as a batonable terminal device. And when the device capability parameters A1 are matched with the device capability parameters C2, the terminal device C is determined to be the relay terminal device.

In some embodiments, the applications installed on the various terminal devices may change, for example, application uninstallation, application update, or installation of new applications. Each time the application installed on the terminal device changes, the changed data can be sent to other terminal devices, so that the device capability parameters of the terminal device stored on the other terminal devices are also updated. In the lan, the device capability parameter of each terminal device is recorded as a record on the other terminal devices. And traversing the records when the relay terminal equipment is searched according to the application data, and matching the application data with the equipment capability parameters in the records.

For example, if the terminal device a has the applications A1 and A2 installed thereon, the device capability parameters A1 and A2 of the terminal device a are stored on the other terminal devices. When the application A1 is uninstalled on the terminal device a, the terminal device a no longer has the device capability parameter A1. And deleting the device capability parameters A1 stored on other terminal devices by synchronization. When the application A3 is newly installed on the terminal device a, the terminal device a has the device capability parameter A3. And synchronously adding the new equipment capability parameters A3 of the terminal equipment A on other terminal equipment.

In one scenario, as shown in an application scenario diagram shown in fig. 7, the initiating relay terminal device is a display device 100-1, and the first application is a video playing application. The current scene is that the video playing application of the display device is playing the video, and the application data of the first application is the related data of the playing video. In the same local area network, terminal equipment such as a display device 100-2, a sound box 100-3, an intelligent alarm clock 100-4 and the like also exist. The display 100-1 stores in advance device capability parameters of terminal devices such as the display device 100-2, the speaker 100-3, and the smart alarm clock 100-4.

The device capability parameters of the display device 100-2 are playing video and playing audio, the device capability parameters of the sound box 100-3 are playing audio, and the device capability parameters of the intelligent alarm clock 100-4 are alarm clock reminding. After the video playing application on the display device 100-1 runs in the foreground, the terminal device capable of executing video playing operation is searched in the local area network. And if the application data is the playing video, playing the video according to the application data and traversing the stored equipment capacity parameters. And finally, the device capability parameter of the display device 100-2 is found to play the video, and the display device 100-2 is determined as the relay terminal device if the video is matched with the current application data.

After the accessible terminal device is determined, the display device 100-1 generates a relay prompt for prompting that the user currently has the accessible terminal device, and the user can input a relay instruction according to the relay prompt. As shown in the schematic user interface diagram of fig. 8, since the display device has a display, the relay prompt generated may be to display a relay button on the display. The user can input the relay instruction by selecting the relay button. After receiving the relay instruction input by the user, the display device 100-1 generates a relay request according to the relay instruction and sends the relay request to the display device 100-2. Here, the relay request may carry an instruction to play a video and video data played on the display device 100-1 before relay. And after receiving the relay request, the display device 100-2 continues to play the video according to the video playing instruction and the video playing data.

In one scenario, as an application scenario diagram shown in fig. 9, the initiating relay terminal device is a tablet computer 200-1, and the first application is a video call application. The current scene is the video call by using the video call application of the tablet computer, and the application data of the first application is the video call data. In the same lan, there are also terminal devices such as the display device 200-2 and the mobile terminal 200-3. The device capability parameters of the display device 200-2 and the mobile terminal 200-3 are stored in the tablet computer 200-1 in advance.

The device capability parameters of the display device 200-2 are video playing and audio playing, and the device capability parameters of the mobile terminal 200-3 are video playing, audio playing, video call, and the like. The video call application on the tablet computer 200-1 runs in the foreground and searches for terminal equipment capable of executing video call operation in the local area network. And traversing the stored equipment capability parameters according to the application data video call if the application data is the video call. And finally, the equipment capability parameter of the mobile terminal 200-3 is found to be a video call and is matched with the current application data. The mobile terminal 200-3 is determined to be a batched terminal device.

After the accessible terminal device is determined, the tablet computer 200-1 generates a relay prompt, and the user prompts that the user currently has the accessible terminal device and can input a relay instruction according to the relay prompt. Since the tablet computer 200-1 has a display, the relay prompt generated may be a relay button displayed on the display. The user can select the relay button to input relay execution by talking. Here, the relay prompt may be a voice prompt. For example, after the existence of the connectable terminal device is determined, the user is prompted to trigger the relay through voice input by voice broadcasting 'please input the relay voice to start the relay'. The user can also be prompted to trigger relay through gestures by voice broadcasting 'please shake the equipment to start relay'. The prompts can also be displayed on the display at the same time, so that the user can conveniently perform related operations.

The relay is triggered according to the above manner, that is, after the user inputs the relay instruction, the tablet computer 200-1 receives the relay instruction, generates a relay request according to the relay instruction, and sends the relay request to the mobile terminal 200-3. Here, the relay request may carry an instruction of the video call and data related to the video call. After receiving the relay request, the mobile terminal 200-3 continues to perform the video call process according to the video call instruction and the video call data.

In one scenario, as shown in an application scenario diagram shown in fig. 10, the initiating relay terminal device is an intelligent alarm clock 300-1, and the first application is an alarm clock prompt application. The alarm clock prompting application with the current scene being the intelligent alarm clock is prompting, and the application data of the first application is the alarm clock prompting related data. In the same lan, there are also terminal devices such as the display device 300-2 and the display device 300-3. The device capability parameters of the display device 300-2 and the display device 300-3 are stored in the smart alarm clock 300-1 in advance.

The device capability parameters of the display device 300-2 are video playing and audio playing, and the device capability parameters of the display device 300-3 are video playing and audio playing. After the intelligent alarm clock application on the intelligent alarm clock 300-1 runs in the foreground, the intelligent alarm clock application is stored and searched for terminal equipment capable of executing alarm clock prompt operation in the local area network. And at the moment, the application data is an alarm clock prompt, and the stored equipment capability parameters are traversed according to the application data and the alarm clock prompt. Because no equipment capability parameter of other terminal equipment can match the alarm clock prompt of the current application data in the same local area network at present. Then, in the same local area network, there is no other terminal device capable of executing alarm clock prompt operation, that is, there is no connectable terminal device. In such a scenario, no relay prompt is generated on the intelligent alarm clock, and finally the operation of alarm clock prompting is still performed on the intelligent alarm clock 300-1.

In some embodiments, after receiving the relay request, the reachable terminal device executes an operation corresponding to the application data according to the application data carried in the relay request. After the relay, the terminal equipment capable of receiving the relay also feeds back a relay result to the initiating relay terminal equipment. The relay result is used for indicating the accessible terminal device to execute corresponding operation according to the application data.

For example, in the scenario shown in fig. 9, after the video call of the tablet pc 200-1 is relayed to the mobile terminal 200-3, the video call process is continued at the mobile terminal 200-3. Meanwhile, the mobile terminal 200-3 feeds back the relay result to the tablet computer 200-1. After receiving the fed-back relay result, the tablet computer 200-1 may display a prompt related to the relay result on the display. For example, a reminder of "video has been continued on the mobile terminal 200-3" is displayed.

In some embodiments, after the initiating relay terminal device receives the relay result fed back by the relay terminal device, the application process of the first application may be suspended, or the first application may be directly closed.

Illustratively, in the scenario shown in fig. 7, after the video playing of the first application of the display device 100-1 is relayed to the display device 100-2, the video playing process is continued on the display device 100-2. And the display device 100-2 feeds back the relay result to the display device 100-1. After receiving the fed-back relay result, the display device 100-2 may pause the video playing process of the video playing application. The display device 100-2 may also directly close the video playback application according to the relay result.

In some embodiments, after the relay terminal device starts to perform the corresponding operation according to the application data, the user may interrupt the relay at any time. For example, the user may input an interrupt relay instruction on the relay terminal device, and the relay terminal device stops executing the corresponding operation according to the application data after receiving the interrupt relay instruction. Or the user inputs an interruption relay instruction on the initiating relay terminal device, and the initiating relay terminal device sends the interruption relay instruction to the relay terminal device. And after the relay terminal equipment receives the relay interruption instruction word from the relay initiating terminal equipment, stopping executing corresponding operation according to the application data. It should be noted that the manner in which the user inputs the relay interruption instruction may be a voice input manner, a selection button input manner, a gesture input manner, and the like, which is not limited in the present application.

For example, in the application scenario shown in fig. 7, after the display device 100-2 receives the relay request, the video is relayed to be played. At this time, a relay interruption button may be displayed on the display device 100-1 or the display device 100-2. When the user selects the relay interruption button on the display device 100-1 or the display device 100-2, a relay interruption instruction is input. If the relay interruption button is selected on the display device 100-1, a relay interruption instruction is input on the display device 100-1. The display device 100-1 then sends the relay interrupt command to the display device 100-2. The display device 100-2 finishes the relay playing of the video according to the relay interruption instruction. If the relay interruption button is selected on the display device 100-2, a relay interruption instruction is directly input on the display device 100-2. And finally, the display device 100-2 finishes the relay playing of the video according to the relay interruption instruction.

In some embodiments, after the accessible terminal device finishes executing the corresponding operation according to the application data, that is, after finishing the relay operation, the accessible terminal device may feed back the execution progress data to the initiating relay terminal device. The execution progress data is used for indicating the execution progress of the corresponding operation executed according to the application data when the relay of the accessible terminal equipment is finished. And after the initiating relay terminal device receives the execution progress data fed back by the access terminal device, continuing to execute the corresponding operation of the application data according to the execution progress data.

For example, in the application scenario shown in fig. 7, the display device 100-2 feeds back the playing progress of the current video to the display device 100-1 after finishing the relay playing of the video according to the relay interruption instruction. For example, when the relay is finished, the playing progress of the video M on the display device 100-2 is 1 hour, 10 minutes and 6 seconds. The display device 100-2 feeds back the video playing progress of 52% to the display device 100-1. After the display device 100-1 receives the fed back progress of playing, it continues to play the video M from 1 hour, 10 minutes and 6 seconds.

In some embodiments, if there are at least two reachable terminal devices within the local area network and the initiating relay terminal device has a display, a list of reachable terminal devices is displayed on the display. The batched terminal device list includes at least two batched terminal devices, such as the user interface diagram shown in fig. 11. The names of at least two accessible terminal devices are listed in the user interface shown in fig. 11, and the user can input the relay instruction by selecting one of the accessible terminal devices, and only the relay instruction is sent to the selected accessible terminal device. The name of the available terminal device displayed in the available terminal device list may include a location where the device is currently located.

Illustratively, the master horizontal speaker is an initiating relay terminal device, and the first application is an audio playing application. The reachable terminal device found in the home lan includes: second floor TV, secondary lying sound box and other devices. If the user has the intention to lie next to the next, the relay instruction is input by selecting the next lying loudspeaker box from the accessible terminal equipment list, and the relay instruction is sent to the next lying loudspeaker box. And after the secondary horizontal sound box receives the relay instruction, the audio is played in a relay mode.

If the initiating relay terminal device is provided with a display, function option selection fields such as 'delay 5s playing', 'original device continues playing' and the like can be displayed on the user interface. For example, in the user interface shown in fig. 11, if the user selects the "delay 5s play" option, the initiating relay terminal device needs to wait for 5s after receiving the relay instruction input by the user, and then sends the relay instruction to the relay-enabled terminal device. In the 5s waiting process, the user can cancel the relay operation at any time. For example, when the initiated relay terminal device is a display device, the user may input a relay cancellation instruction by pressing a return key on the control device. Therefore, the situation that the user sends the relay instruction by mistake can be avoided. After the waiting process of 5s, if the relay cancelling instruction input by the user is not received, the relay instruction is sent to the selected reachable terminal device.

If the user selects 'original equipment continues playing', the selected accessible terminal equipment receives the relay instruction, starts to execute relay operation and simultaneously initiates the relay terminal equipment to continue the operation before relay. For example, in the application scenario shown in fig. 7, after the display device 100-2 performs the relay operation to play the video, the display device 100-1 continues to play the video. Therefore, the same video can be played on different terminal devices at the same time. At the moment, the playing process and the playing effect of the same video on different terminal devices are not affected.

In some embodiments, after the relay terminal device is initiated to send the relay instruction to the relay terminal device, the relay terminal device performs the relay operation. The relay terminal device can also be used as an initiating relay terminal device, and sends a relay instruction to other relay terminal devices, so that the other relay terminal devices can also execute relay operation. The initiating relay terminal device can also send a relay instruction to a plurality of relay terminal devices at the same time, so that the plurality of relay terminal devices execute relay operation.

Illustratively, a home lan includes a plurality of display devices: the system comprises a living room display device, a main horizontal display device, a secondary horizontal display device and a living room display device. The living room display device is used as a starting relay terminal device, and when the video playing application is used for playing the video, the relay instruction can be simultaneously sent to the other three display devices, so that the relay operation is executed after the relay instruction is received by the other three display devices, namely, the video playing operation is executed. Or the living room display device firstly initiates a receiving instruction to the main horizontal display device, and after the main horizontal display device executes the video playing operation, the main horizontal display device sends a relay instruction to the secondary horizontal display device, so that the secondary horizontal display device executes the video playing operation. And finally, sending a relay instruction to the guest lying display equipment by the secondary lying display equipment so that the guest lying display equipment executes video playing operation. It should be noted that, the user may set an automatic relay sending instruction on each terminal device, or the user may input the relay instruction and then send a relay request to other terminal devices according to the relay instruction.

In some embodiments, when the relay terminal device is initiated to search for the accessible terminal device, it is not only necessary to determine whether the device capability parameters of the other terminal devices are matched with the application data of the first application. It is also necessary to receive presence information of other terminal devices. If the device capability parameter of a certain terminal device matches with the application data of the first application, but the state of the terminal device is offline, the terminal device cannot be determined as a batched terminal device.

In some embodiments, if the relay initiating terminal device finds at least two reachable terminal devices, the terminal device that finally receives the relay request may be determined according to the frequency of use of the at least two reachable terminal devices.

Based on the foregoing embodiments, the present application further provides a content service relay method for a terminal device, as shown in a signaling diagram shown in fig. 12 and a method flowchart shown in fig. 13, where the method includes the following steps:

step S101, a first application is operated on a foreground on the initiated relay terminal device, and the relay terminal device is searched according to application data of the first application, wherein the relay terminal device is a terminal device capable of executing corresponding operation of the application data of the first application.

And step S102, if the relay terminal equipment exists, a relay prompt is generated so that a user inputs relay operation according to the relay prompt, a relay instruction is generated according to the relay operation, a relay request is generated according to the relay instruction, and the relay request is sent to the relay terminal equipment so that the relay terminal equipment can execute corresponding operation of application data according to application data carried by the relay request.

And step S103, if no relay terminal equipment exists, no relay prompt is generated.

The above embodiment is a scheme implemented based on a local area network, and the internal overall structure of the local area network of the present application is shown in fig. 14. The schematic diagram of the internal structure of the local area network shown in fig. 14 only exemplarily shows two terminal devices, and the two terminal devices can be used as both the initiating relay terminal device and the relay terminal device.

Wherein the relay assembly provides the following capabilities for the application upwards:

registering the equipment capability parameters of the terminal equipment to other terminals, and acquiring the equipment capability parameters from other terminal equipment. When some application of some terminal device is not started, the capability parameter of the application which is not started can be sent to other terminal devices through the hardware support component. And the basic information of the online and offline of the terminal equipment can be fed back to other terminal equipment through the hardware support component.

Fig. 15 to 17 show signaling diagrams of interaction between each component of the initiating relay terminal device and each component of the relay terminal device, where fig. 15 shows a process of capability registration, fig. 16 shows a process of acquiring the relay device, and fig. 17 shows a process of video relay playing. After the application of the specific terminal equipment is started (part of the application is not started and self-started, and the application service capacity installed on the current equipment is collected for unified registration after the whole terminal equipment is started), the equipment capacity is registered to the bottom layer service system through the relay component. And sends the registration result to other terminal devices. While the relay component also subscribes to application changes on the device.

Taking the process of video playing relay as an example, the interactive process is as follows: and querying the terminal equipment which can be relayed in the local area network through the relay assembly, and displaying a list of the terminal equipment which can be relayed through the application. After the relay terminal equipment is determined, the application generates a video playing request to request the relay assembly for the identifier and the playing progress of the currently played video, and after playing data is generated according to the identifier and the playing progress of the video, the playing data is transmitted to the opposite terminal through the relay assembly and the bottom layer service system. The inquiry of the relay terminal equipment is carried out through the relay assembly and the bottom system service. The relay terminal equipment is inquired, so that the video playing data is forwarded after the input operation of triggering the relay is received. And finally, after the relay terminal equipment receives the video playing data sent by the initiating relay terminal equipment, the application in the relay equipment is analyzed and played, and the relay result is fed back to the application in the initiating relay terminal equipment.

In some embodiments, searching for an accessible terminal device according to application data of an application may start searching after the application is started, which may improve system efficiency, the terminal device may include a plurality of different applications, and if the application is not started, the batched device may be queried, and data interaction generated in the querying process may improve operating pressure of the terminal device and/or the server and/or the batched device, so that searching for an accessible terminal device according to application data of the application after the application is started may alleviate the problem.

In some embodiments, the application data represents the current function, and some applications may not directly start the function after starting, for example, a video application, generally displays a list of media assets after the application starts, and starts playing a video only after a user selects the application, and an audio application has the same problem. Therefore, in some embodiments, after the application is started, the accessible terminal device is not directly searched according to the application data of the application, but when it is detected that the application data of the function corresponding to the application is called, the accessible terminal device is searched according to the application data of the application. For example, when the video application detects application data representing the starting of the playing function, the relay terminal equipment is searched according to the application data of the application; when the audio application detects application data for starting the representation playing function, the relay terminal equipment is searched according to the application data; and when the alarm clock application detects application data representing the starting of the alarm clock, searching the accessible terminal equipment according to the application data. Therefore, the user can normally operate after the application is started without invalid inquiry, and when the user starts the corresponding function, the relay terminal equipment is searched according to the application data of the application, so that the time for popping the relay prompt is more accurate, and the user experience is improved.

In some embodiments, the reachable terminal device may be found directly from application data of the application after the application is started.

The same or similar contents in the embodiments of the present application may be referred to each other, and the related embodiments are not described in detail.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A terminal device, comprising:

a controller configured to:

searching for a relay terminal device according to application data of a first application, wherein the first application is an application running in a foreground of the terminal device, and the relay terminal device is a terminal device capable of executing corresponding operation of the application data;

when the receiving terminal equipment exists in the same local area network, a relay prompt is generated so as to generate a relay instruction according to the relay operation of the input instruction relay, the relay operation is input by a user according to the relay prompt, a relay request is generated according to the relay instruction, and the relay request is used for being sent to the receiving terminal equipment so as to enable the receiving terminal equipment to execute corresponding operation of the application data according to the application data carried by the relay request;

and when the relay terminal equipment does not exist in the same local area network, the relay prompt is not generated.

2. The terminal device of claim 1, wherein the controller is further configured to:

and receiving a relay result sent by the relay terminal equipment, wherein the relay result is fed back after the relay terminal equipment executes corresponding operation according to the application data, and the relay result is used for indicating that the relay terminal equipment starts to execute corresponding operation according to the application data.

3. The terminal device of claim 1, wherein the controller is further configured to:

and generating a relay ending instruction according to the input instruction for ending the relay operation, and sending the relay ending instruction to the accessible terminal equipment so that the accessible terminal equipment ends executing corresponding operation according to the application data according to the relay ending instruction.

4. The terminal device of claim 3, wherein after the batched terminal device finishes performing the corresponding operation according to the application data, the controller is further configured to:

receiving execution progress data sent by the relay terminal equipment, wherein the execution progress data is used for indicating the execution progress of the corresponding operation of the application data when the relay terminal equipment finishes executing the corresponding operation according to the application data;

and according to the execution progress data, continuously executing the corresponding operation of the application data on the terminal equipment.

5. The terminal device of claim 1, wherein prior to finding an accessible terminal device based on application data of the first application, the controller is further configured to:

receiving equipment capacity parameters from other terminal equipment, wherein the equipment capacity parameters are parameters of applications installed in the other terminal equipment;

the step of determining whether the available terminal equipment exists is specifically as follows: matching the equipment capacity parameter with the application data, and determining other terminal equipment as the available terminal equipment when the equipment capacity parameter is matched with the application data;

and when the equipment capability parameter is not matched with the application data, determining that other terminal equipment is not the accessible terminal equipment.

6. The terminal device according to claim 1, wherein when the terminal device further includes a display, the relay prompt is a relay control displayed on the display, and the relay instruction is an instruction input by a user by selecting the relay control.

7. The terminal device according to claim 1, wherein when the terminal device further includes a display, and there are at least two of the reachable terminal devices, a list of reachable terminal devices is displayed on the display, the list of reachable terminal devices including at least two of the batable terminal devices.

8. The terminal device of claim 7, wherein the relay instruction is an instruction entered by a user by selecting one of the baton terminal devices in the baton terminal device list, and the selected baton terminal device is a terminal device that receives the relay request.

9. The terminal device according to claim 7, wherein the terminal device further stores a frequency of use of the reachable terminal device, and the baton terminal device with the highest frequency of use is the terminal device that receives the baton request.

10. A content service relay method of a terminal device, the method is applied to a controller of the terminal device, and is characterized by comprising the following steps:

searching for the relay terminal equipment according to application data of first application, wherein the first application is an application running in the foreground of the terminal equipment, and the relay terminal equipment is the terminal equipment capable of executing corresponding operation of the application data;

when the available terminal equipment exists in the same local area network, a relay prompt is generated so that a relay instruction is generated according to the input relay operation for indicating relay, the relay operation is input by a user according to the relay prompt, a relay request is generated according to the relay instruction, and the relay request is used for being sent to the available terminal equipment so that the available terminal equipment executes the corresponding operation of the application data according to the application data carried by the relay request;

and when the relay terminal equipment does not exist in the same local area network, the relay prompt is not generated.

Images