WO2023045597A1

WO2023045597A1 - Cross-device transfer control method and apparatus for large-screen service

Info

Publication number: WO2023045597A1
Application number: PCT/CN2022/111223
Authority: WO
Inventors: 夏永霖
Original assignee: 华为技术有限公司
Priority date: 2021-09-26
Filing date: 2022-08-09
Publication date: 2023-03-30
Also published as: CN115883893A

Abstract

Provided are a cross-device transfer control method and apparatus for a large-screen service. The method comprises: enabling a first service application on a large screen; the large screen sending a first control service request to a terminal, wherein the first control service request comprises identification information of the first service application and/or identification information of a first control service, and the first control service is a control service corresponding to the first service application; the terminal displaying, in response to the first control service request, a first control interface corresponding to the first control service; and the terminal implementing the control over the enabled first service application on the large screen by means of receiving an operation acting on the first control interface. By means of the embodiments of the present application, the process of a user selecting a corresponding control service from a smart screen application according to a foreground service application of a large screen can be omitted, such that the operation is simple, and the user experience is improved.

Description

Cross-device flow control method and device for large-screen business

This application claims the priority of the Chinese patent application with the application number 202111126695.4 and the application name "Cross-device flow control method and device for large-screen business" submitted to the China Patent Office on September 26, 2021, the entire contents of which are incorporated by reference in this application.

technical field

The embodiments of the present application relate to the field of terminals, and in particular to a method and device for controlling cross-device flow of large-screen services.

Background technique

At present, there are more and more application scenarios for large screens. In addition to traditional live TV scenarios, there are also new scenarios such as video on demand, screen projection, smooth calls, karaoke, photography, sports and fitness, and games. For different application scenarios, the operation methods required by users are also changing, which brings great challenges to large-screen remote controls. However, the physical buttons on the current remote control are limited, which cannot meet the control requirements of various application scenarios on the large screen.

In related technologies, a mobile phone can be used to remotely control the large screen, that is, a smart screen application is installed on the mobile phone, and commands for the large screen are input through the control service provided by the smart screen application, such as opening applications, searching content, and playing videos. Therefore, the problem that the remote controller cannot meet the control requirements caused by the lack of physical buttons is solved.

However, when the smart screen application itself determines the control service corresponding to the current application scenario of the large screen, there is a problem of complicated operation.

Contents of the invention

This application provides a method and device for large-screen business cross-device flow control, so as to save the user from the process of selecting the corresponding control service from the smart screen application according to the foreground business application of the large screen. The operation is simple and the user experience is improved.

In the first aspect, the embodiment of the present application provides a method for controlling cross-device flow of large-screen services, which is applied to a system including a large screen and a terminal, and the large screen and the terminal have a binding relationship; the method The steps include: opening a first service application on the large screen; sending a first operation service request to the terminal by the large screen, wherein the first operation service request includes identification information and/or identification information of the first service application Identification information of a first manipulation service, where the first manipulation service is a manipulation service corresponding to the first business application; in response to the first manipulation service request, the terminal displays the first manipulation service corresponding to the first manipulation service A manipulation interface; the terminal implements manipulation of the first service application opened on the large screen by receiving an operation acting on the first manipulation interface.

In the embodiment of this application, after receiving the control service request, the terminal can independently obtain its control interface, and then display it on the screen, which saves the user from selecting the corresponding control service from the smart screen application according to the foreground business application of the large screen. Correspondingly, users do not need to know the corresponding relationship between business applications and control services, and do not need to remember the selection path of each control service. The operation is simple and the user experience is improved.

According to the first aspect, the method further includes: switching the foreground business application of the large screen from the first business application to a second business application; the large screen sends a second manipulation service request to the terminal, wherein, The second manipulation service request includes identification information of the second service application and/or identification information of a second manipulation service, and the second manipulation service is a manipulation service corresponding to the second business application; the terminal In response to the second manipulation service request, displaying a second manipulation interface corresponding to the second manipulation service, wherein the second manipulation interface is different from the first manipulation interface; the terminal acts on the The operation on the second control interface realizes the control of the second service application opened on the large screen.

In the embodiment of the present application, after the foreground business application on the large screen is switched, the control interface of the control service corresponding to the business application before switching can be automatically closed on the terminal, and the control interface of the control service of the switched business application can be displayed on the terminal. Quickly display the control interface of the control service corresponding to different business applications, eliminating the need for the user to select the corresponding control service from the smart screen application according to the front-end business application of the large screen. Correspondingly, the user does not need to know the business application and control service There is no need to remember the selection path of each control service, the operation is simple, and the user experience is improved.

According to the first aspect, or any implementation manner of the above first aspect, after the large screen sends the second manipulation service request to the terminal, it further includes: the terminal closing the manipulation interface of the first manipulation service and Terminate the first manipulation service; or, the terminal closes the manipulation interface of the first manipulation service but retains the first manipulation service.

According to the first aspect, or any implementation manner of the above first aspect, the terminal implements the first service application opened on the large screen by receiving an operation acting on the first control interface The manipulation includes: the terminal generates a corresponding operation instruction by receiving an operation acting on the first manipulation interface and sends the operation instruction to the large screen; the large screen executes the corresponding operation according to the operation instruction. processing, so as to complete the manipulation of the first service application.

According to the first aspect, or any implementation manner of the above first aspect, after the terminal displays the first manipulation interface corresponding to the first manipulation service in response to the first manipulation service request, the method further includes : the large screen sends a manipulation termination request to the terminal, and the manipulation termination request includes the identification information of the first business application and/or the identification information of the first manipulation service; the terminal responds to the manipulation The request is terminated, and the first manipulation interface is no longer displayed; the large screen exits the first service application.

In the embodiment of this application, the user can directly control the large screen to exit the foreground business application, and the terminal can exit the control interface of the control service after receiving the control termination request sent by the large screen, so that the user can save the process of manually exiting the control service. Simple and improve user experience.

According to the first aspect, or any implementation manner of the above first aspect, after the terminal displays the first manipulation interface corresponding to the first manipulation service in response to the first manipulation service request, the method further includes : The terminal sends a service termination request to the large screen; the large screen exits the first service application in response to the service termination request; and the terminal no longer displays the first control interface.

According to the first aspect, or any implementation manner of the above first aspect, before the terminal no longer displays the first control interface, it further includes: the large screen sends a service application exit response to the terminal; The terminal no longer displaying the first manipulation interface includes: the terminal no longer displaying the first manipulation interface in response to the service application exit response.

In the embodiment of this application, the user can exit the foreground business application by controlling the large screen through the terminal, and the large screen can exit the foreground business application after receiving the service termination request sent by the terminal, so that the entire process of the business application on the large screen can be controlled by the terminal , easy to operate and enhance user experience.

According to the first aspect, or any implementation of the above first aspect, the first service application is a video-on-demand application, and the first manipulation service is a video broadcast control service; the first manipulation interface includes a video progress bar One or more of the controls in , Collections, and Recommended Videos.

According to the first aspect, or any implementation of the above first aspect, the first business application is a karaoke application, and the first manipulation service is a karaoke broadcast control service; the first manipulation interface includes recommended songs One or more controls in a list of recommended songs and a list of selected songs, the list of recommended songs includes one or more songs, and the list of selected songs includes songs selected by the user from the list of recommended songs.

According to the first aspect, or any implementation manner of the above first aspect, the first business application is a gallery application, and the first manipulation service is a gallery manipulation service; the first manipulation interface includes multiple thumbnails, The plurality of thumbnail images correspond to the plurality of images included in the gallery application.

According to the first aspect, or any implementation manner of the above first aspect, the first business application is a game application, and the first manipulation service is a game manipulation service; the first manipulation interface includes a game screen and/or One or more controls in the game operation buttons.

According to the first aspect, or any implementation manner of the above first aspect, the first service application is a live broadcast application, and the first control service is a live broadcast control service; the first control interface includes a live list, so The live list includes a plurality of classified sub-lists, and any one of the sub-lists includes one or more live channels.

According to the first aspect, or any implementation of the above first aspect, the first control interface further includes a "mobile phone remote control" button; when the terminal receives the When operating instructions, the remote control operation interface is displayed, and the remote control operation interface includes one or more controls in the up, down, left, and right direction keys, OK key, increase/decrease key, exit key, menu key, and power on/off key.

According to the first aspect, or any implementation manner of the above first aspect, the large screen pre-stores the correspondence between the first business application and the first manipulation service.

In the second aspect, the embodiment of the present application provides a large-screen service cross-device flow control method, which is applied to a terminal, including: receiving a first control service request from a large screen, wherein the first control service request includes the The identification information of the first business application opened on the large screen and/or the identification information of the first manipulation service, the first manipulation service is a manipulation service corresponding to the first business application; in response to the first manipulation service requesting to display a first manipulation interface corresponding to the first manipulation service; and realizing manipulation of the first business application opened on the large screen by receiving an operation acting on the first manipulation interface.

According to the second aspect, the method further includes: receiving a second manipulation service request from the terminal, wherein the second manipulation service request includes the information of the second business application after switching the foreground business application on the large screen Identification information and/or identification information of a second manipulation service, where the second manipulation service is a manipulation service corresponding to the second business application; in response to the second manipulation service request, displaying that the second manipulation service corresponds to The second manipulation interface, wherein, the second manipulation interface is different from the first manipulation interface; by receiving the operation acting on the second manipulation interface, the second manipulation interface opened on the large screen is implemented. Manipulation of business applications.

According to the second aspect, or any implementation manner of the above second aspect, after receiving the second manipulation service request from the terminal, it further includes: closing the manipulation interface of the first manipulation service and terminating the second manipulation service request. A manipulation service; or, close the manipulation interface of the first manipulation service but retain the first manipulation service.

According to the second aspect, or any implementation manner of the above second aspect, the manipulation of the first business application opened on the large screen is realized by receiving an operation acting on the first manipulation interface The method includes: generating a corresponding operation instruction by receiving an operation acting on the first manipulation interface; and sending the operation instruction to the large screen.

According to the second aspect, or any implementation manner of the above second aspect, the manipulation of the first business application opened on the large screen is realized by receiving an operation acting on the first manipulation interface Afterwards, the method further includes: receiving a manipulation termination request from the large screen, the manipulation termination request including the identification information of the first business application and/or the identification information of the first manipulation service; responding to the manipulation termination Request to no longer display the first manipulation interface.

According to the second aspect, or any implementation manner of the above second aspect, the manipulation of the first business application opened on the large screen is realized by receiving an operation acting on the first manipulation interface Afterwards, the method further includes: sending a service termination request to the large screen; and not displaying the first control interface again.

According to the second aspect, or any implementation manner of the above second aspect, before no longer displaying the first control interface, it further includes: receiving a service application exit response from the large screen; The first manipulation interface includes: no longer displaying the first manipulation interface in response to the service application exit response.

According to the second aspect, or any implementation of the above second aspect, the first service application is a video-on-demand application, the first manipulation service is a video broadcast control service; the first manipulation interface includes a video progress bar One or more of the controls in , Collections, and Recommended Videos.

According to the second aspect, or any implementation of the above second aspect, the first business application is a karaoke application, and the first manipulation service is a karaoke broadcast control service; the first manipulation interface includes recommended songs One or more controls in a list of recommended songs and a list of selected songs, the list of recommended songs includes one or more songs, and the list of selected songs includes songs selected by the user from the list of recommended songs.

According to the second aspect, or any implementation manner of the above second aspect, the first business application is a gallery application, and the first manipulation service is a gallery manipulation service; the first manipulation interface includes multiple thumbnails, The plurality of thumbnail images correspond to the plurality of images included in the gallery application.

According to the second aspect, or any implementation of the above second aspect, the first business application is a game application, and the first manipulation service is a game manipulation service; the first manipulation interface includes a game screen and/or One or more controls in the game operation buttons.

According to the second aspect, or any implementation manner of the above second aspect, the first service application is a live broadcast application, and the first control service is a live broadcast control service; the first control interface includes a live list, so The live list includes a plurality of classified sub-lists, and any one of the sub-lists includes one or more live channels.

According to the second aspect, or any implementation of the above second aspect, the first control interface further includes a "mobile phone remote control" button; when the terminal receives the When operating instructions, the remote control operation interface is displayed, and the remote control operation interface includes one or more controls in the up, down, left, and right direction keys, OK key, increase/decrease key, exit key, menu key, and power on/off key.

In the third aspect, the embodiment of the present application provides a large-screen business cross-device flow control method, which is applied to the large screen, including: opening the first business application; sending a first control service request to the terminal, wherein the first control The service request includes identification information of the first business application and/or identification information of a first manipulation service, where the first manipulation service is a manipulation service corresponding to the first business application.

According to the third aspect, the method further includes: switching the foreground service application from the first service application to a second service application; sending a second manipulation service request to the terminal, wherein the second manipulation service request includes The identification information of the second business application and/or the identification information of the second manipulation service, where the second manipulation service is a manipulation service corresponding to the second business application.

According to the third aspect, or any implementation manner of the third aspect above, after sending the first manipulation service request to the terminal, it further includes: receiving an operation instruction from the terminal, the operation instruction acting on the generated by an operation on the first manipulation interface on the terminal; corresponding processing is executed according to the operation instruction, so as to complete the manipulation of the first service application.

According to the third aspect, or any implementation manner of the above third aspect, after sending the first manipulation service request to the terminal, it further includes: sending a manipulation termination request to the terminal, the manipulation termination request including the first Identification information of a business application and/or identification information of the first manipulation service; exiting the first business application.

According to the third aspect, or any implementation manner of the above third aspect, after sending the first manipulation service request to the terminal, it further includes: receiving a service termination request from the terminal; in response to the service termination request, Exit the first business application.

According to the third aspect, or any implementation manner of the above third aspect, after exiting the first service application in response to the service termination request, the method further includes: sending a service application exit response to the terminal.

According to the third aspect, or any implementation manner of the above third aspect, the large screen pre-stores the correspondence between the first business application and the first manipulation service.

In a fourth aspect, an embodiment of the present application provides an electronic device used as a terminal, including: a transmission module, configured to receive a first manipulation service request from a large screen, wherein the first manipulation service request includes the large screen The identification information of the first business application opened on the Internet and/or the identification information of the first manipulation service, the first manipulation service is a manipulation service corresponding to the first business application; a display module, configured to respond to the first manipulation service A manipulation service request, displaying a first manipulation interface corresponding to the first manipulation service; a processing module configured to implement the first manipulation interface opened on the large screen by receiving an operation acting on the first manipulation interface A manipulation of a business application.

According to the fourth aspect, the transmission module is further configured to receive a second manipulation service request from the terminal, wherein the second manipulation service request includes the second business after switching the foreground business application on the large screen Application identification information and/or identification information of a second manipulation service, where the second manipulation service is a manipulation service corresponding to the second business application; the display module is further configured to respond to the second manipulation service A request to display a second manipulation interface corresponding to the second manipulation service, wherein the second manipulation interface is different from the first manipulation interface; the processing module is further configured to act on the second manipulation interface by receiving The operation on the interface realizes the manipulation of the second service application opened on the large screen.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the processing module is further configured to close the manipulation interface of the first manipulation service and terminate the first manipulation service; or, close the second manipulation service A control interface for a control service but retains the first control service.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the processing module is specifically configured to generate a corresponding operation instruction by receiving an operation acting on the first manipulation interface; the transmission module, It is also used to send the operation instruction to the large screen.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the transmission module is further configured to receive a manipulation termination request from the large screen, and the manipulation termination request includes the identification of the first service application information and/or identification information of the first manipulation service; the processing module is further configured to, in response to the manipulation termination request, no longer display the first manipulation interface.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the transmission module is further configured to send a service termination request to the large screen; the processing module is further configured to no longer display the first control interface.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the transmission module is further configured to receive a service application exit response from the large screen; the processing module is further configured to respond to the service The application quits responding, and the first manipulation interface is no longer displayed.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the first service application is a video-on-demand application, and the first manipulation service is a video broadcast control service; the first manipulation interface includes a video progress bar One or more of the controls in , Collections, and Recommended Videos.

According to the fourth aspect, or any implementation of the fourth aspect above, the first business application is a karaoke application, and the first manipulation service is a karaoke broadcast control service; the first manipulation interface includes recommended songs One or more controls in a list of recommended songs and a list of selected songs, the list of recommended songs includes one or more songs, and the list of selected songs includes songs selected by the user from the list of recommended songs.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the first business application is a gallery application, and the first manipulation service is a gallery manipulation service; the first manipulation interface includes multiple thumbnails, The plurality of thumbnail images correspond to the plurality of images included in the gallery application.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the first business application is a game application, and the first manipulation service is a game manipulation service; the first manipulation interface includes a game screen and/or One or more controls in the game operation buttons.

According to the fourth aspect, or any implementation manner of the above fourth aspect, the first service application is a live broadcast application, and the first control service is a live broadcast control service; the first control interface includes a live list, so The live list includes a plurality of classified sub-lists, and any one of the sub-lists includes one or more live channels.

According to the fourth aspect, or any implementation of the above fourth aspect, the first control interface further includes a "mobile phone remote control" button; when the terminal receives the When operating instructions, the remote control operation interface is displayed, and the remote control operation interface includes one or more controls in the up, down, left, and right direction keys, OK key, increase/decrease key, exit key, menu key, and power on/off key.

In the fifth aspect, the embodiment of the present application provides an electronic device used as a large screen, including: a processing module, configured to start a first business application; a transmission module, configured to send a first manipulation service request to a terminal, wherein the The first manipulation service request includes identification information of the first business application and/or identification information of the first manipulation service, where the first manipulation service is a manipulation service corresponding to the first business application.

According to the fifth aspect, the processing module is further configured to switch the foreground business application from the first business application to the second business application; the transmission module is further configured to send a second manipulation service request to the terminal, Wherein, the second manipulation service request includes identification information of the second business application and/or identification information of the second manipulation service, and the second manipulation service is a manipulation service corresponding to the second business application.

According to the fifth aspect, or any implementation manner of the above fifth aspect, the transmission module is further configured to receive an operation instruction from the terminal, and the operation instruction acts on the first control interface on the terminal Generated by the operation on the above; the processing module is further configured to execute corresponding processing according to the operation instruction, so as to complete the manipulation of the first service application.

According to the fifth aspect, or any implementation manner of the above fifth aspect, the transmission module is further configured to send a manipulation termination request to the terminal, where the manipulation termination request includes the identification information of the first service application and /or the identification information of the first manipulation service; the processing module is further configured to exit the first service application.

According to the fifth aspect, or any implementation manner of the fifth aspect above, the transmission module is further configured to receive a service termination request from the terminal; the processing module is further configured to respond to the service termination request , exit the first service application.

According to the fifth aspect, or any implementation manner of the above fifth aspect, the transmission module is further configured to send a service application exit response to the terminal.

According to the fifth aspect, or any implementation manner of the above fifth aspect, the electronic device pre-stores the correspondence between the first business application and the first manipulation service.

In a sixth aspect, the embodiment of the present application provides an electronic device, including: a processor and a transceiver; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors Execute, so that the one or more processors implement the method in the second to third aspects or any possible implementation manners of the second to third aspects.

In the seventh aspect, the embodiment of the present application provides a computer-readable storage medium, including a computer program, which is characterized in that, when the computer program is run on the camera, the camera is executed as in the second to third aspects or the second to a method in any possible implementation of the three aspects.

In an eighth aspect, the embodiment of the present application provides a chip, including one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from a memory of an electronic device and send the signal to the processor. The signal, the signal includes a computer instruction stored in the memory; when the processor executes the computer instruction, the electronic device is made to perform any one of the possible functions of the second to third aspects or the second to third aspects method in the implementation.

Description of drawings

FIG. 1 is an exemplary schematic diagram of a remote control controlling a large screen;

Fig. 2 is an exemplary schematic diagram of using a remote controller to input text on a large screen;

FIG. 3 is an exemplary schematic diagram of a smart screen application;

FIG. 4 is an exemplary structural diagram of an application scenario 40 provided by an embodiment of the present application;

FIG. 5 is an exemplary structural diagram of an electronic device 500 provided in an embodiment of the present application;

FIG. 6 is an exemplary software structural block diagram of an electronic device 500 provided by an embodiment of the present application;

Fig. 7 is an exemplary structural block diagram of the cross-device flow control of large-screen services provided by the embodiment of the present application;

FIG. 8 is a flow chart of a process 800 of a large-screen business cross-device flow control method according to an embodiment of the present application;

FIG. 9 is a flow chart of a process 900 of a large-screen business cross-device flow control method according to an embodiment of the present application;

FIG. 10 is a flow chart of a process 1000 of a large-screen business cross-device flow control method according to an embodiment of the present application;

FIG. 11 is an exemplary interactive communication flow diagram for establishing cross-device flow control of large-screen services provided by the embodiment of the present application;

FIG. 12 is an exemplary interactive communication flow diagram of the cross-device flow control for exiting the large-screen business provided by the embodiment of the present application;

Fig. 13 is an exemplary interactive communication flow diagram of the cross-device flow control for exiting the large-screen business provided by the embodiment of the present application;

Figure 14a is a schematic diagram of the main interface of P30pro;

Fig. 14b is a schematic diagram of the main interface of the smart screen application;

Figure 14c is an exemplary schematic diagram of the remote control interface;

Figure 14d is an exemplary schematic diagram of the main interface of V65;

Figure 14e is an exemplary schematic diagram of cross-device flow control between V65 and P30pro;

Fig. 15a is an exemplary schematic diagram of the main interface of V65;

Figure 15b is an exemplary schematic diagram of V65 and P30pro performing cross-device flow control;

Figure 16a is an exemplary schematic diagram of the main interface of V65;

Figure 16b is an exemplary schematic diagram of cross-device flow control between V65 and P30pro;

Figure 17 is an exemplary schematic diagram of V65 and P30pro performing cross-device flow control;

Figure 18 is an exemplary schematic diagram of V65 and P30pro performing cross-device flow control;

Figure 19 is a schematic diagram of the main interface of P30pro;

FIG. 20 is a flowchart of a process 2000 of a large-screen business cross-device flow control method according to an embodiment of the present application;

Fig. 21a is a schematic diagram of the video call interface of V65;

Figure 21b is an exemplary schematic diagram of V65 and P30pro performing cross-device flow control;

Fig. 22 shows a schematic block diagram of an apparatus 2200 according to an embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The term "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations.

The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order of objects. For example, the first target object, the second target object, etc. are used to distinguish different target objects, rather than describing a specific order of the target objects.

In the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations or illustrations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application shall not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

Figure 1 is an exemplary schematic diagram of a remote control controlling a large screen. As shown in Figure 1, the remote control usually includes a power button, a home button, up, down, left, and right arrow keys, a confirmation key, a return key, a voice key, a menu key, Increase key and decrease key. When using the remote control to control the large screen, the user can click the up, down, left, and right keys to move the focus on the large screen. During the movement, the focus can be accompanied by a dynamic effect, and then click the OK button to select the content corresponding to the current focus. With the development of large-screen technology, in addition to the traditional live TV scene, video-on-demand, karaoke, sports and fitness, smooth calls, gallery and other scenes have been added to the big screen. For different application scenarios, the operation mode required by the user is also changing, which brings great challenges to the remote control. For example, Figure 2 is an exemplary schematic diagram of using a remote control to input text on a large screen. As shown in Figure 2, to input the five characters "My Smart Screen", the user needs to click On all the pinyin letters of a word, and click the OK button every time a letter is selected, which takes about 60 steps. It can be seen that it will be very cumbersome to perform complex operations with the remote control, which cannot meet the control requirements of various application scenarios on the large screen.

Based on this, in related technologies, the mobile phone can be used to remotely control the large screen, that is, the smart screen application is installed on the mobile phone. Figure 3 is an exemplary schematic diagram of the smart screen application. As shown in Figure 3, on the main interface of the smart screen application It shows that the connected large screen is Huawei Smart Screen, and the usage time of Huawei Smart Screen today is 4 hours and 48 minutes. You can click the power button on the right to turn on/off Huawei Smart Screen. The mirror control, remote control, smooth call, search video, message board, remote housekeeping and other buttons below can be clicked to enter the control service interface of the corresponding application scene. For example, by clicking the "remote control" button, an analog remote control similar to the panel of the remote control shown in Figure 1 can be displayed on the mobile phone, as shown in Figure 14c for example. It can be seen that inputting large-screen commands through the control service provided by the smart screen application can solve the problem that the remote control cannot meet the control requirements caused by the lack of physical buttons.

However, as mentioned above, even if the smart screen application can provide corresponding control services for various large-screen application scenarios, the process of selecting the corresponding control service requires the user to know the corresponding relationship between the application scenario and the control service in advance. It also requires the user to remember the selection path of each control service, which not only complicates the operation, but also affects the user experience.

Therefore, the embodiment of the present application provides a method for controlling cross-device flow of large-screen services to solve the above problems. Exemplarily, by applying the cross-device transfer control method provided by the embodiment of the present application, in the scenario shown in FIG. You can conveniently input text in the input box on the large screen by operating the terminal device.

Before describing the technical solutions of the embodiments of the present application, firstly, the application scenarios of the embodiments of the present application will be described with reference to the accompanying drawings. FIG. 4 is an exemplary structural diagram of an application scenario 40 provided by the embodiment of the present application. As shown in FIG. 4 , in the application scenario 40, at least two electronic devices may be included, for example, device A, device B and device C , wherein at least one electronic device is a large screen, the large screen can be a smart screen, or it can refer to a set-top box (such as a TV box) running an operating system and an application program and an external display device, etc., and at least one electronic device is a terminal , the terminal can be a mobile phone, a tablet computer, and the like. The application scenario 40 may also include a cloud server.

In the embodiment of this application, a variety of business applications that can be used on the large screen are deployed on the large screen, such as live broadcast, video on demand, karaoke, sports and fitness, games, etc.; various controls corresponding to the aforementioned business applications are deployed on the terminal Services, such as mobile phone remote control, video broadcast control service, motion control service, game control service, etc. The various control services can be provided by applications installed on the terminal (for example, smart screen applications); device data and content data related to the large screen are deployed on the cloud server, for example, card or small program data for control services, and for example , video content posters, video recommendations, etc., are used to synchronize to the application of the terminal, and then displayed on the screen of the terminal.

It should be understood that the embodiment of the present application does not specifically limit the quantity and form of electronic devices included in the application scenario 40 .

In addition, any two electronic devices in the application scenario 40 and the cloud server may communicate with each other in many different ways, for example, communicate through connection or by means of future communication technologies to transmit data. Wherein, the connection manner may include various connection manners such as wired connection or wireless connection. Exemplarily, the two electronic devices may be connected through a USB data cable; the wireless connection between the two electronic devices may be through establishing a Wi-Fi connection, a proximity connection of near field communication, a Bluetooth code scanning connection, and the like. Two electronic devices can also use future communication technologies, for example, by installing different or the same applications on mobile phones and tablets, and transmit data with the help of 5G communication networks. The connection method or communication method is not limited.

In the embodiment of the present application, at least two electronic devices in the application scenario 40 may be bound to each other, and the method for establishing the binding relationship may include any one or more of the following:

(1) Automatically establish a binding relationship between multiple electronic devices that are in the same local area network and log in with the same account (such as a Huawei account).

(2) A binding relationship can be established between multiple electronic devices through methods such as touch and code scanning.

Multiple electronic devices that have established a binding relationship can maintain an electronic device list respectively, and the list lists the information of electronic devices that have a binding relationship with themselves. The information of the electronic device can include the device identification of the electronic device, Device type, device model, etc. For example, the electronic device list maintained by the large screen includes device identifiers of two electronic devices, and the two electronic devices are a mobile phone and a tablet computer. In addition, the electronic device list may also include information about the operation service of the electronic device, for example, identification information of the operation service that the electronic device can provide (such as the name and index of the operation service).

In the embodiment of the present application, the electronic device can periodically update the electronic device list. For example, every predetermined time interval, the electronic device searches the surrounding environment to see if there is an electronic device with the same account in the same local area network, and according to the search As a result, the electronic device list is updated; the electronic device can also update the electronic device list based on the trigger of a certain event, for example, when other electronic devices touch the electronic device, or scan the QR code displayed by the electronic device, the electronic device The device can add the other electronic device into the list of electronic devices.

It should be noted that, in addition to the above two methods, the present application may also adopt other methods to establish a binding relationship between multiple electronic devices, thereby constituting an application scenario, which is not specifically limited in the present application.

FIG. 5 is an exemplary structural diagram of an electronic device 500 provided in an embodiment of the present application. As shown in FIG. 5 , the electronic device 500 may be any one of at least two electronic devices included in the application scenario 40 shown in FIG. 4 .

It should be understood that the electronic device 500 shown in FIG. 5 is only an example, and that the electronic device 500 may have more or fewer components than shown in the figure, may combine two or more components, or may with different part configurations. The various components shown in Figure 5 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The electronic device 500 may include: a processor 510, an external memory interface 520, an internal memory 521, a universal serial bus (universal serial bus, USB) interface 530, a charging management module 540, a power management module 541, a battery 542, an antenna 1, and an antenna 2. Mobile communication module 550, wireless communication module 560, audio module 570, speaker 570A, receiver 570B, microphone 570C, earphone jack 570D, sensor module 580, buttons 590, motor 591, indicator 592, camera 593, display screen 594, And a subscriber identification module (subscriber identification module, SIM) card interface 595, etc. The sensor module 580 may include a pressure sensor 580A, a gyroscope sensor 580B, an air pressure sensor 580C, a magnetic sensor 580D, an acceleration sensor 580E, a distance sensor 580F, a proximity light sensor 580G, a fingerprint sensor 580H, a temperature sensor 580J, a touch sensor 580K, and ambient light Sensor 580L, bone conduction sensor 580M, etc.

The processor 510 may include one or more processing units, for example: the processor 510 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

Wherein, the controller may be the nerve center and command center of the electronic device 500 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 510 for storing instructions and data. In some embodiments, the memory in processor 510 is a cache memory. The memory may hold instructions or data that the processor 510 has just used or recycled. If the processor 510 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 510 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 510 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 510 may include multiple sets of I2C buses. The processor 510 can be respectively coupled to the touch sensor 580K, the charger, the flashlight, the camera 593 and the like through different I2C bus interfaces. For example, the processor 510 may be coupled to the touch sensor 580K through the I2C interface, so that the processor 510 and the touch sensor 580K communicate through the I2C bus interface to realize the touch function of the electronic device 500 .

The I2S interface can be used for audio communication. In some embodiments, processor 510 may include multiple sets of I2S buses. The processor 510 may be coupled to the audio module 570 through an I2S bus to implement communication between the processor 510 and the audio module 570 . In some embodiments, the audio module 570 can transmit audio signals to the wireless communication module 560 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.

The PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal. In some embodiments, the audio module 570 and the wireless communication module 560 may be coupled through a PCM bus interface. In some embodiments, the audio module 570 can also transmit audio signals to the wireless communication module 560 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 510 and the wireless communication module 560 . For example: the processor 510 communicates with the Bluetooth module in the wireless communication module 560 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 570 can transmit audio signals to the wireless communication module 560 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.

The MIPI interface can be used to connect the processor 510 with peripheral devices such as a display screen 594 and a camera 593 . MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In some embodiments, the processor 510 communicates with the camera 593 through the CSI interface to realize the shooting function of the electronic device 500 . The processor 510 communicates with the display screen 594 through the DSI interface to realize the display function of the electronic device 500 .

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 510 with the camera 593 , the display screen 594 , the wireless communication module 560 , the audio module 570 , the sensor module 580 and so on. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 530 is an interface conforming to the USB standard specification, specifically, it may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 530 can be used to connect a charger to charge the electronic device 500, and can also be used to transmit data between the electronic device 500 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.

It should be understood that the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 500 . In other embodiments of the present application, the electronic device 500 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 540 is used for receiving charging input from the charger. Wherein, the charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 540 can receive charging input from a wired charger through the USB interface 530 . In some wireless charging embodiments, the charging management module 540 may receive wireless charging input through a wireless charging coil of the electronic device 500 . While the charging management module 540 is charging the battery 542 , it can also supply power to the electronic device through the power management module 541 .

The power management module 541 is used for connecting the battery 542 , the charging management module 540 and the processor 510 . The power management module 541 receives the input of the battery 542 and/or the charging management module 540, and supplies power for the processor 510, the internal memory 521, the external memory, the display screen 594, the camera 593, and the wireless communication module 560, etc. The power management module 541 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 541 may also be set in the processor 510 . In some other embodiments, the power management module 541 and the charging management module 540 may also be set in the same device.

The wireless communication function of the electronic device 500 can be realized by the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, the modem processor and the baseband processor.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 500 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 550 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 500 . The mobile communication module 550 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 550 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 550 can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 550 may be set in the processor 510 . In some embodiments, at least part of the functional modules of the mobile communication module 550 and at least part of the modules of the processor 510 may be set in the same device.

A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through audio equipment (not limited to speaker 570A, receiver 570B, etc.), or displays images or videos through display screen 594 . In some embodiments, the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent of the processor 510, and be set in the same device as the mobile communication module 550 or other functional modules.

The wireless communication module 560 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. applied on the electronic device 500. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 560 may be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 510 . The wireless communication module 560 can also receive the signal to be transmitted from the processor 510 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the electronic device 500 is coupled to the mobile communication module 550, and the antenna 2 is coupled to the wireless communication module 560, so that the electronic device 500 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device 500 implements a display function through a GPU, a display screen 594, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 594 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 510 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 594 is used to display images, videos and the like. Display 594 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 500 may include 1 or N display screens 594, where N is a positive integer greater than 1.

The electronic device 500 can realize the shooting function through an ISP, a camera 593 , a video codec, a GPU, a display screen 594 , and an application processor.

The ISP is used for processing the data fed back by the camera 593 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 593 .

Camera 593 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the electronic device 500 may include 1 or N cameras 593, where N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 500 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 500 may support one or more video codecs. In this way, the electronic device 500 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.

The NPU is a neural-network (NN) computing processor. By referring to the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process input information and continuously learn by itself. Applications such as intelligent cognition of the electronic device 500 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 520 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 500. The external memory card communicates with the processor 510 through the external memory interface 520 to implement a data storage function. Such as saving music, video and other files in the external memory card.

The internal memory 521 may be used to store computer-executable program codes including instructions. The processor 510 executes various functional applications and data processing of the electronic device 500 by executing instructions stored in the internal memory 521 . The internal memory 521 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data created during the use of the electronic device 500 (such as audio data, phonebook, etc.) and the like. In addition, the internal memory 521 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.

The electronic device 500 can implement audio functions through an audio module 570 , a speaker 570A, a receiver 570B, a microphone 570C, an earphone interface 570D, and an application processor. Such as music playback, recording, etc.

The audio module 570 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 570 may also be used to encode and decode audio signals. In some embodiments, the audio module 570 may be set in the processor 510 , or some functional modules of the audio module 570 may be set in the processor 510 .

The speaker 570A, also called "horn", is used to convert audio electrical signals into sound signals. Electronic device 500 can listen to music through speaker 570A, or listen to hands-free calls.

Receiver 570B, also called "earpiece", is used to convert audio electrical signals into audio signals. When the electronic device 500 receives a call or a voice message, the receiver 570B can be placed close to the human ear to receive the voice.

Microphone 570C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by putting his mouth close to the microphone 570C, and input the sound signal to the microphone 570C. The electronic device 500 may be provided with at least one microphone 570C. In some other embodiments, the electronic device 500 may be provided with two microphones 570C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 500 can also be provided with three, four or more microphones 570C, so as to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.

The earphone interface 570D is used for connecting wired earphones. The earphone interface 570D may be a USB interface 530, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

The pressure sensor 580A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, pressure sensor 580A may be located on display screen 594 . There are many types of pressure sensors 580A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to pressure sensor 580A, the capacitance between the electrodes changes. The electronic device 500 determines the intensity of pressure according to the change in capacitance. When a touch operation acts on the display screen 594, the electronic device 500 detects the intensity of the touch operation according to the pressure sensor 580A. The electronic device 500 may also calculate the touched position according to the detection signal of the pressure sensor 580A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.

The gyro sensor 580B can be used to determine the motion posture of the electronic device 500 . In some embodiments, the angular velocity of the electronic device 500 about three axes (ie, x, y and z axes) may be determined by the gyro sensor 580B. The gyro sensor 580B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 580B detects the shaking angle of the electronic device 500, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shaking of the electronic device 500 through reverse movement to achieve anti-shake. The gyroscope sensor 580B can also be used for navigation and somatosensory game scenes.

The air pressure sensor 580C is used to measure air pressure. In some embodiments, the electronic device 500 calculates the altitude based on the air pressure value measured by the air pressure sensor 580C to assist positioning and navigation.

The magnetic sensor 580D includes a Hall sensor. The electronic device 500 may use the magnetic sensor 580D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 500 is a flip machine, the electronic device 500 may detect opening and closing of the flip according to the magnetic sensor 580D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor 580E can detect the acceleration of the electronic device 500 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the electronic device 500 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

Distance sensor 580F, used to measure distance. The electronic device 500 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 500 can use the distance sensor 580F for distance measurement to achieve fast focusing.

Proximity light sensor 580G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The electronic device 500 emits infrared light through the light emitting diode. Electronic device 500 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object near the electronic device 500 . When insufficient reflected light is detected, the electronic device 500 may determine that there is no object near the electronic device 500. The electronic device 500 can use the proximity light sensor 580G to detect that the user holds the electronic device 500 close to the ear to make a call, so as to automatically turn off the screen to save power. Proximity light sensor 580G can also be used in leather case mode, automatic unlock and lock screen in pocket mode.

The ambient light sensor 580L is used for sensing ambient light brightness. The electronic device 500 can adaptively adjust the brightness of the display screen 594 according to the perceived ambient light brightness. The ambient light sensor 580L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 580L can also cooperate with the proximity light sensor 580G to detect whether the electronic device 500 is in the pocket, so as to prevent accidental touch.

The fingerprint sensor 580H is used to collect fingerprints. The electronic device 500 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, fingerprint photography, and fingerprint answering of incoming calls.

The temperature sensor 580J is used to detect temperature. In some embodiments, the electronic device 500 uses the temperature detected by the temperature sensor 580J to implement a temperature treatment strategy. For example, when the temperature reported by the temperature sensor 580J exceeds the threshold, the electronic device 500 may reduce the performance of the processor located near the temperature sensor 580J, so as to reduce power consumption and implement thermal protection. In some other embodiments, when the temperature is lower than another threshold, the electronic device 500 heats the battery 542 to avoid abnormal shutdown of the electronic device 500 caused by the low temperature. In some other embodiments, when the temperature is lower than another threshold, the electronic device 500 boosts the output voltage of the battery 542 to avoid abnormal shutdown caused by low temperature.

Touch sensor 580K, also known as "touch panel". The touch sensor 580K can be arranged on the display screen 594, and the touch sensor 580K and the display screen 594 form a touch screen, also called “touch screen”. The touch sensor 580K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations can be provided through the display screen 594 . In some other embodiments, the touch sensor 580K may also be disposed on the surface of the electronic device 500 , which is different from the position of the display screen 594 .

The bone conduction sensor 580M can acquire vibration signals. In some embodiments, the bone conduction sensor 580M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 580M can also touch the human pulse and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 580M can also be disposed in the earphone, combined into a bone conduction earphone. The audio module 570 can analyze the voice signal based on the vibration signal of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 580M, so as to realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 580M, so as to realize the heart rate detection function.

The keys 590 include a power key, a volume key and the like. The key 590 may be a mechanical key. It can also be a touch button. The electronic device 500 may receive key input and generate key signal input related to user settings and function control of the electronic device 500 .

The motor 591 can generate a vibrating reminder. The motor 591 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. The motor 591 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 594 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 592 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and can also be used to indicate messages, missed calls, notifications and so on.

The SIM card interface 595 is used for connecting a SIM card. The SIM card can be connected and separated from the electronic device 500 by inserting it into the SIM card interface 595 or pulling it out from the SIM card interface 595 . The electronic device 500 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 595 can support Nano SIM card, Micro SIM card, SIM card etc. Multiple cards can be inserted into the same SIM card interface 595 at the same time. The types of the multiple cards may be the same or different. The SIM card interface 595 is also compatible with different types of SIM cards. The SIM card interface 595 is also compatible with external memory cards. The electronic device 500 interacts with the network through the SIM card to implement functions such as calling and data communication. In some embodiments, the electronic device 500 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 500 and cannot be separated from the electronic device 500 .

The software system of the electronic device 500 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 500 .

FIG. 6 is a block diagram of an exemplary software structure of an electronic device 500 provided by an embodiment of the present application.

The layered architecture of the electronic device 500 divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer from top to bottom.

The application layer can consist of a series of application packages.

As shown in FIG. 6, the application package may include application programs such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 6, the application framework layer can include window manager, phone manager, content provider, view system, resource manager, notification manager, etc.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

The phone manager is used to provide communication functions of the electronic device 500 . For example, the management of call status (including connected, hung up, etc.).

Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the download completion, message reminder, etc. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.

Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

A system library can include multiple function modules. For example: surface manager (surface manager), two-dimensional graphics engine (for example: SGL), three-dimensional graphics processing library (for example: OpenGL ES), media library (Media Libraries), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

2D graphics engine is a drawing engine for 2D drawing.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.

The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, an audio driver, a Wi-Fi driver, a sensor driver, and a Bluetooth driver.

It should be understood that the components included in the software structure shown in FIG. 6 do not constitute a specific limitation on the electronic device 500 . In other embodiments of the present application, the electronic device 500 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.

This application can deploy large-screen business applications on the large screen, and deploy control services on the terminal, so as to control the corresponding large-screen business application on the large screen through the control service on the terminal, so as to realize cross-device flow control of large-screen services .

Fig. 7 is an exemplary structural block diagram of the cross-device flow control of the large-screen service provided by the embodiment of the present application. As shown in Figure 7, multiple business applications (for example, business applications 1-3) are deployed on the large screen, such as live broadcast, video on demand, karaoke, sports and fitness, games, etc.; Control services (for example, control services 1-3), such as mobile phone remote control, video broadcast control service, motion control service, game control service, etc. The business application on the large screen and the control service on the terminal may have the following correspondence: control service 1 corresponds to business application 1, control service 2 corresponds to business application 2, and control service 3 corresponds to business application 3. For example, the live service control service controls live broadcast applications, the video broadcast control service controls video-on-demand applications, the sports control service controls sports and fitness applications, the game control service controls game applications, and so on.

In addition, the framework layer is deployed on both the large screen and the terminal, which includes: distributed soft bus, distributed security authentication, distributed task scheduling and transfer task management services, among which,

The distributed soft bus uses a unified communication base based on distributed devices such as mobile phones, tablets, smart wearable devices, and smart screens to provide unified distributed communication capabilities for the interconnection and intercommunication between electronic devices; distributed security authentication provides E2E The encrypted channel provides a secure cross-device transmission mechanism for user applications, ensuring that "the correct person uses the correct data through the correct device"; distributed task scheduling provides capabilities such as remote service startup, remote service connection, and remote migration Through the combination of different capabilities, it can support the user's application to complete cross-device migration or multi-device collaboration business experience; the transfer task management service implements the registration of the user's application, provides transfer entry, status maintenance, status display, exit transfer, etc. management ability.

Based on the above-mentioned embodiments shown in FIG. 4-FIG. 7, the embodiment of the present application provides a method for controlling cross-device flow of large-screen services, so as to simplify the operation process when determining and controlling services and improve user experience.

FIG. 8 is a flowchart of a process 800 of a method for controlling cross-device flow of large-screen services according to an embodiment of the present application. The process 800 can be jointly executed by two electronic devices in the application scenario 40, wherein one electronic device is a large screen, and the other electronic device is a terminal. The process 800 is described as a series of steps or operations. It should be understood that the process 800 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 8 . Process 800 may include:

Step 801, start the business application on the big screen.

When a service application is started on the large screen, the service application is displayed on the screen of the large screen at this time, and the service application may be called a foreground service application of the large screen.

Step 802, the large screen sends a manipulation service request to the terminal.

In order to realize the cross-device flow control of the business application of the large screen and the terminal, after the business application is opened on the large screen, it can send a control service request to the terminal.

In a possible implementation manner, the manipulation service request includes identification information of the requested manipulation service, and the manipulation service is a manipulation service corresponding to the foreground business application of the large screen, that is, the manipulation service requested by the large screen from the terminal is for Control the foreground business application. The large screen can store the preset correspondence between business applications and control services. When the large screen needs to perform cross-device flow control on the foreground business application, it can query the corresponding relationship to obtain the control service corresponding to the foreground business application, and then The identification information of the manipulation service is written into the manipulation service request and sent to the terminal, so that the terminal can determine the manipulation service requested by the large screen according to the identification information of the manipulation service. The identification information of the manipulation service may be the name, index, etc. of the manipulation service.

In a possible implementation, the control service request includes the identification information of the foreground business application on the large screen, so that the terminal can determine the foreground business application according to the identification information of the foreground business application, and then according to the preset business application and control service The corresponding relationship between them determines the manipulation service corresponding to the foreground business application.

In a possible implementation manner, the manipulation service request may include both identification information of the requested manipulation service and identification information of the foreground business application on the large screen.

For example, the foreground business application on the large screen is a game application (such as a racing game), which is difficult to control if only the remote control is used, so the large screen sends a control service request to the terminal, and the control service request includes the name of the racing game control service to request to control the racing game through the racing game control service on the terminal.

In step 803, the terminal displays a manipulation interface corresponding to the manipulation service in response to the manipulation service request.

After receiving the manipulation service request, the terminal may determine the manipulation service requested by the large screen based on the identification information of the manipulation service in the manipulation service request. Alternatively, after receiving the manipulation service request, the terminal may determine the foreground business application on the large screen based on the identification information of the foreground business application in the manipulation service request, and then determine the corresponding The control service corresponding to the foreground business application.

The terminal needs to obtain some data to generate a control interface for the control service. Some of these data can come from the cloud server, and the other part can come from the large screen. The data from the cloud server can include content data of business applications, recommendation information based on the user's personal habits, user's historical collection, user's address book, Setting information of business applications, etc.; data from the large screen may include screenshots of the large screen, a gallery on the large screen, a list of business applications installed on the large screen, etc. It should be understood that there is a one-to-one correspondence between the control interface generated by the terminal and the control service, so the data required to generate the control interface is associated with the control service and the service application corresponding to the control service, and these data are not limited to the foregoing examples. Other data may also be included, which is not specifically limited in this embodiment of the present application.

When the large screen requests the above-mentioned control service for the first time, the terminal may not have the data required to generate the control interface, or only part of the data required to generate the control interface. At this time, the terminal can send business application data to the cloud server and/or the large screen request, so as to obtain the data stored on the cloud server and/or on the large screen, the terminal can obtain the control interface of the control service based on the aforementioned data, and then display it on the screen in the form of a card or applet for user operation and use.

When the large screen does not request the above-mentioned control service for the first time, the terminal has obtained the data required for the above-mentioned generation of the control interface during the previous provision of the control service, and also stored the control data during the previous process of providing the control service, so that the terminal can It is no longer necessary to send business application data requests to the cloud server and/or the large screen. At this time, the terminal can directly display the control interface of the control service on the screen in the form of a card or applet based on historical data for user operation. Optionally, when the control service is not provided for the first time, the terminal can also send a business application data request to the cloud server and/or the large screen, so as to obtain the incremental data needed to generate the control interface, without having to send all the data required to generate the control interface Download the data again, so that new data of business applications can be obtained, such as game progress of game applications, synchronization data of shared applications, etc., and the efficiency of obtaining control interfaces can be improved.

The control interface can display corresponding buttons, sliders, up/down menus and other touch components according to the requirements of the front-end business application, as well as thumbnails and usage screens corresponding to the front-end business application. For example, the control interface of the control service corresponding to the video-on-demand application can include the progress bar of the current video playback, the selection button of the current video, the thumbnail of the recommended video, etc. The user can drag the progress bar to adjust the current video played on the large screen You can click the selection button to select the video to play on the big screen, and you can click the thumbnail of the video to change the video played on the big screen. For example, the control interface of the control service corresponding to the K song application can include popular K The list of songs, the list of selected songs, etc., users can click on a song to add to the list of selected songs, and can click on an added song to play it directly on the big screen; another example is the control of the control service corresponding to the gallery application The interface may include thumbnails of images stored in the large screen, so that a certain thumbnail can be clicked to display an image corresponding to the thumbnail on the large screen.

It can be seen that after the terminal receives the control service request, whether it is the first request or not, the terminal can independently obtain its control interface and display it on the screen. The process of selecting the corresponding control service from the smart screen application.

Except for some uninterruptible business applications, the terminal can pop up a control interface on any current interface. The aforementioned uninterruptible business application means that once the business application starts, it must continue and cannot be interrupted. For example, in a video call application, if the user is in a video call, a control interface will pop up on the call interface. On the one hand, the user usually does not interrupt the call To control the large screen, on the other hand, it is inconvenient to control the large screen during the call; or it is not convenient to cut into other business applications during the process of the business application. For example, when the user is playing a game on the terminal, the control interface pops up suddenly, which may affect the The game goes on. It should be understood that there may also be other service applications that cannot be interrupted, which is not specifically limited in this embodiment of the present application.

The scenarios where the terminal can pop up the control interface can include: the terminal is in a black screen, at this time the terminal will light up the screen and pop up the control interface on the screen off interface; the terminal is in a bright screen, and the terminal will pop up the control interface on the main interface at this time; An interface of an application program is displayed on the screen of the terminal, and at this time, the terminal pops up a control interface on the interface. It should be understood that the terminal may also pop up a control interface on other interfaces, which is not specifically limited in this embodiment of the present application.

It should be noted that the embodiment of this application does not specifically limit the business application on the large screen and the control service on the terminal. The control interface of the control service is not limited by the number and type of physical buttons, and can be used for the actual operation of business applications. It needs to be set, and there is no specific limitation on this.

For example, the terminal receives a control service request sent by the large screen. The control service request includes the name of the racing game control service. The terminal determines the control service based on the name. After querying the local data, the terminal finds that there is no historical data for the control service. Therefore, Send a business application data request to the cloud server, obtain the control interface of the racing game control service based on the device data of the large screen from the cloud server, the content data of the racing game, etc., and then display it on the screen in the form of a card or a small program. The control interface may include the left and right arrow keys, the rendered racing map, the track and other images, the image of the racing car, etc. The user can control the forward direction of the racing car on the track by clicking on the left and right arrow keys.

Exemplarily, in some embodiments, the pop-up may include a dynamic process of appearing from the edge of the terminal display interface and gradually entering and displaying more and more content, or may include appearing near the center of the terminal display interface And the dynamic process of gradually enlarging and occupying more and more terminal display interfaces. For example, manipulating the pop-up of a service card/applet may refer to: manipulating the service card/applet to appear from the bottom of the terminal display interface and gradually entering the terminal display interface, gradually displaying more and more content; or, manipulating the service card/applet Appears near the center of the terminal display interface, then gradually enlarges, and finally occupies more than half of the terminal display interface. In some implementations, the control service card/applet may include operable controls, and the user can click these controls to move the position of the control service card/applet, change the size of the control service card/applet, make the control service card/ The applet is closed/hidden/popped up again.

Step 804, the terminal sends the operation instruction generated by the operation on the control interface to the large screen.

The touch screen of the terminal provides the premise of a variety of user operations. The touch screen does not specifically limit the user's operation mode, and can quickly and efficiently capture the user's operations on the touch screen, and then generate corresponding operation instructions.

Based on this, the user operates the touch components on the control interface displayed on the touch screen to generate corresponding operation instructions. For example, clicking a button indicates that the user selects the button, and the operation instruction indicates that the button is selected; dragging the slider indicates that the button is selected. When the user adjusts the value of the numerical interval to which the slider belongs, the operation command indicates the value change; the finger slides on the control interface to change the trajectory or generate a trajectory, then the operation instruction indicates the trajectory; and so on.

The terminal sends the acquired operation instructions to the large screen.

Step 805, the large screen performs corresponding processing according to the operation instruction, so as to complete the control of the foreground business application.

After the large screen receives the operation command from the terminal, on the one hand, it executes the corresponding data processing according to the operation command; on the other hand, when necessary, it renders the corresponding picture according to the operation command and displays it on the large screen. In this way, by transferring the control of the large-screen business to the terminal for implementation, the terminal provides the control service of the large-screen business. Based on the characteristics of the touch screen of the terminal, the corresponding control interface of the control service can be set according to the actual operation requirements of the large-screen business. It is further limited by the number and type of physical buttons of the traditional remote control.

FIG. 9 is a flowchart of a process 900 of a method for controlling cross-device flow of large-screen services according to an embodiment of the present application. The process 900 may be jointly executed by two electronic devices in the application scenario 40, wherein one electronic device is a large screen, and the other electronic device is a terminal. The process 900 is described as a series of steps or operations. It should be understood that the process 900 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 9 . Process 900 may include:

Step 901, the large screen sends a manipulation termination request to the terminal.

If the foreground business application on the large screen changes, one possible situation is that the user exits the business application displayed on the big screen by operating the physical remote control or the simulated remote control on the terminal; another possible situation is that the user By operating the physical remote control or the analog remote control on the terminal, start other business applications without exiting the business application displayed on the screen, the other business applications will be displayed on the large screen, and the foreground business application will switch to this business application. The business application displayed before retreats to the background operation of the large screen and becomes the background business application of the large screen; another possible situation is that, in the process of using the business application displayed on the large screen, the large screen receives a timely call from the application For an incoming call, the user connects the incoming call by operating the physical remote control or the analog remote control on the terminal. At this time, the instant call application is displayed on the large screen, and the foreground business application switches to the instant call application, while the previous business application retreats to The background operation of the large screen becomes the background business application of the large screen.

Since the large screen and the terminal are in the flow control of the foreground business application, when the foreground business application on the large screen changes, the large screen will send a control termination request to the terminal, so that the terminal no longer provides the control service of the foreground business application .

The large screen may send a manipulation termination request to the terminal, similar to step 801 in the above method embodiment, the manipulation termination request may also include the identification information of the manipulation service and/or the identification information of the foreground business application on the large screen. The purpose of the identification information is to allow the terminal to determine the control service to exit. For a specific determination process, reference may be made to step 801, which will not be repeated here.

In step 902, the terminal no longer displays the manipulation interface of the manipulation service in response to the manipulation termination request.

After receiving the manipulation termination request, the terminal may determine the manipulation service that the large screen requests to terminate based on the identification information of the manipulation service in the manipulation termination request. Alternatively, after receiving the manipulation termination request, the terminal may determine the foreground business application on the large screen based on the identification information of the foreground business application in the manipulation termination request, and then determine the corresponding The control service corresponding to the foreground business application.

Optionally, the terminal may directly close the control interface of the control service. For example, the terminal is displaying the control interface of the video broadcast control service, and at this moment, the terminal can directly close the control interface of the video broadcast control service.

Optionally, the terminal may pop up a window on the control interface to remind the user that the service application on the large screen has been closed, and display buttons of "Yes" and "No" on the pop-up window for the user to choose. For example, the terminal is displaying the control interface of the video broadcast control service. At this time, the terminal can pop up a window on the control interface of the video broadcast control service. Control Services", and buttons for "Yes" and "No". When the user clicks the "Yes" button, it means that the user agrees to stop the video broadcast and control service, and the terminal exits the control interface; when the user clicks the "No" button, it means that the user does not agree to stop the video broadcast and control service, and the terminal continues to display the control interface and detects An operation instruction generated by the user's operation.

Step 903, the large screen exits the current foreground business application.

After the large screen sends out a control termination request, it can exit the current foreground business application.

It should be noted that, in this embodiment of the present application, the execution order of step 902 and step 903 is not specifically limited, and step 902 may be executed first, followed by step 903, or step 903 may be executed first, followed by step 902, or , step 902 and step 903 are executed simultaneously.

FIG. 10 is a flow chart of a process 1000 of a method for controlling cross-device flow of large-screen services according to an embodiment of the present application. The process 1000 may be jointly executed by two electronic devices in the application scenario 40, wherein one electronic device is a large screen, and the other electronic device is a terminal. The process 1000 is described as a series of steps or operations. It should be understood that the process 1000 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 10 . Process 1000 may include:

Step 1001, the terminal sends a service termination request to the large screen.

When the user wants to exit the foreground business application, he can also exit the foreground business application by manipulating the large screen through the terminal. For example, the user is watching a video on the large screen, and clicks the close button on the control interface of the video broadcast control service on the terminal, thereby generating an operation instruction to close the service application, and the terminal sends a service termination request to the large screen according to the operation instruction. For another example, when the user is watching a video on a large screen, and clicks the button of "mobile phone remote control" on the control interface of the video broadcast control service on the terminal, the interface of the mobile phone remote control can be pulled up on the terminal, which simulates the mobile phone remote control The device can make the mobile phone realize the same function as the physical remote control. When the user clicks the "exit" button on the interface of the mobile remote control, an operation instruction to close the service application can be generated. The terminal sends a service termination request to the large screen according to the operation instruction. .

Optionally, the service termination request may include identification information of the foreground service application on the large screen, so that the large screen can determine to exit the foreground service application according to the identification information.

Optionally, the service termination request may not include the identification information of the foreground business application on the large screen. By analyzing the control service from which the service termination request comes, it can be determined whether to exit the foreground business application, or as long as the large screen receives the service termination Request, just exit the foreground business application directly. This is because the large screen and the terminal are in the cross-device flow control of the foreground business application before, so as long as the terminal sends a service termination request, the default is to exit the foreground business application.

Step 1002, the large screen exits the current foreground service application in response to the service termination request.

After receiving the service termination request, the large screen can exit the current foreground service application.

Optionally, the large screen can directly exit the interface of the foreground business application and display the main interface. For example, the large screen directly exits the VOD application and returns to the main interface.

Optionally, the large screen can also pop up a window on the interface of the foreground business application to prompt the user whether to exit the foreground business application, and display "Yes" and "No" buttons on the pop-up window for the user to choose. For example, the large screen pops up a window on the user interface of the video-on-demand application, and the pop-up window includes "whether to exit the video-on-demand application" and buttons of "yes" and "no". When the user clicks the "Yes" button, it means that the user agrees to exit the VOD application, and the large screen exits the VOD application interface and returns to the main interface; when the user clicks the "No" button, it indicates that the user does not agree to exit the VOD application, and the terminal Continue to display the interface of the video-on-demand application, and detect the operation instruction from the terminal or the remote controller.

Step 1003, the large screen sends a service application exit response to the terminal.

After the large screen exits the foreground business application, it can send an exit response to the terminal to inform the terminal of the success or failure of the foreground business application exit.

Step 1004, the terminal responds to the exit response of the service application, and no longer displays the manipulation interface of the manipulation service.

When the service application exit response indicates that the large screen exits the foreground service application successfully, the terminal may exit the control interface of the control service. For this process, reference may be made to step 902 in the foregoing method embodiment, which will not be repeated here.

When the service application exit response indicates that the large screen fails to exit the foreground service application, the terminal can continue to display the control interface of the control service, and detect the operation instructions generated by the user's operation.

It should be noted that, in the embodiment of this application, after executing step 1001, the terminal can directly execute step 1004, that is, the terminal sends a service termination request to the large screen, and then exits the control interface of the control service without waiting for the large screen to exit according to the service termination request. Foreground business application. At this time, the large screen does not need to send a service application exit response to the terminal.

On the basis of the embodiment shown in FIG. 7 , FIG. 11 is an exemplary interactive communication flow diagram for establishing cross-device flow control of large-screen services provided by the embodiment of the present application. As shown in FIG. 11 , participating Components include business applications, flow task management services, and distributed task scheduling, and the participating components on the terminal include distributed task scheduling and manipulation services. In the embodiment of the present application, there are multiple electronic devices having a binding relationship, and the multiple electronic devices include a large screen and multiple terminals. The business application on the large screen can be controlled by the control service on the terminal for cross-device flow control. The embodiment of this application describes the process of establishing large-screen business cross-device flow control between the large screen and the terminal.

Big screen side:

1. The business application requests the registration control service from the transfer task management service

The user clicks the icon of the service application on the main interface of the large screen to open the service application. At this time, the business application requests the transfer task management service to register the control service to notify the transfer task management service that the business application has been opened and to request the cross-device transfer control of the business application. For example, after the user opens the video-on-demand application, the video-on-demand application requests the transfer task management service to register the manipulation service.

2. The transfer task management service returns the terminal information to the business application

After receiving the request from the business application, the transfer task management service queries the preset correspondence between the business application and the control service, and determines the control service corresponding to the aforementioned business application. Then, a terminal that can provide the aforementioned manipulation service is determined according to the electronic device list maintained locally. If there is only one electronic device that can provide control services, then the electronic device is the terminal that provides control services; The terminal of the service. The transfer task management service can select the first electronic device as the terminal that provides manipulation services according to the arrangement order of multiple electronic devices in the electronic device list; or, the transfer task management service can determine the earliest electronic device according to the online status of multiple electronic devices. / The latest electronic device is used as a terminal to provide control services; or, the transfer task management service can transmit the information of multiple electronic devices to the display module of the large screen, and the display module will display the information of the multiple electronic devices in a pop-up window on the screen for the user to choose one as the terminal to provide the control service. It should be noted that the transfer task management service may also use other methods to determine the terminal providing the manipulation service, which is not specifically limited in this embodiment of the present application. For example, the transfer task management service determines that the control service of the video-on-demand application is the video broadcast control service, and then checks the list of electronic devices to find that the mobile phone P30pro can be used as a terminal that provides the control service.

The transfer task management service returns terminal information to the VOD application, including terminal device identification, device type, and device name.

3. The business application updates the business control flow status to the flow task management service

After receiving the information from the terminal, the business application can update the business control flow status to the flow task management service after making preparations for the business control flow, so as to notify the flow task management service that the operation state of the business application can be updated to cross-device control. For example, the video-on-demand application notifies the streaming task management service to update the control status of the video-on-demand application to P30pro control.

4. The business application requests the distributed task scheduling to initialize the distributed task scheduling

Distributed task scheduling can maintain multiple tasks of business applications, and schedule multiple tasks based on the execution logic and levels among multiple tasks. Initialization can create threads for the execution of multiple tasks to ensure the smoothness of multiple tasks. went well.

5. Business applications request distributed task scheduling to start cross-device control services

The business application requests the distributed task scheduling to start the cross-device manipulation service, and a task of the cross-device manipulation service may be created in the distributed task scheduling. When the distributed task scheduling dispatches a task for the cross-device manipulation service, it can trigger the sending of a manipulation service request to the terminal.

6. The distributed task scheduling of the large screen sends a control service request to the distributed task scheduling of the terminal

For manipulating the service request, reference may be made to step 801 in the above-mentioned method embodiment, which will not be repeated here.

Terminal side:

7. Distributed task scheduling start control service

After the distributed task scheduling receives the manipulation service request, it can determine the manipulation service requested by the large screen based on the identification information of the manipulation service in the manipulation service request. Or, after the distributed task scheduling receives the control service request, it can determine the foreground business application on the large screen based on the identification information of the business application in the control service request, and then according to the preset correspondence between the business application and the control service, Determine the manipulation service corresponding to the foreground business application.

When the distributed task scheduling is dispatched to the manipulation service, it sends a scheduling instruction to the manipulation service, so that the manipulation service pops up a manipulation interface. Regarding the manner of obtaining the manipulation interface, reference may be made to step 802 in the above method embodiment, and details are not repeated here. For example, the screen of the P30pro displays the operation interface of the video broadcast control service.

8. The control service returns the calling result to the distributed task scheduling

After the control interface pops up on the screen, the control service can return the call result to the distributed task scheduling, that is, once the function of the control service is started, it can notify the distributed task scheduling that the control service has started successfully.

9. The distributed task scheduling of the terminal returns the response that the control service starts successfully to the distributed task scheduling of the large screen

After the control interface of the control service is displayed on the terminal, the user can perform control operations on the control interface. At this time, the control service on the terminal is started successfully.

Big screen side:

10. Distributed task scheduling notification business application callback cross-device control service completion

So far, a cross-device flow control process for large screen services has been established between the large screen and the terminal. Users operate on the control interface of the control service through the terminal, and the generated operation instructions are sent to the large screen by the terminal. The large screen is based on the operation instructions. Execute corresponding processing, and if necessary, the large screen can send the processed data to the terminal to achieve data synchronization between the large screen and the terminal, so as to facilitate the timely update of the control interface on the terminal.

It should be noted that after the distributed task scheduling of the terminal receives the control service request, it may also fail to start the control service. The reasons for the failure may include: failure to obtain the control interface of the control service, the terminal does not enable the floating window function of the control service, etc. In this way, the distributed task scheduling of the terminal returns to the distributed task scheduling of the large screen that the control service failed to start. At this time, the business application on the large screen can pop up a window to prompt that the cross-device flow control fails, or exit the cross-device flow control, and notify the flow task management service to update the business control flow status (the notification flow task management service can update the control status of the business application. Exit cross-device control). It should be understood that the business application with a large screen may also use other failure handling methods, which are not specifically limited in this embodiment of the present application.

In a possible implementation manner, the large-screen transfer task management service can actively detect the business applications of the large screen. The difference between this implementation and the embodiment shown in Figure 11 is that in Figure 11, the business application with a large screen actively requests the transfer task management service to register and control the service after opening (step 1), that is, the business application with a large screen notifies The transfer task management service starts cross-device transfer control; and this implementation method is that the transfer task management service can actively detect business applications on the large screen, and when a business application is found to be open, it will automatically determine for it a terminal that can provide the aforementioned control service. The determination method can refer to step 2 of the method embodiment shown in FIG. 11 , which will not be repeated here; that is, in this implementation mode, it is not necessary for the business application to send a request to the transfer task management service to register the control service (that is, not to Step 1) is required, and the transfer task management service can actively send the terminal information that can provide the operation service corresponding to the currently opened business application to the business application.

On the basis of the embodiment shown in FIG. 7 , FIG. 12 is an exemplary interactive communication flow diagram of the cross-device flow control for exiting the large-screen business provided by the embodiment of the present application. As shown in FIG. 12 , participating parties on the large-screen Components include business applications, flow task management services, and distributed task scheduling, and the participating components on the terminal include distributed task scheduling and manipulation services. In the embodiment of the present application, there are multiple electronic devices having a binding relationship, and the multiple electronic devices include a large screen and multiple terminals. The business application on the large screen can be controlled by the control service on the terminal for cross-device transfer control. The embodiment of this application describes the process of cross-device transfer control for the large screen and the terminal to exit the large screen business.

Big screen side:

1. The business application updates the business control flow status to the flow task management service

The user can use the remote control to close the business application on the large screen, or, if the large-screen display is a touch-sensitive display, the user can also click the business application exit control on the large-screen display to close the business application on the large screen . At this time, the business control flow state can be updated to the flow task management service, so as to notify the flow task management service that the operation state of the business application can be updated to quit cross-device control. For example, the video-on-demand application notifies the transfer task management service to update the control status of the video-on-demand application to quit P30pro control.

2. The business application requests the distributed task scheduling to exit the cross-device control service

The business application requests the distributed task scheduling to exit the cross-device control service, and can request the distributed task scheduler to close the task of the cross-device control service. When the distributed task scheduling closes the task of the cross-device control service, it can trigger the sending of a control termination request to the terminal.

3. The distributed task scheduling of the large screen sends a control termination request to the distributed task scheduling of the terminal

For the manipulation termination request, reference may be made to the description of step 901 in the above method embodiment, and details are not repeated here.

Terminal side:

4. Distributed task scheduling closes control service

After the distributed task scheduling receives the manipulation termination request, it can determine the manipulation service requested by the large screen based on the identification information of the manipulation service in the manipulation termination request. Or, after the distributed task scheduling receives the control service request, it can determine the foreground business application on the large screen based on the identification information of the business application in the control service request, and then according to the preset correspondence between the business application and the control service, Determine the manipulation service corresponding to the foreground business application.

When the distributed task scheduler dispatches the manipulation service, it sends a closing command to the manipulation service, so that the manipulation service exits the manipulation interface. Regarding the way of exiting the control interface, reference may be made to step 902 in the above method embodiment, which will not be repeated here.

5. The control service returns the exit result to the distributed task scheduling

After the control service exits the control interface, it can return the exit result to the distributed task scheduler, that is, once the control service exits, it can notify the distributed task scheduler that the control service has exited successfully.

6. The distributed task scheduling of the terminal returns the response that the control service is closed successfully to the distributed task scheduling of the large screen

Big screen side:

7. Distributed task scheduling closes tasks for cross-device manipulation services

8. The business application requests the logout control service from the transfer task management service

After exiting the control service on the terminal side, the business application can request the transfer task management service to cancel the control service, so as to notify the transfer task management service that the control service can be canceled. For example, after the user uses the remote control to control the large screen to exit the video-on-demand application, the video-on-demand application requests the streaming task management service to log out of the video broadcast control service.

It should be noted that after the distributed task scheduling of the terminal receives the control termination request, it may also fail to exit the control service. The reasons for the failure may include: failure to obtain the control interface of the control service, and the user selected "No" on the pop-up window. key, and so on. In this way, what the distributed task scheduling of the terminal returns to the distributed task scheduling of the large screen is that the control service exit failed. At this time, the large-screen business application can pop up a window to prompt that the cross-device transfer control exit failed. It should be understood that the business application with a large screen may also use other failure handling methods, which are not specifically limited in this embodiment of the present application.

On the basis of the embodiment shown in FIG. 7 , FIG. 13 is an exemplary interactive communication flow diagram of the cross-device flow control for exiting the large-screen business provided by the embodiment of the present application. As shown in FIG. 13 , participating parties on the large screen Components include business applications, flow task management services, and distributed task scheduling, and the participating components on the terminal include distributed task scheduling and manipulation services. In the embodiment of the present application, there are multiple electronic devices having a binding relationship, and the multiple electronic devices include a large screen and multiple terminals. The business application on the large screen can be controlled by the control service on the terminal for cross-device transfer control. The embodiment of this application describes the process of cross-device transfer control for the large screen and the terminal to exit the large screen business.

1. The distributed task scheduling of the terminal sends a service termination request to the distributed task scheduling of the large screen

When the user wants to exit the foreground business application, he can also exit the foreground business application by manipulating the large screen through the terminal. For example, a user is watching a video on a large screen, and clicks the close button on the control interface of the video broadcast control service on the terminal, thereby generating an operation instruction to close the business application, and the distributed task scheduling of the terminal sends services to the large screen according to the operation instruction Terminate request. For another example, when the user is watching a video on a large screen, and clicks the button of "mobile phone remote control" on the control interface of the video broadcast control service on the terminal, the interface of the mobile phone remote control can be pulled up on the terminal, which simulates the mobile phone remote control device, which allows the mobile phone to achieve the same functions as the physical remote control. When the user clicks the "Exit" button on the interface of the mobile phone remote control, an operation command to close the business application can be generated. The distributed task scheduling of the terminal sends to the large The screen sends a service termination request.

For the service termination request, reference may be made to the description of step 1001 in the above method embodiment, which will not be repeated here.

Big screen side:

2. Distributed task scheduling closes the task of controlling services across devices

The business application can update the business operation flow state to the flow task management service, so as to notify the flow task management service that the operation state of the business application can be updated to quit cross-device control.

4. The business application requests the logout control service from the transfer task management service

The business application can request the logout of the control service from the transfer task management service to notify the transfer task management service that the control service can be logged out.

5. The business application returns the business application exit response to the distributed task scheduling

6. The distributed task scheduling of the large screen notifies the response of the successful exit of the business application to the distributed task scheduling of the terminal

Terminal side:

7. Distributed task scheduling closes control service

After the distributed task scheduler receives the response that the business application exits successfully, it knows that the business application of the large screen has exited, and can send a close command to the control service, so that the control service exits the control interface. Regarding the way of exiting the control interface, reference may be made to step 902 in the above method embodiment, which will not be repeated here.

8. The control service returns the exit result to the distributed task scheduling

The process of the above-mentioned method embodiment will be described below through several specific examples.

Embodiment one

In the embodiment of this application, the multiple electronic devices with binding relationship include: two mobile phones (P30pro and Mate30), a tablet computer (MatePad Pro) and a smart screen (V65). The foreground business application of the V65 is a video-on-demand application, and the video broadcast control service is a remote control service corresponding to the video-on-demand application.

Fig. 14a is a schematic diagram of the main interface of P30pro. As shown in Fig. 14a, the user clicks the icon of the smart screen application on the main interface to open the smart screen application.

Figure 14b is a schematic diagram of the main interface of the smart screen application. As shown in Figure 14b, the connected V65 is displayed on the main interface of the smart screen application as a Huawei smart screen, and the usage time of the Huawei smart screen today is 30 minutes. Click the power button on the right to turn on/off the Huawei Smart Screen. The main interface also includes buttons for application scenarios such as mirror control, remote control, smooth call, search for movies, message boards, and remote housekeeping. After the user clicks one of the buttons, the smart screen application enters the control service interface of the corresponding application scenario. In the embodiment of the present application, the user clicks the "remote control" button.

Figure 14c is an exemplary schematic diagram of the remote control interface. As shown in Figure 14c, after the user clicks the "remote control" button, the remote control interface can be displayed in the form of a card on the mobile phone, and the remote control includes up, down, left, and right direction keys 1401, OK key 1402, increase/decrease key 1403, exit key 1404, menu key 1405, power on/off key 1406, etc. These buttons have similar functions to the physical buttons of the physical remote control, so users can also operate the V65 by operating the remote control on the mobile phone just like using a physical remote control.

Figure 14d is an exemplary schematic diagram of the main interface of V65. As shown in Figure 14d, the user can click the up, down, left, and right keys 1401 on the remote control on the P30pro to move the focus on the V65, and the focus movement can be accompanied during the movement , when the focus moves to the VOD application icon, the VOD is selected, and the user clicks the OK key 1402 on the remote control to open the content (VOD application) corresponding to the current focus.

After opening the VOD application on the V65, enter the main interface of the VOD application. The main interface can include recommended videos, lists of video applications (Mango TV, iQiyi, Tencent, etc.), and the thumbnails of recommended videos are displayed. In addition, it also includes the user's historical playback records, collection records, etc. The main interface of the V65 can refer to the main interface of smart TVs, TV boxes, set-top boxes, etc., and will not be repeated here.

After opening the VOD application, the V65 can execute the steps of the method embodiment shown in FIG. 8 or FIG. 11 to start the video broadcast control service on the P30pro. In the above hypothesis, the electronic devices that have a binding relationship with V65 include Mate30 and MatePad Pro in addition to P30pro. The transfer task management service of V65 can be determined from the three electronic devices by using step 2 in the method embodiment shown in Figure 11. P30pro is a terminal that can provide video playback and control services. The P30pro can also execute the steps of the method embodiment shown in FIG. 8 or FIG. 11 , so as to pop up the control interface of the video broadcast control service on the screen.

Figure 14e is an exemplary schematic diagram of V65 and P30pro performing cross-device streaming control. As shown in Figure 14e, the video selected by the user is played on the V65, and the control interface of the video broadcast control service pops up on the screen of the P30pro.

The video-on-demand application provides a lot of videos. These videos can include information such as a video cover image, video name, video duration, video producer, and video scoring. On the one hand, it can facilitate users to understand the key information of the video. On the one hand, it can have the effect of attracting users to click, especially the cover image of the video, which is usually the poster, promotional image of the video, or a screenshot of the video that best reflects the core content of the video. The cover image of the video displayed on the large screen can be a 4K large-size image. In order to improve communication efficiency, the thumbnail of the cover image can be displayed on the terminal, and the size of the thumbnail can be adapted to the size of the terminal. Before popping up the control interface of the video broadcast control service, the terminal can download information such as the name of the video, the duration of the video, the producer of the video, the rating of the video, and the thumbnail of the video from the cloud server. A control interface for the video broadcast control service is generated based on the foregoing video information.

The control interface of the video broadcast control service includes a progress bar 1407 of the video being played on the large screen, an anthology (1-5) button 1408 of the same series as the video (for example, a button corresponding to each episode of a TV series), The thumbnail image 1409 of the video of "guess you like" etc. The user can drag the progress bar 1407 to adjust the playback progress of the video, click the collection button 1408 to change the video played on the big screen, and click the thumbnail 1409 to replace the video played on the big screen with the video corresponding to the thumbnail.

In addition, the control interface of the video broadcast control service also includes a "mobile phone remote control" button 1410. After the user clicks the "mobile phone remote control" button 1410, the remote control as shown in Figure 14c will pop up, so that the user can Bring up the remote control to control the big screen.

The method of selecting the video to be played on the V65 may include: the user controls the large screen to select a video through a physical remote control; or, the user controls the large screen to select a video through the remote control on the P30pro; or, the user controls the video through the video broadcast control service on the P30pro The interface controls the large screen to select the video.

Embodiment two

In the embodiment of the present application, the multiple electronic devices with a binding relationship include: a mobile phone (P30pro) and a smart screen (V65). The foreground business application of V65 is a karaoke application, and the karaoke broadcast control service is a remote control service of the karaoke application.

The P30pro can execute the method shown in Figure 14a-Figure 14c in Embodiment 1, which will not be repeated here.

Figure 15a is an exemplary schematic diagram of the main interface of the V65. As shown in Figure 15a, the user can click the up, down, left, and right keys 1401 on the remote control on the P30pro to move the focus on the V65, and the focus movement can be accompanied during the movement , when the focus moves to the karaoke application icon, karaoke is selected, and the user clicks the OK key 1402 on the remote control to open the content (Karaoke application) corresponding to the current focus.

After the karaoke application is opened on the V65, the V65 and P30pro can execute the steps of the method embodiment shown in FIG. 8 or FIG. 11 to start the karaoke broadcast control service on the P30pro, and the control interface of the karaoke broadcast control service pops up on the screen of the P30pro.

Figure 15b is an exemplary schematic diagram of V65 and P30pro performing cross-device streaming control. As shown in Figure 15b, the MV of the song selected by the user is played on the V65, and the control interface of the karaoke broadcast control service pops up on the screen of the P30pro.

The National K Songs application provides a lot of songs, and these songs can include information such as the name of the song, the singer, and the number of singing times. On the one hand, it can facilitate users to understand the key information of the song, and on the other hand, it can attract users to click. Before popping up the control interface of the K song broadcast control service, the terminal can download and obtain information such as the name of the song, the singer, and the number of times of singing from the cloud server. Based on the aforementioned song information, a control interface for the K song play control service is generated.

The control interface of the karaoke broadcast control service includes a list of popular karaoke songs 1501 and a list of selected songs 1502 . The user can select a song in the popular karaoke list, click the "add" button 1503 to add this song to the ordered song list, and click a song in the ordered song list, and the big screen will directly switch to the play button. MV of the song.

In addition, the control interface of the karaoke broadcast control service also includes a "mobile phone remote control" button 1504. After the user clicks the "mobile phone remote control" button 1504, the remote control as shown in Figure 14c will pop up, so that the user can Time to call up the remote control to control the big screen.

The method for selecting a song to play on the V65 may include: the user controls the large screen to select a song through a physical remote control; or, the user controls the large screen to select a song through the remote control on the P30pro; The control interface controls the large screen to select songs.

The process of selecting songs may include: the user controls the large screen to select songs through a physical remote control; or, the user controls the large screen to select songs through the remote control on the P30pro; or, the user controls the large screen through the control interface of the K song broadcast control service on the P30pro screen to select a video.

Embodiment three

In the embodiment of the present application, the multiple electronic devices with a binding relationship include: a mobile phone (P30pro) and a smart screen (V65). The foreground business application of V65 is the gallery application, and the gallery control service is the remote control service of the gallery application.

Figure 16a is an exemplary schematic diagram of the main interface of V65. As shown in Figure 16a, the user can click the up, down, left, and right keys 1401 on the remote control on the P30pro to move the focus on the V65, and the focus movement can be accompanied during the movement , when the focus moves to the gallery application icon, the gallery is selected, and the user clicks the OK key 1402 on the remote control to open the content corresponding to the current focus (the gallery application).

After opening the gallery application on the V65, the V65 and P30pro can execute the steps of the method embodiment shown in FIG. 8 or FIG. 11 to start the gallery control service on the P30pro, and the control interface of the gallery control service will pop up on the screen of the P30pro.

Figure 16b is an exemplary schematic diagram of cross-device transfer control between V65 and P30pro. As shown in Figure 16b, the image selected by the user is displayed on the V65, and the control interface of the library control service pops up on the screen of the P30pro.

The gallery application contains a lot of images of the user, and the images include screenshots obtained by the user manipulating the large screen to capture screenshots, photos obtained by the user manipulating the large screen to take pictures, and the like. The terminal may download the thumbnails of the images in the gallery from the large screen before popping up the manipulation interface of the gallery manipulation service. A manipulation interface of the gallery manipulation service is generated based on the foregoing thumbnail images.

The control interface of the gallery control service includes thumbnails 1601 of the images in the home camera. The images in the home camera are stored in the V65. In the process of obtaining the control interface, the P30pro can not only obtain the data of the control interface, but also obtain the V65 Image information on the image to facilitate thumbnail generation. The user can click a certain thumbnail to indicate that the image corresponding to the thumbnail is selected and displayed on the V65.

In addition, the control interface of the gallery control service also includes a "mobile phone remote control" button 1602. After the user clicks the "mobile phone remote control" button 1602, the remote control as shown in Figure 14c will pop up, so that the user can adjust the remote control when necessary. Use the remote control to control the big screen.

The method for selecting the image displayed on the V65 may include: the user controls the large screen to select an image through a physical remote control; or, the user controls the large screen to select an image through the remote control on the P30pro; or, the user controls the control interface of the service through the gallery on the P30pro , click the thumbnail, and the image corresponding to the thumbnail will be displayed on the V65.

Embodiment four

In the embodiment of the present application, the multiple electronic devices with a binding relationship include: a mobile phone (P30pro) and a smart screen (V65). The foreground business application of the V65 is a racing game application, and the racing game control service is a remote control service of the racing game application.

Fig. 17 is an exemplary schematic diagram of V65 and P30pro performing cross-device streaming control. As shown in Fig. 17, after opening the racing game application on V65, V65 and P30pro can execute the steps of the method embodiment shown in Fig. 8 or Fig. 11 to Start the racing game control service on the P30pro, and the control interface of the racing game control service will pop up on the screen of the P30pro.

The screen of the racing game is displayed on the V65, and the control interface of the racing game control service pops up on the screen of the P30pro.

The terminal can obtain the user's account information, historical racing rankings, racing game screen data, racing control control data, etc. from the cloud server, and obtain the user's historical setting data, game progress, etc. from the large screen. Based on the aforementioned data, the terminal can generate racing games. Control the control interface of the service.

The control interface of the racing game control service includes the left and right arrow keys, the rendered racing map, the racing track and other images, and the racing car image. The user can control the forward direction of the car on the track by clicking on the left and right arrow keys.

In addition, the control interface of the racing game control service also includes a floating panel 1701. The floating panel 1701 includes a main interface button 1702, a menu button 1703, and an exit button 1704. The user can click the main interface button 1702 to directly return to the main interface. The menu button 1703 pops up menu options, you can click the exit button 1704 to exit the racing game application, and you can click "" 1705 on the floating panel to switch the hand assist mode.

As the user operates on the control interface of the racing game control service, the picture of the racing game displayed on the V65 will switch accordingly, including the picture changes accompanying the change of the position of the racing car. The picture includes the track and surrounding mirror images.

Embodiment five

In the embodiment of the present application, the multiple electronic devices with a binding relationship include: a mobile phone (P30pro) and a smart screen (V65). The foreground business application of the V65 is a live broadcast application, and the live broadcast control service is a remote control service for the live broadcast application.

Figure 18 is an exemplary schematic diagram of V65 and P30pro performing cross-device streaming control. As shown in Figure 18, after the live broadcast application is opened on V65, V65 and P30pro can execute the steps of the method embodiment shown in Figure 8 or Figure 11 to Start the live broadcast control service on the P30pro, and the control interface of the live broadcast control service will pop up on the screen of the P30pro.

The live broadcast screen is displayed on the V65, and the control interface of the live broadcast control service pops up on the screen of the P30pro.

The terminal can download the channel information of the live application from the cloud server, including channel name, channel number, channel category, and the like. Based on the foregoing channel information, a control interface for the live broadcast control service is generated.

The control interface of the live broadcast control service includes a live list, which includes all lists, satellite TV lists, CCTV lists, local lists and digital lists. Each list contains buttons for multiple live broadcast stations, for example, the full list includes Beijing Satellite TV, Madden Sports, Zhejiang Satellite TV, Dragon TV, Sichuan Satellite TV, Southeast Satellite TV, Lifestyle, Shaanxi Satellite TV, etc. The user can click the button of a certain live station to indicate that the screen of the selected live station will be played on the V65.

In addition, the control interface of the live broadcast control service also includes a floating panel 1801. The floating panel 1801 includes a main interface button 1802, a menu button 1803, and an exit button 1804. The user can click the main interface button to directly return to the main interface, or click the menu The button pops up menu options, you can click the exit button to exit the live broadcast application, and you can click "" 1805 on the floating panel to switch the hand assist mode.

As the user operates on the control interface of the live broadcast control service, the content displayed on the V65 switches to the screen where the user selects the live broadcast station.

Embodiment six

FIG. 19 is a schematic diagram of the main interface of the P30pro. As shown in FIG. 19 , a power-on/off interface can pop up on the screen of the P30pro, and the power-on/off interface includes a button 1901 for “one-key on/off”. When the bound V65 is not turned on, the user can click the "one-key on/off" button 1901 to control and turn on the V65; when the bound V65 is on, the user can click the "one-key on/off" button 1901 to control Turn off the V65.

It should be noted that the above-mentioned embodiments are only used as examples to describe the cross-device flow control that can establish large-screen services in multiple application scenarios between the large-screen and the terminal, but the solutions provided by the embodiments of the present application are not limited to The above application scenarios can also be applied to many other application scenarios, for example, the terminal controls the large screen to take pictures, the terminal controls the large screen to play sports and fitness videos, the terminal controls the large screen to make smooth calls, the terminal controls the large screen to share images, etc. . That is to say, no matter what kind of business application on the large screen, you can create the corresponding control service, and then deploy the control service on the terminal to realize the cross-device flow control of the business. In addition, the control interface of the control service in the embodiment of the present application is not limited to the graphic screens in the above-mentioned several embodiments, and other design schemes may also be adopted, which is not specifically limited.

FIG. 20 is a flowchart of a process 2000 of a method for controlling cross-device flow of large-screen services according to an embodiment of the present application. The process 2000 may be jointly executed by two electronic devices in the application scenario 40, wherein one electronic device is a large screen, and the other electronic device is a terminal. Process 2000 is described as a series of steps or operations, and it should be understood that process 2000 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 20 .

In the embodiment of this application, before executing the process 2000, the two electronic devices can execute the process 800 shown in Figure 8 to establish the cross-device flow control of the first business application on the large screen and the terminal, that is, the foreground business of the large screen The application is a first service application, and the terminal is manipulating the first service application through the first manipulation service, and a first manipulation interface corresponding to the first manipulation service is displayed on the terminal.

Process 2000 may include:

Step 2001, the foreground business application on the large screen is switched from the first business application to the second business application.

As mentioned above, before the process 2000 starts, the foreground business application of the large screen is the first business application, and the control service of the terminal is the first control service, and the terminal receives operations on the first control interface of the first control service, The manipulation of the first service application is realized.

The foreground service application is switched from the first service application to the second service application. One possible situation is that the user exits the first service application displayed on the large screen by operating the physical remote control or the simulated remote control on the terminal, and restarts The second business application on the large screen, the second business application is displayed on the large screen, and the foreground business application is switched to the second business application; another possible situation is that the user operates the physical remote control or the analog remote control on the terminal device, without exiting the first business application displayed on the screen, start the second business application, the second business application is displayed on the large screen, the foreground business application is switched to the second business application, and the previously displayed first business application The application retreats to run in the background of the large screen and becomes the background business application of the large screen; another possible situation is that, in the process of using the business application displayed on the large screen, the large screen receives a timely call application (such as Unicom phone application), the user connects the incoming call by operating the physical remote control or the analog remote control on the terminal. At this time, the instant call application is displayed on the large screen, and the foreground service application is switched to the instant call application (the second service application ), while the previous first business application retreated to the background operation of the large screen and became the background business application of the large screen.

The simulated remote controller on the above-mentioned terminal can be displayed on the screen of the terminal (for example, as shown in FIG. 14c ) by clicking the "mobile phone remote control" button on the first control interface (for example, as shown in FIG. 14e ).

For example, the first business application is a video-on-demand application, and its corresponding first control service is a video broadcast control service. After receiving the operation instruction of accepting the call, the foreground business application switches to the Changlian calling application, and the calling interface of the Changlian calling application is displayed on the screen. The aforementioned operation instruction for accepting a call comes from a physical remote controller or an analog remote controller on the terminal.

Step 2002, the large screen sends a manipulation termination request for the first manipulation service to the terminal.

The foreground business application on the big screen is switched from the first business application to the second business application, and the first business application exits or becomes the background business application of the big screen, so the big screen sends a control termination request for the first control service to the terminal, Close the first manipulation interface so that the terminal no longer provides the first manipulation service of the first business application.

Step 2003, the large screen sends a manipulation service request for the second manipulation service to the terminal.

In order to realize the cross-device flow control of the second business application of the large screen and the terminal, after the large screen is switched to the second business application, it can send a control service request to the terminal.

The second manipulation service request may also include identification information of the second business application and/or identification information of the second manipulation service, where the second manipulation service is a manipulation service corresponding to the second business application.

In step 2004, the terminal no longer displays the first manipulation interface corresponding to the first manipulation service in response to the manipulation termination request.

For a process in which the terminal no longer displays the first manipulation interface corresponding to the first manipulation service in response to the manipulation termination request, reference may be made to step 902 in the foregoing method embodiment, and details are not repeated here.

Step 2005, the terminal displays a second manipulation interface corresponding to the second manipulation service in response to the manipulation service request.

For the terminal displaying the second manipulation interface corresponding to the second manipulation service in response to the manipulation service request, reference may be made to step 803 in the foregoing method embodiment, and details are not repeated here.

Since the first business application is different from the second business application, correspondingly, the first manipulation service is different from the second manipulation service. The contents of the first manipulation interface and the second manipulation interface include layout of the interface, controls included on the interface, The text of the interface, etc. are also different.

Step 2006, the terminal sends the operation instruction generated by the operation on the second control interface to the large screen.

For step 2006, reference may be made to step 804 in the foregoing method embodiment, and details are not repeated here.

Step 2007, the large screen performs corresponding processing according to the operation instruction, so as to complete the manipulation of the second business application.

For step 2007, reference may be made to step 805 in the foregoing method embodiment, and details are not repeated here.

Embodiment seven

In the first to sixth embodiments above, the process of cross-device flow control of several business applications on the large screen is exemplified. Once the foreground business application is started on the large screen, the terminal will pop up the The control interface of the control service corresponding to the business application.

The business applications running on the large screen include foreground business applications and background business applications. Among them, the foreground business application refers to the business application displayed on the screen of the large screen; the background business application refers to the business application not displayed on the screen of the large screen. But the processor of the large screen is still running the program of the business application. For example, for the Changlian call application, when the user uses the Changlian call application to make a video call, the video call interface of the Changlian call application is displayed on the screen. At this time, the Changlian call application is a foreground business application with a large screen; when the user uses When the video-on-demand application is used, the Changlian calling application is not displayed on the screen, but in order to receive the video call application when someone calls in, the processor of the large screen is still running the Changlian calling application program, which can support the monitoring of the Changlian calling application. The minimum program for the call-in function of the Unicom call application. At this time, the Unicom call application is a background business application on a large screen.

On the terminal, the control service provided corresponds to the foreground business application on the large screen. Once the foreground business application on the large screen is switched from the first business application to the second business application, the terminal will close the first business application corresponding to the first business application. The first manipulation interface of the manipulation service displays the second manipulation interface of the second manipulation service corresponding to the second business application.

For example, when a video-on-demand application is being used to play a video on the large screen, and the control interface of the video broadcast control service pops up on the terminal, refer to the embodiments shown in Figs. 14a-14e.

Figure 21a is a schematic diagram of the video call interface of V65. As shown in Figure 21a, during the process of playing video, V65 receives a video call request from the Changlian call application, and the user can operate the physical remote control or the analog remote control on the P30pro The device answers the video call. As shown in Figure 14e, the user can click the "mobile phone remote control" button on the operation interface of the video broadcast control service, and the analog remote control as shown in Figure 14c will pop up on the P30pro. Key 1401 focuses on the "Answer" button in Fig. 21a, and then clicks OK button 1402 to select to answer the video call.

At this time, the call interface of the Changlian call application is displayed on the screen of the large screen, and the foreground business application of the large screen is switched to the Changlian call application, and the large screen and the terminal can automatically execute the steps of the method embodiment shown in FIG. Start the Changlian call control service, wherein the first business application is a video-on-demand application, the first control service is a video broadcast control service, the second business application is a Changlian call application, and the second control service is a Changlian call control service.

The terminal closes the control interface of the video broadcast control service, and pops up the control interface of the Changlian call control service. Correspondingly, Fig. 21a is a schematic diagram of the video call interface of V65. As shown in Fig. 21b, the control interface of Changlian call control service includes the "switch camera" button, the "hang up" button, the "mute" button, and the "speaker" button , "Switch Voice" button and "Share Screen" button. Users can click the "Switch Camera" button to switch the front/rear camera during a video call, click the "Hangup" button to hang up the current video call, click the "Mute" button to turn off the local recording function, click "Speaker" Press the button to make the sound of the video call play through the speaker, click the "Switch Voice" button to switch the current video call to a voice call, and click the "Share Screen" button to share the screen of your own large screen with the other party in the video call. In addition, the control interface of Changlian call control service also includes a "mobile phone remote control" button 2001. After the user clicks the "mobile phone remote control" button 2001, the remote control as shown in Figure 14c will pop up, so that the user can Time to call up the remote control to control the big screen.

After the video call of the Changlian call application ends, the foreground business application on the large screen switches from the Changlian call application to the video-on-demand application, and the video in the video-on-demand application is played on the large screen again. Correspondingly, the large screen and The terminal can execute the steps of the method embodiment shown in FIG. 20 to close the control interface of the Changlian call control service on the terminal, and display the control interface of the video broadcast control service, as shown in FIG. 14e. At this time, the first business application is the Unicom call application, the first control service is the Unicom call control service, the second business application is a video-on-demand application, and the second control service is a video broadcast control service.

It should be understood that, in order to realize the above functions, the electronic device includes hardware and/or software modules corresponding to each function. In combination with the algorithm steps of the examples described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions in combination with the embodiments for each specific application, but this implementation should not be considered as exceeding the scope of the embodiments of the present application.

In this embodiment, the functional modules of the electronic device may be divided according to the above method example. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above integrated modules may be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic, and is only a logical function division, and there may be other division methods in actual implementation.

In an example, FIG. 22 shows a schematic block diagram of an apparatus 2200 according to an embodiment of the present application. As shown in FIG. 22 , the apparatus 2200 may include: a processor 2201 and a transceiver/receiver pin 2202. Optionally, A memory 2203 is also included.

Various components of the device 2200 are coupled together through a bus 2204, wherein the bus 2204 includes not only a data bus, but also a power bus, a control bus, and a status signal bus. However, for clarity of illustration, the various buses are referred to as bus 2204 in the figure.

Optionally, the memory 2203 may be used for the instructions in the foregoing method embodiments. The processor 2201 can be used to execute instructions in the memory 2203, and control the receiving pin to receive signals, and control the sending pin to send signals.

The apparatus 2200 may be the electronic device or the chip of the electronic device in the foregoing method embodiments.

Wherein, all relevant content of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

This embodiment also provides a computer storage medium, the computer storage medium stores computer instructions, and when the computer instructions are run on the electronic device, the electronic device executes the steps of the above-mentioned related methods to realize the large-screen service in the above-mentioned embodiment. Cross-device flow control method.

This embodiment also provides a computer program product, which, when running on a computer, causes the computer to execute the above-mentioned related steps, so as to realize the method for controlling cross-device flow of large-screen services in the above-mentioned embodiment.

In addition, the embodiment of the embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device runs At this time, the processor can execute the computer-executable instructions stored in the memory, so that the chip executes the method for controlling cross-device streaming of large-screen services in the above method embodiments.

Wherein, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the corresponding method provided above The beneficial effects in the method will not be repeated here.

Through the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be assigned by different Completion of functional modules means that the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in the embodiments of the present application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or It may be integrated into another device, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

A unit described as a separate component may or may not be physically separated, and a component shown as a unit may be one physical unit or multiple physical units, which may be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

Any content of each embodiment of the embodiment of the present application, and any content of the same embodiment can be freely combined. Any combination of the above content is within the scope of the embodiments of the present application.

If an integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium Among them, several instructions are included to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods in the various embodiments of the embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes such as U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk.

The embodiments of the embodiments of the present application have been described above in conjunction with the accompanying drawings, but the embodiments of the present application are not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative, not restrictive. Under the enlightenment of the embodiment of the application, those of ordinary skill can also make many forms without departing from the purpose of the embodiment of the application and the scope of protection of the claims, all of which belong to the protection of the embodiment of the application.

Claims

A cross-device transfer control method for large-screen services, applied to a system including a large screen and a terminal, characterized in that the large screen and the terminal have a binding relationship; the method includes:

Opening the first business application on the large screen;

The large screen sends a first manipulation service request to the terminal, where the first manipulation service request includes identification information of the first business application and/or identification information of the first manipulation service, and the first manipulation service The service is a manipulation service corresponding to the first business application;

The terminal displays a first manipulation interface corresponding to the first manipulation service in response to the first manipulation service request;

The terminal realizes the manipulation of the first service application opened on the large screen by receiving an operation acting on the first manipulation interface.
The method according to claim 1, further comprising:

The foreground business application of the large screen is switched from the first business application to a second business application;

The large screen sends a second manipulation service request to the terminal, wherein the second manipulation service request includes identification information of the second business application and/or identification information of the second manipulation service, and the second manipulation service The service is a manipulation service corresponding to the second business application;

In response to the second manipulation service request, the terminal displays a second manipulation interface corresponding to the second manipulation service, where the second manipulation interface is different from the first manipulation interface;

The terminal realizes the manipulation of the second service application opened on the large screen by receiving an operation acting on the second manipulation interface.
The method according to claim 2, characterized in that after the large screen sends the second manipulation service request to the terminal, further comprising:

The terminal closes the manipulation interface of the first manipulation service and terminates the first manipulation service; or, the terminal closes the manipulation interface of the first manipulation service but retains the first manipulation service.
The method according to any one of claims 1-3, wherein the terminal implements the first service opened on the large screen by receiving an operation on the first control interface. App manipulation, including:

The terminal generates a corresponding operation instruction by receiving an operation acting on the first manipulation interface and sends the operation instruction to the large screen;

The large screen executes corresponding processing according to the operation instruction, so as to complete the manipulation of the first service application.
The method according to any one of claims 1-4, characterized in that, after the terminal displays the first manipulation interface corresponding to the first manipulation service in response to the first manipulation service request, the method Also includes:

The large screen sends a manipulation termination request to the terminal, where the manipulation termination request includes identification information of the first business application and/or identification information of the first manipulation service;

The terminal no longer displays the first manipulation interface in response to the manipulation termination request;

The large screen exits the first service application.
The method according to any one of claims 1-4, characterized in that, after the terminal displays the first manipulation interface corresponding to the first manipulation service in response to the first manipulation service request, the method Also includes:

The terminal sends a service termination request to the large screen;

The large screen exits the first service application in response to the service termination request;

The terminal no longer displays the first manipulation interface.
The method according to claim 6, wherein before the terminal no longer displays the first control interface, further comprising:

The large screen sends a service application exit response to the terminal;

The terminal no longer displays the first manipulation interface, including:

The terminal no longer displays the first manipulation interface in response to the exit response of the service application.
The method according to any one of claims 1-7, wherein the first service application is a video-on-demand application, and the first control service is a video broadcast control service;

The first manipulation interface includes one or more controls selected from video progress bar, video selection and recommended video.
The method according to any one of claims 1-7, wherein the first business application is a karaoke application, and the first manipulation service is a karaoke broadcast control service;

The first manipulation interface includes one or more controls in a list of recommended songs and a list of selected songs, the list of recommended songs includes one or more songs, and the list of selected songs includes the list of recommended songs selected by the user. Songs selected in the list.
The method according to any one of claims 1-7, wherein the first business application is a gallery application, and the first manipulation service is a gallery manipulation service;

The first manipulation interface includes a plurality of thumbnail images, and the plurality of thumbnail images correspond to the plurality of images included in the gallery application.
The method according to any one of claims 1-7, wherein the first business application is a game application, and the first manipulation service is a game manipulation service;

The first control interface includes one or more controls in the game screen and/or game operation buttons.
The method according to any one of claims 1-7, wherein the first service application is a live broadcast application, and the first control service is a live broadcast control service;

The first control interface includes a live list, and the live list includes a plurality of classified sub-lists, and any one of the sub-lists includes one or more live channels.
The method according to any one of claims 1-12, characterized in that the first control interface further includes a "mobile phone remote control" button;

When the terminal receives the operation command generated by the button operation of the "mobile phone remote control", it displays the remote control operation interface, which includes the up, down, left, and right direction keys, OK key, increase/decrease key, and exit key , menu key, and one or more controls in the power button.
The method according to any one of claims 1-13, wherein a corresponding relationship between the first business application and the first manipulation service is pre-stored in the large screen.
A cross-device transfer control method for large-screen services, applied to terminals, characterized in that it includes:

receiving a first manipulation service request from the large screen, wherein the first manipulation service request includes identification information of a first business application opened on the large screen and/or identification information of a first manipulation service, and the first The manipulation service is a manipulation service corresponding to the first business application;

In response to the first manipulation service request, display a first manipulation interface corresponding to the first manipulation service;

By receiving an operation acting on the first manipulation interface, the manipulation of the first service application opened on the large screen is realized.
The method according to claim 15, further comprising:

receiving a second manipulation service request from the terminal, wherein the second manipulation service request includes the identification information of the second business application after switching the foreground business application on the large screen and/or the identification of the second manipulation service information, the second manipulation service is a manipulation service corresponding to the second business application;

In response to the second manipulation service request, display a second manipulation interface corresponding to the second manipulation service, where the second manipulation interface is different from the first manipulation interface;

By receiving an operation acting on the second manipulation interface, the manipulation of the second service application opened on the large screen is realized.
The method according to claim 16, characterized in that after receiving the second manipulation service request from the terminal, further comprising:

Closing the manipulation interface of the first manipulation service and terminating the first manipulation service; or, closing the manipulation interface of the first manipulation service but retaining the first manipulation service.
The method according to any one of claims 15-17, wherein the first service application opened on the large screen is realized by receiving an operation acting on the first control interface. manipulation, including:

generating a corresponding operation instruction by receiving an operation acting on the first manipulation interface;

Send the operation instruction to the large screen.
The method according to any one of claims 15-18, wherein the first service application opened on the large screen is implemented by receiving an operation on the first control interface. After manipulation, it also includes:

receiving a manipulation termination request from the large screen, where the manipulation termination request includes identification information of the first business application and/or identification information of the first manipulation service;

In response to the manipulation termination request, the first manipulation interface is no longer displayed.
The method according to any one of claims 15-18, wherein the first service application opened on the large screen is implemented by receiving an operation on the first control interface. After manipulation, it also includes:

Send a service termination request to the large screen;

The first manipulation interface is no longer displayed.
The method according to claim 20, characterized in that, before no longer displaying the first manipulation interface, further comprising:

receiving a service application exit response from the large screen;

The no longer displaying the first manipulation interface includes:

In response to the exit response of the service application, the first manipulation interface is no longer displayed.
The method according to any one of claims 15-21, wherein the first service application is a video-on-demand application, and the first control service is a video broadcast control service;

The first manipulation interface includes one or more controls selected from video progress bar, video selection and recommended video.
The method according to any one of claims 15-21, wherein the first business application is a karaoke application, and the first manipulation service is a karaoke broadcast control service;

The first manipulation interface includes one or more controls in a list of recommended songs and a list of selected songs, the list of recommended songs includes one or more songs, and the list of selected songs includes the list of recommended songs selected by the user. Songs selected in the list.
The method according to any one of claims 15-21, wherein the first business application is a gallery application, and the first manipulation service is a gallery manipulation service;

The first manipulation interface includes a plurality of thumbnail images, and the plurality of thumbnail images correspond to the plurality of images included in the gallery application.
The method according to any one of claims 15-21, wherein the first business application is a game application, and the first manipulation service is a game manipulation service;

The first control interface includes one or more controls in the game screen and/or game operation buttons.
The method according to any one of claims 15-21, wherein the first service application is a live broadcast application, and the first control service is a live broadcast control service;

The first control interface includes a live list, and the live list includes a plurality of classified sub-lists, and any one of the sub-lists includes one or more live channels.
The method according to any one of claims 15-26, characterized in that the first control interface further includes a "mobile phone remote control" button;

When the terminal receives the operation command generated by the button operation of the "mobile phone remote control", it displays the remote control operation interface, which includes the up, down, left, and right direction keys, OK key, increase/decrease key, and exit key , menu key, and one or more controls in the power button.
A cross-device flow control method for large-screen business, applied to large-screen, characterized in that it includes:

Start the first business application;

sending a first manipulation service request to the terminal, where the first manipulation service request includes identification information of the first service application and/or identification information of the first manipulation service, and the first manipulation service corresponds to the The manipulation service of the first business application.
The method according to claim 28, further comprising:

switching the foreground business application from the first business application to a second business application;

sending a second manipulation service request to the terminal, where the second manipulation service request includes identification information of the second service application and/or identification information of a second manipulation service, and the second manipulation service corresponds to The manipulation service of the second business application.
The method according to claim 28 or 29, characterized in that after sending the first manipulation service request to the terminal, further comprising:

receiving an operation instruction from the terminal, where the operation instruction is generated by an operation on the first manipulation interface on the terminal;

Execute corresponding processing according to the operation instruction, so as to complete the manipulation of the first service application.
The method according to any one of claims 28-30, characterized in that after sending the first manipulation service request to the terminal, further comprising:

sending a manipulation termination request to the terminal, where the manipulation termination request includes identification information of the first service application and/or identification information of the first manipulation service;

Exit the first business application.
The method according to any one of claims 28-30, wherein after sending the first manipulation service request to the terminal, further comprising:

receiving a service termination request from the terminal;

Exit the first service application in response to the service termination request.
The method according to claim 32, after exiting the first service application in response to the service termination request, further comprising:

Sending a service application exit response to the terminal.
The method according to any one of claims 28-33, wherein a corresponding relationship between the first business application and the first manipulation service is pre-stored in the large screen.
An electronic device used as a terminal, characterized in that it includes:

A transmission module, configured to receive a first manipulation service request from the large screen, wherein the first manipulation service request includes identification information of the first business application opened on the large screen and/or identification information of the first manipulation service , the first manipulation service is a manipulation service corresponding to the first business application;

A display module, configured to display a first manipulation interface corresponding to the first manipulation service in response to the first manipulation service request;

The processing module is configured to realize the manipulation of the first service application opened on the large screen by receiving an operation acting on the first manipulation interface.
The electronic device according to claim 35, wherein the transmission module is further configured to receive a second manipulation service request from the terminal, wherein the second manipulation service request includes The identification information of the second business application after switching the foreground business application and/or the identification information of the second manipulation service, where the second manipulation service is a manipulation service corresponding to the second business application;

The display module is further configured to display a second manipulation interface corresponding to the second manipulation service in response to the second manipulation service request, wherein the second manipulation interface is different from the first manipulation interface;

The processing module is further configured to realize the manipulation of the second business application opened on the large screen by receiving an operation acting on the second manipulation interface.
The electronic device according to claim 36, wherein the processing module is further configured to close the manipulation interface of the first manipulation service and terminate the first manipulation service; or, close the first manipulation service control interface but keep the first control service.
The electronic device according to any one of claims 35-37, wherein the processing module is specifically configured to generate a corresponding operation instruction by receiving an operation acting on the first control interface;

The transmission module is further configured to send the operation instruction to the large screen.
The electronic device according to any one of claims 35-38, wherein the transmission module is further configured to receive a manipulation termination request from the large screen, the manipulation termination request including the first service Identification information of the application and/or identification information of the first manipulation service;

The processing module is further configured to no longer display the first manipulation interface in response to the manipulation termination request.
The electronic device according to any one of claims 35-38, wherein the transmission module is further configured to send a service termination request to the large screen;

The processing module is further configured to no longer display the first manipulation interface.
The electronic device according to claim 40, wherein the transmission module is further configured to receive a service application exit response from the large screen;

The processing module is further configured to no longer display the first manipulation interface in response to the service application exit response.
The electronic device according to any one of claims 35-41, wherein the first service application is a video-on-demand application, and the first control service is a video broadcast control service;

The first manipulation interface includes one or more controls selected from video progress bar, video selection and recommended video.
The electronic device according to any one of claims 35-41, wherein the first business application is a karaoke application, and the first control service is a karaoke broadcast control service;

The first manipulation interface includes one or more controls in a list of recommended songs and a list of selected songs, the list of recommended songs includes one or more songs, and the list of selected songs includes the list of recommended songs selected by the user. Songs selected in the list.
The electronic device according to any one of claims 35-41, wherein the first business application is a gallery application, and the first manipulation service is a gallery manipulation service;

The first manipulation interface includes a plurality of thumbnail images, and the plurality of thumbnail images correspond to the plurality of images included in the gallery application.
The electronic device according to any one of claims 35-41, wherein the first service application is a game application, and the first manipulation service is a game manipulation service;

The first control interface includes one or more controls in the game screen and/or game operation buttons.
The electronic device according to any one of claims 35-41, wherein the first service application is a live broadcast application, and the first control service is a live broadcast control service;

The first control interface includes a live list, and the live list includes a plurality of classified sub-lists, and any one of the sub-lists includes one or more live channels.
The electronic device according to any one of claims 35-46, wherein the first control interface further includes a "mobile phone remote control" button;

When the terminal receives the operation command generated by the button operation of the "mobile phone remote control", it displays the remote control operation interface, which includes the up, down, left, and right direction keys, OK key, increase/decrease key, and exit key , menu key, and one or more controls in the power button.
An electronic device, used as a large screen, is characterized in that it includes:

a processing module, configured to start the first service application;

A transmission module, configured to send a first manipulation service request to a terminal, where the first manipulation service request includes identification information of the first service application and/or identification information of the first manipulation service, and the first manipulation service is a manipulation service corresponding to the first business application.
The electronic device according to claim 48, wherein the processing module is further configured to switch the foreground service application from the first service application to the second service application;

The transmission module is further configured to send a second manipulation service request to the terminal, where the second manipulation service request includes identification information of the second service application and/or identification information of the second manipulation service, and The second manipulation service is a manipulation service corresponding to the second business application.
The electronic device according to claim 48 or 49, wherein the transmission module is further configured to receive an operation instruction from the terminal, and the operation instruction acts on the first control interface on the terminal generated by the operation;

The processing module is further configured to execute corresponding processing according to the operation instruction, so as to complete the manipulation of the first service application.
The electronic device according to any one of claims 48-50, wherein the transmission module is further configured to send a manipulation termination request to the terminal, the manipulation termination request including the Identification information and/or identification information of the first manipulation service;

The processing module is further configured to exit the first service application.
The electronic device according to any one of claims 48-50, wherein the transmission module is further configured to receive a service termination request from the terminal;

The processing module is further configured to exit the first service application in response to the service termination request.
According to the electronic device according to claim 52, the transmission module is further configured to send a service application exit response to the terminal.
The electronic device according to any one of claims 48-53, wherein the electronic device pre-stores a correspondence between the first business application and the first manipulation service.
An electronic device, characterized in that it comprises:

processors and transceivers;

memory for storing one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors are made to implement the method according to any one of claims 15-34.
A computer-readable storage medium, characterized by comprising a computer program, characterized in that, when the computer program is run on the camera, the camera is made to perform the method according to any one of claims 15-34 .
A chip is characterized in that it includes one or more interface circuits and one or more processors; the interface circuit is used to receive signals from the memory of the electronic device and send the signals to the processors, the The signal comprises computer instructions stored in a memory; when executed by the processor, the computer instructions cause the electronic device to perform the method of any one of claims 15-34.