CN117311568A - Control method and device and electronic equipment - Google Patents

Abstract

The application provides a control method, a control device and electronic equipment, wherein the electronic equipment displays a display interface of a target application in an operation state, the display interface of the target application occupies all display areas allocated to the target application, input operation for calling a multi-task management list based on the target application is obtained, in the process of responding to the input operation, if the target equipment meeting a connection condition is obtained, the ending point of the input operation is determined to be positioned in a target trigger area, and the display interface of the target application in the operation state is transmitted to the target equipment.

Description

Control method and device and electronic equipment

Technical Field

The present application relates to the field of communications technologies, and in particular, to a control method and apparatus, and an electronic device.

Background

With the development of computers and multimedia technologies, electronic devices such as mobile phones, tablet computers, notebook computers, desktop computers and the like have increasingly abundant functions, and the requirements of people on video watching, game playing, online conferences or teaching and the like are met. In the application process, a screen projection mode can be adopted, and the application content displayed by the electronic equipment (namely the screen projection equipment) is projected to another equipment (namely the screen projection equipment) for display, so that more comfortable or convenient use experience is obtained.

However, in practical application, an operator needs to perform many operations on the screen-throwing device, so that the application content displayed by the screen-throwing device can be transmitted to the screen-throwing device for display, the process is tedious, and the screen-throwing efficiency and convenience are reduced.

Disclosure of Invention

In order to solve the technical problems, the application provides the following technical scheme:

in one aspect, the present application proposes a control method, including:

a display interface for displaying a target application in an operating state; the display interface of the target application occupies all the display areas allocated to the target application;

obtaining an input operation; the input operation is used for calling a multitasking management list based on the target application;

and in the process of responding to the input operation, if the target equipment meeting the connection condition is obtained, determining that the ending point of the input operation is positioned in a target trigger area, and transmitting the display interface of the target application in the running state to the target equipment.

Optionally, in the process of responding to the input operation, if a target device satisfying the connection condition is obtained, the control method further includes:

and displaying a target trigger area to indicate that the ending point of the input operation can be positioned in the target trigger area.

Optionally, the target trigger area is located on a sliding path of the input operation.

Optionally, the transmitting the display interface of the target application in the running state to the target device includes:

and transmitting the display interface of the target application in the running state, which is displayed on the first display screen of the electronic equipment, to the target equipment, and simultaneously displaying the display interface on the second display screen of the target equipment.

Optionally, the transmitting the display interface of the target application in the running state to the target device includes:

and switching the display interface of the target application in the running state from the first display screen of the electronic equipment to be transmitted to the target equipment so as to be displayed on the second display screen of the target equipment.

Optionally, the transmitting the display interface of the target application in the running state to the target device includes:

creating a virtual screen; the virtual screen is determined based on the display parameters of the second display screen of the target device and the target display size;

drawing display data of a display interface of the target application in a running state based on the virtual screen;

and transmitting the display data to the target equipment so that a second display screen of the target equipment displays a display interface of the target application in the running state with the target display size.

Optionally, the meeting the connection condition includes one of:

terminal equipment with successful connection channel establishment;

a terminal device capable of scanning.

Optionally, the control method further includes:

and determining the target device from a plurality of terminal devices based on the pointing information of the electronic device.

In another aspect, the present application further proposes a control device, including:

the display module is used for displaying a display interface of the target application in the running state; the display interface of the target application occupies all the display areas allocated to the target application;

the obtaining module is used for obtaining input operation; the input operation is used for calling a multitasking management list based on the target application;

and the transmission module is used for responding to the input operation, if the target equipment meeting the connection condition is obtained, determining that the ending point of the input operation is positioned in a target trigger area, and transmitting the display interface of the target application in the running state to the target equipment.

In yet another aspect, the present application further proposes an electronic device, including:

the first display screen is used for displaying a display interface of the target application in the running state; the display interface of the target application occupies all the display areas allocated to the target application;

And the processor is used for obtaining input operation, responding to the input operation, if the target equipment meeting the connection condition is obtained, determining the ending point of the input operation to be positioned in a target trigger area, and transmitting the display interface of the target application in the running state to the target equipment.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings may be obtained according to the provided drawings without inventive effort to a person skilled in the art.

FIG. 1 is a flow chart of an alternative embodiment of a control method according to the present application;

FIG. 2 is a schematic diagram of an input operation execution scenario for invoking a multitasking list, suitable for the control method proposed in the present application;

FIG. 3 is a schematic view of an alternative scenario for target application projection in response to an input operation, suitable for use in the control method of the present application;

FIG. 4 is a flow chart of a second alternative embodiment of the control method proposed in the present application;

FIG. 5a is a schematic flow chart of an alternative application scenario suitable for the control method proposed in the present application;

FIG. 5b is a schematic flow chart of another alternative application scenario suitable for the control method proposed in the present application;

FIG. 6 is a flow chart of a third alternative embodiment of the control method proposed in the present application;

FIG. 7a is a schematic flow chart of another alternative application scenario suitable for the control method proposed in the present application;

FIG. 7b is a schematic flow chart of another alternative application scenario suitable for the control method proposed in the present application;

FIG. 8 is a flow chart of a fourth alternative embodiment of the control method proposed in the present application;

FIG. 9 is a schematic view of a scenario of an alternative implementation method for selecting a target device, which is suitable for use in the control method proposed in the present application;

FIG. 10 is a schematic structural view of an alternative embodiment of the control device proposed in the present application;

fig. 11 is a schematic hardware structure of an alternative embodiment of an electronic device suitable for the control method proposed in the present application.

Detailed Description

For the description of the background art, the rapid operation of the electronic equipment system is expanded to realize rapid screen projection of the target application operated by the electronic equipment, the display interface of the target application is transmitted to the target equipment, the display interface of the target application is displayed by the target display screen of the target equipment, and an operator can directly use the target equipment to operate the target application. When the shortcut operation is expanded, an area where an ending point of the shortcut operation is located can be expanded, for example, a target trigger area is configured, when the ending point of the shortcut operation is located in the target trigger area, the electronic device can rapidly screen a display interface of the target application to the target device meeting the connection condition, and other screen-casting operations are not needed to be executed, so that the method is very convenient.

The shortcut operation may be an input operation capable of quickly starting a function of the electronic device system, and the application describes a scenario in which an input operation of a multitask management list of the electronic device can be quickly called for, to implement a control method provided in the application. The input operation for quickly initiating the multitasking understanding may be a system gesture that slides up from the bottom edge of the display screen of the electronic device, etc.

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

It should be noted that in this application, words such as "exemplary," "such as" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary," "for example," or "like" is not necessarily to be construed as preferred or advantageous over other embodiments or designs. That is, the use of words such as "exemplary," "for example," or "such as" are intended to present related concepts in a concrete fashion.

Referring to fig. 1, a flowchart of a first alternative embodiment of a control method provided in the present application may be applicable to an electronic device, including, but not limited to, a mobile phone, a tablet computer, a personal computer (personal computer, PC), a smart home device (such as a television), a vehicle-mounted computer, a game console, and a terminal such as an augmented reality (augmented reality, AR) \virtual reality (VR) device, where the specific form of the electronic device is not particularly limited. Based on this, as shown in fig. 1, the control method proposed in this embodiment may include:

step S11, displaying a display interface of a target application in an operation state; the display interface of the target application occupies all display areas allocated to the target application;

when the electronic device starts the target application to enter the running state, a display interface of the target application can be presented on a display screen of the electronic device (for distinguishing the display screen of the electronic device from other display screens, the display screen of the electronic device is recorded as a first display screen), the target application can be any application program in the electronic device, and the presented display interface can be a real-time display interface of the target application, namely, the display interface of the target application which is displayed is dynamically updated so as to display the latest application content.

The display of the first display screen of the electronic device on the display interface of each running application is generally determined by a system of the electronic device, and the system may provide each application with a display area that can be used by each application, which may be all display areas or part of display areas of the first display screen, for example, the display areas of different applications are displayed on separate screens of the electronic device, that is, all display areas of all first display screens are divided into at least two part display areas, and different part display areas are used for displaying display interfaces of different applications.

In order to improve the display effect, an operator can conveniently and clearly watch or operate the content of the display interface of the presented target application, the display interface of the target application can occupy all usable display areas provided by the system for the target application, for example, all display areas of the first display screen in a non-split screen mode, and the display interface of the target application can be in a full screen display state; if the system is in the split screen mode, the system splits the screen to the maximum display area used by the target application and the like, the display position in the first display screen of the display interface for displaying the target application by the electronic equipment is not limited, and the display position can be determined according to the situation.

Step S12, obtaining input operation; the input operation is used for calling a multitasking management list based on the target application;

the multitask management list can display interfaces of all applications running in the background of the electronic equipment in a small window (namely a floating window) display mode, and all the applications in a running state are in a floating window display state.

Referring to the schematic view of the scenario shown in fig. 2, an operation of sliding the input operation upward from the bottom edge of the first display screen of the electronic device will be described as an example, and the display interface of the target application is shown in fig. 2 a, where the operator performs the input operation on the first display screen, and during the execution of the input operation, the state of the target application may be changed based on the input operation. As shown in fig. 2 b, the display state of the display interface of the target application may be changed, for example, the display area of the display interface is gradually reduced, or even the display area of the display interface of the target application may be small enough to display at least a portion of the display interfaces of other applications running in the background of the electronic device, where the display interfaces of the other applications may be presented in the same small-sized display area, but the method is not limited to the state change manner of the target application in the execution process of the input operation shown in fig. 2.

And if the obtained input operation meets the successful calling (namely starting) condition of the multi-task management list, the subsequent steps are not executed any more, the multi-task management list is directly called, and the display interfaces of all the applications running in the background of the electronic equipment are displayed in a floating window mode, wherein the display interface of the target application can be positioned at the first position in the multi-task management list. The application does not limit the display mode of each application running in the background for the multitasking management list.

In practical application of the application, under different implementation manners of the input operation, the input operation may be obtained in a corresponding manner, as shown in fig. 2, by using a touch sensing unit of the first display screen, in the execution process of the input operation, corresponding input operation information, such as touch coordinates, is sensed, so that in the response process of the input operation, the electronic device may determine, based on the input operation information generated correspondingly, that the input operation is a preconfigured shortcut operation for invoking a multitask management list based on a target application, and then determine whether a target device meeting a connection condition exists around the electronic device and whether an end point of the input operation is located in a target trigger area, so as to determine whether to invoke the multitask management list or to throw the target application to the target device for display when ending the input operation.

The target trigger area may be an entry for inputting, to other devices, whether to display a display interface of the target application in a running state in the process of executing the input operation, and may be a designated area in the first display screen, for example, a 1/N (which is a numerical value greater than 1) display area on a top end side of the first display screen, or any part of areas selected from all display areas, etc., where the position information of the target trigger area in the first display screen is not limited, and may be determined according to circumstances.

And step S13, in response to the input operation, if the target equipment meeting the connection condition is obtained, determining that the ending point of the input operation is positioned in the target trigger area, and transmitting the display interface of the target application in the running state to the target equipment.

And if the connection condition is met, the terminal equipment with successful connection channel establishment of the electronic equipment is present or the peripheral equipment of the electronic equipment is scanned, the terminal equipment can be scanned, and one or more terminal equipment can be determined as the target equipment from the terminal equipment with successful connection channel establishment or the terminal equipment which can be scanned.

Based on the above, in the process of responding to the input operation, whether the target device meeting the connection condition is obtained or not can be determined, if the target device is not obtained, that is, no available device for displaying the projection screen exists around the electronic device, the multitasking management list can be directly called in response to the input operation, and a floating window of each application running in the background can be displayed.

If the target device meeting the connection condition is obtained, that is, it is determined that other devices available for displaying the screen are available, it is further required to determine whether the end point of the input operation is located in the target trigger area, if the end point of the input operation is not located in the target trigger area, the screen display mode of the electronic device is not started, and the multitasking management list is still called in response to the input operation. If the ending point of the input operation is located in the target trigger area, the trigger condition for starting the display screen-throwing mode of the electronic equipment is determined to be met, the display screen-throwing mode of the electronic equipment can be started, the display interface of the target application in the running state is sent to the target equipment, the second display screen of the target equipment displays the display interface of the target application in the running state, and the method for realizing the screen-throwing display is not limited.

For example, still taking the scenario shown in fig. 2 as an example, a sliding operation is performed on the first display screen, the display state of the display interface of the target application currently displayed in the running state is changed accordingly, for example, the display size of the display interface is reduced, the display position of the display interface is changed, as shown in fig. 3, the display interface of the target application may be reduced and move in the sliding direction of the first display screen, during the process of performing the input operation by an operator, whether the target device meeting the connection condition is obtained may be determined according to the method described above, if so, and when the input operation is finished, the end point of the input operation is determined based on the corresponding input operation information, which indicates that the intention of the operator to perform the input operation this time is to throw the target application onto the target device, the electronic device may enter the screen throwing mode for the target device, and the display interface of the target application in the running state is transmitted to the target device.

In the process of executing the input operation by an operator, a corresponding sliding path can be obtained, a pre-configured target trigger area can be located on the sliding path of the input operation, for example, an end point of the sliding path generated from the start of executing the input operation to the end of executing the input operation enters the target trigger area, or the end point and a plurality of adjacent sliding position points (sliding points in the sliding path) enter the target trigger area, or the sliding path of the input operation can also pass through the target trigger area and then enter the target trigger area again at the end point of sliding end, and the like.

In summary, in this embodiment of the present application, an operator performs an input operation on a display interface of a displayed target application in a running state, that is, a shortcut operation configured by an electronic device system for invoking a multitask management list based on the target application, for example, the sliding operation that slides up from the bottom end of the first display screen, the electronic device obtains the input operation, and in response to the input operation, when it is determined that there is a target device available for screen projection, and when an end point of the input operation is located in a target trigger area, a invoking function for the input operation in the system is not executed, for example, a multitask management list may be prohibited from being started, and instead, a screen projection display function is started, so that the display interface of the target application in the running state is directly transmitted to the target device for display.

Therefore, the input operation for calling the multi-task management list, which is configured by the electronic equipment system, is expanded, the intention of an operator to execute the input operation is determined by combining the connectable state of the electronic equipment and other equipment, the condition recorded in the step S13 is met, the rapid screen projection of the target application is realized, and the rapid screen projection of the electronic equipment running application is realized by one input operation relative to the control mode of selecting the target equipment to carry out the screen projection in the screen projection setting window, so that the control efficiency and convenience of the application screen projection among the interconnected equipment are improved.

Referring to fig. 4, a flowchart of a second alternative embodiment of the control method proposed in the present application is still applicable to an electronic device, and as shown in fig. 4, the control method may include:

step S41, a display interface of a target application in an operation state is displayed on a first display screen of the electronic equipment; the display interface of the target application occupies all display areas allocated to the target application;

step S42, obtaining input operation; the input operation is used for calling a multitasking management list based on the target application;

regarding the implementation method of step S41 and step S42, the description of the corresponding parts of the context embodiment may be followed, as described in the above description of step S11 and step S12, which is not described in detail herein.

Step S43, if a target device meeting the connection condition is obtained in the process of responding to the input operation, displaying a target trigger area to indicate that the ending point of the input operation can be positioned in the target trigger area;

in combination with the description of the corresponding part of step S13 in the foregoing embodiment, in the process of responding to the obtained input operation, if the target device satisfying the connection condition is obtained, it is indicated that the current electronic device satisfies the screen-throwing condition, and there are available devices that can be used as the screen-throwing devices of the electronic device, where, if there are multiple available devices, one or more target devices can be determined therefrom and used as the screen-throwing devices of the current electronic device.

Then, in order to accurately and efficiently trigger a screen-throwing mode of a target application running on the electronic device, a correspondingly configured target trigger area, such as an application scene shown in fig. 3, may be displayed on a first display screen of the electronic device, after an operator obtains the available target device in the input operation process, the first display screen may present a target trigger area serving as a visual prompt, and the input operation that intuitively guides the operator to subsequently execute may end in the target trigger area, such as a sliding gesture in fig. 3 enters the presented target trigger area (such as a prompt window of the target trigger area indicated in the first display screen shown in fig. 3), so that the electronic device may determine the screen-throwing intention of the operator on the target application accordingly.

Of course, if the operator does not want the target application to be displayed on the target device, the input operation to be executed subsequently can be ended outside the target trigger area, the electronic device determines that the end point of the input operation is outside the target trigger area based on obtaining the corresponding input operation information, recognizes the intention of the operator to call the multi-task management list based on the target device, that is, the original function call intention of the input operation can be directly called and started on the multi-task management list, and display interfaces of applications in running states in the electronic device are displayed in a floating window mode.

And S44, determining that the ending point of the input operation is located in the target trigger area, and transmitting the display interface of the target application in the running state, which is displayed by the first display screen, to the target device so as to display the display interface on the second display screen of the target device at the same time.

And continuing to execute the input operation by the operator based on the target trigger area displayed by the first display screen after the executed input operation enters the target trigger area, wherein the electronic equipment can determine the ending point of the input operation to the target trigger area based on the detected input operation coordinates, and can start to transmit the display interface of the target application operated by the electronic equipment to the target equipment for display according to the determined screen throwing intention of the target application.

It should be noted that, in the process of responding to the input operation, the present application does not limit the execution sequence of the two judging conditions, that is, determining whether to obtain the target device satisfying the connection condition and determining whether the end point of the input operation is located in the target trigger area, including but not limited to the step sequence described in the embodiments of the present application, and may also notify execution or further determine whether to obtain the target device satisfying the connection condition if it is determined that the end point of the input operation is located in the target trigger area, and execute the transmission process of the display interface of the subsequent target device if the connection channel is successfully established with the target device.

In some embodiments, in an alternative implementation manner in which the electronic device transmits the display interface of the target application in the running state to the target device as described in the above step S44, as shown in fig. 5a, after the electronic device starts the running of the target application and displays the display interface of the target application on the first display screen, the operator performs a sliding operation (i.e. the above input operation), in the response process of the sliding operation, it is determined that the electronic device is connected to the target device, and at the end point of the sliding operation in the target trigger area, the display interface of the target application in the running state may be transmitted to the target device, as indicated by an arrow in fig. 5a, where the electronic device transmits a data stream of the display interface of the target application to the target device, but is not limited to the screen throwing manner shown in fig. 7 a.

In this way, the display interface of the target application in the running state can be displayed on both the first display screen of the electronic device and the second display screen of the target device. The display interface of the target application in the running state in the electronic equipment is simultaneously displayed on the first display screen and the second display screen. The display interfaces of the target application displayed on the two display screens may be real-time display interfaces to display the latest application content of the target application, the transmission implementation manner of the display interfaces of the target application is not limited, and the display interfaces can be determined according to a communication transmission mechanism corresponding to the communication connection manner between the electronic device and the target device, which is not described in detail herein.

It should be noted that, the display interface of the target application in the running state may be displayed on the second display screen of the target device in a full-screen display mode as shown in fig. 5a, that is, the display interface of the target application is displayed in all display areas of the second display screen. If the target device runs other applications at this time, the second display screen displays the display interfaces of the other applications, and the second display screen of the target device may also display the respective display interfaces of the other applications and the target application in a split screen manner.

Optionally, as shown in fig. 5b, the second display screen of the target device may also display the display interface of the target application in the running state, that is, in a non-full screen display mode, according to the display size of the display interface of the target application in the electronic device. Therefore, the display mode of the second display screen of the target device for displaying the display interface of the target application in the running state is not limited, and the display size of the display data of the display interface of the target application in the running state drawn by the electronic device can be determined.

Referring to fig. 6, a flowchart of a third alternative embodiment of the control method provided in the present application, which is still applicable to an electronic device, may describe another alternative implementation manner in which the electronic device transmits a display interface of a target application in an operating state to the target device in the first embodiment, and referring to application scenarios shown in fig. 7a and 7b, the control method provided in the present embodiment may include:

Step S61, a display interface of a target application in an operation state is displayed on a first display screen of the electronic equipment; the display interface of the target application occupies all display areas allocated to the target application;

step S62, obtaining input operation; the input operation is used for calling a multitasking management list based on the target application;

step S63, if a target device meeting the connection condition is obtained in the process of responding to the input operation, displaying a target trigger area to indicate that the ending point of the input operation can be positioned in the target trigger area;

regarding the implementation method of step S61 to step S63, the description of the corresponding parts of the context embodiment may be followed, as described in the above description of step S41 to step S43, which is not described in detail here.

Step S64, determining that the ending point of the input operation is located in a target trigger area, and switching the display interface of the target application in a running state from the first display screen to be transmitted to the target equipment for display on a second display screen of the target equipment;

step S65, displaying a system operation interface on the first display screen.

In order to determine, according to the method described above, that the display interface of the target application in the running state is sent to the target device, and is displayed by the second display screen of the target device, in order to not affect other operations of the operator on the electronic device after the target application is projected to the target device, the display interface of the target application in the running state may be finished on the first display screen of the electronic device, and instead, the display interface of the target application in the running state may be displayed on the second display screen of the target device, and the electronic device may send the obtained application content of the target application to the target device, so as to update, in real time, the application content in the display interface of the target application displayed on the second display screen based on the application content.

For example, taking the target application as the video playing software as an example, as shown in fig. 7a, according to the control method described above, a playing display interface of the video playing software in an operating state is transmitted to the target device, the playing display interface is displayed on a second display screen of the target device, and video content is continuously played and displayed in the playing display interface, that is, the video source may send a video stream to the target device through a connection channel between the electronic device and the target device, and output the video stream, that is, the corresponding video is continuously played and displayed in the playing display interface of the video playing software operated by the electronic device displayed on the second display screen of the target device, but the method is not limited to the transmission mode of the video content.

After the electronic device drops the playing display interface of the video playing software to the target device, as shown in fig. 7a, the electronic device may end displaying the playing display interface of the video playing software on the first display screen and return to the system operation interface of the electronic device, as shown in fig. 7a, where the system operation interface may be a system desktop, that is, a page displaying icons of different applications of the electronic device, but is not limited to the application icons shown in fig. 7a, and may be determined according to the content of the system desktop configured by the electronic device.

It should be noted that, after the first display screen finishes displaying the playing display interface of the video playing software in the running state, the display interface may also be switched to display a preset display interface, for example, a display interface of a specific application (may be an application frequently used by an operator, such as social communication software, etc.), which is not limited to the return electronic device system operation interface shown in fig. 7a, and may be determined according to circumstances.

In addition, before the target application running on the electronic device is projected to the target device for display according to the method described above, if the target device displays the display interface of a certain application running on the target device (recorded as the first application), the received display interface of the target application in the running state can still be displayed in all display areas of the second display screen of the target device according to the method described above, i.e. the display interface of the target application is in a full-screen display state. Optionally, the target device may also display the display interface of the target application and the display interface of the first application in a split screen manner, where the display interface of the target application in the running state displayed by the second display screen may occupy all display areas allocated by the target device system, and the implementation process is not limited in this application.

Optionally, as shown in fig. 7b, after the target device obtains the display interface of the target application in the running state, the second display screen may adopt a non-full screen display mode to display the display interface of the target application, which may be determined based on the display size of the display data of the display interface of the target application in the running state drawn by the drawing engine before the electronic device sends the display interface of the target application in the running state, and if the display size of the second display screen is the display size of the first display screen, the second display screen may display the display interface of the target application in the running state through the display mode shown in fig. 7 b; if the display size of the second display screen is the display size of the second display screen, the second display screen can display the display interface of the target application in the running state through the display mode shown in fig. 7 a.

Therefore, the method for realizing the display of the display interface of the target application in the running state by the second display screen of the target device is not limited, including but not limited to the full-screen display or the split-screen display or the non-full-screen display modes described above, and can be determined according to the display configuration content of the target device or the display size of the display data of the display interface of the target application in the running state sent by the electronic device, which is not described in a one-to-one way example.

Referring to fig. 8, a flowchart of a fourth alternative embodiment of the control method provided in the present application, where the method is still applicable to an electronic device, the present embodiment may describe an alternative implementation manner how to transmit a display interface of a target application in a running state to a target device in each foregoing embodiment, as shown in fig. 8, and the method may include:

step S81, displaying a display interface of a target application in an operation state; the display interface of the target application occupies all display areas allocated to the target application;

step S82, obtaining input operation; the input operation is used for calling a multitasking management list based on the target application;

step S83, in response to the input operation, if the target device meeting the connection condition is obtained, determining that the end point of the input operation is located in the target trigger area, and creating a virtual screen; the virtual screen is determined based on the display parameters of the second display screen of the target device and the target display size;

regarding the implementation method for determining that the end point of the input operation is located in the target trigger area with respect to the target device that satisfies the connection condition obtained in step S81, step S82, and step S83, reference may be made to the description of the corresponding portions of the context embodiment, which is not described in detail herein.

In the case that it is determined that the transmission of the display interface of the target application in the running state to the target device is started, in order to ensure that the transmitted display interface of the target application is adapted to the second display screen of the target device, so that the second display screen can display the display interface of the target application in the running state with high quality (such as clear display, etc.), the electronic device may create a virtual screen adapted to the second display screen, that is, obtain the display parameter and the target display size of the second display screen of the target device, and create a virtual screen with the display parameter and the target display size based on the display parameter and the target display size of the second display screen.

The target display size may be the maximum display size of the second display screen or the display size of the maximum display area of the display interface allocated to the target application, which may be determined in combination with the display manner of the target device to the display interface of the target application described above.

Step S84, drawing display data of a display interface of the target application in an operation state based on the virtual screen;

And step S85, transmitting the display data to the target equipment so that a second display screen of the target equipment displays a display interface of the target application in the running state in a target display size.

In the process of displaying the display interface of any application on the first display screen of the electronic device, a drawing engine is required to draw display data of the display interface of the application based on the display size of the first display screen, and the display data is displayed through output, so that the display interface of the application is presented on the first display screen.

Based on the above, according to the method, when the electronic device needs to screen the display interface of the target application in the running state on the second display screen of the target device, because the display size and the display parameter of each of the first display screen and the second display screen are often different, if the display data of the display interface of the target application in the running state drawn based on the first display screen is directly sent to the target device, the display data is displayed on the second display screen of the target device, and the display size and the display parameter difference between the first display screen and the second display screen easily causes that the content of the display interface of the target application in the running state presented by the second display screen is unclear, thereby affecting the viewing experience feel of an operator.

In order to improve the above problem, when it is determined that the display interface of the target application in the running state is projected onto the second display screen of the target device for display, the electronic device will create a virtual screen according to the method described in step S83, after which the rendering engine of the electronic device obtains the content of the display interface of the target application in the running state, and does not render the display data of the display interface of the target application based on the first display screen any more, but may render the display data of the display interface of the target application in the running state based on the created virtual screen, that is, the display size of the first display screen according to which the rendering engine is controlled to render the display data is switched to the target display size possessed by the virtual screen, so as to render the display data of the display interface of the target application in the running state.

In this way, the electronic equipment transmits the display data drawn by the drawing engine to the target equipment, and the second display screen of the target equipment directly outputs and displays the received display data, so that the display interface of the target application in the running state of the electronic equipment can be clearly presented, that is, the display quality of the second display screen on the display interface of the target application is ensured, the user watching and operating experience is improved, and the control efficiency is improved.

It should be noted that, in the application scenario shown in fig. 7a, in the screen-projection display mode of the target application, the drawing engine of the electronic device may draw the corresponding display data according to the above-described method and send the display data to the target device. However, in the application scenario shown in fig. 5a, since the display interface of the target application in the running state is simultaneously displayed on the first display screen of the electronic device and the second display screen of the target device in the screen display mode of the target application, in addition to the method for implementing the drawing and transmission of the corresponding display data described in the steps S83-S85, the drawing engine may draw the display data of the display interface of the target application in the running state based on the first display screen, and the display data obtained in the drawing manner is not sent to the target device, and is directly output and displayed by the electronic device, so that the display interface of the target application in the running state is presented on the first display screen.

In some embodiments, in the actual application of the control method described in the fourth embodiment, after the target application is displayed on the target device by dropping a screen, the operator may directly use the input device of the target device to perform an input operation on the content of the display interface of the target application displayed on the second display screen, if the input operation described above (such as the sliding operation in the application scenario) is recorded as the first input operation, the input operation may be recorded as the second input operation, after the target device detects the corresponding second input operation information, the input operation may be sent to the electronic device through the connection channel, in the process of responding to the second input operation information, the electronic device may perform a corresponding operation on the display interface of the target application in the running state based on the second operation coordinate included in the second input operation information and the created virtual screen, for example, close the target application, or obtain new display data according to the method, send the new display data to the target device, display the new display interface of the target application is displayed on the second display screen of the target device, and so on.

In combination with the control method described in the above embodiments, in the process of responding to the input operation, in the process of obtaining the target device satisfying the connection condition, the electronic device determines that the terminal device with the connection channel established successfully is a plurality of terminal devices or does not establish any connection channel successfully through the connection channel successfully connected or the scanning mode of the surrounding devices, but scans the plurality of terminal devices successfully, and the target device can be selected from the plurality of terminal devices. In the application scenario shown in fig. 9, in response to an input operation, a device selection window may be displayed on the first display screen, in which the obtained device identifiers (such as the respective device names of the device 1 and the device 2 shown in fig. 9) of the available devices for target application projection may be displayed, and the operator may be prompted to directly select one or more available devices from the device identifiers as target devices, that is, in response to a selection operation on at least one device identifier displayed in the device selection window, determine that the available device with the selected device identifier is the target device, close the device selection window, and execute a subsequent control method.

As shown in fig. 9, the device selection window displayed by the first display screen may further display an option for storing the selected device as a target device for each application to be screened, so that an operator may determine whether to select the selected device according to an actual application situation, and if the selected option is selected, execute the control method provided in the present application on the application in the running state, and directly determine that the stored screened device is the target device. Optionally, before this, it may also be determined whether a connection channel is successfully established between the stored target device and the electronic device, if not, it may be determined whether the target device is successfully scanned, if not, it is indicated that the current target device is unavailable, the target device may be reselected according to the method described above, if it is determined that the target device is available, that is, the connection channel is successfully established between the electronic device and the target device, or the electronic device successfully scans the target device, and a subsequent control method flow may be executed, which is not described herein in detail.

Optionally, under the condition that a plurality of terminal devices are determined according to the method described above, an output device selection window is not required, an available target device can be directionally found through a UWB (Ultra Wide Band) positioning technology, a connection channel between the target device and the target device is established, that is, the target device is determined from the plurality of terminal devices based on the pointing information of the electronic device (such as the direction information of the electronic device, etc., the method for obtaining the target device is not limited in the application), and the implementation method for realizing the directional selection of the target device by the UWB positioning technology is not detailed in the application.

It should be understood that, according to the method described above, the number of available devices, that is, the terminal devices, that are available for the screen-projection display of the target device by the current electronic device is determined to be one, and the terminal device may be directly determined to be the target device, so as to continue to execute the control method provided in the present application.

It should be noted that, for the target devices in the control method described in the above embodiments, the target devices include, but are not limited to, tablet computers or display devices shown in the drawings, and may also be other terminal devices with a second display screen, such as a notebook computer, an intelligent home device (e.g. a television). Similarly, the electronic device implementing the control method is not limited to the mobile phone shown in each application scene of the drawings, and may be a vehicle-mounted terminal, a wearable device (such as a smart watch, etc.), etc., where the application does not limit the product types of each electronic device applicable to the control method provided in the application, and may be determined according to circumstances.

Referring to fig. 10, a schematic structural diagram of an alternative embodiment of a control device proposed in the present application, as shown in fig. 10, the control device may include:

a display module 101, configured to display a display interface of a target application in an running state; the display interface of the target application occupies all the display areas allocated to the target application;

an obtaining module 102 for obtaining an input operation; the input operation is used for calling a multitasking management list based on the target application;

and the transmission module 103 is used for transmitting the display interface of the target application in the running state to the target device if the target device meeting the connection condition is obtained and the ending point of the input operation is determined to be positioned in the target trigger area in the process of responding to the input operation.

Optionally, the control device may further include:

and the target trigger area display module is used for displaying a target trigger area in the process of responding to the input operation so as to indicate that the ending point of the input operation can be positioned in the target trigger area.

The target trigger area is located on the sliding path of the input operation.

In some embodiments, the transmission module 103 may include:

The first transmission unit is used for transmitting the display interface of the target application in the running state, which is displayed on the first display screen of the electronic equipment, to the target equipment, and displaying the display interface on the second display screen of the target equipment at the same time; or,

and the second transmission unit is used for switching the display interface of the target application in the running state from the first display screen of the electronic equipment to be transmitted to the target equipment so as to be displayed on the second display screen of the target equipment.

In still other embodiments, the transmission module 103 may include:

a virtual screen creation unit for creating a virtual screen; the virtual screen is determined based on the display parameters of the second display screen of the target device and the target display size;

a display data drawing unit for drawing display data of a display interface of the target application in an operating state based on the virtual screen;

and the display data transmission unit is used for transmitting the display data to the target equipment so that the second display screen of the target equipment displays the display interface of the target application in the running state in the target display size.

The control device described in connection with the above embodiments, the above satisfaction of the connection condition includes one of:

Terminal equipment with successful connection channel establishment;

a terminal device capable of scanning.

Therefore, the control device may further include:

the first obtaining module is used for obtaining terminal equipment with successful connection channel establishment; or,

and the first determining module is used for determining the terminal equipment which can be scanned by the electronic equipment.

Based on this, in the case where the plurality of terminal apparatuses are provided, the control device may further include:

and the target device determining module is used for determining the target device from the plurality of terminal devices based on the pointing information of the electronic device.

It should be noted that, regarding the various modules, units, and the like in the foregoing embodiments of the apparatus, the various modules and units may be stored as program modules in a memory, and the processor executes the program modules stored in the memory to implement corresponding functions, and regarding the functions implemented by each program module and the combination thereof, and the achieved technical effects, reference may be made to descriptions of corresponding parts of the foregoing method embodiments, which are not repeated herein.

The present application further provides a computer readable storage medium, on which at least one set of computer instructions may be stored, where a processing device implements a control method according to the present application by executing the computer instructions, and with respect to a implementation procedure of the control method, reference may be made to the description of corresponding parts of the above method embodiments, which is not described in detail herein by way of example.

Referring to fig. 11, a schematic hardware structure of an alternative embodiment of an electronic device suitable for the control method proposed in the present application, as shown in fig. 11, the electronic device may include: a first display 111 and a processor 112, wherein:

the first display 111 may be used to display a display interface of the target application in the running state, where the display interface of the target application occupies all the display area allocated to the target application.

The processor 112 may be configured to obtain an input operation, and in response to the input operation, if a target device satisfying a connection condition is obtained and an end point of the input operation is determined to be located in a target trigger area, and transmit a display interface of a target application in a running state to the target device, where the implementation process may refer to the description of the corresponding portion of the above method embodiment, and this embodiment is not described in detail.

In this embodiment of the present application, the first display screen 111 may include a display panel, where the display panel may be a touch display panel, and the touch sensing unit senses a touch event on the touch display panel to obtain an input operation such as the sliding operation and input operation information thereof, so as to implement the control method of the present application. And the display interface of the application is presented by displaying the display data of the display interface of the application drawn by the drawing engine, the type of the first display screen 111 and the display principle thereof will not be described in detail in the present application.

The optional electronic device may further include at least one connection port, where the connection port may be used to connect the target device, so as to form a connection channel between the electronic device and the target device, through which information transmission between the devices, such as a display interface of the target application, or input operation information, etc., can be implemented.

In practical application, the connection port may be a communication element supporting wireless communication modes such as wifi, bluetooth and/or near field channel modes, so that the electronic device may implement data interaction with other devices (such as the target device or other devices) through the communication element.

Optionally, the connection port may further include one or more interfaces supporting wired communication, such as a general-purpose input/output (GPIO) interface, a USB interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, etc., to implement data transmission between the components in the electronic device. Wherein, the data interaction can be carried out among the components in the electronic equipment through a communication bus, such as a data bus, an instruction bus and the like.

Alternatively, the processor 112 may store a program code implementing the control method proposed in the present application, and the control method is implemented by executing the program code. Optionally, the processor 112 may also include at least one memory unit and at least one processing unit, where the processing unit may execute the program code stored in the memory unit to implement the control method set forth herein.

The processing units may include, among other things, application processors (application processor, AP), modem processors, graphics processors (graphics processing unit, GPU), image signal processors (image signal processor, ISP), controllers, video codecs, digital signal processors (digital signal processor, DSP), central processing units (Central Processing Unit, CPU), application-specific integrated circuits (application-specific integrated circuit, ASIC), off-the-shelf programmable gate arrays (FPGAs), or other programmable logic devices. The memory unit may include high-speed random access memory, and may also include nonvolatile memory, such as at least one magnetic disk storage device or other volatile solid state memory device, etc., and the present application does not limit the constituent structure of the processor 112.

It should be understood that the processor 112 itself has a memory space, and the above-listed memory or other storage medium may not be integrated or connected, where the processor 112 may be any one or more of the above-listed processors, load the program code stored in the memory space, implement the control method set forth in the present application, and the implementation process is not described in detail in the present application.

It should be understood that the structure of the electronic device shown in fig. 11 is not limited to the electronic device in the embodiment of the present application, and in practical application, the electronic device may include more or fewer components than those shown in fig. 11, or may combine some components, such as at least one input component of a camera, a microphone, and the like; at least one output component such as a speaker, vibration mechanism, lamp, etc.; an antenna; a sensor module including various sensors; the power management module, the antenna, etc. can determine the hardware structure according to the type of the electronic device and the functional requirement thereof, and the application is not specifically enumerated herein.

Finally, it should be noted that, in the embodiments described above, unless the context clearly indicates otherwise, the words "a," "an," "the," and/or "the" are not to be construed as limiting, but rather as including the singular, as well. In general, the terms "comprises" and "comprising" merely indicate that the steps and elements are explicitly identified, and they do not constitute an exclusive list, as other steps or elements may be included in a method or apparatus. The inclusion of an element defined by the phrase "comprising one … …" does not exclude the presence of additional identical elements in a process, method, article, or apparatus that comprises an element.

Wherein, in the description of the embodiments of the present application, "/" means or is meant unless otherwise indicated, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" means two or more than two.

The terms "first," "second," and the like, herein are used for descriptive purposes only and are not necessarily for distinguishing one operation, element or module from another, and not necessarily for describing or implying any actual such relationship or order between such elements, elements or modules. And is not to be taken as indicating or implying a relative importance or implying that the number of technical features indicated is such that the features defining "first", "second" or "a" may explicitly or implicitly include one or more such features.

In addition, various embodiments in the present specification are described in a progressive or parallel manner, and each embodiment is mainly described in a different manner from other embodiments, and identical and similar parts between the various embodiments are only required to be mutually referred. The device and the electronic equipment disclosed in the embodiments correspond to the method disclosed in the embodiments, so that the description is simpler, and the relevant parts are referred to in the description of the method.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A control method, the control method comprising:

a display interface for displaying a target application in an operating state; the display interface of the target application occupies all the display areas allocated to the target application;

obtaining an input operation; the input operation is used for calling a multitasking management list based on the target application;

and in the process of responding to the input operation, if the target equipment meeting the connection condition is obtained, determining that the ending point of the input operation is positioned in a target trigger area, and transmitting the display interface of the target application in the running state to the target equipment.

2. The control method according to claim 1, in the course of the response to the input operation, if a target device satisfying a connection condition is obtained, the control method further comprising:

and displaying a target trigger area to indicate that the ending point of the input operation can be positioned in the target trigger area.

3. The control method according to claim 1, the target trigger area being located on a sliding path of the input operation.

4. The control method according to claim 1, the transmitting the display interface of the target application in the running state to the target device, comprising:

and transmitting the display interface of the target application in the running state, which is displayed on the first display screen of the electronic equipment, to the target equipment, and simultaneously displaying the display interface on the second display screen of the target equipment.

5. The control method according to claim 1, the transmitting the display interface of the target application in the running state to the target device comprising:

and switching the display interface of the target application in the running state from the first display screen of the electronic equipment to be transmitted to the target equipment so as to be displayed on the second display screen of the target equipment.

6. The control method according to claim 1, the transmitting the display interface of the target application in the running state to the target device, comprising:

creating a virtual screen; the virtual screen is determined based on the display parameters of the second display screen of the target device and the target display size;

drawing display data of a display interface of the target application in a running state based on the virtual screen;

and transmitting the display data to the target equipment so that a second display screen of the target equipment displays a display interface of the target application in the running state with the target display size.

7. The control method according to claim 1, the satisfaction of the connection condition comprising one of:

terminal equipment with successful connection channel establishment;

a terminal device capable of scanning.

8. The control method according to claim 7, the control method further comprising:

and determining the target device from a plurality of terminal devices based on the pointing information of the electronic device.

9. A control apparatus, the control apparatus comprising:

the display module is used for displaying a display interface of the target application in the running state; the display interface of the target application occupies all the display areas allocated to the target application;

The obtaining module is used for obtaining input operation; the input operation is used for calling a multitasking management list based on the target application;

and the transmission module is used for responding to the input operation, if the target equipment meeting the connection condition is obtained, determining that the ending point of the input operation is positioned in a target trigger area, and transmitting the display interface of the target application in the running state to the target equipment.

10. An electronic device, the electronic device comprising:

the first display screen is used for displaying a display interface of the target application in the running state; the display interface of the target application occupies all the display areas allocated to the target application;

and the processor is used for obtaining input operation, responding to the input operation, if the target equipment meeting the connection condition is obtained, determining the ending point of the input operation to be positioned in a target trigger area, and transmitting the display interface of the target application in the running state to the target equipment.