CN111857926B

CN111857926B - Control method and device

Info

Publication number: CN111857926B
Application number: CN202010707564.4A
Authority: CN
Inventors: 郑维; 王金超; 田亚楠
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2020-07-21
Filing date: 2020-07-21
Publication date: 2023-08-18
Anticipated expiration: 2040-07-21
Also published as: CN117215697A; CN111857926A

Abstract

The application provides a control method and a control device, which are used for synchronizing first display content of a first application object to display in a display area of second electronic equipment in response to screen throwing operation after screen throwing operation of the first application object in the first electronic equipment is obtained, and controlling a movable identifier to move in the display area of the second electronic equipment, so that the movable identifier can be controlled to slide, click and other control operations at least through an input part on the first electronic equipment, the control of the first application object displayed on the second electronic equipment through the first electronic equipment is realized, the control of the first application object and the update of the display content in the second electronic equipment are completed, and therefore, when the control of the first application object is required, the first application object is not required to be switched to the first electronic equipment for display, and the display content of the first application object is not required to be synchronized to the second electronic equipment through the screen throwing operation again after the control is completed.

Description

Control method and device

Technical Field

The application belongs to the technical field of data processing, and particularly relates to a control method and device.

Background

The display area of the electronic device can be enlarged by the screen projection technology at present, for example, the first electronic device is connected with the second electronic device, the screen of the first electronic device is smaller than that of the second electronic device, and the content displayed in the display area of the first electronic device is projected to the display area of the second electronic device to be displayed by the screen projection technology, so that the display area of the second electronic device is used as the display area of the first electronic device, and the expansion of the display area of the first electronic device is realized.

Disclosure of Invention

In one aspect, the present application provides a control method, including:

obtaining a screen projection operation aiming at a first application object in first electronic equipment;

responding to the screen throwing operation, and synchronizing the first display content of the first application object to the display area of the second electronic equipment for display;

and controlling the movable identifier to move in the display area of the second electronic device.

Optionally, the method further comprises:

obtaining first movement data of an input component corresponding to the movable identifier in the first electronic device;

calculating second movement data of the input component in the second electronic device based on the first movement data;

the controlling the movable flag to move in the display area of the second electronic device includes: and controlling the movable identifier to move in the display area of the second electronic device based on the second movement data.

Optionally, the method further comprises:

obtaining control operation of a first application object displayed by the second electronic equipment;

processing the first application object based on the control operation to obtain real-time display content of the first application object in an operation state;

And synchronizing the display content to the display area of the second electronic equipment for display so as to update the content displayed by the second electronic equipment.

Optionally, the method further comprises: displaying an application object in a display area of the first electronic device in the process of maintaining the display of the first application object in the display area of the second electronic device;

obtaining a control operation for the application object;

processing the application object based on control operation aiming at the application object to obtain display content of real-time display of the application object in an operation state;

and displaying the display content in the display area of the first electronic device, wherein the content displayed in the display area of the second electronic device is kept unchanged.

Optionally, the method further comprises:

obtaining a calling operation for the first electronic device;

responding to the calling operation, calling a task manager of the first electronic equipment, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic equipment;

the first application object is determined from the plurality of application objects.

In another aspect, the present application provides a control apparatus comprising:

The device comprises an obtaining unit, a display unit and a display unit, wherein the obtaining unit is used for obtaining screen projection operation aiming at a first application object in first electronic equipment;

the response unit is used for responding to the screen throwing operation and synchronizing the first display content of the first application object to the display area of the second electronic equipment for display;

and the control unit is used for controlling the movable mark to move in the display area of the second electronic device.

Optionally, the obtaining unit is further configured to obtain first movement data of an input component corresponding to the movable identifier in the first electronic device;

the apparatus further comprises: a calculation unit configured to calculate second movement data of the input part in the second electronic device based on the first movement data;

the control unit is used for controlling the movable identifier to move in the display area of the second electronic device based on the second movement data.

Optionally, the obtaining unit is further configured to obtain a control operation for a first application object displayed by the second electronic device;

the apparatus further comprises: the processing unit is used for processing the first application object based on the control operation to obtain display content of real-time display of the first application object in an operation state;

And the response unit is also used for synchronizing the display content to the display area of the second electronic equipment for display so as to update the content displayed by the second electronic equipment.

Optionally, the obtaining unit is further configured to obtain a call operation for the first electronic device;

the response unit is further used for responding to the calling operation and calling a task manager of the first electronic device, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic device;

the apparatus further comprises: and the determining unit is used for determining the first application object from the plurality of application objects.

Optionally, the second electronic device is a display.

According to the control method and the control device, after the screen throwing operation aiming at the first application object in the first electronic equipment is obtained, the screen throwing operation is responded, the first display content of the first application object is synchronized to the display area of the second electronic equipment to be displayed, and the movable identifier is controlled to move in the display area of the second electronic equipment, so that the control operation such as sliding, clicking and the like can be carried out at least through the input component on the first electronic equipment to control the movable identifier, the control of the first application object displayed on the second electronic equipment through the first electronic equipment is realized, the control of the first application object and the update of the display content in the second electronic equipment are completed, and therefore, when the control of the first application object is needed, the first application object is not needed to be switched to the first electronic equipment to be displayed, and the display content of the first application object is not needed to be synchronized to the second electronic equipment through the screen throwing operation again after the control is completed.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flowchart of a screen projection processing method provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of a display of a plurality of application objects provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of another display of multiple application objects provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of still another embodiment of the present application for displaying a plurality of application objects;

FIG. 5 is a flowchart of another screen-projection processing method according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a display of a first application object selected by a screen operation according to an embodiment of the present application;

FIG. 7 is a flowchart of a further screen-projection processing method according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another display of selecting a first application object through a screen-drop operation according to an embodiment of the present application;

FIG. 9 is a flowchart of another screen-projection processing method according to an embodiment of the present application;

FIG. 10 is a flowchart of a further method for screen projection processing according to an embodiment of the present application;

FIG. 11 is a flowchart of a further screen-projection processing method according to an embodiment of the present application;

FIG. 12 is a flow chart of a control method provided by an embodiment of the present application;

FIG. 13 is a schematic diagram of a first electronic device and a second electronic device according to an embodiment of the present application, where different operations may be performed simultaneously;

FIG. 14 is a flow chart of another control method provided by an embodiment of the present application;

fig. 15 is a schematic structural diagram of a control device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

Referring to fig. 1, a screen projection processing method provided by the embodiment of the application may include the following steps:

101. a call operation for the first electronic device is obtained.

102. And in response to the calling operation, calling a task manager of the first electronic device, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic device.

The invoking operation has a function of invoking the task manager, and the invoking operation for the first electronic device is obtained, where the invoking operation may be at least one of a gesture operation for the first electronic device and an operation for a component of the first electronic device, for example, the invoking operation may be a sliding operation (such as an upward sliding) for a display area of the first electronic device, and for example, the invoking operation may be a double-click operation for a home key of the first electronic device.

If the up-slide operation is taken as the invoking operation, the operation body is obtained to be in contact with the display area of the first electronic device and to be moved up, it is determined that the up-slide operation is obtained as the invoking operation, in which case the task manager of the first electronic device may be invoked. In the process that the operating body is in contact with the display area of the first electronic device, the first electronic device continuously monitors a down event and a move event, and the direction of the move event is an up event and an up event, so that it is determined that the up sliding operation is obtained.

In this embodiment, the invoking operation may take effect when the first electronic device is in the unlocked state, that is, if the invoking operation is obtained when the first electronic device is in the unlocked state, the invoking operation may be responded to, if the first electronic device is in the screen-off state, the operating body makes the invoking operation for the first electronic device, but the first electronic device does not obtain the invoking operation, so that the invoking operation cannot take effect. The current calling operation is generally effective when the first electronic device is in an unlocking state, and the embodiment can set that the calling operation is effective when the first electronic device is in a screen locking state, so that the calling operation can be responded even if the first electronic device is not unlocked. The unlocking state refers to that the first electronic device is on screen and all application objects in the first electronic device are available, the locking state refers to that the first electronic device is on screen, but the application objects in the first electronic device are disabled or only a small part of the application objects are available (such as that a camera is available), and the screen-extinguishing state refers to that the first electronic device is off screen.

And if the task manager of the first electronic device is called, displaying a plurality of application objects managed by the task manager in a display area of the first electronic device, taking the task manager as an entrance of expanding screen projection, and projecting the display content of at least one application object in the plurality of application objects to the second electronic device for display. The plurality of application objects managed by the task manager may be application objects used by the first electronic device in a preset period of time, and may be application objects of at least one type of application objects that have been used, have been closed, have been used, have been switched to a background operation, are currently running, and the like. The preset time period may be a time period after a delay from the response calling operation as a start time, and the present embodiment is not limited to the preset time period.

One way in which the display area of the first electronic device displays a plurality of application objects is: the identification of the plurality of application objects is displayed in the display area, such as displaying thumbnail images of the plurality of application objects or displaying a running interface of the plurality of application objects in the display area. In displaying the plurality of application objects, thumbnail images of the plurality of application objects may be simultaneously displayed in a display area of the first electronic device, and as shown in fig. 2, thumbnail images of the plurality of application objects managed by the task manager are displayed in the display area of the first electronic device upon obtaining the upward sliding operation; or, when the double-click operation for the home key is obtained, running interfaces of a plurality of application objects managed by the task manager are displayed in a display area of the first electronic device, as shown in fig. 3, the running interfaces of the plurality of application objects are displayed in a stacked manner, the first displayed application object is in a screen-throwing disabled state, other application objects are in the screen-throwing disabled state, and by sliding the application objects displayed in the switchable display area leftwards and rightwards, different application objects are switched from the screen-throwing disabled state to the screen-throwing enabled state, and the corresponding application objects in the screen-throwing enabled state are switched to the screen-throwing disabled state.

In addition to the display manner shown in fig. 3, the present embodiment may also display a plurality of application objects managed by the task manager in other display manners, as shown in fig. 4, in which the running interfaces of the plurality of application objects are displayed in a tiled manner, where the display area of the first electronic device displays the running interfaces of at least one application object, but the running interfaces are matched and not overlapped with each other, and the running interfaces of the application objects displayed in the display area are switchable by sliding leftwards and rightwards.

103. A first application object is determined from a plurality of application objects.

The first application object is one application object of the application objects, the first application object determining process may be based on an operation of an operation body on the application objects, by which one application object is selected from the application objects as the first application object, or may be automatically determined from the application objects, for example, the first application object managed by the task manager is determined as the first application object, for example, usage data of each application object of the application objects managed by the task manager is obtained, based on the usage data of each application object, the first application object is determined from the application objects, and the usage data at least indicates a usage frequency of the application object and/or a frequency of the application object being screened, so as to select, based on the usage data, the first application object whose usage frequency and/or frequency being screened satisfies a preset condition, for example, the preset condition may be an application object whose usage frequency is the largest or whose usage frequency is higher than a certain threshold, and the preset condition is not limited in this embodiment.

104. And synchronizing the first display content of the real-time display of the first application object in the running state to the display area of the second electronic device for display, so as to screen the first display content of the first application object to the display area of the second electronic device for display.

The first display content is real-time display content of the first application object in the running state, namely, if the first application object is displayed in the display area of the first electronic device, the first electronic device can display the first display content at the current moment, so that the condition of the first application object in the second electronic device when the first application object is in the running state in the first electronic device is the same as the condition of the first application object in the first electronic device. If the condition of the first application object includes an operation stage of the first application object and a display screen in the operation stage, in the process of projecting the first application object to the display area of the second electronic device, the first application object directly operates to the operation stage of the first application object in the second electronic device and displays the display screen in the operation stage.

For example, the first application object points to a game application, the game application enters a game stage in the first electronic device and is in a monster state, and during the process of projecting the game application to the display area of the second electronic device, the second electronic device can directly enter the game stage of the game application and also display an interface for a user to monster at the first electronic device. Based on the above, if the first application object is in the running state in the first electronic device, the first electronic device transmits a frame image of the first application object from the closed state to the current running state to the second electronic device, and the second electronic device sequentially loads a frame image of the first application object from the closed state to the current running state into the display area of the second electronic device, so that the second electronic device can display the first display content of the real-time display of the first application object in the running state.

If the first application object is in a closed state in the first electronic device, in the process of switching the first electronic device to the second electronic device, the first electronic device is switched from the closed state to the running state, and the first display content which is displayed in real time in the running state is synchronized to the second electronic device, so that the screen switching process not only has the content screen switching function, but also can trigger the first application object to be changed to the running state, and the automatic switching of the first application object from the closed state to the running state is realized, so that the starting operation is not required to be executed for the first application object.

For example, the first application object points to a chat application, the chat application is in a closed state in the first electronic device, and in the process of displaying the chat application on the display area of the second electronic device, the first electronic device switches the chat application from the closed state to the running state, i.e. the first electronic device can start the chat application, and the display interface of the chat application is used as the first display content to be synchronized to the display area of the second electronic device for displaying, so that the second electronic device can directly enter the chat application.

In the process of displaying the first display content in real time when the first application object is in the running state, the first electronic device can display the content of the other application object in real time when the first application object is in the running state, the content displayed in the first electronic device and the content displayed in the second electronic device are mutually independent, so that the application objects corresponding to the first electronic device and the second electronic device cannot be influenced by each other, for example, the first electronic device plays a game, the second electronic device looks at a live video, or the first electronic device performs chat, the second electronic device looks at a video, or the first electronic device plays a game, the second electronic device performs on-hook and the like, and different application objects are operated through the first electronic device and the second electronic device, so that different requirements of users are met.

In this embodiment, the other application object displayed by the first electronic device may be an application object determined from a desktop of the first electronic device, for example, selected according to a selection operation of the operation body for a display area of the first electronic device; of course, another application object displayed by the first electronic device may also be determined in other manners, which will not be described herein.

The first electronic device and the second electronic device may be connected by at least one of a wired connection and a wireless connection, for example, the first electronic device and the second electronic device may be connected by a DP (Display Port) line or HDMI (High Definition Multimedia Interface Cable, high definition multimedia interface line), and for example, the first electronic device and the second electronic device may be connected to the same local area network. Because the stability of the wired connection mode is better than that of the wireless connection mode, the first electronic equipment and the second electronic equipment can be connected in a wired connection mode, and if the first electronic equipment and the second electronic equipment are connected in a wired mode and a wireless mode at the same time, the first electronic equipment and the second electronic equipment can be transmitted in a wired mode.

The relationship of the second electronic device and the first electronic device may be, but is not limited to: the display area of the second electronic device is larger than that of the first electronic device, so that the display content of an application object needing to use the larger display area can be projected to the display area of the second electronic device. In addition, the second electronic device may be an electronic device having a display function and no computing capability, for example, the second electronic device may be a display, etc., the second electronic device does not have an input component such as a mouse and a keyboard, etc., the second electronic device is controlled by the input component of the first electronic device, the computing required to be performed for the control is processed by the first electronic device, and the content displayed in real time after the processing of the first electronic device is transmitted to the second electronic device for display.

According to the screen-throwing processing method, the calling operation aiming at the first electronic equipment is obtained, the task manager of the first electronic equipment is called in response to the calling operation, a plurality of application objects managed by the task manager are displayed in the display area of the first electronic equipment, the first application object is determined from the application objects, the first display content of the first application object, which is displayed in real time and is in an operating state, is synchronized to the display area of the second electronic equipment for display, therefore, the task manager can be used as an extended screen-throwing entrance, the first application object is selected from the application objects managed by the task manager to be used as an extended screen-throwing application object, and the number of the application objects in the task manager is smaller than that of the application objects in a desktop, so that the first application object can be selected from the application objects, and the number of the selected application objects can be controlled to improve the selection efficiency.

In the screen throwing process, the first display content of the real-time display of the first application object in the running state is synchronized to the display area of the second electronic device for display, so that the first application object is in the running state when being thrown to the second electronic device, and even if the first application object is in the closing state in the first electronic device, the first application object can be controlled to be switched from the closing state to the running state in the screen throwing process; if the first application object is in an operation state in the first electronic device, the first application object still keeps the operation state when the screen is projected to the second electronic device, the displayed content is a first display content displayed in real time when the first application object is in the operation state, so that the condition of the first application object in the second electronic device is the same as the condition of the first application object in the first electronic device, partial operation of the first application object in the second electronic device is omitted, and the operation of the first application object in the second electronic device is quickened.

Referring to fig. 5, another screen projection processing method provided by the embodiment of the present application may include the following steps:

201. a call operation for the first electronic device is obtained.

202. And in response to the calling operation, calling a task manager of the first electronic device, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic device.

In this embodiment, for the description of step 201 and step 202, please refer to the above embodiment, and this embodiment is not described again.

203. A selected operation of the operation body for one of the plurality of application objects is obtained, and the operation body is moved in a first direction during the maintaining of the selected operation.

The selection operation is used for indicating to select one application object in the plurality of application objects, and dragging the selected application object to move in a first direction through the operation body under the condition of maintaining the selection, so that the one application object in the plurality of application objects is in a selected dragging state.

The first direction may be one of left, right, up and down directions, the display area of the first electronic device may currently display at least one application object of all application objects managed by the task manager, and the at least one application object currently displayed may not be selected to be screen-cast into the second electronic device, and the application object displayed on the display area of the first electronic device needs to be switched, and the switching process may be performed after a switching operation for the display area of the first electronic device is obtained, for example, the application object displayed on the display area of the first electronic device is switched after a sliding operation for the display area of the first electronic device is obtained, for example, both left sliding and right sliding may be switched, so that in order to distinguish from the switching application object, the first direction in which the embodiment is moved after one application object is selected based on the selection operation is different from the sliding direction in which the application object is switched, for example, the first direction is up or down.

204. If the release selection operation is monitored during the movement in the first direction, it is determined that the screen throwing operation is obtained. Releasing the selected operation indicates that the selected operation is finished, and from the monitoring of the selected operation to the dragging of an application object to move to a first direction and then to the ending of the selected operation, the screen throwing operation is considered to be finished once, and for the first electronic equipment, the screen throwing operation is determined to be obtained when the first electronic equipment monitors a down event, a move event and the direction of the move event is the first direction and the up event.

205. And responding to the screen throwing operation, determining the application object corresponding to the selected operation as a first application object, and designating the first application object through the selected operation in the screen throwing operation process.

206. And synchronizing the first display content of the real-time display of the first application object in the running state to the display area of the second electronic device for display, so as to screen the first display content of the first application object to the display area of the second electronic device for display.

In this embodiment, the screen-throwing operation is used to determine a first application object from a plurality of application objects and instruct the first electronic device to synchronize the first display content to the display area of the second electronic device, and the screen-throwing operation is described as having the functions of determining the first application object, determining the first display content and synchronizing the first display content to the second electronic device, so as to complete multiple tasks through one screen-throwing operation.

As shown in fig. 6, after the task manager is invoked, the display area of the first electronic device displays the application object 1 among the plurality of application objects managed by the task manager, and switches from displaying the application object 1 to the application object 3 by sliding to the left while the application object 1 is switched from the screen-on state to the screen-off disabled state, and the application object 3 is switched from the screen-off disabled state to the screen-on enabled state. If the selected operation for the application object 3 is obtained, which indicates that the current operation body selects the application object 3, the operation body is monitored to move downwards in the process of maintaining the selected application object 3, if the selected operation is monitored to be finished in the process of moving downwards, the screen throwing operation is determined to be obtained, and the first electronic device synchronizes the first display content of the real-time display of the application object 3 in the running state to the second electronic device.

If the upward movement is monitored after the downward movement, and the selected operation is monitored after the upward movement is monitored, the first electronic device determines that the screen-throwing operation is not obtained, the application object 3 is not determined to be the first application object, and further, the display content corresponding to the application object 3 is not synchronized to the second electronic device. However, if the screen-throwing operation is detected after the downward movement and then the upward movement and then the downward movement, and the end of the selected operation is detected after the downward movement, the screen-throwing operation can be determined to be obtained, and therefore, in the embodiment, the end of the selected operation is detected during the downward movement.

According to the screen-throwing processing method, from monitoring the selected operation to dragging an application object to move in the first direction to finishing the selected operation, the screen-throwing operation is considered to be finished once, the first application object is determined from a plurality of application objects in response to the screen-throwing operation, the first electronic device is instructed to synchronize the first display content to the display area of the second electronic device for display, the screen-throwing operation is described, and meanwhile the screen-throwing operation has the functions of determining the first application object, determining the first display content and synchronizing the first display content to the second electronic device, so that a plurality of tasks are finished through one screen-throwing operation.

In this embodiment, the method for determining to obtain the screen projection operation may also refer to the screen projection processing method shown in fig. 7, and may include the following steps:

301. a call operation for the first electronic device is obtained.

302. And in response to the calling operation, calling a task manager of the first electronic device, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic device.

303. A selected operation of the operation body for one of the plurality of application objects is obtained, and the operation body is moved in a first direction during the maintaining of the selected operation.

304. And moving a first distance to a first direction, and displaying a plurality of controls associated with the application object corresponding to the selected operation in a display area of the first electronic device.

305. And controlling the working state of at least one control in the plurality of controls in the process of continuing to move from the position where the first distance is located to the first direction.

306. And if the release selection operation is monitored in the moving process in the first direction and the control related to the screen throwing in the plurality of controls is in an available state, determining to acquire the screen throwing operation.

307. And responding to the screen throwing operation, determining the application object corresponding to the selected operation as a first application object, and designating the first application object through the selected operation in the screen throwing operation process.

308. And synchronizing the first display content of the real-time display of the first application object in the running state to the display area of the second electronic device for display, so as to screen the first display content of the first application object to the display area of the second electronic device for display.

The difference between the above-mentioned screen projection processing method shown in fig. 5 is that steps 304 to 306 are: in the process of maintaining the selected operation to move to the first direction, a control associated with the application object can be displayed in a display area of the first electronic device; movement in a first direction changes the operational state of the control; the screen operation is also related to the control being in an available state.

Wherein the application object associated control comprises at least: and the control related to screen throwing is in an available state, which indicates that the affiliated application object can throw the screen to the second electronic device, and the control related to screen throwing is in a disabled state, which indicates that the affiliated application object can not throw the screen to the second electronic device. The application object associated control may further include: controls with other functionality, such as controls with functionality to display application information for an application object.

If the operation body continues to move towards the first direction after moving a first distance, the working state of the control is changed along with the change of the distance moved in the first direction, and the changing of the working state of the control can include but is not limited to: the change in distance along the first direction causes the working state of one of all the controls associated with the application object to be in an available state, the working states of the other controls to be in a disabled state, and the controls in the available state may change as the distance changes.

As shown in fig. 8, after the operation body moves to the first distance, three controls are displayed in the display area of the first electronic device, respectively: an application information control (represented by control 1 in fig. 8), a lock control (represented by control 2 in fig. 8), and a screen-drop control (represented by control 3 in fig. 8), the application information control being for indicating application information for displaying an application object, the lock control being for indicating a lock application program, the screen-drop control being for indicating a screen-drop of the application object.

If the operating body moves to the first distance, the working state of the application information control is in an available state (for example, the hooking in 8 indicates that the control is selected and is in the available state), and the working states of the two remaining controls are in a disabled state; if the operating body continues to move to a second distance in the first direction, the working state of the application information control is switched from the available state to the disabled state, the locking control is switched from the disabled state to the available state, and the screen throwing control is maintained in the disabled state; and if the operating body continues to move from the second distance to the first direction to the third distance, the working state of the application information control is maintained in a disabled state, the locking control is switched from the available state to the disabled state, and the screen throwing control is switched from the disabled state to the available state. If the control is moved in the direction opposite to the first direction in the moving process, the working state of the control can be controlled to be switched, and the switching of the working state of the control is related to the moving distance and is not described herein.

If the screen throwing control is in an available state and the release selection operation is monitored, the screen throwing operation is determined to be obtained, the operation body is lifted up when the screen throwing control is in the available state, the release/end of the selection operation is described, the screen throwing operation is determined to be obtained, and the first electronic device can synchronize the first display content of the real-time display of the first application object in the running state selected by the selection operation to the display area of the second electronic device for display.

The working state of the control related to the application object is displayed in the display area of the first electronic device through movement of the operating body, so that a user can know the control currently in the available state through display of the first electronic device, if the control related to screen projection is in the available state, the user can determine that the first electronic device can be triggered currently to perform screen projection, and therefore the operation of the user in the first electronic device is assisted by combining with the change of the working state of the control displayed in the display area of the first electronic device, and the selected operation is released when the fact that the first electronic device can perform screen projection is determined.

Referring to fig. 9, a further screen projection processing method provided by the embodiment of the application may include the following steps:

401. a call operation for the first electronic device is obtained.

402. And in response to the calling operation, calling a task manager of the first electronic device, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic device.

403. And determining a first application object from the plurality of application objects, so that the first application object is designated through a selection operation in the screen projection operation process.

404. And synchronizing the first display content of the real-time display of the first application object in the running state to the display area of the second electronic device for display.

405. A second application object is determined from the plurality of application objects. In the process of displaying the first display content in the display area of the second electronic device, the first electronic device may still continuously determine a second application object capable of performing screen projection from the plurality of application objects, where the second application object is different from the first application object, a manner of determining the second application object may refer to a manner of determining the first application object, and a manner of determining the second application object may be the same as or different from a manner of determining the first application object, which is not described in this embodiment.

406. And synchronizing at least the second display content of the real-time display of the second application object in the running state to the display area of the second electronic equipment for display, so as to screen at least the second display content of the second application object to the display area of the second electronic equipment for display.

One way in which the second display content is synchronized to the display of the display area of the second electronic device is: the first display content is synchronized to a first display area display in the display area of the second electronic device, and the second display content is synchronized to a second display area display in the display area of the second electronic device, so that the first display content and the second display content can be displayed simultaneously in the display area of the second electronic device. The first display area and the second display area may be two independent areas in the display area of the second electronic device, or the second display area is a display area of the second electronic device, the first display area is a partial area of the display area of the second electronic device, and the first display content and the second display content may be simultaneously displayed in the display area of the second electronic device in a picture-in-picture manner.

If the first display content and the second display content are displayed at the same time, the sound playing function of the second electronic device can be provided for one application object of the first application object and the second application object to use, for example, the sound playing function is provided for the second application object to use, so that audio mixing of the first application object and the second application object is prevented, and the output effect of the audio is prevented from being influenced.

Another way of synchronizing the second display content to the display area display of the second electronic device is: and replacing the first display content displayed in the display area of the second electronic device with the second display content, so that the content displayed in the display area of the second electronic device can be updated after another screen-throwing application object is determined.

After the first electronic device synchronizes the first display content of the first application object and the second display content of the second application object to the display area of the second electronic device, the first electronic device may mark the first application object and the second application object as a screen-projection locking state, where the screen-projection locking state is used to indicate that the display contents of the first application object and the second application object are displayed in the second electronic device, and the corresponding screen-projection processing method further includes: and if the first application object is selected from the plurality of application objects managed by the task manager, synchronizing the third display content of the real-time display of the first application object in the running state to the display area of the second electronic device for display.

That is, if the first application object in the plurality of application objects managed by the task manager is determined to be the application object to be screen-thrown currently, the content of the first application object is continuously displayed in the display area of the second electronic device, and the display content of the first application object changes with the operation of the first application object, and the third display content of the application object determined to be screen-thrown again to be the application object in the operation state and displayed in real time can be synchronized to the display area of the second electronic device, so that the content displayed by the second electronic device can synchronously change with the operation of the first application object in the first electronic device.

In this embodiment, the first application object and the second application object may also be controlled by other manners, where one possible manner is: if the second display content of the second application object in real time in the running state is synchronized to the display area of the second electronic device for display, the first application object is controlled to be in a state of prohibiting screen throwing, so that the first application object is pulled back in the process that the second application object is displayed in the second electronic device, the display area of the first display content of the first application object is controlled to be limited in the display area of the first electronic device, and therefore the state change of the application object can be controlled while the display content in the second electronic device is switched.

For the above-mentioned screen-throwing processing method, if the first display content of the first application object is synchronized to be displayed in the second electronic device, the screen-throwing processing method may further control the first application object to be maintained in a locked running state, where the locked running state indicates that the first application object is prohibited from being closed by the task manager in the process of synchronizing the first display content to the second electronic device, that is, in the process of executing the object closing operation by the task manager, other application objects except the first application object in the plurality of application objects managed by the task manager are closed, and the first application object can still be in a running state.

Besides the task manager being able to close the application object in the first electronic device, the application object in the first electronic device may be closed by the antivirus software and the cleaning software in the first electronic device, and if the first application object is maintained in a locked running state, the antivirus software and the cleaning software in the first electronic device may still be in a running state during the execution of the antivirus and the cleaning, and the first application object is prohibited from being closed by other software.

If at least two application objects in the task manager can be on-screen, for example, at least two application objects are in an on-screen locking state, so that at least two application objects can be on-screen to the second electronic device at the same time or alternatively, at least two application objects which can be on-screen to the second electronic device can be in a locking running state, so that each application object on-screen to the second electronic device still remains in the running state when the first electronic device performs an object closing function (such as closing through the task manager).

Referring to fig. 10, a further screen projection processing method provided by the embodiment of the present application may include the following steps:

501. a call operation for the first electronic device is obtained.

502. And in response to the calling operation, calling a task manager of the first electronic device, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic device.

503. And determining a first application object from the plurality of application objects, so that the first application object is designated through a selection operation in the screen projection operation process.

504. And synchronizing the first display content of the real-time display of the first application object in the running state to the display area of the second electronic device for display.

505. A third application object is determined from the plurality of application objects in synchronizing the first display content to the display of the display area of the second electronic device.

In synchronizing the first display content to the second electronic device for display, the display area of the first electronic device may remain at the display interface of the task manager, and the display area of the first electronic device continues to display the plurality of application objects in the task manager.

In the process that the first electronic device continues to display the plurality of application objects, the operation of the operation body on the plurality of application objects can be obtained, a third application object is selected from the plurality of application objects, the selected third application object is displayed in the display area of the first electronic device, and the display of the third application object in the first electronic device does not influence the display in the second electronic device.

Wherein the operation of the operation body with respect to the plurality of application objects may be a selected operation, such as a click operation with respect to one of the plurality of application objects. Of course, the embodiment may also determine the third application object displayed in the display area of the first electronic device in other manners.

506. Displaying the fourth display content of the real-time display of the third application object in the running state in the display area of the first electronic device, and please refer to the description of the first display content for the description of the fourth display content of the real-time display of the third application object in the running state, which is not described herein.

Through the technical scheme, in the process of displaying the first display content in the second electronic device, the third application object can be still determined from the plurality of application objects, and the fourth display content which is displayed in real time and is in the running state of the third application object is displayed in the display area of the first electronic device, so that the task manager can serve as an entrance for displaying the content of the first electronic device and the second electronic device at the same time, and the first electronic device and the second electronic device can display different application objects independently of each other, and the mutual influence between the first electronic device and the second electronic device is avoided.

For the above-mentioned screen-throwing processing method, after the first display content of the first application object is synchronized to the second electronic device for display, the screen-throwing processing method may further set the first application object as the first object in the management queue of the task manager, so that the first object is displayed in the display area of the first electronic device after the task manager is invoked, and if the task manager is invoked again, the application object that is currently thrown to the second electronic device may be displayed in the first display area of the first electronic device.

If the first application object is changed from the screen-throwing first application object to the second application object and the first application object is in the screen-throwing locking state, the ordering of the first application object and the second application object in the management queue is adjusted, if the second application object is the first object in the management queue, the first application object is the second object in the management queue, and thus the application object in the screen-throwing locking state can be preferentially displayed.

That is, if the plurality of application objects in the first electronic device are in the screen-casting locked state, the plurality of application objects in the screen-casting locked state are arranged before other application objects, and the application object currently cast on the second electronic device is the first object in the management queue.

The above explanation describes that the screen of an application object in the task manager is displayed in the second electronic device, and besides the screen of the application object can be displayed in the second electronic device, the screen of the application object can be canceled, and the screen processing method shown in fig. 11 may further include, based on the screen processing method shown in fig. 1:

105. and obtaining the screen throwing canceling operation of the operation body aiming at the first application object.

106. And responding to the screen-throwing cancellation operation, and synchronizing the content currently displayed in the display area of the first electronic equipment to the display area of the second electronic equipment so as to replace the content displayed in the display area of the second electronic equipment through the screen-throwing cancellation operation, wherein the content displayed in the first electronic equipment and the content displayed in the second electronic equipment can be synchronized through the screen-throwing cancellation operation.

One way to obtain the operation body to cancel the screen throwing operation for the first application object is: obtaining a selection operation of the operation body aiming at the first application object, and moving the operation body to a second direction in the process of maintaining the selection operation; if the release selection operation is monitored during the movement in the second direction, the cancellation of the screen throwing operation is determined to be obtained.

The second direction is opposite to the first direction corresponding to the screen throwing operation, for example, the first direction corresponding to the screen throwing operation indicates downward, the second direction indicates upward, the first application object is selected from the monitoring of the selection operation to the dragging of the first application object to move to the second direction, then the selection operation is finished, the first electronic device is regarded as finishing one-time cancellation of the screen throwing operation, and for the first electronic device, the first electronic device monitors the down event, the move event and the move event in the directions of the second direction and the up event, and then the cancellation of the screen throwing operation is determined.

Another way to obtain the operation body to cancel the screen dropping operation for the first application object is: obtaining a selection operation of an operation body aiming at a first application object, and moving the operation body to a first direction in the process of maintaining the selection operation; displaying a plurality of controls associated with the first application object in a display area of the first electronic device moving a second distance in the first direction; controlling the working state of at least one control in the plurality of controls in the process of continuing to move from the position of the second distance to the first direction; and if the release selection operation is monitored in the moving process in the first direction and the control related to the screen throwing in the plurality of controls is in a disabled state, determining to acquire the screen throwing cancellation operation.

The second distance may be the same as or different from the first distance corresponding to the screen-throwing operation, and is different from the screen-throwing operation in that if the control related to the screen throwing is monitored to be in a disabled state in the process of moving in the first direction to release the selected operation, the screen-throwing operation is canceled, the first electronic device is instructed to synchronize the content currently displayed in the second electronic device, and the content displayed in the display area of the second electronic device is replaced, so that the content displayed in the first electronic device and the content displayed in the second electronic device are synchronized.

In addition, the above-mentioned operation of cancelling the screen may have other functions, for example, obtain the operation body to cancel the screen operation of cancelling the first application object; and responding to the screen-throwing cancellation operation, displaying the display content of the first application object in the display area of the first electronic device, switching the first application object to the first electronic device for continuous display by canceling the screen-throwing operation, enabling the first application object to continue to run in the first electronic device at the stage to which the second electronic device runs, ensuring that the first application object is smoothly switched between the first electronic device and the second electronic device for display, so that when the first application object is hoped to be switched to the first electronic device for display, the display of the first application object in the second electronic device does not need to be closed and the first application object does not need to be restarted, and the screen-throwing cancellation operation can enable the first application object to be seamlessly switched between the first electronic device and the second electronic device for display.

Referring to fig. 12, a flowchart of a control method provided by an embodiment of the present application may include the following steps:

601. a screen throwing operation for a first application object in a first electronic device is obtained.

The first application object is an application object selected by a user from the first electronic device, for example, the first application object may be an application object selected by a user from a plurality of application objects displayed on a desktop of the first electronic device, or the embodiment determines the first application object in the following manner:

obtaining a calling operation for the first electronic device; in response to the invoking operation, invoking a task manager of the first electronic device, and displaying a plurality of application objects managed by the task manager in a display area of the first electronic device; the first application object is determined from the plurality of application objects, and therefore, the task manager is taken as an entrance for expanding screen projection, one application object in the plurality of application objects managed by the task manager is determined as the first application object, and the screen projection operation is performed on the first application object, and the detailed process is described in the above embodiments and is not described herein.

602. And responding to the screen throwing operation, and synchronizing the first display content of the first application object to the display area of the second electronic equipment for display.

It will be appreciated that: the screen-throwing operation is used for indicating that the display area of the first display content of the first application object is the display area of the second electronic device, after the screen-throwing operation is obtained, the first display content of the first application object is triggered to be synchronized to the display area of the second electronic device for display, the first display content of the first application object can be the first display content of the first application object in real-time display in the running state, and the first display content in real-time display in the running state can be but is not limited to the content which can be displayed by the first electronic device at the current moment when the first application object is in the running state, so that the first application object can be ensured to be smoothly switched into the second electronic device when the first application object is displayed in the display area of the second electronic device, and the content which the first application object has been running in the first electronic device does not need to be repeatedly run in the second electronic device.

In this embodiment, the screen throwing operation may be a screen throwing operation of the operation body for the first application object, where the screen throwing operation may not only select the first application object but also trigger to synchronize the first display content of the first application object to the second electronic device, for example, the screen throwing operation may be the above-mentioned operation from monitoring the selection operation for the first application object to dragging the first application object to move in the first direction to the end of the selection operation, which is regarded as completing the screen throwing operation once, and other possible manners of the screen throwing operation are not described one by one in this embodiment.

603. The movable indicator is controlled to move in the display area of the second electronic device.

If the first display content of the first application object is synchronized to the display area of the second electronic device, the movable identification is synchronized with the first application object to the second electronic device so as to limit the movable identification from moving in the display area of the second electronic device. Since the movable indicator moves in the display area of the second electronic device, this means that the movable indicator is displayed in the display area of the second electronic device, meaning that if the first display content of the first application object is synchronized to the second electronic device, both the movement and the display of the movable indicator are limited to the display area of the second electronic device.

The movable identifier comprises, but is not limited to, an image such as a mouse pointer, a cursor and the like which can move along with the movement of the input component, the input component is connected to the first electronic device, for example, the input component can be a mouse, a keyboard and the like, the movement of the movable identifier on the second electronic device is controlled through the input component on the first electronic device, so that the control of the first application object displayed on the second electronic device through the first electronic device is realized, the control of the first application object and the update of the display content in the second electronic device are completed, and therefore, when the control of the first application object is needed, the first application object is not needed to be switched to the display of the first electronic device, and the display content of the first application object is not needed to be synchronized to the second electronic device through the screen throwing operation after the control is completed.

The input component may be connected to the first electronic device in a manner that is not limited to: the input component is connected to an expansion interface of the first electronic device, for example, the first electronic device is reserved with a type-c interface, the type-c interface is used as the expansion interface of the first electronic device, so that the first electronic device can be connected to a mouse, a keyboard and the like with the type-c interface, and different types of input components are connected to the first electronic device. Of course, besides the mouse and the keyboard, the first electronic device can also be connected with other hardware for the first electronic device through the expansion interface for use, and the form of the expansion interface reserved by the first electronic device is not limited to a type-c interface.

In the process of controlling a first application object on a second electronic device through a first electronic device, the first electronic device does not display the real-time display content of the first application object in an operation state in the control process, but transmits the real-time display content of the first application object in the operation state to the second electronic device for display in real time, that is, in the process of controlling the first application object, although the operation processing capacity corresponding to the control operation is integrated in the first electronic device, the first electronic device only processes the first application object based on the control operation, and the display content obtained after the processing is transmitted to the second electronic device for display and the display content obtained after the display processing of the first electronic device is forbidden.

In order to control the movable identifier to move in the display area of the second electronic device, the embodiment preferentially maps the movable identifier to the display area of the second electronic device when selecting the movable identifier to map the display area, so that the movable identifier can be controlled to move and display in the display area of the second electronic device in response to the screen throwing operation.

The screen of the first electronic device comprises a first type screen and a second type screen, the first type screen synchronizes the first display content of the real-time display of the first application object in the running state to the display area of the second electronic device for display, but the first electronic device can display the display content of the real-time display of other application objects in the running state, and the second type screen is the display content of the real-time display of the same application object in the running state.

For the two types of screen projection, if the screen projection operation triggers the first type of screen projection, the movable identifier is controlled to move in the display area of the second electronic device, the first application object is controlled by hardware such as an input part of the first electronic device, and meanwhile, if the first electronic device has a touch function, the first electronic device can control the application object displayed in the first electronic device through the touch operation, so that although the first electronic device and the second electronic device display different application objects, the two application objects can be independently controlled, the two application objects are mutually independent and cannot influence each other, as shown in fig. 13, the application object 1 is displayed in the second electronic device, the application object 2 is displayed in the first electronic device, the first electronic device is connected with a mouse through a reserved expansion interface, a mouse pointer is displayed and moves in the second electronic device, the display content of the application object 1 displayed in the second electronic device is controlled to change through the mouse pointer, and the display content of the application object 2 can be controlled to change through the finger touch function; if the screen-throwing operation triggers the second type screen throwing, the movable identifier is controlled to move in the display area of the first electronic device, the movement of the movable identifier is rendered into the display content corresponding to the first electronic device through the rendering function of the first electronic device, and then the second electronic device is synchronized to the second electronic device, so that the second electronic device also displays the movement of the movable identifier, and the display content of the first electronic device is ensured to be consistent with the display content of the second electronic device.

However, the computing processing capability is integrated in the first electronic device no matter the first type of screen projection or the second type of screen projection, that is, the processing of the application objects displayed in the first electronic device and the second electronic device is completed by the first electronic device, and the second electronic device has the display function.

According to the control method, after the screen throwing operation aiming at the first application object in the first electronic equipment is obtained, the screen throwing operation is responded, the first display content of the first application object is synchronized to the display area of the second electronic equipment for display, and the movable identifier is controlled to move in the display area of the second electronic equipment, so that the control operation such as sliding, clicking and the like can be carried out at least through the input component on the first electronic equipment to control the movable identifier, the control of the first application object displayed on the second electronic equipment through the first electronic equipment is realized, the control of the first application object and the update of the display content in the second electronic equipment are completed, and therefore, when the control of the first application object is needed, the first application object is not needed to be switched to the first electronic equipment for display, and the display content of the first application object is not needed to be synchronized to the second electronic equipment through the screen throwing operation again after the control is completed.

In this embodiment, the movement of the movable identifier in the display area of the second electronic device may be controlled by an input component, where the input component belongs to the first electronic device, so that, to control the movement of the movable identifier, the control method provided in this embodiment further includes: obtaining first movement data of an input component corresponding to a movable identifier in first electronic equipment; second movement data of the input part in the second electronic device is calculated based on the first movement data.

The first movement data is movement data generated by an input component in the first electronic device under the action of a user, such as the movement distance of a mouse under the action of the user, and the movement of the movable identifier in the display area of the second electronic device is also different under the condition that the input component generates different first movement data. However, the first movement data cannot be directly used as movement data of the movable identifier, and the second movement data of the input component in the second electronic device needs to be calculated based on the first movement data, for example, the first movement data is mapped to a coordinate system of the second electronic device to which the display area of the second electronic device belongs based on the coordinate system of the first movement data and the display area of the second electronic device, so as to obtain the second movement data of the input component in the second electronic device, and then the movable identifier is controlled to move in the display area of the second electronic device based on the second movement data.

The second movement data indicates at least a movement direction and a movement distance of the input part in the second electronic device, and the movement of the movable flag can be controlled based on the movement direction and the movement distance indicated by the second movement data, and the specific procedure will not be described in detail in this embodiment.

Referring to fig. 14, a flowchart of another control method provided by the embodiment of the present application is shown, and the method may further include the following steps based on fig. 12:

604. control operations for a first application object displayed by the second electronic device are obtained. The control operation for the first application object may be, but is not limited to, a control operation performed by an input unit of the first electronic device, such as a control operation capable of changing a display of the second electronic device by clicking, sliding, inputting, or the like, which is performed by the input unit, and the control operation may be one control operation obtained by combining a series of actions or one control operation obtained by a single action, and the type of the control operation is not limited in this embodiment.

605. And processing the first application object based on the control operation to obtain the display content of the real-time display of the first application object in the running state. The processing of the first application object may be different when the control operation is different, for example, the sliding operation first electronic device determines the content pointed by the sliding operation, the target content pointed by the sliding operation is the display content of real-time display of the running state of the first application object obtained after the processing, and the detailed process of processing the first application object based on the control operation is not described here, but the point to be noted is that: the control operation is obtained by monitoring the first electronic equipment, and the first application object is processed based on the control operation and is executed by the first electronic equipment, but the first electronic equipment does not display the real-time display content of the running state of the first application object obtained after the processing, and the display area of the first electronic equipment can display the real-time display content of the running state of the other application object, so that the first electronic equipment and the second electronic equipment display different application objects, and the display content of at least two application objects in the first electronic equipment can be respectively displayed in different electronic equipment.

606. And synchronizing the display content to the display area of the second electronic device for display so as to update the content displayed by the second electronic device. The first electronic equipment transmits the display content obtained after the control operation processing to the second electronic equipment in real time, and the second electronic equipment displays the display content, so that the display content in the second electronic equipment can change along with the control operation, and an instant visual feeling is brought to a user.

For example, the first application object is a game application, the second electronic device can display game scenes of the game application, such as a monster scene, a commodity auction scene, a chat scene and the like in the game application, the first electronic device can control the game scenes for any game scene, such as a monster/fight process by controlling a user role in the game application through a mouse and a keyboard of the first electronic device, and the second electronic device can synchronously display the monster/fight process, so that a user is given a feeling of operating the monster/fight process in the second electronic device.

In the process of displaying the related content of the first application object by the second electronic device, the first electronic device may display another application object and control the other application object, and the corresponding control method provided in this embodiment may further include the following steps:

Displaying an application object in a display area of the first electronic device while maintaining the display of the first application object in the display area of the second electronic device; obtaining a control operation for an application object; processing the application object based on control operation aiming at the application object to obtain display content of real-time display of the application object in an operation state; the display content is displayed in a display area of the first electronic device, and the content displayed in the display area of the second electronic device remains unchanged.

In the process of maintaining the first application to be displayed in the display area of the second electronic device, the first electronic device can independently display another application object and independently control the other application object, the display of the second electronic device is not affected, and the purpose that the two application objects are simultaneously displayed in different electronic devices is achieved.

For the foregoing method embodiments, for simplicity of explanation, the methodologies are shown as a series of acts, but one of ordinary skill in the art will appreciate that the present application is not limited by the order of acts, as some steps may, in accordance with the present application, occur in other orders or concurrently. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required for the present application.

Corresponding to the above control method, the embodiment of the present application further provides a control device, whose structural schematic diagram is shown in fig. 15, which may include: the obtaining unit 10, the responding unit 20 and the control unit 30.

An obtaining unit 10 is configured to obtain a screen projecting operation for a first application object in the first electronic device.

the obtaining unit obtains a calling operation for the first electronic equipment; the response unit responds to the calling operation and calls a task manager of the first electronic equipment, and a plurality of application objects managed by the task manager are displayed in a display area of the first electronic equipment; the determining unit in the control device is configured to determine the first application object from the plurality of application objects, thereby determining one application object from the plurality of application objects managed by the task manager as the first application object by using the task manager as an extended screen-throwing portal, and performing a screen-throwing operation on the first application object, where detailed procedures of the determining unit are described in the above embodiments and will not be described herein.

And the response unit 20 is used for responding to the screen throwing operation and synchronizing the first display content of the first application object to the display area of the second electronic device for display.

In this embodiment, the screen-throwing operation may be a screen-throwing operation of the operation body for the first application object, where the screen-throwing operation may not only select the first application object but also trigger to synchronize the first display content of the first application object to the second electronic device, for example, the screen-throwing operation may be the above-mentioned operation from the monitoring of the selection operation for the first application object to the dragging of the first application object to the first direction to the end of the selection operation, and is regarded as completing the screen-throwing operation once, and other possible manners of the screen-throwing operation are not described in this embodiment.

And a control unit 30 for controlling the movable flag to move in the display area of the second electronic device. If the first display content of the first application object is synchronized to the display area of the second electronic device, the movable identification is synchronized with the first application object to the second electronic device so as to limit the movable identification from moving in the display area of the second electronic device. Since the movable indicator moves in the display area of the second electronic device, this means that the movable indicator is displayed in the display area of the second electronic device, meaning that if the first display content of the first application object is synchronized to the second electronic device, both the movement and the display of the movable indicator are limited to the display area of the second electronic device.

In order to control the movable identifier to move in the display area of the second electronic device, the embodiment preferentially maps the movable identifier to the display area of the second electronic device when selecting the movable identifier to map the display area, so that the movable identifier can be controlled to move and display in the display area of the second electronic device in response to the screen throwing operation. The screen of the first electronic device includes a first type screen and a second type screen, and the two types of screen display modes and the control of the movable identifier are different, specifically please refer to the above method embodiment. However, the computing processing capability is integrated in the first electronic device no matter the first type of screen projection or the second type of screen projection, that is, the processing of the application objects displayed in the first electronic device and the second electronic device is completed by the first electronic device, and the second electronic device has the display function, for example, the second electronic device is a display.

After the screen throwing operation aiming at the first application object in the first electronic equipment is obtained, the control device responds to the screen throwing operation, the first display content of the first application object is synchronized to the display area of the second electronic equipment for display, and the movable identifier is controlled to move in the display area of the second electronic equipment, so that the control operation such as sliding, clicking and the like can be carried out at least through the input component on the first electronic equipment to control the movable identifier, the control of the first application object displayed on the second electronic equipment through the first electronic equipment is realized, the control of the first application object and the update of the display content in the second electronic equipment are completed, and therefore, when the control of the first application object is needed, the first application object is not needed to be switched to the first electronic equipment for display, and the display content of the first application object is not needed to be synchronized to the second electronic equipment through the screen throwing operation again after the control is completed.

In this embodiment the movement of the movable identity in the display area of the second electronic device may be controlled by an input means belonging to the first electronic device, whereby the obtaining unit 10 is further arranged to obtain first movement data of the input means of the first electronic device corresponding to the movable identity for controlling the movement of the movable identity. And the calculating unit in the control device is used for calculating second movement data of the input part in the second electronic device based on the first movement data, for example, the first movement data is mapped to the coordinate system of the display area of the second electronic device based on the coordinate system of the first movement data and the display area of the second electronic device, so as to obtain the second movement data of the input part in the second electronic device. The corresponding control unit 30 controls the movable identification to move in the display area of the second electronic device based on the second movement data.

The second movement data indicates at least a movement direction and a movement distance of the input part in the second electronic device, and the control unit 30 may control the movement of the movable flag based on the movement direction and the movement distance indicated by the second movement data, and the specific procedure will not be described in this embodiment.

The obtaining unit 10 is further configured to obtain a control operation for the first application object displayed by the second electronic device, where the control operation is used to instruct processing of the first application object, and the processing may be completed by a processing unit in the control device, and the processing unit is configured to process the first application object based on the control operation, so as to obtain display content of real-time display where the first application object is in an running state.

The processing of the first application object may be different when the control operation is different, for example, the sliding operation first electronic device determines the content pointed by the sliding operation, the target content pointed by the sliding operation is the display content of real-time display of the running state of the first application object obtained after the processing, and the detailed process of processing the first application object based on the control operation is not described here, but the point to be noted is that: the control operation is obtained by monitoring the first electronic equipment, and the first application object is processed based on the control operation and is executed by the first electronic equipment, but the first electronic equipment does not display the real-time display content of the running state of the first application object obtained after the processing, and the display area of the first electronic equipment can display the real-time display content of the running state of the other application object, so that the first electronic equipment and the second electronic equipment display different application objects, and the display content of at least two application objects in the first electronic equipment can be respectively displayed in different electronic equipment.

And after the processing unit processes the first application object, the obtained display content of the first application object in the running state, which is displayed in real time, is synchronized to the display area of the second electronic device by the response unit to be displayed so as to update the content displayed by the second electronic device.

In the process of displaying the related content of the first application object by the second electronic device, the control device may further control the first electronic device to display another application object and control the other application object, and the corresponding control device provided in this embodiment may further include:

the display unit is used for displaying an application object in the display area of the first electronic device in the process of maintaining the display of the first application object in the display area of the second electronic device; an obtaining unit that is further configured to obtain a control operation for the application object; the processing unit is used for processing the application object based on the control operation aiming at the application object to obtain the display content of real-time display of the application object in the running state; and the display unit is also used for displaying the display content in the display area of the first electronic device, and the content displayed in the display area of the second electronic device is kept unchanged.

The embodiment of the application also provides electronic equipment, which comprises a processor and a communication module; the processor is used for obtaining a screen projection operation aiming at a first application object in the first electronic equipment; responding to the screen throwing operation, and synchronizing the first display content of the first application object to the display area of the second electronic equipment for display through the communication module; the movable indicator is controlled to move in the display area of the second electronic device.

The communication module includes, but is not limited to, a wired communication module and a wireless communication module, by which the electronic device and the other electronic device can be connected through at least one of a wired connection mode and a wireless connection mode, such as through a DP line or HDMI connection, and for example, the electronic device and the other electronic device are connected to the same local area network. Because the stability of the wired connection mode is better than that of the wireless connection mode, the electronic equipment and the other electronic equipment can be connected in a wired connection mode, and if the electronic equipment and the other electronic equipment are connected in a wired mode and a wireless mode at the same time, the electronic equipment and the other electronic equipment can be transmitted in a wired mode.

The relationship of an electronic device to another electronic device may be, but is not limited to: the display area of the other electronic device is larger than that of the electronic device, so that the display content of the application object needing to use the larger display area can be projected to the display area of the other electronic device. In addition, the other electronic device may be an electronic device with a display function and no computing capability, for example, the other electronic device may be a display or the like, the other electronic device is not provided with an input component such as a mouse and a keyboard, the other electronic device is controlled by the input component of the electronic device, the computing or the like required for the control is processed by the electronic device, and the content displayed in real time after the processing of the electronic device is transmitted to the other electronic device for display.

The embodiment of the application also provides a storage medium, and the storage medium is stored with computer program codes which realize the screen projection processing method and/or the control method when running.

It should be noted that, each embodiment in the present specification may be described in a progressive manner, and features described in each embodiment in the present specification may be replaced or combined with each other, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are referred to each other. For the apparatus class embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference is made to the description of the method embodiments for relevant points.

Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application, which are intended to be comprehended within the scope of the present application.

Claims

1. A control method, comprising:

when the input component is connected to the first electronic device, mapping the movable identifier to a display area of the second electronic device, limiting movement and display of the movable identifier to the display area of the second electronic device, and controlling the movable identifier to move in the display area of the second electronic device so as to realize control of a first application object displayed on the second electronic device and update of first display content; the movable identifier comprises a mouse pointer or a mouse cursor.

2. The method of claim 1, further comprising:

3. The method of claim 1, further comprising:

4. The method of claim 1, further comprising: displaying an application object in a display area of the first electronic device in the process of maintaining the display of the first application object in the display area of the second electronic device;

obtaining a control operation for the application object;

5. The method of claim 1, further comprising:

obtaining a calling operation for the first electronic device;

6. A control apparatus comprising:

the control unit is used for mapping the movable identifier to the display area of the second electronic device when the input component is connected to the first electronic device, limiting the movement and display of the movable identifier to the display area of the second electronic device, and controlling the movable identifier to move in the display area of the second electronic device so as to realize the control of a first application object displayed on the second electronic device and the update of first display content; the movable identifier comprises a mouse pointer or a mouse cursor.

7. The apparatus of claim 6, the obtaining unit further configured to obtain first movement data of an input component of the first electronic device corresponding to the movable identifier;

8. The apparatus of claim 6, the obtaining unit further configured to obtain a control operation for a first application object displayed by the second electronic device;

9. The apparatus of claim 6, the obtaining unit further configured to obtain a call operation for a first electronic device;

10. The apparatus of claim 6, the second electronic device being a display.