CN113721808A

CN113721808A - Control method and device

Info

Publication number: CN113721808A
Application number: CN202111013473.1A
Authority: CN
Inventors: 方宝彤; 李翔
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2021-08-31
Filing date: 2021-08-31
Publication date: 2021-11-30

Abstract

The application discloses a control method and a control device, which comprise the following steps: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an extended screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extended screen to a target screen based on the target window, the target object is displayed on the target screen, which is a different screen from a screen to which the target object belongs before being moved. The target object can be rapidly moved to different display screens for displaying through the target window, so that the object can be moved on different screens more conveniently and accurately.

Description

Control method and device

Technical Field

The present application relates to the field of information processing technologies, and in particular, to a control method and apparatus.

Background

With the continuous development of electronic technology, current electronic devices generally have an external display screen, or obtain the function of an extended display screen through AR (Augmented Reality) technology projection. The multi-screen expansion can realize that the content is released to a plurality of different screens for displaying, and provides rich interactive experience for users.

When a file or other application object in one of the screens needs to be moved to the corresponding extended screen for displaying, the file needs to be moved by a mouse to pass through the edge of the main screen to the extended screen. This just needs to make clear the border position of main screen, and if border position is not obvious for the virtual expanded screen of AR, can appear the inaccurate problem of removing the file again of operation, is not convenient for remove the file to the expanded screen and demonstrate.

Disclosure of Invention

In view of the above, the present application provides a control method and apparatus, as follows:

a control method, comprising:

obtaining a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an extended screen of the electronic equipment;

in response to an operation of moving a target object in the main screen or the extended screen to a target screen based on the target window, displaying the target object on the target screen, the target screen being a different screen from a screen to which the target object belongs before being moved.

Optionally, the obtaining the trigger instruction includes at least one of:

detecting a trigger operation acting on a target key or a target control, and determining to obtain the trigger instruction;

or the like, or, alternatively,

detecting that at least one extended screen is connected or disconnected, and determining to obtain the trigger instruction; or the like, or, alternatively,

detecting that the electronic equipment is switched from a current operation mode to a target operation mode, and determining to obtain the trigger instruction; or the like, or, alternatively,

detecting that the electronic equipment is accessed to a target network, and determining to obtain the trigger instruction; or the like, or, alternatively,

detecting that the electronic equipment starts a target process, and determining to obtain the trigger instruction; or the like, or, alternatively,

detecting to obtain a screen management request, and determining to obtain the trigger instruction; or the like, or, alternatively,

and determining to obtain the trigger instruction when the movement track of the target object is detected to accord with the preset condition.

Optionally, wherein the displaying the target window on the display screen of the electronic device includes:

displaying a first target window on a main screen and/or an extended screen of an electronic device, wherein identifications corresponding to the main screen and the extended screen are displayed in the first target window; or the like, or, alternatively,

displaying a second target window on a main screen of the electronic equipment, and displaying a third target window on an extended screen of the electronic equipment, wherein the second target window at least does not display an identifier corresponding to a screen where the second target window is located, and the third target window at least does not display an identifier corresponding to a screen where the third target window is located; or the like, or, alternatively,

acquiring attribute information of the trigger instruction, and displaying a corresponding target window on a display screen of the electronic equipment at least based on the attribute information; or the like, or, alternatively,

obtaining the use information of the electronic equipment, and displaying a corresponding target window on a display screen of the electronic equipment at least based on the use information.

Optionally, wherein the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window comprises:

moving the target object in the main screen or the extended screen to a target position in the target window, wherein the target position is an area where a target identifier corresponding to the target screen is located; or the like, or, alternatively,

moving a screen identifier corresponding to a screen to which the target object belongs to a target position in the target window, wherein the target position is an area where the target identifier corresponding to the target screen is located; or the like, or, alternatively,

moving a target identifier corresponding to the target screen in the target window to the position of the target object; or the like, or, alternatively,

and inputting the mark information corresponding to the target object in the main screen or the extended screen to a target position in the target window, wherein the target position is an area where a target mark corresponding to the target screen is located.

Optionally, wherein the displaying the target object on the target screen in response to the operation of moving the target object in the main screen or the extended screen to the target position in the target window comprises:

acquiring the editing state information of the target window;

if the target window is not editable, monitoring first coordinate information of a first operation for moving the target object, and if the first coordinate information is matched with the target position, displaying the target object on the target screen; and/or the presence of a gas in the atmosphere,

and if the target window is editable, monitoring whether the operation of moving the target object comprises a second operation at the target position, and if the second operation is included, displaying the target object on the target screen.

Optionally, wherein the displaying the target object on the target screen comprises:

in response to an operation of moving or inputting a first identifier corresponding to a first screen in the display screens to a target position in the target window, displaying a target object determined from the first screen on the target screen, wherein the target position is an area where the target identifier corresponding to the target screen is located, and the first screen is any one of the main screen and the extended screen; or the like, or, alternatively,

and in response to the operation of modifying the identification of the target object of the main screen or the extended screen into the identification of the target corresponding to the target screen, displaying the target object on the target screen.

Optionally, wherein determining a target object from the first screen comprises:

determining an application window at the forefront end of a current display screen in the first screen as the target object; or the like, or, alternatively,

determining an object in the first screen, which has a first association relation with an application window displayed at the forefront of the screen in the target screen, as the target object; or the like, or, alternatively,

determining an object with a moving track meeting a preset condition in the first screen as the target object; or the like, or, alternatively,

and determining an object capable of realizing a first preset function in the first screen as a target object.

acquiring the operation of moving a target object based on the target window;

analyzing the operation to obtain a target area of the target object moving to the target window;

detecting the screen content corresponding to the target area;

and if the screen content corresponding to the target area is not matched with the screen content of the screen to which the target object belongs before being moved, determining the operation as the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window.

Optionally, the displaying the target object on the target screen includes:

acquiring at least one of first position information of the target object in the target window corresponding to the region of the target screen, second position information of the target window in the display screen, or third position information of the region of the target screen in the target window;

acquiring screen size ratio information of the display screen and the target screen;

determining a target display position based on at least one of the first position information, the second position information, the third position information and the screen size ratio information;

and displaying the target object at a target display position of the target screen.

A control device, comprising:

the device comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring a trigger instruction and displaying a target window on a display screen of the electronic equipment, and the display screen comprises a main screen and/or an extended screen of the electronic equipment;

a display unit configured to display a target object in the main screen or the extended screen on a target screen, which is a screen different from a screen to which the target object belongs before being moved, in response to an operation of moving the target object to the target screen based on the target window.

An electronic device comprising a memory and a processor;

the memory is used for storing an application program and data generated by the operation of the application program;

the processor is configured to execute the application program to implement:

A storage medium having stored thereon computer program code which, when executed by a processor, implements a control method as described in any one of the above.

As can be seen from the above technical solutions, a control method and apparatus disclosed in the present application include: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an extended screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extended screen to a target screen based on the target window, the target object is displayed on the target screen, which is a different screen from a screen to which the target object belongs before being moved. The target object can be rapidly moved to different display screens for displaying through the target window, so that the object can be moved on different screens more conveniently and accurately.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application;

fig. 2 is a schematic flowchart of a control method according to an embodiment of the present application;

FIG. 3 is a diagram illustrating a target window display according to an embodiment of the present disclosure;

fig. 4 is a schematic view of an application scenario based on a screen management window according to an embodiment of the present application;

fig. 5 is a schematic view of an application scenario based on a shortcut window according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a control device according to a second embodiment of the present application;

fig. 7 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

A control method provided in an embodiment of the present application is applied to an information processing scenario with multiple display screens, as shown in fig. 1, where fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application. The electronic device 100 itself has a display screen 101, the display screen 101 may be used as a main screen, in order to facilitate display of information, the electronic device 100 is further connected with an extended screen 102, an extended screen 103, and an extended screen 104, and correspondingly, the main screen and the extended screen may display the same information or different information, and an object in the current main screen and/or the extended screen may be moved to another screen for display or storage, it should be noted that the extended screen may be connected with the electronic device 100 by a wire or wirelessly, and the extended screen may be a virtual screen displayed based on screen projection processing. In order to facilitate the movement of objects in different screens, an embodiment of the present application provides a control method, see fig. 2, which is a schematic flow diagram of the control method provided in the embodiment of the present application.

Specifically, the control method may include the steps of:

s201, obtaining a trigger instruction, and displaying a target window on a display screen of the electronic equipment.

As shown in fig. 2, the display screen includes a main screen and/or an extended screen of the electronic device. The trigger instruction is an instruction for displaying a target window on a display screen of the electronic device. The instruction may be determined based on the operation information, for example, an instruction to operate a shortcut key for displaying the target window, or an instruction to select menu information for displaying the target window. The trigger command may be a command that is automatically triggered based on the detected state of the electronic device, and if it is detected that the electronic device is connected to a plurality of display screens, the trigger command may be automatically generated, or the display content of the main screen of the electronic device may be detected, and if it is detected that there are many display objects, the trigger command may be automatically generated.

The implementation of the present application may include various ways to determine the trigger instruction, which will be described in detail in the following examples, and will not be described in detail here.

After the trigger instruction is obtained, the target window may be displayed on a display screen of the electronic device, where the display screen may be a main screen or an extended screen, and may also be all screens corresponding to the electronic device, that is, the main screen and the extended screen are included. Therefore, the target window may be located on any display screen of the electronic device, may be located on all display screens, may also be located on a part of the display screens, and may determine the display screen displayed by the target window based on the actual application scene and the display requirement. The target window may be a window including a corresponding identifier for each display screen, or may be a window including only a corresponding identifier for an extended screen, or may be a window including a corresponding identifier for a portion of display screens, where the identifier may be an image representing a screen, or may be a shortcut window representing a screen, or may be a target area representing a screen, or the like. Correspondingly, the target window can be in a specific state, for example, the target window can only identify a specific instruction, the position of the target window is fixed, and the target window cannot be edited; the target window can be in an editable state, for example, the information of the response form, size, position and the like of the target window can be edited.

S202, in response to the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window, the target object is displayed on the target screen.

The target object is an object located in the main screen or the extended screen, and may be an object in any format, for example, a text document, a picture, an application, an object displayed in a full screen form, an object displayed in an unopened icon, a minimized object, or an object displayed in a window form. That is, in the embodiment of the present application, the moving operation can be realized regardless of the state of the object. The target object may be an object in the home screen, i.e., the object in the home screen may be moved to the at least one extended screen for display. The target object may also be an object in the extended screen, i.e., the object in the extended screen may be moved to a different extended screen and/or the main screen.

It should be noted that, in the embodiment of the present application, the movement of the target object is implemented based on the target window, that is, the movement of the object is not performed after the edges of the main screen and/or the extended screen are identified. The target window may include a mark and/or a region corresponding to each display screen. Taking the example that the target window is displayed on the main screen and the target window includes the window area corresponding to each extended screen, if the object a on the main screen is moved to the window area corresponding to the extended screen 1 in the target window displayed on the main screen, the object a will be displayed on the extended screen 1. Of course, the target screen to be moved finally may also be determined based on the attributes of different objects, the contents of different target windows, and the trigger condition, which will be described in the following embodiments of the present application one by one, and will not be described in detail here.

The embodiment of the application discloses a control method, which comprises the following steps: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an extended screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extended screen to a target screen based on the target window, the target object is displayed on the target screen, which is a different screen from a screen to which the target object belongs before being moved. The target object can be rapidly moved to different display screens for displaying through the target window, so that the object can be moved on different screens more conveniently and accurately.

In the embodiment of the application, the target window is displayed on the display screen of the electronic equipment based on the triggering instruction. Wherein, obtaining the trigger instruction comprises at least one of the following:

and in the first mode, the triggering instruction is determined to be obtained when the triggering operation acting on the target key or the target control is detected.

In the first mode, the trigger instruction is obtained based on a trigger operation, where the trigger operation may be an operation received by a target key or a target control. The target key may be a physical key in the input device, such as a key in a keyboard, and the setting of the execution function corresponding to the target key is to trigger the display of the target window, and specifically, may be implemented by setting a shortcut key, for example, setting "Alt + Q" in the keyboard as the shortcut key for displaying the target window, and when a user presses the shortcut key, the corresponding trigger operation may be determined as a trigger instruction to trigger the display screen of the electronic device to display the target window. Correspondingly, the target key may also be a virtual key, such as a virtual key identifier displayed in the touch panel by projection, and when the user touches the corresponding target key, the corresponding trigger operation is determined as a trigger instruction. The control refers to encapsulation of data and a method, wherein a target control in the embodiment of the present application refers to encapsulation of a method for displaying a target window on a display screen of an electronic device, and specifically, the target control may be a user interface control including interface elements such as a window, a text box, a button, a pull-down menu, and the like.

And secondly, detecting the connection or disconnection of at least one extended screen, and determining to obtain the trigger instruction.

In the embodiment of the application, the electronic device has a main screen and an extended screen, wherein the main screen may be a display screen of the electronic device itself or a display screen connected to the electronic device and satisfying a specific condition. When the extended screen is detected to be accessed into the electronic equipment, an application matched with the extended screen is started, for example, identification information related to the extended screen is generated when the screen is identified. Therefore, when the extended screen is detected to be connected to the electronic device, the trigger instruction can be automatically generated, so that the connection of the extended screen can be recognized, and the display information corresponding to the connection can be generated, namely, the target window is displayed on the display screen of the target device. Similarly, when the disconnection of the extended screen is detected, it is determined that a trigger instruction is obtained, where the disconnection of the extended screen may be the disconnection of the extended screen from the control device itself, such as when the extended screen a is used as the display of the host a, and when the extended screen a is disconnected from the host a and connected to the host B, that is, used as the extended screen of the host B, the trigger instruction is also generated. Correspondingly, if the current host is connected with three extension screens, one of the three extension screens is disconnected from the current host, the trigger instruction is also generated, and the trigger instruction indicates that the display target window is an updated target window and is different from the target window corresponding to the three extension screens connected previously.

It should be noted that, in the embodiment of the present application, the connection manner between the extended screen and/or the main screen and the electronic device may be a wired connection or a wireless connection, where the wired connection may be a wired network connection, or an adaptive connection manner between the wired display and the host, and correspondingly, the wireless connection may be a wireless network connection, a bluetooth connection, and a wireless screen projection manner.

And thirdly, detecting that the electronic equipment is switched from the current operation mode to the target operation mode, and determining to obtain a trigger instruction.

The current operation mode refers to a normal operation mode of the electronic device, and the target operation mode can represent a mode in which the expansion screen needs to be started. For example, the current operation mode may be a display mode in which the electronic device displays information based on a main screen, and if the user starts an extended screen application, recognizing that the start instruction identifies a currently connected extended screen, and entering the extended screen display mode, generating a trigger instruction of a corresponding display target window. For another example, when the current all-in-one machine mode is switched to the display mode, a trigger instruction is obtained, and the display mode is a display mode for a plurality of screens. Or, the current information browsing mode is switched to the office mode, and a trigger instruction is obtained, so that a target window can be displayed on the display screen, and the application of the extended screen is started. Still alternatively, the trigger instruction is obtained by switching the operation mode of the main screen or the operation mode of the electronic device, for example, the electronic device switches from the current sleep mode to the normal operation mode, and the trigger instruction is determined to be obtained. For another example, the electronic device is a notebook computer, the main screen is a notebook display screen, and when it is detected that the notebook expansion state is switched to the box cover state, it can be recognized that other display screens may be started to display information, and it is determined that the trigger instruction is obtained.

And fourthly, detecting that the electronic equipment is accessed to the target network, and determining to obtain the trigger instruction.

The target network may be a network having a different attribute or state from the current network of the electronic device, or may be a network connected from a no-network state to a network state. If the electronic device is currently in the wired network connection mode, when the electronic device is switched to the wireless network connection mode, it can be determined that the trigger instruction is obtained. Or the electronic equipment is accessed to the target local area network from the non-networking state to complete the office task and determine to obtain the trigger instruction.

And fifthly, detecting that the electronic equipment starts a target process, and determining to obtain the trigger instruction.

The target process may be an application process related to screen processing or display processing, such as a screen management application, for example, an information multi-screen display application.

And sixthly, detecting and obtaining a screen management request, and determining to obtain the trigger instruction.

The screen management request refers to a request for managing the display screens of the current electronic device, for example, a request for displaying all the display screens of the electronic device, and after the request is recognized, it can be predicted that the related information of the main screen and/or the extended screen of the electronic device will be displayed later, so that the trigger instruction can be determined to be obtained after the request is detected. It should be noted that the screen management request may be a request generated by the user based on the electronic device, such as a request for invoking a screen management menu. Or a request sent by other terminals received by the electronic device, such as a remote screen management request.

And a seventh mode, determining to obtain the trigger instruction when the movement track of the target object is detected to meet the preset condition.

The target object is an object in a display screen of the electronic device, and can be an object on a main screen or an object in an extended screen, and the movement track of the target object refers to track information for moving the target object from an original position to a target position. The preset condition may be a line condition of the trajectory, or a condition of a predicted end region in the trajectory. Taking a preset condition as an example of a condition for predicting an end point region, identifying a moving track of a target object, obtaining the end point region corresponding to the moving track, presetting a requirement that the target object may be moved to other screens for displaying if the end point region is located in a boundary region of a current display screen, and determining to obtain a trigger instruction so as to display a target window on the display screen.

It should be noted that, in the embodiment of the present application, whether there is a need to generate a target window is comprehensively analyzed based on a current application scenario in combination with a state, a display need, access information, application process information, received or transmitted information, a network state, and the like of an electronic device, and if there is a need to generate a target window, it may be determined to obtain a trigger instruction, so that the target window is displayed on a display screen of the electronic device based on the trigger instruction. Therefore, the implementation requirements of the electronic equipment in any application scene are met.

After the trigger instruction is obtained, a target window is displayed on a display screen of the electronic device based on the trigger instruction, and correspondingly, in the embodiment of the present application, the target window is displayed on the display screen of the electronic device, which includes one or more of the following situations:

(1) and displaying the first target window on a main screen and/or an extended screen of the electronic device.

The first target window has displayed therein identifications corresponding to the main screen and the extended screen. In this manner, the first target window may be displayed on all display screens of the electronic device, such as the main screen and the extended screen, or may be displayed only on the main screen or only on the extended screen. The display content included in the first target window is an identifier corresponding to the main screen and the extended screen, that is, the first target window includes an identifier of each display screen of the electronic device. For example, if the main screen of the electronic device is identified as main screen 001 and the extended screen has three corresponding identifications of extended screen 002, extended screen 003 and extended screen 004, the content displayed in the first target window is main screen 001, extended screen 002, extended screen 003 and extended screen 004. The first target window may be a screen management window in an actual application scene, that is, a region corresponding to each screen is displayed.

(2) And displaying the second target window on a main screen of the electronic equipment, and displaying the third target window on an extended screen of the electronic equipment.

The second target window is at least the mark corresponding to the screen where the display is located, and the third target window is at least not displayed with the mark corresponding to the screen where the display is located. In the mode, corresponding target windows are respectively displayed on a main screen and an extension screen, namely a second target window is displayed on the main screen, a third target window is displayed on the extension screen, and the target windows displayed respectively do not include screen identifications corresponding to the target windows. For example, the second target window displayed in the main screen includes only the identifications corresponding to the respective extended screens.

(3) And acquiring attribute information of the trigger instruction, and displaying a corresponding target window on a display screen of the electronic equipment at least based on the attribute information.

In the embodiment, the target window is displayed by analyzing the trigger instruction and acquiring the corresponding attribute information, so that different target windows can be displayed based on different trigger instructions. The attribute information may include an application attribute of the current electronic device, a state attribute of the electronic device, a display screen attribute of the electronic device, and an information attribute to be displayed. For example, when the trigger instruction of the electronic device is generated based on the accessed extended screen, if it is detected that the extended screen newly accessed by the electronic device includes the extended screen 2 and the extended screen 3, a target window is displayed on the main screen, and the target window includes the corresponding identifiers of the extended screen 2 and the extended screen 3. For another example, if the resolution of the main screen is obtained through the attribute information, and the resolution of the information to be displayed is higher than that of the main screen, a target window is generated on the main screen, and the target window includes an identifier of an extended screen that meets the resolution requirement of the information to be displayed.

(4) And obtaining the use information of the electronic equipment, and displaying a corresponding target window on a display screen of the electronic equipment at least based on the use information.

The usage information of the electronic device includes information of multiple dimensions, such as an operation state dimension, a usage parameter dimension, and a usage object dimension, which may specifically include, but is not limited to, operation information, usage object information, a usage duration, a usage frequency, historical usage data, a historical calling application, and the like of the electronic device. If the electronic equipment is recognized to comprise a plurality of using objects, the biological feature recognition is carried out on the current using object to determine the identification information of the current using object, then the extended screen frequently applied by the current using object is determined based on the identification information of the current using object, and therefore the target window displayed in the display screen of the electronic equipment comprises the identification of the extended screen frequently applied by the object. For another example, the operation information of the electronic device is acquired, the extended screen with high information transmission efficiency of the electronic device can be determined by analyzing the operation information, and then the identifier corresponding to the extended screen is displayed in the target window.

In the embodiment of the application, the content or the display form of the corresponding target window displayed in the display screen is determined based on the screen information of the electronic device, the attribute information of the trigger instruction, the use information of the electronic device and the like, so that the displayed target window can be automatically matched with different processing requirements, and the user experience effect is improved.

Based on the foregoing embodiments, in the embodiments of the present application, the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window includes at least one of the following manners:

the first mode is an operation of moving a target object in a main screen or an extended screen to a target position in a target window.

And the target position is an area where the target mark of the corresponding target screen is located. Referring to fig. 3, a schematic diagram of a target window display provided in an embodiment of the present application is shown, where the target window is displayed on a main screen of an electronic device, and the main screen is identified as a main screen 001. The electronic device comprises two extended screens, wherein the corresponding identifications of the two extended screens are an extended screen 002 and an extended screen 003, and then corresponding areas comprising different identification information are displayed in the target window, if the identification information corresponding to the area 1 is a main screen 001, the identification information corresponding to the area 2 is an extended screen 002, and the identification information comprising the area 3 is an extended screen 003. When the target object moves to different areas of the target window, the target object is displayed on a corresponding screen. For example, when the target object is dragged to the area 2 of the target window, the target object is displayed on the expansion screen 2.

If the position dragged by the target object does not belong to any one of the areas, the target object belongs to invalid operation and cannot be displayed on any display screen. And only when the target object moves to the position in the area range, the target object can be displayed on the display screen corresponding to the area. For example, if the target object needs to be displayed on the extended screen 003, the target object is moved to the area 3 of the target window.

And secondly, moving the screen identifier corresponding to the screen to which the target object belongs to the target window to the target position.

In this manner, the target position is the area where the target mark of the corresponding target screen is located. Still taking fig. 3 as an example, if the target object on the home screen is moved to the extended screen 002 to be displayed, after the target object is selected, the identifier of the home screen in the target window may be moved to the area 2 corresponding to the extended screen 002, thereby completing the moving operation, so that the target object can be displayed on the extended screen 002.

And thirdly, moving the target identifier corresponding to the target screen in the target window to the position of the target object.

In this embodiment, the target object may not be moved, but the identification of the corresponding target screen may be moved. For example, if the target window is displayed on the main screen and the target object in the main screen needs to be displayed on the extended screen, the identifier corresponding to the extended screen in the target window may be moved to the position of the target object in the main screen, so that the target object is displayed on the extended screen.

And fourthly, inputting the mark information corresponding to the target object in the main screen or the extended screen into the target position in the target window.

The target position is an area where a target mark corresponding to the target screen is located, wherein the mark information may be a name mark of the target object, may also be a coordinate mark of the target object, and may be number information of the target object, and the like. In this embodiment, the target object realized based on the information input operation is displayed in a different display screen. If it is necessary to display a target object of the extended screen, the name of which is identified as document a, in the main screen, then "document a" may be input in an area corresponding to the main screen in the target window of the extended screen in which the target object is located, thereby causing the target object to be displayed on the main screen.

In the embodiment of the application, different moving operations aiming at the target object can be realized based on the target window to meet the requirement that the target object is displayed on different display screens, and only the related operations aiming at the target window are carried out without carrying out operation across the edge of the screen, so that the operation is more convenient and faster.

Based on the foregoing embodiments, the displaying a target object on a target screen in response to an operation of moving the target object in a main screen or an extended screen to a target position in a target window in the embodiments of the present application includes:

acquiring editing state information of a target window;

if the target window can not be edited, monitoring first coordinate information of a first operation of the moving target object, and if the first coordinate information is matched with the target position, displaying the target object on a target screen; and/or the presence of a gas in the atmosphere,

and if the target window is editable, monitoring whether the operation of moving the target object comprises a second operation at the target position, and if the second operation is included, displaying the target object on a target screen.

In this embodiment, it is necessary to determine whether or not the target object can be displayed on the target screen based on the edit status information of the target window. By identifying the editing state information, whether the target window can be edited or not can be obtained, wherein if the target window can be edited, the target window can receive a corresponding operation instruction and respond to the operation instruction, and the essence is that a response mode of the target window can be set, for example, a corresponding area of the target window is activated by clicking, or corresponding menu information can be displayed by a right key.

If the target window is not editable, first coordinate information of a first operation of moving the target object is monitored, and the target object can be displayed on the target screen only if the first coordinate information is matched with the target position. The first coordinate information may be end point information reached by the moving target object. For example, the target object is moved to an area corresponding to a second extended screen in the target window and then stopped, the obtained first coordinate information is matched with an effective identification area corresponding to the second extended screen, and the target object is moved to the second extended screen. If the target object is moved to the edge area corresponding to the second extended screen, the obtained first coordinate information is not matched with the effective identification area corresponding to the second extended screen, and the target object cannot be moved to the second extended screen for displaying.

If the target window is editable, it is necessary to monitor whether a second operation on the target position is included in the operations on the target object, where the second operation is a determination operation on the currently moved target position, so that it is possible to determine that the target object is moved to the target position. The corresponding operation may be an operation of clicking to confirm, or an operation of calling the corresponding display menu based on the second operation and selecting information in the display menu. For example, after the target object is dragged to the target position and is determined by double-clicking the right key, the target object is displayed on the display screen corresponding to the target position. Or the target object can be selected, such as copying the target object, and the paste option is selected by right clicking at the target position, so that the target object is displayed on the target screen.

It should be noted that the state of the target window may be switched in different application scenarios, for example, in some application scenarios, to avoid misoperation, the target window may be set to be in an editable state, and in a scenario where few applications are applied to the extended screen, the target window may be set to be in a non-editable state. And flexibly verifying whether the operation on the target object meets the condition of moving the target object to the target screen for displaying based on the editing state of the target state. In the embodiment of the application, the operation of moving the target object can be identified based on the state of the target window, so that the requirement that the target object is displayed on different display screens can be met more accurately.

Based on the foregoing embodiments, in one implementation, displaying a target object on a target screen includes:

and in response to the operation of moving or inputting the first identifier corresponding to the first screen in the display screens to the target position in the target window, displaying the target object determined from the first screen on the target screen.

The target position is an area where a target mark corresponding to the target screen is located; the first screen is any one of a main screen and an extended screen. In this embodiment, when the first identifier corresponding to the first screen is moved or input to the target position, it can be known that the target object in the first screen needs to be displayed on the target screen. The first identifier may be a name identifier of the first screen, or may be number information of the first screen.

In another embodiment, displaying the target object on the target screen includes:

and in response to an operation of modifying the identification of the target object of the main screen or the extended screen to the target identification of the corresponding target screen, displaying the target object on the target screen.

In this embodiment, corresponding objects in different display screens may have an identification naming convention corresponding to the display screen in which they are located. If the target object belongs to the first screen, the corresponding identification prefix is 100 when the object belongs to the first screen, the identification of the target object is 100A according to the identification rule, and the target screen corresponds to the second screen, and if the corresponding identification prefix is 100 when the object belongs to the second screen, the identification of the target object is controlled to be modified into the target identification corresponding to the target screen through voice control information, for example, so that the target object can be displayed on the target display screen. Therefore, when the identification of the target object is recognized to be changed, the target object is triggered to be displayed on the target screen.

In the embodiment of the application, the target object can be determined to be displayed on the target screen based on the triggering manner of the voice and gesture recognition, for example, the target object required to be displayed on the target screen is determined based on the voice information. Specifically, the document may be "please select the second document in the third row", and then a related operation is performed in the area where the target screen identifier corresponding to the target window is located to determine that the document is displayed on the target screen. The target object may also be moved to a target position of the target window by a gesture, so that the target object is displayed on a screen corresponding to the target position.

Further, in the above embodiment, the determining the target object from the first screen includes:

and determining an application window at the forefront end of the current screen in the first screen as a target object.

In this embodiment, if the first screen includes a plurality of application windows, the application window currently at the forefront of the screen is determined as the target object, that is, the application window currently maximized may be determined as the target object or the application window most recently edited by the user may be determined as the target object.

Or;

and determining an object in the first screen, which has a first association relation with the application window displayed at the forefront of the screen in the target screen, as a target object.

The application window displayed at the forefront of the screen in the target screen can be an application window which is currently used or has a display requirement, and then an object having a first association relation with the application window is determined to be a target object in the first screen. The first association may characterize that the two have the same document format, the same attributes, or are in the same project or business scenario. If the application window at the forefront end of the current target screen is displayed by the teaching content, the ancient poetry picture related to the teaching content in the first screen can be used as a target object, and therefore the ancient poetry picture is displayed in the target screen.

Or;

and determining the object with the moving track meeting the preset condition in the first screen as a target object.

By analyzing the moving track of the object, information such as the moving direction, angle, line, end point position and the like of the object can be obtained. Then, the purpose of the object movement can be determined, and if the position of the object in the first screen is adjusted, the object still needs to be moved to the target screen for displaying. If the area to which the object moves can be determined to be the screen edge area by analyzing the movement trajectory, it can be predicted that the object needs to be displayed on another display screen, and the object is determined to be the target object. Or recognizing that the moving track is a track for moving the object to the target window, determining the object as the target object.

Or;

The first preset function is determined based on the application scenario and the actual display requirement, for example, the first preset function may be a function capable of displaying information matched with the target information when the target information is displayed, or may be a function capable of being matched with the trigger instruction. For example, the first preset function is a function capable of setting a page layout, and if the page layout needs to be set in the target screen, an application that can satisfy the page layout setting function in the first screen is determined as a target object, and the application is displayed on the target screen, so that the setting of the page layout can be completed based on the application.

In the embodiment of the present application, an operation of moving a target object in a main screen or an extended screen to a target screen based on a target window is an effective operation, that is, an operation of displaying the target object on the target screen can be realized. However, not every operation is an effective operation that enables display on the target screen. In one embodiment, the method comprises the following steps:

acquiring the operation of moving a target object based on the target window;

detecting the screen content corresponding to the target area;

Firstly, obtaining the operation of moving the target object based on the target window, and then analyzing the operation to obtain the target area of the target object moving to the target window. The method comprises the steps that different areas in a target window correspond to different display screens, the screen content of the display screen corresponding to the areas is detected, whether a screen of a target object and a screen to be displayed belong to the same screen or similar screens can be determined according to the screen content, if the screen of the target object and the screen to be displayed belong to the same screen or similar screens, the operation can be misoperation, and the target object cannot be displayed on the screen corresponding to the target areas. If the screen contents obtained based on the screen content detection do not match, the operation may be determined as an operation of moving the target object in the main screen or the extended screen to the target screen based on the target window, thereby displaying the target object on the target screen.

Further, when the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window is detected, the current screen content of the target screen can be detected to determine whether the target screen meets the display requirement of the target object. For example, if it is detected that the target screen is playing video information and the target object is a picture, the playing of the video is affected if the picture is displayed on the target screen, so that corresponding prompt information may be generated to prompt the user whether the target object is to be displayed on the target screen, if the received feedback information is not to be displayed, the target screen continues to play the video, and if the feedback information is to be displayed, the playing of the video is interrupted and the picture is displayed.

When it is determined that the target object is to be displayed in the target screen, if the target object is a document that is not opened or displayed, the document may be displayed at any position in the target screen, preferably in a blank area of the target screen. If the target object is in the form of a window, the target object is also displayed in the form of a window when displayed on the target screen.

In one embodiment of the present application, the optimal display position of the target object on the target screen may also be determined based on information of the target window, the screen to which the target object belongs, and the screen to be displayed.

Specifically, the displaying the target object on the target screen includes:

acquiring at least one of first position information of a target object in a target window corresponding to a region of a target screen, second position information of the target window in a display screen, or third position information of the region of the target screen in the target window;

acquiring screen size ratio information of a display screen and a target screen;

determining a target display position based on at least one of the first position information, the second position information and the third position information and the screen size ratio information;

and displaying the target object at the target display position of the target screen.

Coordinate information of the target object in the target screen area can be obtained based on the first position information; based on the second location information and the third location information, scaling information of the target screen region to the current display screen may be determined. Then, the proportional relation between the area corresponding to the target screen and the target screen can be determined according to the screen size ratio information of the display screen and the target screen, and based on the proportional relation and the first information, the coordinate information of the target object in the target screen can be determined, that is, the target display position can be determined, so that the target object is displayed at the target display position of the target screen.

And obtaining the coordinates of the starting points of the first screen to which the target object belongs and the target screen of the screen to be displayed, and then calculating the position of the target object on the target screen. For example, the starting point of the first screen is (0,0), the width is 1920; the starting point of the target screen is (1920,0), the sizes of the two screens can be known by using the width and height information in the boundary information in the screen information, and if the target object is located at the upper left corner of the first screen, the ratio of the coordinates of the upper left corner and the sizes of the two screens is obtained, so that the position of the target object on the target screen can be calculated.

In an actual application scenario, the screen management window may be used as a target window. Referring to fig. 4, a schematic diagram of an application scenario based on a screen management window provided in an embodiment of the present application shows the screen management window on a main screen. When the electronic equipment detects the extended screen information, the extended screen information is acquired, and extended screen shortcut interface information (such as extended screen position information and resolution information) can be created. And based on the screen management window, adding the shortcut interface information to the screen management window, wherein the shortcut interface information is embodied as a mark corresponding to each screen in fig. 4. For example, the area marked with 1 corresponds to the main screen, the area marked with 2 corresponds to the first extended screen, and the area marked with 3 corresponds to the second extended screen. When the mouse moves or drags the object to the relevant area in the corresponding screen management window, the object can be directly displayed on the screen corresponding to the area. Furthermore, in order to prevent the generation of misoperation corresponding to the mouse or related operation, a right key or a shortcut key can be set to activate a corresponding area, so that the purpose of displaying the object on the target screen is achieved. For example, moving the object to the area marked with 3 displays the object on the second extended screen.

Correspondingly, the shortcut window which is created independently can be used as the target window, and only the identification area of the screen except the screen where the target window is located can be displayed in the shortcut window. As shown in fig. 5, after moving the object corresponding to the icon 1 to the area corresponding to the expansion screen 1 in the shortcut window and moving the application window a to the area corresponding to the expansion screen 2, the icon 1 is displayed on the expansion screen 1, and the application window a is displayed on the expansion screen 2.

Referring to fig. 6, for a control device provided in the second embodiment of the present application, the technical solution in this embodiment is mainly used to improve the operation convenience and accuracy of displaying an object on different screens.

Specifically, the apparatus in this embodiment may include the following units:

an obtaining unit 601, configured to obtain a trigger instruction, and display a target window on a display screen of an electronic device, where the display screen includes a main screen and/or an extended screen of the electronic device;

a display unit 602 configured to display a target object in the main screen or the extended screen on a target screen, which is a screen different from a screen to which the target object belongs before being moved, in response to an operation of moving the target object to the target screen based on the target window.

It can be seen from the above technical solutions that, a second embodiment of the present application discloses a control device, including: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an extended screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extended screen to a target screen based on the target window, the target object is displayed on the target screen, which is a different screen from a screen to which the target object belongs before being moved. The target object can be rapidly moved to different display screens for displaying through the target window, so that the object can be moved on different screens more conveniently and accurately.

In one embodiment, the obtaining unit 601 includes a sub-unit of at least one of:

the first detection subunit is used for detecting the trigger operation acting on the target key or the target control and determining to obtain the trigger instruction;

or the like, or, alternatively,

the second detection subunit is used for detecting the connection or disconnection of at least one extended screen and determining to obtain the trigger instruction; or the like, or, alternatively,

the third detection subunit is used for detecting that the electronic equipment is switched from the current operation mode to the target operation mode, and determining to obtain the trigger instruction; or the like, or, alternatively,

the fourth detection subunit is configured to detect that the electronic device is accessed to the target network, and determine to obtain the trigger instruction; or the like, or, alternatively,

the fifth detection subunit is configured to detect that the electronic device starts a target process, and determine to obtain the trigger instruction; or the like, or, alternatively,

the sixth detection subunit is used for detecting that a screen management request is obtained and determining to obtain the trigger instruction; or the like, or, alternatively,

and the seventh detection subunit is used for detecting that the movement track of the target object meets a preset condition and determining to obtain the trigger instruction.

Optionally, the obtaining unit includes a first display subunit, configured to display the target window on a display screen of the electronic device, where the first display subunit is specifically configured to:

Optionally, the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window includes:

In one embodiment, the display unit 602 includes:

the first acquisition subunit is used for acquiring the editing state information of the target window;

the first monitoring subunit is used for monitoring first coordinate information of a first operation of moving the target object if the target window is not editable, and displaying the target object on the target screen if the first coordinate information is matched with the target position; and/or the presence of a gas in the atmosphere,

and the second monitoring subunit is used for monitoring whether the operation of moving the target object comprises a second operation at the target position if the target window is editable, and displaying the target object on the target screen if the second operation is included.

Wherein displaying the target object on the target screen comprises:

Wherein determining a target object from the first screen comprises:

Wherein the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window comprises:

acquiring the operation of moving a target object based on the target window;

detecting the screen content corresponding to the target area;

Optionally, the display unit 602 includes a second display subunit, configured to display the target object on the target screen, where the second display subunit is specifically configured to:

It should be noted that, for the specific implementation of each unit in the present embodiment, reference may be made to the corresponding content in the foregoing, and details are not described here.

Referring to fig. 7, a schematic structural diagram of an electronic device provided in the third embodiment of the present application is shown, where the technical scheme in the third embodiment is mainly used to improve operation convenience and accuracy of displaying an object on different screens.

Specifically, the electronic device in this embodiment may include the following structure:

a memory 701 for storing an application program and data generated by the operation of the application program;

a processor 702 for executing the application to implement:

According to the technical scheme, the electronic device disclosed by the third embodiment of the application obtains the trigger instruction, and displays the target window on the display screen of the electronic device, wherein the display screen comprises a main screen and/or an extended screen of the electronic device; in response to an operation of moving a target object in the main screen or the extended screen to a target screen based on the target window, the target object is displayed on the target screen, which is a different screen from a screen to which the target object belongs before being moved. The target object can be rapidly moved to different display screens for displaying through the target window, so that the object can be moved on different screens more conveniently and accurately.

Based on the foregoing embodiments, the present application further provides a storage medium having computer program code stored thereon, where the computer program code implements the audio processing method as described in any one of the above when executed by a processor.

It should be noted that, in the present embodiment, reference may be made to the corresponding contents in the foregoing, and details are not described here.

The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A control method, comprising:

2. The method of claim 1, the obtaining a triggering instruction comprising at least one of:

or the like, or, alternatively,

3. The method of claim 1 or 2, wherein displaying the target window on a display screen of the electronic device comprises:

4. The method of claim 3, wherein the operation of moving the target object in the home screen or the extended screen to a target screen based on the target window comprises:

5. The method of claim 4, wherein displaying the target object in the target window in response to an operation of moving the target object in the main or extended screen to a target position in the target window comprises:

acquiring the editing state information of the target window;

6. The method of claim 3, wherein displaying the target object on the target screen comprises:

7. The method of claim 6, wherein determining a target object from the first screen comprises:

8. The method of claim 1, wherein the operation of moving the target object in the home screen or the extended screen to a target screen based on the target window comprises:

acquiring the operation of moving a target object based on the target window;

detecting the screen content corresponding to the target area;

9. The method of claim 1, the displaying the target object on the target screen, comprising:

10. A control device, comprising: