CN115016702B - Control method and system for selecting application program display screen in extended screen mode - Google Patents

Control method and system for selecting application program display screen in extended screen mode Download PDF

Info

Publication number
CN115016702B
CN115016702B CN202111061215.0A CN202111061215A CN115016702B CN 115016702 B CN115016702 B CN 115016702B CN 202111061215 A CN202111061215 A CN 202111061215A CN 115016702 B CN115016702 B CN 115016702B
Authority
CN
China
Prior art keywords
screen
event
control system
user
operating system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111061215.0A
Other languages
Chinese (zh)
Other versions
CN115016702A (en
Inventor
闫金保
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202111061215.0A priority Critical patent/CN115016702B/en
Publication of CN115016702A publication Critical patent/CN115016702A/en
Application granted granted Critical
Publication of CN115016702B publication Critical patent/CN115016702B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display

Abstract

The embodiment of the application provides a control method and a system for selecting an application program display screen in an extended screen mode, wherein the control method comprises the steps of detecting the operation of a user on a computer in real time; capturing an event of triggering the application program to be opened by a user, and reporting the event to an operating system; analyzing the reported event through an operating system, and judging a terminal from which the reported event originates; after the terminal is determined, the received data of the application program is displayed on a display screen corresponding to the terminal. The control system comprises a detection module, a processing module, an analysis module and a display module. According to the technical scheme provided by the embodiment of the application, a user can select the most appropriate, comfortable and convenient display screen among the display screens to present the application program which the user wants to interact according to the actual demands or working environments of the user, so that the working and learning efficiency of the user is improved, and the experience of the user when the user uses the computer is improved.

Description

Control method and system for selecting application program display screen in extended screen mode
Technical Field
The application relates to the technical field of computers, in particular to a control method and a system for selecting an application program display screen in an extended screen mode.
Background
With the development of society, people have more requirements on the functions of computers, and in work or life, more and more people use an expansion screen to process transactions so as to facilitate work and improve efficiency, such as a double-screen display, equipment to cooperatively achieve the effect of expansion screen, and the like. When the application is opened in the scene of the expansion screen, or the application is opened in the main screen, the user is required to drag the application to the expansion screen; or the last screen displayed when the application was last opened.
For example, in a scenario where a Pad (tablet) is used as an extended screen of a PC (Personal Computer ), because the Pad has better mobility, the Pad may not be at the PC during the transaction process when the Pad is used, and if a new application is to be opened on the Pad screen, the application needs to be dragged to the Pad screen to the PC side, which affects the experience. For another example, in the process of sharing the screen a, the problem needs to be silently handled in the screen B, and an application needs to be opened, and at this time, it cannot be guaranteed that the application must be opened in the screen B.
Disclosure of Invention
In view of this, the present application provides a method and a system for selecting an application display screen in an extended screen mode, so as to solve the problem in the prior art that the user cannot correctly display an application on a screen currently operated by the user when the user uses the extended screen, thereby affecting the user experience.
In a first aspect, an embodiment of the present application provides a control method for selecting an application display screen in an extended screen mode, which is applied to a computer, where the computer has an operating system and a plurality of terminals, the operating system controls the plurality of terminals, and the terminals have display screens, and the control method includes:
the control system selects an application program display screen under the mode of operating an extended screen by the operating system of the computer, and detects the operation of a user on the computer in real time;
the control system captures an event of triggering the application program to be opened by a user and reports the event to the operating system;
the control system analyzes the reported event through the operating system and judges the terminal from which the reported event originates;
after the terminal is determined, the control system displays the received data of the application program on a display screen corresponding to the terminal.
In an implementation manner of the first aspect, the plurality of terminals include a main screen device and a plurality of extension screen devices, a display screen controlled by the main screen device is a main screen, and a display screen controlled by the extension screen device is an extension screen;
capturing an event triggering the opening of an application program by a user at the control system, and reporting the event to the operating system, wherein the event comprises the following steps:
the control system captures an event triggering the opening of the application program by a user;
the control system transmits information of an event triggering the opening of the application program by the user to the main screen equipment;
the control system converts the information of the event of triggering the application program to be opened by the user into main screen side information through the main screen equipment, wherein the main screen side information carries the information of the event of triggering the application program to be opened by the user;
the control system inputs the converted main screen side information to a virtual HID driver in the form of HID data through the main screen equipment;
and the control system reports the information of the main screen side to the operating system through a virtual HID driver.
In an implementation manner of the first aspect, in the analyzing, by the control system through the operating system, the reported event, determining, by the terminal from which the reported event originates, the method includes:
The control system detects whether the received main screen side information carries event trigger screen coordinates or not through the operating system;
if the main screen side information carries the event trigger screen coordinates, the control system compares the event trigger screen coordinates with a coordinate system formed by the main screen equipment and the plurality of expansion screen equipment through the operating system;
the control system judges the position of the event trigger screen coordinate in the coordinate system through the operating system, and determines a terminal corresponding to the event trigger screen coordinate;
the control system sends the data of the synthesized application program to the corresponding terminal through the operating system;
and if the main screen side information does not carry the event trigger screen coordinates, the control system uses the main screen corresponding to the main screen equipment as a display screen through the operating system or uses the main screen corresponding to the terminal preset as the main screen equipment in the operating system as a display screen.
In an implementation manner of the first aspect, in the analyzing, by the control system through the operating system, the reported event, determining, by the terminal from which the reported event originates, the method includes:
The control system detects whether the received main screen side information carries the event trigger screen mark or not through the operating system;
if the main screen side information carries the event trigger screen mark, the control system compares the event trigger screen mark with a mark library which is preset in the control system and consists of the main screen device and the plurality of expansion screen devices through the operating system;
the control system determines the terminal corresponding to the event trigger screen mark through comparison of the operating system;
the control system sends the data of the synthesized application program to the corresponding terminal through the operating system;
and if the event trigger screen mark is not carried in the home screen side information, the control system takes the home screen corresponding to the home screen equipment as a display screen through the operating system or takes the home screen corresponding to the terminal preset as the home screen equipment in the operating system as the display screen.
In a second aspect, the present application provides a control system for selecting an application display screen in an extended screen mode, applied to a computer, where the computer has an operating system and a plurality of terminals, the operating system controls the plurality of terminals, the terminals have display screens, and the control system includes a detection module, a processing module, an analysis module, and a display module;
The detection module is used for detecting the operation of a user on the computer in real time;
the processing module is used for capturing an event of triggering the application program to be opened by a user and reporting the event to the operating system;
the analysis module is used for analyzing the reported event through the operating system and judging the terminal from which the reported event originates;
and the display module is used for displaying the received data of the application program on a display screen corresponding to the terminal after the terminal is determined.
In an implementation manner of the second aspect, the analysis module analyzes, through the operating system, information that characterizes a terminal used by a user and is included in the event, and determines, through content extraction and feature comparison of the information, a terminal from which the event originates.
In an implementation manner of the second aspect, the analysis module sets different event trigger screen marks for each display screen through the operating system, and determines a terminal from which the event originates by comparing the event trigger screen marks included in the event with a preset mark library.
In a third aspect, the present application provides a terminal device, including a host, a main screen device and a plurality of extension screen devices, where the main screen device is respectively communicatively connected to the plurality of extension screen devices and performs data transmission, and the host controls the main screen device and the plurality of extension screen devices to execute the control method according to the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored therein, which when run on a computer, causes the computer to perform the control method as described in the first aspect.
In a fifth aspect, the present application provides a computer program product comprising a computer program which, when run on a computer, causes the computer to perform the control method as described in the first aspect.
According to the technical scheme provided by the embodiment of the application, at least the following technical effects can be realized:
according to the control method and the control system for selecting the application program display screen in the extended screen mode, the user can select the most appropriate, comfortable and convenient display screen among the display screens to present the application program which the user wants to interact according to the actual demands or working environments of the user, so that the working and learning efficiency of the user is improved, and the experience of the user when the user uses the computer is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of a practical application scenario of a control system disclosed in embodiment 1 of the present application;
FIG. 2 is a block diagram of a control system according to embodiment 1 of the present application;
FIG. 3 is a flowchart showing the generalized steps of the control method disclosed in embodiment 2 of the present application;
FIG. 4 is a flowchart showing the steps of Step200 in the control method according to embodiment 2 of the present application;
FIG. 5 is a flowchart showing a Step300 in the control method according to embodiment 2 of the present application;
FIG. 6 is a flowchart showing another Step of Step300 in the control method disclosed in embodiment 2;
fig. 7 is a diagram showing mapping of a main screen and extension screens to a virtual coordinate system XOY in the control method disclosed in embodiment 2 of the present application;
fig. 8 is a schematic diagram showing a method for controlling communication execution among respective hardware of a terminal device according to embodiment 3 of the present application;
fig. 9 is a schematic diagram of data stream transmission of a terminal device according to embodiment 3 of the present application.
Reference numerals:
100-a control system; 110-a detection module; 120-a processing module; 130-an analysis module; 140-a display module;
1-a home screen device; 2-an extension screen device; 3-a host; 4-an application program; 5-icon; 6-OS; a-a home screen area; b-expanding screen area.
Detailed Description
For a better understanding of the technical solution of the present application, the following detailed description of the embodiments of the present application refers to the accompanying drawings.
It should be understood that the described embodiments are merely some, but not all, embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The terminology used in the embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be understood that the term "and/or" as used herein is merely one way of describing an association of associated objects, meaning that there may be three relationships, e.g., a and/or b, which may represent: the first and second cases exist separately, and the first and second cases exist separately. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
In practical application scenes, users are not careful about using single screen to process increasingly diverse matters, in many places of work and study, users want to be provided with larger screens and more screens to process one piece of matters or process multiple pieces of matters simultaneously, especially when the users are required to read multiple files simultaneously to analyze or open multiple pieces of software to perform cooperation work, the users need to use extended screens to process matters, such as a double-screen display, a three-screen display and equipment to cooperate to achieve the effect of the extended screens, and even in some highly complex and highly-confidential works, the users need nine screens to simultaneously display all files and software related to the matters to be processed to complete the work efficiently. It is noted that the user does not have to be locked in a seat in front of the screen, and the user can work at a distance from the main screen through the screen of the mobile terminal, such as a conference room, a bedroom, a meeting room, etc. of a workplace. At this time, when the user opens the application program using the extended screen, the application program is opened on the main screen, the user needs to return to the place where the main screen is located again to drag the application program to the extended screen, and then return to the place where the extended screen is desired to be used, or the application program is displayed on the last displayed screen when being opened last time, once the last displayed screen is the main screen, the user still needs to repeat the process of the former case, which is obviously inconvenient and not humanized. Therefore, the embodiment of the application can display the application program on the correct screen required by the user by judging whether the position of the user, where the event of triggering and opening the application program occurs, is the main screen or the extension screen, so that inconvenience of the user in most of using scenes is solved, and the effects of improving the working efficiency of the user and enhancing the using experience of the user are realized.
Example 1
The embodiment 1 of the application discloses a control system 100 for selecting an application display screen in an extended screen mode, and the control system 100 can effectively solve the problems of poor use experience and affected efficiency when a user uses multi-screen work and study in the existing work and study environments. In some application scenarios, the user uses the dual display, where there is one main screen of the main screen device 1 and one extension screen of the extension screen device 2, and the user can work or learn using the main screen device 1 or the extension screen device 2. In some application scenarios, the user uses a plurality of displays, where there is a main screen of one main screen device 1 and an extension screen of a plurality of extension screen devices 2, and the user can work or learn using the main screen device 1 or one of the extension screen devices 2. In some application scenarios, a PC is used as the main screen device 1, a PAD is used as the extension screen device 2, the user uses the PC to cooperate with the PAD, the extension screen of the PAD is used as the extension screen of the main screen of the PC, and the user can work or learn by using the PC or the PAD. In some application scenarios, the user uses the PC to cooperate with multiple PADs, the extension screens of which are each extension screens of the main screen of the PC, and the user can work or learn using the PC or one of the PADs. The control system 100 disclosed in this embodiment 1 is disposed in a host 3 formed by a terminal PC where a main screen is located and terminal PADs (may also be other intelligent mobile terminals) corresponding to the extension screens, and as shown in fig. 1, the host 3 is connected with the PC and each PAD (may also be other intelligent mobile terminals) in a wired or wireless manner, and the PC and each PAD are also connected with each other in a wireless manner, and the control system 100 in this embodiment 1 executes an instruction for selecting an application display screen in the extension screen mode through the host 3. In these application scenarios, when the user opens the application 4 by clicking the icon 5 of the application 4 with a cursor on the currently used screen (may be the main screen 1 or the extension screen), the currently used screen (may be the main screen 1 or the extension screen) may directly display the application 4. The description of the solution according to the application is therefore also developed around this point.
As shown in fig. 2, a control System 100 for selecting an application display screen in an extended screen mode disclosed in this embodiment 1 is applied to a computer having an operating System 6 (OS) and a plurality of terminals, the operating System controlling the plurality of terminals, the terminals having display screens. The control system comprises a detection module 110, a processing module 120, an analysis module 130 and a display module 140 which are in communication connection with each other, the four modules being capable of transmitting data, transmission signalling and information interaction with each other.
Specifically, the OS6 of the computer runs the control system 100 for selecting an application display screen in the extended screen mode, and the control system 100 detects the user's operation on the computer in real time through the detection module 110.
After the computer runs and turns on its main screen device 1 and a plurality of extension screen devices 2, an OS6 (Operation System) of the computer is started, and the main screen device 1 and the plurality of extension screen devices 2 are put into Operation, and the main screen and the extension screen display screens. The control system 100 for selecting an application display screen in the extended screen mode is operated by the OS6, and the control system 100 starts to detect an operation of the computer by the user through the detection module 110 and responds accordingly.
The control system 100 captures an event that triggers the application 4 to open through the processing module 120 and reports the event to the OS6.
The user operates on the terminal (may be the home screen device 1 or the extension screen device 2) used by the user, and opens a certain application 4 (for example, word, excel, powerPoint, etc.), at which time the user triggers an event that the application 4 is opened. The user-triggered event is captured by the processing module 120 of the control system 100 and reported to the OS6, where the reported event has information characterizing the terminal used by the user. Therefore, as the event triggered by the user is reported to the OS6, the information of the terminal used by the user is also reported to the OS6.
Specifically, in the processing module 120 of the control system 100, the control system 100 captures an event of opening the user triggering application 4, then transmits information of the event of opening the user triggering application 4 to the home screen device 1, converts the information of the event of opening the user triggering application 4 into home screen side information through the home screen device 1, the home screen side information carries information of the event of opening the user triggering application 4, inputs the converted home screen side information into the virtual HID driver in the form of HID data through the home screen device 1, and finally reports the home screen side information to the OS6 through the virtual HID driver.
The control system 100 analyzes the reported event through the analysis module 130 through the OS6, and determines a screen from which the reported event originates.
The control system 100 analyzes information characterizing a terminal used by a user and included in the reported event through the OS6 by the analysis module 130, and determines a terminal from which the reported event originates and a display screen corresponding to the terminal used by the user by extracting content and comparing features of the information.
Specifically, in the analysis module 130 of the control system 100, the control system 100 detects whether the event-triggered screen coordinates are carried in the received home screen side information through the OS 6. If the home screen side information carries the event trigger screen coordinates, the control system 100 compares the event trigger screen coordinates with a coordinate system composed of the home screen device 1 and the plurality of extension screen devices 2 through the OS 6. The control system 100 determines the position of the event trigger screen coordinates in the coordinate system through the OS6, and determines the terminal corresponding to the event trigger screen coordinates. The control system 100 transmits the synthesized data of the application 4 to the corresponding terminal through the OS 6. If the home screen side information does not carry the coordinates of the event trigger screen, the control system 100 uses the home screen corresponding to the home screen device 1 as a display screen through the OS6 or uses the home screen corresponding to the terminal 1 preset as the home screen device in the OS6 as a display screen.
Of course, in the control system 100 for selecting the display screen of the application 4 in the extended screen mode of the embodiment 1, the analysis module 130 may also be configured to characterize the screen corresponding to the operation event of the user triggering the application 4 in other forms, for example, different flags (flags) are set to the main screen device 1 and each extended screen device 2, different event triggering screen flags are set for each terminal through the OS6, and the terminal from which the event originates is determined by comparing the event triggering screen flag included in the event with a preset flag library. At this time, in the analysis module 130 of the control system 100, it is detected by the OS6 whether the event trigger screen flag is carried in the received home screen side information. If the home screen side information carries an event trigger screen flag, the control system 100 compares the event trigger screen flag with a flag library composed of the home screen device 1 and the plurality of extension screen devices 2, which is preset in the control system 100, through the OS 6. The control system 100 determines the terminal corresponding to the event trigger screen flag through comparison of the OS 6. The control system 100 transmits the synthesized data of the application 4 to the corresponding terminal through the OS 6. If the home screen side information does not carry the event trigger screen flag, the control system 100 uses the home screen corresponding to the home screen device 1 as a display screen through the OS6 or uses the home screen corresponding to the terminal 1 preset as the home screen device in the OS6 as a display screen.
After determining the terminal, the control system 100 displays the received data of the application program 4 on a display screen corresponding to the terminal (on the main screen if the terminal is the main screen device 1 and on the extension screen if the terminal is the extension screen device 2) through the display module 140.
In summary, the control system 100 for selecting an application display screen in the extended screen mode of the present embodiment 1 implements displaying the application 4 on the screen of the terminal used when the user performs the triggering operation, which avoids the trouble that the user needs to drag the application 4 from the home screen of the home screen device 1 to the extended screen of the extended screen device 2 used by the user after opening the application 4, or the trouble that the user needs to drag the application 4 from the extended screen of one of the extended screen devices 2 to the extended screen of the other extended screen device 2 used by the user or to the home screen of the home screen device 1 after opening the application 4, improves the convenience of using the terminal by the user and the work and learning efficiency of the user, and enhances the use experience of the user.
Example 2
The embodiment 2 of the application discloses a control method for selecting an application program display screen in an extended screen mode, which can effectively solve the problems of poor use experience and affected efficiency when a user uses multi-screen work and study in the existing work and study environments. In some application scenarios, the user uses the dual display, where there is a main screen of the main screen device and an extension screen of the extension screen device, and the user can work or learn using the main screen device or the extension screen device. In some application scenarios, a user uses multiple displays, where there is a main screen of one main screen device and an extension screen of multiple extension screen devices, the user may work or learn using the main screen or one of the extension screens. In some application scenarios, a PC is used as a main screen device, a PAD is used as an extension screen device, a user uses the PC to cooperate with the PAD, the extension screen of the PAD is used as an extension screen of the main screen of the PC, and the user can work or learn by using the PC or the PAD. In some application scenarios, the user uses the PC to cooperate with multiple PADs, the extension screens of which are each extension screens of the main screen of the PC, and the user can work or learn using the PC or one of the PADs. In these application scenarios, when the user opens the application program by clicking the icon of the application program with the cursor on the currently used screen (may be the main screen or the extension screen), the currently used screen (may be the main screen or the extension screen) may directly display the application program. The description of the solution according to the application is therefore also developed around this point.
As shown in fig. 3, the control method for selecting an application display screen in an extended screen mode disclosed in this embodiment 2 is applied to a computer, where the computer has an Operating System (OS) and a plurality of terminals, the OS controls a plurality of terminals, the terminals have display screens, the terminals include a main screen device and a plurality of extended screen devices, the display screen controlled by the main screen device is the main screen, and the display screen controlled by the extended screen device is the extended screen, and mainly includes the following steps:
step100: the OS of the computer runs a control system for selecting an application display screen in the extended screen mode, and the control system detects an operation of the computer by a user in real time.
Step200: the control system captures an event that a user triggers the application to open and reports the event to the OS.
Step300: the control system analyzes the reported event through the OS and judges the terminal from which the reported event originates.
Step400: after the terminal is determined, the control system displays the received data of the application program on a display screen corresponding to the terminal.
In Step100, after the computer runs and turns on its home screen device and multiple extension screen devices, the OS of the computer starts up, and the home screen device and multiple extension screen devices are put into operation, and the home screen and the extension screen display images respectively. When Step100 is executed, the control system for selecting the application display screen in the extended screen mode is operated by the OS, and the detection of the operation performed by the user on the computer is started and a corresponding response is made. The control system is the control system for selecting the display screen of the application program in the extended screen mode disclosed in embodiment 1 of the present application.
When Step200 is performed, the user performs an operation on the terminal (which may be a control home screen device or an extension screen device) used by the user, and opens an application (for example, word, excel, powerPoint, etc.), and at this time, the user triggers an event that the application is opened. And reporting the event triggered by the user to the OS through the control system selecting the application display screen in the extended screen mode, wherein the reported event has information representing the terminal used by the user. Therefore, as the event triggered by the user is reported to the OS, the information of the terminal used by the user is also reported to the OS.
Specifically, step200 further includes the steps of:
step201: the control system captures events that trigger the opening of the application by the user.
Step202: the control system transmits information of an event triggering the opening of the application by the user to the home screen device.
Step203: the control system converts the information of the event of triggering the application program to be opened by the user into main screen side information through the main screen equipment, wherein the main screen side information carries the information of the event of triggering the application program to be opened by the user.
Step204: the control system inputs the converted home screen side information to the virtual HID driver in the form of HID data through the home screen device.
Step205: the control system reports home screen side information to the OS through the virtual HID driver.
When Step300 is executed, the OS analyzes the information characterizing the terminal used by the user and determines the terminal from which the reported event originates (i.e., the home screen device or the extension screen device used by the user) by extracting the content and comparing the features of the information.
Specifically, step300 further includes the steps of:
step301: the control system detects whether the received home screen side information carries the event trigger screen coordinates or not through the OS.
Step302: if the main screen side information carries the event trigger screen coordinates, the control system compares the event trigger screen coordinates with a coordinate system formed by the main screen equipment and a plurality of expansion screen equipment through an OS.
Step303: the control system judges the position of the event trigger screen coordinates in the coordinate system through the OS, and determines the terminal corresponding to the event trigger screen coordinates.
Step304: the control system transmits the data of the synthesized application program to the corresponding terminal through the OS.
Step305: if the main screen side information does not carry the event trigger screen coordinates, the control system uses the main screen corresponding to the selected main screen device as a display screen through the OS or uses the main screen corresponding to the terminal preset as the main screen device in the OS as the display screen.
Of course, the control method for selecting the display screen of the application program in the extended screen mode of this embodiment 2 may also be used to characterize the terminal corresponding to the operation event of the user triggering the application program in other forms, for example, different flags are set for the home screen device and each extended screen device, and at this time, the steps included in Step300 become the steps shown in fig. 6:
step301': the control system detects whether the received main screen side information carries an event trigger screen flag or not through an OS.
Step302': if the main screen side information carries the event triggering screen flag, the control system compares the event triggering screen flag with a flag library which is preset in the control system and consists of main screen equipment and a plurality of expansion screen equipment through an OS.
Step303': the control system determines the terminal corresponding to the event trigger screen flag through comparison of the OS.
Step304': the control system transmits the data of the synthesized application program to the corresponding terminal through the OS.
Step305': if the main screen side information does not carry the event trigger screen flag, the control system takes a main screen corresponding to the main screen device as a display screen through the OS or takes a main screen corresponding to a terminal preset as the main screen device in the OS as the display screen.
Taking a PC with a main screen and a PAD with an extension screen as an example, assuming that a user operates and opens a certain application program, such as WORD, on the PAD, an operation event for triggering and opening the WORD by the user is generated on the PAD, the PAD transmits the operation event to the PC, the PC converts the received operation event into a corresponding event of the PC, information representing that the operation event is from the PAD is carried in the corresponding event of the PC, the PC transmits the converted corresponding event to a virtual HID driver and reports the virtual HID driver to the OS, and after the corresponding event is processed by the OS, the extension screen with the display screen being the PAD is determined, so that the OS transmits data synthesized by the application program required to be displayed on the extension screen back to the PAD.
The information used for representing that the operation event converted into the corresponding event of the PC is from the PAD comprises specific screen coordinates of the coordinate system XOY where the operation of the user triggering the application program is located, and according to the screen coordinates, the screen used when the user triggering the application program can be judged to belong to which terminal, so that the OS finally sends the synthesized application program data to the terminal and presents the application program to the terminal. Specifically, the coordinate system XOY is a virtual coordinate system in the control system, pixels and ranges included and covered by the main screen and the plurality of extended screens are used as basic elements, and mapped onto the coordinate system XOY together, as shown in fig. 7, the main screen and each extended screen respectively correspond to a part of the ranges in the coordinate system XOY, when an operation event of the application program by a user triggers on the main screen, a terminal corresponding to the main screen generates trigger coordinates representing a trigger position of the operation event and maps the trigger coordinates into the coordinate system XOY simultaneously, so that an area formed by splicing the main screen area a and the extended screen area B is formed, and the trigger coordinates can be displayed in a range corresponding to the main screen in the coordinate system XOY, namely, the main screen area a in fig. 7. According to the value and the position of the trigger coordinates in the coordinate system XOY, the control system converts the trigger coordinates into information representing the position of the operation event, when the OS receives the reported PC corresponding event, the display screen of the operation event of the application program triggered by the user can be judged through the information contained in the PC corresponding event, so that the OS sends the synthesized data of the application program to the display screen, and finally the control system displays the received data of the application program on the display screen.
In summary, the control method for selecting the application display screen in the extended screen mode of the embodiment 2 realizes that the application is displayed on the screen of the terminal used when the user performs the triggering operation, avoids the trouble that the user needs to drag the application from the main screen to the screen of the terminal used by the user after opening the application, improves the convenience of using the terminal by the user and the work and learning efficiency of the user, and enhances the use experience of the user.
Example 3
Embodiment 3 of the present application discloses a terminal device, which has a host and a plurality of terminals, the terminals include a main screen device and a plurality of extension screen devices, the main screen device and the plurality of extension screen devices are respectively connected in communication and perform data transmission, and the host controls the main screen device and the plurality of extension screen devices to execute the control method in embodiment 2 of the present application. The terminals can be PCs or PADs or other intelligent mobile terminals, and the terminals are centrally controlled through a host computer to form a cooperative system. Taking a PC as a main screen device where a main screen is located, a PAD as an extension screen device where an extension screen is located as an example.
As shown in fig. 8, the PC has a service layer, a capability layer, a driving layer and a system layer, where the service layer has units of device discovery connection and management, collaborative mode management, setup management, etc., the capability layer has units of virtualization capability, image capturing coding, reverse control management, etc., the driving layer has units of virtual HID driving, virtual display driving, USB driving, etc., and the system layer has an OS. In this case, the function of the image capturing code is to capture and encode the image data of the virtual display driver, and to transmit the image data to the expansion screen device side through the back control management. The function of the back control management is to provide the virtualization capability for the devices such as a screen, a loudspeaker, a key mouse and the like between the expansion screen device and the PC, provide data such as a screen throwing code stream, an image, back control and the like, and command transmission capability, and convert the events captured by screen throwing display into HID input data. The virtual HID driver is used for receiving HID (keyboard, mouse, touch screen and handwriting pen) input data generated by the back control management, and feeding back to the OS after processing. The virtual reality drive functions are to virtually output an expanded display area, and the upper layer application can acquire images of the display area in a capture and screen capturing mode. The function of the OS is for the system to respond to HID input data. The flow is from the expansion screen device to the PC for the reverse control event, and is represented by a solid arrow.
The extended screen device is provided with a UI, a capability layer and a driving layer, wherein the UI is provided with units such as screen projection display, collaborative mode management and the like, the capability layer is provided with units such as inverse control management, audio and video decoding, a device virtualization module and the like, and the driving layer is provided with units such as USB driving and the like. Among these, the function of the screen-cast display is to play the content that needs to be displayed on the extension screen, which is grabbed from the PC side, and to capture events such as clicking, touching, and the like on the extension screen. The function of the back control management is to provide the virtualization capability for the equipment such as a screen, a loudspeaker, a key mouse and the like between the expansion equipment and the PC, and the data and instruction transmission capability such as screen throwing code stream, image, back control and the like. And converting the event captured by the screen-drop display into HID input data. The flow of this section is from PC to expansion screen equipment, and is represented by the dot-dash arrow.
In fig. 9, the PC and the extension screen device can communicate data with each other by wireless communication. By the control system disclosed in embodiment 1 of the present application and the control method disclosed in embodiment 2 of the present application, the terminal device of embodiment 3 can realize a function of automatically selecting a display screen by an application program in an extended screen mode. Specifically, a manner in which the terminal device of embodiment 3 implements the above-described functions will be described by taking an operation event in which a user triggers an application program to open in the extension screen device as an example. When a user clicks an application icon on the expansion screen device to trigger an operation event opened by an application in the expansion screen device, the screen throwing display of the expansion screen device can capture the operation event and send the operation event to the inverse control management of the expansion screen device, the inverse control management of the expansion screen device can convert the operation event into HID input data which are operation event HID data, the inverse control management of the expansion screen device sends the operation event HID input data to the inverse control management of the PC terminal through data transmission between the PC and the expansion screen device, the inverse control management of the PC terminal sends the operation event HID input data to the virtual HID drive, the virtual HID drive analyzes and processes the operation event HID input data and feeds the operation event HID input data back to the OS, the OS responds to the operation event HID input data after analysis and processing, and therefore the expansion screen device used by the user to trigger the operation event is judged, and the screen of the expansion screen device is taken as a target display screen. And then, the OS sends the response data to a virtual display driver, the virtual display driver firstly virtually outputs a display area of the expansion screen equipment, then displays a display image of an application program to be displayed on the expansion screen equipment end in the display area, encodes the display image, sends the encoded display image to the back control management of the PC end, sends the encoded display image to the back control management of the expansion screen equipment end through data transmission between the PC and the expansion screen equipment, sends the received encoded display image to audio and video decoding through the back control management of the expansion screen equipment end, decodes the encoded display image to restore the display image of the application program to be displayed through audio and video decoding, sends the display image to the projection screen for display, and finally displays the display image of the application program on the expansion screen of the expansion screen equipment through the projection screen display.
According to the control method and the control system for selecting the application program display screen in the extended screen mode, the user can select the most appropriate, comfortable and convenient display screen among the display screens to present the application program which the user wants to interact according to the actual demands or working environments of the user, so that the working and learning efficiency of the user is improved, and the experience of the user when the user uses the computer is improved.
It is to be understood that some or all of the steps or operations in the above-described embodiments are merely examples, and that embodiments of the present application may also perform other operations or variations of the various operations. Furthermore, the various steps may be performed in a different order presented in the above embodiments, and it is possible that not all of the operations in the above embodiments are performed.
Further, in general, improvements to a technology can be clearly distinguished as improvements in hardware (e.g., improvements to circuit structures such as diodes, transistors, switches, etc.) or software (improvements to the process flow). However, with the development of technology, many improvements of the current method flows can be regarded as direct improvements of hardware circuit structures. Designers almost always obtain corresponding hardware circuit structures by programming improved method flows into hardware circuits. Therefore, an improvement of a method flow cannot be said to be realized by a hardware entity module. For example, a programmable logic device (Programmable Logic Device, PLD) (e.g., field programmable gate array (Field Programmable Gate Array, FPGA)) is an integrated circuit whose logic function is determined by the programming of the device by an accessing party. The designer programs itself to "integrate" a digital device onto a single PLD without having to ask the chip manufacturer to design and fabricate application-specific integrated circuit chips. Moreover, nowadays, instead of manually manufacturing integrated circuit chips, such programming is mostly implemented by using "logic compiler" software, which is similar to the software compiler used in program development and writing, and the original code before the compiling is also written in a specific programming language, which is called hardware description language (Hardware Description Language, HDL), but not just one of the hdds, but a plurality of kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), lava, lola, myHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog are currently most commonly used. It will also be apparent to those skilled in the art that a hardware circuit implementing the logic method flow can be readily obtained by merely slightly programming the method flow into an integrated circuit using several of the hardware description languages described above.
Therefore, the method flow proposed by the embodiment of the present application may be implemented in hardware, for example, using a controller, where the controller controls a touch screen to implement the method flow proposed by the embodiment of the present application.
The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable logic controllers, and embedded microcontrollers, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, atmel AT91SAM, microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic of the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller in a pure computer readable program code, it is well possible to implement the same functionality by logically programming the method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc. Such a controller may thus be regarded as a kind of hardware component, and means for performing various functions included therein may also be regarded as structures within the hardware component. Or even means for achieving the various functions may be regarded as either software modules implementing the methods or structures within hardware components.
Corresponding to the embodiment, the application also provides electronic equipment. The electronic device comprises a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method steps according to embodiments of the application.
The present application also provides a computer program product comprising a computer program which, when run on a computer, causes the computer to perform some or all of the steps provided by embodiments of the present application.
It will be apparent to those skilled in the art that the techniques of embodiments of the present application may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present application may be embodied in essence or what contributes to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present application.
The same or similar parts between the various embodiments in this specification are referred to each other. In particular, for the device embodiment and the terminal embodiment, since they are substantially similar to the method embodiment, the description is relatively simple, and reference should be made to the description in the method embodiment for relevant points.

Claims (7)

1. A control method for selecting an application display screen in an extended screen mode, applied to a computer, the computer having an operating system, the operating system controlling a plurality of terminals, the terminals having display screens, the plurality of terminals including a main screen device and a plurality of extended screen devices, the display screen controlled by the main screen device being the main screen, and the display screen controlled by the extended screen device being the extended screen, the control method comprising:
the control system selects an application program display screen under the mode of operating an extended screen by the operating system of the computer, and detects the operation of a user on the computer in real time;
the control system captures an event triggering the opening of an application program by a user, wherein the user can trigger the same event triggering the opening of the application program on the main screen device and at least one expansion screen device;
The control system transmits information of an event triggering the opening of an application program by a user to the main screen equipment;
the control system converts the information of the event of triggering the application program to be opened by the user into main screen side information through the main screen equipment, wherein the main screen side information carries the information of the event of triggering the application program to be opened by the user;
the control system inputs the main screen side information to a virtual HID driver in the form of HID data through the main screen device;
the control system reports the information of the main screen side to the operating system through the virtual HID driver;
the control system detects whether the received main screen side information carries an event trigger screen coordinate or an event trigger screen mark through the operating system, wherein the event trigger screen coordinate or the event trigger screen mark is information of a terminal used for representing an event of triggering an application program to be opened by a user;
if the control system detects that the main screen side information carries the event trigger screen coordinates or the event trigger screen marks, the control system analyzes the event trigger screen coordinates or the event trigger screen marks through the operating system and judges a terminal from which an event opened by the user trigger application program is sourced; after the terminal is determined, the control system displays the received data of the application program on a display screen corresponding to the terminal;
If the control system detects that the main screen side information does not carry the event trigger screen coordinates or the event trigger screen marks, the control system selects the main screen corresponding to the main screen device as a display screen through the operating system or takes the main screen corresponding to a terminal preset as the main screen device in the operating system as a display screen.
2. The control method according to claim 1, wherein the control system detecting, by the operating system, whether the received home screen side information carries an event trigger screen coordinate or an event trigger screen flag, includes:
the control system detects whether the received main screen side information carries event trigger screen coordinates or not through the operating system;
if the main screen side information carries the event trigger screen coordinates, the control system compares the event trigger screen coordinates with a coordinate system formed by the main screen equipment and the plurality of expansion screen equipment through the operating system;
the control system judges the position of the event trigger screen coordinate in the coordinate system through the operating system, and determines a terminal corresponding to the event trigger screen coordinate;
The control system sends the data of the synthesized application program to the corresponding terminal through the operating system;
and if the main screen side information does not carry the event trigger screen coordinates, the control system selects the main screen corresponding to the main screen equipment as a display screen through the operating system or takes the main screen corresponding to a terminal preset as the main screen equipment in the operating system as a display screen.
3. The control method according to claim 1, wherein the control system detecting, by the operating system, whether the received home screen side information carries an event trigger screen coordinate or an event trigger screen flag, includes:
the control system detects whether the received main screen side information carries the event trigger screen mark or not through the operating system;
if the main screen side information carries the event trigger screen mark, the control system compares the event trigger screen mark with a mark library which is preset in the control system and consists of the main screen device and the plurality of expansion screen devices through the operating system;
The control system determines the terminal corresponding to the event trigger screen mark through comparison of the operating system;
the control system sends the data of the synthesized application program to the corresponding terminal through the operating system;
and if the event trigger screen mark is not carried in the home screen side information, the control system takes the home screen corresponding to the home screen equipment as a display screen through the operating system or takes the home screen corresponding to the terminal preset as the home screen equipment in the operating system as the display screen.
4. A control system for selecting an application display screen in an extended screen mode, which is applied to a computer, wherein the computer is provided with an operating system, the operating system controls a plurality of terminals, the terminals are provided with display screens, the terminals comprise a main screen device and a plurality of extended screen devices, the display screen controlled by the main screen device is the main screen, and the display screen controlled by the extended screen device is the extended screen, and the control system is characterized by comprising a detection module, a processing module, an analysis module and a display module;
the detection module is used for detecting the operation of a user on the computer in real time;
The processing module is used for capturing an event of triggering the application program to be opened by a user, wherein the user can trigger the same event of triggering the application program to be opened on the main screen device and at least one expansion screen device;
the processing module is further configured to transmit information of an event of triggering the application program to open to the home screen device, convert the information of the event of triggering the application program to home screen side information through the home screen device, where the home screen side information carries information of the event of triggering the application program to open, input the home screen side information to a virtual HID driver in the form of HID data through the home screen device, and report the home screen side information to the operating system through the virtual HID driver;
the analysis module is used for detecting whether the received main screen side information carries an event trigger screen coordinate or an event trigger screen mark through the operating system, wherein the event trigger screen coordinate or the event trigger screen mark is information of a terminal used for representing an event of opening a user trigger application program;
the analysis module is further configured to, if it is detected that the home screen side information carries the event trigger screen coordinates or the event trigger screen marks, analyze, by using the operating system, the event trigger screen coordinates or the event trigger screen marks, and determine a terminal from which an event opened by the user trigger application program originates; the display module is used for displaying the received data of the application program on a display screen corresponding to the terminal after the terminal is determined;
The analysis module is further configured to select, by using the operating system, the home screen corresponding to the home screen device as a display screen or set, in advance, the home screen corresponding to the terminal of the home screen device in the operating system as a display screen if it is detected that the home screen side information does not carry the event trigger screen coordinates or the event trigger screen marks.
5. The control system according to claim 4, wherein the analysis module sets different event trigger screen markers for each of the display screens through the operating system, and determines a terminal from which the event originates by comparing the event trigger screen markers included in the event with a marker library set in advance.
6. A terminal device, characterized by comprising a host, a main screen device and a plurality of extension screen devices, wherein the main screen device is respectively in communication connection with the plurality of extension screen devices and performs data transmission, and the host controls the main screen device and the plurality of extension screen devices to execute the control method according to any one of claims 1-3.
7. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when run on a computer, causes the computer to execute the control method according to any one of claims 1 to 3.
CN202111061215.0A 2021-09-10 2021-09-10 Control method and system for selecting application program display screen in extended screen mode Active CN115016702B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111061215.0A CN115016702B (en) 2021-09-10 2021-09-10 Control method and system for selecting application program display screen in extended screen mode

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111061215.0A CN115016702B (en) 2021-09-10 2021-09-10 Control method and system for selecting application program display screen in extended screen mode

Publications (2)

Publication Number Publication Date
CN115016702A CN115016702A (en) 2022-09-06
CN115016702B true CN115016702B (en) 2023-10-27

Family

ID=83065129

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111061215.0A Active CN115016702B (en) 2021-09-10 2021-09-10 Control method and system for selecting application program display screen in extended screen mode

Country Status (1)

Country Link
CN (1) CN115016702B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618793A (en) * 2015-02-28 2015-05-13 联想(北京)有限公司 Information processing method and electronic equipment
CN107329717A (en) * 2017-06-14 2017-11-07 黄之 A kind of processing method of displaying information on screen, display methods and display system
WO2018018843A1 (en) * 2016-07-29 2018-02-01 广州视睿电子科技有限公司 Method and system for expanding screen interface
CN109032485A (en) * 2018-07-10 2018-12-18 广州视源电子科技股份有限公司 Display methods, device, electronic equipment, Intelligent flat and storage medium
CN109426408A (en) * 2017-09-01 2019-03-05 中兴通讯股份有限公司 A kind of multi-screen terminal and its apply display control method, device
CN110888615A (en) * 2019-11-12 2020-03-17 厦门亿联网络技术股份有限公司 Multi-input equipment interaction method, device and medium for double-screen different display of Android system
CN111443884A (en) * 2020-04-23 2020-07-24 华为技术有限公司 Screen projection method and device and electronic equipment
CN111708431A (en) * 2020-05-12 2020-09-25 青岛小鸟看看科技有限公司 Human-computer interaction method and device, head-mounted display equipment and storage medium
CN111736789A (en) * 2020-07-31 2020-10-02 成都依能科技股份有限公司 Extended display screen controller and extended display screen control method
CN112764563A (en) * 2020-12-31 2021-05-07 北京科银京成技术有限公司 Multi-screen control method, device and system, electronic equipment and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101965556A (en) * 2008-01-07 2011-02-02 智能技术Ulc公司 Method of launching a selected application in a multi-monitor computer system and multi-monitor computer system employing the same
JP6088127B2 (en) * 2011-10-13 2017-03-01 セイコーエプソン株式会社 Display device, display device control method, and program

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618793A (en) * 2015-02-28 2015-05-13 联想(北京)有限公司 Information processing method and electronic equipment
WO2018018843A1 (en) * 2016-07-29 2018-02-01 广州视睿电子科技有限公司 Method and system for expanding screen interface
CN107329717A (en) * 2017-06-14 2017-11-07 黄之 A kind of processing method of displaying information on screen, display methods and display system
CN109426408A (en) * 2017-09-01 2019-03-05 中兴通讯股份有限公司 A kind of multi-screen terminal and its apply display control method, device
CN109032485A (en) * 2018-07-10 2018-12-18 广州视源电子科技股份有限公司 Display methods, device, electronic equipment, Intelligent flat and storage medium
CN110888615A (en) * 2019-11-12 2020-03-17 厦门亿联网络技术股份有限公司 Multi-input equipment interaction method, device and medium for double-screen different display of Android system
WO2021093619A1 (en) * 2019-11-12 2021-05-20 厦门亿联网络技术股份有限公司 Method, device and medium relating to android system dual-screen display multi-input device
CN111443884A (en) * 2020-04-23 2020-07-24 华为技术有限公司 Screen projection method and device and electronic equipment
CN111708431A (en) * 2020-05-12 2020-09-25 青岛小鸟看看科技有限公司 Human-computer interaction method and device, head-mounted display equipment and storage medium
CN111736789A (en) * 2020-07-31 2020-10-02 成都依能科技股份有限公司 Extended display screen controller and extended display screen control method
CN112764563A (en) * 2020-12-31 2021-05-07 北京科银京成技术有限公司 Multi-screen control method, device and system, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN115016702A (en) 2022-09-06

Similar Documents

Publication Publication Date Title
US11556201B2 (en) Device, method, and user interface for processing intensity of touch contacts
AU2021240136B2 (en) Systems, methods, and graphical user interfaces for interacting with augmented and virtual reality environments
US20220057926A1 (en) Device, Method, and Graphical User Interface for Switching Between Camera Interfaces
AU2014238102B2 (en) Device, method, and graphical user interface for adjusting the appearance of a control
WO2021203724A1 (en) Handwriting selection method and apparatus, and computer device and storage medium
KR20120034637A (en) Gesture-based control systems including the representation, manipulation, and exchange of data
US20220092861A1 (en) Systems, Methods, and Graphical User Interfaces for Sharing Augmented Reality Environments
CN112817555B (en) Volume control method and volume control device
CN115016702B (en) Control method and system for selecting application program display screen in extended screen mode
US20150346973A1 (en) Seamlessly enabling larger ui
CN115016703B (en) Control method and system for selecting application program display screen in extended screen mode
KR20070025138A (en) The space projection presentation system and the same method
WO2023220165A1 (en) Interactions between an input device and an electronic device
US9870061B2 (en) Input apparatus, input method and computer-executable program
KR102220980B1 (en) Apparatus and method for providing augmented reality service
WO2020253282A1 (en) Item starting method and apparatus, and display device
KR20200033640A (en) Terminal, method for contrlling thereof and recording medium on which a program for implemeting the method
CN109308142B (en) Single-host multi-touch screen man-machine interaction system and implementation method thereof
US11967039B2 (en) Automatic cropping of video content
CN111045638B (en) Cursor control method and device, storage medium and terminal
CN116431256A (en) Display control method, electronic device, and readable storage medium
CN114610435A (en) Processing method and electronic equipment
KR20200033639A (en) Terminal, method for contrlling thereof and recording medium on which a program for implemeting the method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant