CN112764563A - Multi-screen control method, device and system, electronic equipment and storage medium - Google Patents
Multi-screen control method, device and system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112764563A CN112764563A CN202011630388.5A CN202011630388A CN112764563A CN 112764563 A CN112764563 A CN 112764563A CN 202011630388 A CN202011630388 A CN 202011630388A CN 112764563 A CN112764563 A CN 112764563A
- Authority
- CN
- China
- Prior art keywords
- application program
- display
- display terminal
- event
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
Abstract
The embodiment of the invention relates to a multi-screen control method, a multi-screen control device, a multi-screen control system, electronic equipment and a storage medium, wherein the method comprises the following steps: responding to an application program started by a user, receiving window position information and window size information distributed by the user for a display interface of the application program, determining a display terminal for presenting the display interface of the application program according to the window position information and the window size information and configuration information corresponding to a preset window position positioning mode, and presenting the display interface on the determined display terminal; acquiring a cursor focus of the application program, and hanging the cursor focus to an event processing signal slot so as to acquire an input event aiming at the application program through the event processing signal slot; and if the input event aiming at the application program is acquired, activating the display interface of the application program, sending the input event to the application program for processing, and simultaneously carrying out different interactive operations on a plurality of display terminals.
Description
Technical Field
The embodiment of the invention relates to the field of embedded technology, in particular to a multi-screen control method, a multi-screen control device, a multi-screen control system, electronic equipment and a storage medium.
Background
The existing embedded application program has the defect of the respective interaction method of multiple interfaces, and the multiple displays can only display one focus in the interfaces, so that input devices such as a mouse, a keyboard and the like cannot be respectively used for interaction on the respective interfaces.
Because a plurality of interfaces can only display one cursor, when an event trigger responds to an event, the cursor is positioned in the interface to monopolize the focus, and the widget can only use a mouse or a Tab key of a keyboard to switch the focus on the graphical user interface, but cannot simultaneously carry out different interactive operations on the plurality of interfaces.
Disclosure of Invention
In view of this, embodiments of the present invention provide a multi-screen control method, apparatus, system, electronic device, and storage medium, so as to implement controlling a plurality of display terminals through a host.
Additional features and advantages of embodiments of the invention will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of embodiments of the invention.
In a first aspect of the present disclosure, an embodiment of the present invention provides a multi-screen control method, which is executed by a host in a multi-screen control system, where the multi-screen control system includes the host and a plurality of display terminals, and the method includes:
responding to an application program started by a user, receiving window position information and window size information distributed by the user for a display interface of the application program, determining a display terminal for presenting the display interface of the application program according to the window position information and the window size information and configuration information corresponding to a preset window position positioning mode, and presenting the display interface on the determined display terminal, wherein the application program is provided with a cursor focus;
acquiring a cursor focus of the application program, and hanging the cursor focus to an event processing signal slot so as to acquire an input event aiming at the application program through the event processing signal slot;
and if the input event aiming at the application program is acquired, activating a display interface of the application program, and sending the input event to the application program so that the application program processes the input event.
In one embodiment, obtaining the input event for the application includes: and acquiring an input event sent by a user through an input device directly connected with the display terminal.
In an embodiment, the obtaining of the input event sent by the user through the input device directly connected to the display terminal includes: and scanning input events sent by input equipment directly connected with the display terminal through a reading thread independently established for the terminal equipment.
In one embodiment, the input device includes at least one of a mouse, a keyboard, a touch screen, and an external tablet.
In an embodiment, if the input device is a mouse, acquiring the input event for the application program includes: and acquiring a key release event and/or a mouse dragging event sent by a user through a mouse directly connected with a display terminal corresponding to the application program.
In an embodiment, if the input device is a keyboard, acquiring the input event for the application program includes: and acquiring a keyboard input event sent by a user through a keyboard directly connected with the display terminal corresponding to the application program.
In an embodiment, before determining, according to the configuration information corresponding to the predetermined window position positioning manner, a display terminal that presents a display interface of the application program, the method further includes:
and the plurality of display terminals are planned to be an expansion screen matched with the host computer according to a preset corresponding mode, window position information and window size information corresponding to each display terminal are determined according to the resolution of each display terminal and the preset corresponding mode, and the configuration information is generated according to the window position information and the window size information corresponding to each display terminal.
In a second aspect of the present disclosure, an embodiment of the present invention further provides a multi-screen control device configured in a host of a multi-screen control system, where the multi-screen control system includes the host and a plurality of display terminals, and the multi-screen control device includes:
an application program starting response unit, configured to respond to a user starting an application program, receive window position information and window size information allocated by the user for a display interface of the application program, determine, according to the window position information and the window size information, a display terminal that presents the display interface of the application program according to configuration information corresponding to a predetermined window position positioning manner, and present the display interface on the determined display terminal, where the application program is provided with a cursor focus;
the event processing signal slot hooking unit is used for acquiring a cursor focus of the application program, hooking the cursor focus to an event processing signal slot and acquiring an input event aiming at the application program through the event processing signal slot;
and the input event response unit is used for activating a display interface of the application program and sending the input event to the application program so that the application program processes the input event if the input event aiming at the application program is acquired.
In one embodiment, the input event response unit is configured to obtain the input event for the application program, and includes: the display terminal is used for acquiring input events sent by a user through the input equipment directly connected with the display terminal.
In an embodiment, the obtaining, by the input event response unit, the input event sent by the user through the input device directly connected to the display terminal includes: the display terminal is used for scanning input events sent by input equipment directly connected with the display terminal through a reading thread independently established for the terminal equipment.
In one embodiment, the input device includes at least one of a mouse, a keyboard, a touch screen, and an external tablet.
In an embodiment, if the input device is a mouse, the input event response unit is configured to obtain an input event for the application program, and the input event response unit includes: and the method is used for acquiring a button release event and/or a mouse dragging event sent by a user through a mouse directly connected with the display terminal corresponding to the application program.
In an embodiment, if the input device is a keyboard, the input event response unit is configured to obtain an input event for the application program, and the input event response unit includes: and the keyboard input event is used for acquiring a keyboard input event sent by a user through a keyboard directly connected with the display terminal corresponding to the application program.
In an embodiment, the apparatus further includes a configuration information generating unit, configured to, before determining, according to configuration information corresponding to a predetermined window position positioning manner, a display terminal that presents a display interface of the application program: and the plurality of display terminals are planned to be an expansion screen matched with the host computer according to a preset corresponding mode, window position information and window size information corresponding to each display terminal are determined according to the resolution of each display terminal and the preset corresponding mode, and the configuration information is generated according to the window position information and the window size information corresponding to each display terminal.
In a third aspect of the present disclosure, an embodiment of the present invention further provides a multi-screen control system, including a host and a plurality of display terminals, where the plurality of display terminals respectively display a display interface of a started application program;
the host is used for executing the multi-screen control method according to any one of the first aspect.
In an embodiment, the host includes a plurality of cores, and the number of the plurality of cores is not less than the number of the plurality of display terminals.
In a fourth aspect of the present disclosure, an electronic device is provided. The electronic device includes: a processor; and a memory for storing executable instructions that, when executed by the processor, cause the electronic device to perform the method of the first aspect.
In a fifth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the method of the first aspect.
The technical scheme provided by the embodiment of the invention has the beneficial technical effects that:
the method comprises the steps that a host responds to an application program started by a user, window position information and window size information distributed by the user for a display interface of the application program are received, according to the window position information and the window size information, a display terminal for presenting the display interface of the application program is determined according to configuration information corresponding to a preset window position positioning mode, and the display interface is presented on the determined display terminal; acquiring a cursor focus of the application program, and hanging the cursor focus to an event processing signal slot so as to acquire an input event aiming at the application program through the event processing signal slot; if the input event aiming at the application program is obtained, the display interface of the application program is activated, the input event is sent to the application program to be processed, different interactive operations can be simultaneously carried out on a plurality of display terminals, each display terminal can be provided with a set of keyboard and mouse for interaction of respective independent display screen applications, different applications can be operated in a host environment to be displayed on the plurality of display terminals, and each display terminal can use independent keyboard and mouse for interaction.
A plurality of display terminals can be driven by one host, so that the expansion operation is convenient and the mutual influence is avoided; the efficiency can be effectively improved compared with the condition of a display terminal.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only a part of the embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the contents of the embodiments of the present invention and the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a multi-screen control system according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a multi-screen control method according to an embodiment of the present invention;
fig. 3 is a schematic diagram illustrating an exemplary correspondence between an expansion screen associated with a host and each display terminal;
FIG. 4 is a schematic structural diagram of a multi-screen control apparatus according to an embodiment of the present invention;
FIG. 5 shows a schematic diagram of an electronic device suitable for use in implementing embodiments of the present invention.
Detailed Description
In order to make the technical problems solved, the technical solutions adopted and the technical effects achieved by the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be described in further detail below with reference to the accompanying drawings, and it is obvious that the described embodiments are only some embodiments, but not all embodiments, of the embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, belong to the scope of protection of the embodiments of the present invention.
It should be noted that the terms "system" and "network" are often used interchangeably herein in embodiments of the present invention. Reference to "and/or" in embodiments of the invention is intended to include any and all combinations of one or more of the associated listed items. The terms "first", "second", and the like in the description and claims of the present disclosure and in the drawings are used for distinguishing between different objects and not for limiting a particular order.
It should be further noted that, in the embodiments of the present invention, each of the following embodiments may be executed alone, or may be executed in combination with each other, and the embodiments of the present invention are not limited in this respect.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The technical solutions of the embodiments of the present invention are further described by the following detailed description with reference to the accompanying drawings.
The embodiment is applicable to the situation of one machine with multiple screens, and is used for connecting one host with multiple display terminals, wherein each display terminal respectively displays one started application program interface, and each display terminal is respectively provided with independent input equipment such as a keyboard and a mouse and the like for independently carrying out user interaction with the application program interface displayed on the display terminal.
Fig. 1 is a schematic structural diagram of a multi-screen control system according to an embodiment of the present invention, which includes a host 110 and a plurality of display terminals (a first display terminal 121, a second display terminal 122 … …, an nth display terminal 123), where the plurality of display terminals respectively display a display interface of a launched application.
It should be noted that, when the host 110 is configured to control the plurality of display terminals, the number of threads used for controlling the plurality of display terminals and the number of cores of the CPU of the host are not limited, and one core may be used, or a plurality of cores may be used, or a single thread may be used to control the plurality of display terminals, or a plurality of threads may be used to control the plurality of display terminals.
Fig. 2 is a flowchart illustrating a multi-screen control method, which can be executed by a multi-screen control device configured in a host, as shown in fig. 2, the multi-screen control method according to the embodiment includes:
in step S210, in response to a user starting an application program, receiving window position information and window size information allocated by the user for a display interface of the application program, determining a display terminal that presents the display interface of the application program according to configuration information corresponding to a predetermined window position positioning manner according to the window position information and the window size information, and presenting the display interface on the determined display terminal, where the application program is provided with a cursor focus.
Each application is provided with a cursor focus, each cursor is stored in an internal stack of the application, and the cursor which is not activated until the next call or the last call is cancelled pops out of the stack for display.
A window with focus can accept keyboard events and the window with input focus is the active window or active window sub-window. And receiving a keyboard pressing event of a certain window part by monitoring the occurrence of a key releasing event, correspondingly processing the event and returning to the window for obtaining the focus, and setting the window for obtaining the focus as an active window. And setting the corresponding window position and window size information output by the main interface window in the created main interface window, and enabling the main interface window to be output and displayed to each display terminal correspondingly.
According to one or more embodiments of the present disclosure, before determining a display terminal that presents a display interface of the application program according to configuration information corresponding to a predetermined window position positioning manner, the plurality of display terminals may be further configured to be an extended screen that is configured to the host according to a predetermined corresponding manner, window position information and window size information corresponding to each display terminal are determined according to a resolution of each display terminal and the predetermined corresponding manner, and the configuration information is generated according to the window position information and the window size information corresponding to each display terminal.
Specifically, absolute coordinates of each display terminal screen are set, and coordinate positions of each interface program are set through a setGeometry function of the embedded Qt. Here, three programs and three display terminals may be taken as an example for explanation, the hardware environment of the solution illustrated in fig. 3 is one host computer plus three display terminals, three display terminals correspondingly run three application programs, fig. 3 is an exemplary schematic diagram of a corresponding relationship between an extension screen supporting the host computer and each display terminal corresponding to the example, if a first application program is displayed on a first display terminal, a second application program is displayed on a second display terminal, and a third application program is displayed on a third display terminal.
Taking the implementation on a domestic operating system channel system as an example, the setting of the absolute coordinates by the application program can be realized by adopting a setGeometry function, the first two parameters of the setGeometry function are used for setting the display position of the application program interface, and the last two energy numbers are used for setting the window size of the application program interface and are expressed by the number of width pixels and the number of height pixels. Taking the positioning manner shown in fig. 3 as an example, when the first application program is started, the absolute coordinates of the first application program are set as follows: setGeometry (0, 1024,768), when the second application is started, setting the absolute coordinates for the second application as: setGeometry (1024,0,1024,768), when the third application is started, setting the absolute coordinates for the third application as: setGeometry (2048,0,1024,768) to meet the requirements of multi-screen displays.
It should be noted that all the applications described in this embodiment are provided with an application cursor. After a user starts an application program through the host computer,
in step S220, a cursor focus of the application is acquired, and the cursor focus is hooked to an event processing signal slot, so as to acquire an input event for the application through the event processing signal slot.
After the program is started, after the program is displayed to a certain display terminal through step S210, the cursor focus of the program needs to be acquired and hung to the event processing signal slot to receive the input event to the program.
For example, the cursor focus of the application program is obtained, and the cursor focus of the main interface can be obtained through the setoverrideccorsor () function. The application forces the cursor to be displayed in all applications' widgets until another setoverlardecursor () is called.
The cursor focus of the application program is obtained, a slot function is created for the main thread, and the QKeyEvent of the embedded Qt creates an event processor which can respond to the event when the key is released and realize the keyboard pressing event for receiving the widget. The widget must initially call setFocusPolicy () to receive focus and get focus to receive the keyboard release event. And simultaneously, a SetActiveWindow () function of the embedded Qt is used for activating the window, so that the window interaction is activated when an event is triggered, and the window is activated in real time by analogy with the focus input on a plurality of display terminals, so that the real-time response and interaction of different screen interfaces are realized. The window must be associated with the message queue of the calling thread.
In step S230, if an input event for the application program is acquired, a display interface of the application program is activated, and the input event is sent to the application program, so that the application program processes the input event.
The obtaining of the input event aiming at the application program comprises obtaining the input event sent by a user through an input device directly connected with the display terminal.
According to one or more embodiments of the present disclosure, in order to increase a response speed to an operation of an external device such as a keyboard and a mouse and reduce a time delay, if input events of a plurality of terminals are processed in multiple threads, the input event processing of each application program may be implemented in a separate thread, for example, an input event sent by an input device directly connected to the display terminal may be scanned by a read thread separately created for the terminal device.
The input device comprises a mouse, a keyboard, a touch screen, an external handwriting board and the like. If the input device is a mouse, a button release event and/or a mouse dragging event sent by a user through the mouse directly connected with the display terminal corresponding to the application program can be acquired. And if the input equipment is a keyboard, acquiring a keyboard input event sent by a user through a keyboard directly connected with the display terminal corresponding to the application program.
In this embodiment, a host responds to a user to start an application program through the host, receives window position information and window size information allocated by the user for a display interface of the application program, determines a display terminal presenting the display interface of the application program according to the window position information and the window size information and configuration information corresponding to a predetermined window position positioning mode, and presents the display interface on the determined display terminal; acquiring a cursor focus of the application program, and hanging the cursor focus to an event processing signal slot so as to acquire an input event aiming at the application program through the event processing signal slot; if the input event aiming at the application program is obtained, the display interface of the application program is activated, the input event is sent to the application program to be processed, different interactive operations can be simultaneously carried out on a plurality of display terminals, each display terminal can be provided with a set of keyboard and mouse for the interaction of the independent display screen applications, the display of the different applications in the environment of one host can be realized, each display terminal can use the independent keyboard and mouse for interaction, the operation is conveniently expanded, the interaction is not influenced, and the efficiency can be effectively improved compared with the case of adopting one display terminal.
As an implementation of the methods shown in the above drawings, the present application provides an embodiment of a multi-screen control device, and fig. 4 is a schematic structural diagram of the multi-screen control device provided in this embodiment, where the embodiment of the device corresponds to the embodiment of the method shown in fig. 2, and the device can be applied to various electronic devices. As shown in fig. 4, the multi-screen control device of the present embodiment is configured in a host of a multi-screen control system, the multi-screen control system includes the host and a plurality of display terminals, and the device includes an application start response unit 410, an event processing signal slot hooking unit 420, and an input event response unit 430.
The application start response unit 410 is configured to, in response to a user starting an application through a host, receive window position information and window size information allocated by the user for a display interface of the application, determine, according to the window position information and the window size information, a display terminal that presents the display interface of the application according to configuration information corresponding to a predetermined window position positioning manner, and present the display interface on the determined display terminal, where the application is provided with a cursor focus.
The event processing signal slot hooking unit 420 is configured to acquire a cursor focus of the application program, and hook the cursor focus to an event processing signal slot, so as to acquire an input event for the application program through the event processing signal slot.
The input event response unit 430 is configured to, if an input event for the application program is acquired, activate a display interface of the application program, and send the input event to the application program, so that the application program processes the input event.
According to one or more embodiments of the present disclosure, the input event response unit 430 is configured to acquire an input event issued by a user through an input device directly connected to the display terminal.
According to one or more embodiments of the present disclosure, the input event response unit 430 is configured to scan an input event issued by an input device directly connected to the display terminal through a read thread separately created for the terminal device.
According to one or more embodiments of the present disclosure, the input device includes at least one of a mouse, a keyboard, a touch screen, and an external handwriting pad.
According to one or more embodiments of the present disclosure, if the input device is a mouse, the input event response unit 430 is configured to obtain a key release event and/or a mouse dragging event sent by a user through a mouse directly connected to a display terminal corresponding to the application program.
According to one or more embodiments of the present disclosure, if the input device is a keyboard, the input event response unit 430 is configured to obtain a keyboard input event sent by a user through a keyboard directly connected to a display terminal corresponding to the application program.
According to one or more embodiments of the present disclosure, the apparatus further includes a configuration information generating unit (not shown in fig. 4), configured to, before determining, according to configuration information corresponding to a predetermined window position positioning manner, a display terminal that presents a display interface of the application program, plan the plurality of display terminals as an extension screen that is configured with the host according to a predetermined corresponding manner, determine, according to a resolution of each display terminal and the predetermined corresponding manner, window position information and window size information that each display terminal corresponds to, and generate the configuration information according to the window position information and the window size information that each display terminal corresponds to.
The multi-screen control device provided by the embodiment can execute the multi-screen control method provided by the embodiment of the method disclosed by the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Referring now to FIG. 5, a block diagram of an electronic device 500 suitable for use in implementing embodiments of the present invention is shown. The terminal device in the embodiment of the present invention is, for example, a mobile device, a computer, or a vehicle-mounted device built in a floating car, or any combination thereof. In some embodiments, the mobile device may include, for example, a cell phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, and the like, or any combination thereof. The electronic device shown in fig. 5 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 5, electronic device 500 may include a processing means (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, embodiments of the invention include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program performs the above-described functions defined in the method of the embodiment of the present invention when executed by the processing apparatus 501.
It should be noted that the computer readable medium mentioned above can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In yet another embodiment of the invention, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: responding to an application program started by a user through a host, receiving window position information and window size information distributed by the user for a display interface of the application program, determining a display terminal for presenting the display interface of the application program according to the window position information and the window size information and configuration information corresponding to a preset window position positioning mode, and presenting the display interface on the determined display terminal, wherein the application program is provided with a cursor focus; acquiring a cursor focus of the application program, and hanging the cursor focus to an event processing signal slot so as to acquire an input event aiming at the application program through the event processing signal slot; and if the input event aiming at the application program is acquired, activating a display interface of the application program, and sending the input event to the application program so that the application program processes the input event.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present invention may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first retrieving unit may also be described as a "unit for retrieving at least two internet protocol addresses".
The foregoing description is only a preferred embodiment of the invention and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure in the embodiments of the present invention is not limited to the specific combinations of the above-described features, but also encompasses other embodiments in which any combination of the above-described features or their equivalents is possible without departing from the spirit of the disclosure. For example, the above features and (but not limited to) the features with similar functions disclosed in the embodiments of the present invention are mutually replaced to form the technical solution.
Claims (12)
1. A multi-screen control method is characterized by being executed by a host in a multi-screen control system, wherein the multi-screen control system comprises the host and a plurality of display terminals, and the method comprises the following steps:
responding to an application program started by a user, receiving window position information and window size information distributed by the user for a display interface of the application program, determining a display terminal for presenting the display interface of the application program according to the window position information and the window size information and configuration information corresponding to a preset window position positioning mode, and presenting the display interface on the determined display terminal, wherein the application program is provided with a cursor focus;
acquiring a cursor focus of the application program, and hanging the cursor focus to an event processing signal slot so as to acquire an input event aiming at the application program through the event processing signal slot;
and if the input event aiming at the application program is acquired, activating a display interface of the application program, and sending the input event to the application program so that the application program processes the input event.
2. The method of claim 1, wherein obtaining input events for the application comprises:
and acquiring an input event sent by a user through an input device directly connected with the display terminal.
3. The method of claim 2, wherein obtaining input events issued by a user via an input device directly connected to the display terminal comprises:
and scanning input events sent by input equipment directly connected with the display terminal through a reading thread independently established for the terminal equipment.
4. The method of claim 1, wherein the input device comprises at least one of a mouse, a keyboard, a touch screen, and an external tablet.
5. The method of claim 4, wherein if the input device is a mouse, acquiring the input event for the application comprises:
and acquiring a key release event and/or a mouse dragging event sent by a user through a mouse directly connected with a display terminal corresponding to the application program.
6. The method of claim 4, wherein if the input device is a keyboard, acquiring the input event for the application comprises:
and acquiring a keyboard input event sent by a user through a keyboard directly connected with the display terminal corresponding to the application program.
7. The method according to claim 1, wherein before determining the display terminal presenting the display interface of the application according to the configuration information corresponding to the predetermined window position positioning manner, the method further comprises:
and the plurality of display terminals are planned to be an expansion screen matched with the host computer according to a preset corresponding mode, window position information and window size information corresponding to each display terminal are determined according to the resolution of each display terminal and the preset corresponding mode, and the configuration information is generated according to the window position information and the window size information corresponding to each display terminal.
8. A multi-screen control apparatus configured in a host of a multi-screen control system, the multi-screen control system including the host and a plurality of display terminals, the apparatus comprising:
an application program starting response unit, configured to respond to a user starting an application program, receive window position information and window size information allocated by the user for a display interface of the application program, determine, according to the window position information and the window size information, a display terminal that presents the display interface of the application program according to configuration information corresponding to a predetermined window position positioning manner, and present the display interface on the determined display terminal, where the application program is provided with a cursor focus;
the event processing signal slot hooking unit is used for acquiring a cursor focus of the application program, hooking the cursor focus to an event processing signal slot and acquiring an input event aiming at the application program through the event processing signal slot;
and the input event response unit is used for activating a display interface of the application program and sending the input event to the application program so that the application program processes the input event if the input event aiming at the application program is acquired.
9. A multi-screen control system is characterized by comprising a host and a plurality of display terminals, wherein the display terminals respectively display a display interface of a started application program;
the host is used for executing the multi-screen control method according to any one of claims 1-7.
10. A multi-screen control system as recited in claim 9, wherein the host includes a plurality of kernels, and a number of the plurality of kernels is not less than a number of the plurality of display terminals.
11. An electronic device, comprising:
one or more processors; and
a memory to store executable instructions that, when executed by the one or more processors, cause the electronic device to perform the method of any of claims 1-7.
12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011630388.5A CN112764563A (en) | 2020-12-31 | 2020-12-31 | Multi-screen control method, device and system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011630388.5A CN112764563A (en) | 2020-12-31 | 2020-12-31 | Multi-screen control method, device and system, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112764563A true CN112764563A (en) | 2021-05-07 |
Family
ID=75699561
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011630388.5A Pending CN112764563A (en) | 2020-12-31 | 2020-12-31 | Multi-screen control method, device and system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112764563A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113177391A (en) * | 2021-05-28 | 2021-07-27 | 掌阅科技股份有限公司 | Method for redirecting operation cursor in streaming interface, computing equipment and storage medium |
| CN113504883A (en) * | 2021-07-08 | 2021-10-15 | 北京字节跳动网络技术有限公司 | Window control method and device, electronic equipment and storage medium |
| CN115016702A (en) * | 2021-09-10 | 2022-09-06 | 荣耀终端有限公司 | Control method and system for selecting application program display screen in extended screen mode |
| CN115454368A (en) * | 2022-09-23 | 2022-12-09 | 扬州万方科技股份有限公司 | Client control method and device for double-display-screen operation console |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05204516A (en) * | 1992-01-30 | 1993-08-13 | Hitachi Ltd | Information processing system and echo-back method for key input |
| CN1200189A (en) * | 1995-09-21 | 1998-11-25 | 埃罗接触系统公司 | Multiuser/multi pointing device graphical user interface system |
| JP2008269615A (en) * | 2007-04-24 | 2008-11-06 | Beijing Kingsoft Software Co Ltd | Method and apparatus for simultaneously displaying mouse pointers in a plurality of display screen areas |
| US20100083122A1 (en) * | 2008-10-01 | 2010-04-01 | International Business Machines Corporation | Systems, methods and computer products for controlling multiple machines using a seamless user-interface to a multi-display |
| CN101893991A (en) * | 2010-07-08 | 2010-11-24 | 上海唯道网络信息技术有限公司 | Multi-screen interactive self-service system and method |
| CN101937315A (en) * | 2010-06-29 | 2011-01-05 | 上海复创计算机信息技术有限公司 | Multi-screen display operation control system and method |
| CN105159537A (en) * | 2015-09-09 | 2015-12-16 | 西南大学 | Multiscreen-based real-time independent interaction system |
| US20170300192A1 (en) * | 2016-04-14 | 2017-10-19 | Samsung Electronics Co., Ltd. | Method of providing multi-screen environment and apparatus thereof |
| CN110109638A (en) * | 2019-05-09 | 2019-08-09 | 深圳超多维科技有限公司 | For the display methods of android terminal, device and android terminal |
| CN110147256A (en) * | 2019-04-03 | 2019-08-20 | 珠海全志科技股份有限公司 | A kind of multi-screen interaction method and device |
| CN111427490A (en) * | 2020-03-30 | 2020-07-17 | 联想(北京)有限公司 | Control method and control device |
-
2020
- 2020-12-31 CN CN202011630388.5A patent/CN112764563A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05204516A (en) * | 1992-01-30 | 1993-08-13 | Hitachi Ltd | Information processing system and echo-back method for key input |
| CN1200189A (en) * | 1995-09-21 | 1998-11-25 | 埃罗接触系统公司 | Multiuser/multi pointing device graphical user interface system |
| JP2008269615A (en) * | 2007-04-24 | 2008-11-06 | Beijing Kingsoft Software Co Ltd | Method and apparatus for simultaneously displaying mouse pointers in a plurality of display screen areas |
| US20100083122A1 (en) * | 2008-10-01 | 2010-04-01 | International Business Machines Corporation | Systems, methods and computer products for controlling multiple machines using a seamless user-interface to a multi-display |
| CN101937315A (en) * | 2010-06-29 | 2011-01-05 | 上海复创计算机信息技术有限公司 | Multi-screen display operation control system and method |
| CN101893991A (en) * | 2010-07-08 | 2010-11-24 | 上海唯道网络信息技术有限公司 | Multi-screen interactive self-service system and method |
| CN105159537A (en) * | 2015-09-09 | 2015-12-16 | 西南大学 | Multiscreen-based real-time independent interaction system |
| US20170300192A1 (en) * | 2016-04-14 | 2017-10-19 | Samsung Electronics Co., Ltd. | Method of providing multi-screen environment and apparatus thereof |
| CN110147256A (en) * | 2019-04-03 | 2019-08-20 | 珠海全志科技股份有限公司 | A kind of multi-screen interaction method and device |
| CN110109638A (en) * | 2019-05-09 | 2019-08-09 | 深圳超多维科技有限公司 | For the display methods of android terminal, device and android terminal |
| CN111427490A (en) * | 2020-03-30 | 2020-07-17 | 联想(北京)有限公司 | Control method and control device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113177391A (en) * | 2021-05-28 | 2021-07-27 | 掌阅科技股份有限公司 | Method for redirecting operation cursor in streaming interface, computing equipment and storage medium |
| CN113177391B (en) * | 2021-05-28 | 2021-11-19 | 掌阅科技股份有限公司 | Method for redirecting operation cursor in streaming interface, computing equipment and storage medium |
| CN113504883A (en) * | 2021-07-08 | 2021-10-15 | 北京字节跳动网络技术有限公司 | Window control method and device, electronic equipment and storage medium |
| CN115016702A (en) * | 2021-09-10 | 2022-09-06 | 荣耀终端有限公司 | Control method and system for selecting application program display screen in extended screen mode |
| CN115016702B (en) * | 2021-09-10 | 2023-10-27 | 荣耀终端有限公司 | Control method and system for selecting application program display screen in extended screen mode |
| CN115454368A (en) * | 2022-09-23 | 2022-12-09 | 扬州万方科技股份有限公司 | Client control method and device for double-display-screen operation console |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112764563A (en) | Multi-screen control method, device and system, electronic equipment and storage medium | |
| US10853979B2 (en) | Electronic device and method for displaying screen thereof | |
| CN109308241B (en) | Method and device for monitoring starting process of application program, terminal equipment and storage medium | |
| US20210357105A1 (en) | Method and apparatus for operating functions of electronic device having flexible display | |
| US20140351729A1 (en) | Method of operating application and electronic device implementing the same | |
| CN110888615A (en) | Multi-input equipment interaction method, device and medium for double-screen different display of Android system | |
| US20200210064A1 (en) | Key Display Method, Terminal, and Non-Transitory Computer-Readable Medium | |
| EP3680765A1 (en) | Navigation bar control method and device | |
| CN109032732B (en) | Notification display method and device, storage medium and electronic equipment | |
| CN114138439A (en) | Task scheduling method and device, electronic equipment and storage medium | |
| CN113784049A (en) | Camera calling method of android system virtual machine, electronic device and storage medium | |
| CN114327087A (en) | Input event processing method and device, electronic equipment and storage medium | |
| CN113419649A (en) | Method for operating electronic device and device thereof | |
| CN110489318B (en) | Systrace information grabbing method and device, storage medium and terminal | |
| CN115604132A (en) | Remote control method and device for server, electronic equipment and readable storage medium | |
| EP4274237A1 (en) | Information display method and apparatus, and device and medium | |
| CN114237743B (en) | Interface loading method and device, electronic equipment and storage medium | |
| CN112596883B (en) | Application switching method and device, storage medium and electronic equipment | |
| CN115269048A (en) | Concurrency control method of application program, electronic device and readable storage medium | |
| CN107390981B (en) | Global menu control method, device, equipment and storage medium | |
| CN110795194B (en) | Desktop display control method, device, terminal and storage medium | |
| CN110874143B (en) | Sensor data acquisition method, intelligent terminal, storage medium and electronic equipment | |
| CN114968010A (en) | Starting method and device of co-processing chip, storage medium and electronic device | |
| CN112306334B (en) | Application assistant calling method and device, storage medium and electronic equipment | |
| KR20130141259A (en) | Method for processing executing image by separating screen and recording-medium recorded program thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |