CN114415877A - Multi-window interaction method, device, equipment and storage medium - Google Patents
Multi-window interaction method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114415877A CN114415877A CN202210089675.2A CN202210089675A CN114415877A CN 114415877 A CN114415877 A CN 114415877A CN 202210089675 A CN202210089675 A CN 202210089675A CN 114415877 A CN114415877 A CN 114415877A
- Authority
- CN
- China
- Prior art keywords
- window
- interaction
- instruction
- event
- collaborative
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a multi-window interaction method, a device, equipment and a computer readable storage medium; the method in the application comprises the following steps: acquiring an operation instruction, and identifying a window attribute in the operation instruction; if the window attribute of the operation instruction is the cooperative window attribute, determining that the window type pointed by the operation instruction is a cooperative window, and determining that the operation instruction is a window interaction instruction; and executing instruction distribution on the window interactive instruction, and distributing the window interactive instruction to the collaborative window. According to the technical scheme, the multiple windows can be driven to simultaneously respond to the interactive command through one interactive command, interaction between the two application windows is realized, and the window interaction scene is enriched.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a multi-window interaction method, apparatus, device, and storage medium.
Background
At present, with the rapid development of the android system, more and more intelligent terminals are increasingly equipped with the android system as an operating system. In the android system, a user sends an interactive instruction to the intelligent terminal in a key and/or touch mode, and the intelligent terminal transmits operation information of the user to a top-layer window to distribute key operation of the user. However, the existing interaction method can only interact for one window individually, when another window needs to be interacted, only the current window can be exited, and the window needing to be interacted is set as the top-level window, the key information can be sent to the window for interaction, and the application scene that multiple windows process the interactive key information together cannot be realized.
Disclosure of Invention
The embodiment of the application provides a multi-window interaction method, a multi-window interaction device and a storage medium, and aims to solve the technical problem that interaction of multiple windows cannot be achieved simultaneously in the prior art.
In one aspect, an embodiment of the present application provides a multi-window interaction method, where the multi-window interaction method includes the following steps:
acquiring a window interaction instruction;
determining a collaborative window according to the window interaction instruction;
distributing the window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-layer window;
and controlling the cooperative window and the top window to execute interactive operation according to the window interactive instruction.
In a possible implementation manner of the present application, before the determining, according to the window interaction instruction, a collaboration window, the method further includes:
accessing a preset collaborative window database to obtain window configuration parameters of an application program;
determining an application window to be configured of the application program according to the window configuration parameters;
adjusting the window attribute of the application window according to the window configuration parameters to obtain a collaborative window;
determining a collaboration window according to the window interaction instruction includes:
and acquiring window attributes carried by the window interaction instruction, and positioning the collaborative window according to the window attributes.
In a possible implementation manner of the present application, the adjusting the window attribute of the application window according to the window configuration parameter to obtain the collaborative window includes:
adjusting the window attribute of the application window according to the window configuration parameter, and driving the application window with the adjusted window attribute to inject a test event into an event distribution thread;
and if the event distribution thread distributes the test event to the top window, setting the application window as a cooperative window.
In a possible implementation manner of the present application, the distributing the window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-level window includes:
acquiring an operation event of the window interaction instruction, and transmitting the operation event to the cooperative window;
and driving the cooperative window to send the operation event to an event distribution thread, and controlling the event distribution thread to distribute the operation event to the top window.
In a possible implementation manner of this application, the driving the cooperative window to send the operation event to an event distribution thread, and controlling the event distribution thread to distribute the operation event to the top-level window includes:
injecting the operation event into the event distribution thread through the cooperative window, and driving the event distribution thread to determine a focus sub-window of the operation event in the top window;
and controlling the event distribution thread to distribute the operation event to a focus sub-window of the top-level window.
In a possible implementation manner of this application, the driving the cooperative window to send the operation event to an event distribution thread, and controlling the event distribution thread to distribute the operation event to the top-level window includes:
acquiring a conversion operation event preset in the collaboration window by the operation event;
and driving the cooperative window to inject the conversion operation event into the event distribution thread, and controlling the event distribution thread to distribute the conversion operation event to the top window.
In a possible implementation manner of the present application, the determining a collaboration window according to the window interaction instruction includes:
acquiring an operation instruction, and identifying a window attribute in the operation instruction;
if the window attribute of the operation instruction is the cooperative window attribute, determining that the window type pointed by the operation instruction is a cooperative window, and determining that the operation instruction is a window interaction instruction.
In another aspect, the present application provides a multi-window interaction apparatus, including:
the instruction acquisition module is configured to acquire a window interaction instruction and determine a collaborative window according to the window interaction instruction;
the instruction coordination module is configured to distribute the window interaction instruction to the coordination window and drive the coordination window to send the window interaction instruction to the top-layer window;
and the multi-window interaction module is configured to control the cooperative window and the top-level window to execute interaction operation according to the window interaction instruction.
On the other hand, the present application further provides a multi-window interaction device, including:
one or more processors;
a memory; and
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the multi-window interaction method.
In another aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is loaded by a processor to execute the steps in the multi-window interaction method.
In the application, an application window pointed by a window interactive instruction is determined to be a cooperative window by acquiring the window interactive instruction and analyzing the window interactive instruction; after determining the corresponding collaborative window, distributing a window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-level window; after the top window receives the window interaction instruction, the cooperative window and the top window are driven to execute corresponding interaction operation according to the window interaction instruction, so that a plurality of windows are driven to simultaneously respond to the interaction instruction through one interaction instruction, interaction between two application windows is realized, and a window interaction scene is enriched.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a scene schematic diagram of a multi-window interaction method according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating an embodiment of a multi-window interaction method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of an embodiment of performing multi-window interaction through a conversion operation event in a multi-window interaction method according to an embodiment of the present application;
fig. 4 is a schematic flowchart of an embodiment of performing a test through a collaboration window in the multi-window interaction method provided in the embodiment of the present application;
FIG. 5 is a flowchart illustrating an embodiment of sending an operation event to a top-level window through a collaboration window in the multi-window interaction method provided in the embodiment of the present application;
FIG. 6 is a schematic structural diagram of an embodiment of a multi-window interaction device provided in an embodiment of the present application;
fig. 7 is a schematic structural diagram of an embodiment of a multi-window interaction device provided in the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be considered as limiting the present invention. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
In this application, the word "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is presented to enable any person skilled in the art to make and use the invention. In the following description, details are set forth for the purpose of explanation. It will be apparent to one of ordinary skill in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and processes are not shown in detail to avoid obscuring the description of the invention with unnecessary detail. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
At present, with the rapid development of the android system, more and more intelligent terminals are increasingly equipped with the android system as an operating system. In the android system, a user sends an interactive instruction to the intelligent terminal in a key and/or touch mode, and the intelligent terminal transmits operation information of the user to a top-layer window to distribute key operation of the user. However, the existing interaction method can only interact for one window individually, when another window needs to be interacted, only the current window can be exited, and the window needing to be interacted is set as the top-level window, the key information can be sent to the window for interaction, and the application scene that multiple windows process the interactive key information together cannot be realized.
Based on this, the application provides a multi-window interaction method, device, equipment and storage medium, and aims to solve the technical problem that multiple windows cannot be interacted simultaneously in the prior art.
The multi-window interaction method in the embodiment of the invention is applied to a multi-window interaction device, the multi-window interaction device is arranged on a multi-window interaction device, one or more processors, a memory and one or more application programs are arranged in the multi-window interaction device, wherein the one or more application programs are stored in the memory and are configured to be executed by the processor to implement the multi-window interaction method; the multi-window interaction device can be an intelligent terminal loaded with an operating system, such as a mobile phone, a tablet computer, an intelligent television, a network device, an intelligent computer and the like; optionally, the multi-window interaction device may also be a server or a service cluster formed by multiple servers.
As shown in fig. 1, fig. 1 is a scene schematic diagram of a multi-window interaction method according to an embodiment of the present application, where a multi-window interaction scene includes a multi-window interaction device 100 (a multi-window interaction apparatus is integrated in the multi-window interaction device 100), and a computer-readable storage medium corresponding to the multi-window interaction method is run in the multi-window interaction device 100 to execute steps of the multi-window interaction method.
It should be understood that the multi-window interaction device in the multi-window interaction method scenario shown in fig. 1, or the apparatuses included in the multi-window interaction device, do not limit the embodiment of the present invention, that is, the number of the multi-window interaction devices included in the multi-window interaction method scenario, the type of the device, or the number of the apparatuses included in each device, the type of the apparatus, do not affect the overall implementation of the technical solution in the embodiment of the present invention, and can be calculated as equivalent replacements or derivatives of the technical solution claimed in the embodiment of the present invention.
The multi-window interaction device 100 in the embodiment of the present invention is mainly used for: acquiring a window interaction instruction;
determining a collaborative window according to the window interaction instruction; distributing the window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-layer window; and controlling the cooperative window and the top window to execute interactive operation according to the window interactive instruction.
The multi-window interaction device 100 in the embodiment of the present invention may be an independent multi-window interaction device, such as an intelligent terminal, e.g., a mobile phone, a tablet computer, an intelligent television, a network device, a server, and an intelligent computer, or may be a multi-window interaction network or a multi-window interaction cluster composed of multiple multi-window interaction devices.
The embodiments of the present application provide a multi-window interaction method, apparatus, device and computer-readable storage medium, which are described in detail below.
Those skilled in the art can understand that the application environment shown in fig. 1 is only one of the application scenarios related to the present application scheme, and does not constitute a limitation on the application scenario of the present application scheme, and that other application environments may further include more or less multi-window interaction devices than those shown in fig. 1, or a multi-window interaction network connection relationship, for example, only one multi-window interaction device is shown in fig. 1, and it is understood that the scenario of the multi-window interaction method may further include one or more multi-window interaction devices, and is not limited herein; the multi-window interactive device 100 may also include a memory for storing window attributes and other data.
It should be noted that the scene diagram of the multi-window interaction method shown in fig. 1 is only an example, and the scene of the multi-window interaction method described in the embodiment of the present invention is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not limit the technical solution provided by the embodiment of the present invention.
Based on the scene of the multi-window interaction method, the invention provides various embodiments of the multi-window interaction method disclosed by the invention.
As shown in fig. 2, fig. 2 is a schematic flowchart of an embodiment of a multi-window interaction method in an embodiment of the present application, where the multi-window interaction method includes the following steps 201-204:
201. acquiring a window interaction instruction;
the multi-window interaction method in this embodiment is applied to a multi-window interaction device, and the type and number of the multi-window interaction device are not specifically limited, that is, the multi-window interaction device may be one or more intelligent terminals or servers, and in a specific embodiment, the multi-window interaction device is a smart phone that carries an android system as an operating system.
When the multi-window interaction equipment runs, receiving a multi-window interaction request, wherein the multi-window interaction request carries a window interaction instruction and drives the multi-window interaction equipment to simultaneously interact with a top window and other windows. The triggering mode of the multi-window interaction request is not specifically limited, that is, the multi-window interaction request may be actively triggered by the user, for example, in order to detect whether the top-level window receives an operation instruction, the user clicks a key detection virtual key or a key detection entity key of the multi-window interaction device, and actively triggers the multi-window interaction request; in addition, the multi-window interaction request may also be automatically triggered by the multi-window interaction device, for example, a timing automatic detection process is preset in the multi-window interaction device, the multi-window interaction device automatically triggers the multi-window interaction request in a preset time period, and optionally, the preset time period of the timing automatic detection process may be set in a user-defined manner according to actual scene requirements.
The multi-window interaction equipment receives the multi-window interaction request, obtains a window interaction instruction carried by the multi-window interaction request, and determines a collaboration window corresponding to the window interaction instruction according to the window interaction instruction.
202. Determining a collaborative window according to the window interaction instruction;
before receiving a multi-window interaction request, the multi-window interaction device presets a collaboration window database, wherein the collaboration window database prestores window configuration parameters of collaboration windows of different application programs. The collaboration window is a specific application window which is preset in each application program and can realize multi-window interaction with the top-level window. Each application may include one or more collaboration windows.
The multi-window interaction equipment accesses the collaborative window database to obtain window configuration parameters of the application program which is stored in the collaborative window database and is adapted to multi-window interaction; the window configuration parameter is used for configuring an application window of an application program, so that the application window is set as a configuration parameter of the collaborative window.
After acquiring the window configuration parameters of the application program, the multi-window interaction device analyzes the window configuration parameters, and determines the application window to be configured in the application program according to the window configuration parameters. Specifically, there may be multiple application windows in an application program, each application window is preset with a different window number, and each application program may configure one or more application windows as collaborative windows.
Specifically, the window configuration parameters include window numbers, the multi-window interaction device locates the application window to be configured of the application program according to the window numbers, and configures the application window into the cooperative window according to the window attribute of the application window to be configured of the window configuration parameters.
Specifically, the multi-window interaction device acquires a multi-window interaction request, acquires an operation instruction carried by the multi-window interaction request, identifies a window attribute in the operation instruction, determines that the operation instruction is a window interaction instruction, acquires the window attribute carried by the window interaction instruction, and positions a collaboration window of a specified application program according to the window attribute, so that the window interaction instruction is distributed to the collaboration window.
203. Distributing the window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-layer window;
the multi-window interaction equipment acquires the multi-window interaction request, intercepts the operation instruction in the multi-window interaction request, judges the window attribute in the intercepted operation instruction, and judges whether the operation instruction is the window interaction instruction for controlling the cooperative window to carry out multi-window interaction according to the window attribute.
Optionally, the multi-window interaction device analyzes the window attribute of the operation instruction, matches the window attribute with a window attribute in a collaborative window database, determines that the window attribute of the operation instruction is the collaborative window attribute if the window attribute of the operation instruction matches with the window configuration parameter in the collaborative window database, determines that the window type pointed by the operation instruction is a collaborative window, and marks the operation instruction as the window interaction instruction.
Optionally, the multi-window interaction device analyzes the window attribute of the operation instruction, matches the window attribute with the window attribute in the cooperative window database, determines that the operation instruction is the window operation instruction if the window attribute of the operation instruction does not match the window configuration parameter in the cooperative window database, that is, the window type corresponding to the window attribute is not the cooperative window, sets the window corresponding to the window attribute as the top-level window, and distributes the window operation instruction to the top-level window.
Specifically, after determining that the operation instruction is a window interaction instruction, the multi-window interaction device stores the window attribute of the window interaction instruction, transmits the window interaction instruction to the cooperative window of the application program, and after receiving the window interaction instruction, the cooperative window analyzes the window interaction instruction, obtains an operation event carried in the window interaction instruction, inputs the operation event into the input event distribution unit, and executes a corresponding key operation.
Specifically, after obtaining an operation event carried by a window interaction instruction, a collaboration window in the multi-window interaction device injects the obtained operation event into an event distribution thread in a key injection manner, and controls the event distribution thread to send the injected operation event to a top-level window of an application program.
204. And controlling the cooperative window and the top window to execute interactive operation according to the window interactive instruction.
The multi-window interaction device distributes the window interaction instruction to the cooperative window of the application program, and controls the cooperative window and the top window of the application program to jointly execute interaction operation according to the window interaction instruction after the received window interaction instruction is sent to the top window of the application program through the cooperative window.
Optionally, when the cooperative windows of the application program in the multi-window interaction device perform interaction operations together according to the window interaction instruction, the operations performed by the cooperative windows according to the window interaction instruction may be the same as the operations performed by the top-level window according to the window interaction instruction; for example, a window interactive instruction in the multi-window interactive device is a window interactive instruction carrying a back key event, the multi-window interactive device sends the window interactive instruction carrying the back key event to the collaboration window and controls the collaboration window to send the window interactive instruction carrying the background key event to the top-level window of the application program, and the multi-window interactive device controls the collaboration window and the top-level window to jointly execute back key interaction according to the window interactive instruction carrying the back key event.
Optionally, when the cooperative windows of the application program in the multi-window interaction device perform interaction operations together according to the window interaction instruction, the operations performed by the cooperative windows according to the window interaction instruction may be different from the operations performed by the top-level window according to the window interaction instruction; that is, according to different requirements of an actual application scenario, a plurality of window interaction instructions for executing different operation events between the collaboration window and the top-level window are preset in the multi-window interaction device, for example, a button conversion window interaction instruction, a top-level response detection window interaction instruction, an automatic test window interaction instruction, and the like are preset in the multi-window interaction device. The multi-window interactive device distributes window interactive instructions for executing different operation events by the collaborative window and the top window to the collaborative window, controls the collaborative window to send the conversion operation event corresponding to the acquired window interactive instruction to the top window, controls the collaborative window to execute the key event in the original window interactive instruction, and controls the top window to execute corresponding interactive operation according to the conversion operation event.
In this embodiment, the multi-window interaction device determines that an application window to which the window interaction instruction points is a collaborative window by acquiring the window interaction instruction and analyzing the window interaction instruction; after determining the corresponding collaborative window, distributing a window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-level window; after the top window receives the window interaction instruction, the cooperative window and the top window are driven to execute corresponding interaction operation according to the window interaction instruction, so that a plurality of windows are driven to simultaneously respond to the interaction instruction through one interaction instruction, interaction between two application windows is realized, and a window interaction scene is enriched.
As shown in fig. 3, fig. 3 is a schematic flowchart of an embodiment of performing multi-window interaction through a conversion operation event in the multi-window interaction method provided in the embodiment of the present application.
Based on the above embodiments, in the embodiment of the present application, a plurality of conversion operation events are preset in the collaboration window, and the conversion operation events are sent to the top-level window for execution after receiving the corresponding window interaction instruction, specifically, the method includes steps 301-302:
301. acquiring a conversion operation event preset in the collaboration window by the operation event;
302. and driving the cooperative window to inject the conversion operation event into the event distribution thread, and controlling the event distribution thread to distribute the conversion operation event to the top window.
In this embodiment, when the multi-window interaction device runs, a conversion operation event database is preset, where the conversion operation event database is used to store mapping relationships of conversion operation events preset in collaboration windows corresponding to different window interaction instructions, and each window interaction instruction used for key conversion corresponds to a specific conversion operation event in the collaboration window.
Specifically, after the multi-window interaction device generates the collaboration window of each application program, one or more customized conversion keys are preset in the collaboration window, the key event conversion is performed through the customized conversion keys, and the converted key event is sent to the top-level window. After the conversion key of the collaborative window is generated, the conversion operation event of the conversion key and the corresponding window interaction instruction are subjected to associated mapping, and the mapping relation of the conversion operation event preset in the collaborative window corresponding to the window interaction instruction is stored in a preset conversion operation event database.
After the cooperative window and the conversion operation event database are configured, the multi-window interaction device receives a conversion window interaction instruction, wherein the conversion window interaction instruction is a window interaction instruction for driving the cooperative window to perform key event conversion. After receiving a conversion window interactive instruction, obtaining a window attribute in the conversion window interactive instruction, positioning the conversion window interactive instruction into a cooperative window of a corresponding application program according to the window attribute, executing key distribution on the conversion window interactive instruction, distributing the conversion window interactive instruction into the cooperative window, controlling the cooperative window to call a conversion operation event database, obtaining a mapping relation of a conversion operation event corresponding to the conversion window interactive instruction, and performing key conversion on the operation event in the conversion window interactive instruction according to the mapping relation, thereby generating the conversion operation event.
And performing key conversion in the cooperative window, after a conversion operation event is generated, controlling the cooperative window by the multi-window interactive device to inject the conversion operation event into an event distribution process, and distributing the conversion operation event to a top-layer window of the application program through the event distribution process.
And after the multi-window interactive device distributes the conversion operation event to the top-level window through the event distribution process, driving the top-level window to execute corresponding window interactive operation according to the conversion operation event, so as to realize key conversion interaction between the collaborative window and the top-level window.
Optionally, in a specific embodiment, a multi-window interaction device receives a window interaction instruction sent by a user, determines that a window attribute of the window interaction instruction is matched with a first collaboration window of an application program, the multi-window interaction device executes key distribution on the first collaboration window according to the window attribute, after the first collaboration window obtains the window interaction instruction, accesses a conversion operation event database, determines that a conversion operation event corresponding to an operation event in the window interaction instruction is a screenshot operation event, and converts the operation event in the window interaction instruction to obtain the screenshot operation event; the multi-window interaction device drives the cooperative window to inject the screenshot operation event into an event distribution process, the event distribution process is controlled to distribute the converted screenshot operation event to the top window, the cooperative window is controlled to execute the unconverted operation event, and the top window is driven to perform screenshot interaction operation according to the screenshot operation event.
In this embodiment, the multi-window interaction device sends the window interaction instruction to the cooperative window by obtaining the window interaction instruction, obtains an operation event by analyzing the window interaction instruction through the cooperative window, and obtains a conversion operation event of the operation instruction in the cooperative window; after the conversion operation event is obtained, the multi-window interactive device drives the cooperative window to inject the conversion operation event into an event distribution thread, the event distribution thread is controlled to distribute the conversion operation event to the top-level window, the cooperative window is driven to execute the unconverted operation event, and the top-level window is driven to carry out conversion interactive operation according to the conversion operation event. And realizing multi-window interaction of the collaboration window and the top-level window, and realizing different interactive operations executed by the collaboration window and the top-level window, thereby enriching application scenes.
As shown in fig. 4, fig. 4 is a schematic flowchart of an embodiment of performing a test through a collaboration window in the multi-window interaction method provided in the embodiment of the present application.
Based on the above embodiments, in the embodiment of the present application, the interaction between the top-layer window and the collaboration window is performed through a test event preset in the collaboration window, specifically, the method includes step 401 — step 402:
401. adjusting the window attribute of the application window according to the window configuration parameter, and driving the application window with the adjusted window attribute to inject a test event into an event distribution thread;
402. and if the event distribution thread distributes the test event to the top window, setting the application window as a cooperative window.
Specifically, after obtaining the window configuration parameter, the multi-window interaction device locates the application window specified in the application program pointed by the window configuration parameter, adjusts the window attribute of the application window specified in the application program according to the window configuration parameter, writes a test event in the application window with the adjusted window attribute, and performs a collaborative test on the application window with the adjusted window attribute.
Specifically, the multi-window interaction device sends a test instruction to the application window with the adjusted window attribute, drives the application window with the adjusted window attribute to send the written test event to the top-level window, that is, drives the application window with the adjusted window attribute to inject the test event into the event distribution thread, controls the event distribution thread to distribute the test event to the top-level window, and determines whether the application window is successfully configured by detecting whether the top-level window responds to the test event.
Optionally, if the application window with the adjusted window attribute is driven to inject the test event into the event distribution thread, and the event distribution thread is controlled to distribute the test event to the top-level window, and after it is detected that the top-level window makes a corresponding interactive response according to the test event within a preset time, it is determined that the application window with the adjusted window attribute passes the test, and the application window is set as the collaboration window.
Optionally, if the application window with the adjusted window attribute injects the test event into the event distribution thread, and the event distribution thread is controlled to distribute the test event to the top-level window, and after it is not detected that the top-level window makes a corresponding interactive response according to the test event within a preset time, it is determined that the application window with the adjusted window attribute passes the test, and the application window is subjected to collaborative setting again.
Specifically, after the multi-window interaction device performs the cooperative test on the cooperative window, the multi-window interaction device also performs the automatic detection on the top-level window through the test event in the cooperative window. Specifically, the multi-window interaction device solidifies the test event in the collaboration window, receives an automated test window interaction instruction, distributes the automated test window interaction instruction to the collaboration window, drives the collaboration window to execute the test event according to the automated test window interaction instruction, generates a corresponding test key event from the test event, injects the test key event into an event distribution thread, controls the event distribution thread to distribute the test key event to the top window, and drives the top window to perform visual automated testing.
In this embodiment, the multi-window interaction device drives the application window with the adjusted window attribute to inject the test event into the event distribution thread by adjusting the window attribute of the application window according to the window configuration parameter, and controls the event distribution thread to distribute the test event to the top-level window; and if the application window with the adjusted window attribute passes the test, setting the application window as a cooperative window. The interaction between the collaboration window and the top window is realized, the automatic detection operation of the top window through the collaboration window is realized, and the application scene is enriched.
As shown in fig. 5, fig. 5 is a flowchart illustrating an embodiment of sending an operation event to a top-level window through a collaboration window in the multi-window interaction method provided in the embodiment of the present application.
In the embodiment of the present application, an operation event is injected into an event distribution thread through a collaboration window, and the operation event is distributed to a top-level window through the event distribution thread, specifically, the method includes step 501-step 502:
501. injecting the operation event into the event distribution thread through the cooperative window, and driving the event distribution thread to determine a focus sub-window of the operation event in the top window;
502. and controlling the event distribution thread to distribute the operation event to a focus sub-window of the top-level window.
After the multi-window interaction device obtains the window interaction instruction and determines the cooperative window of the application program according to the window interaction instruction, the multi-window interaction device obtains the operation event in the window interaction instruction and transmits the operation event to the cooperative window.
After the cooperative window acquires the operation event, the operation event is injected into an event distribution process, after the event distribution process acquires the operation event, the operation event is analyzed, a focus sub-window corresponding to the operation event is determined, a focus window attribute of the focus sub-window is acquired, the operation event is distributed through the focus window attribute, the operation event is distributed to a focus sub-window corresponding to a top layer window according to the focus window attribute to be triggered, and the focus sub-window is controlled to execute corresponding interactive operation.
Specifically, the multi-window interaction device can perform key detection on each focus sub-window in the top-level window according to the collaboration window, and determine whether the focus sub-window can receive a corresponding operation event. When the multi-window interactive device runs, receiving a key detection window interactive instruction, acquiring a key detection event in the key detection window interactive instruction, and sends the key detection event to the collaboration window, which responds to the key detection event, after the key detection event is detected, the key detection event is injected into an event distribution process, the key detection event is analyzed by the event distribution process after the key detection event is obtained, a focus sub-window corresponding to the key detection event is determined, the focus window attribute of the focus sub-window is obtained, the key detection event is distributed through the focus window attribute, and distributing the key detection event to a focus sub-window corresponding to the top window according to the focus window attribute, controlling the focus sub-window to execute corresponding interactive operation, and detecting the response condition of the focus sub-window.
If the event distribution process sends the key detection event to the focus sub-window, the focus sub-window does not correspond to the key detection event, and the focus sub-window is determined to have no response, namely the key corresponding to the focus sub-window is abnormal;
if the event distribution process sends the key detection event to the focus sub-window, the focus sub-window performs correspondence according to the key detection event, and the focus sub-window can normally respond, that is, the keys of the focus sub-window are determined to be normal.
In this embodiment, after receiving a window protection instruction, the multi-window interaction device injects the operation event into the event distribution thread through the cooperative window, and drives the event distribution thread to determine a focus sub-window of the operation event in the top-level window; controlling the event distribution thread to distribute the operation event to a focus sub-window of the top-level window; and controlling the focus sub-window to execute corresponding interactive operation. The interaction of two application windows is realized, and the window interaction scene is enriched.
In order to better implement the multi-window interaction method in the embodiment of the present application, on the basis of the multi-window interaction method, a multi-window interaction device is further provided in the embodiment of the present application, as shown in fig. 6, fig. 6 is a schematic structural diagram of an embodiment of the multi-window interaction device provided in the embodiment of the present application. The multi-window interaction device 600 comprises the following modules 601-603:
an instruction obtaining module 601, configured to obtain a window interaction instruction, and determine a collaboration window according to the window interaction instruction;
an instruction coordination module 602, configured to distribute the window interaction instruction to the coordination window, and drive the coordination window to send the window interaction instruction to the top-level window;
a multi-window interaction module 603 configured to control the collaboration window and the top-level window to perform an interaction operation according to the window interaction instruction.
In some embodiments of the present application, before the multi-window interacting device 600 determines the collaborative window according to the window interaction instruction, the method further includes:
accessing a preset collaborative window database to obtain window configuration parameters of an application program;
determining an application window to be configured of the application program according to the window configuration parameters;
adjusting the window attribute of the application window according to the window configuration parameters to obtain a collaborative window;
determining a collaboration window according to the window interaction instruction includes:
and acquiring window attributes carried by the window interaction instruction, and positioning the collaborative window according to the window attributes.
In some embodiments of the present application, the adjusting, by the multi-window interaction apparatus 600, the window attribute of the application window according to the window configuration parameter to obtain the collaboration window includes:
adjusting the window attribute of the application window according to the window configuration parameter, and driving the application window with the adjusted window attribute to inject a test event into an event distribution thread;
and if the event distribution thread distributes the test event to the top window, setting the application window as a cooperative window.
In some embodiments of the present application, the distributing the window interaction instruction to the collaborative window by the multi-window interaction apparatus 600, and driving the collaborative window to send the window interaction instruction to the top-level window includes:
acquiring an operation event of the window interaction instruction, and transmitting the operation event to the cooperative window;
and driving the cooperative window to send the operation event to an event distribution thread, and controlling the event distribution thread to distribute the operation event to the top window.
In some embodiments of the present application, the multi-window interacting device 600 drives the cooperative window to send the operation event to an event distribution thread, and controls the event distribution thread to distribute the operation event to the top-level window, including:
injecting the operation event into the event distribution thread through the cooperative window, and driving the event distribution thread to determine a focus sub-window of the operation event in the top window;
and controlling the event distribution thread to distribute the operation event to a focus sub-window of the top-level window.
In some embodiments of the present application, the multi-window interacting device 600 drives the cooperative window to send the operation event to an event distribution thread, and controls the event distribution thread to distribute the operation event to the top-level window, including:
acquiring a conversion operation event preset in the collaboration window by the operation event;
and driving the cooperative window to inject the conversion operation event into the event distribution thread, and controlling the event distribution thread to distribute the conversion operation event to the top window.
In some embodiments of the present application, the determining, by the multi-window interacting device 600, the collaborative window according to the window interaction instruction includes:
acquiring an operation instruction, and identifying a window attribute in the operation instruction;
if the window attribute of the operation instruction is the cooperative window attribute, determining that the window type pointed by the operation instruction is a cooperative window, and determining that the operation instruction is a window interaction instruction.
In this embodiment, the multi-window interaction device determines that an application window to which the window interaction instruction points is a collaborative window by acquiring the window interaction instruction and analyzing the window interaction instruction; after determining the corresponding collaborative window, distributing a window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-level window; after the top window receives the window interaction instruction, the cooperative window and the top window are driven to execute corresponding interaction operation according to the window interaction instruction, so that a plurality of windows are driven to simultaneously respond to the interaction instruction through one interaction instruction, interaction between two application windows is realized, and a window interaction scene is enriched.
An embodiment of the present invention further provides a multi-window interaction device, as shown in fig. 7, fig. 7 is a schematic structural diagram of an embodiment of the multi-window interaction device provided in the embodiment of the present application.
The multi-window interaction device integrates any one of the multi-window interaction devices provided by the embodiment of the invention, and comprises:
one or more processors;
a memory; and
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor for performing the steps of the multi-window interaction method described in any of the above-described embodiments of the multi-window interaction method.
Specifically, the method comprises the following steps: the multi-window interaction device may include components such as a processor 701 of one or more processing cores, memory 702 of one or more computer-readable storage media, a power supply 703, and an input unit 704. Those skilled in the art will appreciate that the multi-window interactive apparatus configuration shown in fig. 7 does not constitute a limitation of multi-window interactive apparatuses and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the processor 701 is a control center of the multi-window interactive apparatus, connects various parts of the whole multi-window interactive apparatus by using various interfaces and lines, and performs various functions of the multi-window interactive apparatus and processes data by running or executing software programs and/or modules stored in the memory 702 and calling data stored in the memory 702, thereby performing overall monitoring of the multi-window interactive apparatus. Optionally, processor 701 may include one or more processing cores; preferably, the processor 701 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 701.
The memory 702 may be used to store software programs and modules, and the processor 701 executes various functional applications and data processing by operating the software programs and modules stored in the memory 702. The memory 702 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the multi-window interactive apparatus, and the like. Further, the memory 702 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 702 may also include a memory controller to provide the processor 701 with access to the memory 702.
The multi-window interactive device further comprises a power supply 703 for supplying power to each component, preferably, the power supply 703 may be logically connected to the processor 701 through a power management system, so as to implement functions of managing charging, discharging, power consumption management, and the like through the power management system. The power supply 703 may also include any component including one or more of a dc or ac power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The multi-window interactive apparatus may further include an input unit 704, and the input unit 704 may be used to receive input numeric or character information and generate a keyboard, mouse, joystick, optical or trackball signal input in relation to user setting and function control.
Although not shown, the multi-window interactive apparatus may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 701 in the multi-window interaction device loads the executable file corresponding to the process of one or more application programs into the memory 702 according to the following instructions, and the processor 701 runs the application program stored in the memory 702, thereby implementing various functions as follows:
acquiring a window interaction instruction;
determining a collaborative window according to the window interaction instruction;
distributing the window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-layer window;
and controlling the cooperative window and the top window to execute interactive operation according to the window interactive instruction. In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed descriptions of other embodiments, and are not described herein again.
In a specific implementation, each unit or structure may be implemented as an independent entity, or may be combined arbitrarily to be implemented as one or several entities, and the specific implementation of each unit or structure may refer to the foregoing method embodiment, which is not described herein again.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
The multi-window interaction method provided by the embodiment of the present application is described in detail above, and the principle and the implementation of the present invention are explained in this document by applying specific embodiments, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A multi-window interaction method is characterized by comprising the following steps:
acquiring a window interaction instruction;
determining a collaborative window according to the window interaction instruction;
distributing the window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to the top-layer window;
and controlling the cooperative window and the top window to execute interactive operation according to the window interactive instruction.
2. The multi-window interaction method according to claim 1, wherein before determining the collaborative window according to the window interaction instruction, the method further comprises:
accessing a preset collaborative window database to obtain window configuration parameters of an application program;
determining an application window to be configured of the application program according to the window configuration parameters;
adjusting the window attribute of the application window according to the window configuration parameters to obtain a collaborative window;
determining a collaboration window according to the window interaction instruction includes:
and acquiring window attributes carried by the window interaction instruction, and positioning the collaborative window according to the window attributes.
3. The multi-window interaction method of claim 2, wherein the adjusting the window attribute of the application window according to the window configuration parameter to obtain the collaborative window comprises:
adjusting the window attribute of the application window according to the window configuration parameter, and driving the application window with the adjusted window attribute to inject a test event into an event distribution thread;
and if the event distribution thread distributes the test event to the top window, setting the application window as a cooperative window.
4. The multi-window interaction method of claim 1, wherein the distributing the window interaction instruction to the collaborative window, and driving the collaborative window to send the window interaction instruction to a top-level window, comprises:
acquiring an operation event of the window interaction instruction, and transmitting the operation event to the cooperative window;
and driving the cooperative window to send the operation event to an event distribution thread, and controlling the event distribution thread to distribute the operation event to the top window.
5. The multi-window interaction method of claim 4, wherein the driving the collaborative window to send the operation event to an event distribution thread, controlling the event distribution thread to distribute the operation event to the top-level window, comprises:
injecting the operation event into the event distribution thread through the cooperative window, and driving the event distribution thread to determine a focus sub-window of the operation event in the top window;
and controlling the event distribution thread to distribute the operation event to a focus sub-window of the top-level window.
6. The multi-window interaction method of claim 4, wherein the driving the collaborative window to send the operation event to an event distribution thread, controlling the event distribution thread to distribute the operation event to the top-level window, comprises:
acquiring a conversion operation event preset in the collaboration window by the operation event;
and driving the cooperative window to inject the conversion operation event into the event distribution thread, and controlling the event distribution thread to distribute the conversion operation event to the top window.
7. The multi-window interaction method according to any one of claims 1 to 6, wherein the determining a collaborative window according to the window interaction instruction comprises:
acquiring an operation instruction, and identifying a window attribute in the operation instruction;
if the window attribute of the operation instruction is the cooperative window attribute, determining that the window type pointed by the operation instruction is a cooperative window, and determining that the operation instruction is a window interaction instruction.
8. A multi-window interactive apparatus, comprising:
the instruction acquisition module is configured to acquire a window interaction instruction and determine a collaborative window according to the window interaction instruction;
the instruction coordination module is configured to distribute the window interaction instruction to the coordination window and drive the coordination window to send the window interaction instruction to the top-layer window;
and the multi-window interaction module is configured to control the cooperative window and the top-level window to execute interaction operation according to the window interaction instruction.
9. A multi-window interactive device, comprising:
one or more processors;
a memory; and
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the multi-window interaction method of any of claims 1-7.
10. A computer-readable storage medium, having stored thereon a computer program which is loaded by a processor for performing the steps of the multi-window interaction method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210089675.2A CN114415877A (en) | 2022-01-25 | 2022-01-25 | Multi-window interaction method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210089675.2A CN114415877A (en) | 2022-01-25 | 2022-01-25 | Multi-window interaction method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114415877A true CN114415877A (en) | 2022-04-29 |
Family
ID=81278083
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210089675.2A Pending CN114415877A (en) | 2022-01-25 | 2022-01-25 | Multi-window interaction method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114415877A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120124485A1 (en) * | 2010-11-15 | 2012-05-17 | International Business Machines Corporation | Embedding tools in a collaboration window |
| CN103630719A (en) * | 2012-08-23 | 2014-03-12 | 特克特朗尼克公司 | Trigger display |
| CN104834586A (en) * | 2014-02-10 | 2015-08-12 | 腾讯科技（深圳）有限公司 | Automatic test method, device and system of Android interface |
| CN112579221A (en) * | 2019-09-29 | 2021-03-30 | 北京国双科技有限公司 | Modal popup display method and device |
| US11150861B1 (en) * | 2020-06-25 | 2021-10-19 | Coscreen, Inc. | Apparatus and method for simultaneous multi-user screen and window sharing, capturing and coordination |
| CN113873679A (en) * | 2021-09-17 | 2021-12-31 | 荣耀终端有限公司 | Collaborative window processing method and system and electronic equipment |
| CN113961157A (en) * | 2020-07-21 | 2022-01-21 | 华为技术有限公司 | Display interaction system, display method and equipment |
-
2022
- 2022-01-25 CN CN202210089675.2A patent/CN114415877A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120124485A1 (en) * | 2010-11-15 | 2012-05-17 | International Business Machines Corporation | Embedding tools in a collaboration window |
| CN103630719A (en) * | 2012-08-23 | 2014-03-12 | 特克特朗尼克公司 | Trigger display |
| CN104834586A (en) * | 2014-02-10 | 2015-08-12 | 腾讯科技（深圳）有限公司 | Automatic test method, device and system of Android interface |
| CN112579221A (en) * | 2019-09-29 | 2021-03-30 | 北京国双科技有限公司 | Modal popup display method and device |
| US11150861B1 (en) * | 2020-06-25 | 2021-10-19 | Coscreen, Inc. | Apparatus and method for simultaneous multi-user screen and window sharing, capturing and coordination |
| CN113961157A (en) * | 2020-07-21 | 2022-01-21 | 华为技术有限公司 | Display interaction system, display method and equipment |
| CN113873679A (en) * | 2021-09-17 | 2021-12-31 | 荣耀终端有限公司 | Collaborative window processing method and system and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8041437B2 (en) | System and method for virtual control of laboratory equipment | |
| US11809882B2 (en) | Interface calling method and apparatus, and computer-readable storage medium | |
| CN112316417B (en) | Control equipment connection method, device, equipment and computer readable storage medium | |
| CN112379963B (en) | Remote application window control method and device and computer equipment | |
| CN103699485A (en) | Application program debugging method and device | |
| CN113535541A (en) | Test method, test device, storage medium and computer equipment | |
| CN114415877A (en) | Multi-window interaction method, device, equipment and storage medium | |
| CN108255403B (en) | Information annotation system, method, device and storage medium | |
| CN115604132A (en) | Remote control method and device for server, electronic equipment and readable storage medium | |
| CN115600213A (en) | Vulnerability management method, device, medium and equipment based on application program | |
| CN114218041A (en) | Dynamic process monitoring method, device, equipment and storage medium | |
| CN114489892A (en) | Data processing method, data processing device, computer readable storage medium and computer equipment | |
| CN110874143B (en) | Sensor data acquisition method, intelligent terminal, storage medium and electronic equipment | |
| CN114155636A (en) | Device control method, device, electronic device and storage medium | |
| CN113971191A (en) | Data import method and device and computer readable storage medium | |
| CN114884720B (en) | Resource request processing method, device, electronic equipment and storage medium | |
| CN113849356B (en) | Equipment testing method and device, electronic equipment and storage medium | |
| CN113760750B (en) | Intelligent device testing method and device, electronic device and storage medium | |
| CN115827486A (en) | Data verification method and device, computer equipment and storage medium | |
| CN114390436A (en) | Device control method, device, storage medium and electronic device | |
| CN116679948A (en) | Application updating method, device, equipment and storage medium | |
| CN115378925A (en) | Abnormal request capturing method and device, electronic equipment and storage medium | |
| CN116149696A (en) | System interface migration method and device, computer equipment and storage medium | |
| CN115934736A (en) | Data docking method, device, equipment and storage medium | |
| CN117311571A (en) | Equipment identification method and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |