CN112947815B - Multi-window interaction method and system, readable storage medium and electronic device - Google Patents
Multi-window interaction method and system, readable storage medium and electronic device Download PDFInfo
- Publication number
- CN112947815B CN112947815B CN202110457672.5A CN202110457672A CN112947815B CN 112947815 B CN112947815 B CN 112947815B CN 202110457672 A CN202110457672 A CN 202110457672A CN 112947815 B CN112947815 B CN 112947815B
- Authority
- CN
- China
- Prior art keywords
- window
- signal source
- target window
- title bar
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a multi-window interaction method, which comprises the following steps: adjusting a target window to a first display mode in response to a capture mouse entering the target window; in a first display mode, displaying a title bar corresponding to the target window in the target window, reducing a signal source display area in the target window and enabling a signal source to be displayed in the reduced signal source display area; adjusting the target window to a second display mode in response to the capture mouse leaving the target window; and hiding the title bar, recovering the signal source display area in the target window and displaying the signal source in the recovered signal source display area in a second display mode. By the method and the device, the played signal source can be directly checked, edited or controlled in the multi-window display interface of the terminal according to the requirement, and meanwhile, the monitoring of the signal sources in other windows is not lost, so that the monitoring and interaction efficiency of the multi-signal source is improved.
Description
Technical Field
The invention relates to the field of computer interaction, in particular to a multi-window interaction method, a multi-window interaction system, a readable storage medium and electronic equipment.
Background
In the technical field of large-screen display control, in order to realize the monitoring of a plurality of signal sources on a large screen, the signal source content and the signal source layout displayed by a seat computer are completely consistent with the large screen; when the information of the signal source at a certain display position needs to be specifically checked on the agent computer, the signal source monitoring picture on the current agent needs to be exited, another static editing interface is entered, the signal source configured at the display position and the related information of the signal source are checked under the static editing interface, the whole process is complex, the interaction efficiency is low, and the real-time monitoring of other signal sources on a large screen is lost.
Disclosure of Invention
In view of the foregoing prior art, embodiments of the present invention provide a multi-window interaction method, system, readable storage medium, and electronic device.
A first aspect of the present invention provides a multi-window interaction method, where each window is used to display a signal source, and the multi-window interaction method includes:
adjusting a target window to a first display mode in response to a capture mouse entering the target window;
in a first display mode, displaying a title bar corresponding to the target window in the target window, reducing a signal source display area in the target window and enabling a signal source to be displayed in the reduced signal source display area;
adjusting the target window to a second display mode in response to the capture mouse leaving the target window;
and hiding the title bar, recovering the signal source display area in the target window and displaying the signal source in the recovered signal source display area in a second display mode.
According to some embodiments of the present invention, the title field is located at any peripheral position of the target window.
According to some embodiments of the present invention, the position and size of the title bar with respect to the windows are previously set according to the respective windows, or the position and size of the title bar are changed according to the change in the position and size of the respective windows.
According to some embodiments of the invention, the reducing the signal source display area within the target window comprises:
acquiring the height of the title bar of the target window; and reducing the height of the title bar in a direction perpendicular to the title bar, or reducing the whole signal source display area.
According to some embodiments of the invention, the method further comprises: pre-acquiring an identifier of a signal source associated with the window; and, pre-obtaining a name of a signal source associated with the window.
According to some embodiments of the invention, the signal source comprises a video stream signal source, the method further comprising:
and playing a video stream in a signal source display area in the target window, wherein the video stream is obtained by decoding a signal source related to the target window.
According to some embodiments of the invention, the method further comprises:
and displaying the identification of the signal source, the name of the signal source or the control in a title bar in the target window.
According to some embodiments of the present invention, in the first display mode, other windows outside the target window hide the title bar and leave the respective signal source display areas unchanged.
A third aspect of the present invention provides a multi-window interactive system, each window being used for displaying a signal source, the multi-window interactive system comprising:
the server is connected with the command screen through a video line and is in communication connection with the signal sources, adjusts the window layout according to the scheduling instruction, draws the corresponding signal sources in each window, and outputs the drawing result to the command screen for display;
the command screen is used for displaying the drawing result output by the server; and
and the terminal is in communication connection with the server and is used for acquiring window layout information in the server and information of the signal source corresponding to each window so as to ensure that the windows on the terminal and the signal sources displayed in the windows are kept synchronous with the command screen, and the method is executed in response to mouse operation.
A fourth aspect of the present invention provides a multi-window interactive system, each window for displaying a signal source, the multi-window interactive system comprising:
the splicing processor is connected with the signal source;
the server is in communication connection with the splicing processor and the signal source, controls the splicing processor according to the scheduling instruction so as to adjust the window layout, draws the corresponding signal source in each window and outputs the drawing result to the splicing command screen for displaying;
the splicing command screen is used for displaying the drawing result output by the splicing processor; and
and the terminal is in communication connection with the server and is used for acquiring window layout information in the server and information of the signal source corresponding to each window so as to ensure that the window on the terminal and the signal source displayed in the window are kept synchronous with the splicing command screen, and the method is executed in response to mouse operation.
A fourth aspect of the invention provides a computer readable storage medium storing computer program instructions which, when executed by a processor, implement the method.
A fifth aspect of the invention provides an electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method.
Through the embodiment of the invention, the related information of the signal source in a target window can be directly and rapidly called in the multi-window display interface of the terminal aiming at a certain target window, whether the played signal source is correct or not is determined, the played signal source is edited or controlled according to the requirement, and meanwhile, the monitoring of the signal source in other windows is not lost, so that the multi-signal-source monitoring and interaction efficiency is improved.
Drawings
The above and other objects, features and advantages of the present invention will become more apparent from the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:
FIG. 1a is a schematic diagram of a multi-window interactive system according to some embodiments of the present invention;
FIG. 1b is a schematic diagram of a multi-window interaction system, according to some embodiments of the invention;
FIG. 2 is a flow diagram of a multi-window interaction method according to some embodiments of the invention;
FIGS. 3a and 3b are schematic illustrations of a first display mode of a window according to some embodiments of the invention;
FIG. 4 is a schematic diagram of a title bar of a window according to some embodiments of the invention;
FIG. 5 is a schematic illustration of a second display mode of a window according to some embodiments of the invention;
FIG. 6 is a flow diagram of a specific example of a multi-window interaction method according to some embodiments of the invention;
FIG. 7 is a schematic diagram of a window play video stream, according to some embodiments of the invention;
FIG. 8 is a schematic illustration of a window play video stream according to some embodiments of the invention;
FIG. 9 is a schematic diagram of a window interaction device, according to some embodiments of the invention;
FIG. 10 is a schematic view of an electronic device according to some embodiments of the inventions.
Detailed Description
To make the objects, technical solutions and advantages of some embodiments according to the present invention clearer, technical solutions of some embodiments according to the present invention will be described clearly and completely with reference to the accompanying drawings of some embodiments according to the present invention, and it is obvious that the described embodiments are some but not all embodiments of the present invention.
Further, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.
Unless the context clearly requires otherwise, throughout the description, the words "comprise", "comprising", and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is, what is meant is "including, but not limited to".
In the description of the present invention, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified.
In the present application, the nature of the description related to the implementation through the network is intended to cover both the wired or wireless network connection implemented through the necessary firmware or software of the switch, the router, etc., and the wired or wireless network connection implemented through the intermediary of some servers or other computers, etc., and the description of the router/switch is sometimes omitted when describing the network connection for the sake of simplifying the description and highlighting the invention point. In the present application, the networks involved may include Wi-fi networks, bluetooth networks, private Area Networks (PAN), local Area Networks (LAN), wide Area Networks (WAN), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), general Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), universal Mobile Telecommunications System (UMTS), digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), integrated digital enhanced network (iDEN), wiMAX, LTE advanced, mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, such as a VPN.
It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
FIG. 1a is a schematic diagram of a multi-window interactive system according to some embodiments of the present invention.
As shown in FIG. 1a, a multi-window interaction system according to some embodiments of the present invention includes: a command screen 10, a server 20 and a terminal 40.
The server 20 according to some embodiments of the present invention may be one server, a server cluster, or a cloud server.
The terminal 40 may be an electronic device such as a mobile phone, a tablet computer, a multimedia player, a wearable device, a personal computer, etc.
The server 20 is connected to the signal source in communication, for example, through a network, and specifically, the server 20 can receive the signal source 210, the signal source 211 … …, the signal source n, and the like. The server 20 receives scheduling instructions that the instruction receiving device (not shown) interprets or may receive other instructions from the network. The instruction receiving device is used for resolving the scheduling instruction and comprises: mouse, keyboard, body feeling sensor, touch equipment, laser equipment, speech conversion equipment, wearable equipment etc.. The server 20 is connected with the command screen 10 through a video cable, the server 20 adjusts the window layout according to the scheduling instruction, draws the corresponding signal sources 210 and 211 in each window, and outputs the drawing result to be displayed by the command screen 10. The adjusting of the window layout comprises adjusting the size, the position, the stacking sequence and the like of each window on the command screen. According to some embodiments of the present invention, the server 20 may include a splicing processor 21, and the server controls the splicing processor 21 according to the scheduling instruction to control the presentation manner of each window on the command screen 10 and to display the signal sources 210 and 211 in the corresponding windows. According to some embodiments of the invention, the stitching processor may run in software in a server or may also exist in hardware.
The terminal 40 is communicatively connected to the server 20, for example, via a network connection, and is used to obtain window information in the server 20 and signal source information corresponding to each window, so that the windows on the terminal and the signal sources displayed in the windows are synchronized with the command screen 10. When the server 20 adjusts the window layout according to the scheduling instruction analyzed by the instruction receiving device, the terminal 40 needs to establish a connection with the server 20, and receive the window layout information on the server 20, so that each window of the terminal 40 is synchronized with each window on the command screen 10, and each signal source is output to the corresponding window.
The terminal 40 can also interact with the windows independently, for example, according to some embodiments of the invention, the terminal 40 can perform the following multi-window interaction method: in a default state, the windows played on the terminal 40 do not display the title bar in each window, and when the capture mouse enters one of the windows (or called target windows), the video playing area (or called signal source display area) of the window is automatically reduced and the title bar is displayed; when a captured mouse leaves a window, the title bar is hidden, a video playing area in the target window is recovered, and a video (or other types of signal sources) is displayed in the recovered video playing area (specifically, see the description below), so that related information of the video in the target window can be directly and quickly called in a multi-window display interface of the terminal for a certain target window, whether the played video is correct or not is determined, the played video is edited or controlled as required, meanwhile, the monitoring on the signal sources in other windows is not lost, and the multi-signal-source monitoring and interaction efficiency is improved.
FIG. 1b is a schematic diagram of a multi-window interactive system according to some embodiments of the present invention, comprising: a splice command screen 10', a server 20', a terminal 40 'and a splice processor 21'. The spliced command screen can comprise a plurality of small display screens or a whole large screen.
The server 20' according to some embodiments of the present invention may be a server, a server cluster, or a cloud server.
The terminal 40' may be an electronic device such as a cell phone, a tablet, a multimedia player, a wearable device, a personal computer, etc.
The stitching processor 21' is connected to the signal source, for example via the illustrated switch, or may be connected via a video line.
The server 20 'is connected to the signal source through the switch 50, and can receive the signal source 210', the signal source 211', … …, the signal source n', and the like. Server 20' receives scheduling instructions that are parsed by an instruction receiving device (not shown) or may receive other instructions from the network. The instruction receiving device is used for resolving the scheduling instruction and comprises: mouse, keyboard, body feeling sensor, touch device, laser device, speech conversion device, wearable device, etc.
The server 20 'is communicatively connected to the splicing processor 21', for example, the server 20 'is connected to the splicing processor 21' through the switch 50, and the server 20 'can control the splicing processor 21' according to the scheduling instruction to adjust the window layout, draw the corresponding signal source in each window, and output the drawing result to the splicing command screen for display. The adjusting of the window layout comprises adjusting the size, the position, the stacking sequence and the like of each window on the command screen.
The mosaic command screen 10 'is used for displaying the drawing result output by the mosaic processor 21'.
The terminal 40 'is communicatively connected to the server 20', for example, the terminal 40 'is connected to the server 20' through the switch 50, and obtains the layout information of the windows in the server 20 'and the signal source information corresponding to each window, so that the windows on the terminal and the signal sources displayed in the windows are synchronized with the command screen 10'. When the server 20' controls the splicing processor 21' according to the scheduling instruction analyzed by the instruction receiving device to adjust the window layout, the terminal 40' needs to establish a connection with the server 20' and receive the window layout information on the server 20', so that each window of the terminal 40' is synchronized with each window on the command screen 10', and each signal source is output to a corresponding window.
The terminal 40' can also interact with the windows independently, for example, according to some embodiments of the present invention, the terminal 40' can independently execute a multi-window interaction method, in a default state, the windows played on the terminal 40' do not display the title bar in each window, and when a capture mouse enters one of the windows (or the target window), the video playing area (or the signal source display area) of the window is automatically reduced and the title bar is displayed; when a capture mouse leaves a window, the title bar is hidden, a video playing area in the target window is recovered, and a video (or other types of signal sources) is displayed in the recovered video playing area (specifically, see description below), so that related information of the video in the target window can be directly and quickly called in a multi-window display interface of the terminal for a certain target window, whether the played video is correct or not is determined, the played video is edited or controlled as required, and meanwhile, the monitoring of signal sources in other windows is not lost, so that the monitoring and interaction efficiency of multiple signal sources is improved.
FIG. 2 is a flow diagram of a multi-window interaction method according to some embodiments of the invention.
As shown in FIG. 2, a multi-window interaction method according to some embodiments of the present invention includes steps 100-400. In this application, the window entered by the mouse is also referred to as the target window, or sometimes simply referred to as the window.
Specifically, the terminal captures a mouse to enter the window, and the window is adjusted to be in a first display mode.
And 200, in a first display mode, displaying a title bar corresponding to the window in the window, reducing a video playing area in the window and displaying the signal source in the reduced video playing area.
Fig. 3a and 3b are schematic diagrams of a first display mode of a window according to some embodiments of the invention.
A window according to some embodiments of the present invention includes a title bar and a video playback area.
Referring to fig. 3a, in the first display mode, the title bar in the window is in a visible state, and the video playing area of the window is automatically reduced to a portion of the window.
In the first display mode, in order to monitor whether the video stream played in the video playback area of the window is correct, it is preferable to display the signal source identification and the signal source name on the title bar. In an alternative implementation manner, the video stream played by the playing area is obtained by decoding the signal source through a window decoding process. In order to distinguish different signal sources, a signal source identifier and a signal source name are set in advance for the signal source to display the signal source identifier and the signal source name in a title bar.
According to some embodiments of the present invention, as shown in fig. 3b, some controls, including but not limited to a first control and a second control, may also be displayed on the title bar for controlling the signal source or the window in which the signal source is located. For example, the first control is set to close the signal source or window. And setting the second control to open the signal source or edit the signal source. The first control and the second control may be preset on the title bar. Therefore, the signal source or window to be controlled can be directly controlled under the conditions that the current display interface is not exited and the real-time monitoring on other signal sources is not lost.
FIG. 4 is a schematic diagram of a title bar of a window according to some embodiments of the invention.
Referring to fig. 4, a signal source identification and a signal source name are displayed in a title bar.
Step 300, adjusting the window to a second display mode in response to the capture mouse leaving the window.
Specifically, the terminal captures that the mouse leaves the window, and adjusts the window to the second display mode.
Specifically, in the second display mode, the title bar is hidden. That is, when the mouse leaves the current window, the window enters a second display mode, which is used to play the video, and in order to provide more space for the video being played, the title bar is hidden, in an alternative implementation, the video playing area is restored to an initial value or a default value, so that the video playing area fills the window.
FIG. 5 is a schematic illustration of a second display mode of a window according to some embodiments of the invention.
Referring to fig. 5, in the second display mode, the title bar is hidden, filling the window with a video play area. Thereby providing more space for the video playback area.
FIG. 6 is a flow diagram of a multi-window interaction method according to some embodiments of the invention.
Referring to FIG. 6, the method includes 6 steps in total from 1001-1006.
And communicating with the server to acquire the identification of the signal source associated with the window, so as to keep synchronization with the server. The identification may be associated with the signal source name, see for example table 1.
| Signal source identification | Signal source name |
| 1 | Associative computer |
| 2 | Canon camera |
TABLE 1 Association table of signal source identification and signal source name
The identification can be, for example, a shorthand id, shorthand symbol, etc. of the signal source, and the name of the signal source can be the full name of the signal source.
By communicating with the server, the name of the signal source associated with the window is obtained, so that a description of the signal source can be obtained.
Depending on the actual needs, some signal source identification or name may not necessarily be shown, and therefore, one of steps 1001 or 1002 may be omitted.
By decoding the signal source associated with the window, the video stream can be played on the window of the terminal.
Fig. 7 is a schematic diagram of a window play video stream according to some embodiments of the invention.
Referring to fig. 7, a window is configured to play a video stream by performing the above-described steps 1001, 1002 and 1003 throughout the entire display area of the terminal 40. Specifically, window 401 is used to play video stream 301 according to a pre-configuration, window 402 is used to play video stream 401 according to a pre-configuration, and window 403 is used to play video stream 501 according to a pre-configuration. The above-mentioned pre-configuration may be obtained by synchronizing with the server 20 shown in fig. 1, or may be obtained by analyzing the scheduling command of the receiving terminal 40. It should be noted that the number of windows in the display area of the terminal is not limited to three, and the specific number may be configured according to actual requirements; the incidence relation between the window and the video stream is not fixed, and the window and the video stream can be changed according to a scheduling instruction; the video streams in fig. 7 are for illustration only, and in practice the video streams are determined according to the signal source, which in some embodiments according to the invention comprises: video stream of movie and television videos, video stream converted by graphical interfaces of terminals (the terminals comprise computers, mobile phones, tablet computers and wearable equipment), video stream collected by a camera and the like.
By hiding the title bar of each window in a specific example according to some embodiments of the present invention, that is, the window according to some embodiments of the present invention is configured to hide the title bar in a default state or an initial state, thereby obtaining a larger display space when the window according to some embodiments of the present invention is used to play a video stream. For the video stream needing to be played by hundreds of paths or even more, the largest possible display space can be provided for the video stream in a limited area, and the display effect is further effectively improved.
It is determined whether the terminal captures a mouse into the window, thereby enabling a determination of whether to display or hide the title bar, via step 1004.
With continued reference to fig. 7, in the state shown in fig. 7, the mouse 41 does not enter the window. At this time, each window is kept in a default state, and no title bar is displayed in any of the windows 401, 402, and 403. That is, in the state shown in fig. 7, each window hides the title bar.
FIG. 8 is a schematic diagram of a window play video stream, according to some embodiments of the invention.
When it is determined that the terminal captures the mouse entry window through step 1004, as shown in fig. 8, the mouse 41 enters the window 401 to adjust the window 401 to display the title bar 4011. A signal source identification 4012 and a signal source name 4013 and/or a control are displayed on the title bar 4011 (see fig. 3). At this time, the video playback area for playing back the video stream is simultaneously reduced. Thus, when the title bar 4011 is displayed, the playback of the video stream by the video playback area is not affected. In addition to reducing the vertical size of the video playing area in the manner shown in the figure, the size can be reduced synchronously in both the horizontal and vertical directions, that is, the display area of the signal source is reduced as a whole, so that the original video stream is completely presented in a manner of reducing the whole by a certain proportion.
In an alternative implementation, the height of the title bar 4011 of the window 401 is obtained, and the height of the title bar is reduced in a direction perpendicular to the title bar, so that the title bar is shown in an upper position in the window and the video playing area is shown in a lower position in the window.
According to some embodiments of the present invention, the title bar may be located at any peripheral position of the target window, and the peripheral position includes the following situations: the left, right, bottom, top (as shown in fig. 8) or title bar of the target window is divided into a plurality of portions located on the left side of the target window and a plurality of portions located on the right side of the target window, or distributed in a surrounding manner, so that the distribution of the video playing area after being reduced is surrounded by the title bar. The position and size of the title bar with respect to the window may be preset according to each window. According to some embodiments of the present invention, the position and size of the title bar may be changed according to the position and size of each window, for example, when the size of the window 401 is changed (for example, when the window on the command screen is changed, the size of the window 401 is also changed), the position and size of the title bar are changed accordingly, so as to achieve the best display and interaction efficiency for the video stream playing area and the whole window.
When multiple videos are played in each window of the terminal, the mouse 41 enters the window 401, the title bar is displayed in the window 401 and the video playing area is reduced, and the title bar is hidden in other windows (the window 402 and the window 403), and the respective playing areas are kept unchanged.
According to the technical scheme of some embodiments of the invention, the title bar of the window is configured to be in a visible mode by capturing a mouse to enter the window, and a video playing area for playing the video stream is reduced, so that the title bar can be displayed without pausing the video playing; by displaying the signal source identification and the signal source name on the title bar, whether the video stream played in the video playing area is correct or not can be judged.
Referring to fig. 7 and 8, when the mouse 41 leaves the window 401, the window 401 is adjusted to the second display mode as shown in fig. 7. In the second display mode, the title bar of window 401 is hidden and the play area of window 401 is restored. In the second display mode, the video playback area is restored to fill the entire window. According to the technical scheme of the invention, the title bar of the window is hidden by capturing the event that the mouse leaves the window, so that a larger space is provided for the playing area.
The multi-window interaction method implemented above around the figures may be applied to the terminals shown in fig. 1a and 1b, according to some embodiments of the present invention.
FIG. 9 is a schematic diagram of a window interaction device, according to some embodiments of the invention.
Referring to fig. 9, a multi-window interaction apparatus according to some embodiments of the present invention includes: a first determination module 41, a first interaction module 42, a second determination module 43 and a second determination module 44.
The first determination module 41 is configured to adjust the target window to a first display mode in response to a capture of a mouse into the target window.
The first interaction module 42 is configured to, in the first display mode, display a title bar corresponding to the target window in the target window, reduce a video playing area in the target window, and enable the signal source to be displayed in the reduced video playing area.
The second determination module 43 is for adjusting the target window to a second display mode in response to the capture of the mouse off the target window.
The second interactive module 44 is configured to hide the title bar and restore the video playing area in the target window in the second display mode, and enable the signal source to be displayed in the restored video playing area.
According to some embodiments of the present invention, the modules may be combined with each other, for example, modules 41 and 42 may be combined together to form a module, and modules 43 and 44 may be combined together to form a module. Alternatively, other module division or division modes can be adopted to realize the same functions.
FIG. 10 is a schematic view of an electronic device according to some embodiments of the inventions.
The electronic device 10 shown in fig. 10 includes a general hardware structure, and when the multi-window interaction method according to some embodiments of the present invention is executed by the general electronic device shown in fig. 10, it at least includes a processor 101 and a memory 102. The processor 101 and the memory 102 are connected by a bus 103. The memory 102 is adapted to store instructions or programs executable by the multi-window interaction method of some embodiments of the present invention. Processor 101 may be a stand-alone microprocessor or a collection of one or more microprocessors. Thus, the processor 101 performs the multi-window interaction method according to some embodiments of the present invention as described above by executing instructions stored by the memory 102 to implement processing of multiple windows and/or signal sources. The bus 103 connects the above-mentioned components together, and at the same time connects the above-mentioned components to the display controller 104 and the display device to display the display effect of multi-window interaction. Input/output (I/O) device 105 may be a mouse, keyboard, modem, network interface (through which various signal sources may be accessed, for example), touch input device, motion-sensitive input device, printer, and other devices known in the art. Typically, the input/output devices 105 are coupled to the bus through an input/output (I/O) controller 106.
As will be appreciated by one skilled in the art, embodiments of the present application may provide a method, apparatus (device) or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may employ a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations of methods, apparatus (devices) and computer program products according to embodiments of the application. It will be understood that each flow in the flow diagrams can be implemented by computer program instructions.
These computer program instructions may be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows.
These computer program instructions may also be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows.
Another embodiment of the invention relates to a non-transitory readable storage medium storing a computer-readable program for causing a computer to perform an embodiment of some or all of the above methods.
That is, as can be understood by those skilled in the art, all or part of the steps in the method for implementing the foregoing embodiments may be accomplished by specifying relevant hardware through a program, where the program is stored in a readable storage medium and includes several instructions for enabling a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned readable storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Through the embodiment of the invention, the related information of the video being played in the target window can be directly and quickly called in the multi-window display interface, whether the played video is correct or not is determined, the played video is edited or controlled according to the requirement, and meanwhile, the monitoring of signal sources in other windows is not lost, so that the multi-signal-source monitoring and interaction efficiency is improved.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention.
Claims (8)
1. A multi-window interactive system, comprising:
the server is connected with the command screen through a video line and is in communication connection with the signal sources, adjusts the window layout according to the scheduling instruction, draws the corresponding signal sources in each window, and outputs the drawing result to be displayed by the command screen;
the command screen is used for displaying the drawing result output by the server; and
a terminal, which is in communication connection with the server, and is configured to acquire window layout information in the server and information of a signal source corresponding to each window, so that each window on the terminal and the signal source displayed in each window are kept synchronous with the command screen, and execute a multi-window interaction method in response to a mouse operation, where each window of the terminal is configured to display one signal source, and the multi-window interaction method includes:
adjusting a target window to a first display mode in response to a capture mouse entering the target window;
in a first display mode, displaying a title bar corresponding to the target window in the target window, reducing a signal source display area in the target window and enabling a signal source to be displayed in the reduced signal source display area, and hiding the title bar and keeping the respective signal source display areas unchanged in other windows outside the target window;
adjusting the target window to a second display mode in response to the capture mouse leaving the target window;
and hiding the title bar, recovering the signal source display area in the target window and displaying the signal source in the recovered signal source display area in a second display mode.
2. A multi-window interactive system, comprising:
the splicing processor is connected with the signal source;
the server is in communication connection with the splicing processor and the signal sources, controls the splicing processor according to the scheduling instruction so as to adjust the window layout, draws the corresponding signal sources in each window and outputs the drawing results to the splicing command screen for displaying;
the splicing command screen is used for displaying the drawing result output by the splicing processor; and
the terminal is in communication connection with the server and is used for acquiring window layout information in the server and information of signal sources corresponding to the windows, so that the windows on the terminal and the signal sources displayed in the windows are kept synchronous with the splicing command screen, and a multi-window interaction method is executed in response to mouse operation, wherein each window of the terminal is used for displaying one signal source; the multi-window interaction method comprises the following steps:
adjusting a target window to a first display mode in response to a capture mouse entering the target window;
in a first display mode, displaying a title bar corresponding to the target window in the target window, reducing a signal source display area in the target window and enabling a signal source to be displayed in the reduced signal source display area, and hiding the title bar and keeping the respective signal source display areas unchanged in other windows outside the target window;
adjusting the target window to a second display mode in response to the capture mouse leaving the target window;
and hiding the title bar, recovering the signal source display area in the target window and displaying the signal source in the recovered signal source display area in a second display mode.
3. The multi-window interactive system as claimed in claim 1 or 2, wherein the title field is located at any peripheral position of the target window.
4. The multi-window interactive system according to claim 1 or 2, wherein the position and size of the title bar with respect to the windows are preset according to the respective windows, or the position and size of the title bar are changed according to the change of the position and size of the respective windows.
5. The multi-window interactive system of claim 1 or 2, wherein said reducing the signal source display area within the target window comprises:
acquiring the height of the title bar of the target window; and reducing the height of the title bar in a direction perpendicular to the title bar, or reducing the whole signal source display area.
6. The multi-window interactive system according to claim 1 or 2, wherein said multi-window interactive method further comprises: pre-acquiring an identifier of a signal source associated with the window; and, pre-obtaining a name of a signal source associated with the window.
7. The multi-window interactive system according to claim 1 or 2, wherein said signal source comprises a video stream signal source, said multi-window interactive method further comprising:
and playing a video stream in a signal source display area in the target window, wherein the video stream is obtained by decoding a signal source related to the target window.
8. The multi-window interactive system according to claim 1 or 2, wherein said multi-window interactive method further comprises:
and displaying the identification of the signal source, the name of the signal source or the control in a title bar in the target window.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110457672.5A CN112947815B (en) | 2021-04-27 | 2021-04-27 | Multi-window interaction method and system, readable storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110457672.5A CN112947815B (en) | 2021-04-27 | 2021-04-27 | Multi-window interaction method and system, readable storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112947815A CN112947815A (en) | 2021-06-11 |
| CN112947815B true CN112947815B (en) | 2022-11-25 |
Family
ID=76233530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110457672.5A Active CN112947815B (en) | 2021-04-27 | 2021-04-27 | Multi-window interaction method and system, readable storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112947815B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113485604B (en) * | 2021-07-30 | 2024-02-09 | 京东方智慧物联科技有限公司 | Interactive terminal, interactive system, interactive method and computer readable storage medium |
| CN113608644A (en) * | 2021-08-13 | 2021-11-05 | 北京仁光科技有限公司 | Multi-window adjusting method, readable storage medium, electronic device and system |
| CN114625417A (en) * | 2022-01-07 | 2022-06-14 | 北京仁光科技有限公司 | Multi-signal-source interface safety interaction device |
| CN114741016B (en) * | 2022-05-19 | 2022-09-16 | 京东方科技集团股份有限公司 | Operation method, device, electronic equipment and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012212061A (en) * | 2011-03-31 | 2012-11-01 | Sharp Corp | Multi-display device |
| CN110851011A (en) * | 2019-09-17 | 2020-02-28 | 丁建华 | System and method for interacting large-screen multi-signal-source complex display contents |
| CN212413300U (en) * | 2020-06-30 | 2021-01-26 | 南京艾拓维讯信息技术有限公司 | Large-screen visual display operation device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100555403C (en) * | 2007-06-26 | 2009-10-28 | 广东威创视讯科技股份有限公司 | A kind of assembly wall multiuser interactive control and assembly wall display message playback reproducer and method |
| US8531522B2 (en) * | 2008-05-30 | 2013-09-10 | Verint Systems Ltd. | Systems and methods for video monitoring using linked devices |
| US8499254B2 (en) * | 2008-10-27 | 2013-07-30 | Microsoft Corporation | Surfacing and management of window-specific controls |
| CN102541449B (en) * | 2011-12-22 | 2014-04-23 | 杭州海康威视数字技术股份有限公司 | Method and system for rapidly and conveniently controlling previewing channel of hard disk video recorder |
| CN104049875B (en) * | 2014-06-18 | 2018-04-06 | 北京市交通信息中心 | It is a kind of based on it is event driven be applicable multi-screen splicing large screen display method |
| CN111061381A (en) * | 2018-10-16 | 2020-04-24 | 南京仁光电子科技有限公司 | Screen global input control system and method |
| CN111596985B (en) * | 2020-04-24 | 2023-03-14 | 腾讯科技（深圳）有限公司 | Interface display method, device, terminal and medium in multimedia conference scene |
-
2021
- 2021-04-27 CN CN202110457672.5A patent/CN112947815B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012212061A (en) * | 2011-03-31 | 2012-11-01 | Sharp Corp | Multi-display device |
| CN110851011A (en) * | 2019-09-17 | 2020-02-28 | 丁建华 | System and method for interacting large-screen multi-signal-source complex display contents |
| CN212413300U (en) * | 2020-06-30 | 2021-01-26 | 南京艾拓维讯信息技术有限公司 | Large-screen visual display operation device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112947815A (en) | 2021-06-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112947815B (en) | Multi-window interaction method and system, readable storage medium and electronic device | |
| US9106791B2 (en) | Collaborative entertainment platform | |
| CN108235105B (en) | Barrage presenting method, recording medium, electronic device and information processing system | |
| US20220377259A1 (en) | Video processing method and apparatus, electronic device, and non-transitory computer readable storage medium | |
| US7852368B2 (en) | Method and apparatus for composing images during video communications | |
| US20120274728A1 (en) | Video Conference Apparatus, Method, and Storage Medium | |
| CN111930994A (en) | Video editing processing method and device, electronic equipment and storage medium | |
| US8467509B2 (en) | Video displaying apparatus, video displaying system and video displaying method | |
| US10115431B2 (en) | Image processing device and image processing method | |
| CN111405339B (en) | Split screen display method, electronic equipment and storage medium | |
| KR20140057036A (en) | Method for providing information and electronic apparatus thereof | |
| CN113206964B (en) | Screen projection data display processing method and device, terminal equipment and storage medium | |
| KR101987749B1 (en) | Method and apparatus for virtual hair styling service | |
| CN113778360B (en) | Screen projection method and electronic equipment | |
| CN114584797A (en) | Display method and device of live broadcast picture, electronic equipment and storage medium | |
| CN113010075B (en) | Multi-signal source window interaction method and system, readable storage medium and electronic device | |
| US20230282185A1 (en) | Bullet-Screen Comment Display | |
| CN105100870A (en) | Screenshot method and terminal equipment | |
| CN111405303B (en) | Method for quickly establishing live broadcast based on webpage | |
| CN107888846A (en) | The signal method for previewing and television set of new access information source | |
| KR20160117933A (en) | Display apparatus for performing a search and Method for controlling display apparatus thereof | |
| US20170161871A1 (en) | Method and electronic device for previewing picture on intelligent terminal | |
| CN105611390B (en) | A kind of pair of vertical screen video file carries out picture and text synthetic method and device | |
| CN111787267A (en) | Conference video subtitle synthesis system and method | |
| CN113495664A (en) | Information display method, device, equipment and storage medium based on media information stream |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |