CN113608644A - Multi-window adjusting method, readable storage medium, electronic device and system - Google Patents
Multi-window adjusting method, readable storage medium, electronic device and system Download PDFInfo
- Publication number
- CN113608644A CN113608644A CN202110932976.2A CN202110932976A CN113608644A CN 113608644 A CN113608644 A CN 113608644A CN 202110932976 A CN202110932976 A CN 202110932976A CN 113608644 A CN113608644 A CN 113608644A
- Authority
- CN
- China
- Prior art keywords
- window
- signal source
- total
- video stream
- adjustment method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
Abstract
The invention provides a multi-window adjusting method, which comprises the steps of generating a total window and drawing each window on the total window; acquiring interactive data, and updating the display effect of the total window on the screen according to the interactive data to obtain a current viewport; creating a preview window of the total window as a first preview window; creating a rectangular frame on a first preview window, and linking the rectangular frame with the current viewport; and updating the current viewport in accordance with the interaction with the rectangular box, wherein the interaction data comprises interaction data resulting from the interaction with the rectangular box. The multi-window adjusting method provided by the embodiment of the invention is convenient for a user to monitor and adjust the multi-window.
Description
Technical Field
The invention relates to the field of interaction, in particular to a multi-window adjusting method, a readable storage medium, electronic equipment and a system.
Background
In the prior art, when the display range of an interface exceeds the display range of a screen, a scroll bar is generally adopted to adjust the interface, and an area which a user needs to pay attention to is adjusted to the visible range of the screen. However, when more detail in the adjustment interface is needed, it is not convenient to adjust only by a scroll bar.
Disclosure of Invention
In view of the foregoing prior art, embodiments of the present invention provide a multi-window adjustment method, a readable storage medium, an electronic device, and a system.
A first aspect of the present invention provides a multi-window adjusting method, including:
generating a total window, and drawing each window on the total window;
acquiring interactive data, and updating the display effect of the total window on the screen according to the interactive data to obtain a current viewport;
creating a preview window of the total window as a first preview window;
creating a rectangular frame on a first preview window, and linking the rectangular frame with the current viewport; and
updating the current viewport in accordance with the interaction with the rectangular box, wherein the interaction data comprises interaction data resulting from the interaction with the rectangular box.
According to some embodiments of the invention, linking the rectangular box with the current viewport comprises:
acquiring the interactive data;
and updating the relative position of the rectangular frame and the first preview window in real time according to the interactive data.
According to some embodiments of the invention, the updating the relative position of the rectangular frame and the first preview window in real-time according to the interaction data comprises:
and the position of the first preview window is unchanged, and the position of the rectangular frame is updated in real time according to the interactive data.
According to some embodiments of the present invention, the position of the first preview window is unchanged, and the updating the position of the rectangular frame in real time according to the interaction data includes:
calculating a proportional relation between the current viewport and the total window according to the interaction data to obtain the size of the rectangular frame;
calculating a relative position of the current viewport and the total window according to the interaction data to obtain a position of the rectangular frame; and
a rectangular frame is rendered on the first preview window.
According to some embodiments of the invention, the interaction on which the interaction data is based comprises:
moving the global window;
enlarging the total window; and/or
And reducing the total window.
According to some embodiments of the invention, the interaction on which the interaction data is based comprises:
amplifying the total window with a predetermined position as a reference;
or, reducing the total window by taking a preset position as a reference;
wherein the predetermined locations comprise: the current position of the mouse and the center position of the general window.
According to some embodiments of the invention, updating the current viewport comprises, in accordance with the interaction with the rectangular box:
acquiring interactive data of the rectangular frame moved by the user;
changing the positional relationship of the total window and the current viewport according to the interaction data; and updating the current viewport according to the position relation of the changed total window and the current viewport.
According to some embodiments of the invention, the drawing the windows on the total window comprises:
acquiring window information of each window and signal source information pre-associated in the window; and
generating a total window, and drawing the windows on the total window.
According to some embodiments of the present invention, the generating a total window and drawing the windows on the total window includes:
drawing the appearance of each window according to the window information of each window; and
and drawing the video stream in each window according to the signal source information in each window.
According to some embodiments of the invention, the window information comprises coordinates of an upper left vertex of the window, a width of the window, and a height of the window, and the drawing the appearance of the window according to the window information comprises:
and drawing the appearance of the window according to the coordinates of the top left vertex of the window, the width of the window and the height of the window.
According to some embodiments of the invention, the rendering the video stream within the window according to the signal source information within the window comprises:
acquiring an image frame of a signal source according to the signal source information; and
rendering the image frame as a video stream within a window.
According to some embodiments of the invention, the generating an overall window comprises generating an overall window according to a predetermined aspect ratio.
A second aspect of the invention provides a computer readable storage medium for storing computer program instructions, wherein the computer program instructions, when executed by a processor, implement the multi-window adjustment method.
A third aspect of the present invention provides an electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, and wherein the one or more computer program instructions are executed by the processor to implement the multi-window adjustment method.
A fourth aspect of the present invention provides a multi-window adjustment system, wherein the multi-window adjustment system includes:
a command screen configured to display a video stream of a target signal source;
the splicing controller is in communication connection with the command screen and is configured to receive a video stream of a signal source, adjust the video stream of the target signal source according to a control instruction and target signal source information and output the adjusted video stream to the command screen through a video output interface, wherein the splicing controller receives the control instruction and the target signal source information through a network interface;
the server is configured to be in communication connection with the splicing controller and sends the control instruction and the target signal source information to the network interface of the splicing controller through a network; the server is also configured to be in communication connection with a signal source and used for acquiring a network video stream of the signal source, wherein the network video stream is obtained after the video stream of the signal source is encoded;
the terminal is configured to be in communication connection with the server, receive the target signal source information of the server, receive the network video stream corresponding to the target signal source information, bind a window and the target signal source information so that the window can play the network video stream corresponding to the bound target signal source information, and execute the multi-window adjusting method.
The technical scheme of the embodiment of the invention generates a total window and draws each window on the total window; acquiring interactive data, and updating the display effect of the total window on the screen according to the interactive data to obtain a current viewport; creating a preview window of the total window as a first preview window; creating a rectangular frame on a first preview window, and linking the rectangular frame with the current viewport; wherein the rectangular box is also capable of generating the interaction data to update the current viewport. Therefore, the multi-window adjusting method can realize the rapid and efficient monitoring and adjustment of the multiple windows.
Drawings
The above and other objects, features and advantages of the present invention will become more apparent from the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:
FIG. 1 is a schematic diagram of a multiple window adjustment system according to some embodiments of the invention;
FIG. 2 is a schematic diagram of a server acquiring a network video stream of a signal source according to some embodiments of the invention;
FIG. 3 is a schematic diagram of a server acquiring a network video stream of a signal source according to further embodiments of the invention;
FIG. 4 is a schematic diagram of multi-window adjustment according to some embodiments of the invention;
FIG. 5 is a schematic illustration of a summary window according to some embodiments of the inventions;
FIG. 6 is a schematic diagram of a viewport in accordance with some embodiments of the invention;
FIG. 7 is a schematic diagram of an electronic device according to some embodiments of the inventions.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention.
Further, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.
Unless the context clearly requires otherwise, throughout the description, the words "comprise", "comprising", and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is, what is meant is "including, but not limited to".
In the description of the present invention, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
FIG. 1 is a schematic diagram of a multiple window adjustment system according to some embodiments of the invention.
Referring to fig. 1, a multi-window adjustment system 60 according to an embodiment of the present invention is communicatively connected to at least one signal source for controlling a target signal source. According to some embodiments of the present invention, the multi-window adjustment system 60 includes a command screen 10, a splicing processor 21, a switch 50, a terminal 40, and a server 20. According to some embodiments of the invention, the signal source comprises: desktop, camera, notebook computer, panel computer, show accuse all-in-one, touch-sensitive screen, cell-phone etc..
In an embodiment of the present invention, the command screen 10 is used to display a video stream of a target signal source. The conductor screen 10 can include one display device or a plurality of display devices. For example, the command screen 10 of some embodiments of the present invention includes a display or a projector; other embodiments of the present invention include a command screen 10 that includes multiple displays, multiple projectors, or a combination of multiple displays and projectors.
According to some embodiments of the present invention, the stitching processor 21 comprises a video input interface, a video output interface and a network interface.
According to some embodiments of the invention, the stitching processor 21 is communicatively coupled to the command screen 10 via a video output interface.
According to some embodiments of the present invention, the splicing processor 21 is configured to receive the video stream of the signal source through the video input interface, and adjust the video stream of the target signal source according to the control instruction and the target signal source information, and output the adjusted video stream to the command screen 10 through the video output interface (described below). Specifically, the stitching processor 21 of the embodiment of the present invention receives the video streams of the signal source 210, the signal source 220, and the signal source 230 through the video input interface. It should be understood that the number of signal sources that can be received by the embodiments of the present invention is not limited to three, and in practice, a corresponding number of signal sources may be accessed as needed. Taking the signal source as a desktop computer as an example, the display output device interface of the desktop computer may be connected to the video input interface of the stitching processor 21 through a video cable. For example, if the interface of the display output device of the desktop computer is HDMI, and the video input interface of the stitching processor 21 is HDMI, the two are connected by an HDMI video line. It should be understood that the embodiment of the present invention does not limit the type of the video output interface of the signal source, and in practice, the video output interface of the signal source includes HDMI, DVI, VGA, and the like.
The splicing processor 21 of the embodiment of the present invention receives a control instruction and target signal source information of the server 20 through a network interface.
A server 20 configured to be communicatively connected to the splicing processor 21, wherein the server 20 transmits the control instruction and the target signal source information to the network interface of the splicing processor 21. The server 20 may be one server, a server cluster, or a cloud server.
The server 20 is further configured to be connected in communication with a signal source, and configured to obtain a network video stream of the signal source, where the network video stream is obtained by encoding a video stream of the signal source (please refer to fig. 2 specifically).
Fig. 2 is a schematic diagram of a server acquiring a network video stream of a signal source according to some embodiments of the invention.
Referring to fig. 2, the multi-window processing system according to some embodiments of the present invention further includes a screen splitter 220 and a video encoder 230. The screen splitter 220 splits the video output interface of the signal source into multiple paths, and specifically, one path of video stream of the signal source is output to a local display device (not necessary), the other path of video stream of the signal source is output to the stitching processor 21, and the other path of video stream of the signal source is output to the video encoder 230.
The video encoder 230 of the embodiment of the present invention can encode the video stream of the signal source into a network video stream. Therefore, the server of the embodiment of the invention can obtain the network video stream of the signal source. Specifically, the network video stream of the embodiment of the present invention may be a network video stream of h.265. It should be understood that the network video stream may be in other formats as required.
In the multi-window adjustment system according to some embodiments of the present invention, the signal source is communicatively connected to the server 20 in such a way that the signal source outputs a video stream through the video output interface. The video stream output by the signal source is input into the screen splitter 220, one of the video streams is input into the video encoder 230 by the screen splitter 220, the network video stream of the signal source is output after the video encoder 230 encodes the video stream, the network video stream is accessed into the switch 50, the server 20 is accessed into the switch 50, and therefore the server 20 can obtain the network video stream of the signal source.
The command screen 10 can be large in size and can display video streams from hundreds of sources. In an intelligent interactive application environment, the content to be displayed by the command screen 10 can be pre-distributed on the terminal 40, and then the server 20 controls the splicing processor 21, so that the splicing processor 21 displays the corresponding content on the command screen according to the distribution condition on the terminal 40; or vice versa, the display layout on the terminal 40 is synchronized according to the layout situation on the conductor screen. However, the terminal 40 usually adopts a general-purpose electronic device, and the size of the physical display device is limited, so that when the terminal 40 simultaneously displays multiple signal sources, the window corresponding to each signal source is very small, which is not beneficial for the user to pay attention or monitor all or part of the displayed content directly on the terminal 40. To this end, the embodiment of the present invention provides a multi-window adjustment method (see the following description).
Fig. 3 is a schematic diagram of a server acquiring a network video stream of a signal source according to further embodiments of the invention.
In contrast to the previous embodiments of the present invention, the splicing controller 21 and the command screen 10 are omitted in the embodiment shown in fig. 3, other components are the same as those in some embodiments of the present invention, and the same reference numerals are used for the same parts, wherein the terminal 40, the server 20 and the signal source 210, the screen splitter 220 and the video encoder 230 have the same functions as those in fig. 2, but in fig. 3, it is not considered how the target signal source information and the control instruction are transmitted to the splicing controller, and it is not considered how the splicing controller displays the video stream of the corresponding target signal source on the command screen according to the above information.
That is, the multi-window adjusting method provided by the embodiment of the present invention can be performed on the terminal 40 in a system having only the terminal 40, the server 20, and the signal source 210, the screen splitter 220, and the video encoder 230 as shown in fig. 3. Those skilled in the art will understand that the number of signal sources in actual use is one to many. It will also be appreciated by those skilled in the art that when the number of signal sources is plural, one screen splitter and one video encoder may be provided for each signal source. When the signal source is multiple, the server 20 and the terminal 40 can access and acquire one or more network video streams of the signal source. The network video streams of the signal sources all have unique identifications.
When the network video streams corresponding to the plurality of signal sources are played on the terminal 40, the size of the display device of the terminal 40 is usually smaller, and it is inconvenient for a user to view the plurality of network video streams on the terminal 40 with the smaller display size.
Fig. 4 is a flow chart of a multi-window adjustment method of some embodiments of the invention.
As shown in fig. 4, the flowchart of the multi-window adjustment method of the embodiment of the present invention includes steps 100-400, which are performed by the terminal 40 in conjunction with information from other components.
In embodiments of the present invention, the summary window covers or draws all of the content available for display.
Since the physical display device size is fixed, when there are many windows on the total window, each window is very small in order to monitor multiple windows simultaneously. According to some embodiments of the invention, the size of the total window is larger than the size of the physical display device. When there are many windows in the embodiment of the present invention, a part of the total window is displayed so that each window can be presented on the physical display device in a user-friendly size.
According to some embodiments of the present invention, an overall window may be generated according to a predetermined aspect ratio. For example, the generated total window may be a total window having a height greater than a width; or, the generated total window is a total window with a width larger than a height; alternatively, the total window generated is one of equal height and width. In an embodiment of the present invention, the height may represent a dimension of the overall window in a vertical direction, and the width may represent a dimension of the overall window in a horizontal direction.
According to some embodiments of the present invention, the shape of the overall window is not limited to a rectangle, and the shape of the overall window may be other shapes, for example, a regular shape or an irregular shape.
According to some embodiments of the present invention, the drawing of each window on the total window includes two substeps, step 110 and step 120.
And step 110, acquiring window information of each window and signal source information pre-associated in the window.
According to some embodiments of the invention, the window information includes an upper left vertex coordinate of the window, a width of the window, and a height of the window.
The position of the window and the size of the window can be determined on the total window according to the window information. For example, the window is first positioned on the overall window based on the top left vertex coordinates, and the size of the window is determined based on the width of the window and the height of the window. When the total window includes a plurality of windows, the window information further includes a window map layer value. Therefore, when the shielding condition exists between the windows, the stacking sequence or the shielding condition of the windows is determined according to the window map layer value.
In the multi-window adjusting method of the embodiment of the invention, pre-associated signal source information in the window is obtained. In some embodiments of the invention, the signal source information comprises a signal source identification. In some embodiments of the present invention, the signal source information further includes a signal source address, a port number, or a signal source type. The signal source Address in the embodiment of the present invention may be an IP Address (Internet Protocol Address).
In some embodiments of the present invention, the signal source may be a local signal source or a remote signal source.
According to some embodiments of the invention, the window information for each window may also be obtained over a network. That is, the window information of each window is obtained through the network, and the appearance of each window is drawn on the total window according to the obtained window information of each window. The network may be a local area network or a wide area network. For example, window information for each window, as well as pre-associated signal source information within the window, may be obtained from server 20. According to some embodiments of the present invention, window information for each window is obtained in real time over a network.
And step 120, drawing each window on the total window.
Step 120 comprises two substeps, step 121 and step 122, respectively.
And 121, drawing the appearance of each window according to the window information of each window.
Specifically, the appearance of each window is drawn on the total window according to the window information. According to some embodiments of the present invention, the window information of each window may be obtained by receiving data input by a user, that is, the window information of each window is specified by the user, for example, the coordinates of the top left vertex of each window, the width of each window, and the height of each window are specified by the user, and then the appearance of each window is drawn on the total window according to the window information specified by the user.
And step 122, drawing the video stream in each window according to the signal source information in each window.
Step 122 includes two substeps, step 1221 and step 1222, respectively.
And 1221, acquiring an image frame of the signal source according to the signal source information.
Specifically, in each window, an image frame of the signal source is acquired according to the signal source information of the window.
Step 1222, render the image frame as a video stream within a window.
Specifically, the image frames of the signal source are rendered as a video stream within a window.
According to some embodiments of the invention, the rendering of the appearance of each window in step 121 and the rendering of the video stream within each window in step 122 may be real-time rendering. That is, in each update period, the appearance of each window is redrawn according to the window information, and the video stream in each window is redrawn according to the signal source information in each window.
According to some embodiments of the invention, drawing the appearance of each window in step 121 may redraw the window appearance only when the window information changes. That is, when the window position is changed, the window size is adjusted, and the layer value of the window is changed, the window appearance is redrawn. At this point, the rendering of the video stream within the window by step 122 remains in real-time.
According to some embodiments of the invention, the interaction actions associated with (or based on) the interaction data of embodiments of the invention include: move the overall window, zoom in on the overall window, and/or zoom out on the overall window. For example, the total window is moved by a first operation of the mouse, enlarged by a second operation of the mouse, and reduced by a third operation of the mouse. Specifically, the first operation may be clicking and dragging, the second operation may be sliding the wheel upward, and the third operation may be sliding the wheel downward. Further, the enlarging of the total window specifically includes enlarging the total window with a predetermined position as a reference. The reducing of the total window specifically includes reducing the total window with reference to a predetermined position. In an embodiment of the present invention, the predetermined positions comprise: the current position of the mouse is taken as a preset position, and/or the central position of the general window is taken as a preset position.
According to some embodiments of the invention, the viewport location is fixed. That is, the view port of the embodiment of the present invention is located in a fixed area of the physical display device.
In order to display a part of the porthole in the embodiment of the present invention, the visible area may be set as a portion where the viewport overlaps with the porthole.
FIG. 5 is a schematic illustration of a summary window according to some embodiments of the inventions.
As shown in FIG. 5, the summary window 1000 is the entire content available for display. One or more windows may be created on the overall window 1000. For example, window 101, window 102, window 103, and window 104 are created on top of the general window 1000. It should be understood that the number of windows in the embodiment of the present invention is not limited to 4, and a corresponding number of windows may be created according to the use case. For example, the corresponding window is created according to the number of signal sources.
According to some embodiments of the present invention, the windows may be arranged in a tiled arrangement, in a stacked arrangement, in a spaced arrangement, and in an irregular arrangement. The positions of the windows and the positional relationship between the windows can be obtained in step 121, and are not described herein again.
According to some embodiments of the invention, the size of the windows may be the same or may be completely different. The size of the window can also be obtained in step 121, which is not described herein again.
Fig. 6 is a schematic diagram of a viewport in accordance with some embodiments of the invention.
The size of the viewport is smaller than the total window. The viewport is used to display a part of the overview window, i.e. which part of the overview window the viewport displays is changed in real time in dependence of the interaction data. For example, when the user drags the mouse, a first operation is generated, and the first operation acts on the porthole 1000, so that the relative positions of the porthole 1000 and the viewport 2000 are changed. When the user slides the wheel upward, a second operation is generated, which acts on the porthole 1000 such that the porthole 1000 is enlarged with respect to the viewport 2000. When the user slides the scroll wheel downward, a third operation is generated, and the third operation acts on the global window 1000, so that the global window 1000 is reduced relative to the viewport 2000. Thereby causing the content of the viewport 2000 to be rendered on the physical display device of the terminal 40 after updating in accordance with the interaction data.
Referring to fig. 6, fig. 6 is the content currently displayed by the viewport. That is, when the user wants to focus on window 101 and window 102, the user can interact with the mouse, generate interaction data, and adjust the total window using the interaction data, so that only window 101 and window 102 are displayed in viewport 2000, thereby focusing on both windows. In an embodiment of the invention, the content displayed by the viewport is updated in real time according to the interaction data. For example, in some embodiments of the present invention, a user operating a mouse generates interaction data such that the position or size of the porthole changes, whereby the relative size and relative position of the viewport and the porthole changes, updating the viewport in real time.
And step 300, creating a preview window of the total window as a first preview window.
With continued reference to FIG. 6, first preview window 3000 is created in accordance with some embodiments of the present invention. First preview window 3000 is created according to general window 1000, and specifically, first preview window 3000 may be created after general window 1000 is reduced.
With continued reference to FIG. 6, according to some embodiments of the present invention, a rectangular box 4000 is created on first preview window 3000, wherein the rectangular box is created from viewport 2000. Specifically, when the user zooms in, zooms out, or moves the global window through the interactive data in step 200, the size and position of the viewport are fixed, and the global window changes, so that the viewport is updated according to the interactive data, that is, in the embodiment of the present invention, the rectangular frame 4000 is linked with the viewport 2000.
According to some embodiments of the present invention, the current viewport 2000 may be updated according to the interaction with the rectangular box 4000. According to some embodiments of the invention, interactive data of the user moving the rectangular frame is obtained; changing the positional relationship of the total window and the current viewport according to the interaction data; and updating the current viewport according to the position relation of the changed total window and the current viewport.
The technical scheme of the embodiment of the invention generates a total window and draws each window on the total window; acquiring interactive data, and updating the display effect of the total window on the screen according to the interactive data to obtain a current viewport; creating a preview window of the total window as a first preview window; creating a rectangular frame on a first preview window, and linking the rectangular frame with the current viewport; wherein the rectangular box is also capable of generating the interaction data to update the current viewport. Therefore, the multi-window adjusting method provided by the embodiment of the invention is convenient for a user to quickly and efficiently monitor and adjust the multi-window.
Fig. 7 is a schematic diagram of an electronic device of an embodiment of the invention.
The electronic device 700 of some embodiments of the present invention is configured to perform the method of multi-window adjustment of embodiments of the present invention.
The electronic device 700 of some embodiments of the present invention may be a dedicated device or a general-purpose device.
When the electronic device of the embodiment of the present invention is a general-purpose control device, as shown in fig. 7, the electronic device 700 includes a computing unit 701, which can execute the method of multi-window adjustment of the embodiment of the present invention according to a computer program stored in a Read Only Memory (ROM)702 or a computer program loaded from the storage unit 702 into a Random Access Memory (RAM) 703. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
Various components in the electronic device 700 are connected to the I/O interface 705.
An output unit 707 such as various types of displays, speakers, and the like.
A storage unit 702 such as a magnetic disk, an optical disk, or the like; and a communication unit 709 such as a network card, modem, wireless communication transceiver, etc.
The communication unit 709 allows the electronic device 700 to exchange information/data with other devices, for example, to acquire window information of each window and pre-associated signal source information within the window, through a computer network such as the internet and/or various telecommunication networks.
Program code for implementing the multi-window adjustment method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the method of multi-window adjustment specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In order to provide interaction with a user, the electronic device has: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user.
The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the embodiments of the present invention may be executed in parallel, may be executed sequentially, or may be executed in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, which is not limited herein.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (15)
1. A multi-window adjusting method is characterized in that the multi-window adjusting method comprises the following steps:
generating a total window, and drawing each window on the total window;
acquiring interactive data, and updating the display effect of the total window on the screen according to the interactive data to obtain a current viewport;
creating a preview window of the total window as a first preview window;
creating a rectangular frame on a first preview window, linking the rectangular frame with the current viewport, an
Updating the current viewport in accordance with the interaction with the rectangular box, wherein the interaction data comprises interaction data resulting from the interaction with the rectangular box.
2. The multi-window adjustment method of claim 1, wherein linking the rectangular frame with the current viewport comprises:
acquiring the interactive data;
and updating the relative position of the rectangular frame and the first preview window in real time according to the interactive data.
3. The multi-window adjustment method according to claim 2, wherein the updating the relative position of the rectangular frame and the first preview window in real time according to the interaction data comprises:
and the position of the first preview window is unchanged, and the position of the rectangular frame is updated in real time according to the interactive data.
4. The multi-window adjustment method according to claim 3, wherein the position of the first preview window is unchanged, and the position of the rectangular frame is updated in real time according to the interactive data, and the method comprises:
calculating a proportional relation between the current viewport and the total window according to the interaction data to obtain the size of the rectangular frame;
calculating a relative position of the current viewport and the total window according to the interaction data to obtain a position of the rectangular frame; and
a rectangular frame is rendered on the first preview window.
5. The multi-window adjustment method according to claim 1, wherein the interaction on which the interaction data is based comprises:
moving the global window;
enlarging the total window; and/or
And reducing the total window.
6. The multi-window adjustment method of claim 5, wherein the interaction on which the interaction data is based comprises:
amplifying the total window with a predetermined position as a reference;
or, reducing the total window by taking a preset position as a reference;
wherein the predetermined locations comprise: the current position of the mouse and the center position of the general window.
7. The multi-window adjustment method of claim 1, wherein updating the current viewport based on the interaction with the rectangular box comprises:
acquiring interactive data of the rectangular frame moved by the user;
changing the positional relationship of the total window and the current viewport according to the interaction data; and
and updating the current viewport according to the position relation between the changed total window and the current viewport.
8. The multi-window adjustment method according to claim 1, wherein said drawing each window on the total window comprises:
acquiring window information of each window and signal source information pre-associated in the window; and
generating a total window, and drawing the windows on the total window.
9. The multi-window adjustment method of claim 8, wherein the generating a total window and drawing each window on the total window comprises:
drawing the appearance of each window according to the window information of each window; and
and drawing the video stream in each window according to the signal source information in each window.
10. The multi-window adjustment method according to claim 9, wherein the window information includes coordinates of top-left vertex of the window, a width of the window, and a height of the window, and the drawing the appearance of the window according to the window information includes:
and drawing the appearance of the window according to the coordinates of the top left vertex of the window, the width of the window and the height of the window.
11. The multi-window adjustment method of claim 9, wherein the rendering the video stream in the window according to the signal source information in the window comprises:
acquiring an image frame of a signal source according to the signal source information; and
rendering the image frame as a video stream within a window.
12. The multi-window adjustment method of claim 1, wherein said generating an overall window comprises generating an overall window according to a predetermined aspect ratio.
13. A computer readable storage medium storing computer program instructions which, when executed by a processor, implement a multi-window adjustment method as claimed in any one of claims 1-12.
14. An electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the multi-window adjustment method of any one of claims 1-12.
15. A multi-window adjustment system, comprising:
a command screen configured to display a video stream of a target signal source;
the splicing controller is in communication connection with the command screen and is configured to receive a video stream of a signal source, adjust the video stream of the target signal source according to a control instruction and target signal source information and output the adjusted video stream to the command screen through a video output interface, wherein the splicing controller receives the control instruction and the target signal source information through a network interface;
the server is configured to be in communication connection with the splicing controller and sends the control instruction and the target signal source information to the network interface of the splicing controller through a network; the server is also configured to be in communication connection with a signal source and used for acquiring a network video stream of the signal source, wherein the network video stream is obtained after the video stream of the signal source is encoded;
a terminal configured to communicatively connect with the server, receive the target signal source information of the server, receive the network video stream corresponding to the target signal source information, bind a window with the target signal source information so that the window can play the network video stream corresponding to the bound target signal source information, and perform the multi-window adjustment method according to any one of claims 1 to 12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110932976.2A CN113608644A (en) | 2021-08-13 | 2021-08-13 | Multi-window adjusting method, readable storage medium, electronic device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110932976.2A CN113608644A (en) | 2021-08-13 | 2021-08-13 | Multi-window adjusting method, readable storage medium, electronic device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113608644A true CN113608644A (en) | 2021-11-05 |
Family
ID=78308571
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110932976.2A Pending CN113608644A (en) | 2021-08-13 | 2021-08-13 | Multi-window adjusting method, readable storage medium, electronic device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113608644A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5463726A (en) * | 1990-11-20 | 1995-10-31 | International Business Machines Corporation | Method and apparatus for graphic accessing of multiple software applications |
| US20180007444A1 (en) * | 2016-07-01 | 2018-01-04 | Snapchat, Inc. | Systems and methods for processing and formatting video for interactive presentation |
| CN111107418A (en) * | 2019-12-19 | 2020-05-05 | 北京奇艺世纪科技有限公司 | Video data processing method, video data processing device, computer equipment and storage medium |
| CN112947815A (en) * | 2021-04-27 | 2021-06-11 | 北京仁光科技有限公司 | Multi-window interaction method and system, readable storage medium and electronic device |
-
2021
- 2021-08-13 CN CN202110932976.2A patent/CN113608644A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5463726A (en) * | 1990-11-20 | 1995-10-31 | International Business Machines Corporation | Method and apparatus for graphic accessing of multiple software applications |
| US20180007444A1 (en) * | 2016-07-01 | 2018-01-04 | Snapchat, Inc. | Systems and methods for processing and formatting video for interactive presentation |
| CN111107418A (en) * | 2019-12-19 | 2020-05-05 | 北京奇艺世纪科技有限公司 | Video data processing method, video data processing device, computer equipment and storage medium |
| CN112947815A (en) * | 2021-04-27 | 2021-06-11 | 北京仁光科技有限公司 | Multi-window interaction method and system, readable storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220247984A1 (en) | System and method for interactive projection | |
| WO2022110903A1 (en) | Method and system for rendering panoramic video | |
| CN109831662B (en) | Real-time picture projection method and device of AR (augmented reality) glasses screen, controller and medium | |
| WO2021204296A1 (en) | Remote display method for three-dimensional model, first terminal, electronic device and storage medium | |
| WO2020007113A1 (en) | Method and device for loading image | |
| US9135885B2 (en) | Resolution independent client side rendering | |
| CN107204023B (en) | Method and apparatus for avoiding distortion of graphics drawn in canvas | |
| EP4160386A1 (en) | Efficient communication interface for casting interactively controlled visual content | |
| WO2023165301A1 (en) | Content publishing method and apparatus, computer device, and storage medium | |
| US9501812B2 (en) | Map performance by dynamically reducing map detail | |
| JP2005148450A (en) | Display controller and program | |
| CN107861711B (en) | Page adaptation method and device | |
| WO2018233537A1 (en) | Method and apparatus for dynamically displaying interface content, and device thereof | |
| WO2023246302A1 (en) | Subtitle display method and apparatus, device and medium | |
| JP2012079188A (en) | Style information processor and method | |
| WO2014174630A1 (en) | Multi-monitor and display method for multi-monitor | |
| CN113608644A (en) | Multi-window adjusting method, readable storage medium, electronic device and system | |
| JP7289390B2 (en) | Image processing device for display wall system and display control method | |
| CN112711459B (en) | Multimedia data processing method, device, equipment and computer readable storage medium | |
| JP6287498B2 (en) | Electronic whiteboard device, electronic whiteboard input support method, and program | |
| CN114741016A (en) | Operation method, device, electronic equipment and computer readable storage medium | |
| CN113094144A (en) | Display screen interface control method and electronic equipment | |
| CN113655923A (en) | Multi-window adjusting method and system, readable storage medium and electronic equipment | |
| JP2002229767A (en) | Animation reproducing method and device | |
| CN116781976B (en) | Program display method, device and system for intelligent television box |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |