CN111045620A - Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system - Google Patents
Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system Download PDFInfo
- Publication number
- CN111045620A CN111045620A CN201910426126.8A CN201910426126A CN111045620A CN 111045620 A CN111045620 A CN 111045620A CN 201910426126 A CN201910426126 A CN 201910426126A CN 111045620 A CN111045620 A CN 111045620A
- Authority
- CN
- China
- Prior art keywords
- scene
- window
- screen
- signal source
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
Abstract
The invention discloses a screen display method on a multi-signal source scene, which comprises the following steps: sending a scene ID, scene information and a windowing request to a server; responding windowing feedback that the server agrees to perform windowing, windowing in a corresponding size according to the scene information at a corresponding position, and drawing corresponding images in each window; and responding to a scene screen loading command, converting the length and width of the scene window and the length and width of the spliced screen to obtain a zoom coefficient, calculating the window position and the window size of each window in the scene relative to the spliced screen according to the zoom coefficient, and sending the scene screen loading command and screen loading information to the server, so that the server can control the splicing controller to open the window at the corresponding position on the screen according to the screen loading information and draw the image of the signal source in the opened window. The invention has simple, flexible and high-efficiency operation. Moreover, even if the client adjusts the scene, the screen content can be always displayed on the screen, and the zero information state can not occur.
Description
Technical Field
The present invention relates to a screen display technology, and in particular, to a screen display method and a screen display system for a multi-signal source scene, and a screen display program product for a multi-signal source scene.
Background
In some instances, a screen within a common line of sight is often used to present relevant content to the public, which may be from multiple sources, including computers and various electronic devices, which may be video or pictures transmitted by such devices. The content of these sources is usually presented on the screen in a fixed layout, for example, assuming that there are three sources to be displayed on the screen, these three sources can be displayed on the screen in a left-to-right manner in sequence.
In order to realize the display of the plurality of signal sources on the screen, a splicing controller is needed, and in order to change the layout of the signal sources on the screen, the connection relationship between each signal source and each input port of the splicing controller needs to be changed.
Disclosure of Invention
In view of the above problems, an aspect of the present invention provides a method for displaying on a screen in a multi-signal-source scene, including:
sending a scene ID, scene information and a windowing request to a server; the scene information includes: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates;
responding windowing feedback that the server agrees to perform windowing, windowing in a corresponding size according to the scene information at a corresponding position, and drawing corresponding images in each window; and
the method comprises the steps of responding to a scene screen loading command, converting the length and width of a scene window and the length and width of a spliced screen to obtain a zoom coefficient, calculating the window position and the window size of each window in the scene relative to the spliced screen according to the zoom coefficient, and sending the scene screen loading command and screen loading information to a server, so that the server can control a splicing controller to open a window at the corresponding position on the screen according to the screen loading information and draw an image of a signal source in the opened window, wherein the screen loading information comprises the calculated window position and window size of each window relative to the spliced screen, the video stream address of an image to be displayed in each window, the IP address and port number of the signal source from which the image originates, the splicing controller channel corresponding to the signal source, and the splicing controller ID.
The second aspect of the present invention provides a method for displaying on screen in a multi-signal-source scene, which includes:
receiving a scene ID, scene information and a windowing request sent by a screen-up requester, if the window-up requester agrees to perform windowing, sending windowing feedback agreeing to perform windowing, and storing the scene ID and the scene information under the screen-up requester, wherein the scene information comprises: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates;
receiving a scene screen loading command and screen loading information, controlling a splicing controller according to the screen loading information, enabling the splicing controller to open windows at corresponding positions on a screen, and drawing an image of a signal source in the opened windows, wherein the screen loading information comprises window positions and window sizes of each window relative to the splicing screen, video stream addresses of images to be displayed in the corresponding windows, IP addresses and port numbers of the signal source from which the images originate, a splicing controller channel corresponding to the signal source and a splicing controller ID.
A third aspect of the invention provides a computer program product comprising instructions for causing a computer to perform the method for on-screen display of a multi-signal source scene when the computer program product runs on a computer.
A fourth aspect of the present invention provides a multi-signal-source scene on-screen display system, which includes: the system comprises at least one client, a server and a splicing controller, wherein the client, the server and the splicing controller are in network connection;
the method comprises the steps that a client sends a scene ID, scene information and a windowing request to a server, wherein the scene information comprises: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates;
the server receives the scene ID, the scene information and the windowing request sent by the client, and if the client agrees to windowing, the server sends windowing feedback agreeing to windowing, and stores the scene ID and the scene information under an upper screen requester corresponding to the client;
the client responds to windowing feedback of windowing agreed by the server, windows in corresponding sizes according to the scene information at corresponding positions, and corresponding images are drawn in each window;
the client receives a scene screen-on command, responds to the scene screen-on command, converts the length and width of a scene window and the length and width of a spliced screen to obtain a zoom coefficient, calculates the window position and the window size of each window in the scene relative to the spliced screen according to the zoom coefficient, and sends the scene screen-on command and screen-on information to the server; the screen-loading information comprises the window position and the window size of each window relative to the splicing screen, the video stream address of the image to be displayed in each window, the IP address and the port number of a signal source from which the image originates, a splicing controller channel corresponding to the signal source and a splicing controller ID;
and the server receives the scene screen-up command and the screen-up information, controls the splicing controller according to the screen-up information, enables the splicing controller to open windows at corresponding positions on the screen, and draws the image of the signal source in the opened windows.
The method is different from the prior art that the layout of a plurality of signal sources is adjusted by changing the position of the input port of the signal source on the splicing controller. Moreover, even if the client side is adjusting the scene, the screen can always display the picture content, a zero information state cannot occur (when the splicing controller is used, the signal source output end needs to be disconnected from the input end of the splicing controller so as to change the signal source to the other input end of the splicing controller, and therefore, a screen picture zero signal is caused), a user cannot perceive that someone is adjusting the scene in the background through the screen, so that the continuous information acquisition requirement of the user is ensured as much as possible, the situation that the attention of the user is wasted in a meaningless layout adjustment process is avoided, and the user can concentrate on the content in the scene.
Drawings
FIG. 1 is a schematic diagram of a multi-signal source on-screen display system according to an embodiment of the present invention;
FIG. 2 is one of the interface screen shots displayed on a client in a multi-signal source on-screen display system according to an embodiment of the present invention;
FIG. 3 is a screen display result on a multi-signal source scene;
FIG. 4 is one of the screenshots of a scene formation process in a multi-signal source scene on-screen display system, according to an embodiment of the present invention;
fig. 5 is one of the screenshots of the scene formation process in the multi-signal source scene on-screen display system according to the embodiment of the invention.
Detailed Description
In this application, references to network implementations are intended to encompass both wired and wireless network connections implemented through the necessary firmware or software, such as switches, routers, etc., as well as wired and wireless network connections implemented through the intermediary of some servers or other computers, etc. In the present application, the networks involved may include Wi-fi networks, Bluetooth networks, Private Area Networks (PAN), Local Area Networks (LAN), Wide Area Networks (WAN), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), Integrated digital enhanced network (iDEN), WiMAX, LTE advanced, Mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, such as a VPN.
In addition, since the transmission of signals over a network (including encoding the signals into a video stream of a certain format, such as an rtsp stream, etc., and decoding accordingly) is well known, no additional component or process descriptions are provided for the encoding, decoding, and transmission of such portions.
In order to facilitate understanding of the technical solution of the present invention, the embodiment of the present invention is described by taking a personal computer as an example. Those skilled in the art will appreciate that the means for hosting the respective clients and servers of the present invention may be any of a variety of electronic devices including, but not limited to, personal computers, server computers, hand-held or laptop devices, mobile devices (such as mobile phones, Personal Digital Assistants (PDAs), media players, and the like), multiprocessor systems, consumer electronics, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. In the application, the screen-up requester can be understood as a screen-up requester client, the client can be understood as a client device, and the server can be understood as a server device according to the context. The signal source mentioned in the present application may include various electronic devices mentioned above, which are used for providing images in a scene, and furthermore, the signal source may also be installed with a corresponding client or server according to actual needs, so as to execute the corresponding method of the present invention. In addition, the signal source may also include various cameras that provide video or pictures as providers of images of the scene.
Fig. 1 is a schematic diagram of a multi-signal-source scene on-screen display system provided in a first aspect of the present application, where the multi-signal-source scene on-screen display system includes at least one client, a server 3 and a splice controller 5, where the at least one client may be installed on a signal source 1 or 2, the signal source 1, the signal source 2, the server 3 and the splice controller 5 are connected to each other through a router 4, output ends of the signal source 1 and the signal source 2 are respectively connected to an input end of the splice controller 5, and the splice controller 5 outputs contents of the signal sources 1 and 2 to a screen 6.
Fig. 2 illustrates one of the screenshots presented by a client of the on-screen display system for a multiple signal source scene, the right side of the screenshot displaying image content of the multiple signal sources located within the multiple windows, and the left side of the screenshot displaying thumbnails of the image layouts of the multiple signal sources on the right side, according to an embodiment of the invention. For example, the current right side in the figure shows a scene with a scene ID of "plan number six", in the "plan number six" scene, images from three signal sources are distributed in a scene display area on the right side, specifically, located at the upper left, upper right, and lower left of the area, and each signal source occupies one display window or window. The thumbnail corresponding to this "plan six" scene is located second to the left. Also shown on the left side of fig. 2 are a number of other scene thumbnails with the scene ID below, which may be, for example, scenes composed of four (or two) signal source content in different layouts.
According to the actual situation, the position, the size, the overlapping sequence and the like of the display window of each signal source on the right side can be adjusted through the dragging operation. As described further below with respect to fig. 4 and 5, the information about the position, size, etc. of the window is transmitted to the server, and the server stores the information about the position, size, etc. of the window according to the storage requirements of the client. When the client side requires synchronization later, the server side sends the information such as the position, the size and the like of the window stored by the server side to the client side, the client side zooms the window according to the zoom scale and provides a corresponding scene thumbnail, and therefore the thumbnail can reflect the layout condition of a right signal source.
The embodiments of the multi-signal-source scene on-screen display method of the present invention will now be exemplarily described in conjunction with the client, the server, and the like of the multi-signal-source scene on-screen display system of the present invention. However, the implementation of the on-screen display method in the multi-signal source scenario according to the present invention is not limited to the implementation by such a client and a server.
According to some embodiments of the multi-signal source scene on-screen display method of the present invention, the method comprises;
s1, sending a scene ID, scene information and a windowing request to a server; the scene information includes: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates; the scene information may further include information such as a signal source resolution, a window stacking order, a signal source frame rate, and the like.
The method comprises the steps of setting a signal source 1 to be provided with a client of a multi-signal-source scene screen display system for implementing the method, calling the signal source 1 or the client corresponding to the signal source 1 as a screen requester, and sending a scene ID, scene information and a windowing request to a server through the screen requester.
And S2, responding windowing feedback that the server agrees to perform windowing, windowing in a corresponding size according to the scene information at a corresponding position, and drawing corresponding images in each window.
In step S1, the on-screen requester (signal source 1) sends a scene ID, scene information, and a windowing request to the server; after receiving the scene ID, the scene information and the windowing request from the signal source 1, the server sends windowing feedback for granting windowing to the upper screen requester if the upper screen requester is granted to open windows in corresponding positions and sizes for respectively displaying the source images of the signals in the scene, and stores the scene ID and the scene information under the upper screen requester (or stored in the data of the upper screen requester). The feedback may also include the scene ID and scene information.
And after receiving windowing feedback that the server side agrees to perform windowing, the on-screen requester performs windowing in a corresponding size and draws corresponding images in each window according to the scene information at a corresponding position. The corresponding video network image can be rendered within each window, for example by decoding the RTSP stream of the signal source of the respective window. Since it is known to those skilled in the art to draw an image within a certain window, the description is not provided herein. The result of the drawing may refer to fig. 2.
Then, for each window moving, zooming out and zooming in operation, the on-screen requester sends a window adjustment request and window adjustment information to the server, and after the server agrees to the window adjustment, the corresponding window is moved, zoomed out and zoomed in, and meanwhile, the server stores the adjusted scene information, and the scene information is stored under the on-screen requester (or stored in the data of the on-screen requester). The method comprises the steps of sending a window adjustment request and window adjustment information to a server, and adjusting a corresponding window after the server agrees to window adjustment, wherein the adjustment information comprises: the window moves, reduces and enlarges the relevant parameters, such as the moving distance and the moving direction, the reduction factor and the enlargement factor, and the like.
S3, responding to a scene screen loading command, converting the length and width of a scene window and the length and width of a spliced screen to obtain a zoom coefficient, calculating the window position and the window size of each window in the scene relative to the spliced screen according to the zoom coefficient, and sending the scene screen loading command and screen loading information to the server so that the server can control the splicing controller to open the window at the corresponding position on the screen according to the screen loading information, as shown in FIG. 3; the screen-loading information comprises the window position and the window size of each window relative to the splicing screen, the video stream address of the image to be displayed in each window, the IP address and the port number of the signal source from which the image originates, the splicing controller channel corresponding to the signal source, the splicing controller ID and other information.
The scene on-screen command may be initiated by an on-screen requester, for example, the on-screen request may be implemented by a user clicking a scene on-screen tab in an operation interface of a computer of the on-screen requester.
The length and width of the scene window refer to the length and width of the window displaying the scene.
The window position and the window size of each window in the scene relative to the spliced screen are as follows: when the scene is displayed on the spliced screen, the position and the size of each window are required.
The splicing controller channel corresponding to the signal source is an input position of the signal source on the splicing controller, for example, the signal source 1 is connected to a first input port of the splicing controller, and the signal source 2 is connected to a second input port of the splicing controller.
Since the information on the screen received by the server includes the information such as the splice controller channel and the splice controller ID corresponding to the signal source, after receiving the scene screen command and the screen information, the server can control the splice controller to open a window at a corresponding position on the screen according to the screen information, for example, open a first window having a corresponding size for the signal source 1 (i.e., from the first input port) at the first position and draw the image of the signal source 1 therein, and open a second window having a corresponding size for the signal source 2 (i.e., from the second input port) at the second position and draw the image of the signal source 2 therein, so that the signal source 1 at the first input port is displayed on the first window, and the signal source 2 at the second input port is displayed on the second window.
According to still further embodiments of the multi-signal source scene on-screen display method of the present invention, the method comprises:
s1, receiving a scene ID, scene information and a windowing request sent by a screen-up requester, if windowing is agreed, sending windowing feedback agreeing to windowing, and storing the scene ID and the scene information under the screen-up requester (or under the data of the screen-up requester); the scene information includes: the method comprises the steps of identifying each window ID in a scene, each window position in the scene, each window size in the scene, the video stream address of an image to be displayed in each window, and the IP address and port number of a signal source from which the image originates.
Here, the scene ID, the scene information, and the windowing request are transmitted to the server through the on-screen requester (assumed as the signal source 1). After receiving the scene ID, the scene information and the windowing request of the screen-up requester, if the screen-up requester is allowed to open windows in corresponding positions and sizes for respectively displaying each signal source in the scene, the server sends windowing feedback for allowing windowing to the screen-up requester, and stores the scene ID and the scene information under the screen-up requester (or stored in the data of the screen-up requester). The windowing feedback may also continue to include the scene ID and scene information. The scene information may further include information such as a signal source resolution, a window stacking order, a signal source frame rate, and the like.
Thereafter, the screen-up requester sends a window adjustment request and window adjustment information to the server for each window moving, zooming-out and zooming-in operation of the screen-up requester. After receiving the window adjustment request and the window adjustment information, the server sends corresponding adjustment feedback to the upper screen requester if the adjustment is agreed, so that the upper screen requester moves, reduces and enlarges the corresponding window, and meanwhile, the server stores the adjusted scene information and stores the scene information under the upper screen requester (or in the data of the upper screen requester). The adjustment information includes: the window moves, reduces and enlarges the relevant parameters, such as the moving distance and the moving direction, the reduction factor and the enlargement factor, and the like.
S2, receiving a scene screen loading command and screen loading information, controlling a splicing controller according to the screen loading information, enabling the splicing controller to open windows at corresponding positions on a screen, and drawing an image of a signal source in the opened windows; the screen-loading information comprises the window position and the window size of each window relative to the splicing screen, the video stream address of the image to be displayed in each window, the IP address and the port number of the signal source from which the image originates, the splicing controller channel corresponding to the signal source, the splicing controller ID and other information.
And the screen-up requester sends a scene screen-up command and screen-up information to the server, and after receiving the scene screen-up command and the screen-up information, the server can control the splicing controller to open a window at a corresponding position on the screen according to the screen-up information and draw an image of the signal source in the opened window. Initiation of the scene on-screen command may be accomplished, for example, by clicking on a scene on-screen tab in the on-screen requestor computer operating interface.
The window position and the window size of each window in the scene relative to the spliced screen are as follows: when the scene is displayed on the spliced screen, the position and the size of each window are required.
The splicing controller channel corresponding to the signal source is an input position of the signal source on the splicing controller, for example, the signal source 1 is connected to a first input port of the splicing controller, and the signal source 2 is connected to a second input port of the splicing controller.
Because the on-screen information received by the server contains information such as the splicing controller channel and the splicing controller ID corresponding to the signal source, therefore, after receiving the scene screen-up command and the screen-up information, the server can control the splicing controller to open the window at the corresponding position on the screen according to the screen-up information, and draw the image of the signal source in the opened window, for example, in a first position, a first window of corresponding size is opened for the signal of the signal source 1, i.e. from the first input port, and an image of the signal source 1 is drawn therein, and a second window of corresponding size for the signal source 2, i.e. from the second input port, is opened in the second position, and an image of the signal source 2 is drawn therein, thereby causing the signal source 1 of the first input port to be displayed on the first window and the signal source 2 of the second input port to be displayed on the second window.
Different from the prior art that the layout of a plurality of signal sources must be adjusted by changing the positions of the input ports of the signal sources on the splicing controller, as described above, the multi-signal-source scene on-screen method implemented by the invention enables the control of the display of the multi-signal-source scene on the screen and the layout adjustment of the multi-signal-source scene to be implemented by the program with the corresponding functions of the invention. Compared with the prior art, the method is simple, flexible and efficient to operate. Moreover, even if the client is adjusting the scene, the screen can always display the picture content, and no zero information state occurs (in the prior art, the signal source output end needs to be disconnected from the input end of the splicing controller so as to switch the signal source to the other input end of the splicing controller, thereby causing the zero signal of the screen picture), the user can not perceive the background person adjusting the scene through the screen, thereby ensuring the continuous information acquisition requirement of the user as much as possible, avoiding the user attention from being wasted in a meaningless layout adjusting process, and enabling the user to concentrate on the content in the scene.
The method is different from the prior art that the layout of a plurality of signal sources is adjusted by changing the position of the input port of the signal source on the splicing controller. Moreover, even if the client side is adjusting the scene, the screen can always display the picture content, a zero information state cannot occur (when the splicing controller is used, the signal source output end needs to be disconnected from the input end of the splicing controller so as to change the signal source to the other input end of the splicing controller, and therefore, a screen picture zero signal is caused), a user cannot perceive that someone is adjusting the scene in the background through the screen, so that the continuous information acquisition requirement of the user is ensured as much as possible, the situation that the attention of the user is wasted in a meaningless layout adjustment process is avoided, and the user can concentrate on the content in the scene.
Fig. 4 and 5 show screenshots of one scene generation process that may be used in the multi-signal source on-screen display method of the present invention.
To illustrate the scene generation process, referring to fig. 2, the left area of the main interface of fig. 2 is an image corresponding to 4 accessible clients (or signal sources) within the access authority range of the client (or the on-screen requester client), and the left area of the main interface may also present a list of IP addresses of all accessible clients, as shown in fig. 5, where the accessible clients may include the client itself.
In some embodiments, if some or all of the clients within the access right range of the client are not accessed into the server, the corresponding client identification positions in the list may be presented in a gray inoperable state, so that the user can see the operable clients at a glance.
The user of the client may operate on the left IP list, for example, if the user of the upper screen requester client wants to access data of one of the client a, a mouse may be clicked at the position of the client a in the list and an action of dragging the client a into the right side of the main interface is performed (where the identification of the client a may not actually move, and the size and position of the dragging defines the size and position of the window); when the connection with the client a is established for the first time, an instruction (including the window size and position therein and the related information of the signal source to be dragged) corresponding to the action is sent to the server, if the server agrees to perform the operation, the server agrees to display the data of the client a in the window size corresponding to the dragging operation, the server sends the instruction to the client a to instruct the client a to send the data, for example, a desktop, to the screen-up requester client, and the screen-up requester client then displays the desktop of the client a (assuming that the desktop of the client a is a map picture) on the right side of the main interface in the position and display window size, as shown in the area on the right side of fig. 4. Similarly, a screenup requestor client may issue a request to a server to open multiple clients simultaneously, e.g., drag the client's desktop all into the right side. Desktop windows of the clients can be displayed in an overlapping manner.
The above shows a scene generation manner, that is, a server receives a scene forming request and corresponding scene information that are sent by a screen-up requester (a screen-up requester client) and require to form a certain scene, and if the scene forming request is granted, the screen-up requester (the screen-up requester client) is instructed to form a scene corresponding to the scene information.
Those skilled in the art will appreciate that the above-described scene formation process is for exemplary purposes only, and that the formation of a scene may also be accomplished in other ways.
As shown in fig. 1, the multi-signal-source on-screen display system 1 according to the embodiment of the present invention includes: the system comprises at least one client, a server 3 and a splicing controller 5, wherein the at least one client can be installed on the signal source 1 or 2, the signal source 1, the signal source 2, the server 3 and the splicing controller 5 are connected through a network (for example, through a router therein), output ends of the signal source 1 and the signal source 2 are respectively connected to an input end of the splicing controller 5, and the splicing controller 5 outputs contents of the signal sources 1 and 2 to a screen 6.
Assuming that the signal source 1 is installed with the client, the signal source 1 is referred to as a screen-up requester (or called a screen-up requester client) and sends a scene ID, scene information, and a windowing request to the server. The scene information includes: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates; the scene information may further include information such as a signal source resolution, a window stacking order, a signal source frame rate, and the like.
And the server receives the scene ID, the scene information and the windowing request sent by the screen-up requester, sends windowing feedback for agreeing to window-opening if the window-opening is agreed, and stores the scene ID and the scene information under the screen-up requester (or under the data of the screen-up requester). The feedback may also include the scene ID and scene information.
And the screen-up requester responds to the windowing feedback of the windowing agreed by the server, windows in corresponding sizes according to the scene information at corresponding positions, and draws corresponding images in each window. The corresponding video network image can be rendered within each window, for example by decoding the RTSP stream of the signal source of the respective window. Since it is known to those skilled in the art to draw an image within a certain window, the description is not provided herein. The result of the drawing may refer to fig. 2.
Then, for each window moving, zooming out and zooming in operation, the on-screen requester sends a window adjustment request to the server, and after the server agrees to the window adjustment, the corresponding window is moved, zoomed out and zoomed in, and the server stores the adjusted scene information and stores the scene information under the on-screen requester (or stored in the on-screen requester data).
After the screen application requester receives the scene screen application command, for example, the screen application requester can input the screen application command or receive the scene screen application command by clicking a scene screen application tag in a client of the screen application requester or in a computer operation interface.
Responding to a scene screen-up command, converting the length and width of a scene window and the length and width of a spliced screen by a screen-up requester to obtain a scaling coefficient, calculating the window position and the window size of each window in the scene relative to the spliced screen according to the scaling coefficient, and sending the scene screen-up command and screen-up information to a server; the screen-loading information comprises the window position and the window size of each window relative to the splicing screen, the video stream address of the image to be displayed in each window, the IP address and the port number of the signal source from which the image originates, the splicing controller channel corresponding to the signal source, the splicing controller ID and other information.
The window position and the window size of each window in the scene relative to the spliced screen are as follows: when the scene is displayed on the spliced screen, the position and the size of each window are required.
The splicing controller channel corresponding to the signal source is an input position of the signal source on the splicing controller, for example, the signal source 1 is connected to a first input port of the splicing controller, and the signal source 2 is connected to a second input port of the splicing controller.
And the server receives the scene screen-up command and the screen-up information, controls the splicing controller according to the screen-up information, enables the splicing controller to open windows at corresponding positions on the screen, and draws the image of the signal source in the opened windows.
Because the on-screen information received by the server contains information such as the splicing controller channel and the splicing controller ID corresponding to the signal source, therefore, after receiving the scene screen-up command and the screen-up information, the server can control the splicing controller to open the window at the corresponding position on the screen according to the screen-up information, and draw the image of the signal source in the opened window, for example, in a first position, a first window of corresponding size is opened for the signal of the signal source 1, i.e. from the first input port, and an image of the signal source 1 is drawn therein, and a second window of corresponding size for the signal source 2, i.e. from the second input port, is opened in the second position, and an image of the signal source 2 is drawn therein, thereby causing the signal source 1 of the first input port to be displayed on the first window and the signal source 2 of the second input port to be displayed on the second window.
The various parts of the multi-signal source scene on-screen display system, including the server and client therein, were referred to in the foregoing when describing the multi-signal source scene on-screen display method around fig. 1-5. Those skilled in the art will appreciate, upon reading the present context, that the foregoing description of the server and client in the on-screen display method embodiment of the multiple signal source scenario may be included in this embodiment without modification or with appropriate modification. Still other embodiments of the multi-signal-source on-screen display system according to the present invention include respective combinations of the client and the server involved in completing the aforementioned multi-signal-source on-screen display method. For simplicity, further description is omitted here.
The present application further provides a computer program product comprising computer executable instructions which, when executed by a processor, cause the processor to perform the steps performed by the server or the client in the multi-signal source scene synchronization method between the aforementioned screens, according to some embodiments. In the foregoing, when the on-screen display method in a multi-signal-source scene is described, detailed descriptions are given to the server and the client, and are not repeated here for the sake of simplicity.
The present application further provides a computer device, according to some embodiments of the computer program device, the computer device includes a memory, a processor, and a computer program stored on the memory and executable on the computer, where the processor implements the steps performed by the server or the client in the multi-signal-source scene on-screen display method. In the foregoing, when the on-screen display method in a multi-signal-source scene is described, detailed descriptions are given to the server and the client, and are not repeated here for the sake of simplicity.
The present application also provides a computer apparatus for implementing a process or a part of a process performed by a client in the method, the computer apparatus comprising:
1, a windowing request module, configured to send a scene ID, scene information, and a windowing request to a server, where the scene information includes: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates; the scene information may further include information such as a signal source resolution, a window stacking order, a signal source frame rate, and the like.
2. The windowing module is used for responding windowing feedback that the server side agrees to perform windowing, windowing in a corresponding size according to the scene information at a corresponding position and drawing corresponding images in each window; the feedback may also further include the scene information.
And then, aiming at each window moving, reducing and amplifying operation, the windowing request module sends a window adjusting request to the server side, and enables the corresponding window to move, reduce and amplify after the server side agrees to the window adjustment.
3. Scene screen module
The scene screen-on module is used for responding to a scene screen-on command, converting the length and width of the scene window and the length and width of the spliced screen to obtain a zoom coefficient, and calculating the window position and the window size of each window in the scene relative to the spliced screen according to the zoom coefficient, namely, when the scene is displayed on the spliced screen, the position and the size of each window are correspondingly positioned.
The scene screen-on module sends a scene screen-on command and screen-on information to the server, where the screen-on information includes information such as a window position and a window size of each window relative to the mosaic screen, a video stream address of an image to be displayed in each window, an IP address and a port number of a signal source from which the image originates, a mosaic controller channel corresponding to the signal source (e.g., a first input port of the signal source 1 accessing the mosaic controller, a second input port of the signal source 2 accessing the mosaic controller), and a mosaic controller ID, so that the server can control the mosaic controller to open a window at a corresponding position on the screen according to the screen-on information and draw the image of the signal source in the window, for example, opening a first window with a corresponding size for the signal of the signal source 1 (i.e., from the first input port) at the first position, and draws therein an image of the signal source 1 and opens a second window of corresponding size for the signal source 2 (i.e. from the second input port) at the second position and draws therein an image of the signal source 2, such that the signal source 1 of the first input port is displayed on the first window and the signal source 2 of the second input port is displayed on the second window.
The present application further provides a computer apparatus for carrying out the processes performed by the client in the method or a part thereof, the computer apparatus comprising, according to one embodiment of the computer apparatus:
1. windowing response module
And the windowing response module receives the scene ID, the scene information and the windowing request from the client, sends windowing feedback agreeing to windowing to the client if the client agrees to windowing, and stores the scene ID and the scene information in the user corresponding to the client (or in corresponding user data or in a corresponding user name). The feedback may also include the scene ID and scene information.
2. Scene on-screen response module
The scene screen-on response module controls the splicing controller to open a window at a corresponding position on the screen according to the scene screen-on command and the screen-on information sent by the client, for example, to open a first window with a corresponding size for the signal source 1 (i.e., from the first input port) at the first position and draw the image of the signal source 1 therein, and to open a second window with a corresponding size for the signal source 2 (i.e., from the second input port) at the second position and draw the image of the signal source 2 therein, so that the signal source 1 at the first input port is displayed on the first window, and the signal source 2 at the second input port is displayed on the second window.
According to some other embodiments of the computer device, the computer device of the present invention may further include more modules corresponding to the steps or details involved in the server of the foregoing multi-signal-source-scene on-screen display method embodiment. For the sake of simplicity, no further description is provided herein.
In view of the fact that modules corresponding to step sequences can be continuously generated to achieve the same functional effect in the field of computers, or functional modules can be formed by subdividing details of each step and continuously calling the functional modules back to achieve a larger function, the scope of the present invention is not limited to the modules provided herein, and all combinations of modules that can achieve the aforementioned functions of the present invention are within the scope of the present invention.
The method is different from the prior art that the layout of a plurality of signal sources is adjusted by changing the position of the input port of the signal source on the splicing controller. Moreover, even if the client side is adjusting the scene, the screen can always display the picture content, a zero information state cannot occur (when the splicing controller is used, the signal source output end needs to be disconnected from the input end of the splicing controller so as to change the signal source to the other input end of the splicing controller, and therefore, a screen picture zero signal is caused), a user cannot perceive that someone is adjusting the scene in the background through the screen, so that the continuous information acquisition requirement of the user is ensured as much as possible, the situation that the attention of the user is wasted in a meaningless layout adjustment process is avoided, and the user can concentrate on the content in the scene.
Claims (10)
1. The method for displaying the screen on the scene with multiple signal sources comprises the following steps:
sending a scene ID, scene information and a windowing request to a server; the scene information includes: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates;
responding windowing feedback that the server agrees to perform windowing, windowing in a corresponding size according to the scene information at a corresponding position, and drawing corresponding images in each window; and
the method comprises the steps of responding to a scene screen loading command, converting the length and width of a scene window and the length and width of a spliced screen to obtain a zoom coefficient, calculating the window position and the window size of each window in the scene relative to the spliced screen according to the zoom coefficient, and sending the scene screen loading command and screen loading information to a server, so that the server can control a splicing controller to open a window at the corresponding position on the screen according to the screen loading information and draw an image of a signal source in the opened window, wherein the screen loading information comprises the calculated window position and window size of each window relative to the spliced screen, the video stream address of an image to be displayed in each window, the IP address and port number of the signal source from which the image originates, the splicing controller channel corresponding to the signal source, and the splicing controller ID.
2. The multi-signal source scene on-screen display method of claim 1, comprising:
sending a window adjustment request and window adjustment information to a server, and adjusting a corresponding window after the server agrees to the window adjustment, wherein the adjustment information comprises: window movement, reduction and enlargement of the relevant parameters.
3. The method for displaying the screen on the scene with multiple signal sources comprises the following steps:
receiving a scene ID, scene information and a windowing request sent by a screen-up requester, if the window-up requester agrees to perform windowing, sending windowing feedback agreeing to perform windowing, and storing the scene ID and the scene information under the screen-up requester, wherein the scene information comprises: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates;
receiving a scene screen loading command and screen loading information, controlling a splicing controller according to the screen loading information, enabling the splicing controller to open windows at corresponding positions on a screen, and drawing an image of a signal source in the opened windows, wherein the screen loading information comprises window positions and window sizes of each window relative to the splicing screen, video stream addresses of images to be displayed in the corresponding windows, IP addresses and port numbers of the signal source from which the images originate, a splicing controller channel corresponding to the signal source and a splicing controller ID.
4. A multi-signal source on-screen display method according to claim 3, comprising:
after receiving the window adjustment request and the window adjustment information, the server sends corresponding adjustment feedback to the upper screen requester if the adjustment is agreed, so that the upper screen requester moves, reduces and enlarges the corresponding window, and simultaneously stores the adjusted scene information under the upper screen requester; the adjustment information includes: window movement, reduction and enlargement of the relevant parameters.
5. The method for on-screen display of a multi-signal source scene of claim 4, wherein the windowing feedback comprises a scene ID and scene information.
6. The method for on-screen display of a multi-signal-source scene according to any of claims 1-5, wherein the scene information comprises a signal source resolution, a window stacking order, and a signal source frame rate.
7. Computer program product comprising instructions for causing a computer to perform the method for on-screen display of a multi-signal source scenario according to one of claims 1 to 6 when the computer program product is run on the computer.
8. A multi-signal source on-screen display system, comprising: the system comprises at least one client, a server and a splicing controller, wherein the client, the server and the splicing controller are in network connection;
the method comprises the steps that a client sends a scene ID, scene information and a windowing request to a server, wherein the scene information comprises: ID of each window in the scene, position of each window in the scene, size of each window in the scene, video stream address of the image to be displayed in each window, IP address and port number of the signal source from which the image originates;
the server receives the scene ID, the scene information and the windowing request sent by the client, and if the client agrees to windowing, the server sends windowing feedback agreeing to windowing, and stores the scene ID and the scene information under an upper screen requester corresponding to the client;
the client responds to windowing feedback of windowing agreed by the server, windows in corresponding sizes according to the scene information at corresponding positions, and corresponding images are drawn in each window;
the client receives a scene screen-on command, responds to the scene screen-on command, converts the length and width of a scene window and the length and width of a spliced screen to obtain a zoom coefficient, calculates the window position and the window size of each window in the scene relative to the spliced screen according to the zoom coefficient, and sends the scene screen-on command and screen-on information to the server; the screen-loading information comprises the window position and the window size of each window relative to the splicing screen, the video stream address of the image to be displayed in each window, the IP address and the port number of a signal source from which the image originates, a splicing controller channel corresponding to the signal source and a splicing controller ID;
and the server receives the scene screen-up command and the screen-up information, controls the splicing controller according to the screen-up information, enables the splicing controller to open windows at corresponding positions on the screen, and draws the image of the signal source in the opened windows.
9. The multi-signal source scene on-screen display system of claim 8, wherein, after receiving the window adjustment request and the window adjustment information, the server sends a corresponding adjustment feedback to the client if the adjustment is agreed to be performed, so that the client moves, reduces and enlarges the corresponding window, and simultaneously the server stores the adjusted scene information, which is stored under the on-screen requester corresponding to the client; the adjustment information includes: window movement, reduction and enlargement of the relevant parameters.
10. The multi-signal source scene on-screen display system of claim 8 or 9, wherein the windowing feedback comprises a scene ID and scene information; the scene information comprises signal source resolution, window stacking sequence and signal source frame rate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910426126.8A CN111045620B (en) | 2019-05-21 | 2019-05-21 | Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910426126.8A CN111045620B (en) | 2019-05-21 | 2019-05-21 | Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111045620A true CN111045620A (en) | 2020-04-21 |
| CN111045620B CN111045620B (en) | 2021-02-26 |
Family
ID=70231665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910426126.8A Active CN111045620B (en) | 2019-05-21 | 2019-05-21 | Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111045620B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111831245A (en) * | 2020-07-14 | 2020-10-27 | 北京仁光科技有限公司 | Windowing control method and device in display control system and storage medium |
| CN112463095A (en) * | 2020-12-04 | 2021-03-09 | 威创集团股份有限公司 | Multi-signal window synchronous windowing display method and device |
| CN112711389A (en) * | 2020-12-31 | 2021-04-27 | 安徽听见科技有限公司 | Multi-terminal screen-loading method, device and equipment applied to electronic whiteboard |
| CN112929583A (en) * | 2021-05-10 | 2021-06-08 | 北京小鸟科技股份有限公司 | Method and system for synchronously recording and replaying original signal source based on large-screen window |
| CN113823211A (en) * | 2021-09-28 | 2021-12-21 | 惠科股份有限公司 | Driving method, driving device and display device |
| CN114020396A (en) * | 2021-11-18 | 2022-02-08 | 湖南麒麟信安科技股份有限公司 | Display method of application program and data generation method of application program |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104184825A (en) * | 2014-09-05 | 2014-12-03 | 国家电网公司 | Mobile terminal control method based on splicing controller echo |
| CN107766024A (en) * | 2017-10-20 | 2018-03-06 | 威创集团股份有限公司 | A kind of PPT projection control methods and system based on combination |
| CN107807807A (en) * | 2017-11-16 | 2018-03-16 | 威创集团股份有限公司 | The signal source Zoom method and system of display window |
| CN109144304A (en) * | 2018-02-13 | 2019-01-04 | 北京仁光科技有限公司 | At least one display window distributing adjustment and touch-control automatic calibrating method and system |
| CN109697042A (en) * | 2017-10-20 | 2019-04-30 | 北京仁光科技有限公司 | Multisignal source dispatching method, device, equipment and computer readable storage medium |
-
2019
- 2019-05-21 CN CN201910426126.8A patent/CN111045620B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104184825A (en) * | 2014-09-05 | 2014-12-03 | 国家电网公司 | Mobile terminal control method based on splicing controller echo |
| CN107766024A (en) * | 2017-10-20 | 2018-03-06 | 威创集团股份有限公司 | A kind of PPT projection control methods and system based on combination |
| CN109697042A (en) * | 2017-10-20 | 2019-04-30 | 北京仁光科技有限公司 | Multisignal source dispatching method, device, equipment and computer readable storage medium |
| CN107807807A (en) * | 2017-11-16 | 2018-03-16 | 威创集团股份有限公司 | The signal source Zoom method and system of display window |
| CN109144304A (en) * | 2018-02-13 | 2019-01-04 | 北京仁光科技有限公司 | At least one display window distributing adjustment and touch-control automatic calibrating method and system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111831245A (en) * | 2020-07-14 | 2020-10-27 | 北京仁光科技有限公司 | Windowing control method and device in display control system and storage medium |
| CN112463095A (en) * | 2020-12-04 | 2021-03-09 | 威创集团股份有限公司 | Multi-signal window synchronous windowing display method and device |
| CN112711389A (en) * | 2020-12-31 | 2021-04-27 | 安徽听见科技有限公司 | Multi-terminal screen-loading method, device and equipment applied to electronic whiteboard |
| CN112929583A (en) * | 2021-05-10 | 2021-06-08 | 北京小鸟科技股份有限公司 | Method and system for synchronously recording and replaying original signal source based on large-screen window |
| CN112929583B (en) * | 2021-05-10 | 2021-07-23 | 北京小鸟科技股份有限公司 | Method and system for synchronously recording and replaying original signal source based on large-screen window |
| CN113823211A (en) * | 2021-09-28 | 2021-12-21 | 惠科股份有限公司 | Driving method, driving device and display device |
| CN113823211B (en) * | 2021-09-28 | 2022-08-23 | 惠科股份有限公司 | Driving method, driving device and display device |
| CN114020396A (en) * | 2021-11-18 | 2022-02-08 | 湖南麒麟信安科技股份有限公司 | Display method of application program and data generation method of application program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111045620B (en) | 2021-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111045620B (en) | Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system | |
| JP7385052B2 (en) | Photography methods, equipment, electronic equipment and storage media | |
| US9197853B2 (en) | Switching between views using natural gestures | |
| US11729355B2 (en) | Video conferencing during real time collaboration on a virtual canvas | |
| EP2637401A1 (en) | Video communication terminal and method of displaying images | |
| KR101989016B1 (en) | Method and apparatus for transferring files during video telephony in electronic device | |
| US10897435B2 (en) | Instant messaging method and system, and electronic apparatus | |
| CN112181342A (en) | Display method, display device, electronic apparatus, and storage medium | |
| WO2021073327A1 (en) | Window display method and apparatus, and terminal and storage medium | |
| CN110958479B (en) | Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system | |
| JP2017033291A (en) | Information processing device and control method thereof, information processing system, and computer program | |
| CN113535315A (en) | Background graph generation method and device, electronic equipment and storage medium | |
| WO2023217081A1 (en) | Element control method and apparatus for information input page, device, and medium | |
| CN112995401A (en) | Control display method, device, equipment and medium | |
| US10764535B1 (en) | Facial tracking during video calls using remote control input | |
| JP2016225874A (en) | Display image zooming terminal, display image zooming method and display image zooming program | |
| CN114510205B (en) | Display interaction method, display device, electronic device and storage medium | |
| US9137487B2 (en) | Apparatus and method for providing video call in portable terminal | |
| WO2020000393A1 (en) | Image processing method and apparatus, first electronic device, and image processing system | |
| CN112312058B (en) | Interaction method and device and electronic equipment | |
| US20210065333A1 (en) | Image processing apparatus and non-transitory computer readable medium storing program | |
| JP5678753B2 (en) | Screen synchronization system and information processing apparatus | |
| CN220823147U (en) | Multi-signal source remote calling system | |
| CN114564267B (en) | Information processing method, apparatus, electronic device and storage medium | |
| CN106201397B (en) | Display method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |