CN111510741A - System and method for transmission and distributed display of at least two video signals - Google Patents
System and method for transmission and distributed display of at least two video signals Download PDFInfo
- Publication number
- CN111510741A CN111510741A CN202010318461.9A CN202010318461A CN111510741A CN 111510741 A CN111510741 A CN 111510741A CN 202010318461 A CN202010318461 A CN 202010318461A CN 111510741 A CN111510741 A CN 111510741A
- Authority
- CN
- China
- Prior art keywords
- video
- screen
- decoding
- encoder
- layout mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Abstract
The invention relates to a system for the transmission and distributed display of at least two video signals, an encoder receiving the input of the video signals, a sub-screen receiving the input of a decoding and display component; an encoder removes the covered area of the current frame of the received video signal according to the layout mode of the video window of the video signal on the screen and the information corresponding to the covered area, and then encodes the processed current frame into n parts according to the layout mode, wherein n is the number of sub-screens spanned on the screen by the video window corresponding to the video signal determined according to the layout mode; the encoder also encapsulates the encoded portions into corresponding video streams and sends the video streams over a network to corresponding decoding and display components. The invention can eliminate or reduce the memory space required by the covered area of the video window during coding, reduce the bandwidth in the transmission process, eliminate redundant data and improve the real-time transmission.
Description
Technical Field
The present invention relates to video signal transmission and display technology, and more particularly to transmission and distributed display technology for multiple video signals.
Background
In the prior art, in order to retrieve and display the contents of a plurality of remote video signals on a local screen, the contents of the plurality of video signals need to be encoded into each network stream signal, the network stream signal is transmitted to the local through a network, then the network stream signal is decoded into a video stream signal, and then the video stream signal is output to the local screen.
With the continuous improvement of the video definition requirement of the user, in the above process, the video signal content with high definition needs to be coded and decoded, so the coding and decoding calculation amount is also continuously improved, and the response delay is caused; in addition, when a large number of video signals need to be called, each high-definition video signal occupies a large bandwidth, which causes network congestion and unsmooth transmission of each video signal.
Disclosure of Invention
In view of the above, the present application proposes a system, method, device and storage medium for transmission and distributed display of at least two video signals.
A first aspect of the invention provides a system for transmission and distributed display of at least two video signals, the system comprising: an encoder, a decoding and displaying part, and a screen including a plurality of sub-screens, the encoder receiving an input of a video signal, the sub-screens receiving an input of the decoding and displaying part;
an encoder removes the covered area of the current frame of the received video signal according to the layout mode of the video window of the video signal on the screen and the information corresponding to the covered area, and then encodes the processed current frame into n parts according to the layout mode, wherein n is the number of sub-screens spanned on the screen by the video window corresponding to the video signal determined according to the layout mode; the encoder also encapsulates each encoded part into a corresponding video stream and sends the video stream to a corresponding decoding and displaying component through a network, wherein the corresponding decoding and displaying component is a decoding and displaying component connected with a sub-screen spanned on a screen by a video window;
the decoding and displaying part receives the video stream from the encoder, draws images according to the layout mode and the stacking relation of the video windows of the video signal on the screen, and outputs the images to the corresponding sub-screens for displaying.
According to some embodiments of the invention, the system further comprises a server, the encoder, the decoding and display components are networked;
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, calculating a covered area according to the layout mode and the stacking relation, outputting information corresponding to the layout mode and the covered area to the encoder and outputting the information corresponding to the layout mode and the stacking relation to the decoding and displaying component; alternatively, the first and second electrodes may be,
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, outputting information corresponding to the layout mode and the stacking relation to the encoder and the decoding and displaying component, and the encoder calculates the covered area of each video window according to the layout mode and the stacking relation.
According to some embodiments of the present invention, the server stores in advance a correspondence relationship of the video signal and the encoder and encoder information, a correspondence relationship of the sub-screen and the decoding and displaying part and decoding and displaying part information, the encoder information including the encoder address and the port number, the decoding and displaying part information including the decoding and displaying part address and the port number.
According to some embodiments of the present invention, the server includes an input device and a display device, the input device being configured to receive a user input to generate a layout manner and a stacking relationship of the video signal on the screen, and to calculate the covered area according to the layout manner and the stacking relationship; the server instructs each encoder to encode video signal content at a low resolution, which is low relative to the resolution on the screen, and to retrieve the low resolution encoded video signal content over the network for display on the display device.
According to some embodiments of the invention, the clearing process comprises setting the covered area to a solid black color.
A second aspect of the invention provides a method for transmission and distributed display of at least two video signals, comprising:
clearing the covered area of the current frame of the received video signal according to the layout mode of the video window of the video signal on the screen and the information corresponding to the covered area, and then coding the processed current frame into n parts according to the layout mode, wherein n is the number of sub-screens which are spanned on the screen by the video window corresponding to the video signal determined according to the layout mode; and packaging each encoded part into a corresponding video stream, and sending the video stream to a corresponding decoding display end through a network, wherein the corresponding decoding display end is connected with a sub-screen spanned on a screen by a video window.
According to some embodiments of the invention, the clearing process comprises setting the covered area to a solid black color.
According to some embodiments of the present invention, the decoding display end receives the video stream from the encoder, and draws an image according to a layout manner and a stacking relation of video windows of the video signal on a screen, and outputs the image to a corresponding sub-screen for display.
A third aspect of the invention provides an apparatus for transmission and distributed display of at least two video signals, comprising a memory and a processor; wherein the memory is to store executable program code; the processor is configured to read executable program code stored in the memory to perform the method for transmission and distributed display of at least two video signals.
A fourth aspect of the invention provides a computer-readable storage medium having stored thereon a computer program, characterized in that the computer program, when being executed by a processor, implements the method for transmission and distributed display of at least two video signals.
The invention can eliminate or reduce the memory space required by the region during coding, further reduce the bandwidth in the transmission process, eliminate redundant data and improve the real-time transmission.
Drawings
FIG. 1 shows a schematic block diagram of a transmission and display system for at least two video signals according to some embodiments of the present invention;
FIG. 2 illustrates a flow diagram of a method for transmission and distributed display of at least two video signals according to some embodiments of the invention;
fig. 3 shows an exemplary embodiment of the described device for transmission and distributed display of at least two video signals.
Detailed Description
In this application, the networks involved may include Wi-fi networks, Bluetooth networks, Private Area Networks (PAN), local area networks (L AN), Wide Area Networks (WAN), IEEE 802.1x, intranets, internetworks, extranets and combinations thereof, as well as digital cellular telephone networks, which may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, DO-data optimized (DO-DO), enhanced data Rate evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), digital enhanced broadband S (IS-136/TDMA), integrated digital enhanced network (DEiN), DEVATE, private mobile network access networks (MBWA) such as MBWA L, private VPN, etc. the term "private network" refers to a network such as a public access network such as a VPN 20.
The invention will now be described, by way of example, with reference to the accompanying drawings, in connection with which it is to be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. Additionally, the described embodiments are intended to be illustrative of some, but not all embodiments of the invention.
Referring to fig. 1, there is schematically shown a schematic block diagram of a transmission and display system for at least two video signals and associated components, in accordance with an embodiment of the present invention; the video transmission system comprises an encoder (11,22), a server 6, and decoding and display components (111, 222, 333, and 444). The server 6, the encoders (11,22) and the decoding and display components (111, 222, 333 and 444) are networked (shown interconnected by the switch 5 in fig. 1). The encoders (11,22) and the video signals (1, 2) are connected in a non-network form, for example by video lines, or by electro-optical converters, optical fibres and electro-optical converters. The outputs of the decoding and display components are connected to respective corresponding sub-screens 61-64 (the respective sub-screens are combined into a screen 7, the sub-screens and the screen are introduced for convenience of description and for the sake of distinction); according to the actual application requirements, each sub-screen can be separately placed in space.
The server 6 generates a layout manner and a stacking relationship of video windows of the video signal 1 and the video signal 2 on the mosaic screen 7, calculates a covered area of the video windows, and transmits information corresponding to the layout manner and the stacking relationship to the decoding and display section (111, 222, 333, 444) through the network, and transmits information corresponding to the layout manner and the covered area of the video windows to the encoder (11,22) through the network.
The layout mode includes the sub-screens spanned by the video window corresponding to each video signal on the spliced screen 7 and the distribution position information thereof on the sub-screens, as shown in fig. 1, the video window 51 corresponding to the video signal 1 spans the sub-screen 61 and the sub-screen 64, and the video window 52 corresponding to the video signal 2 spans the sub-screens 61-64, that is, each video signal spans a plurality of sub-screens respectively; the video windows 51 or 52 may also be distributed on only one of the sub-screens or one of the regions of one of the sub-screens according to actual requirements. The stacking relationship refers to the stacking sequence of the video windows 51 and 52, and the video window 52 is shown stacked on the video window 51 in fig. 1. According to the distribution position and the stacking relation of each video window on the screen, the server calculates the covered area in each video window, the area covered by the video window 52 in fig. 1 is the covered area on the video window 51, and the video window 52 does not have the covered area because the video window is overlapped above the video window 51.
According to some embodiments of the present invention, the server 6 may receive user inputs in various manners to generate a layout manner and a stacking relationship of the video signal 1 and the video signal 2 on the screen 7 and calculate the covered area, the server 6 may include an input device which may input in a keyboard input, an optical input, a touch input, etc., the server 6 may further include a display device which may display in a projection, L ED, etc., for displaying a distribution manner of the video signal 1 and the video signal 2 on the current screen 7, the input device and the display device included in the server 6 may also be a touch input and display integrated device (such as a touch input and display screen, also called a unified machine) for displaying contents of the respective video signals (1, 2) corresponding to the contents on the screen 7 on one side and for receiving user inputs on the other side, according to some embodiments of the present invention, the server 6 may send control commands to the respective encoders (11,22) to encode the video signal contents at a lower resolution than the video signal content on the video signal, the video signal server 6 acquires the encoded contents after the encoding via a network, and presents the encoded contents on the video signal in a lower resolution than the video signal on the video signal 7, thereby reducing the video signal distribution relationship, the video signal distribution manner of the video signal input device and the video signal on the entire screen 7, the video signal, the video encoder 7, the video encoder and the video encoder may be directly transmitted by the video encoder, or by the video encoder, the video encoder 7, the video encoder 7, the video encoder may be directly, the video encoder may be directly transmit the video encoder, the video encoder may be used for displaying the video encoder, and display device may be used for displaying the display device, and display integrated device may be used for displaying.
The encoder (11,22) is configured to acquire input video content, acquire information corresponding to a layout mode and a covered area, perform a clearing process on the covered area of the received current frame according to the information of the covered area of the video window, and then encode the processed current frame into n parts according to the layout mode, where n is the number of sub-screens spanned by the video window corresponding to the video signal on the screen 7. The following two cases are intended to be covered when the processed current frame is encoded into n parts according to the layout mode: coding the current frame after the clearing processing into n parts under the condition that the covered area exists, and directly coding the current frame into n parts under the condition that the covered area does not exist; the method is as follows. The encoding includes encoding in h264, h265 or other formats. The encoder also encapsulates the encoded portions into corresponding rtsp or rtmp or rtp video streams and sends the video streams over the network to the corresponding decoding and display components (i.e., the decoding and display components to which the various sub-screens spanned by the video signal are connected). The purge processing includes, for example: set the covered area to pure black (rgb 0, 0, 0) or indicate that only parts outside the covered area are subsequently encoded. Taking fig. 1 as an example, where the display video window 51 is partially covered, therefore, the encoder 11 sets the covered area of the current frame to pure black; in addition, the layout of fig. 1 shows that the video window 51 spans the sub-screens 61 and 63, so that the encoder 11 correspondingly encodes the video frame from the video signal 1 into two parts (or two encoded parts), one of which is output to the decoder 111 corresponding to the sub-screen 61, and the other of which is output to the decoder 222 corresponding to the sub-screen 64. Similarly, the encoder 22 obtains the information corresponding to the layout mode and the covered area of the server 6, determines that the covered area does not exist according to the information, and at this time, does not need to perform additional 0 setting (i.e., does not need to perform pure black setting on the relevant area), and the encoder 22 encodes the video signal 2 according to the layout mode and encodes the video signal into four parts, wherein the four parts respectively correspond to the parts of the video window 52 located on the sub-screens 61-64, and the four parts are respectively sent to the decoding and displaying components 1-4 corresponding to the sub-screens, and then output to the sub-screens 61-64 through the latter. According to some embodiments of the present invention, after obtaining the information corresponding to the layout manner and the covered area, the encoder may determine whether the covered area has been previously cleared, and if so, encode the current frame after clearing processing along with the previous clearing processing manner for the covered area, that is, encode the current frame into n parts according to the layout manner.
And the decoding and displaying parts (111, 222, 333, 444) are used for acquiring information corresponding to the layout mode and the stacking relation of the server 6, acquiring the video stream from the encoder, performing video decoding on the video stream, drawing images according to the layout mode and the stacking relation, and outputting the images to the corresponding sub-screens for displaying. The decoding and display means may be caused to acquire the video streams from the respective encoders in the following manner: the network flow signal address of each encoded part obtained by encoding is sent to the server 6 by the encoders 11 and 12, and the server 6 sends the network flow signal address to the corresponding decoding and displaying part 555, so that the decoding and displaying part acquires the network flow signal address; alternatively, the network stream signal address is sent directly by the encoders 11 and 22 to the decoding and display means, and so on. Further, taking the decoding and displaying section 111 as an example, as shown in fig. 1, the decoding and displaying section 111 decodes the corresponding encoded part after acquiring it from the network stream signal address, renders the image of the content (the illustrated part of the video signal 1 and the part of the video signal 2 on the sub-screen 61) decoded by the decoding and displaying section according to the layout and the stacking relationship, and outputs the image for display on the sub-screen 61.
According to some embodiments of the present invention, the server may store in advance a correspondence relationship of the video signal and the encoder, for example, the video signals 1,2 correspond to the encoders 11,22, respectively, and encoder information including the encoder address and the port number. The server may also pre-store the correspondence of the sub-screens and decoding and displaying components, such as sub-screens 61-64 corresponding to decoding and displaying components 111-444, respectively, and decoding and displaying component information including the decoding and displaying component addresses and port numbers. The server can determine, based on the stored information and in combination with the layout, which parts each video signal needs to be encoded into by the corresponding encoder and to which decoding and display component each part is to be sent. The correspondence and/or address information may also be pre-stored in the encoder and decoding and display component as required, or the server may send the correspondence and/or address to the encoder and decoding and display component as required.
According to some embodiments of the present invention, the server may directly send the layout and stacking relationship of the video windows to the respective encoders, and the encoders calculate the covered areas of the respective video windows themselves, instead of the server calculating the covered areas.
By the embodiment, the memory space required by the covered area of the video window during encoding can be eliminated or reduced, the bandwidth in the transmission process is further reduced, redundant data is eliminated, and the transmission real-time performance is improved.
Fig. 2 schematically illustrates a flow diagram of a method for transmission and distributed display of at least two video signals, according to some embodiments of the present invention.
As shown in the drawing, the server generates a layout manner and a stacking relationship of the video windows on the mosaic screen (S11), transmits information corresponding to the layout manner and the stacking relationship to the decoding display side through the network (S12), calculates a covered area of the video windows according to the layout manner and the stacking relationship (S13), and transmits information corresponding to the layout manner and the covered area of the video windows to the encoding side through the network. According to other embodiments of the present invention, the server may also directly send information corresponding to the layout manner and the stacking relationship to the encoding end, and the encoding end calculates the covered area of the video window.
The encoding end acquires the input video content (S21), acquires the information corresponding to the layout mode and the covered area (S21), removes the covered area of the current frame of the acquired video content according to the information of the covered area of the video window (S23), and encodes the current frame into n parts according to the layout mode (S24), wherein n is the number of sub-screens spanned on the screen 7 by the video window corresponding to the video signal. And the coding object is the current frame after the clearing processing, and for the current frame without the covered area, the coding object is directly the current frame. The encoding includes encoding in h264, h265 or other formats. The encoding side also encapsulates the encoded parts into a corresponding video stream (S25), such as an rtsp or rtmp or rtp video stream, and transmits the video stream to a corresponding decoding and display part through a network (S26). Taking the aforementioned fig. 1 as an example, the display video window 51 is partially covered, so that the corresponding encoding end of the encoder 11 sets the covered area of the current frame to be pure black; in addition, the layout of fig. 1 shows the video window 51 spanning the sub-screens 61 and 63, and thus the encoding side accordingly encodes the video frame from the video signal 1 into two parts. According to another embodiment of the present invention, after obtaining the information corresponding to the layout method and the covered area, the encoding end determines whether the covered area has been previously cleared (S221), and if so, encodes the current frame after clearing in the previous clearing method for the covered area, that is, the step S24 is performed: the current frame is encoded into n parts according to the layout, with the steps thereafter as described above.
The decoding display side acquires information corresponding to the layout mode and the stacking relationship from the service side (S30), acquires video streams from the encoding sides (S31), performs video decoding on the video streams (S32), draws images according to the layout mode and the stacking relationship (S33), and outputs the images to a corresponding sub screen for display (S34). As shown in fig. 1, the decoding and display section 111 acquires and decodes the corresponding encoded content (or network stream signal) according to the network stream signal address, image-draws the content (partial video signal 1 and partial video signal 2) decoded by it according to the layout and the stacking relationship, and outputs the image for display on the sub-screen 61.
According to some embodiments of the present invention, the server may store in advance a correspondence relationship of the video signal and the encoder, for example, the video signals 1,2 correspond to the encoders 11,22, respectively, and encoder information including the encoder address and the port number. The server may also pre-store the correspondence of the sub-screens and decoding and displaying components, such as sub-screens 61-64 corresponding to decoding and displaying components 111-444, respectively, and decoding and displaying component information including the decoding and displaying component addresses and port numbers. The server can determine, based on the stored information and in combination with the layout, which parts each video signal needs to be encoded into by the corresponding encoder and to which decoding and display component each part is to be sent. The correspondence and/or address information may also be pre-stored in the encoder and decoding and display component as required, or the server may send the correspondence and/or address to the encoder and decoding and display component as required.
According to some embodiments of the present invention, the server may directly send the layout manner and the stacking relationship of the video windows to each encoding end, and the encoding end calculates the covered area of each video window, instead of calculating the covered area by the server.
Furthermore, the respective transmission and processing details mentioned above in describing the video transmission system are also suitable for use in the method for transmission and distributed display of at least two video signals herein, for example, the server may receive user inputs in various manners to generate the layout manner and the stacking relationship of the video signals 1 and 2 on the screen 7 and calculate the covered area. The server can acquire video content corresponding to the screen content but with relatively low definition through the network. The encoding end can send each encoded content or the network flow signal address of the encoded part obtained by encoding to the server end, and the server end sends the network flow signal address to the corresponding decoding display end, so that the decoding display end obtains the network flow signal address. Alternatively, the decoding display end may obtain the network stream signal address in other manners, for example, each encoding end directly sends the network stream signal address to the decoding and displaying component, and so on. For the sake of simplicity, no further description is provided herein.
The present application also provides an apparatus for transmission and distributed display of at least two video signals, comprising a memory and a processor; wherein the memory is to store executable program code; the processor is used for reading the executable program codes stored in the memory to execute the method for the transmission and the distributed display of at least two video signals, and comprises the steps of clearing covered areas of a current frame of the received video signals according to the layout mode of video windows of the video signals on a screen and information corresponding to the covered areas, and then coding the processed current frame into n parts according to the layout mode, wherein n is the number of sub-screens spanned on the screen by the video windows corresponding to the video signals determined according to the layout mode; and packaging the encoded parts into corresponding video streams, and sending the video streams to corresponding decoding and displaying components through a network, wherein the corresponding decoding and displaying components are connected with sub-screens spanned on the screen by video windows. The clearing process includes setting the covered area to a solid black color. In addition, the details related to the method for transmitting and displaying at least two video signals and the distributed display method described in the foregoing embodiments are also applicable here, and are not repeated for the sake of simplicity.
Fig. 3 shows an exemplary presentation of the described apparatus for transmission and distributed display of at least two video signals, the apparatus comprising a processor 51, a memory 52 and a bus 53.
In some instances, the device may also include an input device 501, an input port 502, an output port 503, and an output device 504. The input port 502, the processor 51, the memory 52, and the output port 503 are connected to each other via the bus 53, and the input device 501 and the output device 504 are connected to the bus 53 via the input port 502 and the output port 503, respectively, and further connected to other components of the device. It should be noted that the output interface and the input interface can also be represented by I/O interfaces. Specifically, the input device 501 receives input information from the outside and transmits the input information to the processor 51 through the input port 502; processor 51 processes the input information based on computer-executable instructions stored in memory 52 to generate output information, temporarily or permanently stores the output information in memory 52, and then transmits the output information to output device 504 via output port 503; the output device 503 outputs the output information to the outside of the device.
The memory 52 includes mass storage for data or instructions. By way of example, and not limitation, memory 52 may include an HDD, a floppy disk drive, flash memory, an optical disk, a magneto-optical disk, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Memory 52 may include removable or non-removable (or fixed) media, where appropriate. The memory 52 may be internal or external to the device, where appropriate. In a particular embodiment, the memory 52 is a non-volatile solid-state memory. In particular embodiments, memory 52 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.
The bus 53 comprises hardware, software, or both coupling together components of the device for the transmission of at least two video signals and distributed display with one another, by way of example and not limitation, the bus 53 may comprise an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a low pin count (L PC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (V L B) bus, or other suitable bus, or a combination of two or more of these.
The processor 51 performs, based on the computer program stored in the memory 52, a clearing process on a covered area of a current frame of the received video signal according to a layout manner on a screen of video windows of the input or stored video signal and information corresponding to the covered area, and then encodes the processed current frame into n parts according to the layout manner, where n is the number of sub-screens spanned by the video windows corresponding to the video signal determined according to the layout manner on the screen; and packaging the encoded parts into corresponding video streams, and sending the video streams to corresponding decoding and displaying components through a network, wherein the corresponding decoding and displaying components are connected with sub-screens spanned on the screen by video windows. The clearing process includes setting the covered area to a solid black color. In addition, the details related to the method for transmitting and displaying at least two video signals and the distributed display method described in the foregoing embodiments are also applicable here, and are not repeated for the sake of simplicity.
According to still other embodiments of the invention, the computer program may be divided into one or more units in various ways, stored in the memory, and executed by the processor to accomplish the invention. The one or more units may be a series of computer program instruction segments capable of performing certain functions, which are used to describe the execution of the computer program in the apparatus. The computer program may be divided into units according to the functions realized by the flow steps in the embodiment described above with reference to fig. 2. For the sake of simplicity, this will not be repeated here.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is the control center for the device and that connects the various parts of the overall device using various interfaces and lines.
The device may be a part of or a computing device such as a desktop computer, a notebook, a palm top, and a cloud server. The apparatus may include, but is not limited to, a processor and a memory. It will be understood by those skilled in the art that the schematic illustrations are merely examples of devices and do not constitute a limitation on the devices.
The present application further provides a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the method for transmission and distributed display of at least two video signals, including performing a clearing process on a covered area of a current frame of a received video signal according to a layout manner of video windows of the video signals on a screen and information corresponding to the covered area, and then encoding the processed current frame into n parts according to the layout manner, where n is a number of sub-screens spanned by the video windows corresponding to the video signals on the screen, and the n is a number of sub-screens spanned by the video windows corresponding to the video signals on the screen; and packaging the encoded parts into corresponding video streams, and sending the video streams to corresponding decoding and displaying components through a network, wherein the corresponding decoding and displaying components are connected with sub-screens spanned on the screen by video windows. The clearing process includes setting the covered area to a solid black color. In addition, the details related to the method for transmitting and displaying at least two video signals and the distributed display method described in the foregoing embodiments are also applicable here, and are not repeated for the sake of simplicity.
The invention can eliminate or reduce the memory space required by the region during coding, further reduce the bandwidth in the transmission process, eliminate redundant data and improve the real-time transmission.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A system for transmission and distributed display of at least two video signals, the system comprising: an encoder, a decoding and displaying part, and a screen including a plurality of sub-screens, the encoder receiving an input of a video signal, the sub-screens receiving an input of the decoding and displaying part;
an encoder removes the covered area of the current frame of the received video signal according to the layout mode of the video window of the video signal on the screen and the information corresponding to the covered area, and then encodes the processed current frame into n parts according to the layout mode, wherein n is the number of sub-screens spanned on the screen by the video window corresponding to the video signal determined according to the layout mode; the encoder also encapsulates each encoded part into a corresponding video stream and sends the video stream to a corresponding decoding and displaying component through a network, wherein the corresponding decoding and displaying component is a decoding and displaying component connected with a sub-screen spanned on a screen by a video window;
the decoding and displaying part receives the video stream from the encoder, draws images according to the layout mode and the stacking relation of the video windows of the video signal on the screen, and outputs the images to the corresponding sub-screens for displaying.
2. The system of claim 1, further comprising a server, encoder, decoding and display components networked;
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, calculating a covered area according to the layout mode and the stacking relation, outputting information corresponding to the layout mode and the covered area to the encoder and outputting the information corresponding to the layout mode and the stacking relation to the decoding and displaying component; alternatively, the first and second electrodes may be,
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, outputting information corresponding to the layout mode and the stacking relation to the encoder and the decoding and displaying component, and the encoder calculates the covered area of each video window according to the layout mode and the stacking relation.
3. The system of claim 1, wherein the server stores in advance a correspondence relationship between the video signal and the encoder and encoder information, a correspondence relationship between the sub-screen and the decoding and displaying part and decoding and displaying part information, the encoder information including the encoder address and the port number, the decoding and displaying part information including the decoding and displaying part address and the port number.
4. The system of claim 1, wherein the server comprises an input device and a display device, the input device is used for receiving user input to generate a layout mode and a stacking relation of the video signals on the screen, and calculating the covered area according to the layout mode and the stacking relation; the server instructs each encoder to encode video signal content at a low resolution, which is low relative to the resolution on the screen, and to retrieve the low resolution encoded video signal content over the network for display on the display device.
5. The system of any of claims 1-4, the clearing process comprising setting the covered area to a solid black color.
6. Method for the transmission and distributed display of at least two video signals, comprising:
clearing the covered area of the current frame of the received video signal according to the layout mode of the video window of the video signal on the screen and the information corresponding to the covered area, and then coding the processed current frame into n parts according to the layout mode, wherein n is the number of sub-screens which are spanned on the screen by the video window corresponding to the video signal determined according to the layout mode; and packaging each encoded part into a corresponding video stream, and sending the video stream to a corresponding decoding display end through a network, wherein the corresponding decoding display end is connected with a sub-screen spanned on a screen by a video window.
7. The method of claim 6, the clearing process comprising setting the covered region to a solid black color.
8. The method according to claim 6 or 7, further comprising the decoding display end receiving the video stream from the encoder, drawing the image according to the layout mode and the stacking relation of the video window of the video signal on the screen, and outputting the image to the corresponding sub-screen for display.
9. An apparatus for transmission and distributed display of at least two video signals, comprising a memory and a processor; wherein the memory is to store executable program code; the processor is adapted to read executable program code stored in the memory to perform the method for transmission and distributed display of at least two video signals according to claim 6 or 7.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method for transmission and distributed display of at least two video signals of claim 6 or 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010318461.9A CN111510741A (en) | 2020-04-21 | 2020-04-21 | System and method for transmission and distributed display of at least two video signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010318461.9A CN111510741A (en) | 2020-04-21 | 2020-04-21 | System and method for transmission and distributed display of at least two video signals |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111510741A true CN111510741A (en) | 2020-08-07 |
Family
ID=71877877
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010318461.9A Pending CN111510741A (en) | 2020-04-21 | 2020-04-21 | System and method for transmission and distributed display of at least two video signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111510741A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112887731A (en) * | 2021-01-22 | 2021-06-01 | 北京淳中科技股份有限公司 | Compressed code stream fetching method and device, electronic equipment and storage medium |
| CN113438536A (en) * | 2021-06-22 | 2021-09-24 | 北京飞讯数码科技有限公司 | Video display method, device, equipment and storage medium |
| CN116414510A (en) * | 2023-04-11 | 2023-07-11 | 国网浙江省电力有限公司 | Display adjustment method based on intelligent management cockpit |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101540905A (en) * | 2008-03-20 | 2009-09-23 | 联发科技股份有限公司 | Method for video coding |
| CN105898134A (en) * | 2015-11-15 | 2016-08-24 | 乐视移动智能信息技术（北京）有限公司 | Image acquisition method and device |
| CN107368269A (en) * | 2016-05-11 | 2017-11-21 | 北京京东尚科信息技术有限公司 | Transmit the methods, devices and systems of screen picture |
| CN110941409A (en) * | 2019-10-23 | 2020-03-31 | 西安万像电子科技有限公司 | Operation method for split screen display and server |
| US20200112750A1 (en) * | 2016-03-16 | 2020-04-09 | Mediatek Inc. | Method and apparatus of video data processing with restricted block size in video coding |
-
2020
- 2020-04-21 CN CN202010318461.9A patent/CN111510741A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101540905A (en) * | 2008-03-20 | 2009-09-23 | 联发科技股份有限公司 | Method for video coding |
| CN105898134A (en) * | 2015-11-15 | 2016-08-24 | 乐视移动智能信息技术（北京）有限公司 | Image acquisition method and device |
| US20200112750A1 (en) * | 2016-03-16 | 2020-04-09 | Mediatek Inc. | Method and apparatus of video data processing with restricted block size in video coding |
| CN107368269A (en) * | 2016-05-11 | 2017-11-21 | 北京京东尚科信息技术有限公司 | Transmit the methods, devices and systems of screen picture |
| CN110941409A (en) * | 2019-10-23 | 2020-03-31 | 西安万像电子科技有限公司 | Operation method for split screen display and server |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112887731A (en) * | 2021-01-22 | 2021-06-01 | 北京淳中科技股份有限公司 | Compressed code stream fetching method and device, electronic equipment and storage medium |
| CN113438536A (en) * | 2021-06-22 | 2021-09-24 | 北京飞讯数码科技有限公司 | Video display method, device, equipment and storage medium |
| CN116414510A (en) * | 2023-04-11 | 2023-07-11 | 国网浙江省电力有限公司 | Display adjustment method based on intelligent management cockpit |
| CN116414510B (en) * | 2023-04-11 | 2023-09-29 | 国网浙江省电力有限公司 | Display adjustment method based on intelligent management cockpit |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111510741A (en) | System and method for transmission and distributed display of at least two video signals | |
| US9716737B2 (en) | Video streaming in a wireless communication system | |
| EP3595305B1 (en) | Method for allocating code rates for intra-frame coded frames, computer device and storage medium | |
| US20110002376A1 (en) | Latency Minimization Via Pipelining of Processing Blocks | |
| WO2021057705A1 (en) | Video encoding and decoding methods, and related apparatuses | |
| CN111010567B (en) | Multi-signal-source remote calling method and system | |
| US8875214B2 (en) | Television | |
| US20170078609A1 (en) | Image processing method and apparatus based on screen spliting | |
| CN111510742B (en) | System and method for transmission and display of at least two video signals | |
| US20150256443A1 (en) | Method for transmitting image information and packet communication system | |
| US9967567B2 (en) | Method and system for enhancing image quality of compressed video stream | |
| US10097829B2 (en) | System and method for compression of digital content | |
| US8111746B2 (en) | Motion graphics keying in the compressed domain | |
| JP2009239335A (en) | Video interpolation device and video interpolation method | |
| CN110572672A (en) | Video encoding and decoding method and device, storage medium and electronic device | |
| US9118803B2 (en) | Video conferencing system | |
| CN110572677A (en) | video encoding and decoding method and device, storage medium and electronic device | |
| CN108737877B (en) | Image processing method and device and terminal equipment | |
| US20220007039A1 (en) | Video encoding method, video decoding method, and related apparatuses | |
| WO2021057478A1 (en) | Video encoding and decoding method and related apparatus | |
| US20200077096A1 (en) | Compression of segmented video | |
| JP2017535171A (en) | An apparatus and method for cutting several encoded video streams without prior decoding. | |
| CN117201835A (en) | Multi-signal source pushing method, system, medium and equipment | |
| CN116033226A (en) | System for multi-terminal display and control of signal sources | |
| CN112866749B (en) | Multi-terminal signal on-screen display control system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200807 |
|
| RJ01 | Rejection of invention patent application after publication |