CN111510742B - System and method for transmission and display of at least two video signals - Google Patents

System and method for transmission and display of at least two video signals Download PDF

Info

Publication number
CN111510742B
CN111510742B CN202010318537.8A CN202010318537A CN111510742B CN 111510742 B CN111510742 B CN 111510742B CN 202010318537 A CN202010318537 A CN 202010318537A CN 111510742 B CN111510742 B CN 111510742B
Authority
CN
China
Prior art keywords
video
encoder
decoding
screen
covered area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010318537.8A
Other languages
Chinese (zh)
Other versions
CN111510742A (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zen Ai Technology Co ltd
Original Assignee
Beijing Zen Ai Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zen Ai Technology Co ltd filed Critical Beijing Zen Ai Technology Co ltd
Priority to CN202010318537.8A priority Critical patent/CN111510742B/en
Publication of CN111510742A publication Critical patent/CN111510742A/en
Application granted granted Critical
Publication of CN111510742B publication Critical patent/CN111510742B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention relates to a system for transmission and display of at least two video signals, said system comprising: an encoder, a decoding and displaying part, and a screen, the encoder receiving an input of a video signal, the screen receiving an input of the decoding and displaying part; an encoder removes the covered area of the current frame of the received video signal according to the information corresponding to the covered area of the video window of the video signal on the screen, and then encodes the removed current frame; the encoder also encapsulates the encoded content into a video stream and sends the video stream over a network to a decoding and display component. The invention can eliminate or reduce the memory space required by the covered area of the video window during coding, reduce the bandwidth in the transmission process, eliminate redundant data and improve the real-time transmission.

Description

System and method for transmission and display of at least two video signals
Technical Field
The present invention relates to video signal transmission and display technology, and more particularly to transmission and display technology of multiple video signals.
Background
In the prior art, in order to retrieve and display the contents of a plurality of remote video signals on a local screen, the contents of the plurality of video signals need to be encoded into each network stream signal, the network stream signal is transmitted to the local through a network, then the network stream signal is decoded into a video stream signal, and then the video stream signal is output to the local screen.
With the continuous improvement of the video definition requirement of the user, in the above process, the video signal content with high definition needs to be coded and decoded, so the coding and decoding calculation amount is also continuously improved, and the response delay is caused; in addition, when a large number of video signals need to be called, each high-definition video signal occupies a large bandwidth, which causes network congestion and unsmooth transmission of each video signal.
Disclosure of Invention
In view of the above, the present application proposes a system, method, device and storage medium for transmission and display of at least two video signals.
A first aspect of the invention provides a system for transmission and display of at least two video signals, the system comprising: an encoder, a decoding and displaying part, and a screen, the encoder receiving an input of a video signal, the screen receiving an input of the decoding and displaying part;
an encoder removes the covered area of the current frame of the received video signal according to the information corresponding to the covered area of the video window of the video signal on the screen, and then encodes the removed current frame; the encoder also encapsulates the encoded content into a video stream and sends the video stream to the decoding and display component over the network;
the decoding and displaying part receives the video stream from the encoder, draws images according to the layout mode and the stacking relation of the video windows of the video signal on the screen, and outputs the images to the screen for displaying.
According to some embodiments of the invention, the system further comprises a server, the encoder, the decoding and display components are networked;
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, calculating a covered area according to the layout mode and the stacking relation, outputting information corresponding to the covered area to the encoder and outputting the information corresponding to the layout mode and the stacking relation to the decoding and displaying component; or,
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, outputting information corresponding to the layout mode and the stacking relation to the encoder and the decoding and displaying component, and outputting the information corresponding to the layout mode and the stacking relation to the decoding and displaying component, and the encoder calculates the covered area of each video window according to the layout mode and the stacking relation.
According to some embodiments of the present invention, a server stores in advance a correspondence relationship of a video signal and an encoder, encoder information including the encoder address and port number, and decoding and displaying part information including the decoding and displaying part address and port number.
According to some embodiments of the present invention, the server includes an input device and a display device, the input device being configured to receive a user input to generate a layout manner and a stacking relationship of the video signal on the screen, and to calculate the covered area according to the layout manner and the stacking relationship; the server instructs each encoder to encode video signal content at a low resolution, which is low relative to the resolution on the screen, and to retrieve the low resolution encoded video signal content over the network for display on the display device.
According to some embodiments of the invention, the clearing process comprises setting the covered area to a solid black color.
A second aspect of the invention provides a method for transmission and display of at least two video signals, comprising:
clearing the covered area of the current frame of the received video signal according to the information corresponding to the covered area of the video window of the video signal on the screen, and then coding the current frame after clearing; and packaging the coded content into a corresponding video stream, and sending the video stream to a decoding display terminal through a network.
According to some embodiments of the invention, the clearing process comprises setting the covered area to a solid black color.
According to some embodiments of the invention, the decoding display end receives the video stream from the encoder, draws images according to the layout mode and the stacking relation of the video windows of the video signal on the screen, and outputs the images to the screen for displaying.
A third aspect of the invention provides an apparatus for transmission and display of at least two video signals, comprising a memory and a processor; wherein the memory is to store executable program code; the processor is configured to read executable program code stored in the memory to perform the method for transmission and display of at least two video signals.
A fourth aspect of the invention provides a computer-readable storage medium, in which a computer program is stored, which computer program, when being executed by a processor, is adapted to carry out the method for transmission and display of at least two video signals.
The invention can eliminate or reduce the memory space required by the region during coding, further reduce the bandwidth in the transmission process, eliminate redundant data and improve the real-time transmission.
Drawings
FIG. 1 shows a schematic block diagram of a transmission and display system for at least two video signals according to some embodiments of the present invention;
FIG. 2 illustrates a flow diagram of a method for transmission and display of at least two video signals according to some embodiments of the invention;
fig. 3 shows an exemplary embodiment of the described device for transmission and distributed display of at least two video signals.
Detailed Description
In the present application, the essence of the present application, which relates to the implementation through a network, is intended to cover both wired or wireless network connections implemented through necessary firmware or software such as a switch, a router, etc., and wired or wireless network connections implemented through some server or other computer, etc., as an intermediary. In the present application, the networks involved may include Wi-fi networks, Bluetooth networks, Private Area Networks (PAN), Local Area Networks (LAN), Wide Area Networks (WAN), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), Integrated digital enhanced network (iDEN), WiMAX, LTE advanced, Mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, such as a VPN.
The invention will now be described, by way of example, with reference to the accompanying drawings, in connection with which it is to be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. Additionally, the described embodiments are intended to be illustrative of some, but not all embodiments of the invention.
Referring to fig. 1, there is schematically shown a schematic block diagram of a transmission and display system for at least two video signals and associated components, in accordance with an embodiment of the present invention; the video transmission system comprises an encoder (11,22), a server 6 and a decoding and display unit 555. The server 6, the encoders (11,22), the decoding and display means 555 are networked, the three being shown in fig. 1 as interconnected by the switch 5). The encoders (11,22) and the video signals (1, 2) are connected by, for example, video lines, or by three of an electro-optical converter, an optical fiber, and an electro-optical converter. The output of the decoding and display component 555 is connected to the screen 8.
The server 6 generates a layout manner and a stacking relationship of video windows of the video signal 1 and the video signal 2 on the screen 8, calculates a covered area of the video window, and transmits information corresponding to the layout manner and the stacking relationship to the decoding and display section 555 via the network and transmits information corresponding to the covered area of the video window to the encoder (11,22) via the network.
The layout mode includes information of distribution positions of video windows corresponding to each video signal on the screen 8, as shown in fig. 1, a video window 51 corresponding to the video signal 1 and a video window 52 corresponding to the video signal 2 are distributed on the screen 8 and occupy one distribution position. The stacking relationship refers to the stacking sequence of the video windows 51 and 52, and the video window 52 is shown stacked on the video window 51. According to the distribution position and the stacking relation of each video window on the screen, the server calculates the covered area in each video window, the area covered by the video window 52 in fig. 1 is the covered area on the video window 51, and the video window 52 does not have the covered area because the video window is overlapped above the video window 51.
According to some embodiments of the present invention, the server 6 may receive user input in various ways to generate the layout and stacking relationship of the video signals 1 and 2 on the screen 8 and calculate the covered area. The server 6 may comprise an input device. The input device can realize input in a keyboard input mode, an optical input mode, a touch input mode and the like. The server 6 may also comprise a display device, which may implement a display in the form of a projection, LED, etc., for displaying the distribution of the video signal 1 and the video signal 2 on the current screen 8. The input device and the display device comprised by the server 6 may also be a touch input and display integrated device (e.g. a touch input and display screen, also called a combo), which is used on the one hand to display the content of the respective video signal (1, 2) corresponding to the content on the screen 8 and on the other hand to receive user input. According to some embodiments of the invention, the server 6 may send control commands to the encoders (11,22) to encode the video signal content at a lower resolution than the video signal, and the server 6 may retrieve the encoded content over the network and present it on the touch input and display device. The video signal content presented on the touch input and display device of the server 6 may have only a lower definition or only a distribution profile of the entire video signal content, such as a wire frame, whereby the encoding time and transmission bandwidth of the encoder during the transmission of each video signal content to the server may be reduced, so that the saved encoding time and bandwidth is used for encoding and transmitting the selected video signal content, while facilitating the service end to operate and control the video window on the screen 8 with real-time reference to the display content on the touch input and display device. At the same time, the video signal content encoded by each encoder (11,22) for the decoding and display means can be of higher definition to meet the viewing requirements on the screen 8. According to some embodiments of the present invention, it is also possible to directly send the layout manner, the stacking relationship, and the covered area of the video signals 1 and 2 on the screen 8 to the server, calculate the covered area by the server, or directly send the layout manner, the stacking relationship, and the covered area of the video signals 1 and 2 on the screen 8 to the server.
The encoder (11,22) is configured to acquire input video content and information corresponding to a covered area of the video window on the screen, perform, according to the information of the covered area of the video window, a clearing process on the received covered area of the current frame, and then encode the current frame after the clearing process. The following encoding of the current frame after the erasure process is intended to cover the following two cases: and coding the current frame after clearing processing in the case of the covered area, and directly coding the current frame in the case of no covered area, wherein the coding comprises coding in 264, h265 or other formats. The encoder also encapsulates the encoded content into a corresponding rtsp or rtmp or rtp video stream and sends the video stream over the network to the decoding and display component 555. The purge processing includes, for example: set the covered area to pure black (rgb is 0, 0, 0, or set 0 process) or instruct to encode only the part outside the covered area subsequently. For example, fig. 1 shows that the video window 51 is partially covered, and therefore, the encoder 11 sets the covered area of the current frame to pure black. The encoder 22 receives the information corresponding to the covered area from the server 6, and determines that the covered area does not exist in the video window 52 according to the information, i.e. no additional 0 setting process is needed at this time. According to some embodiments of the present invention, after obtaining the information corresponding to the covered area, the encoder may determine whether the covered area has been previously cleared, and if so, encode the current frame after clearing in the manner of the previous clearing for the covered area.
The decoding and displaying part 555 is configured to receive information corresponding to the layout manner and the stacking relationship from the server 6, acquire the video streams from the encoders, perform video decoding on the video streams, draw images according to the layout manner and the stacking relationship, and output the images for display on the screen 8. The decoding and display means may be caused to acquire the video streams from the respective encoders in the following manner: the network stream signal address of the encoded part obtained by encoding is sent to the server 6 by the encoders 11 and 12, and the server 6 sends the network stream signal address to the corresponding decoding and displaying part 555, so that the decoding and displaying part acquires the network stream signal address; alternatively, the network stream signal address is sent directly by the encoders 11 and 22 to the decoding and display means, and so on.
According to some embodiments of the present invention, a server stores in advance a correspondence of a video signal and an encoder, encoder information including the encoder address and port number, and decoding and displaying part information including the decoding and displaying part address and port number. For example, the video signals 1,2 correspond to the encoders 11,22, respectively. The correspondence and/or address may also be pre-stored in the encoder and decoding and display component as required, or sent by the server to the encoder and/or decoding and display component as required.
According to some embodiments of the present invention, the server may directly send the layout and stacking relationship of the video windows to the respective encoders, and the encoders calculate the covered areas of the respective video windows themselves, instead of the server calculating the covered areas.
Furthermore, according to still further embodiments of the present invention, the functions of the decoding and display part 555 and the functions of the server 6 may be integrated in one host or computer.
By the embodiment, the memory space required by the covered area of the video window during encoding can be eliminated or reduced, the bandwidth in the transmission process is further reduced, redundant data is eliminated, and the transmission real-time performance is improved.
Fig. 2 schematically illustrates a flow diagram of a method for transmission and display of at least two video signals, in accordance with some embodiments of the present invention.
As shown in the figure, the server generates a layout manner and a stacking relationship of the video window on the mosaic screen (S11), transmits information corresponding to the layout manner and the stacking relationship to the decoding display terminal through the network (S12), calculates a covered area of the video window according to the layout manner and the stacking relationship (S13), and transmits information corresponding to the covered area of the video window to the encoding terminal through the network. According to other embodiments of the present invention, the server may also directly send information corresponding to the layout manner and the stacking relationship to the encoding end, and the encoding end calculates the covered area of the video window. The encoding end can be an encoder or a computer or other devices with similar encoding functions.
The encoding side acquires input video content (S21), acquires information corresponding to a covered area of a video window (S21), performs a clearing process on the covered area of a current frame of the acquired video content (S23) according to the information corresponding to the covered area of the video window, and encodes the current frame after the clearing process (S24). And the coding object is the current frame after the clearing processing, and for the current frame without the covered area, the coding object is directly the current frame. The encoding includes encoding in h264, h265 or other formats. The encoding side also encapsulates the encoded part into a video stream (S25), such as an rtsp or rtmp or rtp video stream, and transmits the video stream to the corresponding decoding display side through the network (S26). Taking the aforementioned fig. 1 as an example, the display video window 51 is partially covered, so that the corresponding encoding end of the encoder 11 sets the covered area of the current frame to be pure black. According to another embodiment of the present invention, after acquiring the information corresponding to the covered area, the encoding end determines whether the covered area has been previously cleared (S221), and if so, encodes the current frame after clearing in the previous clearing manner for the covered area, that is, the step S24 is performed: the current frame is encoded, with the steps thereafter as previously described.
The decoding display side acquires information corresponding to the layout mode and the stacking relation from the server side (S30), acquires video streams from the encoding sides (S31), performs video decoding on the video streams (S32), draws images according to the layout mode and the stacking relation (S33), and outputs the images to a screen for displaying (S34). As shown in fig. 1, the decoding and display section 555 acquires and decodes each encoded content (or network stream signal) according to the network stream signal address, performs image rendering on the contents (video signal 1 and video signal 2) decoded by it according to the layout manner and the stacking relationship, and outputs the image for display on the screen 8.
According to some embodiments of the present invention, the service end may store in advance a correspondence relationship between the video signal and the encoding end, for example, the video signals 1 and 2 correspond to the encoders 11 and 22, respectively, and encoding end information including the encoding end address and the port number. The corresponding relation and/or the address can also be pre-stored in the encoding end and the decoding display end according to the needs, or the server end sends the corresponding relation and/or the address to the encoding end and/or the decoding display end according to the needs.
According to some embodiments of the present invention, the server may directly send the layout manner and the stacking relationship of the video windows to each encoding end, and the encoding end calculates the covered area of each video window, instead of calculating the covered area by the server.
By the embodiment, the memory space required by the covered area of the video window during encoding can be eliminated or reduced, the bandwidth in the transmission process is further reduced, redundant data is eliminated, and the transmission real-time performance is improved.
Furthermore, the respective transmission and processing details mentioned above in describing the video transmission system are also suitable for use in the method for transmission and display of at least two video signals of the present invention herein, for example, the server may receive user inputs in various manners to generate the layout manner and the stacking relationship of the video signals 1 and 2 on the screen 8 and calculate the covered area. The server can acquire video content corresponding to the screen content but with relatively low definition through the network. The encoding end can send each encoded content or the network flow signal address of the encoded part obtained by encoding to the server end, and the server end sends the network flow signal address to the decoding display end, so that the decoding display end obtains the network flow signal address. Alternatively, the decoding display end may obtain the network stream signal address in other manners, for example, each encoding end directly sends the network stream signal address to the decoding display end, and so on. For the sake of simplicity, no further description is provided herein.
The present application also provides an apparatus for transmission and display of at least two video signals, comprising a memory and a processor; wherein the memory is to store executable program code; the processor is used for reading the executable program codes stored in the memory to execute the method for transmitting and displaying at least two video signals, and comprises the steps of clearing covered areas of a current frame of the received video signals according to information corresponding to the covered areas of video windows of the video signals on a screen, and then coding the cleared current frame; and packaging the coded content into a video stream, and sending the video stream to a decoding display terminal through a network. The cleaning process includes setting the covered area to a solid black color. In addition, the details related to the method for transmitting and displaying at least two video signals described in the foregoing embodiments are also applicable here, and for the sake of simplicity, the details are not repeated.
Fig. 3 shows an exemplary presentation of the described apparatus for transmission and distributed display of at least two video signals, the apparatus comprising a processor 51, a memory 52 and a bus 53.
In some instances, the device may also include an input device 501, an input port 502, an output port 503, and an output device 504. The input port 502, the processor 51, the memory 52, and the output port 503 are connected to each other via the bus 53, and the input device 501 and the output device 504 are connected to the bus 53 via the input port 502 and the output port 503, respectively, and further connected to other components of the device. It should be noted that the output interface and the input interface can also be represented by I/O interfaces. Specifically, the input device 501 receives input information from the outside and transmits the input information to the processor 51 through the input port 502; processor 51 processes the input information based on computer-executable instructions stored in memory 52 to generate output information, temporarily or permanently stores the output information in memory 52, and then transmits the output information to output device 504 via output port 503; the output device 503 outputs the output information to the outside of the device.
The memory 52 includes mass storage for data or instructions. By way of example, and not limitation, memory 52 may include an HDD, a floppy disk drive, flash memory, an optical disk, a magneto-optical disk, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Memory 52 may include removable or non-removable (or fixed) media, where appropriate. The memory 52 may be internal or external to the device, where appropriate. In a particular embodiment, the memory 52 is a non-volatile solid-state memory. In particular embodiments, memory 52 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.
The bus 53 comprises hardware, software, or both coupling the components of the device for the transmission and distributed display of at least two video signals to each other. By way of example, and not limitation, the bus 53 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus, or a combination of two or more of these. Although specific buses have been described and shown in the embodiments of the invention, any suitable buses or interconnects are contemplated by the invention.
The processor 51 performs, based on the computer program stored in the memory 52, a clearing process on a covered area of a current frame of the received video signal according to a layout manner on a screen of video windows of the input or stored video signal and information corresponding to the covered area, and then encodes the processed current frame into n parts according to the layout manner, where n is the number of sub-screens spanned by the video windows corresponding to the video signal determined according to the layout manner on the screen; and packaging the encoded parts into corresponding video streams, and sending the video streams to corresponding decoding and displaying components through a network, wherein the corresponding decoding and displaying components are connected with sub-screens spanned on the screen by video windows. The cleaning process includes setting the covered area to a solid black color. In addition, the details related to the method for transmitting and displaying at least two video signals and the distributed display method described in the foregoing embodiments are also applicable here, and are not repeated for the sake of simplicity.
According to still other embodiments of the invention, the computer program may be divided into one or more units in various ways, stored in the memory, and executed by the processor to accomplish the invention. The one or more units may be a series of computer program instruction segments capable of performing certain functions, which are used to describe the execution of the computer program in the apparatus. The computer program may be divided into units according to the functions realized by the flow steps in the embodiment described above with reference to fig. 2. For the sake of simplicity, this will not be repeated here.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, which is the control center for the device, with various interfaces and lines connecting the various parts of the overall device.
The device may be a part of or a computing device such as a desktop computer, a notebook, a palm top, and a cloud server. The apparatus may include, but is not limited to, a processor and a memory. It will be understood by those skilled in the art that the schematic illustrations are merely examples of devices and do not constitute a limitation on the devices.
The present application further provides a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the method for transmission and display of at least two video signals, including performing a clearing process on a covered area of a current frame of a received video signal according to information corresponding to the covered area of a video window of the video signal on a screen, and then encoding the cleared current frame; and packaging the coded content into a corresponding video stream, and sending the video stream to a decoding display terminal through a network. The clearing process includes setting the covered area to a solid black color. In addition, the details related to the method for transmitting and displaying at least two video signals described in the foregoing embodiments are also applicable here, and for the sake of simplicity, the details are not repeated.
The invention can eliminate or reduce the memory space required by the region during coding, further reduce the bandwidth in the transmission process, eliminate redundant data and improve the real-time transmission.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (4)

1. A system for transmission and display of at least two video signals, the system comprising: at least two encoders corresponding to the video signals, a decoding and displaying part, and a screen, the encoders receiving input of the video signals, the screen receiving input of the decoding and displaying part;
an encoder removes the covered area of the current frame of the received video signal according to the information corresponding to the covered area of the video window of the video signal on the screen, and then encodes the removed current frame, wherein the covered area is the area covered by other video windows of the at least two video signals in one or more video windows of the at least two video signals; the encoder also encapsulates the encoded content into a video stream and sends the video stream to the decoding and display component over the network;
the decoding and displaying part receives the video stream from the encoder, draws images according to the layout mode and the stacking relation of the video window of the video signal on the screen, and outputs the images for the screen to display;
the system also comprises a server, wherein the server, the encoder, the decoding and displaying components are connected through a network;
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, calculating a covered area according to the layout mode and the stacking relation, outputting information corresponding to the covered area to the encoder and outputting the information corresponding to the layout mode and the stacking relation to the decoding and displaying component; or,
the server is used for generating a layout mode and a stacking relation of the video signals on a screen, outputting information corresponding to the layout mode and the stacking relation to the encoder and the decoding and displaying component, and the encoder calculates the covered area of each video window according to the layout mode and the stacking relation.
2. The system according to claim 1, wherein the server stores in advance a correspondence relationship between the video signal and the encoder, encoder information including the encoder address and the port number, and decoding and displaying means information including the decoding and displaying means address and the port number.
3. The system of claim 1, wherein the server comprises an input device and a display device, the input device is used for receiving user input to generate a layout mode and a stacking relation of the video signals on the screen, and calculating the covered area according to the layout mode and the stacking relation; the server instructs each encoder to encode video signal content at a low resolution, which is low relative to the resolution on the screen, and to retrieve the low resolution encoded video signal content over the network for display on the display device.
4. The system of any of claims 1-3, the clearing process comprising setting the covered area to a solid black color.
CN202010318537.8A 2020-04-21 2020-04-21 System and method for transmission and display of at least two video signals Active CN111510742B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010318537.8A CN111510742B (en) 2020-04-21 2020-04-21 System and method for transmission and display of at least two video signals

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010318537.8A CN111510742B (en) 2020-04-21 2020-04-21 System and method for transmission and display of at least two video signals

Publications (2)

Publication Number Publication Date
CN111510742A CN111510742A (en) 2020-08-07
CN111510742B true CN111510742B (en) 2022-05-27

Family

ID=71877751

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010318537.8A Active CN111510742B (en) 2020-04-21 2020-04-21 System and method for transmission and display of at least two video signals

Country Status (1)

Country Link
CN (1) CN111510742B (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090238268A1 (en) * 2008-03-20 2009-09-24 Mediatek Inc. Method for video coding
CN105898134A (en) * 2015-11-15 2016-08-24 乐视移动智能信息技术（北京）有限公司 Image acquisition method and device
MX2021012481A (en) * 2016-03-16 2022-05-30 Hfi Innovation Inc Method and apparatus of video data processing with restricted block size in video coding.
CN107368269B (en) * 2016-05-11 2019-03-26 北京京东尚科信息技术有限公司 Transmit the methods, devices and systems of screen picture
CN110941409A (en) * 2019-10-23 2020-03-31 西安万像电子科技有限公司 Operation method for split screen display and server

Also Published As

Publication number Publication date
CN111510742A (en) 2020-08-07

Similar Documents

Publication Publication Date Title
CN111510741A (en) System and method for transmission and distributed display of at least two video signals
JP5174117B2 (en) Method and apparatus for motion compensated frame rate upconversion
RU2657210C2 (en) Block flipping and skip mode in intra block copy prediction
EP3595305B1 (en) Method for allocating code rates for intra-frame coded frames, computer device and storage medium
US20110002376A1 (en) Latency Minimization Via Pipelining of Processing Blocks
WO2018010662A1 (en) Video file transcoding method and device, and storage medium
US20210409685A1 (en) Video encoding method, video decoding method, and related apparatuses
WO2021057705A1 (en) Video encoding and decoding methods, and related apparatuses
CN111510742B (en) System and method for transmission and display of at least two video signals
CN111010567B (en) Multi-signal-source remote calling method and system
KR101640851B1 (en) Method for transmitting image information and packet communication system
US9967567B2 (en) Method and system for enhancing image quality of compressed video stream
US10097829B2 (en) System and method for compression of digital content
CN115543083A (en) Image display method and device and electronic equipment
US9118803B2 (en) Video conferencing system
CN112866749B (en) Multi-terminal signal on-screen display control system and method
CN110572672A (en) Video encoding and decoding method and device, storage medium and electronic device
US11849127B2 (en) Video encoding method, video decoding method, and related apparatuses
CN108737877B (en) Image processing method and device and terminal equipment
CN117201835A (en) Multi-signal source pushing method, system, medium and equipment
CN117319759A (en) Multi-signal source pushing and displaying method, system, medium and equipment
CN116033226A (en) System for multi-terminal display and control of signal sources
JP2017535171A (en) An apparatus and method for cutting several encoded video streams without prior decoding.
US9560376B2 (en) Method for processing a motion information item, encoding and decoding methods, corresponding devices, signal and computer program
US10595047B2 (en) Wireless display subsystem and system-on-chip

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant