CN112468763A - Video transmission and display method, device, equipment and storage medium of conference television - Google Patents
Video transmission and display method, device, equipment and storage medium of conference television Download PDFInfo
- Publication number
- CN112468763A CN112468763A CN202011253448.6A CN202011253448A CN112468763A CN 112468763 A CN112468763 A CN 112468763A CN 202011253448 A CN202011253448 A CN 202011253448A CN 112468763 A CN112468763 A CN 112468763A
- Authority
- CN
- China
- Prior art keywords
- video
- conference
- video stream
- target
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 71
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000007781 pre-processing Methods 0.000 claims abstract description 25
- 238000004458 analytical method Methods 0.000 claims description 12
- 230000002194 synthesizing effect Effects 0.000 claims description 11
- 238000000605 extraction Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 6
- 230000015572 biosynthetic process Effects 0.000 claims description 4
- 238000003786 synthesis reaction Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a video transmission and display method, a device, equipment and a storage medium of a video conference, wherein the video transmission method of the video conference comprises the following steps: acquiring a plurality of paths of conference video streams; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; and sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream. The embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams, so that a conference console can simultaneously display multiple paths of videos; the multi-channel conference video stream is synthesized into one target video stream for transmission, so that network bandwidth resources occupied by the transmission of the conference video stream are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Description
Technical Field
The embodiment of the invention relates to the technical field of data transmission, in particular to a video transmission and display method, a video transmission and display device, video transmission and display equipment and a storage medium for a video conference.
Background
The video conference system generally includes a video conference terminal and a conference console, participants at different conference sites carry out conferences through the video conference terminal, the video conference terminal generally sends video conference signals at the conference sites to the conference console for displaying, and a user can monitor each conference site through the conference console.
The conference control console communicates with the conference television terminal through an Internet Protocol (IP) network, and due to network bandwidth limitation, a conference video signal that can be sent by the conference television terminal at a time is limited, and when the conference television terminal is accessed to a plurality of conference video signals at a time, the plurality of conference video signals are sent at the same time, which may occupy too many network resources, and further affect the actual communication quality of the conference television, especially in a scene of low bandwidth or unstable network conditions. If the multiple conference video signals are not sent simultaneously, all the conference video signals cannot be displayed simultaneously in the conference console, a user wants to check other conference videos when the current conference video is displayed, the purpose can be achieved only by manually switching video channels, and the conference video display system is troublesome to operate and low in efficiency.
Disclosure of Invention
In view of this, embodiments of the present invention provide a video transmission and display method, apparatus, device and storage medium for a video conference, so as to reduce network bandwidth resources occupied by a video conference signal in a transmission process.
In a first aspect, an embodiment of the present invention provides a video transmission method for a video conference, which is applied to a video conference terminal, and includes:
acquiring a plurality of paths of conference video streams;
preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams;
synthesizing the multiple paths of preprocessed video streams into a path of target video stream;
and sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream.
Further, preprocessing each path of conference video stream according to a preset processing rule to obtain multiple paths of preprocessed video streams includes:
uniformly extracting frames of each path of conference video stream according to a preset frame extraction rule to obtain multiple paths of intermediate video streams, wherein one path of intermediate video stream comprises multiple frames of video images;
and adding a preset identification code corresponding to the intermediate video stream to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams.
Further, after synthesizing the multiple preprocessed video streams into one target video stream, the method further includes:
coding the target video stream to obtain a coded video stream;
correspondingly, sending the target video stream to a conference console, so that the conference console displays the multiple pre-processed video streams according to the target video stream, includes:
and sending the coded video stream to a conference console so that the conference console displays the multi-path conference video stream according to the coded video stream.
In a second aspect, an embodiment of the present invention provides a video display method for a video conference, which is applied to a conference console, and includes:
acquiring a target video stream, wherein the target video stream is a video stream formed by a video conference terminal;
analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule;
and sending each path of preprocessed video stream to a corresponding display window for displaying.
Further, the acquiring the target video stream includes:
receiving a coded video stream sent by a conference television terminal;
and decoding the coded video stream to obtain a target video stream.
Further, the parsing the target video stream into multiple pre-processed video streams according to a preset parsing rule includes:
and analyzing the target video stream into a plurality of paths of preprocessed video streams according to the preset identification code of each frame of video image in the target video stream.
In a third aspect, an embodiment of the present invention provides a video transmission apparatus for a video conference, which is applied to a video conference terminal, and includes:
the conference video acquisition module is used for acquiring a plurality of paths of conference video streams;
the preprocessing module is used for preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams;
the video synthesis module is used for synthesizing the multi-path preprocessing video streams into a path of target video stream;
and the target video sending module is used for sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream.
In a fourth aspect, an embodiment of the present invention provides a video display apparatus for a video conference, which is applied to a conference console, and includes:
the target video acquisition module is used for acquiring a target video stream, wherein the target video stream is a video stream formed by the conference television terminal;
the analysis module is used for analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule;
and the display module is used for sending each path of preprocessed video stream to the corresponding display window for displaying.
In a fifth aspect, an embodiment of the present invention provides an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the video transmission method of the video conference provided by any embodiment of the present invention, and/or implement the video display method of the video conference provided by any embodiment of the present invention.
In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a video transmission method of a video conference provided in any embodiment of the present invention, and/or implements a video display method of a video conference provided in any embodiment of the present invention.
The embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams, so that a conference console can simultaneously display multiple paths of videos; the multi-channel conference video stream is synthesized into one target video stream for transmission, so that network bandwidth resources occupied by the transmission of the conference video stream are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Drawings
Fig. 1 is a schematic flowchart of a video transmission method for a video conference according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a video transmission method for a video conference according to a second embodiment of the present invention;
fig. 3 is a schematic flowchart of a video display method of a video conference system according to a third embodiment of the present invention;
fig. 4 is a schematic flowchart of a video display method of a video conference according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of a video transmission apparatus for a video conference according to a fifth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a video display apparatus of a video conference according to a sixth embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. A process may be terminated when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
Furthermore, the terms "first," "second," and the like may be used herein to describe various orientations, actions, steps, elements, or the like, but the orientations, actions, steps, or elements are not limited by these terms. These terms are only used to distinguish one direction, action, step or element from another direction, action, step or element. The terms "first", "second", etc. are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "plurality", "batch" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Example one
Fig. 1 is a schematic flowchart of a video transmission method for a video conference system according to an embodiment of the present invention, which is applicable to a usage scenario of a video conference system, especially a video scenario with low bandwidth and few large moving pictures, and can be integrated in a video conference terminal of the video conference system. As shown in fig. 1, a video transmission method for a video conference provided by an embodiment of the present invention includes:
and S110, acquiring the multi-channel conference video stream.
Specifically, the video stream of the conference refers to video content related to a conference site, which is acquired by the video conference terminal through the input channel, and the video content may be a video captured by a video camera connected to the video conference terminal, for example, a video of a participant captured by a camera. The video content may also be content related to a conference displayed on a display screen connected to the conference television terminal, for example, conference material displayed on the display screen.
The number of the conference video streams is the same as that of the input channels of the conference television terminal, namely, the conference television terminal has several input channels, and then several conference video streams can be obtained. The conference video stream may be a local main/auxiliary video of the conference television terminal (referred to as a local main video stream/a local auxiliary video stream for short), or a main/auxiliary video of a remote terminal acquired by the conference television terminal (referred to as a remote main video stream/a remote auxiliary video stream for short), or a video stream generated by other video input sources of the local terminal. Generally, a video conference stream acquired by one video conference terminal at least includes a main video stream at a local terminal and an auxiliary video stream at the local terminal, that is, the video conference terminal can acquire at least two video conference streams. The main video stream of the local terminal is usually conference materials displayed on a display screen, the auxiliary video stream of the local terminal is usually videos of participants shot by a camera, and of course, the main video stream and the auxiliary video stream can be interchanged or other contents according to user settings. And when the video conference terminal can be connected with the third input channel, the three conference video streams can be obtained.
And S120, preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams.
Specifically, each path of conference video stream is preprocessed according to a preset processing rule, and each path of conference video stream is simplified to reduce the size of each path of conference video stream. For example, each path of conference video stream is uniformly frame-extracted according to a preset frame-extracting rule, so as to obtain multiple paths of preprocessed video streams. Illustratively, the preset frame extraction rule is that the size of the conference video stream is reduced by half, one frame of video image is extracted every other frame of video image, and the size of a new conference video stream composed of the extracted multiple frames of video images is reduced by half compared with the size of the original conference video stream.
S130, synthesizing the multiple pre-processing video streams into one path of target video stream.
Specifically, the preprocessed multiple paths of preprocessed video streams are combined into one path of target video stream, so that the transmission of the multiple paths of preprocessed video streams can be realized only by the transmission of one path of target video stream.
S140, the target video stream is sent to a conference console, so that the conference console displays the multi-channel preprocessing video stream according to the target video stream.
Specifically, after the multiple paths of conference video streams are combined into one path of target video stream, the conference television terminal sends the path of target video stream to the conference console. Then the conference console will restore the target video stream to multiple pre-processed video streams after receiving the target video stream, and the multiple pre-processed video streams can be displayed simultaneously.
The video transmission method of the conference television provided by the embodiment of the invention obtains a plurality of paths of conference video streams; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; and sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream. The simultaneous transmission of multiple paths of video streams is realized, so that the conference console can display multiple paths of videos simultaneously; the multi-channel conference video stream is synthesized into one target video stream for transmission, so that network bandwidth resources occupied by the transmission of the conference video stream are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Example two
Fig. 2 is a schematic flow chart of a video transmission method for a video conference according to a second embodiment of the present invention, which is a further refinement of the above embodiment. As shown in fig. 2, a video transmission method for a video conference according to a second embodiment of the present invention includes:
and S210, acquiring the multi-channel conference video stream.
S220, uniformly frame-extracting each path of conference video stream according to a preset frame-extracting rule to obtain multiple paths of intermediate video streams, wherein one path of intermediate video stream comprises multiple frames of video images.
Specifically, each path of conference video stream is uniformly frame-extracted according to a preset frame-extracting rule, that is, the conference video stream is subjected to fine and simplified processing, and the space occupied by the conference video stream is reduced. Generally, a section of video is composed of multiple frames of video images, and uniform frame extraction is performed on a conference video stream, that is, multiple frames of video images at specific positions are extracted according to a preset frame extraction rule, and the extracted video images form a new video stream, that is, an intermediate video stream.
Preferably, assuming that N conference video streams are obtained, the preset frame-decimation rule is to decimate each conference video stream uniformly to 60/N frames per second.
And S230, adding a preset identification code corresponding to the intermediate video stream to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams.
Specifically, the preset identification code is identification information used for distinguishing a conference television terminal input channel corresponding to a conference video stream, and is also called in-band information. Different input channels in the video conference terminal have different preset identification codes. And adding a corresponding preset identification code to each frame of video image, namely modifying a plurality of pixels at the head of each frame of video image, and writing the preset identification code corresponding to the middle video stream where the frame of video image is located. The intermediate video stream added with the preset identification code forms a pre-processing video stream, so that video images among different input channels can be distinguished. Illustratively, the preset identification code of the home terminal main video stream is set to 000, and the preset identification code of the acquired conference auxiliary video stream is set to 001, then the preset identification code is set to 000 for each frame of video image in the intermediate video stream corresponding to the home terminal main video stream after frame extraction, and the preset identification code is set to 001 for each frame of video image in the intermediate video stream corresponding to the conference auxiliary video stream after frame extraction.
Optionally, the preset identification code is added, and the corresponding preset identification code may also be added in the first frame video image and the last frame video image of each path of intermediate video stream. Optionally, an alternative implementation manner of this step may also be that a corresponding preset identification code is added to the first frame video image of each path of intermediate video stream, and each path of intermediate video stream is arranged according to a preset sequence.
And S240, synthesizing the multiple pre-processed video streams into one path of target video stream.
Specifically, the multiple pre-processed video streams are combined into one target video stream, and then the target video stream is equivalent to a video sequence formed by the multiple pre-processed video streams. In this embodiment, each path of conference video stream is subjected to uniform frame extraction processing according to 60/N frames per second, that is, each path of preprocessed video stream is 60/N frames per second, and then a target video stream synthesized by N paths of preprocessed video streams is 60 frames per second.
And S250, encoding the target video stream to obtain an encoded video stream.
Specifically, the target video stream is encoded, that is, the format of the target video stream is converted by a specific compression technique, so as to reduce the bandwidth of the target video stream, thereby obtaining an encoded video stream. Encoding the video stream facilitates network transmission.
S260, sending the coded video stream to a conference console so that the conference console displays the multi-channel conference video stream according to the coded video stream.
Specifically, the encoded video stream is sent to the conference console, and the conference console performs corresponding processing on the encoded video stream to simultaneously display the multiple pre-processed video streams.
The video transmission method of the conference television provided by the embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams, so that a conference console can simultaneously display multiple paths of videos; the multi-channel conference video stream is synthesized into one target video stream for transmission, so that network bandwidth resources occupied by the transmission of the conference video stream are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
EXAMPLE III
Fig. 3 is a schematic flowchart of three video display methods for a video conference system according to a third embodiment of the present invention, which are applicable to a usage scenario of a video conference system, especially a video scenario with low bandwidth and few large motion pictures, and which can be integrated in a conference console of the video conference system. As shown in fig. 3, a video display method of a video conference provided by a third embodiment of the present invention includes:
s310, obtaining a target video stream, wherein the target video stream is a video stream formed by the conference television terminal.
Specifically, the target video stream is a path of target video stream formed by the video transmission method of the video conference provided by any embodiment of the present invention at the video conference terminal. The target video stream is formed by integrating a plurality of pre-processing video streams.
And S320, analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule.
Specifically, the preset parsing rule is a parsing rule of the target video stream, and corresponds to a preset processing rule in the video transmission method for a video conference provided in any embodiment of the present invention. And analyzing the target video stream according to a preset analysis rule, so that one path of target video stream can be reduced into a plurality of paths of preprocessed video streams before synthesis. For example, the target video stream is parsed into multiple pre-processed video streams according to the preset identification code of each frame of video image.
And S330, sending each path of preprocessed video stream to a corresponding display window for displaying.
Specifically, the video content of each input channel of the video conference terminal has a corresponding display window on the conference console. Each path of preprocessed video stream is sent to the corresponding display window to be displayed, so that simultaneous display of multiple paths of preprocessed video streams is achieved, when a user monitors each input channel of the conference television terminal through the conference console, monitoring of all the input channels can be achieved without manual switching, and operation is convenient.
Furthermore, the user can also manually set the monitoring video (corresponding pre-processing video stream) of the input channel to be displayed, that is, the number and the content of the monitoring input channels can be set by the user, so that the video input channel and the content monitored by the conference console have more flexibility, and great convenience is provided for the user operation.
The video display method of the video conference provided by the third embodiment of the invention obtains the target video stream, wherein the target video stream is a path of video stream formed by the video conference terminal; analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule; and sending each path of preprocessed video stream to a corresponding display window for displaying. The simultaneous transmission and display of multiple paths of video streams are realized, network bandwidth resources occupied by conference video stream transmission are reduced, and the transmission of multiple paths of video signals under a low-bandwidth scene is facilitated; the user can monitor all the input channels without manual switching, and the operation of the conference console is simplified.
Example four
Fig. 4 is a schematic flowchart of a video display method of a video conference provided in a fourth embodiment of the present invention, which is a further refinement of the third embodiment. As shown in fig. 4, a video display method of a video conference provided by the fourth embodiment of the present invention includes:
and S410, receiving the coded video stream sent by the video conference terminal.
Specifically, the video conference terminal encodes the target video stream before transmitting the target video stream, and therefore receives the encoded video stream transmitted by the video conference terminal first.
S420, decoding the coded video stream to obtain a target video stream, wherein the target video stream comprises a plurality of frames of video images, and each frame of video image has a preset identification code.
Specifically, the received encoded video stream is decoded to restore the encoded video stream to a state before encoding, that is, the target video stream is obtained after decoding. The target video stream is composed of a plurality of frames of video images of the multi-channel preprocessing video stream, and each frame of video image is added with a preset identification code.
S430, analyzing the target video stream into a plurality of paths of preprocessed video streams according to the preset identification code of each frame of video image in the target video stream.
Specifically, multiple frames of video images with the same preset identification code in the target video stream are the video images in one path of preprocessed video stream, and all the preprocessed video streams can be divided by the preset identification code.
Optionally, if only the first frame video image and the last frame video image in each path of the preprocessed video stream in the target video stream have the preset identification codes, the corresponding preprocessed video stream may be determined by determining the first frame video image and the last frame video image with the same preset identification codes.
Optionally, if only the first frame of video image in each path of the preprocessed video stream in the target video stream has the preset identification code, and the multiple paths of preprocessed video streams are stored in sequence, the multiple frames of video images between the first frame of video image of the current preset identification code and the first frame of video image of the next preset identification code are the content of the preprocessed video stream corresponding to the current preset identification code.
And S440, sending each path of preprocessed video stream to a corresponding display window for displaying.
The video display method of the conference television provided by the fourth embodiment of the invention realizes the simultaneous transmission and display of multiple paths of video streams, reduces network bandwidth resources occupied by the transmission of the conference video streams, and is more beneficial to the transmission of multi-channel video signals in low-bandwidth scenes; the user can monitor all the input channels without manual switching, and the operation of the conference console is simplified.
EXAMPLE five
Fig. 5 is a schematic structural diagram of a video transmission apparatus for a video conference system according to a fifth embodiment of the present invention, which is applicable to a use scene of a video conference system, especially a video scene with low bandwidth and few large moving pictures, and can be integrated in a video conference terminal of the video conference system. The video transmission device for a video conference, provided by this embodiment, can implement the video transmission method for a video conference, provided by any embodiment of the present invention, and has a corresponding functional structure and beneficial effects of the implementation method, and reference may be made to the description of any method embodiment of the present invention for content that is not described in detail in this embodiment.
As shown in fig. 5, a video transmission apparatus for a video conference according to a fifth embodiment of the present invention includes: a conference video acquisition module 510, a preprocessing module 520, a video composition module 530, and a target video transmission module 540, wherein:
the conference video acquiring module 510 is configured to acquire multiple conference video streams;
the preprocessing module 520 is configured to preprocess each path of conference video stream according to a preset processing rule to obtain multiple paths of preprocessed video streams;
the video synthesizing module 530 is configured to synthesize the multiple pre-processed video streams into one target video stream;
the target video sending module 540 is configured to send the target video stream to a conference console, so that the conference console displays the multiple pre-processed video streams according to the target video stream.
Further, the preprocessing module 520 includes:
the frame extracting unit is used for uniformly extracting frames of each path of conference video stream according to a preset frame extracting rule to obtain multiple paths of intermediate video streams, wherein one path of intermediate video stream comprises multiple frames of video images;
and the identification code adding unit is used for adding a preset identification code corresponding to the intermediate video stream to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams.
Further, the method also comprises the following steps:
the encoding module is used for encoding the target video stream to obtain an encoded video stream;
correspondingly, the target video sending module 540 is specifically configured to:
and sending the coded video stream to a conference console so that the conference console displays the multi-path conference video stream according to the coded video stream.
The video transmission device of the conference television provided by the embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams through the conference video acquisition module, the preprocessing module, the video synthesis module and the target video sending module, so that a conference console can simultaneously display multiple paths of videos; the multi-channel conference video stream is synthesized into one target video stream for transmission, so that network bandwidth resources occupied by the transmission of the conference video stream are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
EXAMPLE six
Fig. 6 is a schematic structural diagram of a video display apparatus of a video conference system according to a sixth embodiment of the present invention, which is applicable to a use scene of a video conference system, especially a video scene with low bandwidth and few large moving pictures, and can be integrated in a conference console of the video conference system. The video display device of the video conference, provided by this embodiment, can implement the video display method of the video conference, provided by any embodiment of the present invention, and has a corresponding functional structure and beneficial effects of the implementation method, and reference may be made to the description of any method embodiment of the present invention for content that is not described in detail in this embodiment.
As shown in fig. 6, a video display device for a video conference according to a sixth embodiment of the present invention includes: target video acquisition module 610, parsing module 620 and display module 630, wherein:
the target video acquiring module 610 is configured to acquire a target video stream, where the target video stream is a video stream formed by a video conference terminal;
the parsing module 620 is configured to parse the target video stream into multiple pre-processed video streams according to a preset parsing rule;
the display module 630 is configured to send each of the preprocessed video streams to a corresponding display window for displaying.
Further, the target video obtaining module 610 includes:
the receiving unit is used for receiving the coded video stream sent by the conference television terminal;
and the decoding unit is used for decoding the coded video stream to obtain a target video stream.
Further, the target video stream includes multiple frames of video images, each frame of video image has a preset identification code, and the parsing module 620 is specifically configured to:
and analyzing the target video stream into a plurality of paths of preprocessed video streams according to the preset identification code of each frame of video image in the target video stream.
The video display device of the video conference provided by the embodiment of the invention realizes the simultaneous transmission and display of multiple paths of video streams through the target video acquisition module, the analysis module and the display module, reduces network bandwidth resources occupied by the transmission of the video streams of the video conference, and is more beneficial to the transmission of multiple paths of video signals in a low-bandwidth scene; the user can monitor all the input channels without manual switching, and the operation of the conference console is simplified.
EXAMPLE seven
Fig. 7 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention. Fig. 7 illustrates a block diagram of an exemplary electronic device 712 (hereinafter device 712) suitable for use in implementing embodiments of the present invention. The electronic device 712 (hereinafter referred to as device 712) shown in fig. 7 is merely an example, and should not bring any limitation to the functions and the scope of the use of the embodiments of the present invention.
As shown in fig. 7, device 712 is embodied as a general purpose device. Components of device 712 may include, but are not limited to: one or more processors 716, a storage device 728, and a bus 718 that couples the various system components (including the storage device 728 and the processors 716).
Program/utility 740 having a set(s) of program modules 742 may be stored, for instance, in storage 728, such program modules 742 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination may include an implementation of a network environment. Program modules 742 generally perform the functions and/or methodologies of embodiments of the invention as described herein.
The device 712 may also communicate with one or more external devices 714 (e.g., keyboard, pointing terminal, display 724, etc.), with one or more terminals that enable a user to interact with the device 712, and/or with any terminals (e.g., network card, modem, etc.) that enable the device 712 to communicate with one or more other computing terminals. Such communication may occur through input/output (I/O) interfaces 722. Also, the device 712 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public Network, such as the internet) via the Network adapter 720. As shown in FIG. 7, the network adapter 720 communicates with the other modules of the device 712 via the bus 718. It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with device 712, including but not limited to: microcode, end drives, Redundant processors, external disk drive Arrays, RAID (Redundant Arrays of Independent Disks) systems, tape drives, and data backup storage systems, among others.
The processor 716 executes various functional applications and data processing by executing programs stored in the storage device 728, for example, to implement a video transmission method of a video conference provided by any embodiment of the present invention and/or to implement a video display method of a video conference provided by any embodiment of the present invention. The video transmission method of the conference television can comprise the following steps: acquiring a plurality of paths of conference video streams; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; synthesizing the multiple paths of preprocessed video streams into a path of target video stream; and sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream. The video display of the conference television may include: acquiring a target video stream, wherein the target video stream is a video stream formed by a video conference terminal; analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule; and sending each path of preprocessed video stream to a corresponding display window for displaying.
Example eight
An eighth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a video transmission method of a video conference provided in any embodiment of the present invention, and/or implements a video display method of a video conference provided in any embodiment of the present invention.
The video transmission method of the conference television can comprise the following steps: acquiring a plurality of paths of conference video streams; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; synthesizing the multiple paths of preprocessed video streams into a path of target video stream; and sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream.
The video display of the conference television may include: acquiring a target video stream, wherein the target video stream is a video stream formed by a video conference terminal; analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule; and sending each path of preprocessed video stream to a corresponding display window for displaying.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or terminal. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A video transmission method of a video conference is applied to a video conference terminal, and is characterized by comprising the following steps:
acquiring a plurality of paths of conference video streams;
preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams;
synthesizing the multiple paths of preprocessed video streams into a path of target video stream;
and sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream.
2. The method of claim 1, wherein preprocessing each of the plurality of conference video streams according to a predetermined processing rule to obtain a plurality of preprocessed video streams comprises:
uniformly extracting frames of each path of conference video stream according to a preset frame extraction rule to obtain multiple paths of intermediate video streams, wherein one path of intermediate video stream comprises multiple frames of video images;
and adding a preset identification code corresponding to the intermediate video stream to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams.
3. The method of claim 2, wherein after synthesizing the plurality of pre-processed video streams into a target video stream, further comprising:
coding the target video stream to obtain a coded video stream;
correspondingly, sending the target video stream to a conference console, so that the conference console displays the multiple pre-processed video streams according to the target video stream, includes:
and sending the coded video stream to a conference console so that the conference console displays the multi-path conference video stream according to the coded video stream.
4. A video display method of a conference television is applied to a conference console, and is characterized by comprising the following steps:
acquiring a target video stream, wherein the target video stream is a video stream formed by a video conference terminal;
analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule;
and sending each path of preprocessed video stream to a corresponding display window for displaying.
5. The method of claim 4, wherein obtaining the target video stream comprises:
receiving a coded video stream sent by a conference television terminal;
and decoding the coded video stream to obtain a target video stream.
6. The method of claim 4, wherein the target video stream comprises a plurality of frames of video images, each frame of video image having a preset identification code, and parsing the target video stream into multiple pre-processed video streams according to a preset parsing rule comprises:
and analyzing the target video stream into a plurality of paths of preprocessed video streams according to the preset identification code of each frame of video image in the target video stream.
7. A video transmission device of a video conference is applied to a video conference terminal, and is characterized by comprising:
the conference video acquisition module is used for acquiring a plurality of paths of conference video streams;
the preprocessing module is used for preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams;
the video synthesis module is used for synthesizing the multi-path preprocessing video streams into a path of target video stream;
and the target video sending module is used for sending the target video stream to a conference console so that the conference console displays the multi-channel preprocessed video stream according to the target video stream.
8. A video display device of a conference television, which is applied to a conference console, is characterized by comprising:
the target video acquisition module is used for acquiring a target video stream, wherein the target video stream is a video stream formed by the conference television terminal;
the analysis module is used for analyzing the target video stream into a plurality of paths of preprocessed video streams according to a preset analysis rule;
and the display module is used for sending each path of preprocessed video stream to the corresponding display window for displaying.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the video transmission method of a video conference according to any one of claims 1-3 and/or implement the video display method of a video conference according to any one of claims 4-6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a video transmission method of a video conference according to any one of claims 1 to 3 and/or a video display method of a video conference according to any one of claims 4 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011253448.6A CN112468763B (en) | 2020-11-11 | 2020-11-11 | Video transmission and display method, device and equipment for conference television and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011253448.6A CN112468763B (en) | 2020-11-11 | 2020-11-11 | Video transmission and display method, device and equipment for conference television and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112468763A true CN112468763A (en) | 2021-03-09 |
| CN112468763B CN112468763B (en) | 2023-11-24 |
Family
ID=74825465
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011253448.6A Active CN112468763B (en) | 2020-11-11 | 2020-11-11 | Video transmission and display method, device and equipment for conference television and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112468763B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024055844A1 (en) * | 2022-09-16 | 2024-03-21 | 北京字跳网络技术有限公司 | Transmission method and apparatus for a plurality of data streams, and device and medium |
| WO2024066136A1 (en) * | 2022-09-27 | 2024-04-04 | 中兴通讯股份有限公司 | Video composition technology-based remote control gateway application technology |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106101605A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | A kind of Screen sharing implementation method of video conference |
| CN106101606A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | The Screen sharing of a kind of video conference realizes device |
| CN107241564A (en) * | 2016-03-29 | 2017-10-10 | 华为技术有限公司 | Multi-stream video conference method based on IMS network architecture, apparatus and system |
| CN111107297A (en) * | 2019-12-30 | 2020-05-05 | 广州市百果园网络科技有限公司 | Video transmission method, device, resource server and storage medium |
| US10768885B1 (en) * | 2019-04-23 | 2020-09-08 | Study Social Inc. | Video conference with shared whiteboard and recording |
-
2020
- 2020-11-11 CN CN202011253448.6A patent/CN112468763B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241564A (en) * | 2016-03-29 | 2017-10-10 | 华为技术有限公司 | Multi-stream video conference method based on IMS network architecture, apparatus and system |
| CN106101605A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | A kind of Screen sharing implementation method of video conference |
| CN106101606A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | The Screen sharing of a kind of video conference realizes device |
| US10768885B1 (en) * | 2019-04-23 | 2020-09-08 | Study Social Inc. | Video conference with shared whiteboard and recording |
| CN111107297A (en) * | 2019-12-30 | 2020-05-05 | 广州市百果园网络科技有限公司 | Video transmission method, device, resource server and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024055844A1 (en) * | 2022-09-16 | 2024-03-21 | 北京字跳网络技术有限公司 | Transmission method and apparatus for a plurality of data streams, and device and medium |
| WO2024066136A1 (en) * | 2022-09-27 | 2024-04-04 | 中兴通讯股份有限公司 | Video composition technology-based remote control gateway application technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112468763B (en) | 2023-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109510990B (en) | Image processing method and device, computer readable storage medium and electronic device | |
| US20030001964A1 (en) | Method of converting format of encoded video data and apparatus therefor | |
| US9197852B2 (en) | System and method for point to point integration of personal computers with videoconferencing systems | |
| US6744927B1 (en) | Data communication control apparatus and its control method, image processing apparatus and its method, and data communication system | |
| EP2134092B1 (en) | Information processing apparatus and method, and program | |
| EP2061255A1 (en) | Information processing device and method | |
| US20080101455A1 (en) | Apparatus and method for multiple format encoding | |
| US8976220B2 (en) | Devices and methods for hosting a video call between a plurality of endpoints | |
| CN112468763B (en) | Video transmission and display method, device and equipment for conference television and storage medium | |
| CN112954398B (en) | Encoding method, decoding method, device, storage medium and electronic equipment | |
| CN111641804A (en) | Video data processing method and device, terminal, camera and video conference system | |
| CN112911383A (en) | Multipath screen projection method, device and system under local area network | |
| CN111263164A (en) | High frame frequency video parallel coding and recombination method | |
| CN112764853A (en) | Screen projection method, equipment and system | |
| CN110572673A (en) | Video encoding and decoding method and device, storage medium and electronic device | |
| CN112291483B (en) | Video pushing method and system, electronic equipment and readable storage medium | |
| CN112261417B (en) | Video pushing method and system, equipment and readable storage medium | |
| CN113141352A (en) | Multimedia data transmission method and device, computer equipment and storage medium | |
| CN107872683B (en) | Video data processing method, device, equipment and storage medium | |
| CN111093091A (en) | Video processing method, server and system | |
| CN110572677A (en) | video encoding and decoding method and device, storage medium and electronic device | |
| CN114339070B (en) | MPSoC-based multipath image processing display interaction system | |
| CN114915797A (en) | Multi-channel video decoding method and device and related products | |
| CN111107316B (en) | Image display method, device and system | |
| CN113066140A (en) | Image encoding method, image encoding device, computer device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |