CN112468763B - Video transmission and display method, device and equipment for conference television and storage medium - Google Patents
Video transmission and display method, device and equipment for conference television and storage medium Download PDFInfo
- Publication number
- CN112468763B CN112468763B CN202011253448.6A CN202011253448A CN112468763B CN 112468763 B CN112468763 B CN 112468763B CN 202011253448 A CN202011253448 A CN 202011253448A CN 112468763 B CN112468763 B CN 112468763B
- Authority
- CN
- China
- Prior art keywords
- video
- conference
- video stream
- stream
- path
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 72
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000007781 pre-processing Methods 0.000 claims abstract description 60
- 238000000605 extraction Methods 0.000 claims description 18
- 238000004458 analytical method Methods 0.000 claims description 10
- 230000002194 synthesizing effect Effects 0.000 claims description 9
- 230000015572 biosynthetic process Effects 0.000 claims description 5
- 238000003786 synthesis reaction Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a video transmission and display method, a device, equipment and a storage medium of a video conference, wherein the video transmission method of the video conference comprises the following steps: acquiring a multi-path conference video stream; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; and sending the target video stream to a conference control console so that the conference control console displays the multipath preprocessing video stream according to the target video stream. The embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams, so that a conference console can display multiple paths of videos simultaneously; the multi-path conference video stream is synthesized into one path of target video stream for transmission, so that network bandwidth resources occupied by conference video stream transmission are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Description
Technical Field
The embodiment of the invention relates to the technical field of data transmission, in particular to a video transmission and display method, device and equipment of a conference television and a storage medium.
Background
The conference television system generally comprises a conference television terminal and a conference console, conference participants at different conference sites can carry out conference through the conference television terminal, the conference television terminal generally sends conference video signals at the conference sites to the conference console for display, and a user can monitor each conference site through the conference console.
The conference console communicates with the conference television terminal through an IP (Internet Protocol ) network, and because of the limitation of network bandwidth, the conference television terminal can send limited conference video signals at a time. If the multi-path conference video signals are not transmitted at the same time, all the conference video signals cannot be displayed at the same time in the conference console, and a user wants to view other conference videos when the current conference video is displayed, and can achieve the purpose only by manually switching video channels, so that the operation is troublesome and the efficiency is low.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, apparatus, device and storage medium for video transmission and display of a video conference, so as to reduce network bandwidth resources occupied by video conference signals during transmission.
In a first aspect, an embodiment of the present invention provides a video transmission method for a video conference, which is applied to a video conference terminal, including:
acquiring a multi-path conference video stream;
preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams;
synthesizing the multipath preprocessing video streams into a path of target video stream;
and sending the target video stream to a conference control console so that the conference control console displays the multipath preprocessing video stream according to the target video stream.
Further, preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams, wherein the steps of:
uniformly extracting frames of each path of conference video stream according to a preset frame extraction rule to obtain a plurality of paths of intermediate video streams, wherein one path of intermediate video stream comprises a plurality of frames of video images;
and adding a preset identification code corresponding to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams.
Further, after synthesizing the multiple paths of preprocessed video streams into one path of target video stream, the method further includes:
encoding the target video stream to obtain an encoded video stream;
correspondingly, sending the target video stream to a conference console, so that the conference console displays the multiple paths of preprocessing video streams according to the target video stream comprises:
and sending the encoded video stream to a conference control console so that the conference control console displays the multi-path conference video stream according to the encoded video stream.
In a second aspect, an embodiment of the present invention provides a video display method for a conference tv, which is applied to a conference console, including:
acquiring a target video stream, wherein the target video stream is a path of video stream formed by a video conference terminal;
analyzing the target video stream into a plurality of paths of preprocessing video streams according to a preset analysis rule;
and sending each path of preprocessed video stream to a corresponding display window for display.
Further, obtaining the target video stream includes:
receiving an encoded video stream sent by a video conference terminal;
and decoding the coded video stream to obtain a target video stream.
Further, the target video stream includes a plurality of frames of video images, each frame of video image has a preset identification code, and resolving the target video stream into a plurality of paths of preprocessing video streams according to a preset resolving rule includes:
and analyzing the target video stream into a plurality of paths of preprocessing video streams according to the preset identification code of each frame of video image in the target video stream.
In a third aspect, an embodiment of the present invention provides a video transmission device for a video conference, which is applied to a video conference terminal, including:
the conference video acquisition module is used for acquiring a plurality of paths of conference video streams;
the preprocessing module is used for preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams;
the video synthesis module is used for synthesizing the multipath preprocessing video streams into a path of target video stream;
and the target video sending module is used for sending the target video stream to a conference control console so that the conference control console displays the multipath preprocessing video stream according to the target video stream.
In a fourth aspect, an embodiment of the present invention provides a video display apparatus for a conference tv, which is applied to a conference console, including:
the target video acquisition module is used for acquiring a target video stream, wherein the target video stream is a path of video stream formed by the video conference terminal;
the analysis module is used for analyzing the target video stream into a plurality of paths of preprocessing video streams according to a preset analysis rule;
and the display module is used for sending each path of preprocessed video stream to the corresponding display window for display.
In a fifth aspect, an embodiment of the present invention provides an electronic device, including:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the video transmission method of the video conference provided by any embodiment of the present invention, and/or implement the video display method of the video conference provided by any embodiment of the present invention.
In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the video transmission method for a video conference provided by any embodiment of the present invention, and/or implements the video display method for a video conference provided by any embodiment of the present invention.
The embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams, so that a conference console can display multiple paths of videos simultaneously; the multi-path conference video stream is synthesized into one path of target video stream for transmission, so that network bandwidth resources occupied by conference video stream transmission are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Drawings
Fig. 1 is a flow chart of a video transmission method for a video conference according to a first embodiment of the present invention;
fig. 2 is a flow chart of a video transmission method of a video conference according to a second embodiment of the present invention;
fig. 3 is a flow chart of a video display method of a video conference provided in a third embodiment of the present invention;
fig. 4 is a flow chart of a video display method of a video conference provided in a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of a video transmission device for video conferencing provided in a fifth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a video display device for a video conference according to a sixth embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts steps as a sequential process, many of the steps may be implemented in parallel, concurrently, or with other steps. Furthermore, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Furthermore, the terms "first," "second," and the like, may be used herein to describe various directions, acts, steps, or elements, etc., but these directions, acts, steps, or elements are not limited by these terms. These terms are only used to distinguish one direction, action, step or element from another direction, action, step or element. The terms "first," "second," and the like, are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present invention, "plurality", "batch" means at least two, for example, two, three, etc., unless specifically defined otherwise.
Example 1
Fig. 1 is a flow chart of a video transmission method for a video conference according to a first embodiment of the present invention, where the embodiment is applicable to use scenes of a video conference system, especially video scenes with low bandwidth and less large moving pictures, and can be integrated in a video conference terminal of the video conference system. As shown in fig. 1, a video transmission method for a video conference according to an embodiment of the present invention includes:
s110, acquiring a multi-path conference video stream.
Specifically, the conference video stream refers to video content related to a conference scene acquired by the conference television terminal through an input channel, where the video content may be a camera video acquired by a camera device connected to the conference television terminal, for example, a video of a conference participant captured by a camera. The video content may also be conference related content displayed on a display screen connected to the conference television terminal, for example conference material displayed on the display screen.
The number of conference video streams is the same as the number of input channels of the conference television terminal, namely, the conference television terminal is provided with a plurality of input channels, so that a plurality of conference video streams can be obtained. The conference video stream may be a main/auxiliary video local to the conference television terminal (abbreviated as a local main video stream/a local auxiliary video stream), or a main/auxiliary video of a remote terminal acquired by the conference television terminal (abbreviated as a remote main video stream/a remote auxiliary video stream), or a video stream generated by other video input sources of the local terminal. In general, a conference video stream acquired by a conference television terminal at least includes a main video stream of a local end and an auxiliary video stream of the local end, that is, the conference television terminal can acquire at least two paths of conference video streams. The main video stream of the local terminal is usually conference data displayed on a display screen, and the auxiliary video stream of the local terminal is usually video of conference participants shot by a camera, and of course, the main video stream and the auxiliary video stream can be interchanged according to user setting, and can also be other contents. When the video conference terminal can be connected with the third input channel, three conference video streams can be obtained.
S120, preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams.
Specifically, preprocessing is performed on each path of conference video stream according to a preset processing rule, and simplifying is performed on each path of conference video stream so as to reduce the size of each path of conference video stream. For example, according to a preset frame extraction rule, performing uniform frame extraction processing on each path of conference video stream to obtain multiple paths of preprocessed video streams. For example, if the preset frame extraction rule is to halve the size of the conference video stream, one frame of video image is extracted every other frame of video image, and the size of a new conference video stream composed of the extracted multi-frame video images is halved compared with the original conference video stream.
S130, synthesizing the multi-path preprocessing video stream into a path of target video stream.
Specifically, the preprocessed multiple paths of preprocessed video streams are synthesized into one path of target video stream, so that the transmission of the multiple paths of preprocessed video streams can be realized only through the transmission of one path of target video stream.
And S140, sending the target video stream to a conference control console so that the conference control console displays the multipath preprocessing video stream according to the target video stream.
Specifically, after the multi-path conference video stream is synthesized into one path of target video stream, the conference television terminal sends the path of target video stream to the conference console. Then the conference console will restore the target video stream to a multi-path pre-processed video stream after receiving the target video stream, and the multi-path pre-processed video stream may be displayed simultaneously.
The video transmission method of the video conference provided by the embodiment of the invention obtains a plurality of conference video streams; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; and sending the target video stream to a conference control console so that the conference control console displays the multipath preprocessing video stream according to the target video stream. The simultaneous transmission of multiple paths of video streams is realized, so that a conference console can display multiple paths of videos simultaneously; the multi-path conference video stream is synthesized into one path of target video stream for transmission, so that network bandwidth resources occupied by conference video stream transmission are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Example two
Fig. 2 is a flow chart of a video transmission method for a video conference according to a second embodiment of the present invention, and the present embodiment is further detailed in the foregoing embodiment. As shown in fig. 2, a video transmission method for a video conference provided in a second embodiment of the present invention includes:
s210, acquiring a multi-path conference video stream.
S220, uniformly extracting frames of each path of conference video stream according to a preset frame extraction rule to obtain a plurality of paths of intermediate video streams, wherein one path of intermediate video stream comprises a plurality of frames of video images.
Specifically, according to a preset frame extraction rule, each path of conference video stream is subjected to uniform frame extraction, namely, the conference video stream is subjected to simplification processing, and the occupied space of the conference video stream is reduced. In general, a video segment is composed of multiple frames of video images, and a conference video stream is uniformly frame-extracted, namely multiple frames of video images at a specific position are extracted according to a preset frame-extracting rule, and the extracted video images form a new video stream, namely an intermediate video stream.
Preferably, assuming that N paths of conference video streams are acquired, the preset frame extraction rule is to uniformly extract frames of each path of conference video stream to 60/N frames per second.
S230, adding a preset identification code corresponding to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams.
Specifically, the preset identification code is identification information for distinguishing an input channel of the video conference terminal corresponding to the video conference stream, which is also called in-band information. Different input channels in the video conference terminal are provided with different preset identification codes. And adding a corresponding preset identification code to each frame of video image, namely modifying a plurality of pixels at the head of each frame of video image, and writing the preset identification code corresponding to the middle video stream where the frame of video image is positioned. The intermediate video stream after the addition of the preset identification code forms a pre-processed video stream, so that video images among different input channels can be distinguished. For example, the preset identification code of the main video stream of the home terminal is set to 000, and the preset identification code of the acquired auxiliary video stream of the conference is set to 001, so that the preset identification code is set to 000 for each frame of video image in the corresponding intermediate video stream after the main video stream of the home terminal is extracted, and the preset identification code is set to 001 for each frame of video image in the corresponding intermediate video stream after the auxiliary video stream of the conference is extracted.
Optionally, the preset identification code is added, and the corresponding preset identification code can be added in the first frame of video image and the last frame of video image of each path of intermediate video stream. Optionally, in an alternative implementation manner of this step, a corresponding preset identification code is added to the first frame of video image of each path of intermediate video stream, and each path of intermediate video stream is arranged according to a preset sequence.
S240, synthesizing the multi-path preprocessing video stream into a path of target video stream.
Specifically, the multiple preprocessing video streams are synthesized into one target video stream, and then the target video stream is equivalent to a video sequence formed by the multiple preprocessing video streams. In this embodiment, the frame extraction process is performed uniformly on each path of conference video stream according to 60/N frames per second, that is, each path of preprocessing video stream is 60/N frames per second, and then the target video stream synthesized by the N paths of preprocessing video streams is 60 frames per second.
S250, encoding the target video stream to obtain an encoded video stream.
Specifically, the target video stream is encoded, that is, the format of the target video stream is converted by a specific compression technology, and the bandwidth of the target video stream is reduced, so that the encoded video stream is obtained. The encoded video stream is more convenient for network transmission.
And S260, sending the coded video stream to a conference control console so that the conference control console displays the multi-path conference video stream according to the coded video stream.
Specifically, the encoded video stream after encoding is sent to a conference console, and the conference console can display multiple paths of preprocessed video streams simultaneously after performing corresponding processing on the encoded video stream.
The video transmission method of the conference television provided by the second embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams, so that a conference console can display multiple paths of videos simultaneously; the multi-path conference video stream is synthesized into one path of target video stream for transmission, so that network bandwidth resources occupied by conference video stream transmission are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Example III
Fig. 3 is a flow chart of a video display method of three video conferences provided in a third embodiment of the present invention, where the present embodiment is applicable to use scenes of a video conference system, especially video scenes with low bandwidth and less large moving pictures, and can be integrated in a conference console of the video conference system. As shown in fig. 3, a video display method for a video conference according to a third embodiment of the present invention includes:
s310, obtaining a target video stream, wherein the target video stream is a path of video stream formed by the video conference terminal.
Specifically, the target video stream is a path of target video stream formed by the video transmission method of the video conference provided by any embodiment of the invention. The target video stream is formed by integrating multiple preprocessing video streams.
S320, analyzing the target video stream into a plurality of paths of preprocessing video streams according to a preset analysis rule.
Specifically, the preset parsing rule is a parsing rule of a target video stream, which corresponds to a preset processing rule in the video transmission method of the video conference provided by any embodiment of the present invention. And analyzing the target video stream according to a preset analysis rule, so that one path of target video stream can be restored into a plurality of paths of preprocessing video streams before synthesis. For example, the target video stream is parsed into a plurality of preprocessing video streams according to the preset identification code of each frame of video image.
S330, sending each path of preprocessing video stream to a corresponding display window for display.
Specifically, the video content of each input channel of the video conference terminal has a corresponding display window on the conference console. And each path of preprocessing video stream is sent to a corresponding display window for display, so that the simultaneous display of multiple paths of preprocessing video streams is realized, and when a user monitors each input channel of the conference television terminal through the conference control console, the monitoring of all the input channels can be realized without manual switching, and the operation is convenient.
Furthermore, the user can manually set the monitoring video (corresponding preprocessing video stream) of the input channel to be displayed, namely, the number and the content of the monitoring input channels can be set by the user, so that the video input channels and the content monitored by the conference console have more flexibility, and great convenience is provided for the user operation.
The video display method of the video conference provided by the third embodiment of the invention obtains the target video stream, wherein the target video stream is a path of video stream formed by the video conference terminal; analyzing the target video stream into a plurality of paths of preprocessing video streams according to a preset analysis rule; and sending each path of preprocessed video stream to a corresponding display window for display. The simultaneous transmission and display of multiple paths of video streams are realized, the network bandwidth resources occupied by the transmission of the conference video streams are reduced, and the transmission of the multi-channel video signals in a low-bandwidth scene is facilitated; the user can monitor all input channels without manual switching, and the operation of the conference console is simplified.
Example IV
Fig. 4 is a flow chart of a video display method of a video conference provided in a fourth embodiment of the present invention, and the third embodiment is further refined. As shown in fig. 4, a video display method for a video conference provided in a fourth embodiment of the present invention includes:
s410, receiving the coded video stream sent by the video conference terminal.
Specifically, the video conference terminal encodes the target video stream before transmitting the target video stream, so that the encoded video stream transmitted by the video conference terminal is received first.
S420, decoding the coded video stream to obtain a target video stream, wherein the target video stream comprises multi-frame video images, and each frame of video image is provided with a preset identification code.
Specifically, the received encoded video stream is decoded, so that the encoded video stream is restored to a state before encoding, that is, the target video stream is obtained after decoding. The target video stream is composed of multiple frames of video images of multiple paths of preprocessing video streams, and each frame of video image is added with a preset identification code.
S430, analyzing the target video stream into a multi-channel preprocessing video stream according to the preset identification code of each frame of video image in the target video stream.
Specifically, multiple frames of video images with the same preset identification codes in the target video stream are video images in one path of preprocessing video stream, and all the preprocessing video streams can be divided through the preset identification codes.
Optionally, if only the first frame video image and the last frame video image have the preset identification codes in each path of the preprocessed video stream in the target video stream, determining the first frame video image and the last frame video image with the same preset identification codes can determine the corresponding preprocessed video stream.
Optionally, if only the first frame of video image in each path of preprocessed video stream in the target video stream has a preset identification code, and the multiple paths of preprocessed video streams are stored in sequence, the multi-frame video image between the first frame of video image of the current preset identification code and the first frame of video image of the next preset identification code is the content of the corresponding preprocessed video stream of the current preset identification code.
S440, each path of preprocessing video stream is sent to a corresponding display window to be displayed.
The video display method of the conference television provided by the fourth embodiment of the invention realizes the simultaneous transmission and display of multiple paths of video streams, reduces network bandwidth resources occupied by the transmission of the conference video streams, and is more beneficial to the transmission of multichannel video signals in a low-bandwidth scene; the user can monitor all input channels without manual switching, and the operation of the conference console is simplified.
Example five
Fig. 5 is a schematic structural diagram of a video transmission device for a video conference provided in a fifth embodiment of the present invention, where the embodiment is applicable to use scenes of a video conference system, especially video scenes with low bandwidth and less large moving pictures, and can be integrated in a video conference terminal of the video conference system. The video transmission device for the video conference provided by the embodiment can realize the video transmission method for the video conference provided by any embodiment of the invention, has the corresponding functional structure and beneficial effects of the realization method, and the details which are not described in detail in the embodiment can refer to the description of any method embodiment of the invention.
As shown in fig. 5, a video transmission device for a video conference provided in a fifth embodiment of the present invention includes: a conference video acquisition module 510, a preprocessing module 520, a video composition module 530, and a target video transmission module 540, wherein:
the conference video acquisition module 510 is configured to acquire a multi-path conference video stream;
the preprocessing module 520 is configured to preprocess each path of conference video stream according to a preset processing rule, so as to obtain multiple paths of preprocessed video streams;
the video synthesis module 530 is configured to synthesize the multiple paths of preprocessed video streams into a target video stream;
the target video sending module 540 is configured to send the target video stream to a conference console, so that the conference console displays the multiple paths of preprocessed video streams according to the target video stream.
Further, the preprocessing module 520 includes:
the frame extraction unit is used for uniformly extracting frames of each path of conference video stream according to a preset frame extraction rule to obtain a plurality of paths of intermediate video streams, wherein one path of intermediate video stream comprises a plurality of frames of video images;
the identification code adding unit is used for adding a preset identification code corresponding to the intermediate video stream to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams.
Further, the method further comprises the following steps:
the encoding module is used for encoding the target video stream to obtain an encoded video stream;
accordingly, the target video sending module 540 is specifically configured to:
and sending the encoded video stream to a conference control console so that the conference control console displays the multi-path conference video stream according to the encoded video stream.
The video transmission device of the conference television provided by the embodiment of the invention realizes the simultaneous transmission of multiple paths of video streams through the conference video acquisition module, the preprocessing module, the video synthesis module and the target video transmission module, so that a conference console can display multiple paths of videos simultaneously; the multi-path conference video stream is synthesized into one path of target video stream for transmission, so that network bandwidth resources occupied by conference video stream transmission are reduced, and the transmission of multi-channel video signals in a low-bandwidth scene is facilitated.
Example six
Fig. 6 is a schematic structural diagram of a video display device for a video conference provided in a sixth embodiment of the present invention, where the present embodiment is applicable to use scenes of a video conference system, especially video scenes with low bandwidth and less large moving pictures, and can be integrated in a conference console of the video conference system. The video display device for the video conference provided by the embodiment can realize the video display method for the video conference provided by any embodiment of the invention, has the corresponding functional structure and beneficial effects of the realization method, and the details which are not described in detail in the embodiment can refer to the description of any method embodiment of the invention.
As shown in fig. 6, a video display apparatus for a video conference according to a sixth embodiment of the present invention includes: a target video acquisition module 610, a parsing module 620, and a display module 630, wherein:
the target video acquisition module 610 is configured to acquire a target video stream, where the target video stream is a path of video stream formed by the video conference terminal;
the parsing module 620 is configured to parse the target video stream into multiple preprocessing video streams according to a preset parsing rule;
the display module 630 is configured to send each path of the preprocessed video stream to a corresponding display window for display.
Further, the target video acquisition module 610 includes:
a receiving unit for receiving the coded video stream sent by the video conference terminal;
and the decoding unit is used for decoding the coded video stream to obtain a target video stream.
Further, the target video stream includes multiple frames of video images, each frame of video image has a preset identification code, and the parsing module 620 is specifically configured to:
and analyzing the target video stream into a plurality of paths of preprocessing video streams according to the preset identification code of each frame of video image in the target video stream.
The video display device of the conference television provided by the embodiment of the invention realizes the simultaneous transmission and display of multiple paths of video streams through the target video acquisition module, the analysis module and the display module, reduces network bandwidth resources occupied by the transmission of the conference video streams, and is more beneficial to the transmission of multichannel video signals in a low-bandwidth scene; the user can monitor all input channels without manual switching, and the operation of the conference console is simplified.
Example seven
Fig. 7 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention. Fig. 7 shows a block diagram of an exemplary electronic device 712 (hereinafter device 712) suitable for use in implementing embodiments of the invention. The electronic device 712 (hereinafter referred to as device 712) shown in fig. 7 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 7, device 712 is in the form of a general purpose device. Components of device 712 may include, but are not limited to: one or more processors 716, a storage device 728, and a bus 718 that connects the different system components (including the storage device 728 and the processor 716).
Bus 718 represents one or more of several types of bus structures, including a memory device bus or memory device controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry standard architecture (Industry Subversive Alliance, ISA) bus, micro channel architecture (Micro Channel Architecture, MAC) bus, enhanced ISA bus, video electronics standards association (Video Electronics Standards Association, VESA) local bus, and peripheral component interconnect (Peripheral Component Interconnect, PCI) bus.
Device 712 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by device 712 and includes both volatile and nonvolatile media, removable and non-removable media.
Storage 728 may include computer system readable media in the form of volatile memory, such as random access memory (Random Access Memory, RAM) 730 and/or cache memory 732. Device 712 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, the storage system 734 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, commonly referred to as a "hard disk drive"). Although not shown in fig. 7, a magnetic disk drive for reading from and writing to a removable nonvolatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable nonvolatile optical disk such as a Read Only Memory (CD-ROM), digital versatile disk (Digital Video Disc-Read Only Memory, DVD-ROM), or other optical media, may be provided. In such cases, each drive may be coupled to bus 718 through one or more data media interfaces. Storage 728 may include a number of program products having a set (e.g., a plurality) of program modules configured to carry out the functions of embodiments of the invention.
Programs/utilities 740 having a set(s) of program modules 742 may be stored, for example, in storage 728, such program modules 742 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 742 generally perform the functions and/or methodologies of the described embodiments of the invention.
Device 712 may also communicate with one or more external devices 714 (e.g., keyboard, pointing terminal, display 724, etc.), one or more terminals that enable a user to interact with device 712, and/or any terminals (e.g., network card, modem, etc.) that enable device 712 to communicate with one or more other computing terminals. Such communication may occur through an input/output (I/O) interface 722. Also, device 712 may communicate with one or more networks such as a local area network (Local Area Network, LAN), a wide area network (Wide Area Network, WAN) and/or a public network such as the internet via network adapter 720. As shown in fig. 7, the network adapter 720 communicates with other modules of the device 712 via the bus 718. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with device 712, including, but not limited to: microcode, end drives, redundant processors, external disk drive arrays, disk array (Redundant Arrays of Independent Disks, RAID) systems, tape drives, data backup storage systems, and the like.
The processor 716 executes various functional applications and data processing by running a program stored in the storage device 728, for example, to implement the video transmission method of the video conference provided by any of the embodiments of the present invention and/or to implement the video display method of the video conference provided by any of the embodiments of the present invention. The video transmission method of the conference television may include: acquiring a multi-path conference video stream; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; synthesizing the multipath preprocessing video streams into a path of target video stream; and sending the target video stream to a conference control console so that the conference control console displays the multipath preprocessing video stream according to the target video stream. The video display of the conference television may include: acquiring a target video stream, wherein the target video stream is a path of video stream formed by a video conference terminal; analyzing the target video stream into a plurality of paths of preprocessing video streams according to a preset analysis rule; and sending each path of preprocessed video stream to a corresponding display window for display.
Example eight
An eighth embodiment of the present invention further provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements, for example, the video transmission method of the video conference provided by any embodiment of the present invention, and/or implements the video display method of the video conference provided by any embodiment of the present invention.
The video transmission method of the conference television may include: acquiring a multi-path conference video stream; preprocessing each path of conference video stream according to a preset processing rule to obtain a plurality of paths of preprocessed video streams; synthesizing the multipath preprocessing video streams into a path of target video stream; and sending the target video stream to a conference control console so that the conference control console displays the multipath preprocessing video stream according to the target video stream.
The video display of the conference television may include: acquiring a target video stream, wherein the target video stream is a path of video stream formed by a video conference terminal; analyzing the target video stream into a plurality of paths of preprocessing video streams according to a preset analysis rule; and sending each path of preprocessed video stream to a corresponding display window for display.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or terminal. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer, for example, through the internet using an internet service provider.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (6)
1. A video transmission method for a video conference, applied to a video conference terminal, comprising:
acquiring a multi-path conference video stream; the number of the conference video streams is the same as the number of the input channels of the conference television terminal; the conference video stream comprises a local end main video stream/local end auxiliary video stream, a remote end main video stream/remote end auxiliary video stream and video streams generated by other video input sources of the local end;
uniformly extracting frames of each path of conference video stream according to a preset frame extraction rule to obtain multiple paths of intermediate video streams; the preset frame extraction rule is that one frame of video image is extracted from every other frame of video image, and the size of a new conference video stream formed by the extracted multi-frame video images is half of that of the original conference video stream; the one-path intermediate video stream comprises a plurality of frames of video images;
adding a preset identification code corresponding to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams; the preset identification code is used for distinguishing identification information of an input channel of the video conference terminal corresponding to the video conference stream; synthesizing the multipath preprocessing video streams into a path of target video stream;
encoding the target video stream to obtain an encoded video stream;
and sending the coded video stream to a conference control console so that the conference control console restores and simultaneously displays the multipath preprocessed video streams according to the coded video stream.
2. A video display method of a conference television, applied to a conference console, comprising:
receiving an encoded video stream transmitted by a video conference terminal using the video transmission method of a video conference according to claim 1;
decoding the coded video stream to obtain a target video stream; the target video stream comprises a plurality of frames of video images, and each frame of video image is provided with a preset identification code; the preset identification code is used for distinguishing the identification information of the input channel of the video conference terminal corresponding to the video conference stream;
analyzing the target video stream into a plurality of paths of preprocessing video streams according to a preset identification code of each frame of video image in the target video stream;
and sending each path of preprocessed video stream to a corresponding display window for simultaneous display.
3. A video transmission device for a video conference, which is applied to a video conference terminal, comprising:
the conference video acquisition module is used for acquiring a plurality of paths of conference video streams; the number of the conference video streams is the same as the number of the input channels of the conference television terminal; the conference video stream comprises a local end main video stream/local end auxiliary video stream, a remote end main video stream/remote end auxiliary video stream and video streams generated by other video input sources of the local end;
the preprocessing module comprises a frame extraction unit and an identification code adding unit;
the frame extraction unit is used for carrying out uniform frame extraction on each path of conference video stream according to a preset frame extraction rule to obtain multiple paths of intermediate video streams; the preset frame extraction rule is that one frame of video image is extracted from every other frame of video image, and the size of a new conference video stream formed by the extracted multi-frame video images is half of that of the original conference video stream; the one-path intermediate video stream comprises a plurality of frames of video images;
the identification code adding unit is used for adding a preset identification code corresponding to the intermediate video stream to each frame of video image of each path of intermediate video stream to obtain a plurality of paths of preprocessed video streams; the preset identification code is used for distinguishing identification information of an input channel of the video conference terminal corresponding to the video conference stream;
the video synthesis module is used for synthesizing the multipath preprocessing video streams into a path of target video stream;
the encoding module is used for encoding the target video stream to obtain an encoded video stream;
and the target video sending module is used for sending the coded video stream to a conference control console so that the conference control console restores and simultaneously displays the multipath preprocessing video streams according to the coded video stream.
4. A video display device for a conference television, applied to a conference console, comprising:
the target video acquisition module comprises a receiving unit and a decoding unit;
the receiving unit is used for receiving the coded video stream sent by the video conference terminal by adopting the video transmission method of the video conference as claimed in claim 1;
the decoding unit is used for decoding the coded video stream to obtain a target video stream; the target video stream comprises a plurality of frames of video images, and each frame of video image is provided with a preset identification code; the preset identification code is used for distinguishing the identification information of the input channel of the video conference terminal corresponding to the video conference stream;
the analysis module is used for analyzing the target video stream into a plurality of paths of preprocessing video streams according to the preset identification code of each frame of video image in the target video stream;
and the display module is used for sending each path of preprocessed video stream to the corresponding display window for simultaneous display.
5. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the video transmission method of the conference tv set forth in claim 1 and/or implement the video display method of the conference tv set forth in claim 2.
6. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the video transmission method of a video conference according to claim 1 and/or implements the video display method of a video conference according to claim 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011253448.6A CN112468763B (en) | 2020-11-11 | 2020-11-11 | Video transmission and display method, device and equipment for conference television and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011253448.6A CN112468763B (en) | 2020-11-11 | 2020-11-11 | Video transmission and display method, device and equipment for conference television and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112468763A CN112468763A (en) | 2021-03-09 |
| CN112468763B true CN112468763B (en) | 2023-11-24 |
Family
ID=74825465
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011253448.6A Active CN112468763B (en) | 2020-11-11 | 2020-11-11 | Video transmission and display method, device and equipment for conference television and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112468763B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115550694A (en) * | 2022-09-16 | 2022-12-30 | 北京字跳网络技术有限公司 | Method, apparatus, device and medium for transmission of multiple data streams |
| CN117834344A (en) * | 2022-09-27 | 2024-04-05 | 中兴通讯股份有限公司 | Remote control gateway application technology based on video synthesis technology |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106101606A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | The Screen sharing of a kind of video conference realizes device |
| CN106101605A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | A kind of Screen sharing implementation method of video conference |
| CN107241564A (en) * | 2016-03-29 | 2017-10-10 | 华为技术有限公司 | Multi-stream video conference method based on IMS network architecture, apparatus and system |
| CN111107297A (en) * | 2019-12-30 | 2020-05-05 | 广州市百果园网络科技有限公司 | Video transmission method, device, resource server and storage medium |
| US10768885B1 (en) * | 2019-04-23 | 2020-09-08 | Study Social Inc. | Video conference with shared whiteboard and recording |
-
2020
- 2020-11-11 CN CN202011253448.6A patent/CN112468763B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241564A (en) * | 2016-03-29 | 2017-10-10 | 华为技术有限公司 | Multi-stream video conference method based on IMS network architecture, apparatus and system |
| CN106101606A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | The Screen sharing of a kind of video conference realizes device |
| CN106101605A (en) * | 2016-07-05 | 2016-11-09 | 宁波菊风系统软件有限公司 | A kind of Screen sharing implementation method of video conference |
| US10768885B1 (en) * | 2019-04-23 | 2020-09-08 | Study Social Inc. | Video conference with shared whiteboard and recording |
| CN111107297A (en) * | 2019-12-30 | 2020-05-05 | 广州市百果园网络科技有限公司 | Video transmission method, device, resource server and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112468763A (en) | 2021-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9769423B2 (en) | System and method for point to point integration of personal computers with videoconferencing systems | |
| RU2479937C2 (en) | Information processing apparatus and method | |
| CN111917988B (en) | Remote camera application method, system and medium of cloud mobile phone | |
| US8976220B2 (en) | Devices and methods for hosting a video call between a plurality of endpoints | |
| US20080101455A1 (en) | Apparatus and method for multiple format encoding | |
| CN112468763B (en) | Video transmission and display method, device and equipment for conference television and storage medium | |
| EP2134092A1 (en) | Information processing apparatus and method, and program | |
| CN113992883B (en) | Video conference processing method, processing device, conference system, and storage medium | |
| CN112911383A (en) | Multipath screen projection method, device and system under local area network | |
| CN111641804A (en) | Video data processing method and device, terminal, camera and video conference system | |
| CN111263164A (en) | High frame frequency video parallel coding and recombination method | |
| CN110572673A (en) | Video encoding and decoding method and device, storage medium and electronic device | |
| CN112291483B (en) | Video pushing method and system, electronic equipment and readable storage medium | |
| TWI381733B (en) | High definition video conference system | |
| CN107872683B (en) | Video data processing method, device, equipment and storage medium | |
| US20160142633A1 (en) | Capture apparatuses of video images | |
| CN112565799B (en) | Video data processing method and device | |
| CN115766695A (en) | Websocket-based remote browsing method and device for real-time image of industrial camera | |
| CN115550694A (en) | Method, apparatus, device and medium for transmission of multiple data streams | |
| CN110798700B (en) | Video processing method, video processing device, storage medium and electronic equipment | |
| CN111107316B (en) | Image display method, device and system | |
| CN113691815A (en) | Video data processing method, device and computer readable storage medium | |
| CN112954394A (en) | High-definition video encoding and decoding playing method, device, equipment and medium | |
| CN115474073B (en) | Method and device for intelligently switching picture layout | |
| CN105812922A (en) | Multimedia file data processing method, system, player and client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |