CN108965298B - High-definition video processing interaction technology based on multi-component theme - Google Patents
High-definition video processing interaction technology based on multi-component theme Download PDFInfo
- Publication number
- CN108965298B CN108965298B CN201810795159.5A CN201810795159A CN108965298B CN 108965298 B CN108965298 B CN 108965298B CN 201810795159 A CN201810795159 A CN 201810795159A CN 108965298 B CN108965298 B CN 108965298B
- Authority
- CN
- China
- Prior art keywords
- video stream
- accumulation
- definition
- image characteristic
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a multi-component theme-based high-definition video processing interaction method, which comprises the following steps: collecting a grouped high-definition real-time video stream; decoding the high-definition real-time video stream of each packet; obtaining a video stream channel with 8 bits; forming video stream segment data; putting the video stream fragment data into a register of a CPU to obtain a result; obtaining an accumulation R of video stream image characteristic values; if the video stream image characteristic value exceeds the set accumulation threshold value, adding a grouping label into the accumulation of the video stream image characteristic value; if the video stream synchronization output threshold value is exceeded, the synchronization control data bit is programmed. By means of mixed encoding of the grouping labels and the synchronous control data bits into the high-definition video stream, high-freedom personalized grouping can be achieved, and meanwhile, the synchronous concurrency of the multi-path output video is greatly improved; the acquisition, decoding, encoding, distribution and interaction of the multi-component theme high-definition video stream can be realized through one embedded device, and the mode is simpler and more flexible.
Description
Technical Field
The invention belongs to the technical field of video stream packet transmission, and particularly relates to a high-definition video processing interaction method based on a multi-component theme.
Background
In a multi-component topic discussion scenario, particularly in an exploratory packet teaching scenario, an existing implementation scheme is to receive a packet of high-definition video through a wireless screen projector, process each packet of high-definition video by using a decoder and an encoder, and finally distribute the video by using a video matrix.
Because the wireless screen projector can only allow one wireless device to project the screen at each time, when a plurality of groups of screens are projected simultaneously, one wireless screen projector needs to be configured for each group, so that the screen is not convenient to project, and the screen projectors can interfere with each other.
Moreover, the transmission of video signals among the decoder, the encoder and the video matrix needs to be realized through a plurality of video lines, which not only makes it difficult to flexibly adjust the transmission according to the actual grouping requirements during grouping, but also has very low coding and decoding efficiency.
Finally, the video matrix is troublesome to operate when video signal switching is realized, which needs to remember the logical relationship between each group and needs to frequently switch the input and output sources, which increases the difficulty of interaction and is not beneficial to the efficient development of multi-component theme high-definition video interaction.
Therefore, the current video stream packet transmission mode has the technical problems of poor transmission flexibility caused by complex system and difficult interaction.
Disclosure of Invention
The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview and is intended to neither identify key/critical elements nor delineate the scope of such embodiments. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
The invention adopts the following technical scheme:
in some optional embodiments, there is provided a multi-component theme-based high definition video processing interaction method, including:
an extraction operation process;
repeating the extraction operation process to obtain the accumulation of the video stream image characteristic values;
judging whether the accumulation of the video stream image characteristic value exceeds a set accumulation threshold value or not, if so, adding a packet label into the accumulation of the video stream image characteristic value, wherein the packet label is added in a mode that 8-bit data is added into the accumulation of the video stream image characteristic value to be used as a packet identifier;
and judging whether the accumulation of the video stream image characteristic values exceeds a set video stream synchronous output threshold value, if so, mixing and encoding synchronous control data bits into the accumulation of the video stream image characteristic values, and adding 8-bit data into the accumulation of the video stream image characteristic values to control the synchronous output of the multi-channel video.
In some optional embodiments, the extraction operation process comprises: extracting the data of the front 8 XN bits of each video stream channel, and combining to form video stream fragment data; and putting the video stream fragment data into a register of the CPU through a CPU data channel, and calling an arithmetic logic unit of the CPU to carry out XOR operation to obtain a result.
In some alternative embodiments, in the process of extracting the data of the first 8 × N bits of each video stream channel, where N is 3N, N is a positive integer.
In some optional embodiments, the method further comprises, before: collecting a grouped high-definition real-time video stream; decoding the high-definition real-time video streams of each group to obtain a plurality of groups of decoded new high-definition video streams; the new high definition video stream for each packet is arranged to obtain an 8-bit video stream channel.
In some optional embodiments, the method for processing and interacting a high definition video based on a multi-component theme further includes: outputting a high-definition video stream; and in the process of outputting the high-definition video stream, identifying the grouping of the high-definition video stream through the grouping label, and controlling the video stream synchronization rate when a plurality of groups of video streams are output through the synchronization control data bits.
In some alternative embodiments, the set accumulation threshold is 80% of the total pixels of the 30 frame image.
In some optional embodiments, the video stream synchronization output threshold is 80% of the sum of the pixels of the 30 frames of images of all packets.
The invention has the following beneficial effects: by means of mixed encoding of the grouping labels and the synchronous control data bits into the high-definition video stream, high-freedom personalized grouping can be achieved, and meanwhile, the synchronous concurrency of the multi-path output video is greatly improved; on the basis of ensuring the quality of the high-definition video, the integration processing, distribution and interaction requirements of the multi-component theme high-definition video are met; and the acquisition, decoding, encoding, distribution and interaction of the multi-component theme high-definition video stream can be realized through one embedded device, and the mode is simpler and more flexible.
For the purposes of the foregoing and related ends, the one or more embodiments include the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative aspects and are indicative of but a few of the various ways in which the principles of the various embodiments may be employed. Other benefits and novel features will become apparent from the following detailed description when considered in conjunction with the drawings and the disclosed embodiments are intended to include all such aspects and their equivalents.
Drawings
Fig. 1 is a schematic flow chart of the multi-component theme-based high-definition video processing interaction method of the present invention.
Detailed Description
The following description and the drawings sufficiently illustrate specific embodiments of the invention to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. The scope of embodiments of the invention encompasses the full ambit of the claims, as well as all available equivalents of the claims.
As shown in fig. 1, in some illustrative embodiments, there is provided a multi-component theme-based high definition video processing interaction method, comprising:
101: packet high definition real time video streams V1, V2, V3 … … are captured.
102: and decoding the high-definition real-time video stream of each group based on a real-time streaming protocol to obtain a plurality of groups of decoded new high-definition video streams P1, P2 and P3 … ….
103: the new high definition video stream for each packet is arranged to obtain an 8-bit video stream channel. Taking the new high-definition video stream P1 as an example, the feature vector of each pixel of P1 is 24-bit data, and the 24-bit data is arranged every 8 bits, so that an 8-bit video stream channel can be obtained as follows:
(00110011)(01110011)(01010011)……。
104: and extracting the data of the first 8 XN bits of each video stream channel, and combining to form video stream fragment data.
The word length of the CPU is not more than 8 XN, N is 3N, and N is a positive integer, and the word length of the CPU is not more than N)/24 can be calculated. Assuming that (CPU word length) is 32, and n is 1, data P of the video stream segment is obtained, where P is 001100110111001101010011.
105: and putting the video stream fragment data into a register of the CPU through a CPU data channel.
106: calling an arithmetic logic unit of the CPU to carry out XOR operation to obtain a result r, wherein the result r is as follows:
r-P ≦ 111111111111111111111111, resulting in r-110011001000110010101100.
An arithmetic logic unit is a component of a computer that performs various arithmetic and logical operations, and the basic operations of an operator include addition, subtraction, multiplication, and division operations, and, or, not, xor, and the like logical operations, and shift, compare, and transfer operations, and the arithmetic logic unit is an execution unit of a central processing unit CPU.
107: if the accumulation of the video stream image feature values is R and the initial value of R is null, R is R. Repeating the extraction operation process, namely continuously repeating the steps 104, 105 and 106 to obtain the accumulated R of the video stream image characteristic values, wherein R is R0r1r2……rk-2rk-1rk… …, wherein k is not less than 2.
108: and judging whether the accumulation of the video stream image characteristic values exceeds a set accumulation threshold value, wherein the set accumulation threshold value is 80% of the total pixels of 30 frames of images in the decoded new high-definition video stream.
109: and if the set accumulation threshold value is exceeded, adding a grouping label to the accumulation of the video stream image characteristic value.
Grouping labels are added by adding 8-bit data to the accumulation of the video stream image feature values to serve as grouping identifiers, for example, 00000001 represents group 1, 00000010 represents group 2, 00000100 represents group 3 … …, and then R is 00000001R0r1r2……00000001rk-2rk-1rk……。
If the accumulation threshold is not exceeded, the process returns to step 104.
110: and judging whether the accumulation of the image characteristic values of the video stream exceeds a set video stream synchronous output threshold value, wherein the video stream synchronous output threshold value is 80% of the sum of the pixels of each 30 frames of images in the new high-definition video stream after all the packets are decoded, so as to ensure that the video stream of all the packets has an image frame rate of at least 24 frames/second.
111: if the video stream synchronous output threshold value is exceeded, synchronous control data bits are mixed and coded into the accumulation of the video stream image characteristic value, and 8-bit data is added into the accumulation of the video stream image characteristic value to control the synchronous output of the multi-channel video. For example, when 00000001 represents synchronous output, R is 00000001R0r1r2……00000001rk- 2rk-1rk……00000001。
If the video stream synchronization output threshold is not exceeded, the process returns to step 104.
112: and outputting the high-definition video stream. In the process of outputting the high-definition video stream, the grouping labels identify the groups of the high-definition video stream, and the synchronous rate of the video streams during the output of a plurality of groups is controlled through the synchronous control data bits, so that free grouping and high-definition synchronous interaction are realized.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
Claims (3)
1. The high-definition video processing interaction method based on the multi-component theme is characterized by comprising the following steps of:
an extraction operation process;
101: collecting grouped high-definition real-time video streams V1, V2 and V3 … …;
102: decoding the high-definition real-time video stream of each group based on a real-time stream transmission protocol to obtain a plurality of groups of decoded new high-definition video streams P1, P2 and P3 … …;
103: arranging the new high-definition video stream of each packet to obtain a video stream channel of 8 bits;
104: extracting the data of the front 8 XN bits of each video stream channel, and combining to form video stream fragment data;
the word length of the CPU is not more than 8 XN, N is 3N, and N is a positive integer, and the word length of the CPU is not more than N)/24 can be calculated;
105: putting the video stream fragment data into a register of a CPU through a CPU data channel;
106: calling an arithmetic logic unit of the CPU to carry out XOR operation to obtain a result;
step 104, step 105 and step 106 constitute an extraction operation process;
repeating the extraction operation process to obtain the accumulation of the video stream image characteristic values;
judging whether the accumulation of the video stream image characteristic value exceeds a set accumulation threshold value or not, if so, adding a packet label into the accumulation of the video stream image characteristic value, wherein the packet label is added in a mode that 8-bit data is added into the accumulation of the video stream image characteristic value to be used as a packet identifier;
and judging whether the accumulation of the video stream image characteristic values exceeds a set video stream synchronous output threshold value, if so, mixing and encoding synchronous control data bits into the accumulation of the video stream image characteristic values, and adding 8-bit data into the accumulation of the video stream image characteristic values to control the synchronous output of the multi-channel video.
2. The multi-component theme-based high-definition video processing interaction method of claim 1, wherein the set accumulation threshold is 80% of total pixels of 30 frames of images.
3. The multi-component theme-based high-definition video processing interaction method of claim 2, wherein the video stream synchronization output threshold is 80% of the sum of all the grouped 30-frame image pixels.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810795159.5A CN108965298B (en) | 2018-07-19 | 2018-07-19 | High-definition video processing interaction technology based on multi-component theme |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810795159.5A CN108965298B (en) | 2018-07-19 | 2018-07-19 | High-definition video processing interaction technology based on multi-component theme |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108965298A CN108965298A (en) | 2018-12-07 |
| CN108965298B true CN108965298B (en) | 2020-10-13 |
Family
ID=64482213
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810795159.5A Active CN108965298B (en) | 2018-07-19 | 2018-07-19 | High-definition video processing interaction technology based on multi-component theme |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108965298B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101621674A (en) * | 2009-07-09 | 2010-01-06 | 华为技术有限公司 | Processing method of video data and related equipment and system |
| CN103327265A (en) * | 2013-06-04 | 2013-09-25 | 浙江工业大学 | Four-way video combining method and device thereof based on FPGA |
| CN104080015A (en) * | 2014-06-19 | 2014-10-01 | 宁波公众信息产业有限公司 | Video coding method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6259733B1 (en) * | 1998-06-16 | 2001-07-10 | General Instrument Corporation | Pre-processing of bit rate allocation in a multi-channel video encoder |
| US8284322B2 (en) * | 2006-04-18 | 2012-10-09 | Marvell World Trade Ltd. | Shared memory multi video channel display apparatus and methods |
-
2018
- 2018-07-19 CN CN201810795159.5A patent/CN108965298B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101621674A (en) * | 2009-07-09 | 2010-01-06 | 华为技术有限公司 | Processing method of video data and related equipment and system |
| CN103327265A (en) * | 2013-06-04 | 2013-09-25 | 浙江工业大学 | Four-way video combining method and device thereof based on FPGA |
| CN104080015A (en) * | 2014-06-19 | 2014-10-01 | 宁波公众信息产业有限公司 | Video coding method |
Non-Patent Citations (1)
| Title |
|---|
| "基于FPGA的多路视频拼接系统设计";金峰;《中国优秀硕士论文全文数据库》;20160615;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108965298A (en) | 2018-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102273205B (en) | The software video transcoder accelerated with GPU | |
| CN103475935A (en) | Method and device for retrieving video segments | |
| CN107113447A (en) | High frame rate low frame rate rate transmission technology | |
| EP2274739A2 (en) | Video multiviewer system with serial digital interface and related methods | |
| CN104717509A (en) | Method and device for decoding video | |
| CN112612433A (en) | Screen projection method, device and system for vertical screen video | |
| CN101237583B (en) | A decoding and coding method and device for multiple screen | |
| EP3029869A1 (en) | Information processing device, information processing method, and program | |
| CN103338392A (en) | Method for seamless switching of images in video polling | |
| EP2279615A1 (en) | Video multiviewer with scaling | |
| CN102065208B (en) | Realization method of digital audio and video signal SerDes | |
| CN108965298B (en) | High-definition video processing interaction technology based on multi-component theme | |
| CN1640150A (en) | Image processing method and system to increase perceived visual output quality in case of lack of image data | |
| TWI605705B (en) | Stream decoding method and stream decoding circuit | |
| CN116437028B (en) | Video display method and system | |
| CN103873873B (en) | A kind of image coding/decoding method under non-Reliability Channel | |
| CN101466037A (en) | Method for implementing video decoder combining software and hardware | |
| CN112995543B (en) | Distributed video switching system, method and equipment | |
| CN100407795C (en) | Frame field self-adaptive detection method | |
| US9380260B2 (en) | Multichannel video port interface using no external memory | |
| US11335227B2 (en) | Display system with variable resolution | |
| CN1067831C (en) | MPEG-2 vedio-frequency decoder and its input buffer control method | |
| KR20060068254A (en) | Video encoding method, video decoding method, and video decoder | |
| CN1225544A (en) | Digital information source decoding device | |
| CN112583771B (en) | Data mapper and data mapping method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |