CN102752600B - Realizing method for reducing time delay of image transmission system - Google Patents
Realizing method for reducing time delay of image transmission system Download PDFInfo
- Publication number
- CN102752600B CN102752600B CN201210243802.6A CN201210243802A CN102752600B CN 102752600 B CN102752600 B CN 102752600B CN 201210243802 A CN201210243802 A CN 201210243802A CN 102752600 B CN102752600 B CN 102752600B
- Authority
- CN
- China
- Prior art keywords
- image
- data
- coding
- strip data
- band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a realizing method for reducing the time delay of an image transmission system, wherein an image transmitting terminal receives input image data, divides the input image data into stripe data and outputs the stripe data to an encoding unit; the receiving of the stripe data, the encoding of the stripe data and the output of the encoded stripe data are carried out in a parallel mode for encoding unit images; the image transmitting terminal adds data stripe heads to the encoded stripe data and subsequently transmits to an image receiving terminal; the image receiving terminal extracts the encoded stripe data according to the stripe heads and outputs the encoded stripe data to a decoding unit; the decoding unit adopts a parallel mode to receive the encoded stripe data, decode the encoded stripe data and output the stripe data; and the image receiving terminal organizes the decoded recovered stripe data into image data to be output according to the stripe heads. According to the realizing method, through stream treatment to the stripe data divided from images, the time delay of the image transmission system and the realizing resource of the image transmission system are reduced.
Description
Technical field
The invention belongs to image transmission data chain field, relate to a kind of implementation method reducing time delay of image transmission system.
Background technology
Image delivering system be a kind of collect image collection, the technology that processes and be transmitted as one, along with the broad development of multimedia technology and Radio Transmission Technology, therefore image delivering system, with its intuitive and convenient, informative feature and be widely used in many fields of engineering, also becomes a study hotspot.And time delay is applied especially in image delivering system in aerospace engineering, be the index of an important measurement system quality, the end-to-end time delay of system requires lower usually.Time delay is lower, then user more can watch decoded picture in the time shorter again, thus on this basis, makes commander and judge.Otherwise if time delay is too high, then real-time is just poor, just meaning is lost in particular for the image delivering system of Precision Guidance and Control for emergency.So the method that research reduces Time Delay of Systems is necessary.
In image delivering system, time delay mainly comprises a few major part: the propagation delay time of image input and output, image coding and decoding processing delay, caching delay and channel coding/decoding processing delay.Can find out, the generation of time delay mainly produces at image coding and decoding end.So the reduction of Time Delay of Systems focuses on the time delay reducing image coding and decoding.
That has published at present is mainly divided into two classes about the method reducing image coding and decoding terminal delay time, the first kind is the rate control algorithm used in research Image Coding, reach close to the method for target bit rate, minimizing coding side buffered data the object reducing caching delay by making every frame coded data as far as possible, but this strategy can only realize the steady of coded data in certain hour, can not be accurate to every frame completely and all just reach target bit rate, and the usual more complicated of algorithm, amount of calculation are large; Equations of The Second Kind is the fast algorithm of research image coding and decoding, thus reduces the processing delay of image coding and decoding, but the lifting of speed inevitably brings the loss of certain mass.
Summary of the invention
Technology of the present invention is dealt with problems and is: overcome the deficiencies in the prior art, provides a kind of implementation method reducing time delay of image transmission system, by the stream treatment to the strip data gone out by Iamge Segmentation, reduces the time delay of image delivering system and realizes resource.
Technical solution of the present invention is:
Reduce an implementation method for time delay of image transmission system, described image delivering system comprises image transmitting terminal and image-receptive end, and wherein, image transmitting terminal comprises coding unit; Image-receptive end comprises decoding unit, and image transmitting terminal and image-receptive end carry out the transmission of view data according to following steps:
Image transmitting terminal receives the view data of input and outputs to coding unit after being divided into strip data;
Coding unit image adopts the mode of parallel processing to carry out the reception of strip data, the output of the coding of strip data and the rear strip data of coding;
Image transmitting terminal is sent to image-receptive end after strip data after coding is added slice header;
Image-receptive end extracts the rear strip data of coding according to slice header, and strip data after coding is outputted to decoding unit;
The reception of strip data after described decoding unit adopts the mode of parallel processing to encode, the decoding of strip data and the output of strip data after coding;
Image-receptive end exports after the strip data recovered after decoding being organized into view data according to slice header.
Further, the buffer area that described coding unit employing at least two is identical with strip data size carries out buffer memory and coding to the strip data inputted.
Further, the parallel processing manner of described coding unit is: while encoding to the strip data of current time, and after the coding complete the coding of previous moment, strip data exports, and receives the strip data that subsequent time arrives.
Further, described slice header comprises band mark head, bar reel number, and image-receptive end determines strip data after a complete coding according to band mark head, and according to after band, the strip data recovered after decoding is organized into view data.
Further, the buffer area that described decoding unit employing at least two is identical with strip data size after coding carries out buffer memory and coding to strip data after the coding inputted.
Further, the parallel processing manner of described decoding unit is: while after the coding of current time, strip data is decoded, the strip data produced after previous moment decoding is exported, and strip data after the coding of subsequent time arrival is received.
The present invention compared with prior art tool has the following advantages:
View data is divided into multiple band by image transmitting terminal by the present invention, is unit with strip data, by method for parallel processing, makes the manifold processing time overlapping, thus reaches the object reducing Time Delay of Systems.The method is applicable to the video compression algorithm carrying out image procossing by block (namely band of the present invention is the set of block), as: H.264 algorithm, MPEG4 algorithm, is easy to through engineering approaches and realizes, and picture quality does not have loss.
Conventional images transmission system Image Coding end processing mode is all restart compressed encoding process after receiving a whole two field picture.And the present invention's to take strip data as unit carry out image input and compression, input a strip data just to start to compress later, image input and the parallel processing of encoding just is opened in single-frame images, achieve the overlapping of image input delay and image compression encoding time delay, effectively reduce the Time Delay of Systems that coding side causes.
Conventional images transmission system image-receptive end is all restart decoding decompression after the bit stream data receiving a whole two field picture, and code flow structure of the present invention with strip data after encoding for unit is organized, image-receptive end decompresses so just can start decoding after strip data after receiving a coding, achieve the overlapping of code stream input buffer delay and image decoding decompression time delay, effectively reduce the Time Delay of Systems that decoding end causes.
Be that elementary cell processes with strip data due to the present invention, so its internal memory consumed is be that elementary cell is distributed with band mostly.As for the present invention, 2 stripe size at least can be distributed in the original image input block of its Image Coding end, and for prior art, its original image input block at least needs the whole two field picture size of distribution 2, in like manner in image decoding end.Therefore, it is few that the present invention has consumption memory source, saves the feature of memory headroom.
The complexity of the present invention to input picture does not have particular requirement, no matter is that dynamically large complicated image or dynamically little simple image all can reach the object reducing time delay of image transmission system, has adaptability widely.And algorithm realization is simple, real-time is high, is easy to Project Realization.
Accompanying drawing explanation
Fig. 1 is flow chart of the present invention
Fig. 2 is transmitting terminal parallel processing schematic diagram;
Fig. 3 is receiving terminal parallel processing schematic diagram;
Fig. 4 is image transmitting terminal schematic flow sheet of the present invention;
Fig. 5 is image-receptive end schematic flow sheet of the present invention.
Embodiment
Flow chart as shown in Figure 1, the present invention includes the following step:
(1) first the original digital image after A/D sampling digitizing is sent into and is cushioned as in the FIFO constructed by the FPGA of image transmitting terminal image acquisition units, send an interrupt signal to the DSP as image transmitting terminal coding unit after FPGA collects a strip data, DSP triggers the view data that EDMA consistency operation high-speed receiving FPGA sends over a band after receiving this interrupt signal.
(2) just start image coding operation immediately after coding unit DSP receives a strip data, this strip data received is encoded, and use EDMA to export band bit stream data after coding.The mode of coding unit parallel processing as shown in Figure 2, divide equally for n strip data, wherein: S by a frame image data
mkrepresent input time of a strip data, m is image frame number, and k is bar reel number, bar reel number scope be (1, n); C
mkrepresent the scramble time of a band; T
mkrepresent the bit stream data transmission time of a band.
In Fig. 2, because the complexity of each strip data of reality is different, so the scramble time of each band and bit stream data length are inconsistent, and transmission rate is certain, therefore the bit stream data transmission time of each band also and different, and this transmission also relates to the process of Rate Control, data buffer storage, so cannot go out its practical work process by Precise Representation with Fig. 2.Fig. 2 just simply describes the process of transmitting terminal by band parallel processing.The all working of image transmitting terminal, just start encode and transmit owing to inputting a band, all working being equivalent to image transmitting terminal is all advanced by the time of n-1 band, thus reaches the object reducing image transmitting terminal time delay.
(3) coding unit is that unit is encoded with strip data, often generates the bit stream data of a band, just re-starts encapsulation to it, add slice header information before band bit stream data.As shown in table 1, wherein band mark head and bar reel number are used for identifying differentiation complete band bit stream data, band coded system and being used with the decoding unit of band quantized value by image-receptive end.
Table 1
| Explanation | Band mark head | Bar reel number | Band coded system | Band quantized value |
| Length | 32bit | 6bit | 1bit | Between 1bit to 7bit |
(4) operation is moved in the reception carrying out code stream as the DSP of image-receptive end decoding unit on backstage by EDMA.Often receive a certain amount of bit stream data, EDMA has just triggered the CPU of interrupt notification DSP, and CPU carries out subsequent treatment to the bit stream data received.Meanwhile, EDMA continues to receive bit stream data, and uses EDMA to export band recovery data.
(5) receiving code flow data limit in decoding unit DSP limit is searched for a complete band bit stream data.Search principle is: the band mark head in search slice header, once search a band mark head, then continue the next band mark head of search, to be searched after two band mark heads, then mean and receive a complete band bit stream data, extract actual band bit stream data and carry out decoding process according to slice header information, export the band recovery data that decoding generates, the mode of decoding unit parallel processing as shown in Figure 3.Wherein: T
mkrepresent bit stream data input time of a band, m is image frame number, and k is bar reel number, bar reel number scope be (1, n); D
mkrepresent the decode time of a band bit stream data; R
mkrepresent that a band recovers the output time of data.
With the analysis of step (2) in like manner, in reality, each band bit stream data length is different, so transmission time and decode time are not identical yet, therefore cannot go out its practical work process by Precise Representation with Fig. 3.Fig. 3 just simply describes the process of image-receptive end by band parallel processing.Key diagram is as all working of receiving terminal, because bit stream data is for unit is organized with band bit stream data, so just start to carry out decode operation after a complete band bit stream data can be received, thus reach the object reducing image-receptive terminal delay time.
(6) to the strip data recovered, be stored in image-receptive end decoding image buffering area according to bar reel number, and judged whether this band is last band according to bar reel number, if, then whole frame decoding Postprocessing technique completes, and can be used for the process such as follow-up display.This due to image transmitting terminal be in order original band data are encoded successively according to bar reel number and transmit, so image-receptive end receipt decoding recover strip data be also order.Therefore, when shaping reel number to be restored is the strip data of last band, also means and recover a whole frame decoding image.
Embodiment:
The experiment condition of the present embodiment is:
(1) be input as the digital video image of 720x576x8bit size, frame per second is 25f/s;
(2) bit rate output of encoding is 2Mbps;
(3) strip data resolution and strip data size are 720x16x8bit.
In conjunction with experimental condition recited above, according to the schematic flow sheet of Fig. 4 and Fig. 5.
Image transmitting terminal
(1) FPGA carries out buffer memory to the DID received, when data cached reach 720x16x8bit size after, trigger EDMA to DSP interrupt signal and input image data moved.It is very high that EDMA moves speed, and what it caused move time delay can ignore.According to frame per second, the time that FPGA receives a buffer memory strip data is:
(2) DSP receives informed code main task after a complete strip data, starts coded treatment, and the band bit stream data that coding generates just is stored in code stream and sends in buffering area to be sent.So when DSP backstage EDMA moves other strip data, DSP can carry out coded treatment to this strip data; And carry out strip data receive with coding while, will to be generated by DSP backstage another passage of EDMA and the bit stream data organized exports; Thus the parallel processing achieving strip data input, coding and export.Cushion the method that a two field picture starts to encode again compared to prior art, the time of saving can rough calculation be:
(3) code flow structure that bit stream data take band as unit is organized, band head key message is added according to table 1, wherein band mark head is 0x00000001, bar reel number scope is 1 ~ 36, band coded system is 0 (I frame) or 1 (P frame), band quantized value scope is (0,51).After code stream organization, output it to image-receptive end according to the speed of 2Mbps.
Can find out according to above analysis, under this experiment condition, the present invention comparatively prior art rough calculation can reduce
time, effectively reduce the time delay of image transmitting terminal.
Image-receptive end
(1) image-receptive end DSP uses the sequential serial bit stream data that EDMA reception image transmitting terminal sends over according to 2M speed, after often receiving the data of 120 words, by completing the CPU interrupting informing DSP.DSP searches for this bit stream data, searches two 0x00000001 band mark heads then for retrieving the data flow comprising a complete band bit stream data, then carries out decoding process to it.
(2) according to the band coded system in slice header and band quantized value parameter, decoding process is carried out to band bit stream data, recover a band decoded data.While carrying out above-mentioned process to the band bit stream data be made up of strip data after encoding, EDMA still receives bit stream data on backstage; Meanwhile, use another passage of EDMA to recover data on backstage to the band generated to export.So achieve that bit stream data receives, the decoding of strip data and strip data export after coding parallel processing.Suppose that the bit stream data length of a two field picture is: 2000000/25=80000 bit, the size of one of them band bit stream data is: 80000/36=2222 bit, receive a whole two field picture bit stream data compared to prior art and start the method processed of decoding again, the time of saving can rough calculation be:
(3) strip data recovered is stored in the correspondence position of decoding image buffering area according to bar reel number, if bar reel number is 36, then represent last strip data having recovered this two field picture, namely get a complete decoded picture, Graphics Processing can be carried out to it.
Can find out according to above analysis, under this experiment condition, the present invention can reduce the time of 38.89ms compared with prior art rough calculation, effectively reduces the time delay of image-receptive end.
The part that the present invention does not elaborate belongs to techniques well known.
Claims (1)
1. reduce an implementation method for time delay of image transmission system, described image delivering system comprises image transmitting terminal and image-receptive end, and wherein, image transmitting terminal comprises coding unit; Image-receptive end comprises decoding unit,
It is characterized in that, image transmitting terminal and image-receptive end carry out the transmission of view data according to following steps:
The view data that image transmitting terminal receives input also outputs to coding unit after being divided into strip data, and described coding unit adopts at least two buffer areas identical with strip data size to carry out buffer memory and coding to the strip data inputted;
Coding unit image adopts the mode of parallel processing to carry out the reception of strip data, the output of the coding of strip data and the rear strip data of coding, the parallel processing manner of described coding unit is: while encoding to the strip data of current time, after the coding complete the coding of previous moment, strip data exports, and receives the strip data that subsequent time arrives;
Image transmitting terminal is sent to image-receptive end after strip data after coding is added slice header;
Image-receptive end extracts the rear strip data of coding according to slice header, and strip data after coding is outputted to decoding unit, decoding unit adopts at least two to carry out buffer memory and coding with the coding buffer area that strip data size is identical afterwards to strip data after the coding inputted;
The reception of strip data after described decoding unit adopts the mode of parallel processing to encode, the decoding of strip data and the output of strip data after coding, the parallel processing manner of described decoding unit is: while after the coding of current time, strip data is decoded, the strip data produced after previous moment decoding is exported, and strip data after the coding of subsequent time arrival is received;
Image-receptive end exports after the strip data recovered after decoding being organized into view data according to slice header, described slice header is as shown in table 1, comprise band mark head, bar reel number, image-receptive end determines strip data after a complete coding according to band mark head, and according to after band, the strip data recovered after decoding is organized into view data:
Table 1
。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210243802.6A CN102752600B (en) | 2012-07-13 | 2012-07-13 | Realizing method for reducing time delay of image transmission system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210243802.6A CN102752600B (en) | 2012-07-13 | 2012-07-13 | Realizing method for reducing time delay of image transmission system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102752600A CN102752600A (en) | 2012-10-24 |
| CN102752600B true CN102752600B (en) | 2015-02-11 |
Family
ID=47032474
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210243802.6A Active CN102752600B (en) | 2012-07-13 | 2012-07-13 | Realizing method for reducing time delay of image transmission system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102752600B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241325A (en) * | 2017-06-05 | 2017-10-10 | 威创集团股份有限公司 | A kind of ultralow delay transport method and device of IP videos |
| CN107888945A (en) * | 2017-11-22 | 2018-04-06 | 豪威科技(上海)有限公司 | A kind of image transfer method and system |
| CN111212285A (en) * | 2018-11-21 | 2020-05-29 | 珠海格力电器股份有限公司 | Hardware video coding system and control method of hardware video coding system |
| CN110933436A (en) * | 2019-12-17 | 2020-03-27 | 展讯通信（上海）有限公司 | Image encoding method, image encoding device, computer device, and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064848A (en) * | 2006-04-27 | 2007-10-31 | 索尼株式会社 | Image data processing apparatus and method |
| CN101841717A (en) * | 2010-05-07 | 2010-09-22 | 华为技术有限公司 | Method for realizing decoding, software decoder and decoding device |
-
2012
- 2012-07-13 CN CN201210243802.6A patent/CN102752600B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064848A (en) * | 2006-04-27 | 2007-10-31 | 索尼株式会社 | Image data processing apparatus and method |
| CN101841717A (en) * | 2010-05-07 | 2010-09-22 | 华为技术有限公司 | Method for realizing decoding, software decoder and decoding device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102752600A (en) | 2012-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102752600B (en) | Realizing method for reducing time delay of image transmission system | |
| WO2017193821A1 (en) | Cloud desktop image processing method, server, client and computer storage medium | |
| CN101742313B (en) | Compression sensing technology-based method for distributed type information source coding | |
| CN102638579A (en) | Data processing method and system based on data transmission of mobile equipment | |
| CN101835043A (en) | Adaptive bandwidth desktop sharing method based on block encoding | |
| CN111556322A (en) | FPGA-based rapid image compression and transmission system | |
| CN103152606B (en) | Video file processing method and device, system | |
| CN103618903A (en) | High-speed low-power-consumption wireless sensor network video compression sampling method and high-speed low-power-consumption wireless sensor network video compression sampling device | |
| CN111263164A (en) | High frame frequency video parallel coding and recombination method | |
| CN103050123B (en) | A kind of method and system of transmitting voice information | |
| CN107360380A (en) | A kind of double Compression camera devices and its host computer decoding apparatus | |
| JP2006338226A (en) | Remote operation system | |
| CN112218082B (en) | Reconfigurable multi-video coding acceleration design-based method and system | |
| JP4973358B2 (en) | Remote operation system | |
| Amin et al. | Modified run length encoding scheme with introduction of bit stuffing for efficient data compression | |
| CN104796718B (en) | The transmission method of distributed video coding based on CS in WMSN | |
| CN103152567A (en) | Any order number index Columbus encoder and method thereof | |
| CN112449138A (en) | Low-delay video transmission system and method | |
| CN112770179B (en) | Efficient transmission system for on-line event rebroadcasting | |
| WO2022257969A1 (en) | Point cloud coding method, decoding method, and related device | |
| CN117804609A (en) | Nondestructive infrared image processing method based on FPGA (field programmable Gate array) under limited telemetry bandwidth condition | |
| CN104113345B (en) | Decompression circuit and related decompression method | |
| WO2022257970A1 (en) | Point cloud geometric information encoding processing method, decoding processing method, and related device | |
| WO2022258010A1 (en) | Point cloud encoding processing method and apparatus, and point cloud decoding processing method and apparatus | |
| WO2022257972A1 (en) | Encoding control method and apparatus, and decoding control method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |