CN102752600A - Realizing method for reducing time delay of image transmission system - Google Patents
Realizing method for reducing time delay of image transmission system Download PDFInfo
- Publication number
- CN102752600A CN102752600A CN2012102438026A CN201210243802A CN102752600A CN 102752600 A CN102752600 A CN 102752600A CN 2012102438026 A CN2012102438026 A CN 2012102438026A CN 201210243802 A CN201210243802 A CN 201210243802A CN 102752600 A CN102752600 A CN 102752600A
- Authority
- CN
- China
- Prior art keywords
- image
- data
- coding
- strip data
- time delay
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a realizing method for reducing the time delay of an image transmission system, wherein an image transmitting terminal receives input image data, divides the input image data into stripe data and outputs the stripe data to an encoding unit; the receiving of the stripe data, the encoding of the stripe data and the output of the encoded stripe data are carried out in a parallel mode for encoding unit images; the image transmitting terminal adds data stripe heads to the encoded stripe data and subsequently transmits to an image receiving terminal; the image receiving terminal extracts the encoded stripe data according to the stripe heads and outputs the encoded stripe data to a decoding unit; the decoding unit adopts a parallel mode to receive the encoded stripe data, decode the encoded stripe data and output the stripe data; and the image receiving terminal organizes the decoded recovered stripe data into image data to be output according to the stripe heads. According to the realizing method, through stream treatment to the stripe data divided from images, the time delay of the image transmission system and the realizing resource of the image transmission system are reduced.
Description
Technical field
The invention belongs to image transmission data chainning field, relate to a kind of implementation method that reduces the image delivering system time delay.
Background technology
Image delivering system is a kind of collection that collects image, handle and be transmitted as the technology of one; Broad development along with multimedia technology and Radio Transmission Technology; Image delivering system is widely used in many fields of engineering with its intuitive and convenient, informative characteristics, also therefore become a research focus.And time delay is the index of an important measurement system quality in aerospace engineering is used especially image delivering system, and the end-to-end time delay of system requires lower usually.Time delay is low more, and then the user can watch decoded picture in the shorter again time more, thereby on this basis, makes commander and judge.Otherwise if time delay is too high, then real-time is just poor, has just lost meaning for emergency in particular for the image delivering system of Precision Guidance and Control.So the method for research reduction system time delay is necessary.
In image delivering system, time delay mainly comprises several major parts: the propagation delay time of image input and output, image coding and decoding processing delay, caching delay and channel coding/decoding processing delay.Can find out that the generation of time delay mainly is to produce at the image coding and decoding end.So the reduction of system's time delay focuses on reducing the time delay of image coding and decoding.
The method of having published at present about reducing the image coding and decoding terminal delay time mainly is divided into two types; The first kind is the rate control algorithm that uses in the research image encoding; Method through make every frame coded data approach target bit rate, minimizing coding side buffered data as far as possible reaches the purpose that reduces caching delay; But this strategy can only realize coded data in the certain hour steadily, can not be accurate to every frame fully and all reach target bit rate just, and the common more complicated of algorithm, amount of calculation are big; Second type is the fast algorithm of research image coding and decoding, thereby reduces the processing delay of image coding and decoding, but the lifting of speed inevitably can bring the loss of certain mass.
Summary of the invention
Technology of the present invention is dealt with problems and is: overcome the deficiency of prior art, a kind of implementation method that reduces the image delivering system time delay be provided, through stream treatment to the strip data that goes out by image segmentation, the time delay that has reduced image delivering system with realize resource.
Technical solution of the present invention is:
A kind of implementation method that reduces the image delivering system time delay, said image delivering system comprise image transmitting terminal and image receiving terminal, and wherein, the image transmitting terminal comprises coding unit; The image receiving terminal comprises decoding unit, and image transmitting terminal and image receiving terminal carry out image data transmission according to following steps:
The image transmitting terminal outputs to coding unit after receiving the view data of input and being divided into strip data;
The coding unit image adopts the mode of parallel processing to carry out the reception of strip data, the output of the coding of strip data and coding back strip data;
The image transmitting terminal sends to the image receiving terminal after coding back strip data is added slice header;
The image receiving terminal extracts coding back strip data according to slice header, and the back strip data of will encoding outputs to decoding unit;
The reception of strip data after said decoding unit adopts the mode of parallel processing to encode, the decoding of coding back strip data and the output of strip data;
After being organized into view data, the strip data that the image receiving terminal will recover after will decoding according to slice header exports.
Further, said coding unit adopts at least two buffer areas identical with the strip data size that the strip data of input is carried out buffer memory and coding.
Further, the parallel processing mode of said coding unit is: when the strip data of current time was encoded, strip data was exported behind the coding that the coding of previous moment is accomplished, and the strip data that next arrives is constantly received.
Further, said slice header comprises band sign head, bar reel number, and the image receiving terminal is confirmed strip data behind the complete coding according to band sign head, and is organized into view data according to the strip data that will recover after will decoding behind the band.
Further, strip data was carried out buffer memory and coding after said decoding unit adopted at least two buffer areas identical with coding back strip data size to the coding of input.
Further; The parallel processing mode of said decoding unit is: when strip data is decoded behind the coding of current time; Strip data to previous moment decoding back produces is exported, and strip data behind next coding that arrives is constantly received.
The present invention compared with prior art has following advantage:
The present invention is divided into a plurality of bands with the image transmitting terminal with view data, is the unit with the strip data, through method for parallel processing, makes the manifold processing time overlapping, thereby reaches the purpose of reduction system time delay.This method is applicable to the video compression algorithm that carries out image processing by piece (being that band of the present invention is the set of piece), as: H.264 algorithm, MPEG4 algorithm are easy to through engineering approaches and realize, and picture quality do not have loss.
Conventional images transmission system image encoding end processing mode all is to receive a whole two field picture to restart the compressed encoding processing later on.And the present invention's to be the unit with the strip data carry out image input and compression; Importing a strip data just begins later on to compress; In single-frame images, just opened the parallel processing of image input with coding; Realize the overlapping of image input delay and image compression encoding time delay, effectively reduced system's time delay that coding side causes.
Conventional images transmission system image receiving terminal all is that the bit stream data that receives a whole two field picture is restarted the decoding decompression later on; And code flow structure of the present invention is that the unit is organized with the back strip data of encoding; So image receiving terminal strip data after receiving a coding just can start later decoding and decompress; Realize the overlapping of code stream input buffering time delay and picture decoding decompression time delay, effectively reduced system's time delay that decoding end causes.
Because the present invention is to be that elementary cell is handled with the strip data, so the internal memory of its consumption is to be that elementary cell is distributed with the band mostly.As for the present invention, the original image input block of its image encoding end can be distributed 2 stripe size at least, and for prior art, its original image input block need be distributed 2 whole two field pictures sizes at least, in like manner in the picture decoding end.Therefore, the present invention has that to consume memory source few, the characteristics of saving memory headroom.
The present invention does not have particular requirement to the complexity of input picture, no matter is that dynamically big complicated image or dynamic little simple image all can reach the purpose that reduces the image delivering system time delay, has adaptability widely.And algorithm is realized simply, real-time is high, is easy to Project Realization.
Description of drawings
Fig. 1 is a flow chart of the present invention
Fig. 2 is a transmitting terminal parallel processing sketch map;
Fig. 3 is a receiving terminal parallel processing sketch map;
Fig. 4 is an image transmitting terminal schematic flow sheet of the present invention;
Fig. 5 is an image receiving terminal schematic flow sheet of the present invention.
Embodiment
Flow chart as shown in Figure 1 the present invention includes the following step:
(1) at first sends into as cushioning among the constructed FIFO of the FPGA of image transmitting terminal image acquisition units through the original digital image after the A/D sampled, digitalization; FPGA sends an interrupt signal to the DSP as image transmitting terminal coding unit after collecting a strip data, and triggering EDMA consistency operation received the view data that FPGA sends over a band fast after DSP received this interrupt signal.
(2) coding unit DSP just starts the image encoding operation after receiving a strip data immediately, this strip data that receives is encoded, and use EDMA that the back band bit stream data of encoding is exported.The mode of coding unit parallel processing is as shown in Figure 2, and a frame image data is divided equally and is n strip data, wherein: S
MkThe expression strip data input time, m is an image frame number, k is the bar reel number, bar reel number scope be (1, n); C
MkThe scramble time of a band of expression; T
MkThe bit stream data transmission time of a band of expression.
Among Fig. 2; Because the complexity of actual each strip data is different; So the scramble time of each band and bit stream data length are inconsistent, and transmission rate is certain, so the bit stream data transmission time of each band is also also different; And this transmission also relates to the process of Rate Control, metadata cache, so can't accurately express its practical work process with Fig. 2.Fig. 2 has just simply described the process of transmitting terminal by the band parallel processing.The all working of image transmitting terminal, because band of input just begins coding and transmission, all working that is equivalent to the image transmitting terminal has all shifted to an earlier date the time of n-1 band, thereby has reached the purpose that reduces image transmitting terminal time delay.
(3) coding unit is to encode in the unit with the strip data, and the bit stream data of a band of every generation just encapsulates it again, before the band bit stream data, adds slice header information.As shown in table 1, wherein band sign head and bar reel number are used for identification and distinguish a complete strips tape code flow data, band coded system and used with the decoding unit of band quantized value by the image receiving terminal.
Table 1
| Explanation | Band sign head | The bar reel number | The band coded system | The band quantized value |
| Length | 32bit | 6bit | 1bit | 1bit is between the 7bit |
(4) DSP as image receiving terminal decoding unit moves operation through EDMA carries out code stream on the backstage reception.Whenever receive a certain amount of bit stream data, EDMA just triggers the CPU that accomplishes interrupt notification DSP, and CPU carries out subsequent treatment to the bit stream data that receives.Simultaneously, EDMA continues bit stream data is received, and uses EDMA that the band restore data is exported.
(5) decoding unit DSP edge joint receipts bit stream data limit is searched for a complete band bit stream data.The search principle is: the band sign head during search bar is taken the lead; In case search a band sign head, then continue the next band sign head of search, to be searched after two band sign heads; Then mean and receive a complete band bit stream data; Extract actual band bit stream data and carry out decoding processing according to slice header information, the band restore data that decoding generates is exported, the mode of decoding unit parallel processing is as shown in Figure 3.Wherein: T
MkThe expression band bit stream data input time, m is an image frame number, k is the bar reel number, bar reel number scope be (1, n); D
MkThe decode time of a band bit stream data of expression; R
MkThe output time of a band restore data of expression.
With the analysis of step (2) in like manner, in the reality, each band bit stream data length is different, so transmission time and decode time are also inequality, so can't accurately express its practical work process with Fig. 3.Fig. 3 has just simply described the process of image receiving terminal by the band parallel processing.Key diagram is as all working of receiving terminal; Because bit stream data is to be that the unit is organized with the band bit stream data; So just begin to carry out decode operation after can receiving a complete band bit stream data, thereby reached the purpose that reduces image receiving terminal time delay.
(6) strip data to recovering; According to the bar reel number it is stored in image receiving terminal decoding image buffering area, and judges according to the bar reel number whether this band is last band, if; Then whole frame decoding image recovers to accomplish, and can be used for processing such as follow-up demonstration.This is owing to the image transmitting terminal is in order original strip data to be encoded successively and transmit according to the bar reel number, also is order so the image receiving terminal receives strip data that decoding recovers.Therefore, when waiting to recover the bar reel number, also mean to recover a whole frame decoding image for the strip data of last band.
Embodiment:
The experiment condition of present embodiment is:
(1) be input as the big or small digital video image of 720x576x8bit, frame per second is 25f/s;
(2) the coding bit rate output is 2Mbps;
(3) strip data resolution is that the strip data size is 720x16x8bit.
In conjunction with experimental condition recited above, according to the schematic flow sheet of Fig. 4 and Fig. 5.
The image transmitting terminal
(1) FPGA carries out buffer memory to the DID that receives, when data cached reach the 720x16x8bit size after, trigger EDMA for interrupt signal of DSP input image data moved.It is very high that EDMA moves speed, and it causes moves time delay and can ignore.According to frame per second, the time that FPGA receives a strip data of buffer memory is:
(2) DSP receives a complete strip data and notifies the coding main task later on, starts encoding process, and the band bit stream data that generates of encoding just is stored in the code stream transmission buffering area to be sent.So when DSP backstage EDMA moved other strip data, DSP can carry out encoding process to this strip data; And when carrying out the strip data reception and encoding, export through the bit stream data that DSP backstage another passage of EDMA will generate and organize; Thereby realized the parallel processing of strip data input, coding and output.Cushions a two field picture compared to prior art and begin Methods for Coding again, but the time rough calculation of saving is:
(3) be that the code flow structure of unit is organized with the band to bit stream data, add band head key message according to table 1, wherein band sign head is 0x00000001; Bar reel number scope is 1～36; The band coded system is 0 (I frame) or 1 (P frame), and band quantized value scope is (0,51).Through behind the code stream tissue, output it to the image receiving terminal according to the speed of 2Mbps.
Can find out according to above analysis; Under this experiment condition; The present invention effectively reduces the time delay of image transmitting terminal than the time that the prior art rough calculation can reduce
.
The image receiving terminal
(1) image receiving terminal DSP uses EDMA to receive the sequential serial bit stream data that the image transmitting terminal sends over according to 2M speed, after the data of 120 words of every reception, through accomplishing the CPU that interrupts informing DSP.DSP searches for this bit stream data, searches two 0x00000001 band sign heads then for to retrieve the data flow that comprises a complete strips tape code flow data, then it is carried out decoding processing.
(2) according to band coded system in the slice header and band quantized value parameter the band bit stream data is carried out decoding processing, recover a band decoded data.When the band bit stream data of being made up of coding back strip data was carried out above-mentioned processing, EDMA still received bit stream data on the backstage; Simultaneously, use another passage of EDMA the band restore data that has generated to be exported on the backstage.So realized bit stream data reception, the decoding of coding back strip data and the parallel processing of strip data output.The bit stream data length of supposing a two field picture is: the 2000000/25=80000 bit; The size of one of them band bit stream data is: the 80000/36=2222 bit; Receives one compared to prior art and put in order the method that the two field picture bit stream data begins decoding processing again, but the time rough calculation of saving is:
(3) strip data that recovers is stored in the correspondence position of decoding image buffering area according to the bar reel number; If the bar reel number is 36; Then expression has recovered last strip data of this two field picture, promptly gets access to a complete decoded picture, can show it and handle.
Can find out that according to above analysis under this experiment condition, the present invention can reduce time of 38.89ms than the prior art rough calculation, effectively reduces the time delay of image receiving terminal.
The part that the present invention does not set forth in detail belongs to techniques well known.
Claims (6)
1. implementation method that reduces the image delivering system time delay, said image delivering system comprises image transmitting terminal and image receiving terminal, wherein, the image transmitting terminal comprises coding unit; The image receiving terminal comprises decoding unit,
It is characterized in that image transmitting terminal and image receiving terminal carry out image data transmission according to following steps:
The image transmitting terminal outputs to coding unit after receiving the view data of input and being divided into strip data;
The coding unit image adopts the mode of parallel processing to carry out the reception of strip data, the output of the coding of strip data and coding back strip data;
The image transmitting terminal sends to the image receiving terminal after coding back strip data is added slice header;
The image receiving terminal extracts coding back strip data according to slice header, and the back strip data of will encoding outputs to decoding unit;
The reception of strip data after said decoding unit adopts the mode of parallel processing to encode, the decoding of coding back strip data and the output of strip data;
After being organized into view data, the strip data that the image receiving terminal will recover after will decoding according to slice header exports.
2. a kind of implementation method that reduces the image delivering system time delay as claimed in claim 1 is characterized in that: said coding unit adopts at least two buffer areas identical with the strip data size that the strip data of input is carried out buffer memory and coding.
3. according to claim 1 or claim 2 a kind of implementation method that reduces the image delivering system time delay; It is characterized in that: the parallel processing mode of said coding unit is: when the strip data of current time is encoded; Strip data is exported behind the coding that the coding of previous moment is accomplished, and the strip data that next arrives is constantly received.
4. a kind of implementation method that reduces the image delivering system time delay as claimed in claim 1; It is characterized in that: said slice header comprises band sign head, bar reel number; The image receiving terminal is confirmed strip data behind the complete coding according to band sign head, and is organized into view data according to the strip data that will recover after will decoding behind the band.
5. a kind of implementation method that reduces the image delivering system time delay as claimed in claim 1 is characterized in that: strip data was carried out buffer memory and coding after said decoding unit adopted at least two buffer areas identical with coding back strip data size to the coding of input.
6. like claim 1 or 5 described a kind of implementation methods that reduce the image delivering system time delay; It is characterized in that: the parallel processing mode of said decoding unit is: when strip data is decoded behind the coding of current time; Strip data to previous moment decoding back produces is exported, and strip data behind next coding that arrives is constantly received.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210243802.6A CN102752600B (en) | 2012-07-13 | 2012-07-13 | Realizing method for reducing time delay of image transmission system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210243802.6A CN102752600B (en) | 2012-07-13 | 2012-07-13 | Realizing method for reducing time delay of image transmission system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102752600A true CN102752600A (en) | 2012-10-24 |
| CN102752600B CN102752600B (en) | 2015-02-11 |
Family
ID=47032474
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210243802.6A Active CN102752600B (en) | 2012-07-13 | 2012-07-13 | Realizing method for reducing time delay of image transmission system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102752600B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241325A (en) * | 2017-06-05 | 2017-10-10 | 威创集团股份有限公司 | A kind of ultralow delay transport method and device of IP videos |
| CN107888945A (en) * | 2017-11-22 | 2018-04-06 | 豪威科技(上海)有限公司 | A kind of image transfer method and system |
| CN110933436A (en) * | 2019-12-17 | 2020-03-27 | 展讯通信（上海）有限公司 | Image encoding method, image encoding device, computer device, and storage medium |
| CN111212285A (en) * | 2018-11-21 | 2020-05-29 | 珠海格力电器股份有限公司 | Hardware video coding system and control method of hardware video coding system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064848A (en) * | 2006-04-27 | 2007-10-31 | 索尼株式会社 | Image data processing apparatus and method |
| CN101841717A (en) * | 2010-05-07 | 2010-09-22 | 华为技术有限公司 | Method for realizing decoding, software decoder and decoding device |
-
2012
- 2012-07-13 CN CN201210243802.6A patent/CN102752600B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064848A (en) * | 2006-04-27 | 2007-10-31 | 索尼株式会社 | Image data processing apparatus and method |
| CN101841717A (en) * | 2010-05-07 | 2010-09-22 | 华为技术有限公司 | Method for realizing decoding, software decoder and decoding device |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241325A (en) * | 2017-06-05 | 2017-10-10 | 威创集团股份有限公司 | A kind of ultralow delay transport method and device of IP videos |
| CN107888945A (en) * | 2017-11-22 | 2018-04-06 | 豪威科技(上海)有限公司 | A kind of image transfer method and system |
| CN111212285A (en) * | 2018-11-21 | 2020-05-29 | 珠海格力电器股份有限公司 | Hardware video coding system and control method of hardware video coding system |
| CN110933436A (en) * | 2019-12-17 | 2020-03-27 | 展讯通信（上海）有限公司 | Image encoding method, image encoding device, computer device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102752600B (en) | 2015-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102638579B (en) | A kind of data processing method and system based on mobile device data transmission | |
| WO2017193821A1 (en) | Cloud desktop image processing method, server, client and computer storage medium | |
| CN108243256B (en) | Data storage method, coding equipment and decoding equipment | |
| CN102752600A (en) | Realizing method for reducing time delay of image transmission system | |
| CN103023796B (en) | network data compression method and system | |
| CN105656981A (en) | Data transmission method and system | |
| CN102438145A (en) | Image lossless compression method on basis of Huffman code | |
| CN111556322A (en) | FPGA-based rapid image compression and transmission system | |
| CN105024702A (en) | Floating-point-type data lossless compression method for scientific calculation | |
| GB2523347A (en) | Encoder, decoder and method | |
| CN114442954B (en) | LZ4 coding compression device | |
| CN103020138A (en) | Method and device for video retrieval | |
| CN102023978B (en) | Mass data processing method and system | |
| CN103369365A (en) | Audio and video synchronous recording device | |
| CN104243886B (en) | A kind of high speed image parsing and video generation method based on plug-in part technology | |
| WO2019019294A1 (en) | Double buffering protocol data analysis system applicable to multi-task scheduling environment | |
| CN103533352A (en) | Compression method and device and decompression method and device for image with transparency | |
| CN103050123B (en) | A kind of method and system of transmitting voice information | |
| CN105631000A (en) | Terminal-caching data compression method based on mobile terminal position characteristic information | |
| CN102630008A (en) | Method and terminal for wireless video transmission | |
| CN103152567A (en) | Any order number index Columbus encoder and method thereof | |
| CN101720033A (en) | Video transmission equipment as well as USB transmission device and method thereof | |
| US8593310B1 (en) | Data-driven variable length encoding of fixed-length data | |
| CN112839230A (en) | Image data compression apparatus and image data decompression apparatus | |
| CN105049870A (en) | Sparseness estimation-based distributed video compressed sensing fast reconstruction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |