CN206807668U - Time-domain gradable code device based on area-of-interest - Google Patents
Time-domain gradable code device based on area-of-interest Download PDFInfo
- Publication number
- CN206807668U CN206807668U CN201620795738.6U CN201620795738U CN206807668U CN 206807668 U CN206807668 U CN 206807668U CN 201620795738 U CN201620795738 U CN 201620795738U CN 206807668 U CN206807668 U CN 206807668U
- Authority
- CN
- China
- Prior art keywords
- image
- enhancement layer
- roi
- primary layer
- electrically connected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005611 electricity Effects 0.000 claims 1
- 230000002708 enhancing effect Effects 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 10
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000002123 temporal effect Effects 0.000 abstract description 4
- 150000001875 compounds Chemical class 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Abstract
The utility model discloses the time-domain gradable code device based on area-of-interest, original image is as basic tomographic image, and area-of-interest division is carried out to original image and handles to obtain the enhancement layer image for only including ROI section, and absolute coding and decoding are carried out to both, in channel condition by limited time, enhancement layer coding data are discardable and only transmit the coded data of Primary layer, the coded data that now terminal receives has relatively low temporal resolution, the transmittable enhancement layer image when channel allows to transmit enhancement layer coding data, when decoding terminals export, enhancement layer image is attached on the basic two field picture of former frame output by corresponding ROI positions.Now ROI has higher temporal resolution in enhancement layer image.The utility model combination ROI technologies and time-domain gradable coding techniques, both can guarantee that ROI region quality, and and can ensures that video is smooth.
Description
Technical field
It the utility model is related to technical field of image processing, and in particular to the time-domain gradable coding based on area-of-interest
Device.
Background technology
In video monitoring scene, different demands causes to be different to the attention rate of different zones, to wherein comparing
Region (ROI, region of interest) interested needs higher picture quality.Therefore can be adopted in Video coding
The coding of high quality is carried out to ROI with the higher quality factor.For example, traffic video monitoring have for car plate definition it is very high
It is required that so the regional quality containing car plate is higher, other parts quality is weaker.To ensure ROI video quality and non-ROI
Video quality is variant, typically carries out quantization encoding using different coding quality factor pair ROI and non-ROI.But it is subjective
Effect is general, and limited to the reduction effect of code word, in practice the state of channel affected by many factors can cause video flowing without
Method is all transferred to terminal client, and now ROI region is encoded even with higher quality can not also ensure that client regards
The smoothness that frequency receives.
Video flowing affected by many factors can be caused can not to be all transferred to terminal client to solve the state of channel
Problem, scalable coding technology are applied and given birth to.Fig. 3 gives flexible time domain coding schematic diagram, and red is T in figure0Layer, green
For T1Layer, blueness is T2Layer.Flexible time domain coding includes Primary layer and enhancement layer, and Primary layer can not typically refer to enhancement layer.
During Bandwidth-Constrained, basic tomographic image (low frame per second, T in Fig. 3 can be only transmitted0Layer)；When bandwidth status is preferable, can transmit basic
Layer and enhancement layer image (high frame per second).Then, though flexible time domain solves the problems, such as that transmission is unstable, ROI volumes are not accounted for
Code.
Utility model content
In view of the shortcomings of the prior art, the utility model aims to provide a kind of time-domain gradable based on area-of-interest and compiled
Code device and method, by combining ROI technologies and time-domain gradable coding techniques, ROI region quality was both can guarantee that, and can ensures
Video is smooth.
To achieve these goals, the utility model adopts the following technical scheme that：
Time-domain gradable code device based on area-of-interest, including transmitting terminal and receiving terminal；
The transmitting terminal include image input device, interesting image regions division processor, Primary layer image encoder,
Enhancement layer image encoder and sending module；Wherein, described image input equipment and Primary layer image encoder are electrically connected with, institute
State image input device to be electrically connected with successively with interesting image regions division processor, enhancement layer image encoder, the base
This tomographic image encoder and enhancement layer image encoder are electrically connected at sending module；
The receiving terminal includes Primary layer picture decoder, enhancement layer image decoder, image combined processor, image
Output equipment and receiving module, the receiving module, Primary layer picture decoder and image combined processor are electrically connected with successively,
And the receiving module, enhancement layer image decoder and image combined processor are electrically connected with successively, described image Combined Processing
Device is electrically connected at image output device；The Primary layer picture decoder is also directly electrically connected at described image output and set
It is standby.
The time domain based on area-of-interest using the above-mentioned time-domain gradable code device based on area-of-interest can divide
Level coding method, comprises the following steps：
At transmitting terminal, original image is inputted S1 by image input device；
Original image described in S2 is the image of Primary layer；Processor is divided to described original using interesting image regions
Image carries out area-of-interest division, is divided into ROI section and non-ROI section, the image of the ROI section is as enhancement layer
Image；
S3 carries out absolute coding using Primary layer image encoder to the image of the Primary layer, furthermore with enhancement layer figure
As encoder carries out absolute coding to the image of the enhancement layer；
For S4 when channel condition is by limited time, transmitting terminal only sends the coding of Primary layer image encoder output by sending module
Data, coded data and the enhancement layer image encoder that the output of Primary layer image encoder is then sent when channel condition allows are defeated
The coded data gone out；
S5 is at receiving terminal, if receiving only the coded data of Primary layer image encoder output using receiving module,
Row decoding is then entered to the coded data using Primary layer picture decoder and obtains the decoded picture of Primary layer, base is received when simultaneously
This tomographic image encoder and the coded data of enhancement layer image encoder output, then utilize Primary layer picture decoder and increasing simultaneously
The coded data that strong tomographic image decoder exports to Primary layer image encoder and enhancement layer image encoder respectively enters row decoding
Obtain the decoded picture of Primary layer and the decoded picture of enhancement layer；
S6 is when having to the decoded picture of Primary layer in step S5, then directly described basic to image output device output
The decoded picture of layer；When decoded picture and the decoded picture of enhancement layer that Primary layer is obtained in step S5, the compound place of image is utilized
Manage device and the decoded picture of the enhancement layer replaced in the decoded picture of the Primary layer part of position correspondence therewith, compound
To final compound decoded picture, and exported to image output device.
It should be noted that in step S2, the image of the ROI section of original image is only included in enhancement layer, only includes one
Layer enhancement layer.
It should be noted that the decoded picture of Primary layer can only be referred to during the image of coding Primary layer, encoding enhancement layer
Decoded picture with reference to Primary layer or the decoded picture with reference to enhancement layer during image.
The beneficial effects of the utility model are：
1st, the utility model combination ROI technologies and time-domain gradable coding techniques, both can guarantee that ROI region quality, and can
Ensure that video is smooth.
2nd, in channel condition by limited time, the coded data of enhancement layer is discardable and only transmits the coded data of Primary layer, this
When the coded data that receives of terminal have relatively low temporal resolution, it is transmittable when channel allows to transmit enhancement layer coding data to increase
Strong tomographic image, when receiving terminal decoding exports, enhancement layer image is attached to the Primary layer of former frame output by corresponding ROI positions
On image.Now ROI has higher temporal resolution in enhancement layer image.
Brief description of the drawings
Fig. 1 is device hardware connection diagram of the present utility model；
Fig. 2 is method flow diagram of the present utility model；
Fig. 3 is the principle schematic of flexible time domain coding.
Embodiment
Below with reference to accompanying drawing, the utility model will be further described, it is necessary to which explanation, the present embodiment is with this skill
Premised on art scheme, detailed embodiment and specific operating process are given, but the scope of protection of the utility model is not
It is limited to the present embodiment.
As shown in figure 1, the time-domain gradable code device based on area-of-interest, including transmitting terminal and receiving terminal；
The transmitting terminal include image input device, interesting image regions division processor, Primary layer image encoder,
Enhancement layer image encoder and sending module；Wherein, described image input equipment and Primary layer image encoder are electrically connected with, institute
State image input device to be electrically connected with successively with interesting image regions division processor, enhancement layer image encoder, the base
This tomographic image encoder and enhancement layer image encoder are electrically connected at sending module；
The receiving terminal includes Primary layer picture decoder, enhancement layer image decoder, image combined processor, image
Output equipment and receiving module, the receiving module, Primary layer picture decoder and image combined processor are electrically connected with successively,
And the receiving module, enhancement layer image decoder and image combined processor are electrically connected with successively, described image Combined Processing
Device is electrically connected at image output device；The Primary layer picture decoder is also directly electrically connected at described image output and set
It is standby.
As shown in Fig. 2 using the above-mentioned time-domain gradable code device based on area-of-interest based on area-of-interest
Time-domain gradable coding method, comprise the following steps：
At transmitting terminal, original image is inputted S1 by image input device；When input be image sequence when, then it is original
Image is exactly each two field picture in image sequence.
Original image described in S2 is the image of Primary layer；Processor is divided to described original using interesting image regions
Image carries out area-of-interest division, is divided into ROI section and non-ROI section, the image of the ROI section is as enhancement layer
Image；
S3 carries out absolute coding using Primary layer image encoder to the image of the Primary layer, furthermore with enhancement layer figure
As encoder carries out absolute coding to the image of the enhancement layer；
For S4 when channel condition is by limited time, transmitting terminal only sends the volume of Primary layer image encoder output by sending module
Code data, the coded data and enhancement layer image encoder of the output of Primary layer image encoder are then sent when channel condition allows
The coded data of output；
S5 is at receiving terminal, if receiving only the coded data of Primary layer image encoder output using receiving module,
Row decoding is then entered to the coded data using Primary layer picture decoder and obtains the decoded picture of Primary layer, base is received when simultaneously
This tomographic image encoder and the coded data of enhancement layer image encoder output, then utilize Primary layer picture decoder and increasing simultaneously
The coded data that strong tomographic image decoder exports to Primary layer image encoder and enhancement layer image encoder respectively enters row decoding
Obtain the decoded picture of Primary layer and the decoded picture of enhancement layer；
S6 is when having to the decoded picture of Primary layer in step S5, then directly described basic to image output device output
The decoded picture of layer；When decoded picture and the decoded picture of enhancement layer that Primary layer is obtained in step S5, the compound place of image is utilized
Manage device and the decoded picture of the enhancement layer replaced in the decoded picture of the Primary layer part of position correspondence therewith, compound
To final compound decoded picture, and exported to image output device.
It should be noted that in step S2, the image of the ROI section of original image is only included in enhancement layer, only includes one
Layer enhancement layer.
It should be noted that the decoded picture of Primary layer can only be referred to during the image of coding Primary layer, encoding enhancement layer
Decoded picture with reference to Primary layer or the decoded picture with reference to enhancement layer during image.
Embodiment one
The multiple proportion of low frame per second and high frame per second is determined according to ROI and transmission requirement, such as 1：2, i.e., the image of basal layer and
The image of enhancement layer is alternately present every frame.
The coding and transmission process of transmitting terminal：
Primary layer is input picture, and its resolution ratio is 1920 × 1080, and basic tomographic image is encoded, does not differentiate between ROI
With non-ROI region, basic tomographic image is T0Layer；
Enhancement layer is the image of the only ROI section comprising original image, only includes one layer of enhancement layer, enhancement layer T1Layer,
Now the size of enhancement frame is ROI sizes.Basic frame is referred to during coding and also refers to enhancement frame.The volume of basal layer and enhancement layer
Code data have independent coding parameter such as image size, movable information, transformation parameter, quantization parameter etc..
According to transmission channel virtual condition, transmission may be selected (channel condition by limited time, such as channel strip in enhancement layer coding data
Width is less than or equal to threshold value), it can also select not transmit (when channel condition allows, as channel width is more than threshold value).
Receiving terminal decodes process：
Code stream after inputting as coding, enters row decoding to Primary layer first, obtained decoded picture resolution ratio be 1920 ×
1080, low frame rate image, and basic tomographic image does not differentiate between ROI and non-ROI region.After Primary layer Image Coding is received only
Coded data, then decoded picture is directly exported after decoding.
Coded data after enhancement layer image coding is also included in the code stream received, then enter row decoding, decoding obtains
The decoded picture for enhancement layer decoded picture, i.e. ROI section；
Obtained enhancement layer ROI section will be decoded replace the data of correspondence position in basic tomographic image, obtain it is compound after
Decoded picture；Export decoded picture sequence.
For those skilled in the art, technical scheme that can be more than and design, make various corresponding
Change and deformation, and all these change and deformation should be construed as being included in the utility model claims protection domain it
It is interior.
Claims (1)
1. the time-domain gradable code device based on area-of-interest, it is characterised in that including transmitting terminal and receiving terminal；
The transmitting terminal includes image input device, interesting image regions division processor, Primary layer image encoder, enhancing
Tomographic image encoder and sending module；Wherein, described image input equipment and Primary layer image encoder are electrically connected with, the figure
As input equipment and interesting image regions divide processor, enhancement layer image encoder is electrically connected with successively, the Primary layer
Image encoder and enhancement layer image encoder are electrically connected at sending module；
The receiving terminal includes Primary layer picture decoder, enhancement layer image decoder, image combined processor, image output
Equipment and receiving module, the receiving module, Primary layer picture decoder and image combined processor are electrically connected with successively, and institute
State receiving module, enhancement layer image decoder and image combined processor to be electrically connected with successively, described image combined processor electricity
Property is connected to image output device；The Primary layer picture decoder is also directly electrically connected at described image output equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201620795738.6U CN206807668U (en) | 2016-07-26 | 2016-07-26 | Time-domain gradable code device based on area-of-interest |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201620795738.6U CN206807668U (en) | 2016-07-26 | 2016-07-26 | Time-domain gradable code device based on area-of-interest |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN206807668U true CN206807668U (en) | 2017-12-26 |
Family
ID=60727702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201620795738.6U Active CN206807668U (en) | 2016-07-26 | 2016-07-26 | Time-domain gradable code device based on area-of-interest |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN206807668U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106060553A (en) * | 2016-07-26 | 2016-10-26 | 公安部第研究所 | Time domain scalable coding device based on region of interest and method thereof |
-
2016
- 2016-07-26 CN CN201620795738.6U patent/CN206807668U/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106060553A (en) * | 2016-07-26 | 2016-10-26 | 公安部第研究所 | Time domain scalable coding device based on region of interest and method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101189882B (en) | Method and apparatus for encoder assisted-frame rate up conversion (EA-FRUC) for video compression | |
| CN101577828B (en) | Tone mapping for bit-depth scalable video codec | |
| US8942292B2 (en) | Efficient significant coefficients coding in scalable video codecs | |
| CN101729892B (en) | Coding method of asymmetric stereoscopic video | |
| CN102905128B (en) | Codec processor is the method for Rate Control during wireless video transmission | |
| Pece et al. | Adapting standard video codecs for depth streaming. | |
| CN111131828B (en) | Image compression method and device, electronic equipment and storage medium | |
| CN107113447A (en) | High frame rate low frame rate rate transmission technology | |
| KR20150027145A (en) | Method and apparatus for encoding a video stream having a transparency information channel | |
| CN101009842A (en) | Method and device for value insertion in the hierarchical video compression | |
| WO2021057697A1 (en) | Video encoding and decoding methods and apparatuses, storage medium, and electronic device | |
| CN206807668U (en) | Time-domain gradable code device based on area-of-interest | |
| CN109068134A (en) | Method for video coding and device | |
| CN107396082A (en) | A kind for the treatment of method and apparatus of view data | |
| CN106060553A (en) | Time domain scalable coding device based on region of interest and method thereof | |
| CN206283618U (en) | Spatial scalable coding device based on area-of-interest | |
| CN112218084B (en) | High-efficiency video coding standard frame-level code rate control method facing surveillance video | |
| CN110572677B (en) | Video encoding and decoding method and device, storage medium and electronic device | |
| CN106060554A (en) | ROI based space hierarchical coding device and method | |
| CN104053009A (en) | Encoding method of monitoring video and device | |
| WO2023030072A1 (en) | Encoding and decoding method, encoder, decoder, and electronic device | |
| CN110572672A (en) | Video encoding and decoding method and device, storage medium and electronic device | |
| CN102413333B (en) | Video compression coding/decoding system and method based on underdetermined blind signal separation | |
| CN102811349B (en) | No-feedback multi-description distributed video coder-decoder capable of adjusting redundancy automatically and coding method thereof | |
| CN106170089B (en) | H.265-based multi-path coding method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant |