CN101217652A - An image information recording and extracting method in the process of the encoding and decoding of video images - Google Patents

An image information recording and extracting method in the process of the encoding and decoding of video images Download PDF

Info

Publication number
CN101217652A
CN101217652A CNA2007101690184A CN200710169018A CN101217652A CN 101217652 A CN101217652 A CN 101217652A CN A2007101690184 A CNA2007101690184 A CN A2007101690184A CN 200710169018 A CN200710169018 A CN 200710169018A CN 101217652 A CN101217652 A CN 101217652A
Authority
CN
China
Prior art keywords
rectangular area
image
upper left
left corner
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2007101690184A
Other languages
Chinese (zh)
Other versions
CN101217652B (en
Inventor
胡瑞敏
夏洋
牟晓弦
屠增辉
刘琼
李明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan University WHU
Original Assignee
Wuhan University WHU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan University WHU filed Critical Wuhan University WHU
Priority to CN2007101690184A priority Critical patent/CN101217652B/en
Publication of CN101217652A publication Critical patent/CN101217652A/en
Application granted granted Critical
Publication of CN101217652B publication Critical patent/CN101217652B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention relates to an image information recording and extracting method thereof in the process of coding and decoding video images. By setting marks, such as a region changing mark, a region number mark, a region ID, the horizontal coordinate of the left-top corner position of the region, the vertical coordinate of the left-top corner position of the region, the horizontal coordinate of the lower right corner position of the region and the vertical coordinate of the lower right corner position of the region, etc., a multi-area mark as well as subsequent and region-based video coding and video processing is fully supported. The invention can be realized by modifying and expanding the existing video standard so as to support the region-based mark, the video coding and the video processing. The invention has excellent popularizing prospect and is hopeful to generally improve the quality and the efficiency of video transmission.

Description

Image information recording in the video image encoding and decoding process and extracting method
Technical field
The invention belongs to the video coding and decoding technology field, particularly image information recording and the extracting method in the video image encoding and decoding process.
Background technology
The network video stream business develop the inevasible restriction that is subjected to the finite bandwidth resource rapidly, and when very low bit rate carries out video compression, tend to lose some detailed information, even wherein partial information is that people are interested especially, such as the shoulder of the personage's head in video conference zone, the little target area of carrying important information in the aerial image, the interference fringe zone in the interference multispectral image, and focus zone or the like in the medical image, these can be referred to as area-of-interest.From the subjective vision angle, the recovery quality in these zones directly has influence on the whole subjective feeling quality of reconstructed image.Do not have at present effect technique as yet and can solve this defective that has video technique now.
Summary of the invention
The object of the invention is to solve the prior art deficiency, at area-of-interest transmission quality problem, provides image information recording and extracting method in the video image encoding and decoding process.
For achieving the above object, the invention provides the image information recording method in a kind of encoding video pictures process, write down following image information content and enroll the video coding code stream,
(1) at least one rectangular area in the selection piece image, the number in zone selected in record, and write down each regional area I D.
(2) with the macro block be the following information of unit record,
The position, the upper left corner in selected zone with respect to the position, the upper left corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the vertical shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone vertical shift with respect to the position, the upper left corner of image under it;
(3) in the record present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area whether the same.
(4) whether record uses zone marker.
And described image is still frame or motion picture.
And if do not use the function of zone marker, then the positional information of the number of rectangular area, each rectangular area and area I D save record.
And, if in the present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area the same, then the positional information of the number of the rectangular area of present image, each rectangular area and area I D save record.
The present invention also provides the image information extracting method in the corresponding video image decoding process, it is characterized in that: from the video coding code stream, obtain digital picture, from digital picture, extract following information,
(1) obtains the number of selecting the zone, obtain each regional area I D of record.
(2) be that unit extracts following information with the macro block,
The position, the upper left corner in selected zone with respect to the position, the upper left corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the vertical shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone vertical shift with respect to the position, the upper left corner of image under it.
(3) whether the position of the number of rectangular area and each rectangular area is the same in the position that obtains the number of rectangular area in the present image and each rectangular area and the last piece image.
(4) obtain whether use zone marker.
And described digital picture is to have removed the redundant and two field picture that obtains of time domain from the video coding code stream.
And if do not use the function of zone marker, then the positional information of the number of rectangular area, each rectangular area and area I D need not obtain.
And, if in the present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area the same, then the positional information of the number of the rectangular area of present image, each rectangular area and area I D need not obtain.
Technical scheme of the present invention has added the special design of facing area mark in video image encoding and decoding, can support Video processing and video coding based on the zone, has strengthened interested area information content, has improved the transmission of video images quality.The present invention can be used as the high level syntax design, carries out standard in video standard, so that carry out extensive use in video technique.
Embodiment
This method is made amendment on existing video standard and is expanded, to support mark, video coding and the Video processing based on the zone.Specifically support the mark of multizone and follow-up video coding and Video processing based on the zone by marks such as setting area change mark, regional number mark, position, regional upper left corner horizontal coordinate, position, regional upper left corner vertical coordinate, position, regional lower right corner horizontal coordinate, position, regional lower right corner vertical coordinate, area I D comprehensively.
The invention provides the image information recording method in a kind of encoding video pictures process: select at least one rectangular area in the piece image, and number and each regional area I D in zone selected in record.With the macro block is unit record: the position, the upper left corner in selected zone with respect to the position, the upper left corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the vertical shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone vertical shift with respect to the position, the upper left corner of image under it.In the record present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area whether the same.Whether record uses zone marker.
The present invention also provides the image information extracting method in the corresponding video image decoding process, is that unit obtains with the macro block: the number in zone, the area I D that each is regional, the position, the upper left corner in selected zone is with respect to the horizontal-shift of the position, the upper left corner of image under it, the position, the upper left corner in selected zone is with respect to the vertical shift of the position, the upper left corner of image under it, the position, the lower right corner in selected zone is with respect to the horizontal-shift of the position, the upper left corner of image under it, the position, the lower right corner in selected zone is with respect to the vertical shift of the position, the upper left corner of image under it.Whether the position of the number of rectangular area and each rectangular area is the same in the position that obtains the number of rectangular area in the present image and each rectangular area and the last piece image.Obtain and whether use zone marker.
The present invention can be used for still image transmission or dynamic video transmission.During coding, image information can be from still frame or motion picture.During decoding, obtain digital picture from the video coding code stream, digital image information can be to have removed the redundant and two field picture that obtains of time domain from the video coding code stream.
Described area I D is the numbering in selected zone, and if any 3 zones, then Qu Yu ID can be respectively 1,2,3.
In order to reduce transmission code rate, improve encoding-decoding efficiency, the present invention proposes further scheme: if do not use the function of zone marker, then the positional information of the number of rectangular area, each rectangular area and area I D need not write down (or obtaining).If in the present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area the same, then the positional information of the number of the rectangular area of present image, each rectangular area and area I D need not write down (or obtaining).Saving on this information content has directly brought the minimizing of transmission code rate, and does not damage transmission quality.Technical scheme of the present invention can be used as the high level syntax design, carries out standard in video standard, guarantees the coding transmitting terminal and receive decoding end to adopt corresponding scheme.The present invention is an example with the AVS-P2 video standard, and technical solution of the present invention is converted to modification to video standard grammer on the middle and senior level, indicates the part that the statement of symbol * adds on existing AVS-P2 standard code basis for embodiment in the following form.The target statement is not for having the AVS-P2 standard code now for other, and implication can be with reference to " the information technology advanced audio/video coding part 2: video " of State Administration for Quality Supervision and Inspection and Quarantine's issue, and the present invention will not give unnecessary details.
(1) " definition of I image head " among the AVS-P2 is revised as:
i_picture_header() { Descriptor
i_picture_start_code f(32)
bbv_delay u(16)
time_code_flag u(1)
if(time_code_flag==’1’)
time_code u(24)
marker_bit f(1)
picture_distance u(8)
if(low_delay==’1’)
bbv_check_times ue(v)
progress_ive_frame u(1)
if(progress ive frame==’0’)
picture_structure u(1)
top_field_first u(1)
repeat_first field u(1)
fixed_picture_qp u(1)
picture_qp u(6)
if(progressive_frame==’0’){
if(picture_structure==’0’){
skip_mode_flag u(1)
}
}
If(roi_enable_flag){
*roi_change_flag u(1)
If(roi_change_flag){
*roi_num u(4)
for(i=0;i<region_num;i++){
*region_ID u(4)
*region_spos_x u(7)
*region_spos_y u(7)
*marker_bit f(1)
*region_epos_x u(7)
*region_epos_y u(7)
}
}
}
reserved_bits r(4)
loop_filter_disable u(1)
if(!loop_filter disable){
loop_fi lter_parameter_flag u(1)
if(loop_filter_parameter_flag){
alpha_c_offset se(v)
beta_offset se(v)
}
}
next_start_code()
}
In the semantic description of I image head, increase following content simultaneously:
1) mark current region information change roi_change_flag1 position signless integer.Whether the area information that present frame is described is different with former frame.
2) marked region number region_num4 position signless integer.Provide the number altogether in the zone of institute's mark in the present frame.Marked region is a rectangle.
3) regional location horizontal coordinate region_spos_x7 position signless integer.With the macro block is that unit shows the horizontal-shift of the position, the upper left corner of institute's marked region with respect to the position, the upper left corner of image under it.
4) regional location vertical coordinate region_spos_y7 position signless integer.With the macro block is that unit shows the vertical shift of the position, the upper left corner of institute's marked region with respect to the position, the upper left corner of image under it.
5) regional location horizontal coordinate region_epos_x7 position signless integer.With the macro block is that unit shows the vertical shift of the position, the lower right corner of institute's marked region with respect to the position, the upper left corner of image under it.
6) regional location vertical coordinate region_epos_y7 position signless integer.With the macro block is that unit shows the vertical shift of the position, the lower right corner of institute's marked region with respect to the position, the upper left corner of image under it.
(2) " definition of PB image head " among the AVS-P2 is revised as:
pb_picture_header(){ Descriptor
pb_picture_start_code f(32)
bbv_delay u(16)
picture_coding_type u(2)
picture_distance u(8)
if(low_delay==’1’)
bbv_check_times ue(v)
progressive_frame u(1)
if(progressive_frame==’0’){
picture_structure u(1)
if(picture_structure==’0’)
advanced_pred_mode_disable u(1)
}
top_field_first u(1)
repeat_first_field u(1)
fixed_picture_qp u(1)
picture_qp u(6)
if(!(picture_coding_type==’10’&& PictureStructure==1))
picture_reference_flag u(1)
no_forward_reference_flag u(1)
If(roi_enable_flag){
*roi_change_flag u(1)
If(roi_change_flag){
*roi_num u(4)
for(i=0;i<region num;i++){
*region_ID u(4)
*region_spos_x u(7)
*region_spos_y u(7)
*marker_bit f(1)
*region_epos_x u(7)
*region_epos_y u(7)
}
}
}
reserved_bits r(3)
skip_mode_flag u(1)
loop_filter_disable u(1)
if(!loop_filter_disable){
loop_filter_parameter_flag u(1)
if(loop_fi lter_parameter_flag){
alpha_c_offset se(v)
beta_offset se(v)
}
}
next_start_code()
}
(3) " sequence head definition " among the AVS-P2 is revised as:
sequence_header() { Descriptor
video_sequence_start_code f(32)
profile_id u(8)
level_id u(8)
progressive_sequence u(1)
horizontal_size u(14)
vertical_size u(14)
chroma_format u(2)
sample_precision u(3)
aspect_ratio u(4)
frame_rate_code u(4)
bit_rate_lower u(18)
marker_bit f(1)
bit_rate_upper u(12)
low_delay u(1)
marker_bit f(1)
bbv_buffer_size u(18)
*roi_enable_flag u(1)
reserved_bits r(3)
next_start_code()
}
In AVS-P2, increase following content simultaneously in the semantic description of sequence head:
Regional code sign: roi_enable_flag sign.Wherein work as its value for adopting regional code in ' 1 ' the expression video sequence; Value does not adopt regional code for ' 0 ' expression.
The present invention also can be used for other video standard except supporting the AVS-P2 standard, only need carry out the information transmission scheme of corresponding grammar correction in can the standard encoding-decoding process, and it is convenient to realize.

Claims (8)

1. the image information recording method in the encoding video pictures process is characterized in that: writes down following image information content and enrolls the video coding code stream,
(1) at least one rectangular area in the selection piece image, the number in zone selected in record, and write down each regional area I D.
(2) with the macro block be the following information of unit record,
The position, the upper left corner in selected zone with respect to the position, the upper left corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the vertical shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone vertical shift with respect to the position, the upper left corner of image under it;
(3) in the record present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area whether the same.
(4) whether record uses zone marker.
2. image information recording method according to claim 1 is characterized in that: described image is still frame or motion picture.
3. image information recording method according to claim 1 and 2 is characterized in that: if do not use the function of zone marker, then the positional information of the number of rectangular area, each rectangular area and area I D save record.
4. image information recording method according to claim 1 and 2, it is characterized in that: if in the present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area the same, then the positional information of the number of the rectangular area of present image, each rectangular area and area I D save record.
5. the image information extracting method in the video image decoding process is characterized in that: from the video coding code stream, obtains digital picture, from digital picture, extracts following information,
(1) obtains the number of selecting the zone, obtain each regional area I D of record.
(2) be that unit extracts following information with the macro block,
The position, the upper left corner in selected zone with respect to the position, the upper left corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the vertical shift of the position, the upper left corner of image under it, selected zone with respect to the position, the lower right corner in the horizontal-shift of the position, the upper left corner of image under it, selected zone vertical shift with respect to the position, the upper left corner of image under it.
(3) whether the position of the number of rectangular area and each rectangular area is the same in the position that obtains the number of rectangular area in the present image and each rectangular area and the last piece image.
(4) obtain whether use zone marker.
6. image information extracting method according to claim 5 is characterized in that: described digital picture is to have removed the redundant and two field picture that obtains of time domain from the video coding code stream.
7. according to claim 5 or 6 described image information extracting methods, it is characterized in that: if do not use the function of zone marker, then the positional information of the number of rectangular area, each rectangular area and area I D need not obtain.
8. according to claim 5 or 6 described image information extracting methods, it is characterized in that: if in the present image in the position of the number of rectangular area and each rectangular area and the last piece image position of the number of rectangular area and each rectangular area the same, then the positional information of the number of the rectangular area of present image, each rectangular area and area I D need not obtain.
CN2007101690184A 2007-12-26 2007-12-26 An image information recording and extracting method in the process of the encoding and decoding of video images Expired - Fee Related CN101217652B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2007101690184A CN101217652B (en) 2007-12-26 2007-12-26 An image information recording and extracting method in the process of the encoding and decoding of video images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2007101690184A CN101217652B (en) 2007-12-26 2007-12-26 An image information recording and extracting method in the process of the encoding and decoding of video images

Publications (2)

Publication Number Publication Date
CN101217652A true CN101217652A (en) 2008-07-09
CN101217652B CN101217652B (en) 2010-09-29

Family

ID=39624006

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101690184A Expired - Fee Related CN101217652B (en) 2007-12-26 2007-12-26 An image information recording and extracting method in the process of the encoding and decoding of video images

Country Status (1)

Country Link
CN (1) CN101217652B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102438144A (en) * 2011-11-22 2012-05-02 苏州科雷芯电子科技有限公司 Video transmission method
CN101742327B (en) * 2008-11-12 2012-11-28 北京中星微电子有限公司 Video encoding and decoding methods and systems, and region description method and device
WO2021068918A1 (en) * 2019-10-10 2021-04-15 Huawei Technologies Co., Ltd. An encoder, a decoder and corresponding methods for simplifying signalling picture header

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742327B (en) * 2008-11-12 2012-11-28 北京中星微电子有限公司 Video encoding and decoding methods and systems, and region description method and device
CN102438144A (en) * 2011-11-22 2012-05-02 苏州科雷芯电子科技有限公司 Video transmission method
WO2021068918A1 (en) * 2019-10-10 2021-04-15 Huawei Technologies Co., Ltd. An encoder, a decoder and corresponding methods for simplifying signalling picture header

Also Published As

Publication number Publication date
CN101217652B (en) 2010-09-29

Similar Documents

Publication Publication Date Title
RU2674312C2 (en) Information processing device and method
US10880543B2 (en) Image prediction method and device
CN101682793B (en) Creating three dimensional graphics data
JP6102680B2 (en) Encoding device, decoding device, encoded data, encoding method, decoding method, and program
ES2334507T3 (en) PROCESS FOR THE DECOMPRESSION OF VIDEOS BASED ON THE OBJECT USING ARBITRARIATELY CONFORMED FEATURES.
US8514938B2 (en) Picture coding apparatus for a still picture sequence and picture decoding apparatus for a still picture sequence
Ma et al. AVS2? Making video coding smarter [standards in a nutshell]
CN108063976B (en) Video processing method and device
US8249155B2 (en) Transcoder, recorder, and transcoding method
CN105828106B (en) A kind of non-integral multiple frame per second method for improving based on motion information
JP3222496B2 (en) Video signal processing device
CN111837397A (en) Bitstream indication for error concealment in view-dependent video coding based on sub-picture bitstream
CN101180885A (en) Method and apparatus for decoding video signal using reference pictures
CN102724492B (en) Method and system for transmitting and playing video images
CN107835424A (en) A kind of media sync transmission player method based on data perception
JP2010515302A (en) Techniques for content-adaptive video frame slicing and non-uniform access unit coding
JP2015228669A (en) Video processing for majority participation type video conference
US10848837B2 (en) Device and method for processing high-definition 360-degree VR image
US20150195570A1 (en) Method of Texture Dependent Depth Partition
CN101217652B (en) An image information recording and extracting method in the process of the encoding and decoding of video images
US20200244952A1 (en) Video decoding device and video decoding method
US9179155B1 (en) Skipped macroblock video encoding enhancements
TW200423744A (en) Apparatus and method for signal processing of format conversion and combination of video signals
WO2021237569A1 (en) Encoding method, decoding method, apparatus and system
CN105163093A (en) Compressed domain video abstraction extraction method and apparatus facing AVS monitoring gear

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100929

Termination date: 20131226