CN106791854A - Image Coding, coding/decoding method and device - Google Patents
Image Coding, coding/decoding method and device Download PDFInfo
- Publication number
- CN106791854A CN106791854A CN201611036416.4A CN201611036416A CN106791854A CN 106791854 A CN106791854 A CN 106791854A CN 201611036416 A CN201611036416 A CN 201611036416A CN 106791854 A CN106791854 A CN 106791854A
- Authority
- CN
- China
- Prior art keywords
- region
- treatment
- diminution
- carried out
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of Image Coding, coding/decoding method and device, the coding method includes carrying out region segmentation to original image according to attention rate grade；Attention rate grade according to each region, it is determined whether carry out diminution treatment to respective regions, for needs reduce the region for the treatment of, it is determined that reducing the diminution parameter for the treatment of, diminution treatment is carried out to respective regions according to the diminution parameter for determining；After diminution treatment is carried out to respective regions, Regional Integration is carried out to Zone Full again, obtain integral image, the integral image is encoded, obtain media file.The application reduces data volume after compression by reducing the data volume in some regions in image, and the video quality of important area is being ensured so as to reach, and keeps under conditions of beholder's satisfaction, and compression bit rate is reduced as far as possible, improves reduced overall rate.
Description
Technical field
The present invention relates to coding and decoding technology, espespecially a kind of Image Coding, coding/decoding method and device.
Background technology
360 degree of panoramic videos, panoramic pictures etc., because typically from the imaging results of two or more camera, and
And the part for being rendered on screen when being presented to beholder and only having intercepted in specific window, so rendering display effect
Resolution ratio will be generally below original video resolution ratio.In order to reach actual displayed effect resolution ratio higher, it is desirable to higher
Original resolution, generally requiring the video of 4K, picture could meet demand.
Therefore, 360 degree of videos, photo resolution be high, code check is big, and data volume is huge, can be taken when on the one hand transmitting a large amount of
Internet resources, and to be easily caused display effect not good due to the unstability of network；Storage is used when on the other hand preserving
Capacity is big, can only the relatively short video of storage time on common storage medium.
The content of the invention
In order to solve the above-mentioned technical problem, the invention provides a kind of Image Coding, coding/decoding method and device, can be full
Image code rate is significantly reduced on the premise of sufficient viewing demand.
In order to reach the object of the invention, the invention provides a kind of method for encoding images, including：
Region segmentation is carried out to original image according to attention rate grade；
Attention rate grade according to each region, it is determined whether carry out diminution treatment to respective regions, is carried out for needs
The region for the treatment of is reduced, it is determined that reducing the diminution parameter for the treatment of, respective regions is carried out at diminution according to the diminution parameter for determining
Reason；
After diminution treatment is carried out to respective regions, Regional Integration is carried out to Zone Full again, obtain integral image, it is right
The integral image is encoded, and obtains media file.
Present invention also offers a kind of picture decoding method, including：
Media file is obtained, the media file is decoded, obtain integral image；
The region for having carried out reducing treatment is identified in the integral image, to the region for having carried out reducing treatment
It is amplified, is reduced to reduce the size of before processing；
After being amplified to the region for having carried out diminution treatment, it is original image that Zone Full is reintegrated.
Present invention also offers a kind of picture coding device, including：
One zoning unit, for carrying out region segmentation to original image according to attention rate grade；
One reducing unit, for the attention rate grade according to each region, it is determined whether carried out at diminution to respective regions
Reason, for needs reduce the region for the treatment of, it is determined that the diminution parameter for the treatment of is reduced, according to the diminution parameter for determining to corresponding
Region carries out diminution treatment；
One integral unit, for after the reducing unit carries out diminution treatment to respective regions, again to Zone Full
Regional Integration is carried out, integral image is obtained；
One compression unit, for being encoded to the integral image, obtains media file.
Present invention also offers a kind of picture decoding apparatus, including：
One decompression unit, for obtaining media file, decodes to the media file, obtains integral image；
One recognition unit, for identifying the region for having carried out reducing treatment in the integral image；
One amplifying unit, for being amplified the region for reduce treatment, is reduced to reduce before processing
Size；
One concatenation unit, for after the amplifying unit is amplified to the region for having carried out diminution treatment, inciting somebody to action
It is original image that Zone Full is reintegrated.
Compared with prior art, the present invention includes carrying out region segmentation to original image according to attention rate grade；According to every
The attention rate grade in one region, it is determined whether carry out diminution treatment to respective regions, for needs reduce the region for the treatment of,
It is determined that reducing the diminution parameter for the treatment of, diminution treatment is carried out to respective regions according to the diminution parameter for determining；To respective regions
After carrying out diminution treatment, Regional Integration is carried out to Zone Full again, obtain integral image, the integral image is compiled
Code, obtains media file.The application reduces data volume after compression, so as to reach by reducing the data volume in some regions in image
To the video quality of important area is being ensured, keep under conditions of beholder's satisfaction, compression bit rate is reduced as far as possible, improve overall
Compression ratio.
Other features and advantages of the present invention will be illustrated in the following description, also, the partly change from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
Accompanying drawing is used for providing further understanding technical solution of the present invention, and constitutes a part for specification, with this
The embodiment of application for explaining technical scheme, does not constitute the limitation to technical solution of the present invention together.
Fig. 1 is the flow chart of the method for encoding images of the embodiment of the application one；
Fig. 2 is the schematic diagram of a kind of method that region segmentation is carried out to original image used in the application；
Fig. 3 be the application in image-region carry out reduce treatment schematic diagram；
Fig. 4 is the schematic diagram for being integrated Zone Full after diminution treatment is carried out in the application；
The flow chart of the picture decoding method that Fig. 5 is provided for another embodiment of the application；
The Organization Chart of the picture coding device that Fig. 6 is provided for the another embodiment of the application；
The Organization Chart of the picture decoding apparatus that Fig. 7 is provided for the another embodiment of the application.
Specific embodiment
To make the object, technical solutions and advantages of the present invention become more apparent, below in conjunction with accompanying drawing to the present invention
Embodiment be described in detail.It should be noted that in the case where not conflicting, in the embodiment and embodiment in the application
Feature can mutually be combined.
Can be in the such as one group computer system of computer executable instructions the step of the flow of accompanying drawing is illustrated
Perform.And, although logical order is shown in flow charts, but in some cases, can be with suitable different from herein
Sequence performs shown or described step.
In the prior art, in order to reach the original of the panorama contents such as display resolution higher, panoramic video, panoramic pictures
Resolution ratio generally reaches 4K.Due to original resolution higher, cause the code check of panoramic video, panoramic pictures very big, and
Data volume is huge.It is that each two field picture is encoded using standard code algorithm at present when being encoded to panorama content,
The data volume of the media file that coding is obtained is huge.Provided which results in substantial amounts of network when panorama content is transmitted, can be taken
Source, and in unstable networks, the display effect of panorama content can be caused not good, also, preservation panorama content needs to take
Larger memory space.
Considered in the application for panoramic video, panoramic pictures etc., due to including 360 degree of panorama in a two field picture
Picture, for beholder, in 360 panorama, it is not what beholder was primarily upon to have many regions, for these
Region, beholder simply may have a guide look of and mistake, in some instances it may even be possible to will not be concerned about all the time.Attention rate grade, root are set in the application
According to beholder to the different attention rates of image different zones, different attention rate grades are set to different zones, to attention rate etc.
The relatively low region of level carries out diminution treatment, by reducing the data volume in these regions, reduces the data volume after coding, so as to protect
Hold under conditions of beholder's satisfaction, the reduced overall rate of panorama content is improved as far as possible, reduce code check, reach complete to 360 degree
Scape video, panoramic pictures carry out more efficient treatment and compression.
As shown in figure 1, the method for encoding images that the embodiment of the application one is provided, including：
Step 101：Region segmentation is carried out to original image according to attention rate grade；
Step 102：Attention rate grade according to each region, it is determined whether diminution treatment is carried out to respective regions, for
Needs reduce the region for the treatment of, it is determined that reducing the diminution parameter for the treatment of, respective regions are entered according to the diminution parameter for determining
Row diminution is processed；
Step 103：After diminution treatment is carried out to respective regions, Regional Integration is carried out to Zone Full again, obtain whole
Image is closed, integral image is encoded, obtain media file.
The method for encoding images of the application can apply to encode any image, it is preferred that such as can be to panorama
The panorama content such as video, panoramic pictures is encoded, it is also possible to which common plane picture is encoded.The image of the application is compiled
Code method can be encoded to the panoramic video of the capture apparatus such as panorama camera, moving camera shooting, panoramic pictures, it is also possible to
Cinerama, panorama animation etc. are encoded by the panorama content of professional equipment shooting and producing.
The method for encoding images of the application can be applied in the capture apparatus such as panorama camera, moving camera, set in shooting
Standby shooting is encoded after obtaining panoramic video, panoramic pictures to panoramic video, panoramic pictures.Panorama can also be equally applied to
In the professional video equipment of content, panoramic video, panoramic picture are encoded during the later stage is processed.
Region in order to realize relatively low to the attention rate of image carries out diminution treatment, and multiple concerns are set in the application
Degree grade, region segmentation is carried out further according to attention rate grade to original image.Attention rate refers to beholder to image different zones
The degree of concern, several ranks are quantified as in the application by attention rate.
For example, attention rate grade may be configured as two-stage or three-level etc., but not limited to this.For two feelings of attention rate grade
Condition, can not carry out diminution treatment to the region of the first attention rate grade, and the region to the second attention rate grade reduces
Treatment.Can be that diminution treatment is not carried out to the region of the first attention rate grade when three attention rate grades, to
The region of two attention rate grades and the 3rd attention rate grade carries out diminution treatment using different diminution parameters, such as can be the 3rd
Diminution ratio of the diminution ratio in the region of attention rate grade more than the region of the second attention rate grade.
Can be adopted in the application carries out region segmentation according to attention rate grade to original image with the following method：
(1) FX delimited in the picture, and the FX of delimitation is corresponding with certain attention rate grade, according to fixation
Region carries out region segmentation to original image.
For example, traditionally people compare high generally for the attention rate with the region in oneself sight line horizontal direction, for
The attention rate of directly over oneself or underface is relatively low.So, surface can be marked off with underface for image
Rectangular area is set as the second attention rate grade, and the region of centre is set to the first attention rate grade.
As illustrated in fig. 2, it is assumed that a width of W pixels of image, a height of H pixels, then：
Region 1：{ (0,0), (W, 0), (W, H/4), (0, H/4) }；
Region 3：{ (0,3H/4), (W, 3H/4), (W, H), (0, H) }；
Region 1 and region 3 are the rectangular areas being made up of four lines, can be entered as the region of the second attention rate grade
Row segmentation.
Region 2：{ (0, H/4), (W, H/4), (W, 3H/4), (0,3H/4) }；
Region 2 is the rectangular area being made up of aforementioned four point line, can be carried out as the region of the first attention rate grade
Segmentation.
(2) region of different attention rate grades is identified by image recognition algorithm, region segmentation is carried out.
For example, being identified by background difference method to the moving object in video, the moving object for coming is will identify that
The region at place as the first attention rate grade region, remainder as the second attention rate grade region.
(3) region of the different attention rate grades of user annotation is received, according to the different attention rate grades of user annotation
Region is split by original image.
For example, user by touch UI or mouse action, can draw a circle to approve out the region of different attention rate grades.
After region segmentation is carried out to original image, the attention rate grade according to each region, it is determined whether to respective area
Domain carries out diminution treatment.Diminution treatment is carried out to some or certain several junior regions of attention rate in the application, to closing
The higher ranked region of note degree does not carry out diminution treatment then, therefore, it is necessary to according to different zones correspondence after region segmentation is carried out
Attention rate grade determine whether to carry out diminution treatment to the region.
For example, for setting during two attention rate grades, if it is the first attention rate grade that region is corresponding, really
It is fixed diminution treatment not to be carried out to the region；If it is the second attention rate grade that region is corresponding, it is determined that the region is contracted
Small treatment.When setting three attention rate grades, if it is the first attention rate grade that region is corresponding, it is determined that not right
The region carries out diminution treatment；If it is the second attention rate grade or the 3rd attention rate grade that region is corresponding, it is determined that to this
Region carries out diminution treatment.
For needs reduce the region for the treatment of, the diminution parameter for carrying out reducing treatment is first determined, according still further to determination
Diminution parameter diminution treatment is carried out to respective regions, to reduce resolution ratio, reduce data volume.
When being reduced to image, diminution ratio is bigger, and image quality loss is bigger, but compression ratio is higher, therefore,
Compromise decision can be as needed gone to reduce parameter.Reducing parameter can be corresponding with attention rate grade, and region is being determined
Be would know that after attention rate grade to the region reduce the diminution parameter for the treatment of.Can also be to reducing the choosing of parameter setting one
Scope is selected, such as 0.4~0.6, dynamically can determine diminution parameter in range of choice.
What deserves to be explained is, in order to subsequently can more efficiently carry out standard code, identified contracting to integral image
The diminution parameter of small treatment, need to ensure after diminution treatment is carried out, Zone Full can be integrated into regular shape (such as rectangle) or
Person can be integrated into regular shape after using the filler pixels less than loading threshold value, also, bigger due to reducing ratio, figure
As mass loss is bigger, in order to the picture quality in the region being unlikely to after processing diminution is seriously reduced, the selection of parameter is reduced
Also should ensure that the pixel loss in the region for carrying out reducing treatment is no more than loss amount threshold value.Above-mentioned loading threshold value and loss amount threshold
Value can determine according to actual needs.
When treatment reduce to respective regions according to the diminution parameter for determining, can be carried out using various known methods
Image down treatment.For example, interpolation Zoom method linearly or nonlinearly etc..
For example, for the region division in Fig. 2, by the region 1 and region 3 of the second attention rate grade leniently W, H/4's high
Area reduction is width W/2, the region of H/8 high, that is, region 1 and region 3 be reduced into original 1/2, and it is 2 to reduce parameter.
As shown in figure 3, specifically, assume region 1 reduce after formation zone 1 ', for the pixel (x, y) in region 1 ', its pixel value f '
For：
F ' (x, y)=f (2x, 2y)；
F (2x, 2y) is the pixel value of the pixel (2x, 2y) in region 1.(x, y) is the coordinate value of pixel in region 1 '.
After diminution treatment is carried out to respective regions, Regional Integration is carried out to Zone Full again, obtain integral image.For
Graphics standard coding more efficiently can be carried out, it is necessary to be integrated by the region after diminution and without the region for reducing,
Become the region of the regular shapes such as a rectangle.The rectangular area being integrated into is the figure that standard is carried out for the ease of next step
As compression, the pixel original spatial relationship do not destroyed in regional should be also as far as possible kept in integration process.
For example, for the situation of region division in above-mentioned Fig. 2, as shown in figure 4, region 1 ' and region 3 ' can be placed in into area
The top in domain 2 ', constitutes a rectangular area of W wide high 5/8.As such, it is desirable to compression data volume be just reduced to it is original
62.5%, improve close to 40% equivalent to compression ratio in effect.
After integral image is obtained, so that it may which the integral image is encoded, and obtains media file, so as to complete the application
Method for encoding images.
Standard code, such as H264, H265 etc. can be carried out to integrating figure.
Additionally, in this application, when region segmentation is carried out to original image according to attention rate grade, also record is split
The level of interest information and the original position-information in original image in each region.
To each region for splitting, original position-information can be with (or counterclockwise) direction clockwise, and region is taken turns
The mode of wide Extreme points set is described, for example Contour={ ContourPointNum=n, P1(x1,y1),P2(x2,y2),
P3(x3,y3),…,Pn(xn,yn), wherein each end points is sequentially connected with the region for constituting closure.
For example, for the region division in Fig. 2, the level of interest information and original position-information in each region can be remembered
Record and be：
It is determined that after the diminution parameter for reducing treatment, also recording the diminution parameter of respective regions；Again to Zone Full
After carrying out Regional Integration, positional information after integration of each region in integral image is also recorded.
For example, for the region division in Fig. 2, above- mentioned information record is as follows：
When being encoded to integral image, also by attention rate class information, original position-information, the diminution in each region
Positional information saves as the additional information of media file after parameter and integration.For example, additional information can be stored in multimedia file
Container floor.Such as, for MP4 files, similar to video/audio/caption information, also MDAT Box can be stored in as track bar.
The method for encoding images that the application is provided, to image and panoramic pictures in image, especially panoramic video, according to
Attention rate grade classification region, is reached using the pretreatment for reducing resolution ratio to the junior region of attention rate and ensures important
The video quality in region reduces the purpose of compression bit rate simultaneously.
As shown in figure 5, the picture decoding method that the application is provided, including：
Step 501：Media file is obtained, media file is decoded, obtain integral image；
Step 502：The region for having carried out reducing treatment is identified in integral image, the region to reduce treatment
It is amplified, is reduced to reduce the size of before processing；
Step 503：After region to having carried out diminution treatment is amplified, it is original graph that Zone Full is reintegrated
Picture.
In the application, it is necessary to be decoded to media file first after media file is got, can be using standard
Image data decoding method is decompressed, and integral image is obtained to media file decoding.
When media file is obtained, the additional information of media file is also obtained simultaneously, original image is included in additional information
The attention rate class information in each region, original position-information, reduce parameter and integrate after positional information.
After integral image is obtained, in order to integral image is reduced into original image, it is necessary to be identified in integral image
Reduce the region for the treatment of.
Optionally, being identified in integral image in the application has carried out the region of diminution treatment, including：According to additional letter
Positional information identifies each region in integral image after the integration in each region included in breath, further according to each region
Attention rate class information determine carried out reduce treatment region.It is to attention rate etc. when being encoded in the application
The relatively low region of level carries out diminution treatment, and the region higher ranked to attention rate does not carry out diminution treatment, therefore, in decoding,
Can according to the attention rate grade in region determine which be carried out reduce treatment region, which is not carry out diminution treatment
Region.
After the region for having carried out reducing treatment is identified from integral image, the region to reduce treatment is carried out
Amplify, be reduced to reduce the size of before processing.Optionally, the region for reduce treatment is amplified in the application, is wrapped
Include：According to the corresponding diminution parameter in region for reduce treatment, amplifying parameters are determined, according to the amplifying parameters pair for determining
The region for reduce treatment is amplified.
It is that the region amplification that will have been reduced is reduced to original chi when the region to having carried out diminution treatment is amplified
It is very little, amplifying parameters can be accordingly determined according to the diminution parameter that diminution treatment used is carried out, further according to amplifying parameters pair
The region for having reduced treatment is enlarged into original size.
For example, for the region division mode in Fig. 2, by the region 1 ' of the second attention rate grade and region 3 ' leniently W/2,
The region of H/8 high is enlarged into W wide, the region of H/4 high.Specifically, assuming formation zone 1, the pixel in region 1 after the amplification of region 1 '
The pixel value f of (x, y) is：
F (x, y)=f ' (x/2, y/2)；
F ' (x/2, y/2) is the pixel value of the pixel (x/2, y/2) in region 1 '.
If x/2 be non-integer, y/2 is integer, then f ' (x/2, y/2)=[(f ' ([x/2], y/2)+f ' ([x/2]+1,
))/2], y/2 wherein symbol " [] " expression is rounded to the decimal in [].
If x/2 is integer, y/2 is non-integer, then f ' (x/2, y/2)=[(f ' (x/2, [y/2])+f ' (x/2, [y/2]
+ 1))/2], wherein symbol " [] " expression is rounded to the decimal in [].
If x/2, y/2 are non-integer, then f ' (x/2, y/2)=[(f ' ([x/2], [y/2])+f ' ([x/2]+1, [y/
2])+f ' ([x/2], [y/2]+1)+f ' ([x/2]+1, [y/2]+1))/4], wherein symbol " [] " represents and the decimal in [] is taken
It is whole.
After region to having carried out diminution treatment is amplified, then it is original image that Zone Full is reintegrated, so far
Decoding operate is completed, original image has been acquired.Optionally, in the application, it is original image that Zone Full is reintegrated,
Including：According to the corresponding original position-information in each region, Zone Full is integrated into original image again.
Position of each region in original image is indicated by original position-information, in the area to reduce treatment
After domain amplification is reduced to original size, regional splicing can be obtained by original image according to original position-information.
For example, for the region partitioning method in Fig. 2, the region 1 and region 3 that will be recovered according to original position-information
The upper and lower of region 2 is respectively placed in, split goes out original image.
As shown in fig. 6, present invention also provides a kind of picture coding device, including：
One zoning unit, for carrying out region segmentation to original image according to attention rate grade；
One reducing unit, for the attention rate grade according to each region, it is determined whether carried out at diminution to respective regions
Reason, for needs reduce the region for the treatment of, it is determined that the diminution parameter for the treatment of is reduced, according to the diminution parameter for determining to corresponding
Region carries out diminution treatment；
One integral unit, for after reducing unit carries out diminution treatment to respective regions, being carried out to Zone Full again
Regional Integration, obtains integral image；
One compression unit, for being encoded to integral image, obtains media file.
Further, above-mentioned zoning unit, is additionally operable to when region segmentation is carried out to original image according to attention rate grade, note
Record the level of interest information and the original position-information in original image in each region of segmentation；
Above-mentioned reducing unit, is additionally operable to it is determined that after the diminution parameter for reducing treatment, recording the diminution parameter of respective regions；
Above-mentioned integral unit, is additionally operable to after Regional Integration is carried out to Zone Full again, records each region and is integrating
Positional information after integration in image；
Above-mentioned compression unit, is additionally operable to when being encoded to integral image, by the attention rate class information in each region,
Original position-information, reduce parameter and integrate after positional information save as the additional information of media file.
Further, when it is determined that reducing the diminution parameter for the treatment of, need to ensure after diminution treatment is carried out, Zone Full can
It is integrated into regular shape or regular shape can be integrated into after using the filler pixels less than loading threshold value, and ensures
The pixel loss for carrying out the region of diminution treatment is no more than loss amount threshold value.
As shown in fig. 7, present invention also provides a kind of picture decoding apparatus, including：
One decompression unit, for obtaining media file, decodes to media file, obtains integral image；
One recognition unit, for identifying the region for having carried out reducing treatment in integral image；
One amplifying unit, for being amplified to the region for reduce treatment, is reduced to reduce the size of before processing；
One concatenation unit, for after amplifying unit is amplified to the region for having carried out diminution treatment, by Zone Full
It is original image to reintegrate.
Further, above-mentioned decompression unit, is additionally operable to be obtained when media file is obtained the additional information of media file,
The attention rate class information in each region comprising original image, original position-information, diminution parameter and integration in additional information
Positional information afterwards；
Above-mentioned recognition unit identifies the region for having carried out reducing treatment in integral image, including：According to position after integration
Confidence breath identifies each region in integral image, and the attention rate class information further according to each region is determined and contracted
The region of small treatment；
Above-mentioned amplifying unit is amplified to the region for reduce treatment, including：According to having carried out reducing treatment
The corresponding diminution parameter in region, determines amplifying parameters, and the region for reduce treatment is entered according to the amplifying parameters for determining
Row amplifies；
It is original image that above-mentioned concatenation unit reintegrates Zone Full, including：It is corresponding original according to each region
Positional information, is integrated into original image by Zone Full again.
Although disclosed herein implementation method as above, described content be only readily appreciate the present invention and use
Implementation method, is not limited to the present invention.Technical staff in any art of the present invention, is taken off the present invention is not departed from
On the premise of the spirit and scope of dew, any modification and change, but the present invention can be carried out in the form and details implemented
Scope of patent protection, must be still defined by the scope of which is defined in the appended claims.
Claims (10)
1. a kind of method for encoding images, it is characterised in that including：
Region segmentation is carried out to original image according to attention rate grade；
Attention rate grade according to each region, it is determined whether carry out diminution treatment to respective regions, reduces for needs
Respective regions, it is determined that reducing the diminution parameter for the treatment of, diminution treatment are carried out according to the diminution parameter for determining by the region for the treatment of；
After diminution treatment is carried out to respective regions, Regional Integration is carried out to Zone Full again, integral image is obtained, to described
Integral image is encoded, and obtains media file.
2. method according to claim 1, it is characterised in that methods described also includes：
When region segmentation is carried out to original image according to attention rate grade, the level of interest letter in each region of segmentation is also recorded
Breath and the original position-information in original image；
It is determined that after the diminution parameter for reducing treatment, also recording the diminution parameter of respective regions；
After Regional Integration is carried out to Zone Full again, position letter after integration of each region in integral image is also recorded
Breath；
When being encoded to the integral image, also by attention rate class information, original position-information, the diminution in each region
Positional information saves as the additional information of media file after parameter and integration.
3. method according to claim 1 and 2, it is characterised in that：
When it is determined that reducing the diminution parameter for the treatment of, need to ensure after diminution treatment is carried out, Zone Full can be integrated into rule
Shape can be integrated into regular shape after using the filler pixels less than loading threshold value, and guarantee is carried out at diminution
The pixel loss in the region of reason is no more than loss amount threshold value.
4. a kind of picture decoding method, it is characterised in that including：
Media file is obtained, the media file is decoded, obtain integral image；
The region for having carried out reducing treatment is identified in the integral image, the region for reduce treatment is carried out
Amplify, be reduced to reduce the size of before processing；
After being amplified to the region for having carried out diminution treatment, it is original image that Zone Full is reintegrated.
5. method according to claim 4, it is characterised in that：
When media file is obtained, the additional information of media file is also obtained, it is every comprising original image in the additional information
The attention rate class information in one region, original position-information, reduce parameter and integrate after positional information；
Described being identified in the integral image has carried out the region of diminution treatment, including：Existed according to positional information after integration
Each region is identified in integral image, the attention rate class information further according to each region is determined and carried out reducing treatment
Region；
It is described that the region for reduce treatment is amplified, including：According to the region correspondence for reduce treatment
Diminution parameter, determine amplifying parameters, according to determine amplifying parameters to it is described carried out reduce treatment region put
Greatly；
Described reintegrate Zone Full is original image, including：According to the corresponding original position-information in each region, again
Zone Full is integrated into original image.
6. a kind of picture coding device, it is characterised in that including：
One zoning unit, for carrying out region segmentation to original image according to attention rate grade；
One reducing unit, for the attention rate grade according to each region, it is determined whether respective regions are carried out with diminution treatment is right
In the region for needing to carry out reducing treatment, it is determined that the diminution parameter for the treatment of is reduced, according to the diminution parameter for determining to respective regions
Carry out diminution treatment；
One integral unit, for after the reducing unit carries out diminution treatment to respective regions, being carried out to Zone Full again
Regional Integration, obtains integral image；
One compression unit, for being encoded to the integral image, obtains media file.
7. device according to claim 6, it is characterised in that：
The zoning unit, is additionally operable to when region segmentation is carried out to original image according to attention rate grade, and it is every that record is split
The level of interest information and the original position-information in original image in one region；
The reducing unit, is additionally operable to it is determined that after the diminution parameter for reducing treatment, recording the diminution parameter of respective regions；
The integral unit, is additionally operable to after Regional Integration is carried out to Zone Full again, records each region in integral image
In integration after positional information；
The compression unit, is additionally operable to when being encoded to the integral image, by the attention rate class information in each region,
Original position-information, reduce parameter and integrate after positional information save as the additional information of media file.
8. the device according to claim 6 or 7, it is characterised in that：
When it is determined that reducing the diminution parameter for the treatment of, need to ensure after diminution treatment is carried out, Zone Full can be integrated into rule
Shape can be integrated into regular shape after using the filler pixels less than loading threshold value, and guarantee is carried out at diminution
The pixel loss in the region of reason is no more than loss amount threshold value.
9. a kind of picture decoding apparatus, it is characterised in that including：
One decompression unit, for obtaining media file, decodes to the media file, obtains integral image；
One recognition unit, for identifying the region for having carried out reducing treatment in the integral image；
One amplifying unit, for being amplified to the region for reduce treatment, is reduced to reduce the size of before processing；
One concatenation unit, for after the amplifying unit is amplified to the region for having carried out diminution treatment, by all
It is original image that region is reintegrated.
10. device according to claim 9, it is characterised in that：
The decompression unit, is additionally operable to be obtained when media file is obtained the additional information of media file, the additional information
In the attention rate class information in each region comprising original image, original position-information, reduce parameter and integrate after position letter
Breath；
The recognition unit identifies the region for having carried out reducing treatment in the integral image, including：According to position after integration
Confidence breath identifies each region in integral image, and the attention rate class information further according to each region is determined and contracted
The region of small treatment；
The amplifying unit is amplified to the region for reduce treatment, including：According to having carried out reducing treatment
The corresponding diminution parameter in region, determines amplifying parameters, according to the amplifying parameters for determining to the area for having carried out reducing treatment
Domain is amplified；
It is original image that the concatenation unit reintegrates Zone Full, including：According to the corresponding home position in each region
Information, is integrated into original image by Zone Full again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611036416.4A CN106791854B (en) | 2016-11-22 | 2016-11-22 | Image coding, coding/decoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611036416.4A CN106791854B (en) | 2016-11-22 | 2016-11-22 | Image coding, coding/decoding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106791854A true CN106791854A (en) | 2017-05-31 |
| CN106791854B CN106791854B (en) | 2019-11-29 |
Family
ID=58971088
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611036416.4A Active CN106791854B (en) | 2016-11-22 | 2016-11-22 | Image coding, coding/decoding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106791854B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109194923A (en) * | 2018-10-18 | 2019-01-11 | 眸芯科技（上海）有限公司 | Video image processing apparatus, system and method based on non-uniformed resolution ratio |
| CN109587495A (en) * | 2018-11-05 | 2019-04-05 | 深圳威尔视觉传媒有限公司 | Method for video coding, device, equipment and storage medium |
| CN110572656A (en) * | 2019-09-19 | 2019-12-13 | 北京视博云科技有限公司 | coding method, image processing method, device and system |
| CN112655210A (en) * | 2018-06-08 | 2021-04-13 | 索尼互动娱乐股份有限公司 | Fast target region coding using multi-segment resampling |
| WO2021204000A1 (en) * | 2020-04-10 | 2021-10-14 | 华为技术有限公司 | Remote image processing method and apparatus |
| CN113630622A (en) * | 2021-06-18 | 2021-11-09 | 中图云创智能科技(北京)有限公司 | Panoramic video image processing method, server, target device, apparatus and system |
| CN113645500A (en) * | 2021-10-15 | 2021-11-12 | 北京蔚领时代科技有限公司 | Virtual reality video stream data processing system |
| CN114697693A (en) * | 2022-03-21 | 2022-07-01 | 联想(北京)有限公司 | Data processing method and device, storage medium and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110286530A1 (en) * | 2009-01-26 | 2011-11-24 | Dong Tian | Frame packing for video coding |
| CN102348116A (en) * | 2010-08-03 | 2012-02-08 | 株式会社理光 | Video processing method, video processing device and video processing system |
| CN102905136A (en) * | 2012-10-29 | 2013-01-30 | 安科智慧城市技术（中国）有限公司 | Video coding and decoding method and system |
| CN103916699A (en) * | 2012-12-31 | 2014-07-09 | 德州仪器公司 | System and method for generating 360 degree video recording using MVC |
| CN105027160A (en) * | 2013-01-28 | 2015-11-04 | 微软技术许可有限责任公司 | Spatially adaptive video coding |
-
2016
- 2016-11-22 CN CN201611036416.4A patent/CN106791854B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110286530A1 (en) * | 2009-01-26 | 2011-11-24 | Dong Tian | Frame packing for video coding |
| CN102348116A (en) * | 2010-08-03 | 2012-02-08 | 株式会社理光 | Video processing method, video processing device and video processing system |
| CN102905136A (en) * | 2012-10-29 | 2013-01-30 | 安科智慧城市技术（中国）有限公司 | Video coding and decoding method and system |
| CN103916699A (en) * | 2012-12-31 | 2014-07-09 | 德州仪器公司 | System and method for generating 360 degree video recording using MVC |
| CN105027160A (en) * | 2013-01-28 | 2015-11-04 | 微软技术许可有限责任公司 | Spatially adaptive video coding |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112655210A (en) * | 2018-06-08 | 2021-04-13 | 索尼互动娱乐股份有限公司 | Fast target region coding using multi-segment resampling |
| CN109194923A (en) * | 2018-10-18 | 2019-01-11 | 眸芯科技（上海）有限公司 | Video image processing apparatus, system and method based on non-uniformed resolution ratio |
| CN109194923B (en) * | 2018-10-18 | 2023-08-29 | 眸芯科技（上海）有限公司 | Video image processing device, system and method based on local non-uniform resolution |
| CN109587495A (en) * | 2018-11-05 | 2019-04-05 | 深圳威尔视觉传媒有限公司 | Method for video coding, device, equipment and storage medium |
| CN110572656A (en) * | 2019-09-19 | 2019-12-13 | 北京视博云科技有限公司 | coding method, image processing method, device and system |
| CN110572656B (en) * | 2019-09-19 | 2021-11-19 | 江苏视博云信息技术有限公司 | Encoding method, image processing method, device, system, storage medium and equipment |
| CN113518249B (en) * | 2020-04-10 | 2023-03-10 | 华为技术有限公司 | Far-end image processing method and device |
| WO2021204000A1 (en) * | 2020-04-10 | 2021-10-14 | 华为技术有限公司 | Remote image processing method and apparatus |
| CN113518249A (en) * | 2020-04-10 | 2021-10-19 | 华为技术有限公司 | Far-end image processing method and device |
| CN113630622A (en) * | 2021-06-18 | 2021-11-09 | 中图云创智能科技(北京)有限公司 | Panoramic video image processing method, server, target device, apparatus and system |
| CN113630622B (en) * | 2021-06-18 | 2024-04-26 | 中图云创智能科技(北京)有限公司 | Panoramic video image processing method, server, target equipment, device and system |
| CN113645500B (en) * | 2021-10-15 | 2022-01-07 | 北京蔚领时代科技有限公司 | Virtual reality video stream data processing system |
| CN113645500A (en) * | 2021-10-15 | 2021-11-12 | 北京蔚领时代科技有限公司 | Virtual reality video stream data processing system |
| CN114697693A (en) * | 2022-03-21 | 2022-07-01 | 联想(北京)有限公司 | Data processing method and device, storage medium and electronic equipment |
| CN114697693B (en) * | 2022-03-21 | 2023-09-19 | 联想(北京)有限公司 | Data processing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106791854B (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106791854B (en) | Image coding, coding/decoding method and device | |
| JP7039668B2 (en) | Image data encapsulation | |
| US7085420B2 (en) | Text detection in continuous tone image segments | |
| US8594449B2 (en) | MPEG noise reduction | |
| JP2021119713A (en) | Encapsulation of image data | |
| CN112561766B (en) | Image steganography and extraction method and device and electronic equipment | |
| Al-Ani et al. | Video compression algorithm based on frame difference approaches | |
| US8630500B2 (en) | Method for the encoding by segmentation of a picture | |
| US20190279684A1 (en) | Image processing apparatus that generates a still image file from a moving image file, image processing method, and storage medium | |
| KR20210066653A (en) | Electronic apparatus and control method thereof | |
| US20190114805A1 (en) | Palette coding for color compression of point clouds | |
| KR101551915B1 (en) | Device and method for video compression | |
| US8243824B2 (en) | Information processing apparatus and method | |
| US9237350B2 (en) | Image processing system with random access capable integral image compression and method of operation thereof | |
| KR20170053714A (en) | Systems and methods for subject-oriented compression | |
| US10999582B1 (en) | Semantically segmented video image compression | |
| CN110958460B (en) | Video storage method and device, electronic equipment and storage medium | |
| WO2022268181A1 (en) | Video enhancement processing methods and apparatus, electronic device and storage medium | |
| Liu et al. | A real-time video watermarking algorithm for authentication of small-business wireless surveillance networks | |
| US20190114807A1 (en) | Method for compression of 360 degree content and electronic device thereof | |
| CN113099237B (en) | Video processing method and device | |
| CN106303366B (en) | Video coding method and device based on regional classification coding | |
| Pokorny | Lossy Compression in the Chroma Subsampling Process | |
| US9571839B2 (en) | Image compression and lossless reconstruction of digital image | |
| CN112911299B (en) | Video code rate control method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |