CN103442248B - A kind of image compression quality appraisal procedure based on binocular stereo vision - Google Patents
A kind of image compression quality appraisal procedure based on binocular stereo vision Download PDFInfo
- Publication number
- CN103442248B CN103442248B CN201310369957.9A CN201310369957A CN103442248B CN 103442248 B CN103442248 B CN 103442248B CN 201310369957 A CN201310369957 A CN 201310369957A CN 103442248 B CN103442248 B CN 103442248B
- Authority
- CN
- China
- Prior art keywords
- compression
- play
- time period
- image
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The invention provides a kind of image quality measure method, it combines binocular stereo vision principle, by adopting binocular fusion technology, under the different compression ratio of same compression algorithm, carry out compression quality assessment for image, and image carries out compression quality assessment under different compression algorithm.
Description
Technical field
The present invention relates to computer vision and image processing techniques, particularly for the appraisal procedure of image compression quality under the different compression ratio of same compression algorithm, and the comparative assessment method of compression quality under different compression algorithm.
Background technology
Picture quality is the important indicator of more various image processing algorithm performance quality and optimization system parameter, therefore sets up effective image quality evaluation mechanism in fields such as IMAQ, compression coding, Internet Transmissions and has great importance.
In the last few years, along with the development of image processing techniques, the research of image quality measure aspect has attracted the extensive concern of researcher, and existing many scientific research institutions and commercial company bound oneself to it both at home and abroad, and the image quality analysis instrument as the development of Imtech of the U.S. is widely used.In addition, also further investigation is expanded as IBM, SK telecommunications group of Korea S etc. with regard to image/video quality evaluation problem.Simultaneously, image quality evaluation algorithm emerges in an endless stream, typical model has based on human visual system (Human VisionSystem, HVS) image quality evaluation model, the evaluation model etc. of structure based similarity (Structural SimilarityImage Measurement, SSIM).SSIM algorithm is incorporated in video encoding standard Knowledge Verification Model H.264 as image quality evaluation index by nearest JVT (Joint Video Team).Domestic also had many mechanisms to be engaged in the research in this field, and achieve related ends.But generally speaking, also have many unknown problems to need to be probed into.
Image quality evaluation can be divided into subjective evaluation method and method for objectively evaluating method, and the former relies on the subjective perception of experimenter to carry out the quality of evaluation object; The quantizating index that the latter provides according to model, simulating human visual system perceives mechanism weighs picture quality.Relative to subjective quality assessment, evaluating objective quality have simple to operate, cost is low, be easy to resolve and embed the advantage such as realization, has become the research emphasis of image quality evaluation.On the other hand, also focus on the combination of subjective evaluation method and method for objectively evaluating in real image application, namely utilize subjective evaluation result to correct the parameter in evaluating objective quality model.
The vision system of the mankind is three-dimensional, there is the impression on the fusion Formation Depth of right and left eyes parallax and right and left eyes, increases the identification capability of the mankind.Stereoscopic vision notes no matter being be obtained for extensive concern on psychology or Neuscience, also the research of many stereoscopic vision aspects is had to be published, be proposed research from aspects such as right and left eyes difference, degree of depth acquisition, retinal rivalry, binocular fusion theoretical, and then the remarkable computational methods of stereoscopic vision are provided support.The remarkable computational methods of stereoscopic vision become a hot research direction of computer vision field research.
Third dimension, telepresenc that image technique based on binocular stereo vision can provide depth information to strengthen image are the developing direction of generation digital medium technique.
Summary of the invention
Object of the present invention is just to provide the evaluation method that a kind of picture quality based on binocular stereo vision is compressed, and for achieving the above object, the present invention takes following technical scheme:
The present invention verifies the psychophysical measurements used in image quality assessment process, comprises the appraisal procedure for image compression quality under the different compression ratio of same compression algorithm, and the comparative assessment method of compression quality under different compression algorithm.According to an aspect of the present invention, provide a kind of picture quality based on binocular stereo vision to compress evaluation method, described method comprises the steps:
Adopt compression algorithm stereoscopic image to compress, obtain the stereo-picture after compression;
By eyes fusion device, binocular fusion is carried out to the stereo-picture after described compression, export and record subjective correlation and perceive number of times; Record the reproduction time of described stereo-picture in binocular fusion process;
Discover number of times and described reproduction time according to described subjective correlation, carry out statistical analysis;
According to the analysis result of described statistical analysis, choose described subjective correlation and discover the compression method of least number of times and compression ratio corresponding with it, thus obtain the compression parameters corresponding to optimal compression quality.
According to an aspect of the present invention, described compression algorithm is DDCT compression algorithm or H.264 compression algorithm.
According to an aspect of the present invention, the stereo-picture after described compression comprises left eye Feature Compression figure and/or right eye Feature Compression figure.
According to an aspect of the present invention, in described compression algorithm, regulate compression parameters, to obtain compressed image corresponding under different compression ratio.
According to an aspect of the present invention, by measure the detailed information of the stereo-picture after described compression loss, direction change and simulation human eye bright adaptation characteristic on the impact of quality perception, draw the distortion metrics of the stereo-picture after described compression
This method is owing to taking above technical scheme, compared with existing single image quality evaluating method, this method is in conjunction with the evaluation of depth information, the calculating means of the stereoscopic vision conspicuousness of the application simple eye receptive field in left and right and binocular fusion, establish the framework of a three-dimensional image objective evaluation model, and ensure that the consistency of model output valve and subjective perception.
Accompanying drawing explanation
Fig. 1 is the flow chart of the picture quality based on binocular stereo vision of the present invention compression appraisal procedure.
Fig. 2 is the schematic flow sheet adopting single compression method to carry out image quality measure in the present invention under different compression ratio.
Fig. 3 is the schematic flow sheet adopting multiple compression method to carry out image quality measure in the present invention.
Embodiment
Below in conjunction with accompanying drawing and example, the present invention is described in detail.
The vision system of the mankind relies on two, left and right eyes to obtain visual information, and corresponding left eye receptive field and right eye receptive field are with a shape but there is certain skew two eyes respectively.Native system is concentrated from compressed picture and is chosen stereo pairs, on the display device left and right view field figure right for image is presented at the right and left of computer screen, is labeled as L (A)-R (A).Wherein, compression collection is according to existing compression algorithm, such as, pictures H.264, after the compression such as DDCT.
Carry out binocular fusion by eyes fusion devices such as stereoscopes, due to binocular parallax, stereoscopic vision can be formed in human brain by the fusion of neural net.By the remarkable computational methods of existing vision, final output and record subjective correlation and perceive number of times, wherein subjective correlation perceive number of times refer to tested by judge aware the fragment whether having fracture in stereotome, and doing button reaction, computer can record tested touch potential and make a decision the mark of correctness.Record the total reproduction time of eyes picture simultaneously.
Based on the picture quality compression appraisal procedure of binocular stereo vision, mainly comprise following three steps: 1) based on receptive field phase difference, obtain left eye characteristic pattern L (A) and the right eye characteristic pattern R (A) of stereotome A.Application H.264, the compression algorithm such as DDCT obtains left eye Feature Compression figure L (A ') and right eye Feature Compression figure R (A ') respectively.In FIG, L (A) represents the left eye characteristic pattern of stereotome A, R (A) represents the right eye characteristic pattern of stereotome A, L (A ') represents the left eye Feature Compression figure into the stereotome A after overcompression process, and R (A ') represents the right eye Feature Compression figure into the stereotome A after overcompression process.L (A)-R (A) in Fig. 1 represents one group of image pair, and namely this image is formed by left eye characteristic pattern L (A) and right eye characteristic pattern R (A); L (A)-R (A ') represents one group of image pair, and namely this image is formed by left eye characteristic pattern L (A) and right eye Feature Compression figure R (A ');
2) binocular fusion: merge the characteristic pattern step of right and left eyes, according to Experiment of Psychology utilizing stereoscope etc. because binocular parallax, can form the object that stereoscopic vision reaches fusion by the fusion of neural net in human brain.
3) statistical computation result is exported.By the response situation after tested viewing, namely record tested button result on keyboard, then apply the remarkable computational methods of existing stereoscopic vision and calculate ratio after output transform shared by zero coefficient and compression ratio.Wherein, when statistical significance there is no other noise jamming, as loss in detail more of piece image, its high fdrequency component be in the transform domain as illustrated zero coefficient more.
In FIG, wherein in binocular fusion step, and L (A)-R (A ') represent that right eye perspective figure is the figure after being compressed by compression algorithm.T1, T2, T3, represent the reproduction time that three kinds of different images are right, the time of T1+T2+T3 is fixing, T1 and T3 can be the identical time period.According in Fig. 1, there are four kinds of method for expressing, such as:
In Fig. 1
expression plays left and right view field figure L (A), the R (A) without compression in the T1 time period, then play left cyclogram L (A) in the T2 time period and by the compressed R of certain compression algorithm (A '), then play left and right view field figure L (A), the R (A) without compression in the T3 time period.
The remarkable computational methods of stereoscopic vision based on the simple eye receptive field in left and right and binocular fusion in vision, by simulating human vision system processing procedure, first set up respectively the simple eye receptive field model in left and right and obtain characteristic of correspondence figure, then melt the result figure of right and left eyes characteristic pattern and different characteristic under contract characteristics, final statistical computation obtains the zero coefficient proportion noted closest to human stereoscopic vision and compression ratio.
Such as, have 4 kinds of situations in FIG, in experiment, random selecting one method is tested, the immediate zero coefficient proportion of final output and compression ratio.
Fig. 2 is for single compression method in the present invention, to the schematic flow sheet that the quality of correspondence image under its different compression ratio is assessed.Specifically,
(1) utilize existing DDCT compression method, regulate compression parameters, compressed image corresponding under obtaining different compression ratio.Way is the root of distortion from compressed image particularly, non-reference picture quality appraisement based on DDCT is estimated, this estimates the loss by metric contraction image detail information, direction changes, and the bright adaptation characteristic of simulation human eye is on the impact of quality perception, finally draws the distortion metrics of image.First the image carrying out encoding is divided into the image block of 8*8, and then carries out local Discrete Cosine change (DCT) to the pixel of each block, then carries out independent quantitative to each DCT coefficient, and eliminates redundancy further by entropy code.
(2) based on binocular stereo vision, according to existing integration technology method, compressed image is made as into stereoscopic image.According to Fig. 1 flow process, the one-tenth stereoscopic image of different compression ratio is concentrated input as stereo pairs A from image compression, then obtains subjective correlation according to the mode of Fig. 1 and discover number of times and reproduction time result.Wherein, in the transform domain of compressed image, the edge detail information of image is mainly reflected on high frequency coefficient, if high frequency coefficient is quantified as zero, must cause the loss of image detail information.When namely there is no other noise jamming in statistical significance, as loss in detail more of piece image, its high fdrequency component be in the transform domain as illustrated zero coefficient more.
(3) the subjective correlation that Fig. 1 flow process draws is discovered number of times and reproduction time result, number of times is perceiveed to correlation and stimulates reproduction time to carry out comprehensive comparative analysis by simple statistical method, if under certain compression ratio, correlation is discovered often, then represent that eyes are better to the tolerance of this compression ratio, this time, corresponding stimulation reproduction time was also shorter.In like manner, otherwise represent that the tolerance of eyes to this compression ratio is poor, namely the effect of compression ratio is poor, then corresponding stimulation reproduction time is just long.
(4) comparative analysis result, chooses correlation and discovers the compression method of least number of times and corresponding compression ratio, thus obtain compression parameters corresponding to optimal compression quality.
Fig. 3 is the method for evaluating quality schematic diagram for correspondence image under multiple compression method in the present invention.Specifically,
Existing different video picture quality compression method being obtained to the compressed image of its correspondence, is finally the form of jpg.As one embodiment of the present of invention, adopt JPG form herein, certainly, other picture format is also fine.Those skilled in the art can adopt the picture format of similar mode to other to process completely, and the form of image can not as the restriction to scope of the present invention.
Based on binocular stereo vision, according to existing integration technology method, compressed image is made into stereoscopic image.
The result of the output of Fig. 1 flow process is perceiveed number of times to correlation and stimulates reproduction time to carry out comprehensive comparative analysis, if correlation to discover expression eyes often better to the tolerance of this compression ratio, this time, corresponding stimulation reproduction time was also shorter.In like manner, otherwise represent that tolerance is poor, namely the effect of compression ratio is poor, then corresponding stimulation reproduction time is just long.
Comparative analysis result, choose under identical compression algorithm correlation discover least number of times compression ratio and the zero coefficient proportion to correspondence, obtain the compression parameters that optimal compression quality is corresponding.
In sum, the present invention proposes a kind of stereo image quality based on binocular stereo vision compression evaluating method, overcome the deficiency that existing picture quality subjective evaluation method and objective method merge mutually.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disc store and optical memory etc.) of computer usable program code.
The present invention describes with reference to according to the flow chart of the method for the embodiment of the present invention, equipment (system) and computer program and/or block diagram.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block diagram and/or square frame and flow chart and/or block diagram and/or square frame.These computer program instructions can being provided to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computer or other programmable data processing device produce device for realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, make on computer or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computer or other programmable devices is provided for the step realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.Although the present invention is with preferred embodiment openly as above, but disclosed example be not used to limit the scope of the invention.Being understood that when not departing from spirit of the present invention, various additional, amendment can being produced at this and replacing.It will be apparent to those of skill in the art that when not departing from spirit of the present invention or intrinsic propesties, and other elements, material and parts can be utilized to realize the present invention with other special shapes, structure, layout, ratio.Those skilled in the art will recognize: the present invention can use structure, layout, ratio, material and the parts and other many amendments that use in invention reality, and these are modified in when not departing from principle of the present invention and are adapted to particular surroundings and operational requirements especially.Therefore, current disclosed embodiment should be understood to illustrative in all respects but not it be asked to the restriction of the scope of protection.
Claims (5)
1., based on a picture quality compression evaluation method for binocular stereo vision, it is characterized in that, described method comprises the steps:
Adopt compression algorithm stereoscopic image to compress, obtain the stereo-picture after compression;
Based on receptive field phase difference, obtain left eye characteristic pattern L (A) and the right eye characteristic pattern R (A) of stereotome A, applied compression algorithm obtains left eye Feature Compression figure L (A ') and right eye Feature Compression figure R (A ') respectively, L (A)-R (A) represents the one group of image be made up of left eye characteristic pattern L (A) and right eye characteristic pattern R (A), L (A)-R (A ') represents the one group of image pair be made up of left eye characteristic pattern L (A) and right eye Feature Compression figure R (A '), L (A ')-R (A ') represents the one group of image pair be made up of left eye Feature Compression figure L (A ') and right eye Feature Compression figure R (A '),
A kind of played in order image pair according in following four kinds of orders:
1: play L (A)-R (A) in the T1 time period, play L (A)-R (A ') in the T2 time period, play L (A)-R (A) in the T3 time period;
2: play L (A ')-R (A ') in the T1 time period, play L (A)-R (A ') in the T2 time period, play L (A ')-R (A ') in the T3 time period;
3: play L (A)-R (A ') in the T1 time period, play L (A)-R (A) in the T2 time period, play L (A)-R (A ') in the T3 time period;
4: play L (A)-R (A ') in the T1 time period, play L (A ')-R (A ') in the T2 time period, play L (A)-R (A ') in the T3 time period;
By eyes fusion device to play image to carrying out binocular fusion, export and record subjective correlation and perceive number of times, described subjective correlation perceives number of times and refers to tested by judging to aware the fragment whether having fracture in stereotome, and doing button reaction, computer can record tested touch potential and make a decision the mark of correctness; Record the reproduction time of described stereo-picture in binocular fusion process;
Number of times is discovered and described reproduction time carries out statistical analysis according to described subjective correlation, described statistical analysis comprises: by the response situation after tested viewing, namely record tested button result on keyboard, then apply the remarkable computational methods of existing stereoscopic vision and calculate ratio after output transform shared by zero coefficient and compression ratio;
According to the result of described statistical analysis, choose described subjective correlation and discover the compression method of least number of times and compression ratio corresponding with it, thus obtain the compression ratio corresponding to optimal compression quality.
2. the picture quality based on binocular stereo vision according to claim 1 compression evaluation method, is characterized in that, described compression algorithm is DDCT compression algorithm or H.264 compression algorithm.
3. the compression of the picture quality based on binocular stereo vision evaluation method according to claim 1, it is characterized in that, the stereo-picture after described compression comprises left eye Feature Compression figure and/or right eye Feature Compression figure.
4. the picture quality based on binocular stereo vision according to claim 2 compression evaluation method, is characterized in that, in described compression algorithm, regulate compression ratio, with compressed image corresponding under obtaining different compression ratio.
5. the compression of the picture quality based on binocular stereo vision evaluation method according to claim 2, it is characterized in that, described method also comprises:
By measure the detailed information of the stereo-picture after described compression loss, direction change and simulation human eye bright adaptation characteristic on the impact of quality perception, draw the distortion metrics of the stereo-picture after described compression.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310369957.9A CN103442248B (en) | 2013-08-22 | 2013-08-22 | A kind of image compression quality appraisal procedure based on binocular stereo vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310369957.9A CN103442248B (en) | 2013-08-22 | 2013-08-22 | A kind of image compression quality appraisal procedure based on binocular stereo vision |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103442248A CN103442248A (en) | 2013-12-11 |
| CN103442248B true CN103442248B (en) | 2015-08-12 |
Family
ID=49695906
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310369957.9A Expired - Fee Related CN103442248B (en) | 2013-08-22 | 2013-08-22 | A kind of image compression quality appraisal procedure based on binocular stereo vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103442248B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105828069B (en) * | 2016-04-06 | 2019-01-18 | 上海交通大学 | A kind of encoder self-adapting regulation method based on subjective quality assessment |
| CN113115040A (en) * | 2021-04-20 | 2021-07-13 | 上海交通大学 | Visual lossless image compression method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102209257A (en) * | 2011-06-17 | 2011-10-05 | 宁波大学 | Stereo image quality objective evaluation method |
| CN102333233A (en) * | 2011-09-23 | 2012-01-25 | 宁波大学 | Stereo image quality objective evaluation method based on visual perception |
-
2013
- 2013-08-22 CN CN201310369957.9A patent/CN103442248B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102209257A (en) * | 2011-06-17 | 2011-10-05 | 宁波大学 | Stereo image quality objective evaluation method |
| CN102333233A (en) * | 2011-09-23 | 2012-01-25 | 宁波大学 | Stereo image quality objective evaluation method based on visual perception |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103442248A (en) | 2013-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102209257B (en) | Stereo image quality objective evaluation method | |
| CN102333233B (en) | Stereo image quality objective evaluation method based on visual perception | |
| CN104243976B (en) | A kind of three-dimensional image objective quality evaluation method | |
| CN104036501B (en) | A kind of objective evaluation method for quality of stereo images based on rarefaction representation | |
| Tamboli et al. | Super-multiview content with high angular resolution: 3D quality assessment on horizontal-parallax lightfield display | |
| CN102547368B (en) | Objective evaluation method for quality of stereo images | |
| CN102843572B (en) | Phase-based stereo image quality objective evaluation method | |
| CN103413298B (en) | A kind of objective evaluation method for quality of stereo images of view-based access control model characteristic | |
| CN104240248B (en) | Method for objectively evaluating quality of three-dimensional image without reference | |
| CN104036502B (en) | A kind of without with reference to fuzzy distortion stereo image quality evaluation methodology | |
| CN104902268B (en) | Based on local tertiary mode without with reference to three-dimensional image objective quality evaluation method | |
| CN104361583B (en) | A kind of method determining asymmetric distortion three-dimensional image objective quality | |
| CN104408716A (en) | Three-dimensional image quality objective evaluation method based on visual fidelity | |
| CN102708567A (en) | Visual perception-based three-dimensional image quality objective evaluation method | |
| CN106791822A (en) | It is a kind of based on single binocular feature learning without refer to stereo image quality evaluation method | |
| CN103442248B (en) | A kind of image compression quality appraisal procedure based on binocular stereo vision | |
| CN102999911B (en) | Three-dimensional image quality objective evaluation method based on energy diagrams | |
| CN105488792B (en) | Based on dictionary learning and machine learning without referring to stereo image quality evaluation method | |
| CN105898279B (en) | A kind of objective evaluation method for quality of stereo images | |
| Shao et al. | Binocular energy response based quality assessment of stereoscopic images | |
| CN105069794B (en) | A kind of total blindness's stereo image quality evaluation method competed based on binocular | |
| CN102737380A (en) | Stereo image quality objective evaluation method based on gradient structure tensor | |
| CN106780432B (en) | A kind of objective evaluation method for quality of stereo images based on sparse features similarity | |
| CN108848365A (en) | A kind of reorientation stereo image quality evaluation method | |
| Jiang et al. | Visual comfort assessment for stereoscopic images based on sparse coding with multi-scale dictionaries |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150812 Termination date: 20190822 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |