CN102984538B - Device and method for three-dimensional image processing - Google Patents
Device and method for three-dimensional image processing Download PDFInfo
- Publication number
- CN102984538B CN102984538B CN201110266219.2A CN201110266219A CN102984538B CN 102984538 B CN102984538 B CN 102984538B CN 201110266219 A CN201110266219 A CN 201110266219A CN 102984538 B CN102984538 B CN 102984538B
- Authority
- CN
- China
- Prior art keywords
- sprite
- mentioned
- interdependent
- basic
- stereoscopic image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Provided are a device and a method for three-dimensional image processing. The device is suitable for processing three-dimensional image data, wherein the three-dimensional image data comprise a base sprite and a dependency sprite. The device comprises an image detecting unit, an image compensation unit and a display device, wherein the image detecting unit is used for detecting the three-dimensional image data and obtaining the base sprite and the dependency sprite; the image compensation unit achieves image compensation for the dependency sprite according to the base sprite to produce a compensation dependency sprite; and the display device achieves the three-dimensional image data according to the base sprite and the compensation dependency sprite. According to the device, image differences between an image corresponding to a left eye and an image corresponding to a right eye are reduced, and a user can see smooth and clear three-dimensional images.
Description
Technical field
The present invention relates to a kind of image processing apparatus and method, particularly relate to a kind of image processing apparatus and method of stereo-picture optimisation technique.
Background technology
Due to human body left eye mend the image grasped and right eye to mend the image grasped be different, and the anaglyph that left eye and right eye are seen is separate, therefore left eye and right eye see the different distances recognizing object of image, and produce the effect of stereo-picture.At present in order to make image produce three-dimensional effect, the image at two different visual angles must be provided respectively to right and left eyes, to produce the image with parallax, and persisting and the characteristic of aforementioned parallax due to human vision, therefore can three-dimensional image effect be reached.
Because stereoscopic image data has the view data of two different visual angles, therefore stereoscopic image data size is usually than being greater of view data of general closed planar image, in order to reduce the space shared by view data, usually can compress to deposit to view data, common Image Data Compression form has MPEG-1, MPEG-2, ..., MPEG-4 etc., also therefore the sprite of more image information and the sprite of less image information may be comprised in stereoscopic image data, for example, correspond to the view data of left eye and correspond to the view data of right eye in Blu-ray Disc three-dimensional image video form (MPEG-4 Multiview Video Coding), be divided into substrate picture (base view) and interdependent picture (dependentview), and interdependent picture produced by carrying out predictive pictures to substrate picture, the image quality can understanding substrate picture is higher relative to interdependent picture, also there is more image information.
Therefore the image of different compression ratio may be mingled with in the broadcasting of a stereo-picture, the phenomenon such as picture sharpness decline, color of image deviation etc. of the distortion that Image Data Compression causes, cause user easily in time watching stereo-picture, to feel uncomfortable or image blurring unclear.
Summary of the invention
In order to solve the problem of prior art, the present invention is a kind of stereoscopic image processing device, be applicable to process one stereoscopic image data, wherein above-mentioned stereoscopic image data comprises a basic sprite and an interdependent sprite, comprise: an image detecting element, in order to detect above-mentioned stereoscopic image data and to obtain above-mentioned basic sprite and above-mentioned interdependent sprite; One image compensation unit, carries out frame compensation to produce the interdependent sprite of a compensation according to above-mentioned basic sprite to above-mentioned interdependent sprite; And a display unit, stereoscopic image data is compensated according to above-mentioned basic sprite and the interdependent sprite display one of above-mentioned compensation, wherein above-mentioned basic sprite and above-mentioned interdependent sprite visually form a stereo-picture, and above-mentioned basic sprite has more image detail relative to above-mentioned interdependent sprite.
The present invention also discloses a kind of stereoscopic image processing method, be applicable to process one stereoscopic image data, wherein above-mentioned stereoscopic image data comprises a basic sprite and an interdependent sprite, comprise: detect above-mentioned stereoscopic image data and obtain above-mentioned basic sprite and above-mentioned interdependent sprite, wherein above-mentioned basic sprite and above-mentioned interdependent sprite visually form a stereo-picture, and above-mentioned basic sprite has more image detail relative to above-mentioned interdependent sprite; According to above-mentioned basic sprite, frame compensation is carried out to produce the interdependent sprite of a compensation to above-mentioned interdependent sprite; And compensate stereoscopic image data according to above-mentioned basic sprite and the interdependent sprite display one of above-mentioned compensation.
The present invention reduces the image difference between the image of corresponding left eye in stereo-picture and the image of corresponding right eye, allows user can watch more smooth-going and stereo-picture clearly.
Accompanying drawing explanation
By reading the following citing describing in detail and coordinate appended accompanying drawing, can more completely understand disclosed by the present invention, as follows:
Fig. 1 is the block diagram of the stereoscopic image processing device 100 of display according to one embodiment of the invention.
One embodiment of Fig. 2 display base sprite and interdependent sprite.
The operational flowchart of the stereoscopic image processing device 100 of Fig. 3 display according to one embodiment of the invention.
Wherein, description of reference numerals is as follows:
100 ~ stereoscopic image processing device;
110 ~ image detecting element;
120 ~ image compensation unit;
130 ~ display unit;
Bb ~ basic sprite block;
Bb1, Bb2 ~ block;
Bd ~ interdependent sprite block;
D ~ stereoscopic image data;
Dc ~ compensation stereoscopic image data;
Fb ~ basic sprite;
Fd ~ interdependent sprite;
L1, L2 ~ dotted line.
Embodiment
Below describe the many embodiments completed by means of the present invention of display.Its describe in order to basic conception of the present invention is described and without limit connotation.Scope of the present invention has best defining in the scope of appended claim.
Fig. 1 is the block diagram of the stereoscopic image processing device 100 of display according to one embodiment of the invention.Stereoscopic display device 100 according to one embodiment of the invention, has image detecting element 110, image compensation unit 120 and display unit 130.Image detecting element 110 detects two sprites of the sprite of corresponding left eye in stereoscopic image data D and the sprite of corresponding right eye, to obtain sprite Fb based on the sprite wherein with more image detail, the sprite with less image detail is interdependent sprite Fd.Image compensation unit 120, compensates detected basic sprite Fb interdependent sprite Fd, and basic sprite Fb and the interdependent sprite Fd after compensating, as compensating image data Dc, is sent to display unit 130.Display unit 130 is in order to export compensating image data Dc.Reduce the image difference between the image of corresponding left eye in stereo-picture and the image of corresponding right eye whereby, allow user can watch more smooth-going and stereo-picture clearly.
In some embodiments of the invention, in order to obtain in stereoscopic image data D, there is the more sprite of image information, two sprites of the sprite of the sprite of corresponding left eye and corresponding right eye can be carried out the process of high-pass filtering by image detecting element 110 respectively, strengthen the image detail of two sprites whereby, then binary conversion treatment is carried out again, in by sprite binaryzation, the pixel gray level degree being greater than set critical grey decision-making can be set to shade of gray maximum, the pixel gray level degree being less than set critical grey decision-making is set to shade of gray minimum, because the more sprite of details is after high-pass filtering, its detail section can be strengthened, therefore be greater than set critical grey decision-making can be more, therefore two sprites amount of detail separately can be tried to achieve further after binary conversion treatment, more simply can judge the sprite that image detail is more and the less sprite of image detail, such as by all quantity being set to shade of gray maximum of calculating two sprites to compare, a fairly large number of sprite then based on sprite Fb, less sprite is then interdependent sprite Fd.Though process with high-pass filtering and binaryzation two sprites and compare in above-described embodiment, in the hope of the sprite of more image detail, but the present invention is not restricted to this, still can directly compare by the result after high-pass filtering, or by comparing the data that other can represent sub-screen image amount of detail, such as, compression ratio etc.We can differentiate in Blu-ray Disc three-dimensional image video form or multi-vision angle video image compressed format (Multiview Video Coding) and correspond to the view data of left eye and correspond to the view data of right eye whereby, classification whichever be have compared with multiple image details substrate picture and there is the interdependent picture of less picture image details, and carry out the compensation of picture whereby.
Basic sprite Fb detected by image detecting element 110 has more image detail than interdependent sprite Fd, and all correspond to identical stereo-picture picture, therefore image compensation unit 120 can by extracting image information relevant in basic sprite Fb to compensate interdependent sprite Fd, then using basic sprite Fb and compensate after interdependent sprite Fd as compensating image data Dc, whereby to promote image detail and the definition of interdependent sprite Fd.
As shown in Figure 2, because basic sprite Fb and interdependent sprite Fd corresponds to identical stereo-picture, a stereo-picture block in the stereo-picture that user sees, also corresponds to a basic sprite block Bb in a basic sprite Fb and interdependent sprite block Bd in interdependent sprite Fd respectively.Owing to allowing user see stereo-picture by the horizontal parallax of two pictures, the block of zones of different in two sprites, the vector of horizontal displacement may be different, to present different three-dimensional image effects (such as, concave or convex).
And in order to make basic sprite block Bb correctly can compensate to corresponding interdependent sprite block Bd, in some embodiments of the invention, image detecting element 110 further finds out the interdependent sprite Fd corresponding to an interdependent sprite block Bd in interdependent sprite Fd in basic sprite Fb.For example, image detecting element 110 first obtains the pixel data of interdependent sprite block Bd, then to the upper multiple block in the upright position (region as in Fig. 2 between dotted line L1 and L2) that basic sprite Fb is identical (such as, block Bb1, Bb2 etc.) compare, then the block that wherein difference is minimum can be found, then definable sprite block Bb based on it.In certain embodiments, the pixel value difference of multiple blocks of varying level position on the sustainable upright position identical with basic sprite Fb by the interdependent sprite block Bd of calculating, find out the minimum corresponding block of difference according to the difference result of multiple correspondence, basic sprite block Bb can be obtained.Image compensation unit 120 can be avoided whereby, when compensating interdependent sprite block Bd, use the basic sprite block of mistake, and causing the interdependent sprite block Bd after compensation to become distortion or distortion.
In some embodiments of the invention, image compensation unit 120, the compensation of picture sharpness can be carried out to interdependent sprite block Bd according to basic sprite block Bb, for example, filter can be strengthened (such as by details, gradient strengthening filtering) by after basic sprite block Bb filtering, more filtered basic sprite block Bb is added interdependent sprite block Bd, to increase its picture sharpness.Then sprite blocks all in interdependent sprite Fd can be carried out above-mentioned compensation, to complete the compensation of interdependent sprite Fd.
In some embodiments of the invention, image compensation unit 120, the color of picture or the compensation of colour temperature can be carried out to interdependent sprite Fd according to basic sprite Fb, for example, image compensation unit 120 calculates its mean value after being added up by basic color pixel value multiple in basic sprite Fb, to produce average basal color pixel value, in like manner, its mean value is calculated, to produce mean-contingency color pixel value after interdependent color pixel value multiple in interdependent sprite Fd being added up.Then the color pixel mean difference of mean-contingency color pixel value in the hope of two sprites is deducted by average basal color pixel value, the last again color pixel mean difference that basis is tried to achieve is added to each interdependent color pixel value in interdependent sprite Fd, reduces the heterochromia of interdependent sprite Fd and basic sprite Fb whereby.In addition, divide due to general color pixel and make RGB tri-kinds of numerical value, therefore image compensation unit 120 by aforesaid way, can compensate each color pixel value respectively.
The operational flowchart of the stereoscopic image processing device 100 of Fig. 3 display according to one embodiment of the invention.In step S302, image detecting element 110 receives stereoscopic image data, wherein stereoscopic image data D comprises basic sprite Fb and interdependent sprite Fd, in general, basis sprite Fb and interdependent sprite Fd, corresponds to the image of left eye and right eye respectively visually to be formed stereo-picture.
Then in step S304, image detecting element 110 detects stereoscopic image data D, by the amount of detail of comparison two sub-screen images, to judge and to obtain basic sprite Fb and interdependent sprite Fd, wherein basic sprite Fb has more image detail relative to interdependent sprite Fd, therefore the quantity or comparatively many of picture image details.For example, image detecting element 110 can carry out high-pass filtering and binary conversion treatment to strengthen the detail section of two sprites to two corresponding sprites, more simply can calculate and judge the sprite that image detail is more and the less sprite of image detail.In some embodiments of the invention, step S304 also comprises the detection basic sprite block Bb of basic sprite Fb and the sprite block Bd of interdependent sprite Fd, and wherein basic sprite block Bb and interdependent sprite block Bd forms stereo-picture D stereo-picture block wherein.
In step S306, image compensation unit 120 carries out frame compensation to produce the interdependent sprite after compensating according to basic sprite Fb to interdependent sprite Fd, and exports basic sprite Fb and the interdependent sprite after compensating to display unit 130 as compensation stereoscopic image data Dc.Wherein compensation way can comprise the compensation of picture sharpness and picture color compensation.For example, when picture sharpness compensates, image compensation unit 120 can strengthen filter by after basic sprite block Bb filtering by details, more filtered basic sprite block Bb is added interdependent sprite block Bd, to increase its picture sharpness.Then sprite blocks all in interdependent sprite Fd can be compensated, to complete the compensation of interdependent sprite Fd.And when carrying out picture color and compensating, image compensation unit 120 calculates its mean value after being added up by basic color pixel value multiple in basic sprite Fb, to produce average basal color pixel value, its mean value is calculated, to produce mean-contingency color pixel value after interdependent color pixel value multiple in interdependent sprite Fd being added up.Then deduct the color pixel mean difference of mean-contingency color pixel value in the hope of two sprites by average basal color pixel value, be finally added to each interdependent color pixel value in interdependent sprite Fd according to the color pixel mean difference of trying to achieve again.
Then, in step S308, display unit 130 exports and shows and compensates stereoscopic image data Dc.
Though the present invention describes preferred embodiment as above, above-mentioned disclosed and be not used to limit the embodiment of the present invention because understanding.On the contrary, it contains multiple change and similar configuration (those of ordinary skill in the art can obviously learn).In addition, the deciphering of most broad sense should be done to comprise all above-mentioned changes and similar configuration according to the scope of appended claim.
Claims (12)
1. a stereoscopic image processing device, is applicable to process one stereoscopic image data, and wherein above-mentioned stereoscopic image data comprises a basic sprite and an interdependent sprite, comprising:
One image detecting element, in order to detect above-mentioned stereoscopic image data and to obtain above-mentioned basic sprite and above-mentioned interdependent sprite;
One image compensation unit, carries out frame compensation to produce the interdependent sprite of a compensation according to above-mentioned basic sprite to above-mentioned interdependent sprite; And
One display unit, compensates stereoscopic image data according to above-mentioned basic sprite and the interdependent sprite display one of above-mentioned compensation;
Wherein above-mentioned basic sprite and above-mentioned interdependent sprite visually form a stereo-picture, and above-mentioned basic sprite has more image detail relative to above-mentioned interdependent sprite; And
Wherein above-mentioned image detecting element also detects an interdependent sprite block of above-mentioned interdependent sprite, and compare to produce multiple picture element comparative result to multiple given area of same vertical position in above-mentioned basic sprite according to the pixel data of above-mentioned interdependent sprite block, and obtain a basic sprite block of above-mentioned basic sprite according to above-mentioned picture element comparative result, and above-mentioned basic sprite block and above-mentioned interdependent sprite block form a stereo-picture block of above-mentioned stereo-picture.
2. stereoscopic image processing device as claimed in claim 1, wherein above-mentioned image detecting element is in above-mentioned stereoscopic image data, two sprites corresponding to above-mentioned stereo-picture carry out high-pass filtering and binary conversion treatment, to produce one first amount of detail and one second amount of detail respectively, and determine above-mentioned basic sprite and above-mentioned interdependent sprite according to above-mentioned first amount of detail and above-mentioned second amount of detail.
3. stereoscopic image processing device as claimed in claim 1, wherein above-mentioned image compensation unit also carries out the compensation of picture sharpness according to above-mentioned basic sprite block to above-mentioned interdependent sprite block.
4. stereoscopic image processing device as claimed in claim 1, wherein above-mentioned image compensation unit carries out picture color compensation according to above-mentioned basic sprite block to above-mentioned interdependent sprite.
5. stereoscopic image processing device as claimed in claim 1, wherein above-mentioned image compensation unit also produces an average basal color pixel value according to multiple basic color pixel values of above-mentioned basic sprite, produce a mean-contingency color pixel value according to the multiple interdependent color pixel value of above-mentioned interdependent sprite, and according to the difference of above-mentioned average basal color pixel value and above-mentioned mean-contingency color pixel value, above-mentioned interdependent color pixel value is compensated.
6. stereoscopic image processing device as claimed in claim 1, wherein the data format of above-mentioned stereoscopic image data is blue light stereoscopic image data form or multi-vision angle video image compressed format.
7. a stereoscopic image processing method, is applicable to process one stereoscopic image data, and wherein above-mentioned stereoscopic image data comprises a basic sprite and an interdependent sprite, comprising:
Detect above-mentioned stereoscopic image data and obtain above-mentioned basic sprite and above-mentioned interdependent sprite, wherein above-mentioned basic sprite and above-mentioned interdependent sprite visually form a stereo-picture, and above-mentioned basic sprite has more image detail relative to above-mentioned interdependent sprite;
According to above-mentioned basic sprite, frame compensation is carried out to produce the interdependent sprite of a compensation to above-mentioned interdependent sprite;
Stereoscopic image data is compensated according to above-mentioned basic sprite and the interdependent sprite display one of above-mentioned compensation; And
Detect an interdependent sprite block of above-mentioned interdependent sprite, pixel data according to above-mentioned interdependent sprite block compares to produce multiple picture element comparative result to multiple given area of same vertical position in above-mentioned basic sprite, and obtain a basic sprite block of above-mentioned basic sprite according to above-mentioned picture element comparative result, and above-mentioned basic sprite block and above-mentioned interdependent sprite block form a stereo-picture block of above-mentioned stereo-picture.
8. stereoscopic image processing method as claimed in claim 7, also comprises:
To in above-mentioned stereoscopic image data, two sprites corresponding to above-mentioned stereo-picture carry out high-pass filtering and binary conversion treatment, to produce one first amount of detail and one second amount of detail respectively; And
Above-mentioned basic sprite and above-mentioned interdependent sprite is determined according to above-mentioned first amount of detail and above-mentioned second amount of detail.
9. stereoscopic image processing method as claimed in claim 7, also comprises and carries out the compensation of picture sharpness according to above-mentioned basic sprite block to above-mentioned interdependent sprite block.
10. stereoscopic image processing method as claimed in claim 7, also comprises and carries out picture color compensation according to above-mentioned basic sprite block to above-mentioned interdependent sprite.
11. stereoscopic image processing methods as claimed in claim 7, also comprise:
Multiple basic color pixel values according to above-mentioned basic sprite produce an average basal color pixel value;
A mean-contingency color pixel value is produced according to the multiple interdependent color pixel value of above-mentioned interdependent sprite; And
Difference according to above-mentioned average basal color pixel value and above-mentioned mean-contingency color pixel value compensates above-mentioned interdependent color pixel value.
12. stereoscopic image processing methods as claimed in claim 7, wherein the data format of above-mentioned stereoscopic image data is blue light stereoscopic image data form or multi-vision angle video image compressed format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110266219.2A CN102984538B (en) | 2011-09-05 | 2011-09-05 | Device and method for three-dimensional image processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110266219.2A CN102984538B (en) | 2011-09-05 | 2011-09-05 | Device and method for three-dimensional image processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102984538A CN102984538A (en) | 2013-03-20 |
| CN102984538B true CN102984538B (en) | 2015-02-25 |
Family
ID=47858219
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110266219.2A Active CN102984538B (en) | 2011-09-05 | 2011-09-05 | Device and method for three-dimensional image processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102984538B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1179065A (en) * | 1996-08-06 | 1998-04-15 | 次级系统有限公司 | Optimal disparity estimation for stereoscopic video coding |
| CN1226786A (en) * | 1997-11-07 | 1999-08-25 | 通用仪器公司 | View offset estimation for stereo scopic video coding |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101450670B1 (en) * | 2007-06-11 | 2014-10-15 | 삼성전자 주식회사 | Method and apparatus for generating block-based stereoscopic image format, and method and apparatus for reconstructing stereoscopic images from the block-based stereoscopic image format |
-
2011
- 2011-09-05 CN CN201110266219.2A patent/CN102984538B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1179065A (en) * | 1996-08-06 | 1998-04-15 | 次级系统有限公司 | Optimal disparity estimation for stereoscopic video coding |
| CN1226786A (en) * | 1997-11-07 | 1999-08-25 | 通用仪器公司 | View offset estimation for stereo scopic video coding |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102984538A (en) | 2013-03-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8780172B2 (en) | Depth and video co-processing | |
| US10567728B2 (en) | Versatile 3-D picture format | |
| CN101646095B (en) | Image processing apparatus, image processing method | |
| TWI598846B (en) | Image data processing method and stereoscopic image display using the same | |
| CN102055998B (en) | Image processing apparatus, image processing method | |
| EP2730090A2 (en) | Depth or disparity map upscaling | |
| CN101198074B (en) | Stereoscopic picture format conversion method and display system using the same | |
| CN102547356A (en) | Image processing device, image processing method, and program | |
| CN102186023A (en) | Binocular three-dimensional subtitle processing method | |
| US20140055450A1 (en) | Image processing apparatus and image processing method thereof | |
| US9478196B2 (en) | Display method and display device | |
| US20110084966A1 (en) | Method for forming three-dimension images and related display module | |
| CN102026012B (en) | Generation method and device of depth map through three-dimensional conversion to planar video | |
| JP2015095779A (en) | Image processing apparatus, image processing method, and electronic equipment | |
| TWI540536B (en) | Processing depth data of a three-dimensional scene | |
| CN102098527B (en) | Method and device for transforming two dimensions into three dimensions based on motion analysis | |
| CN102984538B (en) | Device and method for three-dimensional image processing | |
| CN104767985A (en) | Method of using region distribution analysis to automatically detect 3D image format | |
| US9787980B2 (en) | Auxiliary information map upsampling | |
| EP2563021B1 (en) | Devices and methods for 3-D image processing | |
| CN102055992B (en) | Stereoscopic image forming method and relevant display module | |
| CN110636282B (en) | No-reference asymmetric virtual viewpoint three-dimensional video quality evaluation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |