CN103517052B - Visual point synthesizing method, device and encoder during a kind of coding depth information - Google Patents
Visual point synthesizing method, device and encoder during a kind of coding depth information Download PDFInfo
- Publication number
- CN103517052B CN103517052B CN201210226046.6A CN201210226046A CN103517052B CN 103517052 B CN103517052 B CN 103517052B CN 201210226046 A CN201210226046 A CN 201210226046A CN 103517052 B CN103517052 B CN 103517052B
- Authority
- CN
- China
- Prior art keywords
- distortion
- parallax
- level
- depth value
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The embodiments of the invention provide visual point synthesizing method, device and the encoder during a kind of coding depth information, this method includes：During View Synthesis in coding depth information, to every a line depth value of depth image coding unit, according to depth value and the mapping relations of horizontal parallax, original depth value and distortion depth value are each mapped to original level parallax and level of distortion parallax；Judge whether current line distortion depth value can cause the change for synthesizing viewpoint pixel value according to the difference of original level parallax and level of distortion parallax, and using horizontal parallax distortion threshold；If it is determined that current line distortion depth value then skips the row without result in the change of synthesis viewpoint pixel value during View Synthesis, View Synthesis is not carried out using the line distortion depth value.The device includes：Map unit, judging unit, View Synthesis processing unit.Encoder includes said apparatus.Above-mentioned technical proposal of the present invention can reduce the time complexity of coding side while coding efficiency is ensured.
Description
Technical field
The present invention relates to multimedia technology field, more particularly to visual point synthesizing method, dress during a kind of coding depth information
Put and encoder.
Background technology
In the 98th MPEG（Moving Pictures Experts Group, dynamic image expert group）In meeting, HHI
（Heinrich Hertz Institute, Rhein-hertz research institute）One kind is proposed in depth image compression based on synthesis
The rate-distortion optimization algorithm of viewpoint distortion information.In the algorithm, the distortion size of depth image is by synthesizing the distortion of viewpoint
Change to weigh, can specifically be expressed as:
∑(x, y)∈l[s'T(x,y)-s′T, R(x, y)]2 (1)
Wherein, s'T,R(x, y) represents the virtual view that application original texture image and original depth information are synthesized.Meanwhile,
During coding depth information, an amplitude deepness image is divided into encoded, present encoding and uncoded three class.ForAnd s'T
(x, y), is all that the texture image of selection application distortion is synthesized.Difference is, s'TThe encoded depth of (x, y) application reconstruct
Information is spent, the depth information and other original pixel depth information of original present encoding are synthesized, andUsing
The encoded depth information of reconstruct, the depth information of the present encoding of distortion and other original pixel depth information are closed
Into.If as can be seen that the depth information of current distortion will not cause the change for synthesizing viewpoint, then Δ D=0.
Existing technical scheme is the situation of change based on synthesis viewpoint distortion to being closed caused by current depth information distortion
Estimated into viewpoint distortion, therefore need in actual coding to proceed as follows：
1. encoding before current depth image, View Synthesis is carried out to original depth image and original texture image, that is, synthesized
s'T,R(x,y).View Synthesis is carried out to original depth image and distortion texture image, that is, synthesizes s'T(x, y) and
Before cataloged procedure starts
2. when encoding current block, it is necessary to the rate of progress distortion computation.If current depth block is B, the mistake of calculation rate distortion
True block is B ', and the original depth information in encoded region is P, and distortion depth information is P ', uncoded region original depth
Information is H, then current s'T(x, y) is by P ', B, and H depth information, which is drawn, to be obtained, and need not be calculated at this moment（
It is updated in below step）.However, for the Δ D in calculation formula (1), it is necessary to update current depth block message using B '
The later synthesis view information of distortion is so as to updateIn this process, the synthesis viewpoint pixel only being had influence on to B '
Drafting operation is carried out, rather than is updated for entire image, so Δ D carry out rate distortion computations are can obtain.
3. when having encoded current block, View Synthesis is carried out with current encoded distortion information to update synthesis viewpoint
Information.It is similarly assumed that current depth block is B, reconstructed blocks are B ", and the original depth information in encoded region is P, distortion depth
Information is P ', and uncoded region original depth information is H, during current block is encoded, equally, s'T(x, y) be by
P ', B, H depth information are obtained, however, obtaining B " later, it is necessary to s' when having encoded current blockT(x, y) applies B " to carry out more
Newly.With 2, the synthesis viewpoint pixel that renewal process still only has influence on to B " carries out drafting operation, rather than for entire image
It is updated, so that P ' is obtained, B ", the s' that H is drawnT(x,y)。
It can see from as above process, existing technical scheme needs constantly to carry out the drafting of viewpoint in an encoding process
With renewal, it is necessary to larger time complexity（Time overhead）.Accordingly, it would be desirable to which designing quick technical scheme is ensureing Encoding
Reduce the time complexity of coding side while energy.
The content of the invention
The embodiment of the present invention provides visual point synthesizing method, device and the encoder during a kind of coding depth information, to protect
Reduce the time complexity of coding side while demonstrate,proving coding efficiency.
On the one hand, the embodiments of the invention provide visual point synthesizing method during a kind of coding depth information, the coding is deep
Visual point synthesizing method during degree information includes：
During View Synthesis in coding depth information, to every a line depth value of depth image coding unit, root
According to depth value and the mapping relations of horizontal parallax, by original depth value and distortion depth value be each mapped to original level parallax and
Level of distortion parallax；
Judge that current line loses according to the difference of original level parallax and level of distortion parallax, and using horizontal parallax distortion threshold
Whether true depth value can cause the change for synthesizing viewpoint pixel value；
If it is determined that change of the current line distortion depth value without result in synthesis viewpoint pixel value, then during View Synthesis
The row is skipped, View Synthesis is not carried out using the line distortion depth value.
It is preferred that, in an embodiment of the present invention, the horizontal parallax distortion threshold is the smooth spy according to texture image
Property and composograph in block information, obtain causes synthesize viewpoint change horizontal parallax distortion threshold.
It is preferred that, in an embodiment of the present invention, the difference according to original level parallax and level of distortion parallax, and profit
Judge whether current line distortion depth value can cause the change for synthesizing viewpoint pixel value with horizontal parallax distortion threshold, including：When
When preceding pixel blocks other pixels, horizontal parallax distortion threshold is zero, i.e., the corresponding depth value of current pixel can not produce any
Parallax distortion；If current depth value does not produce any parallax distortion, determine whether that the current line corresponding to current pixel loses
Whether true depth value all meets the scope that the difference of original level parallax and level of distortion parallax is defined in horizontal parallax distortion threshold
Within；If current line distortion depth value all meets the difference of original level parallax and level of distortion parallax in horizontal parallax distortion threshold
Within the scope of defining, then change of the current line distortion depth value without result in synthesis viewpoint pixel value is judged.
It is preferred that, in an embodiment of the present invention, the difference according to original level parallax and level of distortion parallax, and profit
Judge whether current line distortion depth value can cause the change for synthesizing viewpoint pixel value with horizontal parallax distortion threshold, including：When
When preceding pixel is blocked by other pixels or when current pixel neither blocks other pixels nor blocked by other pixels, judge former
Whether beginning horizontal parallax and the difference of level of distortion parallax are within the scope of horizontal parallax distortion threshold is defined, if original level is regarded
Difference and the difference of level of distortion parallax determine whether that current pixel institute is right within the scope of horizontal parallax distortion threshold is defined, then
Whether the current line distortion depth value answered all meets the difference of original level parallax and level of distortion parallax in horizontal parallax distortion threshold
Within the scope of value is defined；If current line distortion depth value all meets the difference of original level parallax and level of distortion parallax in level
Within the scope of parallax distortion threshold is defined, then change of the current line distortion depth value without result in synthesis viewpoint pixel value is judged
Change.
On the other hand, the embodiments of the invention provide View Synthesis device during a kind of coding depth information, the coding
View Synthesis device during depth information includes：
Map unit, during the View Synthesis in coding depth information, to the every of depth image coding unit
A line depth value, according to depth value and the mapping relations of horizontal parallax, original depth value and distortion depth value are each mapped to
Original level parallax and level of distortion parallax；
Judging unit, for the difference according to original level parallax and level of distortion parallax, and utilizes horizontal parallax distortion threshold
Value judges whether current line pixel distortion depth value can cause the change for synthesizing viewpoint pixel value；
View Synthesis processing unit, for if it is determined that current line distortion depth value is without result in the change for synthesizing viewpoint pixel value
Change, then the row is skipped during View Synthesis, do not carry out View Synthesis using the line distortion depth value.
It is preferred that, in an embodiment of the present invention, the horizontal parallax distortion threshold is the smooth spy according to texture image
Property and composograph in block information, obtain causes synthesize viewpoint change horizontal parallax distortion threshold.
It is preferred that, in an embodiment of the present invention, the judging unit includes：First judge module, for current pixel
When blocking other pixels, horizontal parallax distortion threshold is zero, i.e., the corresponding depth value of current pixel can not produce any parallax and lose
Very；If current depth value does not produce any parallax distortion, the current line distortion depth corresponding to current pixel is determined whether
Whether value all meets the difference of original level parallax and level of distortion parallax within the scope of horizontal parallax distortion threshold is defined；If
What the difference that current line distortion depth value all meets original level parallax and level of distortion parallax was defined in horizontal parallax distortion threshold
Within the scope of, then judge change of the current line distortion depth value without result in synthesis viewpoint pixel value.
It is preferred that, in an embodiment of the present invention, the judging unit includes：Second judge module, for current pixel
When being blocked by other pixels or when current pixel neither blocks other pixels nor blocked by other pixels, original level is judged
Whether the difference of parallax and level of distortion parallax is within the scope of horizontal parallax distortion threshold is defined, if original level parallax and mistake
The difference of high tone parallax determines whether working as corresponding to current pixel within the scope of horizontal parallax distortion threshold is defined, then
Whether preceding line distortion depth value all meets original level parallax and the difference of level of distortion parallax is defined in horizontal parallax distortion threshold
Within the scope of；If current line distortion depth value all meets original level parallax and the difference of level of distortion parallax is lost in horizontal parallax
Within the scope of true threshold value is defined, then change of the current line distortion depth value without result in synthesis viewpoint pixel value is judged.
Another further aspect, the embodiments of the invention provide a kind of encoder, the encoder includes above-mentioned coding depth information
When View Synthesis device.
Above-mentioned technical proposal has the advantages that：Because using the View Synthesis process in coding depth information
In, to every a line depth value of depth image coding unit, according to depth value and the mapping relations of horizontal parallax, by original depth
Value and distortion depth value are each mapped to original level parallax and level of distortion parallax；According to original level parallax and level of distortion
The difference of parallax, and judge whether current line distortion depth value can cause to synthesize viewpoint pixel value using horizontal parallax distortion threshold
Change；If it is determined that current line distortion depth value is then jumped without result in the change of synthesis viewpoint pixel value during View Synthesis
The row is crossed, the technological means of View Synthesis is not carried out using the line distortion depth value, it is possible to is ensureing the same of coding efficiency
When reduce coding side time complexity.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Visual point synthesizing method flow chart when Fig. 1 is a kind of coding depth information of the embodiment of the present invention；
View Synthesis apparatus structure schematic diagram when Fig. 2 is a kind of coding depth information of the embodiment of the present invention；
Fig. 3 is judging unit structural representation of the embodiment of the present invention；
Fig. 4 is that original disparity in the case of the identical 1/4 pixel precision parallax of application example of the present invention correspondence and distortion parallax show
It is intended to；
Fig. 5 (a) is the corresponding synthesis viewpoint schematic diagram of application example original depth of the present invention；
Fig. 5 (b) is the corresponding synthesis viewpoint schematic diagram of application example distortion depth of the present invention；
Fig. 5 (c) is that the differential of the pixel value of synthesis viewpoint in application example Fig. 5 (a) of the present invention and Fig. 5 (b) is intended to；
Fig. 6 is that application example of the present invention blocks pixel schematic diagram；
Visual point synthesizing method flow chart when Fig. 7 is application example coding depth information of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
As shown in figure 1, visual point synthesizing method flow chart during coding depth information a kind of for the embodiment of the present invention, the volume
Visual point synthesizing method during code depth information includes：
101st, during the View Synthesis in coding depth information, to every a line depth of depth image coding unit
Value, according to depth value and the mapping relations of horizontal parallax, original level is each mapped to by original depth value and distortion depth value
Parallax and level of distortion parallax；
102nd, according to the difference of original level parallax and level of distortion parallax, and judge current using horizontal parallax distortion threshold
Whether line distortion depth value can cause the change for synthesizing viewpoint pixel value；
103rd, if it is determined that current line distortion depth value is without result in the change for synthesizing viewpoint pixel value, then in View Synthesis mistake
The row is skipped in journey, View Synthesis is not carried out using the line distortion depth value.
It is preferred that, the horizontal parallax distortion threshold is the screening in smoothness properties and composograph according to texture image
Information is kept off, the obtained horizontal parallax distortion threshold for causing to synthesize viewpoint change.
It is preferred that, the difference according to original level parallax and level of distortion parallax, and utilize horizontal parallax distortion threshold
Judge whether current line distortion depth value can cause the change for synthesizing viewpoint pixel value, including：Current pixel blocks other pixels
When, horizontal parallax distortion threshold is zero, i.e., the corresponding depth value of current pixel can not produce any parallax distortion；If current depth
Value does not produce any parallax distortion, then determines whether whether the current line distortion depth value corresponding to current pixel all meets former
Beginning horizontal parallax and the difference of level of distortion parallax are within the scope of horizontal parallax distortion threshold is defined；If current line distortion depth
Value all meets the difference of original level parallax and level of distortion parallax within the scope of horizontal parallax distortion threshold is defined, then judges
Change of the current line distortion depth value without result in synthesis viewpoint pixel value.
It is preferred that, the difference according to original level parallax and level of distortion parallax, and utilize horizontal parallax distortion threshold
Judge whether current line distortion depth value can cause the change for synthesizing viewpoint pixel value, including：Current pixel is hidden by other pixels
During gear or when current pixel neither blocks other pixels nor blocked by other pixels, original level parallax and distortion water are judged
The difference of difference is looked squarely whether within the scope of horizontal parallax distortion threshold is defined, if original level parallax and level of distortion parallax it
Difference then determines whether the current line distortion depth corresponding to current pixel within the scope of horizontal parallax distortion threshold is defined
Whether value all meets the difference of original level parallax and level of distortion parallax within the scope of horizontal parallax distortion threshold is defined；If
What the difference that current line distortion depth value all meets original level parallax and level of distortion parallax was defined in horizontal parallax distortion threshold
Within the scope of, then judge change of the current line distortion depth value without result in synthesis viewpoint pixel value.
Corresponding to above method embodiment, as shown in Fig. 2 viewpoint during coding depth information a kind of for the embodiment of the present invention
Synthesizer structural representation, the View Synthesis device during coding depth information includes：
Map unit 21, during the View Synthesis in coding depth information, to depth image coding unit
Per a line depth value, according to depth value and the mapping relations of horizontal parallax, original depth value and distortion depth value are mapped respectively
For original level parallax and level of distortion parallax；
Judging unit 22, for the difference according to original level parallax and level of distortion parallax, and utilizes horizontal parallax distortion
Whether the current line distortion depth value of threshold decision can cause the change for synthesizing viewpoint pixel value；
View Synthesis processing unit 23, for if it is determined that current line distortion depth value is without result in synthesis viewpoint pixel value
Change, then skip the row during View Synthesis, does not carry out View Synthesis using the line distortion depth value.
It is preferred that, the horizontal parallax distortion threshold is the screening in smoothness properties and composograph according to texture image
Information is kept off, the obtained horizontal parallax distortion threshold for causing to synthesize viewpoint change.
It is preferred that, as shown in figure 3, for judging unit structural representation of the embodiment of the present invention, the judging unit 22 includes：
First judge module 221, when blocking other pixels for current pixel, horizontal parallax distortion threshold is zero, i.e. current pixel pair
The depth value answered can not produce any parallax distortion；If current depth value does not produce any parallax distortion, determine whether to work as
Whether the current line distortion depth value corresponding to preceding pixel all meets the difference of original level parallax and level of distortion parallax in level
Within the scope of parallax distortion threshold is defined；If current line distortion depth value all meets original level parallax and level of distortion parallax
Difference judge within the scope of horizontal parallax distortion threshold is defined, then current line distortion depth value without result in synthesis viewpoint picture
The change of element value.The judging unit includes：Second judge module 222, when being blocked for current pixel by other pixels or
When current pixel neither blocks other pixels nor blocked by other pixels, judge original level parallax and level of distortion parallax it
Whether difference is within the scope of horizontal parallax distortion threshold is defined, if the difference of original level parallax and level of distortion parallax is in level
Within the scope of parallax distortion threshold is defined, then determine whether current line distortion depth value corresponding to current pixel whether all
The difference of original level parallax and level of distortion parallax is met within the scope of horizontal parallax distortion threshold is defined；If current line loses
True depth value all meets the difference of original level parallax and level of distortion parallax within the scope of horizontal parallax distortion threshold is defined,
Then judge change of the current line distortion depth value without result in synthesis viewpoint pixel value.
Another further aspect, the embodiments of the invention provide a kind of encoder, the encoder includes above-mentioned coding depth information
When View Synthesis device.
The above method of the embodiment of the present invention, device or encoder techniques scheme have the advantages that：Because using
During View Synthesis during coding depth information, to every a line depth value of depth image coding unit, according to depth value with
The mapping relations of horizontal parallax, are each mapped to original level parallax by original depth value and distortion depth value and level of distortion are regarded
Difference；Judge that current line distortion is deep according to the difference of original level parallax and level of distortion parallax, and using horizontal parallax distortion threshold
Whether angle value can cause the change for synthesizing viewpoint pixel value；If it is determined that current line distortion depth value is without result in synthesis viewpoint pixel
The change of value, then skip the row during View Synthesis, and the technology hand of View Synthesis is not carried out using the line distortion depth value
Section, it is possible to reduce the time complexity of coding side while coding efficiency is ensured.
The technical scheme that the above method of the embodiment of the present invention, device or encoder are proposed is during coding, often
Before secondary synthesis viewpoint, after obtaining original depth information and current depth information, using original depth information and work as
Preceding depth information, and the characteristic of blocking of texture image characteristic and synthesis viewpoint are analyzed, thus judge whether to need into
Row View Synthesis is operated.（It should be noted that the technical program does not have any influence for decoding end）Specific technical scheme is such as
Under：
In the case of camera horizon parallel arranged, relation between real depth information z and parallax information d can be with
It is expressed as：
Wherein, f represents the focal length of video camera.L represents the reference range between two viewpoints.
If the corresponding quantisation depths of current depth z are v=Q (z), then the relation between parallax information and quantisation depth can be with
It is expressed as：
Different depth informations can cause different horizontal parallaxs it can be seen from formula (3).However, in practical application
In, floor operation (rounding) can be typically done to horizontal parallax.For example in existing 3DV-HEVC, horizontal parallax is used
1/4 pixel precision is rounded, as shown in figure 4, being regarded to be original in the case of the identical 1/4 pixel precision parallax of application example of the present invention correspondence
Difference and distortion parallax schematic diagram.It can see after rounding, original depth and distortion depth correspond to the pixel precision of identical 1/4
Horizontal parallax.Therefore, the distortion of depth information can not necessarily cause the distortion of horizontal parallax.
If the position of current pixel is p, the corresponding parallax d of pixel depth value is R in the operation rounded of 1/N precisionN
(d).Assuming that dopFor original disparity, dspFor distortion parallax.Then parallax distortion can be expressed as
DN(dop,dsp)=RN(dop)-RN(dsp) (4)
In existing 3DV-HEVC, horizontal parallax is rounded using 1/4 pixel precision, then N=4.
When parallax distortion is not 0, the distortion and texture image characteristic for synthesizing virtual view have very big relation, such as scheme
It is the corresponding synthesis viewpoint schematic diagram of application example original depth of the present invention shown in 5 (a)；Fig. 5 (b) is application example of the present invention
The corresponding synthesis viewpoint schematic diagram of distortion depth；Fig. 5 (c) is synthesis viewpoint in application example Fig. 5 (a) of the present invention and Fig. 5 (b)
The differential of pixel value is intended to.As we can see from the figure：The pixel value of position 2 ~ 5 is identical in texture image, these position texture maps
Picture gradient very little is 0, in this case, the picture in the synthesis viewpoint obtained using original depth information and distortion depth information
The pixel value of synthesis viewpoint position 1 ~ 3 in plain difference very little, such as Fig. 5 (a) and Fig. 5 (b)；On the other hand, position 5 in texture image
~ 9 pixel value is changed greatly, and these position texture image gradients are larger, in this case, utilize original depth information and distortion
Pixel differences in the synthesis viewpoint that depth information is obtained are very big, the picture of synthesis viewpoint position 4 ~ 7 in such as Fig. 5 (a) and Fig. 5 (b)
Element value.
The embodiment of the present invention defines threshold value Gl,GrCurrent pixel left side and right side after 1/4 picture element interpolation are represented respectively
Smoothness, specifically, GlRepresent in the range of the pixel on the left of current pixel p, for current pixel p and GlBetween
Any one pixel, the value of the pixel is identical with current pixel p, similarly, GrRepresent the pixel point range on the right side of current pixel p
It is interior, for current pixel p and GrBetween any one pixel, the value of the pixel is identical with current pixel p.
Gl=min { plWherein plMeet：I (m)=I (p)
Gr=max { prWherein prMeet：I (m)=I (p) (5)
Wherein, p1<P represents the pixel on the left of pixel p, pr>P represents the pixel on the right side of pixel p, and I is represented after interpolation
High-resolution reconstruction image.
When current pixel is blocked, the depth information of current pixel does not work in View Synthesis.As shown in fig. 6, being
Application example of the present invention blocks pixel schematic diagram.C, d pixel depth information do not influence the result of View Synthesis.The depth of current pixel
Spend after information distortion, if current pixel is still blocked, you can think that the distortion of its depth information will not be to View Synthesis
Produce influence.When being currently blocked as pixel, application example definition of the present invention：
Wherein poFor the position for the depth pixel for blocking current pixel, p is the position of current pixel.To<Represent closing when 0
Current pixel is blocked by the pixel on the left of it on into viewpoint.If the depth value distortion of current pixel causes current pixel in synthesis
Position in viewpoint move to left but not move to left toIf left side, the depth value distortion does not interfere with synthesis viewpoint
Distortion.Similar, To>0 represent synthesis viewpoint on current pixel by it on the right side of pixel block.
When current pixel blocks other pixels, application example of the present invention requires that current pixel can not produce any parallax and lose
Very.
To sum up, application example of the present invention defines threshold value TlAnd TrIt is as follows（TlRepresent the horizontal parallax and original level after distortion
Parallax is compared, can at most offset to the left how much, TrRepresent that the horizontal parallax after distortion compared with original level parallax, at most may be used
With offset to the right how much）：
And define condition：
C={ RN(v)-RN(v')≤TlAnd RN(v')-RN(v)≤Tr, wherein, C represents the horizontal parallax after distortion assorted
In the range of will not cause the distortion that synthesizes viewpoint, v represents original level parallax, and v' represents level of distortion parallax.
As shown in fig. 7, visual point synthesizing method flow chart during for application example coding depth information of the present invention, including it is as follows
Step：
701st, j=0 is initialized；
702nd, to jth row pixel S in current blockj
703rd, judge whetherD ∈ C, if it is, i.e. it is believed that the distortion of current line depth information pixel is to synthesis
Viewpoint distortion does not influence, then goes to step 704, if it is not, then going to step 706；
704th, jth row is skipped, View Synthesis is not carried out using the jth row pixel；
The 705th, j+1 is assigned to j the newest, i.e. j=j+1,702 are then gone to step；
706th, jth row pixel S is utilizedjView Synthesis；
The 707th, j+1 is assigned to j the newest, i.e. j=j+1,702 are then gone to step.
As can be seen here, when needing the depth value with one piece of distortion to carry out View Synthesis in coding, to every row depth value
Judged, judge whether that the row depth value all meets set C condition, if all meeting, regarded without the row depth value
Point synthesis, otherwise, View Synthesis is carried out according to normal flow.
The technical scope of the technical program application（Field）It is the View Synthesis process in coding depth information process.Compiling
During code depth information calculated distortion, existing method is regarded using every one-row pixels of each depth image coding unit
Point synthesis.In the scheme that the technical program is proposed, first determine whether every a line of depth image coding unit whether to View Synthesis
Have an impact, if do not influenceed, the row is skipped during View Synthesis to reduce encoding-time-complexity.
It is shown experimentally that, for 1024x768 sequence, the technical program proposes that algorithm can be than algorithm coding before
Total time complexity reduction by 4% or so is held, while not loss coding performance.
Those skilled in the art will also be appreciated that the various illustrative components, blocks that the embodiment of the present invention is listed
（illustrative logical block）, unit, and step can be by the knots of electronic hardware, computer software, or both
Conjunction is realized.To clearly show that the replaceability of hardware and software（interchangeability）, above-mentioned various explanations
Property part（illustrative components）, unit and step universally describe their function.Such work(
Can be that the design requirement depending on specific application and whole system is realized by hardware or software.Those skilled in the art
For every kind of specific application various methods can be used to realize described function, but this realization is understood not to
The scope protected beyond the embodiment of the present invention.
Various illustrative logical blocks described in the embodiment of the present invention, or unit can by general processor,
Digital signal processor, application specific integrated circuit（ASIC）, field programmable gate array（FPGA）Or other programmable logic devices,
The design of discrete gate or transistor logic, discrete hardware components, or any of the above described combination is come the function described by realizing or operate.
General processor can be microprocessor, alternatively, the general processor can also for any traditional processor, controller,
Microcontroller or state machine.Processor can also be realized by the combination of computing device, for example digital signal processor and micro-
Processor, multi-microprocessor, one or more microprocessors combine a Digital Signal Processor Core, or any other like
Configuration realize.
The step of method described in the embodiment of the present invention or algorithm can be directly embedded into hardware, computing device it is soft
Part module or the combination of both.Software module can be stored in RAM memory, flash memory, ROM memory, EPROM storages
Other any form of storage media in device, eeprom memory, register, hard disk, moveable magnetic disc, CD-ROM or this area
In.Exemplarily, storage medium can be connected with processor, to allow processor to read information from storage medium, and
Write information can be deposited to storage medium.Alternatively, storage medium can also be integrated into processor.Processor and storage medium can
To be arranged in ASIC, ASIC can be arranged in user terminal.Alternatively, processor and storage medium can also be arranged at use
In different parts in the terminal of family.
In one or more exemplary designs, above-mentioned functions described by the embodiment of the present invention can be in hardware, soft
Part, firmware or any combination of this three are realized.If realized in software, these functions can be stored and computer-readable
On medium, or with it is one or more instruction or code form be transmitted on the medium of computer-readable.Computer readable medium includes electricity
Brain stores medium and is easy to so that allowing computer program to be transferred to other local telecommunication medias from a place.Storing medium can be with
It is that any general or special computer can be with the useable medium of access.For example, such computer readable media can include but
It is not limited to RAM, ROM, EEPROM, CD-ROM or other optical disc storage, disk storage or other magnetic storage devices, or other
What can be used for carrying or store with instruct or data structure and it is other can be by general or special computer or general or specially treated
Device reads the medium of the program code of form.In addition, any connection can be properly termed computer readable medium, example
Such as, if software is to pass through a coaxial cable, optical fiber computer, double from web-site, server or other remote resources
Twisted wire, Digital Subscriber Line（DSL）Or with defined in being also contained in of the wireless way for transmitting such as infrared, wireless and microwave
In computer readable medium.Described disk（disk）And disk（disc）Including Zip disk, radium-shine disk, CD, DVD, floppy disk
And Blu-ray Disc, disk is generally with magnetic duplication data, and disk generally carries out optical reproduction data with laser.Combinations of the above
It can also be included in computer readable medium.
Above-described embodiment, has been carried out further to the purpose of the present invention, technical scheme and beneficial effect
Describe in detail, should be understood that the embodiment that the foregoing is only the present invention, be not intended to limit the present invention
Protection domain, within the spirit and principles of the invention, any modification, equivalent substitution and improvements done etc. all should be included
Within protection scope of the present invention.
Claims (5)
1. visual point synthesizing method during a kind of coding depth information, it is characterised in that the viewpoint during coding depth information is closed
Include into method：
During View Synthesis in coding depth information, to every a line depth value of depth image coding unit, according to depth
The mapping relations of angle value and horizontal parallax, original level parallax and distortion are each mapped to by original depth value and distortion depth value
Horizontal parallax；
Judge that current line distortion is deep according to the difference of original level parallax and level of distortion parallax, and using horizontal parallax distortion threshold
Whether angle value can cause the change for synthesizing viewpoint pixel value；
If it is determined that current line distortion depth value is then skipped without result in the change of synthesis viewpoint pixel value during View Synthesis
The row, does not carry out View Synthesis using the line distortion depth value；
The difference according to original level parallax and level of distortion parallax, and judge that current line loses using horizontal parallax distortion threshold
Whether true depth value can cause the change for synthesizing viewpoint pixel value, including：
When current pixel blocks other pixels, horizontal parallax distortion threshold is zero, i.e. the corresponding depth value of current pixel can not be produced
Raw any parallax distortion；If current depth value does not produce any parallax distortion, working as corresponding to current pixel is determined whether
Whether preceding line distortion depth value all meets original level parallax and the difference of level of distortion parallax is defined in horizontal parallax distortion threshold
Within the scope of；If current line distortion depth value all meets original level parallax and the difference of level of distortion parallax is lost in horizontal parallax
Within the scope of true threshold value is defined, then change of the current line distortion depth value without result in synthesis viewpoint pixel value is judged；
The difference according to original level parallax and level of distortion parallax, and judge that current line loses using horizontal parallax distortion threshold
Whether true depth value can cause the change for synthesizing viewpoint pixel value, including：
When current pixel is blocked by other pixels or when current pixel neither blocks other pixels nor blocked by other pixels,
The difference of original level parallax and level of distortion parallax is judged whether within the scope of horizontal parallax distortion threshold is defined, if original
Horizontal parallax and the difference of level of distortion parallax determine whether current picture within the scope of horizontal parallax distortion threshold is defined, then
Whether the current line distortion depth value corresponding to element all meets the difference of original level parallax and level of distortion parallax in horizontal parallax
Within the scope of distortion threshold is defined；If current line distortion depth value all meets the difference of original level parallax and level of distortion parallax
Within the scope of horizontal parallax distortion threshold is defined, then judge current line distortion depth value without result in synthesis viewpoint pixel value
Change.
2. visual point synthesizing method during coding depth information as claimed in claim 1, it is characterised in that the horizontal parallax distortion
Threshold value is the block information in smoothness properties and composograph according to texture image, and what is obtained causes what synthesis viewpoint changed
Horizontal parallax distortion threshold.
3. View Synthesis device during a kind of coding depth information, it is characterised in that the viewpoint during coding depth information is closed
Include into device：
Map unit, during the View Synthesis in coding depth information, to every a line of depth image coding unit
Depth value, according to depth value and the mapping relations of horizontal parallax, original depth value and distortion depth value is each mapped to original
Horizontal parallax and level of distortion parallax；
Judging unit, is sentenced for the difference according to original level parallax and level of distortion parallax, and using horizontal parallax distortion threshold
Whether the current line distortion depth value that breaks can cause the change for synthesizing viewpoint pixel value；
View Synthesis processing unit, for if it is determined that current line distortion depth value without result in synthesis viewpoint pixel value change,
The row is then skipped during View Synthesis, View Synthesis is not carried out using the line distortion depth value；
The judging unit includes：
First judge module, when blocking other pixels for current pixel, horizontal parallax distortion threshold is zero, i.e. current pixel pair
The depth value answered can not produce any parallax distortion；If current depth value does not produce any parallax distortion, determine whether to work as
Whether the current line distortion depth value corresponding to preceding pixel all meets the difference of original level parallax and level of distortion parallax in level
Within the scope of parallax distortion threshold is defined；If current line distortion depth value all meets original level parallax and level of distortion parallax
Difference judge within the scope of horizontal parallax distortion threshold is defined, then current line distortion depth value without result in synthesis viewpoint picture
The change of element value；
The judging unit includes：
Second judge module, when being blocked for current pixel by other pixels or current pixel neither block other pixels nor
When being blocked by other pixels, judge whether the difference of original level parallax and level of distortion parallax defines in horizontal parallax distortion threshold
Within the scope of, if the difference of original level parallax and level of distortion parallax is within the scope of horizontal parallax distortion threshold is defined,
Then determine whether whether the current line distortion depth value corresponding to current pixel all meets original level parallax and level of distortion
The difference of parallax is within the scope of horizontal parallax distortion threshold is defined；If current line distortion depth value all meets original level parallax
Judge that current line distortion depth value does not have within the scope of horizontal parallax distortion threshold is defined, then with the difference of level of distortion parallax
Cause the change for synthesizing viewpoint pixel value.
4. View Synthesis device during coding depth information as claimed in claim 3, it is characterised in that the horizontal parallax distortion
Threshold value is the block information in smoothness properties and composograph according to texture image, and what is obtained causes what synthesis viewpoint changed
Horizontal parallax distortion threshold.
5. a kind of encoder, it is characterised in that the encoder includes coding depth information any one of claim 3-4
When View Synthesis device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210226046.6A CN103517052B (en) | 2012-06-29 | 2012-06-29 | Visual point synthesizing method, device and encoder during a kind of coding depth information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210226046.6A CN103517052B (en) | 2012-06-29 | 2012-06-29 | Visual point synthesizing method, device and encoder during a kind of coding depth information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103517052A CN103517052A (en) | 2014-01-15 |
| CN103517052B true CN103517052B (en) | 2017-09-26 |
Family
ID=49898974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210226046.6A Expired - Fee Related CN103517052B (en) | 2012-06-29 | 2012-06-29 | Visual point synthesizing method, device and encoder during a kind of coding depth information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103517052B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543200A (en) * | 2003-04-22 | 2004-11-03 | ���µ�����ҵ��ʽ���� | Monitoring device composed of united video camera |
| CN102469314A (en) * | 2010-11-08 | 2012-05-23 | 索尼公司 | In loop contrast enhancement for improved motion estimation |
| CN102510500A (en) * | 2011-10-14 | 2012-06-20 | 北京航空航天大学 | Multi-view video error concealing method based on depth information |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100517517B1 (en) * | 2004-02-20 | 2005-09-28 | 삼성전자주식회사 | Method for reconstructing intermediate video and 3D display using thereof |
| US20070009034A1 (en) * | 2005-07-05 | 2007-01-11 | Jarno Tulkki | Apparatuses, computer program product, and method for digital image processing |
-
2012
- 2012-06-29 CN CN201210226046.6A patent/CN103517052B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543200A (en) * | 2003-04-22 | 2004-11-03 | ���µ�����ҵ��ʽ���� | Monitoring device composed of united video camera |
| CN102469314A (en) * | 2010-11-08 | 2012-05-23 | 索尼公司 | In loop contrast enhancement for improved motion estimation |
| CN102510500A (en) * | 2011-10-14 | 2012-06-20 | 北京航空航天大学 | Multi-view video error concealing method based on depth information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103517052A (en) | 2014-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11509933B2 (en) | Method, an apparatus and a computer program product for volumetric video | |
| AU2020397870B2 (en) | Method and apparatus for point cloud coding | |
| US10979663B2 (en) | Methods and apparatuses for image processing to optimize image resolution and for optimizing video streaming bandwidth for VR videos | |
| CN100576934C (en) | Virtual visual point synthesizing method based on the degree of depth and block information | |
| JP5475855B2 (en) | Virtual reference decoder for multiview video coding | |
| KR101689343B1 (en) | Method and device for providing a layered depth model of a scene | |
| CN103828359A (en) | Representation and coding of multi-view images using tapestry encoding | |
| CN106464906A (en) | Method for depth lookup table signaling in 3d video coding based on high efficiency video coding standard | |
| AU2017331736B2 (en) | Base anchored models and inference for the compression and upsampling of video and multiview imagery | |
| US20220217400A1 (en) | Method, an apparatus and a computer program product for volumetric video encoding and decoding | |
| KR101187530B1 (en) | Rendering strategy for monoscopic, stereoscopic and multi-view computer generated imagery, system using the same and recording medium for the same | |
| WO2019138163A1 (en) | A method and technical equipment for encoding and decoding volumetric video | |
| EP4066161A1 (en) | Method and apparatus for point cloud coding | |
| CN103517052B (en) | Visual point synthesizing method, device and encoder during a kind of coding depth information | |
| CN103533324B (en) | A kind of depth image inner frame coding method, device and encoder | |
| US20230306701A1 (en) | Parallel approach to dynamic mesh alignment | |
| CN107590850A (en) | A kind of 3D scenario building method and system using spherical panorama | |
| CN103379348B (en) | Visual point synthesizing method, device and encoder during a kind of coding depth information | |
| CN103379340B (en) | A kind of residual error prediction method and device | |
| CN104065972B (en) | A kind of deepness image encoding method, device and encoder | |
| US20230306648A1 (en) | Mesh parameterization with temporally correlated uv atlases | |
| US20230319293A1 (en) | Triangulation methods with boundary information for dynamic mesh compression | |
| US20230306647A1 (en) | Geometry filtering for mesh compression | |
| WO2024054290A1 (en) | Texture coordinate prediction in mesh compression | |
| KR20240110024A (en) | Texture coordinate compression using chart partitions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170926 Termination date: 20210629 |