CN104915968B - A kind of optical flow velocity method of estimation based on navier stokes equations - Google Patents
A kind of optical flow velocity method of estimation based on navier stokes equations Download PDFInfo
- Publication number
- CN104915968B CN104915968B CN201510254923.4A CN201510254923A CN104915968B CN 104915968 B CN104915968 B CN 104915968B CN 201510254923 A CN201510254923 A CN 201510254923A CN 104915968 B CN104915968 B CN 104915968B
- Authority
- CN
- China
- Prior art keywords
- energy
- velocity field
- omega
- velocity
- optical flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30181—Earth observation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a kind of optical flow velocity method of estimation based on navier stokes equations.This method constructs new energy-optimised function, and navier stokes equations are deformed and are incorporated among energy equation, and whole energy equation includes the constraint of four aspects:Image consistency, velocity field is smooth, velocity field couple in time and velocity field Incoercibility.New energy-optimised equation proposed by the invention can carry out optical flow velocity estimation simultaneously to whole sequence, but need the variable solved very many, in order to stably solve energy-optimised function, we used a variety of optimization means, optimize including multiresolution from coarse to fine, alternative optimization, multiplier alternating direction optimizes, a variety of optimization methods such as point of safes optimization.
Description
Technical field
The invention belongs to computer vision and field of Computer Graphics, specifically a kind of estimation image or three-dimensional
The method of flow field velocity in volume data, this method can be used for video tracking, in terms of air motion estimation and fluid analysis.
Background technology
With developing rapidly for computer technology, it is true in computer animation that people increasingly focus on natural phenomena
Property, in field of Computer Graphics, such as cigarette, fire, the simulation of water or other fluid are essential.One class method is completely by physics
Equation is simulated, but modulation parameter is very cumbersome, and another kind of is that the stream in true environment is gathered using equipment
Volume data, is then analyzed and is reused to it.The present invention is a link of Equations of The Second Kind method, can be for collecting
Image or volume data carry out velocity field estimation.
The motion of fluid can be retouched with famous Navier Stokes equation (Navier-Stokes Equation)
State:
Wherein u represents velocity field, and f represents external force, and p represents pressure, and t represents the time.And the visible oBject in fluid is (as contaminated
Material, or cigarette particle etc., use I is represented) can be described with equation below:
The optical flow analysis method of early stage only takes into account the uniformity matching of formula (3), i.e. image, this method (and after
Come improved method on this basis) velocity field can be substantially obtained, but this velocity field does not utilize Na Wei-Stokes side
Any constraint of journey, it is accurate not enough for fluid.Formula (2) is incorporated into optical flow velocity estimation by later Gregson
Among model so that the flow field of acquisition meets incompressible characteristic.This method using two consecutive frames for being estimated
For velocity field, good result can be obtained, however, be that there is very strong coupling for the motion in time of fluid,
This coupling is described by formula (1).
The content of the invention
To overcome disadvantages mentioned above, it is an object of the invention to provide a kind of optical flow velocity field method of estimation of global optimum,
This method to whole sequence can meet the characteristics of motion of fluid between optical flow velocity estimation, adjacent two frame simultaneously, and whole
Sequence also meets the characteristics of motion of fluid.
In order to achieve the above object, the present invention proposes a kind of optical flow velocity estimation based on Navier Stokes equation
Method.A brand-new energy optimizing model based on Na Wei-Stokes is first proposed, has then used and has made meticulously very much
The optimisation strategy of work carries out velocity field solution.Implementation method is:First, the golden word of multiresolution is constructed to each frame of fluid sequence
Tower, the pyramidal number of plies is specified by user, but the speed that standard is lowest resolution image does not exceed a length in pixels;
Then, each level of optimization from coarse to fine;In a level every time, optimize each frame according to vertical sequence alternate
Velocity field, the iterations of alternative optimization is specified by user;In each frame speed of alternative optimization, by this frame speed place
Corresponding energy model splits into three parts:Image consistency is smooth with velocity field, the time coupling of velocity field, velocity field
Incoercibility, with multiplier alternating direction optimization method to this three parts alternative optimization, iterations is specified by user.
Brief description of the drawings
Fig. 1 shows the broad flow diagram of the optical flow velocity method of estimation of the invention based on Navier Stokes equation;
Fig. 2 shows the algorithm of multiplier alternating direction optimization method (ADMM) of the present invention.
Embodiment
As shown in figure 1, the optical flow velocity method of estimation based on Navier Stokes equation of the present invention is using following step
Suddenly:
(1) multi-resolution pyramid is constructed to each frame of image sequence.The accuracy of arithmetic speed and result is taken into account, I
0.5 zoom factor has been used to construct pyramid, and the pyramidal number of plies is specified by user according to actual conditions, is specified
Standard be to allow length of the optical flow velocity field in the image of lowest resolution not exceed a pixel.
(2) it is successively secondary from lowest resolution to highest resolution to optimize.Optimized first lowest resolution, in computing most
Start, the initial value of all velocity fields is set to 0, and by optimizing equation below come for each frame speed field computation initial value:
E(ui)=Edata(ui)+α2Esm(ui)
EdataFor image consistency energy, specific formula is:
Locus is x, and integral domain is Ω, IiFor the i-th two field picture.
EsmFor velocity field smoothed energy, specific formula isα is weight coefficient, wherein, N
For sequence length, i.e. number of image frames, uiFor the i-th frame speed, alpha, gamma is weight coefficient.
Although this initial value is also differed farther out from optimal solution, it supports follow-up optimization process enough.
(3) each frame speed is alternately optimized.When optimizing the i-th frame speed, the velocity field of other frames is accordingly to be regarded as
Known quantity, is consequently formed the energy theorem specifically designed for the i-th frame speed:
(4) formula (4) is deformed, is divided into three parts and is optimized with multiplier alternating direction optimization method.First
It is that, into unconfined formula, divergence constraint switchs to energy term by the constraints conversion of formula (4)
Then three parts are respectively:
F1(ui)=Edata(ui)+α2Esm(ui),
F3(ui)=η Ediv(ui).
Wherein η is coefficient.Multiplier alternating direction optimization method can operate (proximal operator) table with near-end
Show, the algorithm seen in Fig. 2.
Near-end handling function is defined as
(a) optimization method of Part I isHere b
X3-y1 in corresponding diagram 2 in algorithm, correspondence after formula expansion;
Euler-Lagrange equation is first obtained with the calculus of variations, is then deployed using point of safes alternative manner and first order Taylor
Solved.
(b) optimization method of Part II isHere
X3-y2 in c respective figures 2 in algorithm, correspondence after formula expansion;
Using the method for point of safes iteration, its Euler-Lagrange equation is during+1 iteration of kth:
During i=1
During i=N-1
1<i<During N-1
Computation sequence is Finally optimal solution is:
During i=1,
During i=N-1,
1<i<During N-1,
(c) optimization method of Part III isHere
In d corresponding diagrams 2 in algorithm(it is now formula (4) optimization when coefficient η tends to infinity
Target), its optimal solution is equivalent to ui=P (d).
Claims (1)
1. a kind of optical flow velocity method of estimation based on Navier Stokes equation, it is characterised in that comprise the following steps:
(1) multi-resolution pyramid is constructed for each two field picture, optimizes the optical flow velocity field of each level from coarse to finely;
(2) each frame speed of whole sequence is alternately optimized, when optimizing a certain frame speed, by the speed of other frames
Regard constant as in field;
(3) velocity field currently to be optimized, its corresponding energy theorem can be turned into three parts, be optimized using multiplier alternating direction
Method (ADMM) is optimized;Part I energy is image consistency energy and velocity field smoothed energy, Part II energy
For the coupling energy of velocity field in time, Part III energy is the Incoercibility energy of velocity field;
(4) using point of safes alternative manner optimization Part I energy;
(5) using point of safes alternative manner optimization Part II energy;
(6) carry out velocity projections to optimize Part III energy using Poisson's equation;
Using following light stream energy optimization model, it is specially:
Wherein, N is sequence length, i.e. number of image frames, uiFor the i-th frame speed, alpha, gamma is weight coefficient;
EdataFor image consistency energy, specific formula is:
IiFor the i-th two field picture, locus is x, and integral domain is Ω,
EsmFor velocity field smoothed energy, specific formula is
EtemEnergy is coupled for the time, specific formula is,
Speed is thrown into incompressible subspace by P () expressions, the mode i.e. u projected using Poissonout=P (uin) be calculated asFormer frame, a later frame velocity field are represented respectively
Velocity field after advection, fiRepresent the external force of the i-th frame.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510254923.4A CN104915968B (en) | 2015-05-19 | 2015-05-19 | A kind of optical flow velocity method of estimation based on navier stokes equations |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510254923.4A CN104915968B (en) | 2015-05-19 | 2015-05-19 | A kind of optical flow velocity method of estimation based on navier stokes equations |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104915968A CN104915968A (en) | 2015-09-16 |
CN104915968B true CN104915968B (en) | 2017-07-21 |
Family
ID=54085005
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510254923.4A Expired - Fee Related CN104915968B (en) | 2015-05-19 | 2015-05-19 | A kind of optical flow velocity method of estimation based on navier stokes equations |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104915968B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105787901B (en) * | 2016-03-21 | 2018-07-24 | 昆明理工大学 | A kind of multiple dimensioned velocity field measurement method for adjacent two interframe in sun full resolution pricture sequence |
CN107478858B (en) * | 2017-07-24 | 2020-02-18 | 大连理工大学 | Motion speed detection sensor device and detection method based on Stokes vector light stream |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2459091A1 (en) * | 2004-02-26 | 2005-08-26 | Photon Control Inc. | Fiber optic flow sensing device and method |
CN103247058A (en) * | 2013-05-13 | 2013-08-14 | 北京工业大学 | Fast optical flow field calculation method based on error-distributed multilayer grid |
-
2015
- 2015-05-19 CN CN201510254923.4A patent/CN104915968B/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2459091A1 (en) * | 2004-02-26 | 2005-08-26 | Photon Control Inc. | Fiber optic flow sensing device and method |
CN103247058A (en) * | 2013-05-13 | 2013-08-14 | 北京工业大学 | Fast optical flow field calculation method based on error-distributed multilayer grid |
Non-Patent Citations (7)
Title |
---|
Discrete Orthogonal Decomposition and Variational Fluid Flow Estimation;Jing Yuan 等;《Journal of Mathematical Imaging and Vision》;20070620;第28卷(第1期);67-80 * |
Divergence-Free Wavelets and High Order Regularization;S. Kadri-Harouna 等;《International Journal of Computer Vision》;20130331;第103卷(第1期);80-99 * |
Dynamic consistent correlation-variational approach for robust optical flow estimation;D. Heitz 等;《Experiments in Fluids》;20081031;第45卷(第4期);595–608 * |
From Capture to Simulation –Connecting Forward and Inverse Problems in Fluids;James Gregson 等;《ACM Transactions on Graphics》;20140731;第33卷(第4期);第1章,第3-5章,5.2节,6.3节 * |
Stable Fluids;Jos Stam;《Conference on Computer Graphics and Interactive Techniques》;19990701;121-128 * |
Variational Estimation of Experimental Fluid Flows with Physics-Based Spatio-Temporal Regularization;Paul Ruhnau 等;《Measurement Science & Technology》;20071204;第18卷(第3期);755-763 * |
基于图像分解的鲁棒光流计算;方宇强 等;《第二十九届中国控制会议论文集》;20100731;2745-2749 * |
Also Published As
Publication number | Publication date |
---|---|
CN104915968A (en) | 2015-09-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Takizawa et al. | Computer modeling techniques for flapping-wing aerodynamics of a locust | |
Zhang et al. | A deformable surface model for real-time water drop animation | |
WO2017031718A1 (en) | Modeling method of deformation motions of elastic object | |
CA2853625C (en) | Computer simulation of physical processes | |
US7647214B2 (en) | Method for simulating stable but non-dissipative water | |
CN103810725B (en) | A kind of video stabilizing method based on global optimization | |
CN107085629A (en) | A kind of fluid simulation method based on video reconstruction Yu Euler's Model coupling | |
CN102509327B (en) | Multiscale global sampling method for filling image void | |
CN103247058B (en) | A kind of quick the Computation of Optical Flow based on error Distributed-tier grid | |
CN105096326A (en) | Laplace cutout matrix method by using moving least square method | |
Kroll et al. | The DLR flow solver TAU-status and recent algorithmic developments | |
CN105865462A (en) | Three dimensional SLAM method based on events with depth enhanced vision sensor | |
CN104616324A (en) | Target tracking method based on adaptive appearance model and point-set distance metric learning | |
CN104915968B (en) | A kind of optical flow velocity method of estimation based on navier stokes equations | |
Sadlo et al. | Vorticity based flow analysis and visualization for pelton turbine design optimization | |
Mohamed et al. | A finite volume method for scalar conservation laws with stochastic time–space dependent flux functions | |
CN106023286A (en) | Fluid animation accelerated generation method based on data driving | |
CN103839280B (en) | A kind of human body attitude tracking of view-based access control model information | |
US8731880B2 (en) | Invertible contact model | |
Wang et al. | Fast GPU-Based Two-Way Continuous Collision Handling | |
CN102426709B (en) | Real-time motion synthesis method based on fast inverse kinematics | |
Sun et al. | A neural pde solver with temporal stencil modeling | |
Cheng et al. | Visibility optimization using variational approaches | |
Yang et al. | Mesh deformation strategy optimized by the adjoint method on unstructured meshes | |
Attar et al. | Physics-based generative design |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170721 Termination date: 20200519 |
|
CF01 | Termination of patent right due to non-payment of annual fee |