CN117576278A - Heart dynamic ultrasonic simulation method based on statistical ray tracing - Google Patents

Heart dynamic ultrasonic simulation method based on statistical ray tracing Download PDF

Info

Publication number
CN117576278A
CN117576278A CN202311595260.3A CN202311595260A CN117576278A CN 117576278 A CN117576278 A CN 117576278A CN 202311595260 A CN202311595260 A CN 202311595260A CN 117576278 A CN117576278 A CN 117576278A
Authority
CN
China
Prior art keywords
intensity
ultrasonic
heart
ray tracing
simulation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311595260.3A
Other languages
Chinese (zh)
Inventor
温柳英
余江涛
王世元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southwest Petroleum University
Original Assignee
Southwest Petroleum University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southwest Petroleum University filed Critical Southwest Petroleum University
Priority to CN202311595260.3A priority Critical patent/CN117576278A/en
Publication of CN117576278A publication Critical patent/CN117576278A/en
Pending legal-status Critical Current

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T90/00Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation

Abstract

The invention discloses a heart dynamic ultrasonic simulation method based on statistical ray tracing, which belongs to the technical field of computer graphics and medical simulation intersection, and comprises the following steps of S1: initializing physical simulation calculation engine world parameters, and defining human tissue material information according to physical properties of heart, liver, kidney, blood vessel, lung and the like; s2: defining scene file parameters and initializing a scene; s3: calculating the relative position and rotation of each joint in the heart model through a transformation matrix, obtaining grid information of each frame through the transformation matrix, importing the grid information into a physical simulation calculation engine, and updating grids according to time circulation; s4: the ultrasonic probe emits rays according to the sampling angle so as to carry out statistical ray tracing; s5: generating an ultrasonic image by echo; the invention considers the scattering, absorption and propagation of the sound wave in the tissue, is beneficial to the formation of the simulated ultrasonic image, and improves the physical accuracy of the simulation result; real-time analog imaging of tissue organ motion is achieved.

Description

Heart dynamic ultrasonic simulation method based on statistical ray tracing
Technical Field
The invention belongs to the technical field of computer graphics and medical simulation intersection, and particularly relates to a heart dynamic ultrasonic simulation method based on statistical ray tracing.
Background
Ultrasound imaging is a non-invasive imaging technique commonly used in medical diagnostics and biomedical research that uses the propagation and reflection of high frequency sound waves in tissue to generate images. This technique plays an important role in clinical diagnosis, surgical navigation and medical education.
Although the conventional ray tracing algorithm can achieve the real-time effect, the surface of the tissue and organ is mostly rugged, but the conventional ray tracing method considers that the surface of the tissue and organ is a perfect smooth surface, so that the generated ultrasonic image can cause sharp hard shadows, and the statistical ray tracing is a powerful computer graphics technology which has been widely used for simulating the propagation and interaction of rays in a virtual scene. The statistical ray tracing method is applied to ultrasonic simulation to soften shadows, so that the ultrasonic image generation process is simulated more realistically.
The prior ultrasonic imaging method only refers to an implementation scheme aiming at a static scene, and does not optimize the ultrasonic simulation of a heart which is a complex dynamic organ. Therefore, in order to solve the above-mentioned problems, the present invention provides a dynamic ultrasound simulation method for heart based on statistical ray tracing, which is used for realizing dynamic ultrasound simulation of heart beating.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a method for realizing dynamic ultrasonic simulation by using a statistical ray tracing method.
The invention provides a heart dynamic ultrasonic simulation method based on statistical ray tracing, which comprises the following steps:
step S1: initializing a universal parameter of a bulletin engine, and defining human tissue material information according to physical properties of heart, liver, kidney, blood vessel, lung, muscle, bone, blood and skin, wherein the human tissue material information comprises acoustic impedance, attenuation coefficient, mirror incidence, roughness, thickness, expected scattering and standard deviation;
step S2: defining scene file parameters and initializing a scene according to the scene file, wherein the scene file parameters comprise the position, resolution, pulse elongation, sampling angle, sampling number, pitch angle, frequency, vibrator interval, initial intensity of ultrasonic waves, stop threshold, initial medium materials of light rays, imported model files and model scaling factors of an ultrasonic probe;
step S3: the method for importing the heart animation model based on the bullets is provided, the relative position and rotation of each joint in the heart model are calculated through a transformation matrix, grid information of each frame is obtained through the transformation matrix and imported into a bullets engine, and meanwhile grids are updated according to time circulation;
step S31: manufacturing a heart beating animation model;
step S32: using FBXSDK to parse the heart model animation, a mesh is computed that holds each frame:
wherein,indicate->Frame index is +.>Vertex coordinates of>Indicate->Frame index is +.>Vertex global transformation matrix,/, for>Indicating index +.>Vertex initial coordinates of (a);
step S33: converting the animation frame grid into grid information which can be used by a pellet;
wherein,indicate->Frame index is +.>The bulletin world vertex position;
step S34: importing grid information into the physical world, and updating the grid according to a designated time step;
step S4: the ultrasonic probe emits rays according to the sampling angle so as to carry out statistical ray tracing; generating random reflection and refraction directions according to the roughness of the surface material of the sound wave striking point; modifying the position of the hit point according to the thickness of the material on the surface of the hit point, generating an ultrasonic echo, a radio frequency echo, reflection refraction and speckle at the new hit point, and updating the intensity of an ultrasonic beam;
step S41: the radio frequency echo consists of recorded ultrasound echoes:
wherein T represents time, T represents hit time, o represents source point, P T Represent the striking point, Ω represent the hemispherical surface, I t>T (T, o) represents the echo contribution from the source point in the direction ω from the intersection point at time T;
calculated in a discrete manner during practice:
wherein I (r (P) Ti ) By slave P) T To the direction ofω i Ray contribution of direction;
step S42: the catadioptric refraction represents a physical effect that occurs when a hit point reaches the boundary of two media, and a normal direction is randomly generated according to roughness, so that the catadioptric refraction direction is determined, and meanwhile, the catadioptric refraction intensity is calculated based on Snell's law:
wherein θ 1 Representing the angle of reflection, θ 2 The angle of refraction is indicated,V i indicating the direction of incidence after normalization,Nrepresents the normal direction, Z 1 ,Z 2 Respectively represent the acoustic impedances of the two media,V tV r representing the refractive direction and the reflective direction;
the intensity updating process of the sound wave has the expression:
wherein,I i indicating the intensity of the sound wave when the hit point is reached,I r representing the intensity of the reflected wave,I t representing the intensity of the refracted wave;
step S43: the speckle is generated because countless sub-wavelength particles are used as point wave sources to perform omnibearing scattering; calculating a scattering effect through an ultrasonic speckle convolution model:
where x represents the lateral direction, y represents the axial direction, z represents the elevation angle,representing added random noise, r (x, y, z) representing scattering intensity, g (x, y, z) representing human tissue scatterer parameter function, h (x, y, z) being based on sampler (ultrasound probe) frequencyf c A modulated gaussian envelope;
wherein sigma x 、σ y 、σ z Pulse extension rates respectively representing transverse, axial and elevation angles;
step S44: the updated ultrasonic beam intensity, besides the reflection and refraction updating, also attenuates when the ultrasonic beam intensity passes through the medium:
wherein I represents the intensity of the ultrasonic wave after attenuation, I 0 Representing the initial intensity of ultrasonic waves, x representing the distance moved in the medium, and alpha representing the attenuation coefficient of the medium;
step S5: an ultrasound image is generated from the echoes.
Compared with the prior art, the invention has the following beneficial effects: (1) The invention considers the scattering, absorption and propagation of sound waves in tissues, and is beneficial to the formation of simulated ultrasonic images, thereby improving the physical accuracy of simulation results; (2) The invention can realize real-time simulation imaging of tissue organ motion; (3) The invention adopts statistical technique to simulate soft shadow, and the reality is higher than that of the former real-time ultrasonic simulation; (4) The invention allows simulating ultrasound imaging in different situations, which helps to study the changes in ultrasound images under different conditions, thus better understanding of heart disease.
Drawings
For a clearer description of embodiments of the invention or of solutions in the prior art, the drawings which are used in the description of the embodiments or of the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings can be obtained from them without inventive effort for a person skilled in the art.
FIG. 1 is a first flow chart of a statistical ray tracing based dynamic ultrasound simulation method of the heart of the present invention;
FIG. 2 is a second flowchart of a dynamic ultrasound simulation method of the heart based on statistical ray tracing in accordance with the present invention;
FIG. 3 is a third flowchart of a dynamic ultrasound simulation method of the heart based on statistical ray tracing in accordance with the present invention.
Detailed Description
The following further details the invention in order to make the objects, technical solutions and advantages of the invention more apparent. The exemplary embodiments of the present invention and the descriptions thereof are used herein to explain the present invention, but are not intended to limit the invention.
As shown in fig. 1, a method for dynamic ultrasound simulation of a heart based on statistical ray tracing comprises the following steps:
step S1: initializing physical simulation calculation engine world parameters, and defining human tissue material information according to physical properties of heart, liver, kidney, blood vessel, lung, muscle, bone, blood and skin, wherein the human tissue material information comprises acoustic impedance, attenuation coefficient, mirror incidence, roughness, thickness, expected scattering and standard deviation;
the physical simulation calculation engine adopts a bulletin engine, and the bulletin engine supports platforms of Windows, linux, MAC, playstation3, XBOX360, nintendoWii and the like. The bullets are also integrated into Maya and Blender 3D, and parameters are set through a bullets engine, so that a foundation is provided for subsequent dynamic ultrasonic simulation of the heart.
Step S2: defining scene file parameters and initializing a scene according to the scene file, wherein the scene file parameters comprise the position, resolution, pulse elongation, sampling angle, sampling number, pitch angle, frequency, vibrator interval, initial intensity of ultrasonic waves, stop threshold, initial medium materials of light rays, imported model files and model scaling factors of an ultrasonic probe;
step S3: the method for importing the heart animation model based on the bullets is provided, the relative position and rotation of each joint in the heart model are calculated through a transformation matrix, grid information of each frame is obtained through the transformation matrix and imported into a bullets engine, and meanwhile grids are updated according to time circulation;
as shown in fig. 2, step S3 further includes:
step S31: manufacturing a heart beating animation model;
step S32: analyzing the heart model animation by using three-dimensional software, and calculating and storing grids of each frame:
wherein, vert ij Vertex coordinates indicating the index j of the ith frame, globalTrans ij Representing the global transformation matrix of the vertex with index j of the ith frame, V j Representing initial coordinates of the vertex with index j;
step S33: converting the animation frame grid into grid information which can be used by a pellet;
wherein, btVert ij Representing the position of a bulleted world vertex with the index j of the ith frame;
the three-dimensional software uses FBXSDK, which can access three-dimensional files of most three-dimensional suppliers through FBX users. The FBX file format supports all main three-dimensional data elements and two-dimensional, audio and video media elements, and the multi-mode parameters can be analyzed by analyzing the heart model animation through the FBXSDK, so that the accuracy of analysis is ensured.
Step S34: importing grid information into the physical world, and updating the grid according to a designated time step;
step S4: the ultrasonic probe emits rays according to the sampling angle so as to carry out statistical ray tracing; generating random reflection and refraction directions according to the roughness of the surface material of the sound wave striking point; modifying the position of the hit point according to the thickness of the material on the surface of the hit point, generating an ultrasonic echo, a radio frequency echo, reflection refraction and speckle at the new hit point, and updating the intensity of an ultrasonic beam;
as shown in fig. 3, step S4 further includes:
step S41: calculating a radio frequency echo consisting of recorded ultrasound echoes:
wherein T represents time, T represents hit time, o represents source point, P T Represent the striking point, Ω represent the hemispherical surface, I t>T (T, o) represents the echo contribution from the source point in the direction ω from the intersection point at time T;
calculated in a discrete manner during practice:
wherein I (r (P) Ti ) By slave P) T To the direction ofω i Ray contribution of direction;
step S42: the catadioptric refraction represents a physical effect that occurs when a hit point reaches the boundary of two media, and randomly generates a normal direction according to roughness, so that the catadioptric refraction direction is determined, and meanwhile, the catadioptric refraction intensity is calculated based on Snell's law:
wherein θ 1 Representing the angle of reflection, θ 2 The angle of refraction is indicated,V i indicating the direction of incidence after normalization,Nrepresents the normal direction, Z 1 ,Z 2 Respectively represent the acoustic impedances of the two media,V tV r representing the refractive direction and the reflective direction;
the intensity updating process of the sound wave is as follows:
wherein,I i indicating the intensity of the sound wave when the hit point is reached,I r representing the intensity of the reflected wave,I t representing the intensity of the refracted wave;
step S43: the generation of the speckle is realized by using innumerable sub-wavelength particles as point wave sources to perform omnibearing scattering; calculating a scattering effect through an ultrasonic speckle convolution model:
where x represents the lateral direction, y represents the axial direction, z represents the elevation angle,representing added random noise, r (x, y, z) representing scattering intensity, g (x, y, z) representing human tissue scatterer parameter function, h (x, y, z) being based on sampler (ultrasound probe) frequencyf c A modulated gaussian envelope;
wherein sigma x 、σ y 、σ z Pulse extension rates respectively representing transverse, axial and elevation angles;
step S44: updating the intensity of the ultrasonic beam, in addition to the reflection and refraction updating, the intensity of the ultrasonic wave also attenuates when traveling in the medium:
wherein I represents the intensity of the ultrasonic wave after attenuation, I 0 Representing the initial intensity of ultrasonic waves, x representing the distance moved in the medium, and alpha representing the attenuation coefficient of the medium;
s5: the image is created, and the brightness of the area is determined according to the echo intensity as follows:
wherein I is rf Representing the contribution of the current echo to the image, the Intensity represents the echo Intensity, and σ (x, y, z) is represented as follows:
when the human tissue scattering probability ζ (x, y, z) > ρ, wherein ρ is the scattering probability threshold, the human tissue scatterer value, i.e. the contribution δ (x, y, z) =μ provided by the scatterer to the image 0 +ζ (x, y, z) σ, otherwise δ (x, y, z) =0, where μ 0 For scattering expectations, σ is the scattering standard deviation;
wherein row represents the image abscissa, distance represents the distance between the echo and the transducer, c represents the ultrasonic wave propagation speed, defined as 1500m/s, A r Representing the axial resolution;
wherein I is [row,i] Representing the image at [ row, i]Ultrasound image brightness at point I rf [i]Representing echo contributions belonging to the ith beam of sampled waves; and finally, carrying out post-processing on the image, and transforming the image under the polar coordinate system into a Cartesian coordinate system to obtain a final simulation image.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various equivalent changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (8)

1. A method for dynamic ultrasound simulation of a heart based on statistical ray tracing, the method comprising:
step S1: initializing physical simulation calculation engine world parameters, and defining human tissue material information according to physical properties of heart, liver, kidney, blood vessel, lung, muscle, bone, blood and skin, wherein the human tissue material information comprises acoustic impedance, attenuation coefficient, mirror incidence, roughness, thickness, expected scattering and standard deviation;
step S2: defining scene file parameters and initializing a scene according to the scene file, wherein the scene file parameters comprise the position, resolution, pulse elongation, sampling angle, sampling number, pitch angle, frequency, vibrator interval, initial intensity of ultrasonic waves, stop threshold, initial medium materials of light rays, imported model files and model scaling factors of an ultrasonic probe;
step S3: calculating the relative position and rotation of each joint in the heart model through a transformation matrix, obtaining grid information of each frame through the transformation matrix, importing the grid information into a physical simulation calculation engine, and updating grids according to time circulation;
step S4: the ultrasonic probe emits rays according to the sampling angle so as to carry out statistical ray tracing; generating random reflection and refraction directions according to the roughness of the surface material of the sound wave striking point; modifying the position of the hit point according to the thickness of the material on the surface of the hit point, generating an ultrasonic echo, a radio frequency echo, reflection refraction and speckle at the new hit point, and updating the intensity of an ultrasonic beam;
step S5: an ultrasound image is generated from the echoes.
2. The method of dynamic ultrasound simulation of the heart based on statistical ray tracing of claim 1, wherein said step S3 further comprises:
step S31: manufacturing a heart beating animation model;
step S32: analyzing the heart model animation by using three-dimensional software, and calculating and storing grids of each frame;
step S33: converting the animation frame grid into grid information which can be used by a physical simulation calculation engine;
step S34: the grid information is imported into the physical world and the grid is updated at specified time steps.
3. The method of dynamic ultrasound simulation of the heart based on statistical ray tracing of claim 1, wherein said step S4 further comprises:
step S41: calculating a radio frequency echo consisting of recorded ultrasonic echoes;
step S42: randomly generating a normal direction according to the roughness, determining a reflection and refraction direction, and simultaneously calculating reflection and refraction intensity based on Snell's law;
step S43: generating speckle, and calculating a scattering effect through an ultrasonic speckle convolution model;
step S44: in addition to updating the reflection refraction, the intensity of the ultrasonic wave beam is updated and also attenuated when the ultrasonic wave passes through the medium.
4. A method of dynamic ultrasound simulation of the heart based on statistical ray tracing as claimed in claim 2,
the analysis heart model animation has the expression:
wherein,indicate->Frame index is +.>Vertex coordinates of>Indicate->Frame index is +.>Vertex global transformation matrix,/, for>Indicating index +.>Vertex initial coordinates of (a);
the expression of converting the animation frame grid into the grid information which can be used by the physical simulation calculation engine is as follows:
wherein,indicate->Frame index is +.>Is calculated by the physical simulation of the engine world vertex position, +.>[0],/>[1],[2]The first three coordinates of the quadruple are represented respectively.
5. A method of dynamic ultrasound simulation of the heart based on statistical ray tracing as claimed in claim 3, wherein the calculated radio frequency echo consists of recorded ultrasound echoes expressed as:
wherein T represents time, T represents hit time, o represents source point, P T Represent the striking point, Ω represent the hemispherical surface, I t>T (T, o) represents the echo contribution from the source point in the direction ω from the intersection point at time T;
wherein I (r (P) Ti ) By slave P) T To omega i The ray contribution of the direction, n, represents the number of ultrasound echoes.
6. A method of dynamic ultrasound simulation of the heart based on statistical ray tracing as claimed in claim 3, wherein the reflected-refraction intensity is calculated based on Snell's law by the expression:
wherein θ 1 Representing the angle of reflection, θ 2 The angle of refraction is indicated,V i indicating the direction of incidence after normalization,Nrepresents the normal direction, Z 1 ,Z 2 Respectively represent the acoustic impedances of the two media,V tV r representing the refractive direction and the reflective direction;
the intensity updating process of the sound wave has the expression:
wherein,I i indicating the intensity of the sound wave when the hit point is reached,I r representing the intensity of the reflected wave,I t representing the intensity of the refracted wave.
7. A method for dynamic ultrasound simulation of the heart based on statistical ray tracing as claimed in claim 3,
the scattering effect is calculated through an ultrasonic speckle convolution model, and the expression is as follows:
where x represents the lateral direction, y represents the axial direction, z represents the elevation angle,representing added random noise, r (x, y, z) representing scattering intensity, g (x, y, z) representing human tissue scatterer parameter function, h (x, y, z) being based on sampler (ultrasound probe) frequencyf c Modulated (modulated)Gaussian envelope curve;
wherein sigma x 、σ y 、σ z Pulse extension rates in the lateral, axial and elevation directions are respectively indicated.
8. A method of dynamic ultrasound simulation of the heart based on statistical ray tracing as claimed in claim 3, wherein the updated ultrasound beam intensity is expressed as:
wherein I represents the intensity of the ultrasonic wave after attenuation, I 0 The ultrasonic initial intensity is represented by x, the distance traveled in the medium, α, the attenuation coefficient of the medium, and e, the natural constant.
CN202311595260.3A 2023-11-28 2023-11-28 Heart dynamic ultrasonic simulation method based on statistical ray tracing Pending CN117576278A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311595260.3A CN117576278A (en) 2023-11-28 2023-11-28 Heart dynamic ultrasonic simulation method based on statistical ray tracing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311595260.3A CN117576278A (en) 2023-11-28 2023-11-28 Heart dynamic ultrasonic simulation method based on statistical ray tracing

Publications (1)

Publication Number Publication Date
CN117576278A true CN117576278A (en) 2024-02-20

Family

ID=89860489

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311595260.3A Pending CN117576278A (en) 2023-11-28 2023-11-28 Heart dynamic ultrasonic simulation method based on statistical ray tracing

Country Status (1)

Country Link
CN (1) CN117576278A (en)

Similar Documents

Publication Publication Date Title
US10565900B2 (en) Ray-tracing methods for realistic interactive ultrasound simulation
Burger et al. Real-time GPU-based ultrasound simulation using deformable mesh models
Kutter et al. Visualization and GPU-accelerated simulation of medical ultrasound from CT images
KR101717695B1 (en) Simulation of medical imaging
US8241041B2 (en) Process and system for simulation or digital synthesis of sonographic images
Mohamed et al. A survey on 3D ultrasound reconstruction techniques
EP1844438B1 (en) Method and system for the simulation or digital synthesis of echographic images
CN107533808A (en) Ultrasonic simulation system and method
Piórkowski et al. The transesophageal echocardiography simulator based on computed tomography images
WO2007100263A1 (en) Method for simulation of ultrasound images
CN117576278A (en) Heart dynamic ultrasonic simulation method based on statistical ray tracing
Li et al. Fast marching method to correct for refraction in ultrasound computed tomography
Wang et al. A real-time ultrasound simulator using Monte-Carlo path tracing in conjunction with optix engine
Szostek et al. Real-time simulation of ultrasound refraction phenomena using ray-trace based wavefront construction method
Starkov et al. Ultrasound simulation with animated anatomical models and on-the-fly fusion with real images via path-tracing
CN112001998B (en) Real-time simulation ultrasonic imaging method based on OptiX and Unity3D virtual reality platforms
Rohling et al. Issues in 3-D free-hand medical ultrasound imaging
Law et al. Geometrical-Acoustics-based Ultrasound Image Simulation.
CN116486021B (en) Three-dimensional model construction method and system based on CT density value and ultrasonic gray value
Amadou et al. Cardiac ultrasound simulation for autonomous ultrasound navigation
Jin et al. Echocardiography Segmentation Based on Cross-modal Data Augmentation Method
Li et al. Realistic Ultrasound Synthesis based on Diagnostic CT to Facilitate Ultrasound-Guided Robotic Spine Surgery
US11532244B2 (en) System and method for ultrasound simulation
CN116030037A (en) Ultrasonic image simulation method based on self-supervision learning
AU2022312475A1 (en) Ultrasound simulation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination