CN114973887B - Interactive display system for realizing ultrasonic image integration by combining multiple modules - Google Patents

Interactive display system for realizing ultrasonic image integration by combining multiple modules Download PDF

Info

Publication number
CN114973887B
CN114973887B CN202210545481.9A CN202210545481A CN114973887B CN 114973887 B CN114973887 B CN 114973887B CN 202210545481 A CN202210545481 A CN 202210545481A CN 114973887 B CN114973887 B CN 114973887B
Authority
CN
China
Prior art keywords
ultrasonic
volume data
data
interactive display
pose
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210545481.9A
Other languages
Chinese (zh)
Other versions
CN114973887A (en
Inventor
石宇
陈芸
刘俐
王卫军
汪国平
赵勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Wangyue Medical Technology Co ltd
Peking University Shenzhen Hospital
Original Assignee
Shenzhen Wangyue Medical Technology Co ltd
Peking University Shenzhen Hospital
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Wangyue Medical Technology Co ltd, Peking University Shenzhen Hospital filed Critical Shenzhen Wangyue Medical Technology Co ltd
Priority to CN202210545481.9A priority Critical patent/CN114973887B/en
Publication of CN114973887A publication Critical patent/CN114973887A/en
Application granted granted Critical
Publication of CN114973887B publication Critical patent/CN114973887B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B23/00Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
    • G09B23/28Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
    • G09B23/286Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine for scanning or photography techniques, e.g. X-rays, ultrasonics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10132Ultrasound image
    • G06T2207/101363D ultrasound image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medicinal Chemistry (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Algebra (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Chemical & Material Sciences (AREA)
  • Pure & Applied Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

The invention relates to the technical field of ultrasonic simulation, in particular to an interactive display system for realizing ultrasonic image integration by combining multiple modules. The ultrasonic interactive pose fusion system comprises a human body simulation unit, a pose fusion calculation unit and an ultrasonic interactive display unit. The invention establishes the human body simulation model through the human body simulation unit, so that an operator can perform real operation on the human body simulation model, then the pose fusion calculation unit identifies the operation pose, the operator can move at any pose, and the ultrasonic interactive display unit interactively operates the pose data in the human body simulation model to acquire the body data, the body data conversion and the body data configuration of the human body simulation unit at different angles, so that a digital ultrasonic image can be displayed, an integrated interactive display environment of diagnosis and training is realized, so that an ultrasonic doctor can perform real operation training close to real diagnosis consistency in the interactive display environment, the limitation of scanning angle and direction is avoided, and the diagnosis comprehensiveness is improved.

Description

Interactive display system for realizing ultrasonic image integration by combining multiple modules
Technical Field
The invention relates to the technical field of ultrasonic simulation, in particular to an interactive display system for realizing ultrasonic image integration by combining multiple modules.
Background
Ultrasonic diagnosis training has been the pain point in medical teaching. In the traditional teaching, medical students usually learn by explaining images through teachers, and only contact real patients and cases in actual hospital practice; however, in the actual practice process, the doctor with the shift usually only lets the doctor perform the hand practice on the relatively simple patient; for relatively rare cases, medical students have no chance of practical operation, and in order to solve the pain point, the medical students have higher operation familiarity and image judgment when officially going on duty, and different ultrasonic diagnosis training systems are developed in the academic world all the time;
in view of the fact that an ultrasonic diagnosis training system is mainly developed in modes of picture and video display cases at the initial stage and 3d reconstruction and the like gradually at the follow-up stage, different human body data reconstruction directions are developed and applied to a simulation teaching system, however, ultrasonic images cannot be accurately displayed in the existing simulation teaching system, scanning angles and directions are limited during simulation of ultrasonic diagnosis, ultrasonic simulation display is incomplete, all angles cannot be normally simulated, and positions between a probe and a receiver need to be adjusted repeatedly to normally work, an interactive display system for realizing ultrasonic image integration by multi-module combination is provided.
Disclosure of Invention
The invention aims to provide an interactive display system for realizing ultrasonic image integration by combining multiple modules so as to solve the problems in the background technology.
In order to achieve the purpose, the invention provides an interactive display system for realizing ultrasonic image integration by combining multiple modules, which comprises a human body simulation unit, a pose fusion calculation unit and an ultrasonic interactive display unit;
the human body simulation unit is used for acquiring, processing and reconstructing real ultrasonic diagnosis data to form a data set basically consistent with real human ultrasonic data;
the pose fusion calculation unit is used for identifying the pose of an operator through a sensor and fusing and determining the pose of pose data;
the ultrasonic interactive display unit is used for establishing an interactive display environment, interactively operating the pose data of the pose fusion calculation unit in the human body simulation unit, and converting the acquired volume data, the volume data conversion and the volume data configuration of the human body simulation unit into digital ultrasonic images.
When the ultrasonic interactive display unit is used, the human body simulation model is established through the human body simulation unit, so that an operator can perform actual operation on the human body simulation model, then the pose fusion calculation unit identifies the operation pose, the operator can move in any pose, the pose data is interactively operated in the human body simulation model through the ultrasonic interactive display unit, and the body data, the body data conversion and the body data configuration of the human body simulation unit at different angles are obtained, so that a digital ultrasonic image can be displayed, the integrated interactive display environment for diagnosis and training is realized, an ultrasonic doctor can perform actual operation training close to real diagnosis consistency in the interactive display environment, the limitation of scanning angles and directions is avoided, and the diagnosis comprehensiveness is improved.
As a further improvement of the technical scheme, the human body simulation unit comprises a human body organ identification and segmentation module, a three-dimensional volume data reconstruction module and a data registration and fusion module;
the human organ identification and segmentation module is used for collecting on an ultrasonic machine and acquiring an available volume data file;
the three-dimensional data reconstruction module is used for classifying and screening the volume data, analyzing the volume data structure after screening is finished, acquiring the three-dimensional volume data of the volume data file, and reconstructing and converting the three-dimensional volume data into virtual volume data;
the data registration and fusion module is used for configuring the virtual volume data into source catalogues of different organs and cases, completing naming, anchoring specific spatial position parameters of the volume data through the spatial positioning equipment, and finely adjusting the parameters to ensure that information such as three-dimensional position, direction, proportion and the like of the virtual volume data are consistent with an actual human body, so as to form a human body simulation model.
As a further improvement of the technical scheme, the pose fusion calculation unit adopts a posture sensor.
As a further improvement of the technical solution, the ultrasound interactive display unit comprises an interactive measurement calculation module, a volume data truncation calculation module and an ultrasound image interactive display module;
the interactive measurement calculation module is used for interactively operating the pose determination data of the pose fusion calculation unit on the human body simulation unit, measuring and calculating coordinate information, and mapping the coordinate information to constructed case volume data to form time-series ultrasonic volume data;
the volume data truncation calculation module is used for receiving ultrasonic volume data, generating a real-time section for the ultrasonic volume data, irradiating the real-time generated section with light, projecting the section onto a projection plate arranged on the outer side of the volume data, and taking an image on the projection plate as an ultrasonic simulation image truncated at the moment;
the ultrasonic image interactive display module is used for superposing all axial position images in a scanning range by using a multi-plane reconstruction algorithm, then carrying out image reconstruction on coronaries, sagittal positions and any angle inclined positions of tissues appointed by recombination lines marked by certain marked lines, and displaying an ultrasonic image in real time.
As a further improvement of the technical solution, the ultrasound interactive display unit further comprises a multi-point synchronous acquisition module, wherein the multi-point synchronous acquisition module is used for acquiring synchronous ultrasound data of each pose point of a human organ in an area array sensor distribution form to form conical multi-layer ultrasound data of each pose point.
As a further improvement of the technical solution, the ultrasound interactive display unit further includes a deformation calculation module, where the deformation calculation module is configured to perform registration and fusion calculation on the ultrasound data acquired at multiple time points to form a time series of ultrasound volume data, perform time series of deformation calculation on each tissue and organ to construct a deformation state of each tissue and organ, and learn and calculate a deformation state model between each tissue and organ as a sample by using a deep learning method.
As a further improvement of the technical solution, the ultrasound interactive display unit further includes an image processing module, and the image processing module is configured to provide a fan-shaped mask for the image, simulate the feeling of a real probe, adjust the size of the image, and adjust the brightness and the contrast.
Compared with the prior art, the invention has the beneficial effects that:
in the interactive display system for realizing the integration of the ultrasonic images by combining the multiple modules, a human body simulation model is established through a human body simulation unit, so that an operator can perform real operation on the human body simulation model, then the pose fusion calculation unit identifies the operation pose, the operator can move in any pose, the pose data is interactively operated in the human body simulation model through the ultrasonic interactive display unit, and the body data, the body data conversion and the body data configuration of the human body simulation unit at different angles are obtained, so that the digital ultrasonic images can be displayed, the integrated interactive display environment for diagnosis and training is realized, so that an ultrasonic doctor can perform real operation training close to real diagnosis consistency in the interactive display environment, the limitation of scanning angles and directions is avoided, and the diagnosis comprehensiveness is improved.
Drawings
FIG. 1 is a schematic diagram showing the overall structure of embodiment 1 of the present invention;
FIG. 2 is a schematic diagram of a structure of an ultrasound interactive display unit according to embodiment 1 of the present invention;
fig. 3 is a diagram showing ultrasound volume data in example 1 of the present invention.
The various reference numbers in the figures mean:
100. a human body simulation unit; 200. a pose fusion calculation unit; 300. and an ultrasonic interactive display unit.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
Referring to fig. 1 to 3, the present embodiment provides an interactive display system for realizing ultrasonic image integration by combining multiple modules, which includes a human body simulation unit 100, a pose fusion calculation unit 200, and an ultrasonic interactive display unit 300;
the human body simulation unit 100 is used for collecting, processing and reconstructing real ultrasonic diagnostic data to form a data set which is basically consistent with real ultrasonic data, so that a human body simulation model is conveniently established, simulation can be performed on the human body simulation model, and medical students can perform practical operation;
specifically, the human body simulation unit 100 includes a human body organ identification and segmentation module, a three-dimensional volume data reconstruction module, and a data registration and fusion module;
the human organ recognition and segmentation module is used for collecting on an ultrasonic machine, acquiring available volume data files, acquiring SOP (sequence of events) according to a standard, and acquiring volume data of corresponding cases: according to the series sublist of the competence construction of the science of Oncology of the national health and continuing education center 'Special primary teaching material for the competence construction of the department of ultrasound medicine', the healthy human body image, the example image of the case and the like of the practice demonstration content required by teaching and education are confirmed, the volume data are collected according to the method specified in the teaching material, the standard volume data are obtained, and the standard volume data are exported according to the correct data format, so that the volume data are obtained;
the three-dimensional data reconstruction module is used for classifying and screening the volume data, analyzing a volume data structure after screening is completed, acquiring three-dimensional volume data of a volume data file, and reconstructing and converting the three-dimensional volume data into virtual volume data;
the data registration and fusion module is used for configuring the virtual volume data into source directories of different organs and cases, completing naming, anchoring specific spatial position parameters of the volume data through spatial positioning equipment, and finely adjusting the parameters to ensure that information such as three-dimensional position, direction and proportion of the virtual volume data is consistent with an actual human body, so as to form a human body simulation model;
in summary, the existing volume data can be obtained according to the human organ identification and segmentation module, the three-dimensional volume data can be obtained according to the existing volume data, the virtual volume data can be obtained according to the three-dimensional volume data, then the virtual volume data is subjected to three-dimensional simulation on a computer, and meanwhile, the generated human simulation model is consistent with the actual human body through the data registration and fusion module, so that the ultrasonic operation demonstration can be conveniently performed subsequently.
The pose fusion calculation unit 200 is configured to identify a pose of an operator through a sensor, and perform fusion pose determination on pose data, that is, the operator performs ultrasonic diagnosis operation consistent with actual diagnosis operation to fuse the operated pose into a pose, so that the pose determination data is conveniently transmitted to the human body simulation unit 100 for reaction, and a scene of an actual ultrasonic diagnosis patient can be simulated;
when the ultrasonic detector performs the ultrasonic examination operation on the human body simulation model of the human body simulation unit 100, the deformation state of each tissue organ can drive the deformation of body data, so that the deformation of the human body organs and the deformation between the organs can be simulated.
In addition, the pose fusion calculation unit 200 adopts a pose sensor which is a high-performance three-dimensional motion pose measurement system based on an MEMS technology and comprises motion sensors such as a three-axis gyroscope, a three-axis accelerometer, a three-axis electronic compass and the like, obtains data such as a three-dimensional pose and an orientation subjected to temperature compensation through an embedded low-power-consumption ARM processor, and outputs zero-drift three-dimensional pose orientation data expressed by quaternion and euler angle in real time by using a quaternion-based three-dimensional algorithm and a special data fusion technology, so that the operation pose of an operator can be determined;
wherein, a control handle is constituteed to a plurality of sensors that attitude sensor includes, and the operator is convenient according to control handle direction regulation.
The ultrasonic interactive display unit 300 is configured to establish an interactive display environment, interactively operate the pose determination data of the pose fusion calculation unit 200 on the human body simulation unit 100, and convert the acquired volume data, volume data conversion, and volume data configuration of the human body simulation unit 100 into a digital ultrasonic image.
Further, the ultrasound interactive display unit 300 includes an interactive measurement calculation module, a volume data truncation calculation module, and an ultrasound image interactive display module;
the interactive measurement calculation module is used for interactively operating the pose determination data of the pose fusion calculation unit 200 on the human body simulation unit 100, measuring and calculating coordinate information, and mapping the coordinate information to constructed case volume data to form time-series ultrasonic volume data;
the volume data truncation calculation module is used for receiving ultrasonic volume data, generating a real-time section for the ultrasonic volume data, irradiating the real-time generated section with light rays, projecting the section on a projection plate arranged outside the volume data, and taking an image on the projection plate as an ultrasonic simulation image truncated at the moment;
the ultrasonic image interactive display module is used for superposing all axial position images in a scanning range by using a multi-plane reconstruction algorithm, then carrying out coronal, sagittal and any angle oblique position image recombination on tissues appointed by recombination lines marked by certain marked lines, and displaying an ultrasonic image in real time;
therein, as shown in fig. 3, the Dicom file of the ultrasound acquisition is converted into a series of picture sequences, and the ultrasound volume data is formed according to the stacking of the picture sequences.
When the ultrasonic interactive display unit 300 is used, a human body simulation model is built through the human body simulation unit 100, so that an operator can perform actual operation on the human body simulation model, then the pose fusion calculation unit 200 identifies the operation pose, the operator can move in any pose, the pose data is interactively operated in the human body simulation model through the ultrasonic interactive display unit 300, the body data conversion and the body data configuration of the human body simulation unit 100 at different angles are obtained, so that a digital ultrasonic image can be displayed, the integrated interactive display environment of diagnosis and training is realized, an ultrasonic doctor can perform actual operation training close to real diagnosis consistency in the interactive display environment, the limitation of scanning angles and directions is avoided, and the diagnosis comprehensiveness is improved.
Example 2
The present embodiment differs from embodiment 1 in that precision loss is caused to registration in consideration of peristaltic movement of a human organ, and therefore, in order to improve the ultrasound diagnosis accuracy, wherein:
the ultrasonic interactive display unit 300 further comprises a multi-point synchronous acquisition module, wherein the multi-point synchronous acquisition module is used for acquiring synchronous ultrasonic data of each pose point of a human organ in an area array sensor distribution form to form conical multi-layer ultrasonic data of each pose point;
specifically, when the cone-shaped multilayer ultrasonic data acquired at multiple points are subjected to fusion correction, the data obtained by ultrasonic simulation is more accurate by selecting the ultrasonic data with the highest precision.
Example 3
In view of the fact that the ultrasound images at a plurality of time points cannot be diagnosed, resulting in an inaccurate diagnosis result, the present embodiment is different from embodiment 1 in order to obtain ultrasound volume data at a plurality of time points, wherein:
the ultrasonic interactive display unit 300 further comprises a deformation calculation module, wherein the deformation calculation module is used for registering and fusing the acquired ultrasonic data at a plurality of time points to form a time series of ultrasonic volume data, performing time series of deformation calculation on each tissue organ, constructing the deformation state of each tissue organ, and using the deformation state as a sample to learn and calculate a deformation state model between each tissue organ by adopting a deep learning method;
therefore, the change of the ultrasonic volume data at different time points can be observed from a time sequence, and the accuracy of ultrasonic diagnosis is improved, wherein in the process of simulating diagnosis detection, the section calculation of the human body data set can be adopted to obtain the section ultrasonic image, and if the acquisition of multiple time points is adopted, the section image is dynamic.
Example 4
Considering that the ultrasound image conversion process causes distortion, the present embodiment is different from embodiment 1 in order to improve the image clarity, wherein:
the ultrasound interactive display unit 300 further comprises an image processing module, wherein the image processing module is used for providing a fan-shaped mask for the image, simulating the feeling of a real probe, adjusting the size of the image to provide more complete imaging data, and adjusting the brightness and the contrast;
specifically, in the current scheme, firstly, a dicom-format image source file derived from a hospital ultrasonic machine is converted into a ni format through 3D Slicer software, and then the ni file is segmented and compressed and converted into a png picture sequence through a python script to form body data.
The foregoing shows and describes the general principles, essential features, and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, and the preferred embodiments of the present invention are described in the above embodiments and the description, and are not intended to limit the present invention. The scope of the invention is defined by the appended claims and equivalents thereof.

Claims (4)

1. The utility model provides an interactive display system that multimode combines realization ultrasonic image integration which characterized in that: the system comprises a human body simulation unit (100), a pose fusion calculation unit (200) and an ultrasonic interactive display unit (300);
the human body simulation unit (100) is used for acquiring, processing and reconstructing real ultrasonic diagnosis data to form a data set basically consistent with real human ultrasonic data;
the pose fusion calculation unit (200) is used for identifying the pose of an operator through a sensor and fusing and determining the pose of pose data;
the ultrasonic interactive display unit (300) is used for establishing an interactive display environment, interactively operating the pose determination data of the pose fusion calculation unit (200) in the human body simulation unit (100), and converting the acquired volume data, the volume data conversion and the volume data configuration of the human body simulation unit (100) into digital ultrasonic images;
the ultrasonic interactive display unit (300) further comprises a multi-point synchronous acquisition module, wherein the multi-point synchronous acquisition module is used for acquiring synchronous ultrasonic data of each pose point of a human organ in an area array sensor distribution form to form conical multi-layer ultrasonic data of each pose point;
the ultrasonic interactive display unit (300) further comprises a deformation calculation module, wherein the deformation calculation module is used for carrying out registration and fusion calculation on the ultrasonic data acquired at a plurality of time points to form a time series of ultrasonic volume data, carrying out time series deformation calculation on each tissue organ to construct the deformation state of each tissue organ, and learning and calculating a deformation state model between each tissue organ by adopting a deep learning method as a sample;
the ultrasonic interactive display unit (300) comprises an interactive measurement calculation module, a volume data truncation calculation module and an ultrasonic image interactive display module;
the interactive measurement calculation module is used for interactively operating the pose determination data of the pose fusion calculation unit (200) on the human body simulation unit (100), measuring and calculating coordinate information, and mapping the coordinate information to constructed case volume data to form time-series ultrasonic volume data;
the volume data truncation calculation module is used for receiving ultrasonic volume data, generating a real-time section for the ultrasonic volume data, irradiating the real-time generated section with light, projecting the section onto a projection plate arranged on the outer side of the volume data, and making an image on the projection plate be an ultrasonic simulation image of the ultrasonic volume data section;
the ultrasonic image interactive display module is used for superposing all axial position images in a scanning range by using a multi-plane reconstruction algorithm, then carrying out image reconstruction on coronaries, sagittal positions and any angle inclined positions of tissues appointed by recombination lines marked by certain marked lines, and displaying an ultrasonic image in real time.
2. The interactive display system for realizing ultrasound image integration by combining multiple modules according to claim 1, wherein: the human body simulation unit (100) comprises a human body organ identification and segmentation module, a three-dimensional data reconstruction module and a data registration and fusion module;
the human organ identification and segmentation module is used for collecting on an ultrasonic machine and acquiring an available volume data file;
the three-dimensional data reconstruction module is used for classifying and screening the volume data, analyzing a volume data structure after screening is completed, acquiring the three-dimensional volume data of a volume data file, and reconstructing and converting the three-dimensional volume data into virtual volume data;
the data registration and fusion module is used for configuring the virtual volume data into source catalogues of different organs and cases, completing naming, anchoring specific spatial position parameters of the volume data through the spatial positioning equipment, and finely adjusting the parameters to ensure that the three-dimensional position, direction and proportion information of the virtual volume data are consistent with those of an actual human body, so as to form a human body simulation model.
3. The interactive display system for realizing ultrasonic image integration by combining multiple modules according to claim 1, wherein: the pose fusion calculation unit (200) adopts a posture sensor.
4. The interactive display system for realizing ultrasonic image integration by combining multiple modules according to claim 1, wherein: the ultrasonic interactive display unit (300) further comprises an image processing module, wherein the image processing module is used for providing a fan-shaped mask for the image, simulating the feeling of a real probe, adjusting the size of the image and adjusting the brightness and the contrast.
CN202210545481.9A 2022-05-19 2022-05-19 Interactive display system for realizing ultrasonic image integration by combining multiple modules Active CN114973887B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210545481.9A CN114973887B (en) 2022-05-19 2022-05-19 Interactive display system for realizing ultrasonic image integration by combining multiple modules

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210545481.9A CN114973887B (en) 2022-05-19 2022-05-19 Interactive display system for realizing ultrasonic image integration by combining multiple modules

Publications (2)

Publication Number Publication Date
CN114973887A CN114973887A (en) 2022-08-30
CN114973887B true CN114973887B (en) 2023-04-18

Family

ID=82985111

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210545481.9A Active CN114973887B (en) 2022-05-19 2022-05-19 Interactive display system for realizing ultrasonic image integration by combining multiple modules

Country Status (1)

Country Link
CN (1) CN114973887B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001095804A (en) * 1999-09-30 2001-04-10 Matsushita Electric Ind Co Ltd Ultrasonic image diagnostic apparatus

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4733938B2 (en) * 2004-07-16 2011-07-27 株式会社東芝 Ultrasonic diagnostic apparatus and ultrasonic image processing apparatus
CN1801214A (en) * 2005-11-18 2006-07-12 厦门大学 Apparatus and method for processing tumor image information based on digital virtual organ
JP5454844B2 (en) * 2008-08-13 2014-03-26 株式会社東芝 Ultrasonic diagnostic apparatus, ultrasonic image display apparatus, and ultrasonic image display program
CN104574329B (en) * 2013-10-09 2018-03-09 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic fusion of imaging method, ultrasonic fusion of imaging navigation system
CN105078514A (en) * 2014-04-22 2015-11-25 重庆海扶医疗科技股份有限公司 Construction method and device of three-dimensional model, image monitoring method and device
CN104463952A (en) * 2014-11-10 2015-03-25 中国科学技术大学 Human body scanning and modeling method
CN105160957A (en) * 2015-07-09 2015-12-16 宋雪燕 Ultrasonic training control system based on CT image simulation and positioning
EP3376472A1 (en) * 2017-03-13 2018-09-19 Koninklijke Philips N.V. Anatomical measurements from ultrasound data
FR3071654B1 (en) * 2017-09-27 2020-10-23 Insimo METHOD AND SYSTEM FOR SIMULATION OF A MORPHOLOGICAL AND / OR FUNCTIONAL MODIFICATION OF A HUMAN OR ANIMAL ORGAN
US10636142B2 (en) * 2018-04-20 2020-04-28 Siemens Healthcare Gmbh Real-time and accurate soft tissue deformation prediction
CN111863249A (en) * 2020-08-07 2020-10-30 北京大学深圳医院 Virtual reality ultrasonic image simulation training method and system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001095804A (en) * 1999-09-30 2001-04-10 Matsushita Electric Ind Co Ltd Ultrasonic image diagnostic apparatus

Also Published As

Publication number Publication date
CN114973887A (en) 2022-08-30

Similar Documents

Publication Publication Date Title
RU2740259C2 (en) Ultrasonic imaging sensor positioning
US20160328998A1 (en) Virtual interactive system for ultrasound training
CN111529063A (en) Operation navigation system and method based on three-dimensional reconstruction multi-mode fusion
CN110827644A (en) Ultrasonic diagnosis virtual teaching system
EP2777034B1 (en) Interacting with a three-dimensional object dataset
CA2318746A1 (en) Endoscopic tutorial system
CN113689577B (en) Method, system, equipment and medium for matching virtual three-dimensional model with entity model
CN112151169B (en) Autonomous scanning method and system of humanoid-operation ultrasonic robot
JP2011141402A (en) Simulation device for ultrasonic diagnosis education
CN104274247A (en) Medical surgical navigation method
CN107862912A (en) Medical educational system based on VR technologies
CN102789732A (en) Transesophageal ultrasound visual simulation system and method for teaching and clinical skill training
Rao et al. Learning orthodontic cephalometry through augmented reality: A conceptual machine learning validation approach
CN115153835A (en) Acetabular prosthesis placement guide system and method based on feature point registration and augmented reality
CN109935313A (en) The medical application of three-dimensional visualization and mixed reality
CN115472051A (en) Medical student operation simulation dummy and use method
Advincula et al. Development and future trends in the application of visualization toolkit (VTK): the case for medical image 3D reconstruction
CN107578662A (en) A kind of virtual obstetric Ultrasound training method and system
CN114973887B (en) Interactive display system for realizing ultrasonic image integration by combining multiple modules
CN111489608A (en) Panoramic VR interactive medical ultrasonic digital phantom system teaching method
CN116631252A (en) Physical examination simulation system and method based on mixed reality technology
CN101176683A (en) Preparation method of human body stereo anatomy image as well as application
US20240008845A1 (en) Ultrasound simulation system
CN108564864A (en) A kind of visualization fractional curettage art tutoring system
TWM569887U (en) Augmented reality system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant