CN212181696U - Panoramic VR interactive medical ultrasonic digital phantom system - Google Patents

Abstract

The utility model is a panoramic VR interactive medical ultrasound digital phantom system. The system has two modules, including a digital modeling module and an actual operation generating VR image module; based on the composition of the system, the hardware part is divided into a professional base server and a Personal client server; both of the above two servers contain handheld devices, image digital processing devices, and wearable panoramic VR devices. With the popularization and development of 5G technology, the system connects the network through the server to realize big data cloud computing, which greatly improves the computing speed and transmission efficiency of VR interactive.

Description

A panoramic VR interactive medical ultrasound digital phantom system

technical field

The utility model describes a panoramic VR interactive medical ultrasound digital phantom system. With the maturity of 5G technology, cloud computing is realized, including a digital modeling module and an actual operation generating VR image module, and through a professional local server and a personal client, Realize panoramic VR interaction in the medical field.

Background technique

At present, medical ultrasound learning is mainly based on theoretical learning based on textbooks and related tutorial books. Due to limited medical resources, the time for ultrasound students to get on the machine is far from achieving the purpose of practice; each hospital focuses on different, limited types of cases, and typical cases It is also elusive; coupled with the increasingly tense doctor-patient relationship, most of the patients are resistant to ordinary practitioners conducting examinations for them.

In the teaching of ultrasound simulation at home and abroad, the tissue-mimicking ultrasound phantom is mainly used. First of all, the phantom production process is complicated, the cost is high, and the price is very high. The cost of imported ultrasonic phantoms is higher, ranging from hundreds of thousands to millions. Most hospitals and individuals cannot afford it, so it is difficult to mass produce; Secondly, the image quality of this phantom simulation is average, and most of them cannot achieve functional imaging, such as cardiac examinations; Case data cannot be imported, and human-computer interaction cannot be realized, and it cannot be applied to mock exams and assessments. In conclusion, the implementation and creation of the panoramic VR interactive medical ultrasound digital phantom system can effectively improve the learning efficiency of students and reduce teaching costs.

Utility model content

A panoramic VR interactive medical ultrasound digital phantom system includes a local handheld data acquisition device, a local server, a VR device, a cloud storage center, a cloud computing center, a personal client, and a personal handheld data acquisition device. The device and the hand-held data acquisition device establish connections with the local server and personal client respectively. The local handheld data acquisition device and the personal handheld data acquisition device perform original image acquisition, and the local handheld data acquisition device transmits the collected information to the local server. Personal handheld data The acquisition device transmits the acquisition information to the personal client, the local server and the personal client transmit the original image acquisition information to the cloud computing center for calculation analysis and processing, and upload the processed data to the cloud storage center for storage, the local server and the personal client. VR devices are electrically connected to the above, and the cloud computing center transmits the data analyzed and processed by the cloud computing center to the VR devices through the local server and personal client respectively to generate VR display.

Preferably: both the local handheld data acquisition device and the personal handheld data acquisition device include an ultrasonic transducer, a 10-axis MEMS acceleration gyroscope, a Bluetooth 5.0/5G communication module, a microprocessor and a power supply module, and the ultrasonic transducer , 10-axis MEMS acceleration gyroscope and Bluetooth 5.0/5G communication module are electrically connected to the microprocessor respectively, and the power module is used to supply power to the microprocessor; the ultrasonic transducer generates ultrasonic waves to detect human tissue, and the reflected ultrasonic waves pass through The transducer generates electrical energy and transmits it to the microprocessor;

Preferably: the 10-axis MEMS acceleration gyroscope provides high-precision position transformation information of the detected human tissue, including positioning data of longitude, latitude, and altitude, and the original data can be encrypted when collecting the original data to ensure its traceability. At the same time, the image with positioning data can also be generated during actual operation, and the image with the generated position data can be transmitted to the microprocessor, so as to trace the operator;

The microprocessor converts the electrical energy generated by the ultrasonic transducer into data, and transmits it to the Bluetooth 5.0/5G communication module together with the data from the 10-axis MEMS accelerometer, through which the data is wirelessly transmitted to the local server and personal client Perform image digitization.

Preferably: the VR device includes a panoramic VR device and a virtual touch glove;

Panoramic VR equipment includes glasses-type VR equipment and helmet-type VR equipment;

The headset and the voice module are installed inside the helmet-mounted VR device, and the voice module and the headset are used interactively.

Preferably: the personal client is a mobile phone, and the local server is a computer.

Preferably: a positioning module is integrated on the personal client, which can be positioned in real time.

The teaching method using the panoramic VR interactive medical ultrasound digital phantom system is,

Step 1: In the original image acquisition process, a virtual human body model is produced in the software, and the sites of each standard section are marked on the body surface of each organ, and a database containing two-dimensional image data and angle data is generated at the same time;

Step 2: transmit the two-dimensional image data and angle data obtained in step 1 to the communication module, generate wireless data, transmit it to the local server and transmit it to the cloud server;

Step 3: perform subsequent software processing on the data received by the local server in step 2, and store the data in the local server and the cloud server;

Step 4: Through the system software, the corresponding section database of the corresponding part is called up as needed, and the simulation demonstration of the actual operation is carried out. Finally, the obtained real-time operation data and image generation data are backed up to the local server and cloud server through data transmission.

Preferred: the specific implementation method of step 1 is:

Step a: digital modeling, making a virtual human body model in the software, and marking the sites of each standard section on the body surface of each organ to generate a database;

Step b, using the inspection section corresponding to the database to collect data: the ultrasonic transducer of the handheld device generates ultrasonic waves to detect human tissue, and the reflected ultrasonic waves pass through the transducer to generate electrical energy, which is converted into two by the multi-core microprocessor on the integrated circuit. At the same time, the 10-axis acceleration gyroscope of the handheld device generates accurate angle data with the change of position, and the gyroscope itself is used as the coordinate origin.

Preferred: the specific implementation method of step 2 is:

The two-dimensional image data and angle data obtained in step 1 are simultaneously transmitted to the Bluetooth 5.0/5G communication module through the microprocessor, and wireless data is generated in the communication module and transmitted to the local server.

Preferred: the specific implementation method of step 3 is:

The local server receives the data, and the subsequent processing flow of the software is as follows:

(1) Correct the coordinate origin error caused by the relative position of the transducer and the gyroscope in the handheld device;

(2) the two-dimensional image data and the angle data that the same time point generates, synthesize the image data with coordinate coding, and each pixel on the image corresponds to a coordinate point on the virtual three-dimensional space;

(3) The two-dimensional image with the coordinate point array is decomposed into small pixels with three-dimensional coordinate coding, and stored as raw data independently. When different organs and different sections are converted, the software automatically corrects the gyroscope angle normalization. zero;

(4) The data obtained by invoking the database and generating the VR image through the above-mentioned actual operations are stored in the local server and uploaded to the cloud server to realize resource sharing.

Preferred: the specific implementation method of step 4 is:

The virtual character is called out through the software. When the handheld device reaches the corresponding section of the corresponding organ of the VR virtual human body, the software automatically recognizes and calls out the corresponding section database of the corresponding part; the handheld device 10-axis MEMS acceleration gyroscope generates data with the change of position , transmit it to the Bluetooth 5.0/5G communication module, generate wireless data, and transmit it to the local server/personal client. A visual picture of the composition of hundreds or thousands of small image units, and then generates a video with a frame rate of 12fps, that is, 12 pictures appear per second, which can match the video conventionally stored by the current ultrasound instrument, and then transmit it to the wearable panorama VR equipment and screens, and finally the obtained real-time operation data and image generation data are backed up to local servers and cloud servers through data transmission.

The utility model has the following beneficial effects:

At present, the existing electronic components can basically meet the theoretical requirements of this system. For example, the 10-axis MEMS acceleration gyroscope has extremely high accuracy (including 3 dimensions of acceleration, 3 dimensions of angular velocity, 3 dimensions of angle, 3 dimensions of magnetic field, and 1 dimension of air pressure). , GPS, range: acceleration is ±16g, angular velocity is ±2000°/s, angle is ±180°, resolution: acceleration is 6.1e-5g, angular velocity is 7.6e-3°/s, stability: acceleration is 0.01g , the angular velocity is 0.05°/s, measurement error: 0.01 degrees), the current peak rate of 5G communication is as high as 1Gbps, which has been commercialized, and the data transmission barrier has been broken. At present, the computing speed of the computer can fully meet the requirements of image processing.

The significance of choosing cloud storage or cloud computing in this utility model is: decentralization, each local server can operate independently, and can realize network operation, even if the local server fails, it will not cause data loss.

The system provided by the utility model has the advantages of low cost, simple operation, easy promotion and popularization, real-time interaction in the learning process, and can apply big data and cloud computing, each local can upload and download cases, each server and client All can share resources, so that cases cover a wider range, so that students can acquire more knowledge, and can also promote multidisciplinary exchanges.

Description of drawings

Figure 1 Schematic diagram of the panoramic VR interactive medical ultrasound digital phantom system;

Figure 2 is a schematic diagram of the local version of the handheld device;

In Fig. 2, 1 is an ultrasonic transducer, 2 is a gyroscope, 3 is a microprocessor, 4 is an integrated circuit, 5 is a Bluetooth 5.0/5G module, 6 is a power supply and 7 is a switch;

Figure 3 is a schematic diagram of a personal client version handheld device;

In Figure 3, 2 gyroscopes, 3 microprocessors, 4 integrated circuits, 5 Bluetooth 5.0/5G modules, 6 power supplies and 7 switches;

Figure 4 is a schematic diagram of the original big data collection process;

5 is a schematic diagram of an image synthesis process with angular coordinate data;

Fig. 6 is a schematic diagram of the real-time imaging process of actual operation;

Figure 7 is a structural diagram of the link between the devices held by the local server and the personal client and the cloud.

Detailed ways

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First, the present embodiment will be described with reference to Figures 1-7 of the specification. A teaching method implemented by a panoramic VR interactive medical ultrasound digital phantom system in this embodiment includes the following steps:

Step 1: In the original image acquisition process, a virtual human body model is produced in the software, and the sites of each standard section are marked on the body surface of each organ, and a database containing two-dimensional image data and angle data is generated at the same time;

Step 2: transmit the two-dimensional image data and angle data obtained in step 1 to the communication module, generate wireless data, and transmit to the local server and the cloud server;

Step 3: perform subsequent software processing on the data received by the local server in step 2, and store the data in the local server and transmit it to the cloud server;

Step 4: Through the system software, the corresponding section database of the corresponding part is called up as needed, and the simulation demonstration of the actual operation is carried out. Finally, the obtained real-time operation data and image generation data are backed up to the local server and cloud server through data transmission.

Specific embodiment 2, this embodiment is described with reference to the accompanying drawings 1-7 of the specification. A panoramic VR interactive medical ultrasound digital phantom system of this embodiment is:

The specific implementation method of step 1 is:

Step a: digital modeling, making a virtual human body model in the software, and marking the sites of each standard section on the body surface of each organ to generate a database;

Step b, using the inspection section corresponding to the database to collect data: the ultrasonic transducer of the handheld device generates ultrasonic waves to detect human tissue, and the reflected ultrasonic waves pass through the transducer to generate electrical energy, which is converted into two by the multi-core microprocessor on the integrated circuit. At the same time, the 10-axis acceleration gyroscope of the handheld device generates accurate angle data with the change of position, and the gyroscope itself is used as the coordinate origin.

Embodiment 3 The present embodiment will be described with reference to the accompanying drawings 1-7 of the description. A panoramic VR interactive medical ultrasound digital phantom system of the present embodiment:

The specific implementation method of step 2 is:

The two-dimensional image data and angle data obtained in step 1 are simultaneously transmitted to the Bluetooth 5.0/5G communication module through the microprocessor, and wireless data is generated in the communication module and transmitted to the local server.

Specific embodiment four, the present embodiment is described with reference to the accompanying drawings 1-7 of the specification, a panoramic VR interactive medical ultrasound digital phantom system of the present embodiment:

The specific implementation method of step 3 is:

The local server receives the data, and the subsequent processing flow of the software is as follows:

(1) Correct the coordinate origin error caused by the relative position of the transducer and the gyroscope in the handheld device;

(2) the two-dimensional image data and the angle data that the same time point generates, synthesize the image data with coordinate coding, and each pixel on the image corresponds to a coordinate point on the virtual three-dimensional space;

(3) The two-dimensional image with the coordinate point array is decomposed into small pixels with three-dimensional coordinate coding, and stored as raw data independently. When different organs and different sections are converted, the software automatically corrects the gyroscope angle normalization. zero;

(4) The data obtained by invoking the database and generating the VR image through the above-mentioned actual operations are stored in the local server.

Specific embodiment five, the present embodiment will be described with reference to the accompanying drawings 1-7 of the description. A panoramic VR interactive medical ultrasound digital phantom system of the present embodiment:

The specific implementation method of step 4 is:

The virtual character is called out through the software. When the handheld device reaches the corresponding section of the corresponding organ of the VR virtual human body, the software automatically recognizes and calls out the corresponding section database of the corresponding part; the handheld device 10-axis MEMS acceleration gyroscope generates data with the change of position , transmit it to the Bluetooth 5.0/5G communication module, generate wireless data, and transmit it to the local server/personal client. The local server finds the corresponding pixels with three-dimensional coordinate encoding through the three-dimensional coordinate data, and arranges them according to the corresponding positions. A visual picture of the composition of hundreds or thousands of small image units, and then generates a video with a frame rate of 12fps, that is, 12 pictures appear per second, which can match the video conventionally stored by the current ultrasound instrument, and then transmit it to the wearable panorama VR equipment and screens, and finally the obtained real-time operation data and image generation data are backed up to local servers and cloud servers through data transmission.

Specific embodiment 6, this embodiment is described with reference to the accompanying drawings 1-7 of the specification. A panoramic VR interactive medical ultrasound digital phantom system of this embodiment includes a local handheld data acquisition device, a local server, a VR device, and a cloud storage center. , cloud computing center, personal client and personal handheld data acquisition device, the local handheld data acquisition device and the human handheld data acquisition device establish connections with the local server and the personal client respectively, the local handheld data acquisition device and the personal handheld data acquisition device For original image acquisition, the local handheld data acquisition device transmits the acquisition information to the local server, the personal handheld data acquisition device transmits the acquisition information to the personal client, and the local server and personal client transmit the original image acquisition information to the cloud computing center for calculation. Analyze and process, and upload the processed data to the cloud storage center for storage. VR devices are electrically connected to the local server and personal client respectively, and the cloud computing center transmits the data analyzed and processed by the cloud computing center through the local server and personal client respectively. Generate VR displays for VR devices.

Embodiment 7 This embodiment will be described with reference to the accompanying drawings 1-7 of the description. A panoramic VR interactive medical ultrasound digital phantom system of this embodiment includes a local handheld device and a personal client handheld device:

1) The local handheld device (Figure 2) is a handheld ultrasound instrument with positioning function. The device includes a transducer, a Bluetooth 5.0/5G module, a 10-axis MEMS acceleration gyroscope, and a highly integrated circuit board (including a multi-core microprocessor). ),switch. Its working principle is: A. The stage of collecting raw data: the transducer can convert electrical energy into ultrasonic waves, and at the same time can convert received ultrasonic waves into electrical energy; , magnetic field, air pressure, altitude, etc.); the microprocessor can convert the electric energy generated by the transducer into data, and transmit it to the Bluetooth 5.0/5G communication module together with the data of the gyroscope, through which the data is wirelessly transmitted to the image digital processing. equipment. This handheld device is essentially different from the traditional ultrasound probe. First of all, it is equivalent to a traditional ultrasound diagnostic instrument without a display. The traditional ultrasound probe is wired and only contains transducers inside. The power converted by ultrasound is transmitted to the host. Perform calculations and generate data, and this handheld device is wirelessly connected, and the process of converting electrical energy into data is directly completed in the device itself. Secondly, a 10-axis MEMS acceleration gyroscope is added to the device, which is not available in traditional ultrasonic probes. This gyroscope can provide high-precision position transformation information, and generate three-dimensional spatial position data, which matches the image, and can provide positioning through GPS, generate unique data with addresses, and use blockchain technology for storage. It cannot be tampered with and can be traced to the source, which can not only protect the intellectual property rights of the case uploader, but also facilitate the supervision of students' learning and reduce the possibility of cheating in exams. B. Simulation practice or examination stage: the transducer does not work, only the gyroscope is required to work, which can reduce the consumption of the transducer and prolong the service life of the handheld device;

2) Personal client hand-held device (Figure 3): virtual handheld ultrasound device, the device includes Bluetooth 5.0/5G module, 10-axis acceleration gyroscope, highly integrated circuit board (including multi-core microprocessor), power supply, switch, core The component is a 10-axis acceleration gyroscope, which generates data (including time, acceleration, angle, angular velocity, latitude and longitude, magnetic field, air pressure, altitude, etc.) with the change of the probe position; the microprocessor can transmit the data of the gyroscope to Bluetooth 5.0/ 5G module, through which data is wirelessly transmitted to the mobile phone. Because of the positioning function, it can be used for student attendance.

The 10-axis MEMS acceleration gyroscope provides high-precision position transformation information of the detected human tissue, and generates three-dimensional spatial position data and transmits it to the microprocessor;

The microprocessor converts the electrical energy generated by the ultrasonic transducer into data, and transmits it to the Bluetooth 5.0/5G communication module together with the data from the 10-axis MEMS accelerometer, through which the data is wirelessly transmitted to the local server and personal client Equipment for image digitization:

a) Local server image digital processing equipment: This equipment is mainly completed based on computer post-processing software, which is also very different from the traditional ultrasound machine host. A high-configuration electronic computer can be competent, mainly by installing image processing software and connecting to the cloud storage function to achieve Big data exchange. Working principle: A. Original data acquisition stage: The functions of the image processing software include matching the image data with the three-dimensional space position data, generating new data, and storing the basic data (normal anatomical image data, student personal file data) locally, and Upload to cloud storage space, while case data and exam data are directly uploaded to cloud storage space, reducing unnecessary occupation of local storage space, so that the local server will not affect the running speed due to the large amount of data, but also reduces the Potential for data loss due to local server failure. B. Simulation practice or examination stage: The local server software system has a VR digital phantom, and students can complete operations on the digital phantom. The server collects the position data (section data) from the handheld device, and after post-processing comparison, the The image data generated with the position change is transmitted to the VR software, and the VR software generates the image and transmits it to the VR device. When the VR device is unavailable or for those who cannot tolerate the VR device, the data can be transmitted to the local display, which can also be used for learning and training. take an exam. The images and videos generated by study and examination are automatically stored for later feedback.

b) Personal client image digital processing equipment: mobile phone, mainly APP (mobile phone software), with interactive VR function, and can be displayed directly on the mobile phone screen, this software function is consistent with the local server software algorithm and function, and has interactive Function, mobile phone-handheld device interaction, student-expert interaction, and expert consultation of difficult cases, improve the overall knowledge structure and practical ability of students.

Eighth specific embodiment, the present embodiment will be described with reference to the accompanying drawings 1-7 of the specification. A panoramic VR interactive medical ultrasound digital phantom system of the present embodiment, the wearable panoramic VR device includes: a panoramic VR device and a virtual touch Gloves, glasses-type VR equipment and helmet-type VR equipment; headset and voice module are installed inside the headset-type VR equipment, and the voice module and the headset are used interactively.

The specific use can be divided into VR head display and VR auxiliary tools: VR head display is the same as the local version of wearable panoramic VR device, while VR auxiliary device is VR mobile phone box + wireless handle (based on Bluetooth or infrared), the former interactive performance is more realistic , the immersion effect is better, the latter is cheap, ordinary students can afford it, and the mobile phone screen can also be displayed on a flat screen.

Embodiment 9 This embodiment will be described with reference to Figures 1-7 of the specification. In this embodiment, a panoramic VR interactive medical ultrasound digital phantom system, the personal client is a mobile phone, and the local server is a computer.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 10 This embodiment will be described with reference to Figures 1 to 7 in the description. A panoramic VR interactive medical ultrasound digital phantom system of this embodiment is provided. The personal client is integrated with a positioning module, capable of real-time positioning.

Claims (5)

1. a panoramic VR interactive medical ultrasound digital phantom system, is characterized in that: comprise local handheld data acquisition equipment, local server, VR equipment, cloud storage center, cloud computing center, personal client and personal handheld data acquisition equipment, The local handheld data acquisition device and the human handheld data acquisition device establish connections with the local server and the personal client respectively, the local handheld data acquisition device and the personal handheld data acquisition device perform original image acquisition, and the local handheld data acquisition device transmits the acquisition information to The local server, the personal handheld data acquisition device transmits the acquisition information to the personal client, the local server and the personal client transmit the original image acquisition information to the cloud computing center for calculation analysis and processing, and upload the processed data to the cloud storage center for storage. The local server and the personal client are respectively electrically connected with VR devices, and the cloud computing center transmits the data analyzed and processed by the cloud computing center to the VR device through the local server and the personal client respectively to generate a VR display. 2. A panoramic VR interactive medical ultrasound digital phantom system according to claim 1, wherein the local handheld data acquisition device and the personal handheld data acquisition device both comprise ultrasonic transducers, 10-axis MEMS acceleration A gyroscope, a Bluetooth 5.0/5G communication module, a microprocessor and a power supply module, the ultrasonic transducer, the 10-axis MEMS acceleration gyroscope and the Bluetooth 5.0/5G communication module are respectively electrically connected with the microprocessor, and the power supply module is used for Supply power to the microprocessor; the ultrasonic transducer generates ultrasonic waves to detect human tissue, and the reflected ultrasonic waves are transmitted to the microprocessor through the transducer to generate electrical energy; The 10-axis MEMS acceleration gyroscope provides high-precision position transformation information of the detected human tissue, and generates three-dimensional spatial position data and transmits it to the microprocessor; The microprocessor converts the electrical energy generated by the ultrasonic transducer into data, and transmits it to the Bluetooth 5.0/5G communication module together with the data from the 10-axis MEMS accelerometer, through which the data is wirelessly transmitted to the local server and personal client Perform image digitization. 3. A panoramic VR interactive medical ultrasound digital phantom system according to claim 1, wherein the VR device comprises a panoramic VR device and a virtual touch glove; Panoramic VR equipment includes glasses-type VR equipment and helmet-type VR equipment; The headset and the voice module are installed inside the helmet-mounted VR device, and the voice module and the headset are used interactively. 4 . The panoramic VR interactive medical ultrasound digital phantom system according to claim 1 , wherein the personal client is a mobile phone, and the local server is a computer. 5 . 5 . The panoramic VR interactive medical ultrasound digital phantom system according to claim 4 , wherein a positioning module is integrated on the personal client, which can be positioned in real time. 6 .

Images