CN219846626U - image display device - Google Patents
image display device Download PDFInfo
- Publication number
- CN219846626U CN219846626U CN202320446903.7U CN202320446903U CN219846626U CN 219846626 U CN219846626 U CN 219846626U CN 202320446903 U CN202320446903 U CN 202320446903U CN 219846626 U CN219846626 U CN 219846626U
- Authority
- CN
- China
- Prior art keywords
- image
- dimensional
- ultrasonic
- target
- dimensional ultrasonic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 210000002758 humerus Anatomy 0.000 claims abstract description 56
- 238000002604 ultrasonography Methods 0.000 claims abstract description 40
- 210000001188 articular cartilage Anatomy 0.000 claims abstract description 29
- 238000004891 communication Methods 0.000 claims abstract description 9
- 239000000523 sample Substances 0.000 claims description 26
- 238000002591 computed tomography Methods 0.000 claims description 11
- 238000000034 method Methods 0.000 claims description 10
- 230000011218 segmentation Effects 0.000 claims description 10
- 230000003287 optical effect Effects 0.000 claims description 9
- 208000010392 Bone Fractures Diseases 0.000 description 26
- 206010017076 Fracture Diseases 0.000 description 26
- 210000000988 bone and bone Anatomy 0.000 description 22
- 239000011159 matrix material Substances 0.000 description 9
- 210000000845 cartilage Anatomy 0.000 description 7
- 238000003384 imaging method Methods 0.000 description 5
- 208000002658 Intra-Articular Fractures Diseases 0.000 description 4
- 208000027418 Wounds and injury Diseases 0.000 description 3
- 238000001356 surgical procedure Methods 0.000 description 3
- 206010020462 Humerus fracture Diseases 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 210000002310 elbow joint Anatomy 0.000 description 2
- 238000002594 fluoroscopy Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000002980 postoperative effect Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 208000007981 Humeral Fractures Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 210000000968 fibrocartilage Anatomy 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000003035 hyaline cartilage Anatomy 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 230000000399 orthopedic effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Landscapes
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
The embodiment of the utility model discloses an image display device, which comprises: an ultrasound device, an image processing device, and a photo-positioning device; the ultrasonic equipment is used for acquiring each two-dimensional ultrasonic image of the distal humerus joint in operation in real time; the photoelectric positioning equipment is mechanically connected with the ultrasonic equipment and is used for acquiring the position information of each two-dimensional ultrasonic image; the image processing equipment is respectively in communication connection with the photoelectric positioning equipment and the ultrasonic equipment, and is used for receiving each two-dimensional ultrasonic image and the position information of each two-dimensional ultrasonic image, obtaining a two-dimensional articular cartilage contour image based on each two-dimensional ultrasonic image, and obtaining a local three-dimensional ultrasonic image of a distal humerus joint according to the two-dimensional articular cartilage contour image and each position information; and displaying the distal humerus joint image based on the target three-dimensional image and the local three-dimensional ultrasonic image acquired before the operation.
Description
Technical Field
The utility model relates to the technical field of medical image processing, in particular to an image display device.
Background
The fracture of the distal humerus refers to the fracture occurring near the elbow joint, the fracture of the distal humerus comprises the intra-articular fracture of the distal humerus and the external fracture of the distal humerus, and if the fracture is the external fracture, the fracture end is stable, and the conservative treatment can be actively adopted. In the case of intra-articular fracture, the current treatment method is usually incision reduction internal fixation operation, and in the operation process, the fracture area of the humerus joint needs to be exposed, so that the operation wound surface is large, the operation complications are easy to occur, and the operation needs to be recovered for a long time.
At present, the real-time imaging examination of the fracture in the distal humerus joint under the condition of no incision exposure is difficult to realize, so that the minimally invasive treatment of the fracture in the distal humerus joint cannot be realized.
Disclosure of Invention
The embodiment of the utility model provides an image display device which can display the image of a distal humerus joint under the condition of incompletely cutting and exposing a distal humerus fracture area when realizing the operation of the distal humerus joint fracture.
An embodiment of the present utility model provides an image display apparatus, including:
an ultrasound device, an image processing device, and a photo-positioning device; wherein the method comprises the steps of
The ultrasonic equipment is used for acquiring each two-dimensional ultrasonic image of the distal humerus joint in operation in real time;
the photoelectric positioning equipment is mechanically connected with the ultrasonic equipment and is used for acquiring the position information of each two-dimensional ultrasonic image;
the image processing equipment is respectively in communication connection with the photoelectric positioning equipment and the ultrasonic equipment, and is used for receiving each two-dimensional ultrasonic image and the position information of each two-dimensional ultrasonic image, obtaining a two-dimensional articular cartilage contour image based on each two-dimensional ultrasonic image, and obtaining a local three-dimensional ultrasonic image of a distal humerus joint according to the two-dimensional articular cartilage contour image and each position information; and displaying the distal humerus joint image based on the target three-dimensional image and the local three-dimensional ultrasonic image acquired before the operation.
Preferably, in an embodiment of the present utility model, the image processing apparatus is further configured to: and processing each two-dimensional ultrasonic image through a pre-trained segmentation model to obtain a two-dimensional articular cartilage contour image, wherein the segmentation model is obtained through training the two-dimensional ultrasonic articular cartilage contour image.
Preferably, in an embodiment of the present utility model, the apparatus further includes: the CT image acquisition module is in communication connection with the image processing equipment and is used for acquiring a three-dimensional electronic computer tomography image of the distal humerus joint as a target three-dimensional image and transmitting the target three-dimensional image to the image processing equipment.
Preferably, in an embodiment of the present utility model, the electro-optical positioning device is further configured to: spatial position information of each pixel point of each two-dimensional ultrasonic image is acquired.
Preferably, in an embodiment of the present utility model, the image processing apparatus further includes: the matching unit is used for matching the local three-dimensional ultrasonic image with the preoperative target three-dimensional image, determining the display position of the preoperative target three-dimensional image corresponding to the local three-dimensional ultrasonic image, and displaying the current three-dimensional image corresponding to the target three-dimensional image based on the display position.
Preferably, in an embodiment of the present utility model, the matching unit is further configured to: and carrying out point-by-point matching on the point cloud data of the local three-dimensional ultrasonic image and the point cloud data of the target three-dimensional image, and determining the display position of the target three-dimensional image before the operation corresponding to the local three-dimensional ultrasonic image based on a matching result.
Preferably, in an embodiment of the present utility model, the electro-optical positioning device includes a calibrator, where the calibrator is mechanically connected to the ultrasound device, and the calibrator is configured to obtain location information of each two-dimensional ultrasound image.
Preferably, in an embodiment of the present utility model, the calibrator includes any one of an optical tracking instrument and an electromagnetic tracking instrument.
Preferably, in the embodiment of the present utility model, the ultrasonic device includes an ultrasonic probe, where the ultrasonic probe is fixedly connected to the calibrator, and the ultrasonic probe is used to acquire each two-dimensional ultrasonic image of a distal humerus joint in operation in real time.
Preferably, in an embodiment of the present utility model, the image processor includes a display unit, and the display unit is configured to display the distal humerus joint image.
The implementation of the embodiment of the utility model has the following beneficial effects:
according to the technical scheme, the humerus outline can be imaged under the condition that the fracture area of the humerus is incompletely cut and exposed, so that a doctor can conveniently perform an operation on a fracture block through the humerus outline image, the operation wound surface is reduced, and the operation complications are reduced. And simultaneously, the postoperative recovery time of the patient is reduced.
Drawings
In order to more clearly illustrate the embodiments of the utility model or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the utility model, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Wherein:
fig. 1 is a schematic view of an image display device according to an embodiment;
FIG. 2 is a schematic diagram of the structure of an ultrasonic probe 32 and a calibrator 31 in one embodiment;
fig. 3 is a schematic structural view of an image display device in an embodiment.
Detailed Description
The following description of the embodiments of the present utility model will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present utility model, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the utility model without making any inventive effort, are intended to be within the scope of the utility model.
Before describing the technical scheme of the embodiment of the present utility model, first, an application scenario of the embodiment of the present utility model is described in an exemplary manner:
distal humeral fracture refers to a fracture of the end of the humerus distal from the heart, typically near the elbow joint. The distal intra-articular fracture of the humerus needs to be treated by incision reduction internal fixation. At present, for the fracture in the distal joint of the humerus, fracture incision reduction internal fixation is generally adopted to realize the treatment of the fracture in the distal joint of the humerus, and the defects existing in the method are numerous, and the radiation exposure exists in the fluoroscopy. The space in the operating room is narrow and small, and the volume of the current image acquisition equipment is larger, and the installation is inconvenient. Performing a fluoroscopy procedure is likely to interrupt the surgical procedure, extending the patient's surgical time. The image acquisition device is cumbersome and inconvenient to move the adjustment position. Inconvenient operation, often requires specialized training personnel to be proficient in use. There is no imaging examination apparatus for the distal humerus joint.
In view of the above, the embodiment of the utility model provides an image display device, which can display the image of the distal humerus joint without completely exposing the distal humerus joint, and assist a doctor in performing reduction operation.
In the description of the embodiments of the present utility model, a joint refers to the portion of a joint between two bones. Articular cartilage is a layer of hyaline cartilage or fibrocartilage on the surface of articulating bones. Cartilage contour is the distal humerus articular surface volar cartilage. The operation is a distal humerus intra-articular fracture operation.
As shown in fig. 1, an image display device of an embodiment of the present utility model includes:
an ultrasound apparatus 1, an image processing apparatus 2, and a photo-positioning apparatus 3; wherein the method comprises the steps of
The ultrasonic equipment 1 is used for acquiring each two-dimensional ultrasonic image of the distal humerus joint in operation in real time;
the photoelectric positioning device 3 is mechanically connected with the ultrasonic device 1, and the photoelectric positioning device 3 is used for acquiring the position information of each two-dimensional ultrasonic image;
the image processing device 2 is respectively in communication connection with the photoelectric positioning device 3 and the ultrasonic device 1, the image processing device 2 is used for receiving each two-dimensional ultrasonic image and the position information of each two-dimensional ultrasonic image, obtaining a two-dimensional articular cartilage contour image based on each two-dimensional ultrasonic image, and obtaining a local three-dimensional ultrasonic image of a distal humerus joint according to the two-dimensional articular cartilage contour image and each position information; and displaying the distal humerus joint image based on the target three-dimensional image and the local three-dimensional ultrasonic image acquired before the operation.
Wherein the two-dimensional ultrasound image comprises an image acquired by the ultrasound probe 32 and the positional information comprises information acquired by the positioning device. The location information may refer to three-dimensional spatial location information. The position information is used to represent the spatial position of the joint in the two-dimensional ultrasound image. Cartilage includes the metacarpal cartilage of the distal humerus joint, i.e., the portion of the distal humerus joint fracture where surgical reduction is required. Since the ultrasound probe 32 can only acquire images of the bone exposed to ultrasound, i.e., due to occlusion of the bone, the ultrasound probe 32 can only acquire partial bone images. For example, if the joint is a portion between two bones, the ultrasound probe 32 acquires an unobstructed portion of the bone image of each bone. The two-dimensional articular cartilage contour image acquired from the plurality of two-dimensional ultrasound images is a partial articular cartilage contour image of the distal humeral joint. The distal humeral joint image includes a distal humeral articular cartilage contour image. The condition of fracture surface displacement or reduction can be displayed by displaying the humerus distal joint image, and the minimally invasive fracture reduction is greatly facilitated. The target three-dimensional image refers to a complete humeral distal joint cartilage contour image obtained prior to surgery. And the local three-dimensional ultrasonic image refers to an image obtained by three-dimensional reconstruction of a two-dimensional ultrasonic image of a part of bones due to the shielding of the bones. The electro-optical positioning device may be an optical positioning device 35, such as an optical positioning navigator (e.g., NDI Polaris Vega XT, etc.), or an electromagnetic positioning device, such as an electromagnetic position tracker (e.g., NDI 3D guide, etc.).
According to the technical scheme of the embodiment of the utility model, the ultrasonic equipment 1 acquires each two-dimensional ultrasonic image of the distal humerus joint in operation in real time, the photoelectric positioning equipment 3 is mechanically connected with the ultrasonic equipment 1, the photoelectric positioning equipment 3 acquires the position information of each two-dimensional ultrasonic image, the image processing equipment 2 is respectively in communication connection with the photoelectric positioning equipment 3 and the ultrasonic equipment 1, the image processing equipment 2 receives the two-dimensional ultrasonic images to obtain two-dimensional cartilage contour images, the local three-dimensional ultrasonic image of the distal humerus joint is obtained according to the two-dimensional cartilage contour images and each position information, the current displayed complete distal humerus joint image is obtained based on the complete target three-dimensional image before operation and the local three-dimensional ultrasonic image acquired in operation, and the position of a fracture area is possibly changed due to the reasons of movement of a patient before operation and during operation, such as movement of a fracture block, so that the fracture area cannot be accurately determined through the complete target three-dimensional image before operation, and the current displayed distal humerus joint image is jointly determined through the target three-dimensional image and the local three-dimensional ultrasonic image acquired in operation, the real-time performance of the distal humerus joint image can be improved, and the accuracy of the distal humerus joint determination of the fracture area can be improved. According to the technical scheme, the humerus outline can be imaged under the condition that the fracture area of the humerus is incompletely cut and exposed, so that a doctor can conveniently perform an operation on a fracture block through the humerus outline image, the operation wound surface is reduced, and the operation complications are reduced. And simultaneously, the postoperative recovery time of the patient is reduced.
In another embodiment of the present utility model, the image processor includes a display unit 21, and the display unit 21 is configured to display the distal humeral joint image. The display unit 21 includes at least one of a display 210, an augmented reality device 220.
In another embodiment of the present utility model, the image processing apparatus 2 is further configured to: and processing each two-dimensional ultrasonic image through a pre-trained segmentation model to obtain a two-dimensional articular cartilage contour image, wherein the segmentation model is obtained through training the two-dimensional ultrasonic articular cartilage contour image.
Wherein the two-dimensional ultrasonic articular cartilage contour image refers to a two-dimensional ultrasonic image of the articular cartilage contour of the distal humeral joint.
In the embodiment of the utility model, the image processing device 2 processes each two-dimensional ultrasonic image through the segmentation model which is trained in advance to obtain the two-dimensional articular cartilage contour image, and in this way, the accuracy of the two-dimensional articular cartilage contour image can be improved.
In one embodiment, the label of the two-dimensional ultrasonic articular cartilage outline image comprises manual labeling by an orthopedics expert, the manual labeling accuracy is high, and the labeled two-dimensional ultrasonic articular cartilage outline is subjected to data amplification to obtain an image training set. The manner of amplification includes, but is not limited to, brightness adjustment, contrast adjustment, and the like. And then, training a robust segmentation algorithm by using an image training set through a pre-constructed model to obtain a segmentation model. The pre-built model may be a U-Net model.
In another embodiment of the present utility model, the apparatus further includes: and the CT image acquisition module is in communication connection with the image processing device 2 and is used for acquiring a three-dimensional electronic computer tomography image of the distal humerus joint as a target three-dimensional image and transmitting the target three-dimensional image to the image processing device 2.
In an embodiment of the present utility model, before an operation, the CT image acquisition module acquires a three-dimensional electronic computed tomography image, i.e., CT (Computed Tomography) image, of the distal humerus joint. A complete distal humeral joint image can be acquired by CT scanning, and taken as a target three-dimensional image. And transmits the target three-dimensional image to the image processing apparatus 2.
In another embodiment of the present utility model, the electro-optical positioning device 3 is further configured to: spatial position information of each pixel point of each two-dimensional ultrasonic image is acquired.
The electro-optical positioning device 3 comprises a calibrator 31, wherein the calibrator 31 is mechanically connected with the ultrasonic device 1, and the calibrator 31 is used for acquiring the position information of each two-dimensional ultrasonic image. The ultrasonic device 1 includes an ultrasonic probe 32, the ultrasonic probe 32 is fixedly connected with the calibrator 31, as shown in fig. 2, the calibrator 31 may sleeve the ultrasonic probe 32 through a housing 33, and is further fixedly connected with the ultrasonic probe 32. Of course, the calibrator 31 and the ultrasonic probe 32 may be separated by a housing 33. A connection line is connected to one end of the ultrasonic probe 32 for connecting the image processing apparatus 2. The ultrasound probe 32 is used to acquire in real time respective two-dimensional ultrasound images of the distal humeral joint during surgery. The calibrator 31 includes any one of an optical tracking instrument and an electromagnetic tracking instrument.
In the embodiment of the present utility model, the photoelectric positioning device 3 is configured to obtain spatial position information of each pixel point of each two-dimensional ultrasound image, obtain spatial position information of each pixel point through the calibrator 31, and record three-dimensional spatial coordinates of each pixel point of the two-dimensional ultrasound image. The pixel points refer to imaging points in a two-dimensional ultrasound image, and are related to imaging resolution.
In an embodiment, the electro-optical positioning device 3 includes a calibrator 31, a calibration box, and the like. The calibrator 31 may refer to a device that can be used for spatial position recognition by the electro-optical positioning device 3, such as mounting a reflective ball mount or an electromagnetic sensor. The calibration box may be a device for performing three-dimensional space calibration of the ultrasonic probe 32 and obtaining an initial calibration matrix, and the device needs to have the following characteristics: 1. the calibration box contains linear three-dimensional structures which can be imaged by ultrasonic scanning, 2. The spatial positions of the linear three-dimensional structures can be preset according to requirements, 3. The whole calibration box and the linear three-dimensional structures contained in the calibration box can be identified and positioned by the photoelectric positioning equipment 3. The calibration matrix is a space transformation matrix formula, which can calculate the space position of the pixel point of the two-dimensional ultrasonic image through the space position of the ultrasonic probe 32, the space position of the ultrasonic probe 32 can be directly measured by means of the calibrator 31 arranged on the ultrasonic probe 32, and the space position of the pixel point of the ultrasonic image can be further reconstructed in three dimensions after being calculated through the calibration matrix. The calibrator 31 comprises a device having a linear three-dimensional structure in which the spatial position information of all lines has been predetermined. The method for determining the position information of the two-dimensional ultrasonic image comprises the steps of firstly setting the space position of a linear three-dimensional structure in a calibration box, carrying out equipment positioning in photoelectric positioning equipment 3, then using an ultrasonic probe 32 provided with a calibrator 31 to scan the calibration box, obtaining a plurality of groups of two-dimensional ultrasonic images with linear structures, establishing a space conversion matrix and a calibration matrix from the ultrasonic probe 32 to the ultrasonic image because the space positions of linear structure points in the two-dimensional ultrasonic images are known, calculating the space conversion matrix and the calibration matrix, and carrying out three-dimensional reconstruction of the ultrasonic image by using the equipment, wherein if the installation positions of the calibrator 31 and the ultrasonic probe 32 are unchanged, the matrix parameters are unchanged, and the equipment can be repeatedly used. The three-dimensional space coordinates of the two-dimensional ultrasonic image can be obtained through the equipment, and the three-dimensional reconstruction is carried out on the two-dimensional ultrasonic image based on the three-dimensional space coordinates.
In another embodiment of the present utility model, the image processing apparatus 2 further includes: the matching unit is used for matching the local three-dimensional ultrasonic image with the preoperative target three-dimensional image, determining the display position of the preoperative target three-dimensional image corresponding to the local three-dimensional ultrasonic image, and displaying the current three-dimensional image corresponding to the target three-dimensional image based on the display position.
In the embodiment of the utility model, the local three-dimensional ultrasonic image and the preoperative target three-dimensional image are matched, and the display position of the local three-dimensional ultrasonic image corresponding to the preoperative target three-dimensional image is determined, optionally, each bone related to the distal humerus joint is included in the local three-dimensional ultrasonic image and the target three-dimensional image, each bone displayed by the local three-dimensional ultrasonic image is not complete, and each bone displayed by the target three-dimensional image is complete. Matching bones in the local three-dimensional ultrasonic image and the target three-dimensional image, comparing the position information of the same bones in the two images, updating the position information of the matched bones in the target three-dimensional image based on the position information of the bones in the local three-dimensional ultrasonic image, and further displaying a current three-dimensional image corresponding to the target three-dimensional image based on the updated position information, wherein the current three-dimensional image comprises the three-dimensional ultrasonic image.
Optionally, in another embodiment of the present utility model, the complete contour of each bone in the target three-dimensional image is matched with the local contour of each bone in the local three-dimensional ultrasound image, and when the matching degree is greater than a preset matching threshold, the local contour of the bone in the local three-dimensional ultrasound image is updated based on the complete contour of the bone in the target three-dimensional image, so as to obtain the current three-dimensional image. Of course, the matching of the complete and partial contours of the bone may be point-by-point by point matching with the point cloud data.
In another embodiment of the present utility model, the target three-dimensional image and the local three-dimensional ultrasound image respectively include a set of point cloud data, and each point in the point cloud data includes spatial position information for performing registration calculation. The matching unit is further configured to: and carrying out point-by-point matching on the point cloud data of the local three-dimensional ultrasonic image and the point cloud data of the target three-dimensional image, and determining the display position of the target three-dimensional image before the operation corresponding to the local three-dimensional ultrasonic image based on a matching result.
The point cloud data includes spatial position information, which may represent the spatial position of a local three-dimensional ultrasound image or a target three-dimensional image. For example, the spatial location information may be represented in spatial location coordinates.
In the embodiment of the utility model, point-by-point matching is carried out on the point cloud data of the local three-dimensional ultrasonic image and the point cloud data of the target three-dimensional image through a point cloud registration algorithm, the point with the matching result meeting the preset matching condition is taken as a display position, and the current three-dimensional image corresponding to the target three-dimensional image is displayed through the display position, namely, the complete three-dimensional image of the distal humerus joint in the ultrasonic scanning area is displayed.
The preset matching condition comprises that the error of the spatial position coordinates of the point of the local three-dimensional ultrasonic image and the point of the target three-dimensional image is smaller than a preset threshold value.
In another embodiment of the present utility model, as shown in fig. 3, the hardware including the ultrasound apparatus 1, the optical positioning apparatus 35, the image processing apparatus 2, and the like is connected through a communication protocol such as openIGTlink. The optical positioning device 35 includes therein a calibrator 31. The ultrasound apparatus 1 comprises an ultrasound probe 32. The patient in fig. 3 lies on an operating table 4, and the ultrasound apparatus 1 performs a two-dimensional ultrasound image of an operation region of the distal humerus of the patient by means of an ultrasound probe 32 and transmits the two-dimensional ultrasound image to the image processing apparatus 2. The optical positioning device 35 acquires positional information of the two-dimensional ultrasound image through the calibrator 31 and transmits the positional information to the image processing device 2. The position of the marker 31 is defined within an area that can be identified by the optical positioning device 35. The image processing device 2 is configured to receive each two-dimensional ultrasound image and position information of each two-dimensional ultrasound image, process the plurality of two-dimensional ultrasound images through a segmentation model that is trained in advance to obtain a two-dimensional articular cartilage contour image, and reconstruct a three-dimensional articular cartilage contour through the two-dimensional articular cartilage contour image and the position information to obtain a three-dimensional articular cartilage contour image. And performing point-by-point matching on the three-dimensional articular cartilage contour image and the CT image acquired before the operation through a point cloud registration algorithm to obtain a three-dimensional humerus distal joint image finally displayed. The image processing apparatus 2 may be a computer or a server or the like. The image processing device 2 displays the image of the distal humerus joint through the display 210 or the augmented reality device 220 (such as AR glasses, etc.), so as to achieve the purpose of real-time dynamic three-dimensional imaging in orthopaedics.
The foregoing disclosure is illustrative of the present utility model and is not to be construed as limiting the scope of the utility model, which is defined by the appended claims.
Claims (10)
1. An image display device, comprising:
an ultrasound device, an image processing device, and a photo-positioning device; wherein the method comprises the steps of
The ultrasonic equipment is used for acquiring each two-dimensional ultrasonic image of the distal humerus joint in operation in real time;
the photoelectric positioning equipment is mechanically connected with the ultrasonic equipment and is used for acquiring the position information of each two-dimensional ultrasonic image;
the image processing equipment is respectively in communication connection with the photoelectric positioning equipment and the ultrasonic equipment, and is used for receiving each two-dimensional ultrasonic image and the position information of each two-dimensional ultrasonic image, obtaining a two-dimensional articular cartilage contour image based on each two-dimensional ultrasonic image, and obtaining a local three-dimensional ultrasonic image of a distal humerus joint according to the two-dimensional articular cartilage contour image and each position information; and displaying the distal humerus joint image based on the target three-dimensional image and the local three-dimensional ultrasonic image acquired before the operation.
2. The apparatus of claim 1, wherein the image processing device is further configured to:
and processing each two-dimensional ultrasonic image through a pre-trained segmentation model to obtain a two-dimensional articular cartilage contour image, wherein the segmentation model is obtained through training the two-dimensional ultrasonic articular cartilage contour image.
3. The apparatus of claim 1, wherein the apparatus further comprises:
a CT image acquisition module is provided for acquiring a CT image,
the CT image acquisition module is in communication connection with the image processing device and is used for acquiring a three-dimensional electronic computer tomography image of the distal humerus joint as a target three-dimensional image and transmitting the target three-dimensional image to the image processing device.
4. The apparatus of claim 1, wherein the electro-optic positioning device is further to:
spatial position information of each pixel point of each two-dimensional ultrasonic image is acquired.
5. The apparatus according to claim 2, wherein said image processing device further comprises:
the matching unit is used for matching the local three-dimensional ultrasonic image with the preoperative target three-dimensional image, determining the display position of the preoperative target three-dimensional image corresponding to the local three-dimensional ultrasonic image, and displaying the current three-dimensional image corresponding to the target three-dimensional image based on the display position.
6. The apparatus of claim 5, wherein the matching unit is further configured to:
and carrying out point-by-point matching on the point cloud data of the local three-dimensional ultrasonic image and the point cloud data of the target three-dimensional image, and determining the display position of the target three-dimensional image before the operation corresponding to the local three-dimensional ultrasonic image based on a matching result.
7. The apparatus of claim 1, wherein the electro-optical positioning device comprises a calibrator mechanically coupled to the ultrasound device, the calibrator configured to obtain positional information for each two-dimensional ultrasound image.
8. The apparatus of claim 7, wherein the calibrator comprises any one of an optical tracking instrument and an electromagnetic tracking instrument.
9. The apparatus of claim 7, wherein the ultrasound device comprises an ultrasound probe fixedly connected to the calibrator, the ultrasound probe being configured to acquire respective two-dimensional ultrasound images of the intra-operative distal humeral joint in real time.
10. The apparatus according to claim 1, wherein the image processing device comprises a display unit for displaying the distal humeral joint image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202320446903.7U CN219846626U (en) | 2023-02-28 | 2023-02-28 | image display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202320446903.7U CN219846626U (en) | 2023-02-28 | 2023-02-28 | image display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN219846626U true CN219846626U (en) | 2023-10-20 |
Family
ID=88340140
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202320446903.7U Active CN219846626U (en) | 2023-02-28 | 2023-02-28 | image display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN219846626U (en) |
-
2023
- 2023-02-28 CN CN202320446903.7U patent/CN219846626U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230355312A1 (en) | Method and system for computer guided surgery | |
| CN103997982B (en) | By operating theater instruments with respect to the robot assisted device that patient body is positioned | |
| US20030011624A1 (en) | Deformable transformations for interventional guidance | |
| US8771188B2 (en) | Ultrasonic bone motion tracking system | |
| AU2018316801B2 (en) | Ultrasound bone registration with learning-based segmentation and sound speed calibration | |
| CN102784003B (en) | Pediculus arcus vertebrae internal fixation operation navigation system based on structured light scanning | |
| EP2950735B1 (en) | Registration correction based on shift detection in image data | |
| CN112971982B (en) | Operation navigation system based on intrahepatic vascular registration | |
| WO2002000093A2 (en) | Registration of target object images to stored image data | |
| US20220183760A1 (en) | Systems and methods for generating a three-dimensional model of a joint from two-dimensional images | |
| WO2006092594A2 (en) | 3d ultrasound registration | |
| EP3288470B1 (en) | Method and device for determining geometric parameters for total knee replacement surgery | |
| WO2006092602A1 (en) | 3d ultrasound imaging | |
| Mirota et al. | High-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery | |
| CN116712171B (en) | Intertrochanteric fracture navigation method, device and storable medium | |
| CN219846626U (en) | image display device | |
| CN116564149A (en) | Operation training method for lumbar intervertebral foramen puncture | |
| CN116019571A (en) | Apparatus and method for positioning a patient's body and tracking patient position during surgery | |
| CN116035832A (en) | Apparatus and method for registering live and scanned images | |
| CN114283179A (en) | Real-time fracture far-near end space pose acquisition and registration system based on ultrasonic images | |
| CN116269497A (en) | Image display method, device, electronic equipment and storage medium | |
| Xie et al. | A small-scaled intraoperative 3d visualization navigation system for femoral head repair surgery | |
| EP4041114B1 (en) | Patterned incision foil and method for determining a geometry of an anatomical surface | |
| US20240024035A1 (en) | Preoperative imaging combined with intraoperative navigation before and after alteration of a surgical site to create a composite surgical three dimensional structural dataset | |
| US20230240755A1 (en) | Systems and methods for registering one or more anatomical elements |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |