CN216145020U

CN216145020U - Enhanced image system

Info

Publication number: CN216145020U
Application number: CN202121360418.5U
Authority: CN
Inventors: 王吉龙; 鲍比·纳多; 杜雷; 李剑月; 黄彬; 陈健; 何进
Original assignee: Suzhou Sumai Medical Technology Co ltd
Current assignee: Suzhou Sumai Medical Technology Co ltd
Priority date: 2021-06-18
Filing date: 2021-06-18
Publication date: 2022-03-29
Anticipated expiration: 2031-06-18

Abstract

The utility model discloses an image enhancement system which comprises a media signal processing device, an image enhancement device, a microscope body and a binocular tube, wherein the image enhancement device comprises a display device and a superposition lens group, the display device is in communication connection with the media signal processing device, the superposition lens group is arranged on a main light path of the microscope body, the binocular tube is arranged on the microscope body, the display device is configured to receive information data sent by the media signal processing device and convert the received information data into an optical image, the optical image sent by the display device is superposed into the main light path of the microscope body through the superposition lens group to form a superposed image, and the superposed image can be observed through the binocular tube. According to the method and the device, some images with additional information can be superposed in the observation field of the microscope, so that an operator can be helped to observe required information more intuitively, better comparison, superposition and fusion are carried out with a real object under the microscope, and the accuracy and precision of the operation are improved.

Description

Enhanced image system

Technical Field

The utility model relates to the technical field of dental diagnosis and treatment, in particular to an enhanced image system of an operating microscope.

Background

Modern medicine has made substantial progress in the fields of in vitro diagnosis, microscopic therapy, medical imaging, minimally invasive therapy and the like, and diagnosis and treatment means of types integrated across categories and multiple disciplines are endless, and due to the continuous development of medical imaging equipment, the medical imaging technology is changing day by day, and the medical imaging technology disciplines are gradually established and formed in the sub-disciplines of CT, MR, interventional radiology, ultrasound, nuclear medicine and the like.

The medical image information has sensitivity, intuition, specificity and early type; image analysis develops from qualitative to quantitative, and from displaying diagnostic information to providing surgical pathway solutions; the image camera and display are developed from two-dimensional simulation to three-dimensional full digitalization; the image storage is developed from film hard copy to film-free soft copy and even network image transmission; the development is moving from single image technology to integrated image technology.

In order to adapt to the digital, networking and fusion of medical imaging science, the view of fusion of three major fields of diagnosis, technology and engineering must be established, and a single major cannot complete the functions of the modern medical imaging science.

In the case of root canal treatment, the physician needs to open the pulp cavity completely, find all the root canals and treat them. Humans typically have 1-4 root canals per tooth, with the most root canals in the posterior teeth. When the root canal orifice is difficult to find due to the conditions of age-increasing change, deposition of restorative dentin, pulp stones, pulp cavity calcification, root canal morphological variation and the like, the anatomical morphology of the pulp cavity needs to be understood and seen from all directions and positions by virtue of the three-dimensional anatomical morphology of the tooth; the number, shape, position, direction and bending condition of the tooth root and the root canal are known and indicated by adopting X-ray films shot by a plurality of angle projection methods; the relationship of the tooth root to the crown; various possible variations of anatomical morphology of the root canal and root canal, etc. As the number of the root canals of part of teeth can reach four, complicated conditions such as collateral root canals, apical bifurcation and the like can exist, and omission can be caused even under the condition of magnifying observation; it is desirable to estimate the likely location of the root canal, and if necessary, to remove a small amount of dentin using a button drill in the sulcus where the root canal is likely or expected, and then to use a sharp probe to attempt to penetrate any calcified areas to indicate where the canal orifice removes the dentinal collar of the neck of the tooth to expose the canal orifice, i.e., if there is a calcification of the canal orifice, it is even more desirable for the practitioner to make repeated trials at each possible location, and inevitably remove too much healthy tooth tissue.

At present, a preoperative dental film mode is often adopted to help a doctor judge and determine the number and the form of root canals, firstly, the doctor needs to divide partial energy to remember the form of a root cap, and even the doctor pauses the operation to observe the dental film again. In addition, the dental film is only a two-dimensional plane image, so that the three-dimensional shape of the root canal cannot be accurately reflected, and actually, the trend of a plurality of root canals is bent for many times, so that the dental film cannot be used for accurate positioning.

Stereo images such as CBCT are complex and difficult to memorize, doctors need to memorize the stereo morphology of the tooth structure in the brain and compare, superpose and fuse with the real object under the microscope in the operation, great efforts are needed, and the accuracy and precision are difficult to ensure.

Therefore, in combination with the above-mentioned technical problems, a new technical solution is needed.

SUMMERY OF THE UTILITY MODEL

In order to solve the technical problems in the prior art, the application provides an enhanced image system of an operation microscope, and the specific scheme is as follows:

the utility model provides an image enhancement system which comprises a media signal processing device, an image enhancement device, a microscope body and a binocular tube, wherein the image enhancement device comprises a display device and a superposition lens group, the display device is in communication connection with the media signal processing device, the superposition lens group is arranged on a main light path of the microscope body, the binocular tube is arranged on the microscope body, the display device is configured to receive information data sent by the media signal processing device and convert the received information data into an optical image, the optical image sent by the display device is superposed into the main light path of the microscope body through the superposition lens group to form a superposed image, and the superposed image can be observed through the binocular tube.

The media signal processing device is configured to convert information data input by the plurality of information input devices into composite information data and send the composite information data to the display device.

Further, the display device comprises an information display area, the information display area is matched with the observation visual field of the binocular tube, and an optical image corresponding to the composite information data is displayed in the information display area after being converted by the media signal processing device; the display device is an OLED display, an LCD display or a DLP display.

Furthermore, the area of the optical image emitted by the display device, which is outside the optical image corresponding to the composite information data, is black.

The media signal processing device is configured to control the opening and closing, the size, the position and the angle of an image displayed in the information display area according to the information data input by the information input device.

Furthermore, the microscope further comprises an image acquisition device, wherein the image acquisition device is in communication connection with the media signal processing device, and the image acquisition device is configured to acquire image information in a main light path of the microscope body in real time and transmit the image information to the media signal processing device.

Furthermore, the information input device comprises a positioning navigation device, the positioning navigation device is installed on a surgical instrument, the positioning navigation device is in communication connection with the media signal processing device, and the positioning navigation device is configured to collect the position information of the surgical instrument in real time and transmit the position information to the media signal processing device.

Compared with the prior art, the enhanced image system of the application has at least one or more of the following beneficial effects:

according to the image enhancement system, the LCD, the OLED, the DLP and other display devices are adopted and matched with the beam splitter prism, image information displayed in the display devices can be superposed in the observation visual field of the microscope, an operator can conveniently observe a target object, and meanwhile, various data information related to an operation can be quickly checked; compared with a projector, the LCD, OLED, DLP and other displays have smaller volume, clearer displayed image, smaller power consumption and low heat productivity; the input can be an HDMI signal, and the connection is simple and convenient; the structure is small and does not occupy space; the media signal processing device may be a computer separate from the microscope or may be part of the microscope; the media signal processing device can preprocess a plurality of signals such as patient case information, oral cavity holographic scanning images, CT, CBCT images or 3D modeling information, a root measuring instrument and the like into a signal, and then output the signal into the display device of the enhanced image device for display; the media signal device can process the input CBCT image data in a built-in software mode, reestablish a three-dimensional model of the target tooth, slice the three-dimensional model, highlight key parts of the tooth such as a root canal orifice, an edge contour and the like at the same time, and enable the slice images to be more clearly observed when the slice images are superposed in an eyepiece visual field area; the information display area in the display devices such as LCD, OLED, DLP and the like is matched with the observation visual field of the microscope, and the information data processed by the media signal processing device is displayed in the information display area, so that the image can be completely and non-cut and superposed in the visual field area of the eyepiece, and the condition that the complete superposed information cannot be observed due to the display at the edge of the visual field can be prevented; the number, size, position, direction, angle and the like of the information superposed in the visual field area of the eyepiece can be adjusted according to the requirement so as to adapt to different habit requirements of an operator; the adjustment of the information superposed in the ocular visual field area can be directly adjusted through a handle, a mouse, a keyboard and the like, and can also be controlled by collecting the biological characteristic information of user voice, gestures, facial expressions, eyeball actions, cranial nerve electric waves, mouth shapes and the like, so that an operator does not need to contact skills to complete the operation, and the operation is simple and rapid; the area except the information to be superposed displayed in the display device is displayed in black, so that in the binocular tube light path observation, not only the image of the main light path of the microscope lens body can be observed, but also the image displayed in the display device can be observed, for example, the root canal therapy is taken, the slice image of the tooth CBCT and the real image of the main light path of the microscope lens body can be superposed and displayed after calibration, so that the highlighted dental pulp hole image can be superposed on the real tooth image, the operation positioning of a doctor is greatly facilitated, the operation difficulty is reduced, and the operation accuracy is improved; the real-time positioning of the surgical instruments can be realized by matching with a positioning navigation device, and the surgical precision is further improved.

Drawings

Fig. 1 is a schematic diagram illustrating an enhanced image system according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram illustrating an optical principle of an enhanced image system according to an embodiment of the present disclosure;

fig. 3 is a schematic perspective view of an image enhancement apparatus according to an embodiment of the present disclosure;

FIG. 4 is a schematic top view of the enhanced imaging device shown in FIG. 3;

FIG. 5 is a schematic rear view of the image enhancement apparatus shown in FIG. 3;

fig. 6 is a schematic cross-sectional view illustrating an image enhancement apparatus according to an embodiment of the present disclosure;

FIG. 7 is a schematic view of a position of a superimposed image and a field of view of a microscope provided in an embodiment of the present application;

FIG. 8 is a schematic view of a position of an optical image within a field of view of a microscope according to an embodiment of the present disclosure;

fig. 9 is a schematic diagram of an image of an endodontic hole superimposed on an image of a real tooth according to an embodiment of the present application;

FIG. 10 is a schematic diagram of an optical image with adjustable size and angle according to an embodiment of the present disclosure;

FIG. 11 is a diagram illustrating an embodiment of the present application providing a multimedia window adjustment by a handle;

FIG. 12 is a schematic flowchart illustrating a process of adjusting a displayed image in a display area through biometric information identification according to an embodiment of the present application;

fig. 13 is a schematic flowchart illustrating an implementation method of an enhanced image system according to an embodiment of the present disclosure;

fig. 14 is a schematic flowchart illustrating a process of analyzing CBCT image data according to an embodiment of the present disclosure.

Wherein, 1-microscope body, 2-enhanced image device, 20-shell, 201-light splitting interface, 202-shell, 203-back plate, 204-power socket, 205-power switch, 21-display device, 22-first lens group, 23-reflection prism, 24-diaphragm, 241-diaphragm adjusting device, 25-second lens group, 26-blue light filter, 27-first light splitting prism, 28-second light splitting prism, 29-lens seat, 3-binocular tube, 4-media signal processing device, 5-ocular visual field region, 6-image region, 61-optical image, 62-tooth image, 63-dental pulp hole image, 7-handle, 71-determination key, 72-cancellation key, 73-multidirectional switch, 74- + key, 75-key, 76-function key.

Detailed Description

To further illustrate the technical means and effects of the present invention adopted to achieve the intended purpose of the utility model, the following detailed description is given to the specific embodiments, structures, features and effects of the present invention in conjunction with the accompanying drawings and preferred embodiments.

Examples

Referring to fig. 1 to 14, fig. 1 is a schematic diagram illustrating an enhanced image system according to an embodiment of the present disclosure; FIG. 2 is a schematic diagram illustrating an optical principle of an enhanced image system according to an embodiment of the present disclosure; fig. 3 is a schematic perspective view of an image enhancement apparatus according to an embodiment of the present disclosure; FIG. 4 is a schematic top view of the enhanced imaging device shown in FIG. 3; FIG. 5 is a schematic rear view of the image enhancement apparatus shown in FIG. 3; fig. 6 is a schematic cross-sectional view illustrating an image enhancement apparatus according to an embodiment of the present disclosure; FIG. 7 is a schematic view of a position of a superimposed image and a field of view of a microscope provided in an embodiment of the present application; FIG. 8 is a schematic view of a position of an optical image within a field of view of a microscope according to an embodiment of the present disclosure; fig. 9 is a schematic diagram of an image of an endodontic hole superimposed on an image of a real tooth according to an embodiment of the present application; FIG. 10 is a schematic diagram of an optical image with adjustable size and angle according to an embodiment of the present disclosure; FIG. 11 is a diagram illustrating an embodiment of the present application providing a multimedia window adjustment by a handle;

FIG. 12 is a schematic flowchart illustrating a process of adjusting a displayed image in a display area through biometric information identification according to an embodiment of the present application; fig. 13 is a schematic flowchart illustrating an implementation method of an enhanced image system according to an embodiment of the present disclosure;

The embodiment provides an enhanced image system, which comprises a media signal processing device 4, an enhanced image device 2, a microscope body 1 and a binocular tube 3, as shown in fig. 1 and 2. The enhanced imaging device 2 comprises a display device 21 and a superimposing mirror group. The display device 21 is in communication connection with the media signal processing device 4. The superposition mirror group is arranged on a main light path of the microscope body 1. The binocular tube 3 is arranged on the microscope body 1. The display device 21 is configured to receive the information data sent by the media signal processing device 4, and convert the received information data into an optical image 61, the optical image 61 sent by the display device 21 is superimposed on the main light path of the microscope body 1 through the superimposing lens group to form a superimposed image, and the superimposed image can be observed through the binocular tube 3. When a user such as a doctor observes the binocular tube 3, the user can see not only the image of the examination surface of the main optical path of the microscope, but also the additional media information superimposed in the main optical path by the display device 21, thereby obtaining more information, improving the efficiency of diagnosis or operation of the doctor, and shortening the operation time.

The media signal processing device 4 can complete the processing of various media signals, including patient case information, oral cavity holographic scanning images, CT, CBCT images or 3D modeling information, a plurality of multimedia signals to be injected, such as a root measuring instrument. And these multimedia signals can be inputted through a plurality of information input means. The information input device is respectively connected with the media signal processing device 4 in a communication way. The media signal processing means 4 is configured to convert information data inputted from a plurality of the information input means into composite information data and transmit the composite information data to the display means 21. That is, if the superimposed media signal is not a single signal, the media signal processing device 4 performs a preprocessing on the multiple signals, and the multiple input media signals are processed by the media signal processing device to form a single video output signal and input to the display device 21 of the enhanced video device 2 through the video signal, thereby implementing the real-time input of the multiple signals.

The image enhancement device 2 specifically includes a display device 21, a first lens group 22, a reflecting prism 23, a diaphragm 24, a second lens group 25, a blue light filter 26 and a first beam splitter prism 27, as shown in fig. 3 to 6. The first beam splitter 27 is a superimposing lens group. The display device 21, the first mirror group 22, the reflecting prism 23, the diaphragm 24, the second mirror group 25, the blue light filter 26 and the first beam splitter prism 27 are all disposed in the housing 20. Further, the first lens group 22, the reflection prism 23 and the second lens group 25 are respectively mounted in the housing 20 through a lens mount 29. The display device 21, the first mirror group 22 and the reflecting prism 23 are sequentially arranged on the same optical path, i.e., the optical path in the horizontal direction shown in fig. 6. The reflecting prism 23 is preferably a right-angle prism. The reflecting prism 23, the second lens group 25, the blue light filter 26 and the first beam splitter prism 27 are sequentially disposed on the same optical path, i.e., the optical path in the vertical direction shown in fig. 6. The light beam emitted from the display device 21 passes through the first mirror group 22, then is totally reflected by the right-angle prism, then is turned ninety degrees to be directed to the second mirror group 25, and then passes through the second mirror group 25 to be directed to the first light splitting prism 27. In a specific implementation, the first beam splitter prism 27 is disposed in a main optical path of the microscope, and when a light beam emitted from the display device 21 enters the first beam splitter prism 27, the light beam and the main optical path of the microscope are superimposed to form a composite optical image, and then an operator can observe a superimposed image superimposed with the content displayed by the display device 21 through an eyepiece of the microscope. Set up blue light filter 26 between second mirror group 25 and first beam splitter 27, can filter the blue light of 420 ~ 480nm wave band to reduce the injury to user's eye. A diaphragm 24 is disposed between the reflecting prism 23 and the second lens group 25, and can cut off or conduct the light path, thereby displaying and closing the superimposed image as required. Specifically, a diaphragm adjusting device 241 is arranged in the housing 20, and the diaphragm adjusting device 241 can be adjusted to drive the diaphragm 24 to move between a shielding position and an opening position, wherein when the diaphragm 24 is located at the shielding position, the diaphragm 24, the reflecting prism 23 and the second mirror group 25 are located on the same optical path, and the diaphragm 24 shields the light beam which passes through the reflecting prism 23 and then enters the second mirror group 25. The adjustment method of the diaphragm 24 may be horizontal cut-in or rotary cut-in, and any adjustment method is within the scope of the present application as long as the diaphragm 24 can cut in and out the optical path.

The display device 21 may be an OLED display, or an LCD display, or a DLP display, or another display or display screen. The display that adopts LCD, OLED, DLP etc. to show will be littleer than miniature projecting apparatus volume, and the image of demonstration is more clear, and the consumption is littleer thereupon calorific capacity also low, and the input can be the HDMI signal, connects simple and conveniently, and the small and exquisite occupation space that does not take place of structure in addition. Since the eyepiece viewing area 5 viewed by the binocular tube 3 is a complete circle, but the display device 21, such as an LCD display, is mostly a rectangular device, the display size ratio of the LCD is typically 16:9 or 4:3, and when the image area 6 processed by the optical lens is superimposed on the circular eyepiece viewing area 5, the cutting problem is involved, as shown in fig. 7. To solve the problem, an information display area is arranged in the image area 6 of the display device 21, so that when the optical image 61 emitted by the display device 21 is superimposed on the main optical path, the information display area is matched with the observation visual field of the binocular tube 3, and the optical image 61 corresponding to the composite information data after being converted by the media signal processing device 4 is displayed in the information display area, so that the composite information data can be completely superimposed on the eyepiece visual field area 5 without cutting, as shown in fig. 8. If displayed at the edge, the eyepiece is not visible. Further, the optical image 61 emitted by the display device 21 is black in the area outside the optical image 61 corresponding to the composite information data. When the main light path of the microscope body 1 and the light path of the display device 21 need to be overlapped, the image to be overlapped is displayed in the information display area, and the blank area of the periphery is blackened, so that in the observation of the light path of the binocular tube 3, the image displayed in the display device 21 can be observed as well as the image of the main light path of the microscope body 1. Taking root canal therapy as an example, the slice image of the tooth CBCT and the real main light path image of the microscope body 1 can be displayed in a superposed manner after calibration, so that the highlighted dental pulp hole image 63 can be superposed on the real tooth image 62, as shown in fig. 9, which greatly facilitates the surgical positioning of the doctor, reduces the surgical difficulty, and improves the surgical accuracy.

The information data, i.e. the multi-channel input media signal, may be pictures, or two-dimensional or three-dimensional data which can be operated and marked, or visual observation data such as dynamic information of a root-measuring instrument, and can be displayed in the form of windows in the information display area. The number, size, position, angle and the like of the windows can be freely edited so as to meet the requirements of different using habits of doctors. In particular, this can be achieved by means of an adjusting device. The adjusting device is connected to the media signal processing device 4 in a communication manner, the adjusting device is configured to input adjusting information to the media signal processing device 4, the media signal processing device 4 is configured to control the information data input by each information input device to display the opening, closing, size, position, angle and the like of the image in the information display area according to the adjusting information input by the adjusting device, and then display each information data in the effective information display area as shown in fig. 10. The media signal processing means 4 may be a computer independent of the microscope, as shown in fig. 1. Or may be a processing device integral with the microscope. When the parameters such as the size and the position of the display of each information data are adjusted, the switch, the size, the position and the angle of the display of each information data can be adjusted by using a mouse, a keyboard and the like as adjusting devices through an external computer. Of course, the switch, size, position, angle, etc. of each information data display may be controlled by a processing device incorporated in the microscope, such as the microscope handle 7. As shown in fig. 11, specifically, after the function key 76 is pressed for 3 seconds, the system switches to the window editing mode, the multi-directional switch 73 is used to select a window to be edited, after the determination key 71 is pressed, one of the windows can be selected, then the function key 76 is pressed, the selection among the window size, position, angle and switch function can be performed, if the window size function is selected, the "+ key 74" is pressed, the window is increased, the "-key 75" is pressed, the window is decreased, then the determination key 71 is pressed, and the window size editing is determined to be finished. Pressing the cancel key 72 during editing can cancel editing. Or the biometric information of the user can be identified, and a collecting device is arranged and is in communication connection with the media signal processing device 4. The acquisition device is configured to acquire the biological characteristic information of the user in real time, and the media signal processing device 4 is configured to control the on/off, the size, the position and the angle of an image displayed in the information display area according to the information data input by the information input device. The biometric information of the user may be user voice, gesture, facial expression, eye movement, cranial nerve wave, mouth shape, etc. Therefore, the user does not need to contact skills to complete the operation, and the operation is simple and quick. The specific control flow is as shown in fig. 12, collecting the biometric information first, then judging whether the information is valid, if so, retrieving the corresponding biometric information base to call out the corresponding execution command and execute the command, and if not, returning to the step of collecting the biometric information.

In a further embodiment, when the slice image of the target tooth CBCT is superimposed on the real image of the target tooth, the image information in the main optical path of the microscope body 1 can be acquired in real time by arranging the image acquisition device. The image acquisition device is in communication connection with the media signal processing device 4. The image acquisition device transmits the image information acquired in real time in the main light path of the microscope body 1 to the media signal processing device 4. The media signal processing device 4 matches the cross-section cutting chart matched with the target tooth in the image information of the main light path according to the image information collected by the image collecting device, and superposes the cross-section cutting chart on the real image of the target tooth, thereby greatly facilitating the operation positioning difficulty of doctors and improving the operation accuracy.

In a further embodiment, the information input device may comprise a positioning navigation device. The positioning navigation device is installed on a surgical instrument, such as a mobile phone. The positioning navigation device is in communication connection with the media signal processing device 4. The positioning navigation device is arranged on the surgical instrument, so that the position information of the surgical instrument can be acquired in real time and is transmitted to the media signal processing device 4. The media signal processing device 4 processes the image data of the target tooth to obtain an optimal path for operating the target tooth, and then optionally displays the position information of the surgical instrument and the relative position information between the surgical instrument and the optimal path in the information display area of the display device 21. For example, the position information of the mobile phone can be displayed in a window in the information display area. Or displaying position image information between the path point and the mobile phone in a window in the information display area to prompt a user whether the mobile phone handpiece deviates from the path point or not.

The housing 20 preferably includes a housing 202 and a back plate 203, and components such as a power switch 205 and a power jack 204 are disposed on the back plate 203. The power socket 204 and the power switch 205 are electrically connected to the display device 21, respectively, and are configured to supply power to the display device 21 and control the on and off of the display device.

In a further implementation, a light splitting interface 201 is provided on one side of the housing 20, and a second light splitting prism 28 is provided in the housing 20 at a position close to the light splitting interface 201, as shown in fig. 6, so that a part of the light beam in the main light path of the microscope or a part of the light beam of the superimposed image in the microscope can be emitted from the light splitting interface 201. By connecting a digital camera or a digital video camera to the light splitting interface 201, images in the microscope can be recorded. Preferably, the splitting ratios of the first beam splitter prism 27 and the second beam splitter prism 28 are respectively 1: 9.

the method for implementing the enhanced image system mainly comprises the following steps, and the flow steps are shown in fig. 13: information data of a target object is led into a media signal processing device 4, the media signal processing device 4 analyzes the led information data, the processed information data is sent to a display device 21 of an image enhancement device 2, the display device 21 receives the information data and converts the information data into an optical image 61 for displaying, the optical image 61 displayed by the display device 21 is incident into a superposition mirror group on a main optical path of a microscope lens body 1 through a lens optical path, and the optical image 61 displayed by the display device 21 and the main optical path are superposed to form a superposed image which is then incident into a binocular tube 3.

After the CBCT image data is imported into the media signal processing device 4, the media signal processing device 4 analyzes the CBCT image data to obtain a three-dimensional image of the oral cavity of the target object, highlight key information in the three-dimensional image of the oral cavity of the target object to generate four views, and selectively display the four views in an information display area of the display device 21, select the target tooth on any one of the four views, generate a three-dimensional image and a cross-section cutting image of the selected target tooth by the media signal processing device 4, process and manage a cross-section slice view sequence, manage interface interaction, and selectively display the cross-section slice view sequence in the information display area of the display device 21.

The information data further includes additional information data, such as root meter data, and after the additional information data is imported into the media signal processing device 4, the media signal processing device 4 processes the additional information data, and optionally displays the additional information data in the information display area of the display device 21.

When the media signal processing device 4 sends the information data to the display device 21, the media signal integrates all the information data into one composite information data, and then sends the composite information data to the display device 21 for display, and the switch, the size, the position and the angle of the corresponding image displayed by each information data in the display device 21 can be adjusted. And finally outputting the superposed image.

Further, the analysis step of the CBCT image data by the media signal processing device 4 is as follows, and the flow chart is as shown in fig. 14: acquiring a folder path where the CBCT image data is located; acquiring a DICOM sequence and sequence information, wherein the sequence information comprises a sequence path, the number of slices and each picture; selecting a sequence according to the sequence information, adding the sequence into a database, and outputting a sequence path; analyzing sequence basic information, storing the analyzed basic information into a sequence volume data structure body and outputting sequence volume data information, receiving the sequence volume data information and controlling image display and interaction by a data control thread, interactively selecting a target tooth on an interface when four-view images are displayed and interacted, inputting selected information into a tooth segmentation module to perform tooth segmentation, outputting a segmented tooth three-dimensional graph to the data control thread, and continuously maintaining image display and interaction by the data control thread.

After outputting the sequence path, the method also comprises the following steps: analyzing the basic information of the sequence, storing the analyzed basic information into a sequence slice information base and outputting the analyzed basic information, receiving the input of the analyzed basic information by the instance management module, and adding the analyzed basic information into the database.

When the four-view images are displayed and interacted, the output path is selected in the interface interaction, the selection information is input to the path control module to be stored and managed, and meanwhile, the data control thread continuously maintains the image display and interaction.

Further, an image acquisition device is arranged to acquire image information in a main light path of the microscope body 1 in real time and transmit the image information to the media signal processing device 4, and the media signal processing device 4 matches a cross section cutting chart matched with a target tooth in the image information of the main light path according to the image information acquired by the image acquisition device and superposes the cross section cutting chart on an image of the target tooth.

Furthermore, a positioning navigation device is arranged on the surgical instrument to acquire the position information of the surgical instrument in real time and transmit the position information to the media signal processing device 4, the media signal processing device 4 processes the image data of the target tooth to obtain the optimal path for operating the target tooth, and then the position information of the surgical instrument and the relative position information between the surgical instrument and the optimal path can be selectively displayed in the information display area of the display device 21.

Compared with the prior art, the enhanced image system and the implementation method thereof have at least one or more of the following beneficial effects:

according to the image enhancement system and the implementation method thereof, the LCD, the OLED, the DLP and other display devices are adopted and matched with the beam splitter prism, so that image information displayed in the display devices can be superposed in the observation visual field of a microscope, an operator can conveniently observe a target object, and meanwhile, various data information related to an operation can be quickly checked; compared with a projector, the LCD, OLED, DLP and other displays have smaller volume, clearer displayed image, smaller power consumption and low heat productivity; the input can be an HDMI signal, and the connection is simple and convenient; the structure is small and does not occupy space; the media signal processing device may be a computer separate from the microscope or may be part of the microscope; the media signal processing device can preprocess the multi-channel signals such as patient case information, oral cavity holographic scanning images, CT, CBCT images or 3D modeling information, root measuring instruments and the like into one channel of signals, and then output the channel of signals into the display device of the enhanced image device 2 for display; the media signal device can process the input CBCT image data in a built-in software mode, reestablish a three-dimensional model of the target tooth, slice the three-dimensional model, highlight key parts of the tooth such as a root canal orifice, an edge contour and the like at the same time, and enable the slice images to be more clearly observed when the slice images are superposed in an eyepiece visual field area; the information display area in the display devices such as LCD, OLED, DLP and the like is matched with the observation visual field of the microscope, and the information data processed by the media signal processing device is displayed in the information display area, so that the image can be completely and non-cut and superposed in the visual field area of the eyepiece, and the condition that the complete superposed information cannot be observed due to the display at the edge of the visual field can be prevented; the number, size, position, direction, angle and the like of the information superposed in the visual field area of the eyepiece can be adjusted according to the requirement so as to adapt to different habit requirements of an operator; the adjustment of the information superposed in the ocular visual field area can be directly adjusted through a handle, a mouse, a keyboard and the like, and can also be controlled by collecting the biological characteristic information of user voice, gestures, facial expressions, eyeball actions, cranial nerve electric waves, mouth shapes and the like, so that an operator does not need to contact skills to complete the operation, and the operation is simple and rapid; the area except the information to be superposed displayed in the display device is displayed in black, so that in the observation of the optical path of the binocular tube 3, not only the image of the main optical path of the microscope lens body can be observed, but also the image displayed in the display device can be observed, for example, the root canal therapy is carried out, the slice image of the CBCT of the tooth and the real image of the main optical path of the microscope lens body can be superposed and displayed after calibration, so that the highlighted dental pulp hole image can be superposed on the real tooth image, the operation positioning of a doctor is greatly facilitated, the operation difficulty is reduced, and the operation accuracy is improved; the real-time positioning of the surgical instruments can be realized by matching with a positioning navigation device, and the surgical precision is further improved.

As used herein, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, including not only those elements listed, but also other elements not expressly listed.

In this document, the terms front, back, upper and lower are used to define the components in the drawings and the positions of the components relative to each other, and are used for clarity and convenience of the technical solution. It is to be understood that the use of the directional terms should not be taken to limit the scope of the claims.

The features of the embodiments and embodiments described herein above may be combined with each other without conflict.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the utility model, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. An image enhancement system is characterized by comprising a media signal processing device (4), an image enhancement device (2), a microscope body (1) and a binocular tube (3), wherein the image enhancement device (2) comprises a display device (21) and a superposition lens group, the display device (21) is in communication connection with the media signal processing device (4), the superposition lens group is arranged on a main light path of the microscope body (1), the binocular tube (3) is arranged on the microscope body (1), the display device (21) is configured to receive information data sent by the media signal processing device (4) and convert the received information data into an optical image, the optical image sent by the display device (21) is superposed into the main light path of the microscope body (1) through the superposition lens group to form a superposed image, the superimposed image can be observed through the binocular tube (3).

2. The system according to claim 1, comprising a plurality of information input devices, wherein the information input devices are respectively connected to the media signal processing device (4) in a communication manner, and the media signal processing device (4) is configured to convert information data inputted from the plurality of information input devices into composite information data and transmit the composite information data to the display device (21).

3. The system according to claim 2, wherein the display device (21) comprises an information display area, the information display area is matched with the observation visual field of the binocular tube (3), and the optical image corresponding to the composite information data is displayed in the information display area after being converted by the media signal processing device (4);

the display device (21) is an OLED display, or an LCD display, or a DLP display.

4. An enhanced image system as claimed in claim 3, wherein the optical image from said display device (21) is black in the region outside the optical image corresponding to said composite information data.

5. The system according to claim 3, further comprising an adjustment device communicatively connected to the media signal processing device (4), the adjustment device being configured to input adjustment information to the media signal processing device (4), the media signal processing device (4) being configured to control the on/off, the size, the position, and the angle of the image displayed in the information display area according to the information data input by the information input device based on the adjustment information.

6. The enhanced imaging system according to claim 3, further comprising a capturing device, said capturing device being communicatively connected to said media signal processing device (4), said capturing device being configured to capture the biometric information of the user in real time, said media signal processing device (4) being configured to control the opening and closing, the size, the position and the angle of the image displayed in the information display area according to the information data inputted by said biometric information input device.

7. The enhanced imaging system according to claim 1, further comprising an image capturing device, said image capturing device being communicatively connected to said media signal processing device (4), said image capturing device being configured to capture image information in a main optical path of said microscope body (1) in real time and to transmit said image information to said media signal processing device (4).

8. The enhanced imaging system of claim 2, wherein the information input device comprises a positioning and navigation device, the positioning and navigation device is mounted on a surgical instrument, the positioning and navigation device is connected with the media signal processing device (4) in a communication manner, and the positioning and navigation device is configured to collect the position information of the surgical instrument in real time and transmit the position information to the media signal processing device (4).