CN113113149A - Prompt information display device and method of augmented reality operation navigation system - Google Patents
Prompt information display device and method of augmented reality operation navigation system Download PDFInfo
- Publication number
- CN113113149A CN113113149A CN202110357343.3A CN202110357343A CN113113149A CN 113113149 A CN113113149 A CN 113113149A CN 202110357343 A CN202110357343 A CN 202110357343A CN 113113149 A CN113113149 A CN 113113149A
- Authority
- CN
- China
- Prior art keywords
- information
- prompt
- prompt information
- category
- belongs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Primary Health Care (AREA)
- General Health & Medical Sciences (AREA)
- Epidemiology (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Evolutionary Computation (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Surgery (AREA)
- Urology & Nephrology (AREA)
- Computer Graphics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Databases & Information Systems (AREA)
- Pathology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a prompt message display device and a method of an augmented reality surgical navigation system. A prompt information display device of an augmented reality surgical navigation system includes: the acquisition module is used for acquiring prompt information to be displayed; the first determining module is used for determining the priority of the prompt message according to the type of the message to which the prompt message belongs; the second determining module is used for determining the information display position of the prompt message according to the information content category to which the prompt message belongs; and the display module is used for displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information. By adopting the technical scheme, the negative influence of the prompt information of the augmented reality operation navigation system on the operator can be reduced.
Description
Technical Field
The application relates to the field of computers, in particular to a prompt information display device and method of an augmented reality surgical navigation system.
Background
The augmented reality operation navigation system enables a wearer to display operation related information in a visual field at the same time, and is matched with position information of an operating instrument in use, which is obtained by a head-mounted camera or other positioning and collecting devices, so that rapid operation navigation is realized. But irregularly displaying too much information to the operator can distract the operator, reduce the work efficiency of the operator, and even create risks.
Disclosure of Invention
In order to solve at least one of the above technical problems, the present application provides a prompt information display apparatus and method of an augmented reality surgical navigation system.
In a first aspect of the present application, a prompt information display device of an augmented reality surgical navigation system includes:
the acquisition module is used for acquiring prompt information to be displayed;
the first determining module is used for determining the priority of the prompt message according to the type of the message to which the prompt message belongs;
the second determining module is used for determining the information display position of the prompt message according to the information content category to which the prompt message belongs;
and the display module is used for displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information.
Optionally, the first determining module is configured to, when determining the priority of the prompt information according to the information type category to which the prompt information belongs, specifically:
if the type of the information to which the prompt information belongs is normal type information, determining the priority of the prompt information according to the type of the information display position to which the prompt information belongs;
if the type of the information to which the prompt information belongs is abnormal information, determining the priority of the prompt information according to the type of the information content to which the prompt information belongs;
the information display position categories comprise a first category, a second category and a third category, the first category represents that the display position of the prompt information belonging to the category is related to the position of the display area, the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient, and the third category represents that the display position of the prompt information belonging to the category is related to the position of the surgical instrument.
Optionally, the first determining module is configured to, when determining the priority of the prompt information according to the information type category to which the prompt information belongs, specifically:
and determining the priority of the prompt message according to the type of the message to which the prompt message belongs and the time type of the message presentation to which the prompt message belongs, wherein the time type of the message presentation comprises permanent presentation and conditional presentation.
Optionally, the second determining module is configured to, when determining the information display position of the prompt information according to the information content category to which the prompt information belongs, specifically:
determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs;
and determining the information display position of the prompt message according to the information display position category to which the prompt message belongs.
Optionally, the second determining module is configured to, when determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs, specifically:
if the information content classification to which the prompt information belongs is an equipment state classification, determining that the information display position classification to which the prompt information belongs is a first classification, wherein the first classification indicates that the display position of the prompt information belonging to the classification is related to the position of a display area;
if the information content category to which the prompt information belongs is a patient information category, determining that the information display position category to which the prompt information belongs is a second category, wherein the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient;
and if the information content classification to which the prompt information belongs is a surgical instrument class, determining that the information display position to which the prompt information belongs is classified into a third class, wherein the third class represents that the display position of the prompt information belonging to the class is related to the position of the surgical instrument.
Optionally, the display module is configured to, when displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information, specifically:
judging whether the prompt information is displayed or not according to the priority of the prompt information and the current information display condition;
and if the prompt information is judged to be displayed, displaying the prompt information at the information display position.
Optionally, the display module is configured to, when determining whether to display the prompt information according to the priority of the prompt information and the current information display status, specifically:
and judging whether the display quantity of the current information exceeds a set value or not, and judging whether the prompt information is displayed or not according to the priority of the prompt information when the display quantity of the current information exceeds the set value.
Optionally, the apparatus includes:
and the display mode determining module is used for acquiring the target direction of the surgical instrument corresponding to the prompt information and determining the display direction of the prompt information according to the target direction when the information display position category to which the prompt information belongs is judged to be a third category, wherein the third category represents that the display position of the prompt information belonging to the category is related to the position of the surgical instrument.
In a second aspect of the present application, a method for displaying prompt information of an augmented reality surgical navigation system includes:
acquiring prompt information to be displayed;
determining the priority of the prompt message according to the type of the message to which the prompt message belongs;
determining the information display position of the prompt information according to the information content category to which the prompt information belongs;
and displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information.
Optionally, the information type category includes normal information and abnormal information;
the determining the priority of the prompt message according to the type of the message to which the prompt message belongs includes:
if the type of the information to which the prompt information belongs is normal type information, determining the priority of the prompt information according to the type of the information display position to which the prompt information belongs;
if the type of the information to which the prompt information belongs is abnormal information, determining the priority of the prompt information according to the type of the information content to which the prompt information belongs;
the information display position categories comprise a first category, a second category and a third category, the first category represents that the display position of the prompt information belonging to the category is related to the position of the display area, the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient, and the third category represents that the display position of the prompt information belonging to the category is related to the position of the surgical instrument.
Optionally, the determining the priority of the prompt information according to the information type category to which the prompt information belongs includes:
and determining the priority of the prompt message according to the type of the message to which the prompt message belongs and the time type of the message presentation to which the prompt message belongs, wherein the time type of the message presentation comprises permanent presentation and conditional presentation.
Optionally, the determining the information display position of the prompt information according to the information content category to which the prompt information belongs includes:
determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs;
and determining the information display position of the prompt message according to the information display position category to which the prompt message belongs.
Optionally, the information content category includes a device status category, a patient information category, a surgical plan category, a surgical step category, and a surgical instrument category;
the determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs includes:
if the information content classification to which the prompt information belongs is an equipment state classification, determining that the information display position classification to which the prompt information belongs is a first classification, wherein the first classification indicates that the display position of the prompt information belonging to the classification is related to the position of a display area;
if the information content category to which the prompt information belongs is a patient information category, determining that the information display position category to which the prompt information belongs is a second category, wherein the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient;
and if the information content classification to which the prompt information belongs is a surgical instrument class, determining that the information display position to which the prompt information belongs is classified into a third class, wherein the third class represents that the display position of the prompt information belonging to the class is related to the position of the surgical instrument.
Optionally, the displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information includes:
judging whether the prompt information is displayed or not according to the priority of the prompt information and the current information display condition;
and if the prompt information is judged to be displayed, displaying the prompt information at the information display position.
Optionally, the determining whether to display the prompt information according to the priority of the prompt information and the current information display condition includes:
and judging whether the display quantity of the current information exceeds a set value or not, and judging whether the prompt information is displayed or not according to the priority of the prompt information when the display quantity of the current information exceeds the set value.
Optionally, the method further includes:
and when the information display position category to which the prompt information belongs is judged to be a third category, acquiring the target direction of the surgical instrument corresponding to the prompt information, and determining the display direction of the prompt information according to the target direction, wherein the third category represents that the display position of the prompt information belonging to the category is related to the position of the surgical instrument.
In a third aspect of the present application, an electronic device comprises a memory for storing computer instructions and a processor, wherein the computer instructions are executed by the processor to implement the method according to the second aspect of the present application.
The technical scheme of the application can achieve the following beneficial technical effects: according to the technical scheme, the priority and the information display position of the prompt information are respectively determined according to the type and the content of the information, so that the priority and the information display position of the prompt information can be rapidly determined; and the prompt information is displayed according to the priority of the prompt information and the information display position, so that the negative influence of the prompt information of the augmented reality operation navigation system on the operator can be reduced.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the application and together with the description serve to explain the principles of the application.
Fig. 1 is a block diagram illustrating a prompt information display device of an augmented reality surgical navigation system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a prompt message display in an embodiment of the present application;
fig. 3 is a flowchart of a prompt information display method of an augmented reality surgical navigation system in an embodiment of the present application;
fig. 4 is a block diagram of an electronic device in the embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are for purposes of illustration only and are not to be construed as limitations of the present application. It should be noted that, for convenience of description, only the portions related to the present application are shown in the drawings.
In addition, the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Referring to fig. 1, a prompt information display device of an augmented reality surgical navigation system includes:
an obtaining module 101, configured to obtain prompt information to be displayed;
the first determining module 102 is configured to determine a priority of the prompt message according to the type of the message to which the prompt message belongs;
the second determining module 103 is configured to determine an information display position of the prompt information according to the information content category to which the prompt information belongs;
and the display module 104 is configured to display the prompt information according to the priority of the prompt information and the information display position of the prompt information.
In this embodiment, according to specific situations, a classification is preset in the system for the prompt information to be displayed to the user in advance, so that when the system obtains a piece of prompt information to be displayed, the position and priority for displaying the prompt information are determined according to the category to which the prompt information belongs. For example, the information type of the prompt message is divided into normal information and abnormal information; the information content category of the prompt information is divided into an equipment state category, a patient information category, a surgical plan category, a surgical step category, a surgical instrument category and the like. In this embodiment, the priority indicates the priority of the display of the prompt information; the priority may be used to determine whether the hint is hidden or hidden by other hints, e.g., when two hints are displayed at the same location, which hint is displayed before and which hint is hidden; the device is used for judging which prompt message is displayed and which prompt message is hidden when the two prompt messages are not allowed to be displayed at the same set position; and the display device is used for judging which prompt message is hidden according to the display priority when the displayed prompt messages exceed the set number.
According to the technical scheme, the priority and the information display position of the prompt information can be respectively judged according to the information type category and the information content category of the prompt information, so that the priority and the information display position can be quickly obtained, the prompt information is displayed according to the priority and the information display position of the prompt information, the probability of confusion of prompt information display can be reduced by displaying the prompt information according to the priority and the information display position of the prompt information, the distraction of the prompt information to an operator is reduced, and the negative influence of the prompt information of the augmented reality operation navigation system to the operator is reduced.
For easy visual understanding, referring to fig. 2, the information display position shown in fig. 2 displays prompt information such as "AR glasses power", "signal", "patient information", "surgical procedure prompt", "patient focus related information", and "surgical instrument related information". Here, "patient information" is displayed at or near the patient 201, "surgical instrument related information" is displayed at or near the surgical instrument 202, "AR glasses power", and "signal" are displayed at fixed positions of the display area of the AR glasses, for example, at the upper left corner or the upper right corner of the display area of the AR glasses.
In one embodiment, the first determining module, when determining the priority of the hint information according to the type of information to which the hint information belongs, is specifically configured to:
if the type of the information to which the prompt information belongs is normal type information, determining the priority of the prompt information according to the type of the information display position to which the prompt information belongs;
if the type of the information to which the prompt information belongs is abnormal information, determining the priority of the prompt information according to the type of the information content to which the prompt information belongs;
the abnormal information refers to information related to various abnormal states which need to be explicitly prompted to a user, such as information about abnormal system connection, extremely low system power, failure in medical equipment identification, failure in patient registration, and the like. Because the abnormal information is large and may influence the normal operation, the abnormal information needs to be displayed with high priority to be presented to the user, so that the influence on the operation process caused by the fact that the user does not know the abnormal information in time is avoided. The normal information refers to information other than various abnormal information prompted to the user, such as successful system connection, electric quantity display when the system electric quantity is normal, successful medical equipment identification, successful patient configuration and the like, and operation step navigation prompt information displayed to the user in the operation process and the like.
The information display position categories comprise a first category, a second category and a third category, wherein the first category represents that the display positions of the prompt messages belonging to the categories are related to the positions of the display areas, for example, the electric quantity of the equipment belongs to the first category and is displayed in the upper left corner or the upper right corner of the display areas of the AR glasses; the second category indicates that the display position of the prompt information belonging to the category is related to the position of the patient, for example, the focus position prompt information of the patient belongs to the second category, and the information is displayed in an augmented reality mode and is superposed on the corresponding position of the body of the patient. The third category indicates that the display position of the prompt information belonging to the category is related to the position of the surgical instrument, for example, in the navigation of the puncture operation, the extension line of the puncture needle body is displayed at the front end of the needle point of the puncture needle in an augmented reality mode, so that the user is helped to judge whether the needle point of the puncture needle is aligned with the lesion position.
In this embodiment, the priority of the abnormal information is higher than that of the normal information, so that the display of the abnormal information is not easily affected by the normal information, and meanwhile, when both the two pieces of prompt information are the abnormal information, the priority is determined by the type of the information content, and when both the two pieces of prompt information are the normal information, the priority is determined by the type of the information display position.
Specifically, the occlusion of the normal information is judged according to the actual distance from the wearer's field of vision and according to the priorities of the first category "related to the display area position", the third category "related to the surgical instrument position", and the second category "related to the patient position" of the information display position categories, which may specifically be: display area position-related priority > surgical instrument position-related priority > patient position-related priority. The priority of the abnormal information is always higher than that of the normal information, and the priority among the abnormal information is determined according to the information content category, which may be specifically: device state class > instrument information class > surgical plan class > patient information class > surgical steps class.
In one embodiment, the first determining module, when determining the priority of the hint information according to the type of information to which the hint information belongs, is specifically configured to:
and determining the priority of the prompt message according to the type of the message to which the prompt message belongs and the time of displaying the message to which the prompt message belongs, wherein the time of displaying the message comprises permanent display and conditional display.
Specifically, the priority of conditional presentation > the priority of permanent presentation, where permanent presentation is defined as the presence of a display in space or screen forever after the device is started (e.g., screen displayable region information appears on the screen forever, patient information is forever fixed in the operating room or in a particular location of the patient); the condition presentation is defined to display the related information if and only if the trigger condition is satisfied, and to hide the related information if the trigger condition is not present. For example, the device power information is permanently displayed, the surgical procedure prompting information is conditionally displayed, and if the two items of prompting information belong to normal information (when the power is not extremely low), the surgical procedure prompting information is preferentially displayed to ensure that the surgery is smoothly performed if the two items of prompting information display positions in the visual field conflict.
In one embodiment, the second determining module, when determining the information display position of the prompt information according to the information content category to which the prompt information belongs, is specifically configured to:
determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs;
and determining the information display position of the prompt message according to the information display position category to which the prompt message belongs.
In this embodiment, the information display position category to which the prompt information belongs is determined according to the information content category, and then the information display position of the prompt information is determined according to the information display position category to which the prompt information belongs. The information display position category is mainly used for determining prompt information.
The information display position category comprises three types of information, namely a display position and a display area position, wherein the display position is related to the position of a patient, and the display position is related to the position of a surgical instrument. Since the prompt message is generally displayed on the display screen, the display area position correlation is generally display screen position correlation, for example, the prompt message related to the frame is displayed on the edge portion of the display screen.
The position correlation includes two types of relative fixed positions and relative movement with the positions. The position is relatively moved, for example, the prompt information related to the position of the display area can be moved from the upper left corner of the display area to the lower left corner of the display area, the prompt information related to the position of the patient can be moved from the foot to the head of the patient, the prompt information related to the position of the surgical instrument can be moved from the root of the surgical instrument to the head of the surgical instrument, and the like.
In an embodiment, the second determining module is configured to, when determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs, specifically:
if the information content classification to which the prompt information belongs is an equipment state classification, determining that the information display position classification to which the prompt information belongs is a first classification, wherein the first classification indicates that the display position of the prompt information belonging to the classification is related to the position of a display area;
if the information content category to which the prompt information belongs is the patient information category, determining the information display position category to which the prompt information belongs as a second category, wherein the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient;
and if the information content classification to which the prompt information belongs is the surgical instrument class, determining that the information display position to which the prompt information belongs is classified into a third class, wherein the third class represents that the display position of the prompt information belonging to the class is related to the surgical instrument position.
Optionally, if the information content category to which the prompt information belongs is a surgical plan category or a surgical step category, the information display position category to which the prompt information belongs is determined according to the specific content of the prompt information.
As noted above, the information content classes may include a device status class, a patient information class, a surgical plan class, a surgical procedure class, and a surgical instrument class.
Specifically, the display position of the device state prompting information is always related to the position of the display area and serves as a first priority prompt; the display position of the patient information prompting information is always related to the position of the patient; the display position of the surgical instrument prompt information is related to the position of the surgical instrument; in the operation plan information, the operation target and peripheral organs are related to the position of the patient, and in different stages of the operation, the prediction of the orientation of the instrument and the like can be related to the instrument and also related to the position of the patient (related to the operation target); the text prompt part of the prompt information of the operation steps is related to the position of the display area, the instrument using part is related to the position of the instrument, and the occurrence position part is related to the position of the patient.
The equipment state class comprises an equipment storage space, electric quantity, a network communication state, a screen displayable area, a camera recognizable area and the like. The device status classes can be further divided into augmented reality devices themselves and monitoring and surgical devices that have a signal source connected to it. The prompt information related to the augmented reality device is generally high in importance, and is the prompt information which is related to the screen position and cannot be ignored and has the highest priority. The monitoring equipment accessed to the signal source has the additional operation and use specifications, has relatively low importance, can be related to the environment position, is permanently displayed, and can be provided with prompt information of a sheltered type.
The patient information includes name, gender, case number, surgical site, physiological signals (e.g., blood pressure, blood oxygen, respiration), etc.
The surgical plan includes the target lesion, the target surgical area, peripheral organs, the planned puncture location, depth, angle, etc.
The surgical steps include textual or graphical prompts for instrument operational steps that need to be taken in sequence to implement the current surgical plan.
The information display mode categories of the prompt message in the embodiment of the application comprise static texts, 2d images and 3d images, and dynamic texts, 2d images and 3d images.
In one embodiment, the display module is configured to, when displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information, specifically:
judging whether the prompt information is displayed or not according to the priority of the prompt information and the current information display condition;
and if the prompt information is judged to be displayed, displaying the prompt information on the information display position.
The current information display condition may be a current total information display quantity, may be whether a certain specific display position has already displayed information, and may be a priority comparison between the displayed prompt information and the prompt information to be displayed.
In one embodiment, the display module is configured to, when determining whether to display the prompt information according to the priority of the prompt information and the current information display condition, specifically:
and judging whether the display quantity of the current information exceeds a set value or not, and judging whether the prompt information is displayed or not according to the priority of the prompt information when the display quantity of the current information exceeds the set value.
In one embodiment, an apparatus comprises:
and the display mode determining module is used for acquiring the target direction of the surgical instrument corresponding to the prompt information and determining the display direction of the prompt information according to the target direction when the information display position category to which the prompt information belongs is judged to be a third category, wherein the third category represents that the display position of the prompt information belonging to the category is related to the position of the surgical instrument. For example, in the puncture surgical navigation process, the prompt information to be displayed is specifically the puncture path direction of the puncture needle, and is determined according to the orientation of the puncture needle when the puncture needle is aligned with the puncture target.
In this embodiment, the display direction of the prompt message is determined according to the target direction, so that after the prompt message is adjusted, the corresponding surgical instrument is also adjusted, that is, the direction of the surgical instrument faces the target direction. The technical scheme of the embodiment can ensure that the user can put the corresponding surgical instrument in a natural state according to the condition of the prompt message, for example, the characters of the prompt message are inverted, and the corresponding surgical instrument needs to be rotated 180 degrees to meet the use requirement of the surgical instrument.
Referring to fig. 3, a prompt information display method of an augmented reality surgical navigation system includes:
s301, acquiring prompt information to be displayed;
s302, determining the priority of the prompt message according to the type of the message to which the prompt message belongs;
s303, determining the information display position of the prompt message according to the information content category to which the prompt message belongs;
and S304, displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information.
In this embodiment, according to specific situations, a classification is preset in the system for the prompt information to be displayed to the user in advance, so that when the system obtains a piece of prompt information to be displayed, the position and priority for displaying the prompt information are determined according to the category to which the prompt information belongs. For example, the information type of the prompt message is divided into normal information and abnormal information; the information content category of the prompt information is divided into an equipment state category, a patient information category, a surgical plan category, a surgical step category, a surgical instrument category and the like.
In this embodiment, the priority indicates the priority of the display of the prompt information; the priority may be used to determine whether the hint is hidden or hidden by other hints, e.g., when two hints are displayed at the same location, which hint is displayed before and which hint is hidden; the device is used for judging which prompt message is displayed and which prompt message is hidden when the two prompt messages are not allowed to be displayed at the same set position; and the display device is used for judging which prompt message is hidden according to the display priority when the displayed prompt messages exceed the set number.
According to the technical scheme, the priority and the information display position of the prompt information can be respectively judged according to the information type category and the information content category of the prompt information, so that the priority and the information display position can be quickly obtained, the prompt information is displayed according to the priority and the information display position of the prompt information, the probability of confusion of prompt information display can be reduced by displaying the prompt information according to the priority and the information display position of the prompt information, the distraction of the prompt information to an operator is reduced, and the negative influence of the prompt information of the augmented reality operation navigation system to the operator is reduced.
In one embodiment, the information type categories include normal category information and abnormal category information;
determining the priority of the prompt message according to the type of the message to which the prompt message belongs, including:
if the type of the information to which the prompt information belongs is normal type information, determining the priority of the prompt information according to the type of the information display position to which the prompt information belongs;
if the type of the information to which the prompt information belongs is abnormal information, determining the priority of the prompt information according to the type of the information content to which the prompt information belongs;
the information display position categories comprise a first category, a second category and a third category, the first category represents that the display positions of the prompt messages belonging to the categories are related to the position of the display area, the second category represents that the display positions of the prompt messages belonging to the categories are related to the position of the patient, and the third category represents that the display positions of the prompt messages belonging to the categories are related to the position of the surgical instrument.
In this embodiment, the priority of the abnormal information is higher than that of the normal information, so that the display of the abnormal information is not easily affected by the normal information, and meanwhile, when both the two pieces of prompt information are the abnormal information, the priority is determined by the type of the information content, and when both the two pieces of prompt information are the normal information, the priority is determined by the type of the information display position.
Specifically, the occlusion of the normal information is judged according to the actual distance from the wearer's field of vision and according to the priorities of the first category "related to the display area position", the third category "related to the surgical instrument position", and the second category "related to the patient position" of the information display position categories, which may specifically be: display area position-related priority > surgical instrument position-related priority > patient position-related priority. The priority of the abnormal class information is always higher than that of the normal class information. The priority among the abnormal information is determined according to the information content category, and may specifically be: device state class > instrument information class > surgical plan class > patient information class > surgical steps class.
In an optional implementation manner, determining the priority of the prompt message according to the type of the message to which the prompt message belongs includes:
and determining the priority of the prompt message according to the type of the message to which the prompt message belongs and the time of displaying the message to which the prompt message belongs, wherein the time of displaying the message comprises permanent display and conditional display.
Specifically, the priority of conditional presentation > the priority of permanent presentation, where permanent presentation is defined as the presence of a display in space or screen forever after the device is started (e.g., screen displayable region information appears on the screen forever, patient information is forever fixed in the operating room or in a particular location of the patient); the condition presentation is defined to display the related information if and only if the trigger condition is satisfied, and to hide the related information if the trigger condition is not present.
In an optional implementation manner, the determining the information display position of the prompt message according to the information content category to which the prompt message belongs includes:
determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs;
and determining the information display position of the prompt message according to the information display position category to which the prompt message belongs.
In this embodiment, the information display position category to which the prompt information belongs is determined according to the information content category, and then the information display position of the prompt information is determined according to the information display position category to which the prompt information belongs. The information presentation location category is primarily used to determine the reminder information,
the information display position category comprises three types of information, namely a display position and a display area position, wherein the display position is related to the position of a patient, and the display position and the position of a surgical instrument. The position correlation includes two types of position relative fixation and position relative movement. Relative movement of the positions, such as a reminder associated with the position of the display area, may be moved from the upper left corner of the display area to the lower left corner of the display area, a reminder associated with the position of the patient may be moved from the foot to the head of the patient, a reminder associated with the position of the surgical instrument may be moved from the root of the surgical instrument to the head of the surgical instrument, and so forth.
In an alternative embodiment, the information content classes include a device status class, a patient information class, a surgical plan class, a surgical steps class, and a surgical instruments class;
determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs, wherein the determining comprises the following steps:
if the information content classification to which the prompt information belongs is an equipment state classification, determining that the information display position classification to which the prompt information belongs is a first classification, wherein the first classification indicates that the display position of the prompt information belonging to the classification is related to the position of a display area;
if the information content category to which the prompt information belongs is the patient information category, determining the information display position category to which the prompt information belongs as a second category, wherein the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient;
and if the information content classification to which the prompt information belongs is the surgical instrument class, determining that the information display position to which the prompt information belongs is classified into a third class, wherein the third class represents that the display position of the prompt information belonging to the class is related to the surgical instrument position.
Optionally, if the information content category to which the prompt information belongs is a surgical plan category or a surgical step category, the information display position category to which the prompt information belongs is determined according to the specific content of the prompt information.
The display position of the equipment state prompting information is always related to the position of the display area and serves as a first priority prompt; the display position of the patient information prompting information is always related to the position of the patient; the display position of the surgical instrument prompt information is related to the position of the surgical instrument; in the operation plan information, the operation target and peripheral organs are related to the position of the patient, and in different stages of the operation, the prediction of the orientation of the instrument and the like can be related to the instrument and also related to the position of the patient (related to the operation target); the text prompt part of the prompt information of the operation steps is related to the position of the display area, the instrument using part is related to the position of the instrument, and the occurrence position part is related to the position of the patient.
Specifically, the device status class includes a device storage space, an electric quantity, a network communication status, a screen displayable area, a camera recognizable area, and the like. The device status classes can be further divided into augmented reality devices themselves and monitoring and surgical devices that have a signal source connected to it. The prompt information related to the augmented reality device is generally high in importance, and is the prompt information which is related to the screen position and cannot be ignored and has the highest priority. The monitoring equipment accessed to the signal source has the additional operation and use specifications, has relatively low importance, can be related to the environment position, is permanently displayed, and can be provided with prompt information of a sheltered type.
The patient information includes name, gender, case number, surgical site, physiological signals (e.g., blood pressure, blood oxygen, respiration), etc.
The surgical plan includes the target lesion, the target surgical area, peripheral organs, the planned puncture location, depth, angle, etc.
The surgical steps include textual or graphical prompts for instrument operational steps that need to be taken in sequence to implement the current surgical plan.
The information display mode categories of the prompt message in the embodiment of the application comprise static texts, 2d images and 3d images, and dynamic texts, 2d images and 3d images.
In an alternative embodiment, displaying the prompt message according to the priority of the prompt message and the message display position of the prompt message includes:
judging whether the prompt information is displayed or not according to the priority of the prompt information and the current information display condition;
and if the prompt information is judged to be displayed, displaying the prompt information on the information display position.
The current information display condition may be a current total information display quantity, may be whether a certain specific display position has already displayed information, and may be a priority comparison between the displayed prompt information and the prompt information to be displayed.
Specifically, the determining whether to display the prompt information according to the priority of the prompt information and the current information display status includes:
and judging whether the display quantity of the current information exceeds a set value or not, and judging whether the prompt information is displayed or not according to the priority of the prompt information when the display quantity of the current information exceeds the set value.
In an alternative embodiment, the method further comprises:
and when the information display position category to which the prompt information belongs is judged to be a third category, acquiring the target direction of the surgical instrument corresponding to the prompt information, and determining the display direction of the prompt information according to the target direction, wherein the third category indicates that the display position of the prompt information belonging to the category is related to the position of the surgical instrument.
In this embodiment, the display direction of the prompt message is determined according to the target direction, so that after the prompt message is adjusted, the corresponding surgical instrument is also adjusted, that is, the direction of the surgical instrument faces the target direction. The technical scheme of the embodiment can ensure that the user can put the corresponding surgical instrument in a natural state according to the condition of the prompt message, for example, the characters of the prompt message are inverted, and the corresponding surgical instrument needs to be rotated 180 degrees to meet the use requirement of the surgical instrument.
In an alternative embodiment, the dynamic policy for prompting for information is as follows: based on the information display mode classification, more than 2 pieces of dynamic information cannot appear in the visual field of the user at the same time.
The following illustrates the priority of the dynamic hint information for each information content category:
for example, the information of the recognizable area of the augmented reality device camera belonging to the device status class is the most important information with the highest priority in the navigation operation process. This information display strategy is: the display position is related to the position of the display area, and the display is permanently displayed and never shielded. Meanwhile, because the pattern is persistent and does not attract attention intentionally, the pattern can be a static 2D pattern, and the visual interference in use is reduced.
For example, the remaining storage space information of the device status class, because it is not needed to be paid attention to in normal use, but is likely to cause failure of the navigation process once insufficient storage space occurs, so the display strategy of the information may be: and (2) displaying, which is related to the position of the display area, only when the residual storage space is smaller than a specific threshold value, and not being blocked (related to the position of the display area which is the recognizable area, and the blocking between the recognizable area and the display area can be avoided through interface design), static or dynamic 2D patterns.
For example, the name information of the patient information category, which is generally used only at the beginning of the surgery, may be displayed according to the following display strategy: only 2 minutes before the start of the procedure, which is related to the patient position, can be shown occluded by all other information, static text.
For example, the body surface puncture needle insertion point information of the operation plan type, which should be associated with the position of the patient, is displayed when the operation step is executed to the navigation puncture, is hidden and displayed after the operation step is executed to the puncture into the skin, can block the puncture target in the body which is the operation plan, can be blocked by the instrument advancing direction indication information, and is in a static 2D pattern.
For example, the body surface feature point selection information of the surgical steps is triggered when the surgical steps are executed to the step, after triggering, the operator can be prompted by static characters in the area related to the screen position, the operator should execute the step at the moment, meanwhile, the operator can be prompted by dynamic 3D to carry out the position operation in the area where the first feature point of the body surface of the patient is located, after the position operation is completed, the static characters on the screen are changed, and meanwhile, the operator is prompted by the dynamic 3D of another feature point area of the body surface of the patient to carry out the next position operation. The screen information may not be occluded and the spatial information may be occluded by other information.
For example, the information of the distance from the puncture needle tip of the surgical instrument to the lesion may be triggered and displayed when the surgical procedure is performed to the puncture navigation. The information is highlighted through dynamic characters and static 3D patterns when the information is fixed outside the body of a patient during first triggering, the information is attracted, meanwhile, the position of the information is kept consistent with the position of the needle point which needs to be paid attention by the current operator, and the information and the needle point of the puncture needle serving as an operation target can be seen clearly at the sight focus of the operator. This information text part is never occluded by non-screen related information, while the static 3D part as a setback may be occluded by other information. When the surgical procedure proceeds to the next step, i.e. after the puncture needle has penetrated the skin, this information should not stay at the puncture needle tip position any more, but instead be converted into surgical planning type information associated with the patient position: the region of the target site is punctured. At this stage of the operation, the operator should concentrate on the puncture target located at the farthest visual field, and the orientation of the puncture needle is stabilized as much as possible in the puncture target by controlling the direction of the hand-held puncture needle. Therefore, the position correlation mode of the information of the distance between the needle point of the puncture needle and the pathological change distance which is also important at the moment should jump to the target position, and the operator is reminded that the sight focus should be changed to the puncture target farther away from the needle point at the moment.
Referring to fig. 4, an electronic device 400, a processor 401 and a memory 402, the memory 402 being used for storing computer instructions to be executed by the processor 401 for implementing the method according to any of the embodiments of the present application.
The present application also provides a computer system for executing the method of the embodiments of the present application, the computer system including a processing unit that can execute various processes in the embodiments shown in the above-described drawings according to a program stored in a Read Only Memory (ROM) or a program loaded from a storage section into a Random Access Memory (RAM). In the RAM, various programs and data necessary for system operation are also stored. The processing unit, the ROM, and the RAM are connected to each other by a bus. An input/output (I/O) interface is also connected to the bus.
The following components are connected to the I/O interface: an input section including a keyboard, a mouse, and the like; an output section including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section including a hard disk and the like; and a communication section including a network interface card such as a LAN card, a modem, or the like. The communication section performs communication processing via a network such as the internet. The drive is also connected to the I/O interface as needed. A removable medium such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive as necessary, so that a computer program read out therefrom is mounted into the storage section as necessary. The processing unit can be realized as a CPU, a GPU, a TPU, an FPGA, an NPU and other processing units.
In the description herein, reference to the description of the terms "one embodiment/mode," "some embodiments/modes," "example," "specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment/mode or example is included in at least one embodiment/mode or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to be the same embodiment/mode or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments/modes or examples. Furthermore, the various embodiments/aspects or examples and features of the various embodiments/aspects or examples described in this specification can be combined and combined by one skilled in the art without conflicting therewith.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
It should be understood by those skilled in the art that the above embodiments are only for clarity of explanation and are not intended to limit the scope of the present application. Other variations or modifications will occur to those skilled in the art based on the foregoing disclosure and are still within the scope of the present application.
Claims (10)
1. A prompt information display device of an augmented reality surgical navigation system, comprising:
the acquisition module is used for acquiring prompt information to be displayed;
the first determining module is used for determining the priority of the prompt message according to the type of the message to which the prompt message belongs;
the second determining module is used for determining the information display position of the prompt message according to the information content category to which the prompt message belongs;
and the display module is used for displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information.
2. The device for displaying the prompt information of the augmented reality surgical navigation system according to claim 1, wherein the first determining module is configured to, when determining the priority of the prompt information according to the type of information to which the prompt information belongs, specifically:
if the type of the information to which the prompt information belongs is normal type information, determining the priority of the prompt information according to the type of the information display position to which the prompt information belongs;
if the type of the information to which the prompt information belongs is abnormal information, determining the priority of the prompt information according to the type of the information content to which the prompt information belongs;
the information display position categories comprise a first category, a second category and a third category, the first category represents that the display position of the prompt information belonging to the category is related to the position of the display area, the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient, and the third category represents that the display position of the prompt information belonging to the category is related to the position of the surgical instrument.
3. The device for displaying the prompt information of the augmented reality surgical navigation system according to claim 1, wherein the first determining module is configured to, when determining the priority of the prompt information according to the type of information to which the prompt information belongs, specifically:
and determining the priority of the prompt message according to the type of the message to which the prompt message belongs and the time type of the message presentation to which the prompt message belongs, wherein the time type of the message presentation comprises permanent presentation and conditional presentation.
4. The device for displaying the prompt information of the augmented reality surgical navigation system according to claim 1 or 2, wherein the second determining module is configured to, when determining the information display position of the prompt information according to the information content category to which the prompt information belongs, specifically:
determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs;
and determining the information display position of the prompt message according to the information display position category to which the prompt message belongs.
5. The device for displaying the prompt information of the augmented reality surgical navigation system according to claim 4, wherein the second determining module is configured to, when determining the information display position category to which the prompt information belongs according to the information content category to which the prompt information belongs, specifically:
if the information content classification to which the prompt information belongs is an equipment state classification, determining that the information display position classification to which the prompt information belongs is a first classification, wherein the first classification indicates that the display position of the prompt information belonging to the classification is related to the position of a display area;
if the information content category to which the prompt information belongs is a patient information category, determining that the information display position category to which the prompt information belongs is a second category, wherein the second category represents that the display position of the prompt information belonging to the category is related to the position of the patient;
and if the information content classification to which the prompt information belongs is a surgical instrument class, determining that the information display position to which the prompt information belongs is classified into a third class, wherein the third class represents that the display position of the prompt information belonging to the class is related to the position of the surgical instrument.
6. The device for displaying the prompt information of the augmented reality surgical navigation system according to claim 1, wherein the display module is configured to, when displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information, specifically:
judging whether the prompt information is displayed or not according to the priority of the prompt information and the current information display condition;
and if the prompt information is judged to be displayed, displaying the prompt information at the information display position.
7. The device for displaying the prompt information of the augmented reality surgical navigation system according to claim 6, wherein the display module is configured to determine whether to display the prompt information according to the priority of the prompt information and a current information display status, and is specifically configured to:
and judging whether the display quantity of the current information exceeds a set value or not, and judging whether the prompt information is displayed or not according to the priority of the prompt information when the display quantity of the current information exceeds the set value.
8. The device for displaying the prompt information of the augmented reality surgical navigation system according to claim 1, wherein the device comprises:
and the display mode determining module is used for acquiring the target direction of the surgical instrument corresponding to the prompt information and determining the display direction of the prompt information according to the target direction when the information display position category to which the prompt information belongs is judged to be a third category, wherein the third category represents that the display position of the prompt information belonging to the category is related to the position of the surgical instrument.
9. A prompt message display method of an augmented reality surgical navigation system is characterized by comprising the following steps:
acquiring prompt information to be displayed;
determining the priority of the prompt message according to the type of the message to which the prompt message belongs;
determining the information display position of the prompt information according to the information content category to which the prompt information belongs;
and displaying the prompt information according to the priority of the prompt information and the information display position of the prompt information.
10. An electronic device comprising a memory and a processor, the memory for storing computer instructions, wherein the computer instructions are executable by the processor to implement the method of claim 9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110357343.3A CN113113149A (en) | 2021-04-01 | 2021-04-01 | Prompt information display device and method of augmented reality operation navigation system |
| PCT/CN2022/081504 WO2022206415A1 (en) | 2021-04-01 | 2022-03-17 | Prompt information display device and method for augmented reality surgical navigation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110357343.3A CN113113149A (en) | 2021-04-01 | 2021-04-01 | Prompt information display device and method of augmented reality operation navigation system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113113149A true CN113113149A (en) | 2021-07-13 |
Family
ID=76713619
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110357343.3A Pending CN113113149A (en) | 2021-04-01 | 2021-04-01 | Prompt information display device and method of augmented reality operation navigation system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113113149A (en) |
| WO (1) | WO2022206415A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114209431A (en) * | 2021-12-24 | 2022-03-22 | 杭州柳叶刀机器人有限公司 | Optical probe recognition method, optical probe recognition device, electronic apparatus, and storage medium |
| WO2022206415A1 (en) * | 2021-04-01 | 2022-10-06 | 上海复拓知达医疗科技有限公司 | Prompt information display device and method for augmented reality surgical navigation system |
| CN117577294A (en) * | 2024-01-12 | 2024-02-20 | 南方医科大学珠江医院 | Intelligent sickbed monitoring system used in laminar flow bin |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657519A (en) * | 2016-02-18 | 2016-06-08 | 海信电子科技（深圳）有限公司 | Method for managing television prompt message and television |
| CN108900714A (en) * | 2018-07-18 | 2018-11-27 | 维沃移动通信有限公司 | A kind of reminding method and terminal |
| CN109451140A (en) * | 2018-09-25 | 2019-03-08 | 深圳壹账通智能科技有限公司 | Social message method for pushing, device, computer storage medium and terminal |
| CN109549689A (en) * | 2018-08-21 | 2019-04-02 | 池嘉昌 | A kind of puncture auxiliary guide device, system and method |
| CN110110026A (en) * | 2019-04-30 | 2019-08-09 | 北京小米移动软件有限公司 | A kind of method, apparatus and medium of intelligent prompt trip help information |
| CN110169822A (en) * | 2018-02-19 | 2019-08-27 | 格罗伯斯医疗有限公司 | Augmented reality navigation system and its application method for being used together with robotic surgical system |
| CN110192211A (en) * | 2017-03-09 | 2019-08-30 | 谷歌有限责任公司 | Notify the presentation level in user interface |
| JP2020058672A (en) * | 2018-10-11 | 2020-04-16 | 株式会社メディカロイド | Robotic surgery support apparatus, robotic surgery support method, and program |
| CN111993889A (en) * | 2020-08-05 | 2020-11-27 | 华人运通(江苏)技术有限公司 | Vehicle instrument control method, device, equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160042563A1 (en) * | 2014-08-11 | 2016-02-11 | Empire Technology Development Llc | Augmented reality information management |
| CN110083425B (en) * | 2019-04-24 | 2023-02-17 | 阿波罗智联(北京)科技有限公司 | UI element display method, display device, electronic equipment and computer readable medium |
| CN113113149A (en) * | 2021-04-01 | 2021-07-13 | 上海复拓知达医疗科技有限公司 | Prompt information display device and method of augmented reality operation navigation system |
-
2021
- 2021-04-01 CN CN202110357343.3A patent/CN113113149A/en active Pending
-
2022
- 2022-03-17 WO PCT/CN2022/081504 patent/WO2022206415A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657519A (en) * | 2016-02-18 | 2016-06-08 | 海信电子科技（深圳）有限公司 | Method for managing television prompt message and television |
| CN110192211A (en) * | 2017-03-09 | 2019-08-30 | 谷歌有限责任公司 | Notify the presentation level in user interface |
| CN110169822A (en) * | 2018-02-19 | 2019-08-27 | 格罗伯斯医疗有限公司 | Augmented reality navigation system and its application method for being used together with robotic surgical system |
| CN108900714A (en) * | 2018-07-18 | 2018-11-27 | 维沃移动通信有限公司 | A kind of reminding method and terminal |
| CN109549689A (en) * | 2018-08-21 | 2019-04-02 | 池嘉昌 | A kind of puncture auxiliary guide device, system and method |
| CN109451140A (en) * | 2018-09-25 | 2019-03-08 | 深圳壹账通智能科技有限公司 | Social message method for pushing, device, computer storage medium and terminal |
| JP2020058672A (en) * | 2018-10-11 | 2020-04-16 | 株式会社メディカロイド | Robotic surgery support apparatus, robotic surgery support method, and program |
| CN110110026A (en) * | 2019-04-30 | 2019-08-09 | 北京小米移动软件有限公司 | A kind of method, apparatus and medium of intelligent prompt trip help information |
| CN111993889A (en) * | 2020-08-05 | 2020-11-27 | 华人运通(江苏)技术有限公司 | Vehicle instrument control method, device, equipment and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022206415A1 (en) * | 2021-04-01 | 2022-10-06 | 上海复拓知达医疗科技有限公司 | Prompt information display device and method for augmented reality surgical navigation system |
| CN114209431A (en) * | 2021-12-24 | 2022-03-22 | 杭州柳叶刀机器人有限公司 | Optical probe recognition method, optical probe recognition device, electronic apparatus, and storage medium |
| CN114209431B (en) * | 2021-12-24 | 2023-11-21 | 杭州柳叶刀机器人有限公司 | Optical probe identification method, device, electronic equipment and storage medium |
| CN117577294A (en) * | 2024-01-12 | 2024-02-20 | 南方医科大学珠江医院 | Intelligent sickbed monitoring system used in laminar flow bin |
| CN117577294B (en) * | 2024-01-12 | 2024-05-10 | 南方医科大学珠江医院 | Intelligent sickbed monitoring system used in laminar flow bin |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022206415A1 (en) | 2022-10-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113113149A (en) | Prompt information display device and method of augmented reality operation navigation system | |
| US10646285B2 (en) | Graphical user interface for a surgical navigation system and method for providing an augmented reality image during operation | |
| US11944344B2 (en) | Guidance system, method and devices thereof | |
| US7774044B2 (en) | System and method for augmented reality navigation in a medical intervention procedure | |
| US7920162B2 (en) | Display method and system for surgical procedures | |
| US5638819A (en) | Method and apparatus for guiding an instrument to a target | |
| US10073515B2 (en) | Surgical navigation system and method | |
| US9681925B2 (en) | Method for augmented reality instrument placement using an image based navigation system | |
| US20100228534A1 (en) | Method, system and computer product for planning needle procedures | |
| CN111212609A (en) | System and method for using augmented reality with shape alignment for placement of medical devices in bone | |
| US20050234320A1 (en) | Method and apparatus for displaying medical information | |
| CN113133813A (en) | Dynamic information display system and method based on puncture process | |
| Yoshimitsu et al. | Development and initial clinical testing of “OPECT”: an innovative device for fully intangible control of the intraoperative image-displaying monitor by the surgeon | |
| Mishra et al. | Artificial intelligence and ophthalmic surgery | |
| CN116313028A (en) | Medical assistance device, method, and computer-readable storage medium | |
| CN113133829B (en) | Surgical navigation system, method, electronic device and readable storage medium | |
| JP5807826B2 (en) | Surgery support device and surgery support program | |
| Suthau et al. | A concept work for Augmented Reality visualisation based on a medical application in liver surgery | |
| EP3804670A1 (en) | Image processing device, image processing method, and intraocular image processing system | |
| CN115909035A (en) | Counting method, system, equipment and medium for surgical instruments | |
| AU2016329032A1 (en) | Presurgical planning for use during surgical procedure | |
| CN114795468A (en) | Intraoperative navigation method and system for intravascular treatment | |
| CN114945990A (en) | System and method for providing surgical assistance based on operational context | |
| CN113805704A (en) | Vision treatment method and system based on VR technology | |
| JP2002017751A (en) | Surgery navigation device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210713 |