CN107506446B - Auxiliary query confirmation method and system - Google Patents
Auxiliary query confirmation method and system Download PDFInfo
- Publication number
- CN107506446B CN107506446B CN201710739954.8A CN201710739954A CN107506446B CN 107506446 B CN107506446 B CN 107506446B CN 201710739954 A CN201710739954 A CN 201710739954A CN 107506446 B CN107506446 B CN 107506446B
- Authority
- CN
- China
- Prior art keywords
- objects
- icons
- arrangement
- icon
- characteristic information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/63—Querying
- G06F16/638—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/36—Creation of semantic tools, e.g. ontology or thesauri
- G06F16/367—Ontology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Abstract
The disclosure relates to the technical field of intelligent assistance, and discloses an auxiliary query confirmation method. The auxiliary query confirmation method comprises the steps of presenting icons of a plurality of objects through an interactive interface, wherein the arrangement of the icons of the objects corresponds to the arrangement of the objects in a real space; a voice instruction and extracting characteristic information carried by the voice instruction; comparing the characteristic information with pre-stored characteristic information to confirm a target object corresponding to the characteristic information; and displaying the icon corresponding to the target object on the interactive interface distinctively through a first mode. The auxiliary query confirmation method can improve the working efficiency.
Description
Technical Field
The disclosure relates to the technical field of intelligent assistance, in particular to an auxiliary query confirmation method and an auxiliary query confirmation system.
Background
When preparing a surgical instrument before an operation, it is necessary to check whether the surgical instrument is completely prepared and the placement position is correct. In performing a medical surgical procedure, surgical instruments need to be delivered to the primary surgeon.
At present, the two steps are manually checked and identified by full-time personnel. In performing a medical surgical operation, the task of delivering surgical instruments, such as scalpels, scissors, gauzes, etc., to a primary surgeon is performed manually by an assistant who needs to identify the instruments and then pick up the instruments for the primary surgeon. The preparation of surgical instruments before surgery is also confirmed by manual inspection by full-time personnel. In the middle, errors are avoided, modification errors delay time, and operation is delayed. Medical appliance identification technology basically relies on an integrated radio frequency module to identify an electronic tag attached to an appliance to inspect the appliance. However, this technique can only check whether the instrument is fully prepared before the operation and cannot help the operator to use the instrument correctly at each step of the operation. Meanwhile, the electronic tag on the appliance also requires the medical appliance to be updated internally, which increases the cost.
Therefore, it is necessary to develop a new method and system for confirming the auxiliary query.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
An object of the present disclosure is to provide an auxiliary query validation method and an auxiliary query validation system, thereby overcoming, at least to some extent, one or more of the problems due to the limitations and disadvantages of the related art.
According to an aspect of the present disclosure, there is provided an auxiliary query validation method, including:
Presenting icons of a plurality of objects through an interactive interface, wherein the arrangement of the icons of the objects corresponds to the arrangement of the objects in a real space;
Receiving a voice instruction of a user and extracting characteristic information carried by the voice instruction;
Comparing the characteristic information with pre-stored characteristic information to confirm a target object corresponding to the characteristic information;
And displaying the icon corresponding to the target object on the interactive interface distinctively through a first mode.
In an exemplary embodiment of the present disclosure, the feature information includes:
One or more of the name and the model of the object.
In an exemplary embodiment of the present disclosure, the feature information further includes:
Switch information, icon display position.
In an exemplary embodiment of the present disclosure, the auxiliary query confirmation method further includes:
And switching on or off the icon and changing one or more display positions of the icon according to the characteristic information.
In an exemplary embodiment of the present disclosure, the auxiliary query confirmation method further includes:
Presenting icons of a plurality of objects through an interactive interface, wherein the arrangement of the icons of the objects corresponds to the preset arrangement of the objects;
Acquiring image information of a plurality of objects and extracting image features carried by the image information;
Comparing the image features with a preset arrangement of the objects to confirm a target object whose image features do not match the preset arrangement of the objects;
And displaying the icon corresponding to the target object on the interactive interface distinctively through a second mode.
In an exemplary embodiment of the present disclosure, the image feature includes:
One or more of a shape, a position, and tag information of the object.
In an exemplary embodiment of the present disclosure, the auxiliary query confirmation method further includes:
And when the image characteristics of the target object corresponding to the icon are matched with the preset arrangement of the objects, the icon is displayed distinctively according to the first mode.
In an exemplary embodiment of the present disclosure, the first manner is distinctively displayed as a highlight or a blinking display, and the corresponding second manner is distinctively displayed as a blinking display or a highlight.
According to one aspect of the present disclosure, there is provided an auxiliary query validation system, comprising
The voice acquisition unit is used for receiving a voice instruction of a user;
The voice recognition unit is used for extracting the characteristic information carried by the voice instruction;
The signal processing unit is used for comparing the characteristic information with pre-stored characteristic information so as to confirm a target object corresponding to the characteristic information;
The display unit is used for presenting icons of a plurality of objects, the arrangement of the icons of the objects corresponds to the arrangement of the objects in a real space, and the icons corresponding to the target objects are displayed distinctively through a first mode.
In an exemplary embodiment of the present disclosure, the feature information includes:
One or more of the name and the model of the object.
In an exemplary embodiment of the present disclosure, the feature information further includes:
Switch information, icon display position.
In an exemplary embodiment of the present disclosure, the signal processing unit controls the display unit to switch on and off the icon and to change one or more of a display position of the icon according to the feature information.
In an exemplary embodiment of the present disclosure, the auxiliary query validation system further includes:
An image acquisition unit for acquiring image information of a plurality of the objects;
The image recognition unit is used for extracting image characteristics carried by the image information;
The signal processing unit is used for comparing the image characteristics with the preset arrangement of the objects so as to confirm the target objects with the image characteristics not matched with the preset arrangement of the objects;
The display unit is used for presenting icons of a plurality of objects, the arrangement of the icons of the objects corresponds to the preset arrangement of the objects, and the icons corresponding to the target objects are displayed distinctively through a second mode.
In an exemplary embodiment of the present disclosure, the image feature includes:
One or more of a shape, a position, and tag information of the object.
In an exemplary embodiment of the present disclosure, when the icon is distinctively displayed in a first manner and the image feature of the target object corresponding to the icon matches a preset arrangement of the objects, the signal processing unit controls the display unit to distinctively display the icon in the first manner.
In an exemplary embodiment of the present disclosure, the first manner is distinctively displayed as a highlight or a blinking display, and the corresponding second manner is distinctively displayed as a blinking display or a highlight.
The auxiliary query confirming method and the auxiliary query confirming system present icons of a plurality of objects through an interactive interface, and the arrangement of the icons of the objects corresponds to the arrangement of the objects in a real space; receiving a voice instruction of a user, extracting characteristic information, comparing the characteristic information with pre-stored characteristic information, and confirming a target object corresponding to the characteristic information; and displaying the icon corresponding to the target object distinctively through an interactive interface. On one hand, the icons corresponding to the target objects are displayed distinctively through the interactive interface, so that the staff can directly and clearly see the placement positions of the objects required by the user, the manual searching process of the staff is reduced, and the working efficiency of the staff is improved; on the other hand, the target object can be determined through the voice instruction of the user, and the method is simple and clear; on the other hand, through the display of the interactive interface, not only is an instruction provided for the staff, but also further inspection is carried out, and the occurrence of errors is avoided.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1 schematically shows a flow diagram of an auxiliary query validation method.
Fig. 2 schematically shows an overall flow diagram of the auxiliary query validation method.
Fig. 3 schematically shows a structural diagram of the auxiliary query validation system.
Fig. 4 schematically shows four sets of appliance icons displayed by the display unit.
In the figure:
1. An object; 2. an icon; 3. a voice acquisition unit; 4. a voice recognition unit; 5. an image acquisition unit; 6. an image recognition unit; 7. a signal processing unit; 8. a display unit; 9. a storage unit; 10. a first placement area; 11. a second placement area.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
In this exemplary embodiment, an auxiliary query validation method is first provided, and referring to a flow chart of the auxiliary query validation method shown in fig. 1, the auxiliary query validation method may include the following steps:
Step S11, a plurality of icons of the objects 1 are presented through the interactive interface, and the arrangement of the icons of the objects 1 corresponds to the arrangement of the objects 1 in the real space.
Step S21, receiving a voice command of a user and extracting feature information carried by the voice command.
Step S31, comparing the characteristic information with pre-stored characteristic information to confirm the target object corresponding to the characteristic information.
Step S41, displaying the icon corresponding to the target object distinctively on the interactive interface through a first mode.
According to the auxiliary query confirming method in the embodiment, on one hand, the icon 2 corresponding to the target object 1 is distinctively displayed through the interactive interface, so that a worker can directly and clearly see the placement position of the object 1 required by the user, the manual searching process of the worker is reduced, and the working efficiency of the worker is improved; on the other hand, the target object can be determined through the voice instruction of the user, and the method is simple and clear; on the other hand, through the display of the interactive interface, not only is an instruction provided for the staff, but also further inspection is carried out, and the occurrence of errors is avoided.
Next, the auxiliary query confirmation method in the present exemplary embodiment will be further described.
Step S11, a plurality of icons 2 of the objects 1 are presented through the interactive interface, and the arrangement of the icons 2 of the objects 1 corresponds to the arrangement of the objects 1 in the real space.
In the present exemplary embodiment, the object 1 may be various surgical instruments, such as: scalpels, surgical scissors, gauze, and the like. The surgical instruments in each hospital are regularly arranged and are not randomly arranged. One object 1 corresponds to one icon 2, and the shape of the icon 2 is consistent with that of the object 1, so that the searching and observing of workers are more visual and convenient. The arrangement of the icons 2 of the object 1 corresponds to the arrangement of the object 1 in the real space. For example, the arrangement of the scalpel, the surgical scissors and the gauze in the real space is that the scalpel, the surgical scissors and the gauze are sequentially arranged from left to right, and the arrangement of the interactive interface is that the scalpel, the surgical scissors and the gauze are sequentially arranged from left to right. When there are two medical instrument placement areas, namely the first placement area 10 and the second placement area 11, two placement areas are also displayed on the interactive interface. The two placement areas are in an up-down relationship and are also displayed on the interactive interface; the two placement areas are in left-right relation and are also displayed in left-right relation on the interactive interface. And displaying icons 2 of different surgical instruments on the interactive interface, wherein the arrangement mode of the icons 2 corresponds to the actual arrangement mode of the surgical instruments. In addition, it will be understood by those skilled in the art that the object 1 may also be various medicines, operating instruments, and the like.
Step S21, receiving a voice command of a user and extracting feature information carried by the voice command.
In the present exemplary embodiment, the user may be a surgeon performing a surgical operation, the voice command may be a word spoken by the surgeon, the characteristic information may be a name of the object 1, such as "scalpel", "surgical scissors", "gauze", and the like, or a model of the object 1, such as JD01, SSD02, SB03, and the like, where letters may be initials of pinyin for the object 1, numbers may be an order of arrangement, and the like, and is not limited herein. Receiving the 'please deliver the scalpel' spoken by the doctor of the main scalpel, and extracting the 'scalpel' from the 'please deliver the scalpel' as the characteristic information. In other example embodiments of the invention, the user may also be a pharmacist, other staff member, or the like; the characteristic information may also be names of various medicines, names of various instruments, and the like.
Step S31, comparing the characteristic information with pre-stored characteristic information to confirm the target object corresponding to the characteristic information.
In the present exemplary embodiment, the pre-stored characteristic information includes one or more of a name and a model of the object 1, for example, the name may be "scalpel", "surgical scissors", "gauze", etc., the model may be JD01, SSD02, SB03, etc., where the letter may be an initial letter of the chinese pinyin of the object 1, the number may be an order of arrangement, etc., and is not particularly limited herein. And comparing the characteristic information of the scalpel with pre-stored characteristic information, and confirming that the scalpel is taken as a target object. Of course, the target object may also be a specific medicine, instrument, etc.
Step S41, displaying the icon 2 corresponding to the target object distinctively on the interactive interface through a first method.
In the present exemplary embodiment, the first mode distinctive display may be a blinking display. After the target object is determined, the position information of the target object is read, and the icon 2 corresponding to the target object is displayed on the interactive interface through flashing. Of course, the first mode distinctive display may be a highlight display. The display modes of the remaining objects 1 are all normal display.
Further, the feature information may further include one or more of switch information and a display position of the icon 2. In this exemplary embodiment, the switch information is the switch information of the icon 2, and the display position of the icon 2 may be displayed at four positions close to the border, such as the upper, lower, left, and right positions of the interactive interface, or at four corner positions of the interactive interface, and the like, which is not limited herein. The doctor can select to open any one of the icons 2 and close the icons 2 at other positions as required. The doctor of the main surgeon can communicate the information of closing the icon 2 or the display position of the icon 2 by voice.
Further, the auxiliary query confirmation method may further include: and switching on or off the icon 2 according to the characteristic information, and changing one or more display positions of the icon 2. That is, the display position of the icon 2 may be changed according to the characteristic information. Refer to four sets of appliance icons 2 displayed by the display unit 8 shown in fig. 4. In the present exemplary embodiment, there are four sets of the same instrument icons 2 on the interactive interface, which are respectively present at four positions close to the border on the interactive interface, namely, on the upper side, the lower side, the left side and the right side. The upper and lower icon 2 combinations are displayed in a horizontal arrangement in units of plates (plates for holding surgical instruments), and the left and right icons 2 are displayed in a vertical arrangement in units of plates. All four groups of icons 2 can be displayed on the screen, but only one group can be displayed at the same time. By default when the machine is turned on, the icon 2 on the lower side of the interactive interface is displayed while the upper, left and right icons 2 are turned off. After the doctor of the main knife issues an instruction to display the icon 2 in the other area, the voice recognition instruction expects the position where the icon 2 appears, and then the icon 2 at the position is opened and the icons 2 at the other positions are closed at the same time. The icon 2 may also be switched on and off according to the characteristic information, in this example embodiment, the icon 2 may be displayed on a medical display, and the medical display may be used to display an image in a doctor operation, turn on the display of the icon 2 when necessary, and turn off the display of the icon 2 when not necessary, so as to avoid an influence on the doctor operation. The doctor of the main knife can send out an instruction for opening the display icon 2 and also can send out an instruction for closing the display icon 2, the characteristic information can comprise 'on', 'off', 'icon' and the like, and after the instruction for opening or closing the icon 2 by the doctor of the main knife is received, the characteristic information is identified, and then the icon 2 is opened or closed.
Referring to fig. 2, an overall flow diagram of the auxiliary query validation method is shown. Further, the auxiliary query confirmation method further includes the following steps:
Step S101, displaying a plurality of icons 2 of objects 1 through an interactive interface, wherein the arrangement of the icons 2 of the objects 1 corresponds to the preset arrangement of the objects 1.
Step S102, collecting image information of a plurality of objects 1 and extracting image characteristics carried by the image information.
Step S103, comparing the image features with the preset arrangement of the object 1 to confirm the target object whose image features do not match with the preset arrangement of the object 1.
And step S104, displaying the icon 2 corresponding to the target object on the interactive interface distinctively through a second mode.
The above steps will be further described below.
Step S101, displaying a plurality of icons 2 of objects 1 through an interactive interface, wherein the arrangement of the icons 2 of the objects 1 corresponds to the objects.
In the present exemplary embodiment, the storage unit 9 stores preset arrangement positions of the respective objects 1, the icons 2 of the respective objects 1 are presented on the interactive interface, and the arrangement of the icons 2 is consistent with the preset arrangement positions. For example, the preset arrangement positions of the scalpel, the surgical scissors and the gauze are the scalpel, the surgical scissors and the gauze in sequence from left to right, and the arrangement positions on the interactive interface are the scalpel, the surgical scissors and the gauze in sequence from left to right. When two medical instrument placing areas are preset, the two placing areas are also displayed on the interactive interface. The two placement areas are in an up-down relationship, and the up-down relationship is also displayed on the interactive interface; the two placement areas are in left-right relation and are also displayed in left-right relation on the interactive interface.
Step S102, collecting image information of a plurality of objects 1 and extracting image characteristics carried by the image information.
In the present exemplary embodiment, the image feature may include one or more of a shape, a position, and tag information of the object 1. The shape of the object 1 can be the outer contour of the object 1, the appearance structure of the surgical instruments has large difference, basically no instruments with small difference can be used, and people can be prevented from being unidentified and eliminated. There may be identical surgical instruments, but there is no requirement on the use, which of the identical instruments is used. The position of the object 1 can be from left to right, the number from top to bottom, the specific position of the object 1 being determined in both directions. The label information of the object 1 may be provided in the form of a bar code or a two-dimensional code at an unimportant location of the surgical instrument, such as a tail of a handle of a scalpel, a tail of a surgical scissors, a roller of a surgical thread, etc. The label information mainly has the function of identifying objects which cannot be analyzed according to shapes by machines such as surgical lines, gauzes and the like, and can be easily distinguished through a special bar code. Image information of each object 1 is acquired and shape, position, or label information of the object 1, etc. is extracted. In other example embodiments of the present invention, the image characteristics may also include the color, size, etc. of the object 1.
Step S103, comparing the image features with the preset arrangement of the object 1 to confirm the target object whose image features do not match with the preset arrangement of the object 1.
In the present exemplary embodiment, for example, the preset arrangement of the object 1 at the second position from top to bottom and the first position from left to right is surgical scissors, it can be found whether the object 1 at the first position from left to right and the second position from top to bottom is surgical scissors through the image feature, and if it is confirmed through the image feature that the object 1 at the position is not surgical scissors, the object 1 at the position is determined to be the target object. Of course, the target object may also be a specific medicine, instrument, etc. that does not match the preset arrangement.
And step S104, displaying the icon 2 corresponding to the target object on the interactive interface distinctively through a second mode.
In the present exemplary embodiment, the second manner distinctive display may be a highlight display. And after the target object is determined, highlighting the icon 2 corresponding to the target object on the interactive interface. Of course, the distinctive display of the second mode may be a blinking display. The display modes of the remaining objects 1 are all normal display.
Through the steps, whether the discharge position of each surgical instrument is correct or not can be further determined before or during the operation. The memory can store the type, number and specific discharge position of the surgical instruments needed in different operations and can display the types, number and specific discharge position through the interactive interface. The actual arrangement information of the object 1 can be collected through the image collecting unit 5, the actual arrangement and the icon 2 corresponding to the preset object 1 which is not consistent in arrangement are displayed distinctively, a direct and clear visual effect can be provided for workers, a basis is provided for the examination of the workers, and therefore the working efficiency is improved. And through machine judgment, the problem of subjectivity does not exist, and errors can be effectively avoided.
Further, the auxiliary query confirmation method further includes: the icon 2 is distinctively displayed in a first mode, and when the image features of the target object corresponding to the icon 2 are matched with the preset arrangement of the object 1, the icon 2 is distinctively displayed in the first mode.
In the present exemplary embodiment, the icon 2 distinctively displays, in a first manner, an object 1 corresponding to the icon 2, which is determined by the user as a target object. The image features of the target object corresponding to the icon 2 are matched with the preset arrangement of the object 1, and the arrangement position of the object 1 is matched with the preset arrangement position. Specifically, the object 1 is selected by a master surgeon, and the object 1 needs to be provided to the master surgeon by a worker and needs to be displayed in a distinguishing manner; however, in the case where the worker does not pick up the object 1, the system recognizes that the object 1 is in the correct position and needs to be displayed normally, and thus a contradiction occurs. At this time, the determination icon 2 is distinctively displayed in a first manner, that is, a blinking distinction display is performed. After the staff picks up the object 1, the object 1 to be placed is absent at the position, and the system considers that the object 1 is not matched with the preset arrangement, so that the second mode differential display, namely the highlight differential display, is performed.
Moreover, although the steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
Further, the present exemplary embodiment also provides an auxiliary query confirmation apparatus corresponding to the above-described auxiliary query confirmation method. Referring to a schematic configuration diagram of the auxiliary query confirming system shown in fig. 3, the auxiliary query confirming apparatus may include a voice acquiring unit 3, a voice recognizing unit 4, an image acquiring unit 5, an image recognizing unit 6, a signal processing unit 7, a display unit 8, and the like. Wherein:
The voice collecting unit 3 can be used for receiving a voice instruction of a user.
The voice recognition unit 4 may be configured to extract feature information carried by the voice instruction.
The signal processing unit 7 may be configured to compare the characteristic information with pre-stored characteristic information to identify a target object corresponding to the characteristic information.
The display unit 8 may be configured to present icons 2 of a plurality of objects 1, wherein the arrangement of the icons 2 of each object 1 corresponds to the arrangement of the object 1 in the real space, and distinctively display the icon 2 corresponding to the target object in a first manner.
In the present exemplary embodiment, the feature information includes: one or more of the name and the model of the object 1.
In this example embodiment, the feature information further includes: the switch information and the icon 2 display position.
In the present exemplary embodiment, the signal processing unit 7 controls the display unit 8 to switch the icon 2 on and off, and to change one or more of the display positions of the icon 2, in accordance with the feature information.
In this example embodiment, the auxiliary query validation system may further include:
The image acquisition unit 5 may be configured to acquire image information of a plurality of the objects 1;
The image recognition unit 6 may be configured to extract image features carried by the image information;
The signal processing unit 7 may be further configured to compare the image features with a preset arrangement of the object 1 to confirm a target object whose image features do not match the preset arrangement of the object 1;
The display unit 8 may be further configured to present icons 2 of a plurality of objects 1, where the arrangement of the icons 2 of each object 1 corresponds to a preset arrangement of the object 1, and differentially display the icon 2 corresponding to the target object through a second method.
In the present exemplary embodiment, the image features include: one or more of a shape, a position, and tag information of the object 1.
In the present exemplary embodiment, when the icon 2 is distinctively displayed in a first manner and the image feature of the target object corresponding to the icon 2 matches a preset arrangement of the object 1, the signal processing unit 7 controls the display unit 8 to distinctively display the icon 2 in the first manner.
In this exemplary embodiment, the first manner distinctive display is a highlight display or a blinking display, and the corresponding second manner distinctive display is a blinking display or a highlight display.
The specific details of each module in the auxiliary query confirming apparatus have been described in detail in the corresponding virtual object 1 motion control method, and therefore are not described herein again.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (8)
1. An assisted query validation method, comprising:
Presenting icons of a plurality of objects through an interactive interface, wherein the arrangement of the icons of the objects corresponds to the arrangement of the objects in a real space, the shapes of the icons are consistent with the shapes of the objects, and the objects are medical instruments;
Receiving a voice instruction of a user and extracting characteristic information carried by the voice instruction;
Comparing the characteristic information with pre-stored characteristic information to confirm a target object corresponding to the characteristic information;
The icon corresponding to the target object is distinctively displayed on the interactive interface through a first mode;
The auxiliary query confirmation method further comprises the following steps:
Presenting icons of a plurality of objects through an interactive interface, wherein the arrangement of the icons of the objects corresponds to the preset arrangement of the objects;
Acquiring image information of a plurality of objects and extracting image features carried by the image information;
Comparing the image features with a preset arrangement of the objects to confirm a target object whose image features do not match the preset arrangement of the objects;
And displaying the icon corresponding to the target object on the interactive interface distinctively through a second mode.
2. The method of claim 1, wherein the characteristic information comprises:
One or more of the name and the model of the object.
3. The method of claim 1, wherein the feature information further comprises:
Switch information, icon display position.
4. The method of claim 3, further comprising:
And switching on or off the icon and changing one or more display positions of the icon according to the characteristic information.
5. The method of claim 1, wherein the image features comprise:
One or more of a shape, a position, and tag information of the object.
6. The method of claim 1, further comprising:
And when the image characteristics of the target object corresponding to the icon are matched with the preset arrangement of the objects, the icon is displayed distinctively according to the first mode.
7. The method for confirming auxiliary queries according to any one of claims 1, 4, and 5, wherein the first manner is distinctively displayed as a highlight or a blinking display, and the corresponding second manner is distinctively displayed as a blinking display or a highlight.
8. An auxiliary query validation system, comprising
The voice acquisition unit is used for receiving a voice instruction of a user;
The voice recognition unit is used for extracting the characteristic information carried by the voice instruction;
The signal processing unit is used for comparing the characteristic information with pre-stored characteristic information so as to confirm a target object corresponding to the characteristic information;
The display unit is used for presenting icons of a plurality of objects, the arrangement of the icons of the objects corresponds to the arrangement of the objects in a real space, and the icons corresponding to the target objects are displayed distinctively in a first mode, wherein the shapes of the icons are consistent with the shapes of the objects, and the objects are medical appliances;
The auxiliary query validation system further comprises:
An image acquisition unit for acquiring image information of a plurality of the objects;
The image recognition unit is used for extracting image characteristics carried by the image information;
The signal processing unit is used for comparing the image characteristics with the preset arrangement of the objects so as to confirm the target objects with the image characteristics not matched with the preset arrangement of the objects;
The display unit is used for presenting icons of a plurality of objects, the arrangement of the icons of the objects corresponds to the preset arrangement of the objects, and the icons corresponding to the target objects are displayed distinctively through a second mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710739954.8A CN107506446B (en) | 2017-08-23 | 2017-08-23 | Auxiliary query confirmation method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710739954.8A CN107506446B (en) | 2017-08-23 | 2017-08-23 | Auxiliary query confirmation method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107506446A CN107506446A (en) | 2017-12-22 |
| CN107506446B true CN107506446B (en) | 2020-07-28 |
Family
ID=60693038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710739954.8A Active CN107506446B (en) | 2017-08-23 | 2017-08-23 | Auxiliary query confirmation method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107506446B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110275971A (en) * | 2019-06-28 | 2019-09-24 | 维沃移动通信有限公司 | A kind of method and mobile terminal of target object lookup |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1143717A2 (en) * | 2000-03-31 | 2001-10-10 | Matsushita Electric Industrial Co., Ltd. | Display interface comprising a channel matrix |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6556971B1 (en) * | 2000-09-01 | 2003-04-29 | Snap-On Technologies, Inc. | Computer-implemented speech recognition system training |
| JP2005025268A (en) * | 2003-06-30 | 2005-01-27 | Toshiba Corp | Electronic device and method for controlling display |
| CN100337238C (en) * | 2005-07-14 | 2007-09-12 | 上海交通大学 | Distributed simulation system for jet engine based on grid |
| CN101620426B (en) * | 2008-07-02 | 2012-08-29 | 鸿富锦精密工业（深圳）有限公司 | Regional machine monitor and management method and computer system therefor |
| CN102685034A (en) * | 2012-06-12 | 2012-09-19 | 上海量明科技发展有限公司 | Method and client for giving prompt for instant messaging message |
| CN104185144B (en) * | 2014-08-21 | 2018-03-23 | 北京橙鑫数据科技有限公司 | Participant's identity information display methods and wireless terminal |
| CN104965596A (en) * | 2015-07-24 | 2015-10-07 | 上海宝宏软件有限公司 | Voice control system |
-
2017
- 2017-08-23 CN CN201710739954.8A patent/CN107506446B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1143717A2 (en) * | 2000-03-31 | 2001-10-10 | Matsushita Electric Industrial Co., Ltd. | Display interface comprising a channel matrix |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107506446A (en) | 2017-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7567233B2 (en) | Global input device for multiple computer-controlled medical systems | |
| US8799792B2 (en) | Workflow driven method of performing multi-step medical procedures | |
| US8242972B2 (en) | System state driven display for medical procedures | |
| US9349031B2 (en) | Method, computer program product, and changing station for tracking a process | |
| WO2018052966A1 (en) | Augmented reality surgical technique guidance | |
| JP2018503416A (en) | User guidance system and method, use of augmented reality device | |
| EP3063752A1 (en) | System and method for a situation and awareness-based intelligent surgical system | |
| US10741282B2 (en) | Medical tool work support system, medical tool work support method, and medical tool work support program | |
| US20150173843A1 (en) | Tracking medical devices | |
| CN107506446B (en) | Auxiliary query confirmation method and system | |
| WO2017151904A1 (en) | Methods and systems for anatomical image registration | |
| CN113673350B (en) | Surgical instrument identification method, device, equipment and storage medium | |
| JP2009042960A (en) | System for supporting maintenance work | |
| US11112399B2 (en) | Apparatus and a method for analyzing a body fluid sample from a sampler | |
| JP6916059B2 (en) | Surgical set cleaning management system | |
| JP5793347B2 (en) | Blood collection tube management system | |
| CN110262728B (en) | Slide information management system and control method of slide information management system | |
| WO2018026003A1 (en) | Medical equipment memorandum information management device, and medical equipment memorandum information management system | |
| US20190244716A1 (en) | Automatic biopsy reporting systems and methods | |
| CN113496770A (en) | Information integration device | |
| TWM574324U (en) | System for marking, identifying and managing medical devices | |
| CN114840110B (en) | Puncture navigation interaction assisting method and device based on mixed reality | |
| CN117562678B (en) | Auxiliary system for neurosurgery microscope | |
| JP2015197757A (en) | Information processing system for surgery and information processing program for surgery | |
| TWI681404B (en) | System and method for marking, identifying and managing medical devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |