CN105144171A - Virtual medical assistant methods and apparatus - Google Patents

Virtual medical assistant methods and apparatus Download PDF

Info

Publication number
CN105144171A
CN105144171A CN201480011385.XA CN201480011385A CN105144171A CN 105144171 A CN105144171 A CN 105144171A CN 201480011385 A CN201480011385 A CN 201480011385A CN 105144171 A CN105144171 A CN 105144171A
Authority
CN
China
Prior art keywords
medical
order
free form
information
task
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201480011385.XA
Other languages
Chinese (zh)
Other versions
CN105144171B (en
Inventor
G·加罗平
R·W·科勒曼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Nuance Communications Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nuance Communications Inc filed Critical Nuance Communications Inc
Publication of CN105144171A publication Critical patent/CN105144171A/en
Application granted granted Critical
Publication of CN105144171B publication Critical patent/CN105144171B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16ZINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR
    • G16Z99/00Subject matter not provided for in other main groups of this subclass
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/10ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Accommodation For Nursing Or Treatment Tables (AREA)

Abstract

In some aspects, a method of using a virtual medical assistant to assist a medical professional, the virtual medical assistant implemented, at least in part, by at least one processor of a host device capable of connecting to at least one network is provided. The method comprises receiving free-form instruction from the medical professional; providing the free-form instruction for processing to assist in identifying from the free- form instruction at least one medical task to be performed, providing at least one first response to the medical professional regarding the free-form instruction prior to the at least one medical task being performed, and receiving first information from the medical professional responsive to the at least one first response.

Description

Virtual Medical assistant method and device
Background technology
Many mobile communication equipments of such as smart phone and so on are equipped with virtual assistant (also referred to as virtual protocol), it is configured to receive speech from user and inputs and adopt locally or identified the speech of user by the various resources of network-accessible, trial is understood the intention of user and is responded by performing one or more expectation task (such as, perform Internet search, make a phone call, make a reservation for appointment etc.) based on this understanding.But, conventional virtual assistant is configured to respond the voice command of general user, and therefore may be restricted in its ability, usually concentrate on mobile communication equipment general information retrieval, personal planning arrangement or be engaged in communication function (such as, telephone calling, in user contact lists individuality send text or email message etc.).
Summary of the invention
Some embodiment comprises a kind of method using Virtual Medical assistant to help medical professional, this Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, the method comprises and receives free form instruction from medical professional, there is provided this free form instruction for process to help to identify at least one medical task that will perform from free form instruction, at least one first response about free form instruction is provided the forward direction medical professional performing at least one medical task described, and receive the first information in response at least one first response described from medical professional.
Some embodiment at least one computer-readable medium, it stores instruction, when instruction performs the method using Virtual Medical assistant to help medical professional when being performed by least one processor, this Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, the method comprises and receives free form instruction from medical professional, there is provided this free form instruction for process to help to identify at least one medical task that will perform from this free form instruction, at least one first response about free form instruction is provided the forward direction medical professional performing at least one medical task described, and receive the first information in response at least one first response described from medical professional.
Some embodiment comprises the main process equipment that can be connected at least one network, this main process equipment comprises at least one processor, it realizes virtual clinical assistant at least in part to help medical professional, at least one processor described is configured to receive free form instruction from medical professional, there is provided this free form instruction for process to help to identify at least one medical task that will perform from this free form instruction, at least one first response about free form instruction is provided the forward direction medical professional performing at least one medical task described, and receive the first information in response at least one first response described from medical professional.
Some embodiment comprises a kind of method using Virtual Medical assistant to help medical professional, this Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, the method comprises and receives free form instruction from medical professional, there is provided this free form instruction from this free form instruction, identify at least one medical task that will perform with help for process, obtain the mark at least one obstacle performing at least one medical task described; And deduction overcomes described at least some information needed at least one obstacle.
Some embodiment comprises at least one computer-readable medium storing instruction, this instruction performs a kind of method using Virtual Medical assistant to help medical professional when performing at least one processor, this Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, the method comprises and receives free form instruction from medical professional, there is provided this free form instruction for process to help to identify at least one medical task that will perform from this free form instruction, obtain the mark at least one obstacle performing at least one medical task described, and deduction overcomes described at least some information needed at least one obstacle.
Some embodiment comprises the main process equipment that can be connected at least one network, this main process equipment comprises at least one processor, it realizes virtual clinical assistant at least in part to help medical professional, at least one processor described is configured to receive free form instruction from medical professional, there is provided this free form instruction for process to help to identify at least one medical task that will perform from this free form instruction, obtain the mark at least one obstacle performing at least one medical task described, and deduction overcomes described at least some information needed at least one obstacle.
Accompanying drawing explanation
Various aspect and the embodiment of the application are described with reference to following figure.
Fig. 1 illustrates the example system that can realize Virtual Medical assistant wherein according to some embodiment;
Fig. 2 illustrates and interacts to help the method for the one or more medical task of specifying in from the free form instruction of medical professional according to some embodiment with medical professional;
Fig. 3 illustrates the method according to the deduction of some embodiment information relevant with the one or more medical task of specifying in from the free form instruction of medical professional;
Fig. 4 A-4H illustrates and applies according to the installation Virtual Medical assistant on the mobile apparatus of some embodiment and use the mutual example between the medical professional of mobile device; And
Fig. 5 is the exemplary computer system that can realize technology described herein in the above according to some embodiment.
Embodiment
As discussed above, conventional virtual assistant is usually suitable for large-scale user useful, and is therefore usually confined to perform in response to user command general and usually considerably less task.Therefore conventional virtual assistant may be not suitable for performing particularization task.The present inventor has realized that and is suitable for medical field to help medical professional to perform an action under the medical practice of medical professional and/or the environment of health ability or the benefit of task.This type of field particular virtual assistant may can perform the function of the limit of power exceeding conventional virtual assistant in medical field.
According to some embodiment, a kind of Virtual Medical assistant realizes on the host device at least in part and is configured to help medical professional to perform one or more medical task, include but not limited to, help medical professional order can order items (such as, medicine, disposal, laboratory result, diagnostic test, change the place of examination, the consultation of doctors etc.), identification collision, access and show patient information, catch the oral account corresponding to patient and meet, the more electronic medical record (EMR) of new patient, arrange patient's access, obtain medical information etc.The details of the Virtual Medical assistant according to some embodiment is provided below.
Term " Virtual Medical assistant " refers to one or more computing machine in this article and realizes parts (such as, software part, hardware component or both combinations), it is configured to receive input from medical professional, initiates the suitable process of this input to identify the one or more medical task of being specified by this input and/or the execution initiating one or more the identified medical task that one or more process is specified by this input with promotion.Medical professional refer in this article medical science, psychiatry or psychologic put into practice in qualified person, include but not limited to general medicine doctor, surgeon, psychiatrist, psychologist, Therapist or other have the health professional of licence.
The present inventor has realized that the benefit of the Virtual Medical assistant realized on the main process equipment operated by medical professional at least in part, wherein, this Virtual Medical assistant is configured to receive free form instruction from medical professional and promote that the process of this free form instruction is with mark and/or the one or more medical task helping to perform the medical professional specified free form instruction.It is usually unconstrained that free form means medical professional for the structure of provided instruction and/or content.Similarly, medical professional can use nature conventional language to provide this instruction, and it does not need (but can) meets any particular command grammer and/or order vocabulary and at least some instruction is understood by Virtual Medical assistant.Accept free form instruction to allow utilize Virtual Medical assistant and do not ask medical professional first to learn the one group of structured command will understood by Virtual Medical assistant.Term " instruction " refers in this article and anyly operates input, includes but not limited to one or more order, request, inquiry, problem, investigation etc.Some example of free form instruction is discussed in more detail below to illustrate each conception of species relevant with device with Virtual Medical assistant method.
As discussed above, the present inventor has recognized that and can receive free form instruction and process this free form instruction to be identified at the benefit of the Virtual Medical assistant of the one or more medical task of specifying in this free form instruction.Some the medical task performed by medical professional usually may require completely at it and specify some information in a particular manner so that it is relatively troublesome for performing in medical task.In addition, some medical task relates to health and the peacefulness of patient, and must careful operation to guarantee the safety and the adaptability that perform some medical task.The present inventor has realized that can exchange via dialogue the Virtual Medical assistant interacted with medical professional can promote performing more efficiently of some medical task.In addition, the talk between Virtual Medical assistant and medical professional can for medical professional remove correctly and perform the one or more medical task that medical professional wants to perform safely some bear.
According to some embodiment, Virtual Medical assistant is configured to receive free form instruction from medical professional, and initiates process to be identified in free form instruction the one or more medical task of specifying.Virtual Medical assistant can via main process equipment or other interfacing equipment before the one or more medical task of execution with provide with this free form instruction relevant at least one respond.The response provided by Virtual Medical assistant can comprise such as additional information request, for eliminate about the explanation of multiple identified a medical task and/or ambiguity request, relevant with one or more identified medical task relative to the one or more alarm conflicted or warning, about the confirmation of one or more identified medical task, whether to want the inquiry that proceeds about medical professional or comment on about any other of free form instruction, problem or inquiry.
As discussed above, medical professional is made to specify each details about the medical task that will perform may be trouble or time-consuming.In addition, some medical mission requirements fully and specify some information in a specific way, made it be relatively heavy for will realizing the medical professional of some medical task before can executing the task.According to some embodiment, Virtual Medical assistant uses the obtainable information of Virtual Medical assistant to infer at least some information performing the one or more medical required by task identified in from the free form instruction of medical professional.Such as, Virtual Medical assistant deducibility from the information of the previous one or more free form instructions received from medical professional, the information obtained when performing one or more prior medical task, from the patient information of the electronic medical record be associated with patient (EMR) and/or the information that obtains from one or more medical information resources of accessing by network.
Therefore, the Virtual Medical assistant of such configuration may be able to help medical professional to perform the one or more medical task of specifying in from the free form instruction of medical professional, and by obtaining more information from medical professional and/or carrying out inferential information based on the addressable data of Virtual Medical assistant and even promote to do like this from when the imperfect, ambiguous, inconsistent of medical professional and/or conflict instruction when existing.Can also (or alternatively) Virtual Medical assistant is configured to provide may complete the useful information of one or more medical task to medical professional to medical professional, such as by patient encounter and/or provide one or more alarm or warning, there is provided the confirmation etc. about the medical task that will perform, as discussed in more detail below.
Here is the more detailed description of the concept relevant with realizing Virtual Medical assistant and embodiment, method and apparatus.Should be appreciated that can in many ways in any one to realize various aspect as herein described.Only provide the example of particular implementation in this article for illustration purposes.In addition, the various aspects described in the examples below can be used individually or in any combination way, and it is not limited to the combination that describes clearly in this article.
Fig. 1 illustrates the system 100 that wherein can be used to realize Virtual Medical assistant according to some embodiment.This Virtual Medical assistant comprises the Virtual Medical assistant realized by one or more processors of mobile device 101 at least in part and applies 110.Virtual Medical assistant can be applied 110 is arranged on mobile device 101 as one or more software part, such as, by Virtual Medical assistant being applied download for " app " via network, or installs this application on mobile device 101.Virtual Medical assistant can be applied 110 be configured to access and utilize via one or more network 150 (such as, via on the host device can network communications capability) be communicatively coupled to one or more Internet resources of Virtual Medical assistant 110.
Virtual Medical assistant applies 110 and be jointly called Virtual Medical assistant in this article by one or more Internet resources that Virtual Medical assistant applies 110 access.Therefore, the action being described as being performed by Virtual Medical assistant should be interpreted as and apply 110 and/or performed by any one or combination that Virtual Medical assistant applies in 110 access, utilization or the Internet resources of entrusting by Virtual Medical assistant, describe its exemplary resources in more detail below in conjunction with the system shown in Fig. 1.Therefore, according to some embodiment, Virtual Medical assistant can be embodied as and have in upper at least some function that realizes of main process equipment (such as, mobile device 101) and the distributed system of at least some function that realizes via one or more Internet resources.
In FIG, Virtual Medical assistant can be used mobile device 101 to apply 110 access via the Virtual Medical assistant installed at least in part on the mobile apparatus by medical professional, as discussed above.Mobile device 101 in Fig. 1 is shown to have many characteristics of components of " smart phone ", but will be appreciated that mobile device 101 can be can from user (such as, medical professional) receive input, provide information (such as, with visual manner, to audibly etc. to user's information reproduction) and any suitable main process equipment that communicates with Internet resources via one or more network, because each side is unrestricted for the use of the main process equipment of any particular type.
Especially, except mobile device, other usually standing or fixing computing equipment that suitable host device type comprises personal computer or can be accessed by medical professional.As the replacement of trustship, Virtual Medical assistant comprises by the one or more network-accessible computing machines using telephone interview, wherein, described (one or more) network computer trustship (host) Virtual Medical assistant, and visit function via independent interfacing equipment.Such as, medical professional can use any suitable telephone plant incoming call can access the system of one or more main process equipment, and what use speech to perform with Virtual Medical assistant is mutual, interfacing equipment (such as, medical professional use phone parts) and Virtual Medical assistant are interacted but itself might not trustship Virtual Medical assistant.This type of embodiment based on phone can visit via the telephone capability of mobile device (such as, using cellular technologies), or other suitable phone parts any can be used to visit.
Mobile device 101 can comprise for converting acoustic energy to electric energy and one or more transducers 103 that vice versa.Such as, transducer 103 can comprise layout on the mobile apparatus to allow one or more loudspeaker of the I/O of acoustic information (I/O) and/or one or more loudspeaker.Different mobile devices can comprise the transducer of different number and layout, any one be suitable for promotion acoustics I/O wherein.Mobile device 101 can comprise another I/O function, and it comprises the display 105 for presenting information to user with visual manner.Display 105 is also configured to input equipment by responding touch, pen input etc.Mobile device 101 can comprise other input blocks one or more allowing user and mobile device interface.Such as, button 102 can be used as select button, or other function any on mobile device can be comprised.Mobile device 101 can comprise keypad (not shown), arrow button or other input block any, mobile device and Virtual Medical assistant such as can be used to apply 110 medical professionals interacted from user and receive input.
Mobile device 101 also can comprise one or more wireless communication unit 106.Such as, the mobile communication equipment of such as cellular phone and so on usually by have can with the transceiver of one or more Cellular network communication.Alternatively or in addition, wireless communication unit 106 can comprise can with the transceiver of other network one or more or external device communication.Such as, wireless communication unit 106 can comprise the parts being configured to carry out communicating via IEEE802.11 standard (Wi-Fi) and be coupled to one or more network (such as to be connected to, the wide area network (WAN) etc. of LAN (Local Area Network) (LAN), such as the Internet and so on) network access point, and/or wireless communication unit 106 can comprise being connected to compatible equipment etc. transceiver.
In order to the diagram of simplified example mobile device 101, wireless communication unit 106 is used to be shown schematically in any wireless communication unit that mobile device 101 realizes, and one or more parts can be comprised, it can be independent or integrated component, can be autonomous system parts, or can be the different system parts communicated with other radio parts one or more.That is, wireless communication unit 106 represents one or any combination in the parts that can realize on the mobile apparatus, and it allows mobile device 101 and one or more network, system and/or miscellaneous equipment to carry out radio communication.Should be appreciated that mobile device 101 is only the example of any one being suitable in trustship Virtual Medical assistant application and/or confession Virtual Medical assistant technology as herein described or the mobile device combinationally used.
The techniques described herein for for have any given number or layout parts any particular device for unrestricted, and any network aware equipment with I/O function can be suitable for the main process equipment of the function of serving as Virtual Medical assistant application access Virtual Medical assistant.As discussed above, such as, main process equipment can be have network access personal computer or other stand-alone computer (such as, to the wired, wireless of one or more network or combination access), can be the network computer can accessed by phone parts, or other suitable computing equipment any.
According to some embodiment, Virtual Medical assistant applies 110 and is configured to present one or more user interface with via main process equipment (such as, mobile device 101) I/O function receive input (such as, from the free form instruction of medical professional).Such as, Virtual Medical assistant can be applied the 110 one or more loudspeakers be configured to via being coupled to mobile device 101 and receive speech from medical professional, and the process of content of speech initiated in order to identify and to understand medical professional, as discussed in more detail below.Alternatively or in addition, Virtual Medical assistant apply 110 can otherwise take up a job as a doctor treat professional receive input, such as via any input mechanism provided on mobile device 101 (such as, touch-sensitive display, keypad, mouse, one or more button or other Interface Controller mechanism any of providing on the host device).According to some embodiment, Virtual Medical assistant applies 110 and is configured to provide graphical user interface (GUI) on the display 105 of mobile device 101, and it presents to medical professional the mechanism that medical professional can be used to provide to Virtual Medical assistant input.
Also Virtual Medical assistant can be applied 110 to be configured to present one or more interface to provide information to medical professional.Such as, Virtual Medical assistant apply 110 can via on main process equipment display (such as, via on the display 105 of mobile device 101 display GUI) show information to user.Virtual Medical assistant applies 110 modes of can also be able to listening and provides information to medical professional, such as use speech synthetic technology via being coupled to one or more loudspeakers of mobile device 101 to reproduce synthesis speech, or by reproducing the pre-recorded speech or one or more sound that are configured to convey a message to medical professional.According to some embodiment, Virtual Medical assistant applies 110 and and mode can be able to be listened to medical professional's information reproduction with vision.Virtual Medical assistant apply 110 can comprise for provide to medical professional information other mechanism because about for provide to medical professional and/or information reproduction any particular type technology use each side unrestricted.
According to some embodiment, Virtual Medical assistant can adopt the Virtual Medical assistant application server 110' being coupled to (one or more) network 150 to apply with the Virtual Medical assistant be arranged on mobile device 101 110 communications to help and one or more Internet resources interface.By realizing at least some function of Virtual Medical assistant on Virtual Medical assistant server 110', the computing machine that installation Virtual Medical assistant on the host device applies 110 can be reduced and take up room (footprint) (such as, resource can be confined on mobile device to a certain degree) wherein.But, in certain embodiments, Virtual Medical assistant application server 110' can not be realized, and 110 can be applied by the Virtual Medical assistant resided on main process equipment realize in order to the function with one or more Internet resources interface, because each side is unrestricted in this.
According to some embodiment, Virtual Medical assistant can not comprise the Virtual Medical assistant of function of accesses virtual medical assistant of being used for by medical professional be arranged on interfacing equipment and apply.Such as, according to some embodiment, medical professional can visit Virtual Medical assistant via not trustship or the telephone plant that may be not suitable for trustship Virtual Medical assistant application software, and can come interact with Virtual Medical assistant via telephone plant.In this type of embodiment, can by can directly or indirectly be applied (such as to realize Virtual Medical assistant by one or more network computing devices that telephone plant is accessed, Virtual Medical assistant application server 110' can realize the whole of Virtual Medical assistant application function or certain part), and by network topology, Virtual Medical assistant function can be sent to the interfacing equipment used by medical professional.
According to some embodiment, Virtual Medical assistant applies and 110 is configured to access, utilizes and/or entrust to the one or more Internet resources being coupled to (one or more) network 150, therefore formed be configured to help to perform medical professional ask or represent the Virtual Medical assistant (being usually expressed as Virtual Medical assistant 100 in example in FIG) of the medical task of medical professional.(one or more) network 150 can be any one or combination in the network interconnected by various Internet resources, includes but not limited to any one in LAN, WAN, the Internet, dedicated network, personal network etc. or combination.The Internet resources described in FIG are only exemplary, and Virtual Medical assistant can comprise any one in the Internet resources shown in Fig. 1 or combine, or other Internet resources unshowned can be utilized, because the techniques described herein are unrestricted for the Internet usage for any given number or configuration.
As described in FIG, Virtual Medical assistant 100 comprises medical treatment and understands resource 120, and it comprises automatic voice identification (ASAR) parts 130, natural language understanding (NLU) and/or clinical language understanding (CLU) parts 140 and dialogue parts 160.The combination of useful hardware, software or hardware and software realizes each in these parts.
Can comprise each group of processor executable with the parts of software simulating, it can be performed by one or more processors of one or more network computer, the such as webserver or multiple webserver.Each in ASR parts 130, NLU/CLU parts 140 and dialogue parts 160 can be embodied as separate part, or any combination of sets of these parts can be become single parts or the distribution type parts in the upper realization of one or more network computer (such as, the webserver).In addition, any one in ASR parts 130, NLU/CLU parts 140 and dialogue parts 160 can be embodied as multiple software and/or the hardware component of one group.Similarly, be described as understanding by medical treatment process that resource 120 performs refer to by any one individually or in the building block as one man operated with other building block or combine the process performed.
System shown in Fig. 1 also comprises many medical resources, it comprises electric health record (EHR) system 170, medical decision making support (CDS) serves 180, order fulfillment system 190 and medical information retrieval service 155, and wherein each is discussed in more detail below.Should be appreciated that the Internet resources shown in Fig. 1 are only exemplary, and Virtual Medical assistant can utilize in shown resource one or any combination, or other resource that is not shown or that describe can be utilized.The various parts shown in Fig. 1 it is also to be appreciated that can be coupled in any appropriate manner, and can be positioned on (one or more) same physical computing system or the independent physical computing systems that can be coupled in any appropriate manner, described any appropriate ways comprises the network using any type, such as local network, wide area network, the Internet etc.
As discussed above, Virtual Medical assistant apply 110 can speech form receive input (such as, free form instruction from medical professional), and ASR parts 130 can be utilized to identify the content (such as, identifying the composition word in speech input) of speech.Especially, medical professional can say free form instruction to main process equipment (such as, mobile device 110) and/or the interface unit directly or indirectly can accessing main process equipment.Virtual Medical assistant applies 110 can receive free form instruction from medical professional, and provides free form instruction to be identified to ASR parts 130.Free form instruction can be processed in any appropriate manner before providing free form instruction to ASR parts 130.Such as, pre-service can be carried out with removal information to free form instruction, free form instruction is formatd or is revised in free form instruction to prepare (such as ASR, can format conform to the audio format expected and/or prepare for transmitting as a stream as audio stream or preparing as suitable audio file to free form instruction), free form instruction is made it possible to be supplied to ASR parts 130 (such as, by network transmission) as audio frequency input.
ASR parts 130 can be configured to processing audio input (such as, represent the audio frequency input of free form instruction) to form the text representation (text representation of the composition word in the free form instruction of the meaning understanding composition word such as, can be processed further) of audio frequency input.This type of process producing text representation can be performed in any suitable manner.In certain embodiments, voice conversion can be become the expression except text representation by ASR parts 130, or can not be word by this speech recognition, but is alternatively sequence or the set of abstract concept.Should be appreciated that can by the word represented in the free form instruction of medical professional and/or representation of concept and/or the data being stored as any suitable form, because each side is unrestricted in this.ASR parts 130 send identified free form instruction to be applied 110 receptions (such as by Virtual Medical assistant by network, to be shown to medical professional) and/or ASR parts 130 identified free form instruction can be supplied to other Internet resources one or more for further process (such as, identified free form instruction can be supplied to NLU/CLU parts 140 to help the semantic content understanding free form instruction to be identified at the one or more medical task of wherein specifying), as discussed in more detail below.
According to some embodiment, can repair ASR parts 130 for medical field at least in part.Such as, ASR parts can determine to utilize medical terminology vocabulary (it can be the part or in addition of another speech recognition vocabulary more generally) while the word sequence that free form instruction is said from medical professional.But each aspect of the present invention is not limited to the use of vocabulary for ASR of vocabulary or any particular type.When deployed, medical Lexical Chains can be received NLU/CLU parts 140 and/or the Knowledge Representation Model that utilizes of dialogue parts 160 in certain embodiments (such as, Medical Language understands body, one or more statistical model and/or one or more rule-based model), make ASR parts 130 produce the text representation of free form instruction, it comprises at least some term taking NLU/CLU parts 140 and/or the intelligible form of dialogue parts 160.
In certain embodiments, ASR parts 130 can be used in the more generally speech recognition vocabulary shared between ASR parts and other Internet resources one or more.But in other embodiments, ASR parts 130 can not have any vocabulary be developed to other exemplary network resource sharing of shown in Figure 1 or other description.In certain embodiments, the Lexical Chains that ASR parts 130 use can be received dissimilar medical knowledge and represent model, such as not be designed to or be used to the model of language understanding.Should be appreciated that any vocabulary that can be used by ASR parts 130 (or other Internet resources any) in any appropriate manner realizes and/or is expressed as data.ASR parts 130 can utilize in suitable acoustic model, vocabulary, grammer, language model etc. one or any combination to perform identification, because each side is for unrestricted for any specific ASR embodiment.
As discussed above, resource 120 is understood in medical treatment can comprise NLU/CLU parts 140, it is configured to the instruction of process free form to be identified in free form instruction the one or more medical task of specifying, and can identify the one or more parameters be associated with one or more medical task.According to some embodiment, Virtual Medical assistant is configured to process the free form instruction from medical professional.For this reason, it is relatively sane for NLU/CLU parts 140 can being designed to for the ability of the task in its mark free form instruction, and described free form instruction may select to provide with many in the countless ways of reproduction instruction in the degree expected or in the degree can understanding (or may) with medical professional.But, do not exist and may can understand about NLU/CLU parts 140 restriction what reproduces, because more restrictions may be subject in this respect than other according to the embodiment of some embodiment.
NLU/CLU parts 140 can use any suitable language understanding technology to determine the meaning of free form instruction, thus help to be identified at one or more tasks of wherein specifying.Such as, NLU/CLU parts can be configured to identify and extract the grammer of free form speech and/or semantic parts, such as belonging to the speech of known semantic type or each several part of word or expression, to promote the understanding of free form instruction.Such as, NLU/CLU parts 140 can identify action word (such as medical professional may tend to specifying the action word used in specific medical task), object word, subject word, medical terms, medical facts and/or NLU/CLU parts 140 and can think and determine that the content of semantic form or free form instruction is to promote to be identified at the word of relevant other type any of the medical task of wherein specifying or kind.
In order to help to identify the medical task in free form instruction, NLU/CLU parts 140 can have by the particularization function of repairing for medical field.Such as, NLU/CLU parts 140 can comprise one or more Knowledge Representation Model, and it catches the semantic knowledge about general language and/or specific Medical Language.Such as, Knowledge Representation Model may can make medical terminology be associated with corresponding kind, classification or type.This type of kind can include but not limited to medicine, allergy, disposal, diagnostic test, laboratory test, health status (condition), disease or disorder, symptom, vital signs, anatomical structure, body part, Medical Devices, observable discovery, can measure discovery etc.Should be appreciated that above-mentioned list is only exemplary, and some embodiment can not to use in above-listed kind one or more, and some embodiment can use other suitable kind.
Knowledge Representation Model can utilize or combine the formal body being linked to medical terminology vocabulary.This formal body can be embodied as relation data block or take other appropriate format any, and can represent the semantic concept relevant with medical field and with can be used to represent with natural language the language concept that the mode of semantic concept is relevant.Medical terminology in this vocabulary can be linked at least one concept in formal body.
Knowledge Representation Model can use, adopts or realize one or more statistical model to extract semantic entity from natural language input.Usually, statistical model can be described as being designed and/or being trained to based on formerly training the conceptual schema observed in input to analyze the functional part of new input.In the sense that, the model that statistical model is different from " rule-based ", it is usually applied hard coded Deterministic rules and is mapped to specific output from the input with particular characteristics.On the contrary, statistical model can carry out operating the specific output determining having the input of particular characteristics with the training by consideration with those identical characteristics (or similar characteristics) the input frequency (such as, with what probability) that output specific for this is associated in the training data of statistical model.Such as, under the background of Virtual Medical assistant, the input that model operates on it may correspond in free form instruction (or from expression that it is derived), and exports the mark that can comprise the medical task of being specified by free form instruction and/or one or more relevant parameter.
Statistical model is allowed to carry out the probability data of extrapolating to be associated with the specific output past example from the trend of specific input characteristics in order to supply, usually with relatively a large amount of exemplary inputs training (or " structure ") statistical model in training main body.Usually, exemplary input is marked with known output, this exemplary input should be associated (such as with this known output, the correct medical task that available commands is specified is to mark the main body of free form instruction input), usually by the mankind person of labelling (such as, there is the professional knowledge in this field) or sometimes automatically.From input mark (" extraction ") characteristic interested (being called " feature "), and statistical model learns the probability that different features is associated from different output, export with those frequency be associated based on the training input with those features.When from new input (such as, the input such as do not marked with known output by the mankind) when extracting same characteristic features, statistical model the learning probability (from training data study) for extracted feature then can be used to determine for new input which exports is most possibly correct.Under the background of Virtual Medical assistant, feature may correspond in the word identified in free form instruction, concept, association, relation etc., and based on these features and relation thereof, statistical model can determine which one or more tasks are most possibly correct for the free form voice received from medical professional.
The Knowledge Representation Model that NLU/CLU parts 140 utilize also can comprise (or alternatively comprising) one or more rule-based model, it provides one group of rule of the parameter about how, the word or expression in free form instruction being mapped to corresponding medical task and/or the word or expression in free form instruction being mapped to identified medical task.Such as, NLU/CLU parts 140 can comprise rule-based natural language processing system to extract medical facts, the fact are linked to concept or help in addition to be identified at the one or more medical task of specifying the free form instruction received from medical professional.In rule-based system, linguist and/or other individuality can create multiple rule, and it can specify free form speech to specify the word of specific medical task (such as, order can the instruction of order items) or combination or word evidence.Rule-based technology can by NLU/CLU parts 140 be used for being identified at from medical professional free form instruction (such as, for patient information request, order can the instruction of order items, the instruction, the more order of new patient's record that obtain oral account, the inquiry etc. about medical bodies) in the one or more medical task of specifying and/or any parameter be associated with identified medical task.
Should be appreciated that NLU/CLU parts can utilize in above-mentioned technology one or any combination to identify medical task in free form instruction and/or mark with any parameter of being associated of the medical task of mark because each side is unrestricted for the combinationally using of any particular technology of confession or technology.According to an embodiment as herein described, use hybrid scheme, wherein, NLU/CLU parts 140 adopt statistical model and rule-based parts to be identified in free form instruction the one or more medical task of specifying.This type of hybrid method can be realized, because adopt each side of hybrid method to be not limited to any specific implementation technology by any one in many modes.According to some embodiment, the statistical model of NLU/CLU parts 140 and rule-based parts can operate same free form instruction concurrently, and in certain embodiments, it serially operates.In parallel or serial operation, statistical model and rule-based parts can operate independently, or exchange information is to promote to be identified at (one or more) the medical task of specifying in free form oral account and/or the parameter be associated with this medical task.
According to some embodiment, rule-based parts can perform first pass to identify semantic entity by such as extracting medical facts to free form instruction, and word or expression is linked into concept by it, and/or identifies other characteristic of known medical task.Then, this semantic entity can be processed to determine which one or more medical task free form instruction most possibly relate to by Using statistics model.That is, the output of rule-based parts can be used as the feature for statistical model.Such as, when rule starts or instruction has met rule in addition, this can be the feature assessed by statistical model.Some rule may be quite specific, make the startup of rule with high probability instruction thus the determination expressed is (detection of such as, combined with the medicine name in mark free form instruction word " order " can high probability indicate medical professional to want Virtual Medical assistant to order this medicine) accurately.
According to some embodiment, statistical model can operate the one or more medical task of being specified by free form instruction for mark most probable, and can use rule-based parts from free form instruction, identify the one or more parameters be associated with identified medical task.Can other appropriate ways Using statistics model and rule-based parts, because each side is unrestricted in this.According to some embodiment, the determination can carrying out about Using statistics model or rule-based parts according to the content of free form instruction.Such as, some instruction very structurized can support rule, and the instruction type in how it express with natural language with marked change can be suitable for the use of statistical model better.
According to some embodiment, can in many ways in any one and statistical model use the ontology of the above-mentioned type in combination.Such as, ontological use can reduce the amount of the operable annotation data when training statistical model, because ontology can be demonstrated express many substitute modes of identical concept.Therefore, can not need to comprise and represent that expression instruction is to perform the annotation data of all substitute modes of some medical task, and this ontology and statistical model can be combined that its Capacity extension is extremely identified that the replacement be not included in the training data of annotation is expressed.Certainly, this is only an ontological purposes, because ontology can use in any suitable manner.
Again, for by the use of rule-based parts and statistical model and the description provided above of combining with ontology is alternatively only exemplary, because the techniques described herein are not limited to any specific implementation technology.The techniques described herein can use only statistical model, only rule-based parts or any combination to realize, because it is not limited to any specific implementation technology.That is, NLU/CLU parts 140 process can as desired simple like that or tip suitably to identify this medical task when one or more medical task exists with the form of the free form instruction provided by medical professional.
As mentioned above, resource 120 is understood in the medical treatment shown in Fig. 1 also can comprise dialogue parts 160.Dialogue parts 160 can comprise interactive function, and it promotes the talk between medical professional and Virtual Medical assistant.As discussed above, Virtual Medical assistant can be configured to provide one or more response to medical professional in combination with the free form instruction received from medical professional.Dialogue parts 160 can completely or partially based on the formulism that the content of free form instruction, situation background and/or the intention by the one or more responses being supplied to medical professional promote this type of to respond.
Can by dialogue parts 160 be coupled to NLU/CLU parts 140 thus obtain about the content of free form instruction information (such as, to receive the information of one or more medical task of mark about what specify in free form instruction) to determine whether to need the response to medical professional, and if be that how such words should carry out formulism to response and what information this response should comprise.Dialogue parts 160 suitably may can perform different dialogues to have obtained the information of multiple medical required by task.Such as, medical task can have a related structured representation, and it comprises multiple field, and this field corresponds to by dialogue parts 160 or the information about each medical task that kept by the addressable parts of dialogue parts 160.Some field may correspond to the parameter in performing the medical required by task of association, and some field may correspond in optional parameter.
Dialogue parts 160 can operate to be identified at the one or more medical task of specifying in the free form instruction of medical professional with NLU/CLU parts 140 in combination, and with by NLU/CLU parts 140 from the information of free form instruction fetch, infer thus, from the background of the talk with medical professional or estimating state or from the information of the inferred from input data that can obtain from one or more Internet resources be filled in be associated with identified (one or more) medical task represent suitable field.Dialogue parts 160 can determine owing to processing the free form instruction that receive that one or more required field is not yet filled (such as, some information can not obtain or from free form instruction predication or otherwise infer), and responsively, by the suitable response formula of medical professional to obtain drain message.Then can apply 110 via the Virtual Medical assistant on main process equipment (such as, the mobile device of medical professional) and this response is supplied to medical professional.Similarly, dialogue parts 160 can determine that some optional information is omitted, and think that it is suitable for the response formula by being designed to ask from medical professional this information.Also dialogue parts 160 can be configured to carry out formulism when the information performing medical required by task completes to response, such as to provide confirmatory to respond to medical professional, to guarantee that task is the task of expection, and the parameter determined by Virtual Medical assistant is correct.
Dialogue parts 160 can be configured to as one man to work with CLU/NLU parts 140 with any ambiguous and/or uncertain by what process that the free form instruction that receives from medical professional obtains to resolve by being designed to from the response formula of medical professional's solicited message.Such as, the process performed by CLU/NLU parts 140 may cause the uncertainty wanting the medical task performed relative to medical professional, or easily may cause multiple possibilities in this respect.The process undertaken by CLU/NLU parts 140 may cause the uncertainty of the one or more parameters being associated or completing medical required by task with medical task.This type of ambiguous and/or uncertainty may by the imperfect or relative low confidence identification of the incomplete understanding of free form instruction, free form instruction (such as, when free form instruction is by as speech reception then), cause from the imperfect or indefinite instruction of medical professional or its combination.Any ambiguous and/or uncertainty can be sent to dialogue parts 160 being designed to resolve any ambiguous/probabilistic response formula to obtain explanation about problem or misgivings in combination with free form instruction by CLU/NLU parts 140.
As discussed above (and as discussed in more detail below), Virtual Medical assistant can be configured to process free form instruction and identify about execution from the compatibility of the one or more medical task of the free form command identification received from medical professional and/or one or more conflicts of adaptability.Such as, can in the process of process free form instruction in identification of medications, allergy, disposal, health status etc. one or problematic interaction between any combination.As discussed in more detail below, can partially by utilizing one or more medical resource to identify this type of conflict, such as EHR system 170, CDS system 180, medical information retrieve resources 155 or other available resources.Dialogue parts 160 can be configured to reception about the information of this type of conflict and by one or more response formula to inquire that medical professional wants how to proceed to medical professional's warning about the existence of conflict and/or in view of identified (one or more) conflict.
According to some embodiment, whether dialogue parts 160 can evaluate compound instruction is suitable in a given case.Such as, the evaluation of ordering medicine is intended to based on medical professional, dialogue parts 160 can be determined to describe from free form instruction fetch (such as, by NLU/CLU parts 140) or institute's identification parameter of inferring thus and inquire that one or more missing parameter is both important.
Above-mentioned functions about dialogue parts 160 is only exemplary, and given dialogue parts can realize in above-mentioned functions certain is part or all of, or can realize not describing in this article or in conjunction with the additional function of another parts or resource description.In addition, some function described in conjunction with dialogue parts 160 can completely or partially (be comprised the Virtual Medical assistant resided on main process equipment to apply and/or Virtual Medical assistant application server by other parts or resource execution, if realized), if because above-mentioned functions is implemented can be performed by any suitable parts or component combination when being implemented.
As discussed above, the system shown in Fig. 1 also comprises many medical resources, comprises EHR system 170.EHR system 170 can comprise the one or more parts stored for the electronic medical record of the patient of one or more health institution.Many health institutions or transit to electronic medical record (EMR) system from paper document establishment, and wherein, the medical information of patient is Electronically stored in data storage bank.Can be the electric health record (EHC) for patient by the archival of information described in previous " recording chart " using paper-based form as patient, together with other associated patient data any.Such as, the demographic information of patient can be comprised for the EHR of patient, notes, operation, pathology and/or radiological report, diagnosis report, imaging results or other diagnostic test result of medical professional that absorption form, history, immunity record, laboratory result, record patient meet/access, seek advice from any one in notes, summary of leaving hospital etc. or combine.
Therefore, EHR is electronic medical record, and it is usually kept by specific health institution, and comprises the data of particular patient being passed in time the nursing filing received from this mechanism (or other mechanism).EHR system 170 can comprise from given mechanism or the electronic medical record for patient from multiple mechanism.EHR system 170 can comprise corresponding to any one in the independent EHC system of each single or multiple mechanism or any combination, or can comprise by or any combination in EHR system that is integrated or otherwise communicative couplings.EHR system 170 also can comprise except filing, manage and upgrading other function except electronic medical record, and/or can store more generally that character is (such as, and be non-specific for particular patient) the specific out of Memory of other medical information or mechanism (such as, standard, standard operating procedure (SOP), strategy etc.).
Another medical resource shown in Fig. 1 comprises medical decision making support (CDS) and serves 180.CDS service 180 is the resources for evaluating medical treatment conflict.Such as, CDS service 180 can comprise about the adaptability of medicine, medical/surgical program and/or diagnostic test etc. and the information of compatibility and with it mutual.For medicine, CDS system 180 can comprise the information about compatibility, medicine and the specific hypersensitive compatibility etc. between dosage, form and method of administration, dissimilar medicine.Relative to disposal, CDS service 180 is seen to comprise and is disposed the compatibility between the medical condition be pre-existing in, the information with the compatibility of medicine etc. about some.CDS service 180 can provide the information of other type in this respect, because each side is unrestricted in this.In some systems, CDS function can integrally or partly be provided by EHR system 170, or CDS can serve 180 integrated or CDS can be utilized to serve 180 as resource by EHR system 170, and the shown structure in Fig. 1 is only exemplary.Should be appreciated that CDS service 180 (if realize) can comprise any quantity of information, it comprises one mentioned above, some or all types of information.
Another medical resource shown in Fig. 1 comprises order fulfillment system 190.Order fulfillment system 190 can comprise the one or more systems can fulfiled to be suitable for the order that electronic format is submitted to.Order fulfillment system 190 in Fig. 1 represent can fulfil be suitable for can in the available order fulfillment system of order items or resource any one or combine.One or more order fulfillment system can be individual system or multiple system and/or illustrate for convenience's sake and together.According to some embodiment, order fulfillment system 190 comprises computerize doctor's advice input system (CPOE) system, and it can receive and process the electronic order in medicine, laboratory test, radiology examination, operation or other medical treatment and/or other planning treatment action items or any combination.
As discussed above, some embodiment comprises Virtual Medical assistant, its be configured to identify in order to order specify in free form instruction one or more can order items instruction and help medical professional to place an order.In this respect, Virtual Medical assistant can be configured to access order fulfillment system 190 to promote the distributing of order received from medical professional by Virtual Medical assistant.In order to promote electronic ordering, Virtual Medical assistant can be configured to utilize any industry standard e interface be connected with order fulfillment system 190 and communicate, or can use and utilize any particularization needed for one or more order fulfillment system or special purpose interface or form.Such as, Virtual Medical assistant can generate according to HL7 standard or in any other suitable way as the order that electronic information presents.The example of industry standard e interface comprise ePrescribing or CPOE for prescription, the CPOE system for ordering program and for order laboratory test many systems in any one, order management dispatching system etc.
According to some embodiment, the example system shown in Fig. 1 also comprises the available medical information retrieve resources 155 of Virtual Medical assistant.Medical information retrieve resources can comprise the one or more resources that can be used for providing or obtaining medical information, and can comprise one or more medical information storage vault and/or one or more searching facility, it is configured to respond to position the medical information be stored in described one or more medical information storage vault to inquiry.Medical information retrieve resources 155 can be utilized to promote to respond medical professional's inquiry according to some embodiment Virtual Medical assistant, identify one or more conflict, infer the information performing one or more medical required by task, or for one or more other objects consistent with helping medical professional.But, do not need Virtual Medical assistant to be configured to access this type of medical information retrieve resources 155, because each side is unrestricted in this.
As discussed above, the present inventor has realized that and is configured to help medical professional to perform the benefit of the Virtual Medical assistant of the one or more medical task that medical professional may want help when performing, one or more medical task includes but not limited to patient access information, prepare and/or submit to be used for can order items order (such as, prepare and/or submit medicine order to, dispose order, laboratory order, diagnostic test order, agreement order, to change the place of examination order, consultation of doctors order etc.), catch, assessment and patient meet the oral account that is associated and/or filed, arrange any one or the combination in agreement etc.Virtual Medical assistant can be configured to the medical task interacting with medical professional in real time to help through desired by medical professional.The medical task that this type of interactivity allows Virtual Medical assistant to respond to obtain drain message to the instruction received from medical professional, instruction carried out to ambiguity elimination, mark is expected, identification collision and the understanding etc. to the instruction that medical professional receives about the alarm of this conflict or warning, confirmation.In addition, the information performing one or more medical required by task is inferred, the medical information being such as used in the information in the information in previous receipt instruction, the information obtained when performing one or more medical task in response to previous receipt instruction, electronic medical record and/or being accessed by network with the Virtual Medical assistant that can allow alternately of medical professional.Be described in more detail below according to some embodiment about some example technique realizing Virtual Medical assistant.
Fig. 2 is can by Virtual Medical assistant execution to help the process flow diagram of the method for medical professional according to illustrating of some embodiment, and wherein, Virtual Medical assistant is performed by least one processor of main process equipment at least in part.Main process equipment can be mobile device, such as there is the smart phone of the medical professional being arranged on the Virtual Medical assistant application on smart phone as application or " app ", or can be can other suitable equipment any of a part (such as, Virtual Medical assistant application) of trustship Virtual Medical assistant.This main process equipment can comprise one or more transceiver, its can with at least one network and/or external device communication, Virtual Medical assistant is applied and can access one or more Internet resources, Virtual Medical assistant application is configured to and this Internet resources cooperation.
In action in 210, receive free form instruction (such as, via the interface function on mobile device or other interfacing equipment) by Virtual Medical assistant from medical professional.Such as, medical professional can say free form instruction, and Virtual Medical assistant application can via being coupled to one or more loudspeakers of mobile device to receive free form voice commands.Alternatively, free form instruction can be received via another input block (such as, via other input mechanisms one or more being coupled to mobile device).Such as, medical professional can key in free form instruction via the keyboard on mobile device or touch-sensitive display panel, and Virtual Medical assistant application can receive free form instruction as free form text instruction.Free form instruction can be received in any other suitable way, because each side in this unrestricted (such as, free form instruction can via with realize the interface unit that main process equipment that Virtual Medical assistant applies separates at least in part in the above and receive).
In action in 220, applied the free form instruction that provides and receive by Virtual Medical assistant for process to identify the one or more medical task of being specified in free form instruction by medical professional.According to some embodiment, after the pre-service performing free form instruction (if need or expect these type of pretreated words any), Virtual Medical assistant application can send this free form instruction with by the one or more resource process being connected to the network can accessed by main process equipment.Such as, Virtual Medical assistant application can be understood resource to medical treatment and provides this free form instruction to analyze this free form instruction to determine its content and meaning, such as by utilize ASR parts, NLU/CLU parts and/or dialogue parts process free form speech with identify medical task and/or with one or more parameters of being associated of the medical task of mark.According to some embodiment, other Internet resources can be utilized to help to be identified at the one or more medical task of specifying in the free form instruction received.
In some cases, process free form instruction to cause identifying the one or more obstacles to performing at least one the medical task identified.Term " obstacle " refers in this article relative to performing at least one medical task identified usually obstacle, complicated and/or cause any situation of problem or misgivings in addition.The example of obstacle be omit the one side required (or used alternatively) performing at least one medical task or at least one medical task information, relative to the execution conflict that is ambiguous, that be associated with at least one medical task of at least one medical task, the uncertainty etc. about the character of the medical task of one or more appointment.As will be appreciated that from example given above, obstacle does not need operation to stop utterly or to forbid that at least one medical task is performed, but problem in this respect or misgivings need only be caused (such as, free form instruction can comprise the information being enough to order, but may identify compatibility or adaptability conflict).But some obstacle may stop the execution of identified medical task (such as, may identify for can drain message needed for the order of order items) really.Should be appreciated that and may identify multiple obstacle in some cases, and may obstacle be identified in other cases.
In action in 230, by Virtual Medical assistant by such as Virtual Medical assistant be applied in perform described at least one identify medical task before present at least one first response (or presenting at least one first response described by any interfacing equipment utilized via medical professional) via main process equipment (such as, mobile device) to medical professional and provide at least one first to respond to medical professional.Such as, can at least one first response described be shown to medical professional on the display of the mobile device and/or speech synthetic technology can be used and carry out reproduced speech via the one or more loudspeakers being coupled to mobile device and at least one first response described is presented to medical professional as audio frequency.According to some embodiment, visual manner and mode of can listening at least one first response described can be rendered to medical professional, or single presentation modes can be used, because each side specificly to present or unrestricted for reproducing technology for for any.
For can be depending on the environment of interfacing equipment that medical professional utilizes and/or medical professional to one or more technology of medical professional's information reproduction.Such as, the display of mobile device can be limited, in this case, it can be preferred that audio frequency presents, or medical professional may the focus of medical professional just wherein concentrate on other places (such as, while driving, perform check or dispose while etc.), audio frequency is presented can be preferably in the environment of (when being with or without the corresponding visual rendition of at least one the first response described) to utilize Virtual Medical assistant.According to some embodiment, the interface that medical professional utilizes only can comprise speech capability, makes performing to audibly alternately between medical professional and Virtual Medical assistant.In some cases, medical professional may just wherein audio frequency present may inappropriate or be difficult to hear or understands, make at least one independent visual rendition responded described can be preferred situation under use Virtual Medical assistant.But, can in any suitable manner, form or pattern provide and reproduce the response from Virtual Medical assistant, because each side is unrestricted in this.
But be presented, at least one first response described can be relevant with at least one identified medical task thought fit by Virtual Medical assistant any response.Such as, Virtual Medical assistant can identify the one or more obstacles to performing at least one medical task described, and by least one first response formula described (such as, using dialogue parts) to comprise the one or more inquiries being supplied to medical professional about described one or more mark obstacle.At least one first response formula described can be changed in this respect and comprise the request that medical professional provides at least some drain message needed for one side performing at least one medical task or at least one medical task, for resolving helping and the request performing the one or more ambiguous information that at least one medical task is associated, the problem of the medical task performing what type is wanted about medical professional, with at least one identify one or more alarms that medical task is associated, warning and/or warning.
At least one first response described alternatively can have nothing to do with any obstacle.Such as, this Virtual Medical assistant can identify one or more medical task when any obstacle to execution at least one medical task described not detected, but, medical virtual assistant may want initiate identify the execution of medical task before ask from medical professional confirmation.Therefore, at least one first response formula described can be changed into comprise about the statement of the understanding of free form instruction and/or Virtual Medical assistant be intended to initiate its perform described in the describing and/or any correlative detail (the one or more parameters such as, be associated with task) of at least one medical task.At least one first response formula described can be changed into the request of confirmation comprising medical professional and confirm the request that this understanding is correct and/or be used for the execution proceeding identified medical task.
In action in 240, Virtual Medical assistant receives information in response at least one first response described from medical professional.Such as, medical professional by provide drain message, ambiguity eliminate information, about at least one medical task guidance, to the confirmation proceeded, about the checking of the understanding of free form instruction, free form instruction cancellation, the amendment etc. of free form instruction is responded.Information from medical professional can use combination above to receive any input mechanism described in free form instruction via any suitable interfacing equipment (such as, using mobile device) and be received by Virtual Medical assistant application.
In action in 245, Virtual Medical assistant can evaluate whether to perform at least one medical task described based on the information received from medical professional at least in part.Especially, Virtual Medical assistant can assess this information and whether should perform at least one medical task described with evaluation.Such as, Virtual Medical backup system can check whether obtained perform institute ask all information of medical required by task or the need of more information, whether resolve ambiguous or requirement more speak more bright, whether be correctly identified to perform medical task, whether removed any conflict or modify instruction removing conflict, medical professional whether confirmed to perform the medical task dispatching of request.If overcome one or more obstacle fully and/or medical professional has confirmed the understanding of free form instruction and authorized Virtual Medical assistant to proceed, then Virtual Medical assistant can initiate the execution (action 250) of at least one the medical task identified in free form instruction.
Need more information to perform institute's medical task of mark if Virtual Medical assistant thinks, then can again perform take action in 210-240 any one or combine.Such as, Virtual Medical assistant can return and wait for the further free form instruction (such as, when medical professional judges not proceed identified medical task) from medical professional.Alternatively, Virtual Medical assistance system again can process free form instruction and/or can generate one or more other by Virtual Medical assistant and respond and be supplied to medical professional and provide more information about free form instruction to ask medical professional in view of more information.Whether Virtual Medical assistant also can evaluate can infer more information based on the additional information received from medical professional now.
This type of that should be appreciated that between medical professional and Virtual Medical assistant is talked with sustainable until determine to be ready to be performed and/or authorize one or more medical task by medical professional.By this way, Virtual Medical assistant can interact with medical professional to help medical professional to perform medical task and/or represent medical professional to perform medical task in real time.Other action that the not method shown in composition graphs 2 describes clearly can be comprised it is also to be appreciated that identify at least one medical task and interact with medical professional.In addition, do not require in performing an action or any particular combination, do not need to perform an action according to order described in conjunction with Figure 2 or according to any particular order, because each side is unrestricted in this yet.Alternatively, method 200 only provides according to the mutual example between the medical professional of some embodiment and Virtual Medical assistance system.
As an example of manner of execution 200, medical professional can climb Kilimanjaro in conjunction with patient care plan and camp overnight in and in col, to provide following free form instruction " to start JohnDoeonDiamox; every day absorbs 250mg pill at every turn, a few days ago start in climbing " Virtual Medical assistant in combination can process free form instruction and recognize that Diamox is the brand name for active component acetic acid azoles amine.The patient that Virtual Medical assistant may have access to JohnDoe records and determines the allergy of this patient to the medicine based on sulfanilamide (SN).Responsively, Virtual Medical assistant by provide following response " patient JohnDoe to the drug allergy based on sulfanilamide (SN), you want to continue? " and will comprise to the response formula of the warning of the drug allergy detected this of medical professional.Responsively, medical professional is by providing to give an order: " good, to order dexamethasone as an alternative " is decided to change this prescription.
Virtual Medical assistant can receive further instruction from medical professional, processes this instruction to determine that prescription is become corticosteroid Dexamethasone by medical professional.When processing further free form instruction, Virtual Medical assistant can determine many details (such as, dosage, frequency, approach etc.) that medical professional fails to provide and distributed needed for medicine order.Virtual Medical assistant can provide following response to medical professional: " the medicine order being used for patient JohnDoe is become dexamethasone.In order to complete this order, prescription details please be provide." medical professional's available commands " and oral 4mg pill twice daily, climbing the previous day start " respond.This is exemplary openly may persist to Virtual Medical assistant and to have obtained and till distributing the information needed for medicine order, according to some embodiment, comprise and complete describing and confirming an order for medical professional and/or the request of any required authorization information is provided for medical professional of order.
As an example of manner of execution 200, wherein, Virtual Medical assistant request is about the further guidance of (one or more) the medical task that will perform, and medical professional can provide following free form instruction: " I needs to consult to instruct biopsy with the ultrasound wave discussed for Kidney neoplasms and peripheral lymph node with doctor Jones." Virtual Medical assistant can receive this free form instruction, process this instruction and determine the explanation of the predetermined instruction needed medical professional.Such as, whether Virtual Medical assistant may want to want to arrange with the consultation of doctors of doctor Jones about medical professional, order biopsy and dispose or both explanation.Responsively, Virtual Medical assistant can provide following response to medical professional: " you want me to arrange the consultation of doctors with Jones? " if medical professional carries out positive response, then Virtual Medical professional can initiate the process setting up this consultation of doctors.The Virtual Medical assistant being identified to the multiple potential task that will perform can follow-uply carry out inquiring " you want me to order ultrasound wave biopsy for Kidney neoplasms and peripheral lymph node? " for, medical professional can reply " after no, let us waits until the consultation of doctors." Virtual Medical assistant can the date and time of the recording scheduled consultation of doctors, and set up after the consultation of doctors has occurred the inside of follow-up is pointed out.After the consultation of doctors has occurred, the prompting set by Virtual Medical assistant can trigger Virtual Medical assistant to medical professional provide following inquiry " you want the ultrasound wave ordering Kidney neoplasms and peripheral lymph node according to the consultation of doctors with doctor Jones to instruct biopsy? " like this, Virtual Medical assistant can help him/her on one's own initiative in the practical operation of medical professional.
As the example performing the method 200 that at least one response wherein said has nothing to do with obstacle, medical professional can provide following free form instruction to medical professional: " set up the routine blood test being used for Jane, have RBC and WBC to add up and urine examination." Virtual Medical assistant can receive and process free form instruction; and determine that medical professional wants to order and test for the laboratory of JaneDoe, and can respond as follows: " test for the laboratory of patient JaneDoe: the routine blood test and the urine examination that comprise red blood cell and white blood cell count.There is there any special instruction? " medical professional can respond as follows: " yes, requiring quick 12 hours ".Above-mentionedly exemplaryly can promote providing of the comprehensive order for testing for the laboratory of patient alternately.According to some embodiment, Virtual Medical assistant can proceed above-mentioned dialogue to provide additional response, and it describes order (comprising the special instruction received) that assistant is intended to send and asks medical professional to confirm this order.
The above-mentioned exemplary dialogue that should be appreciated that between medical professional and Virtual Medical assistant is only the example of Virtual Medical assistant attainable conversation type when helping medical professional.Any suitable exchange that can perform between medical professional and Virtual Medical assistant performs one or more medical task to help medical professional, because each side is not limited to the mutual of any particular type or form.Illustratively some other example is described below.
Method 200 above described in composition graphs 2 illustrates some quality of oral speech of Virtual Medical assistance system, and its permission Virtual Medical assistant and medical professional interact to combine the free form instruction received from medical professional and carry out detecting, inquire, put question to, ask, confirm and/or verifying.Be embodiment according to certain, the Virtual Medical assistance system can inferring the information relevant with the free form instruction provided by medical professional can be realized.By this way, Virtual Medical assistant may can process and operate possible imperfect, ambiguous, inconsistent and/or cause the free form instruction of the one or more conflicts relevant with the one or more medical task of specifying in the free form instruction received.
Fig. 3 comprises and illustrates and can perform to help the process flow diagram of the method for medical professional by the deduction at least some information relevant with the free form instruction received from medical professional by Virtual Medical assistant.Action 310 and 320 is similar to the action 210 and 220 described in method 200 above shown in composition graphs 2 in some aspects, can receive free form instruction go forward side by side row relax to identify at least one medical task that will perform by Virtual Medical assistant from medical professional.Such as, the main process equipment (or via (one or more) other interface unit) that can be applied thereon face operation via Virtual Medical assistant receives free form instruction from medical professional, and sends this free form instruction with by forming one or more parts process of Virtual Medical assistant at least in part to be identified at any medical task of specifying in this free form instruction by network.
In action in 330, identify at least one obstacle to performing the medical task determined from free form instruction.Such as, Virtual Medical assistant can process free form speech (such as, using medical treatment to understand resource) with the content understanding free form speech with determine medical professional order Virtual Medical assistant do or what help.In doing so, the one or more obstacles to the instruction performing medical professional can be identified.Such as, Virtual Medical assistant can determine perform ask the information of medical required by task to be omitted, what can identify in the instruction of medical professional is one or more ambiguous, or can to detect for one or more the identified medical task of execution obstacle, complicated and/or cause probabilistic one or more situation in addition.
In action in 340, infer that at least some information is to help to overcome at least one identified obstacle.Such as, Virtual Medical assistant can carry out inferential information based on the one or more parts that can be used for Virtual Medical assistant or the information that can obtain via the addressable one or more Internet resources of Virtual Medical assistant.According to some embodiment, Virtual Medical assistant assesses the instruction previously received from medical professional and/or the information obtained in response to previously received instruction to infer described at least some information.
Illustratively infer about to the example of at least some information of one or more obstacles performing medical task, medical professional may for Virtual Medical assistant provides instruction: " for I shows the recording chart of JohnDoe ".In response to this instruction, Virtual Medical assistant may initiate in order to obtain the case history of JohnDoe or the process of other relative recording from the addressable EHR system of such as Virtual Medical assistant, and " recording chart " of JohnDoe is presented to medical professional at least partially.In response to receive for JohnDoe patient information or after this, medical professional can say free form instruction " please rewrite prescription ".Virtual Medical assistant can process this instruction and identify medical professional want order medicine, and determine exist perform ask the information of medical required by task to be omitted.Especially, patient's name is indefinite in instruction, and medicine, dosage, frequency, usage, quantity etc. omit completely.
It is one or more that Virtual Medical assistant can infer these missing parameters according to prior instructions or the information obtained from executing the task in response to previous instruction.Such as, Virtual Medical assistant can recognize that medical professional probably mentions JohnDoe due to the prior instructions of " for I shows the recording chart of JohnDoe ".In addition, Virtual Medical assistant be understood that, medical professional orders rewriting about prescription, and prescription information can be present in and to obtain in response to the recording chart in order to obtain JohnDoe or in addition can from storing the patient history that obtains for the EHR system of the record of JohnDoe.Therefore, Virtual Medical assistant can infer according to the electronic medical record for JohnDoe in this information at least some.
In the examples described above, in the trial of inferring at least some information relevant with the prescription that medical professional is intended to fill in, from the EMR of JohnDoe, Virtual Medical assistant can find that JohnDoe has multiple drug prescription.Virtual Medical system section provides response to obtain explanation (such as, Virtual Medical assistant can perform the function similar or identical with the action 230 in the method 200 shown in Fig. 2) to medical professional.Such as, Virtual Medical assistant can present together with such as " such as JohnDoe has multiple prescription to medical professional.You please be select to want the prescription rewritten " and so on vision and/or response can be listened to locate multiple prescriptions of (or the mark of such as medicine name and so on is write a Chinese character in simplified form) together.The prescription that then medical professional can identify expectation is ordered to allow Virtual Medical assistant to proceed medicine.Otherwise, if JohnDoe only has single prescription, then Virtual Medical assistant deducibility this be medical professional's prescription of being intended to rewrite and obtain information needed from the electronic medical record of JohnDoe.
Before performing the medical task ordering medicine, Virtual Medical system can present it to medical professional and is properly understood to the details (such as, the parameter of medicine order) of the understanding of instruction and prescription refill to confirm instruction and confirms that any inferential information is correct.In the examples described above, Virtual Medical assistant can be presented confirmation to medical professional and " for the medicine order of patient JohnDoe, sucked as required and use Albuterol inhalator by mouth.PLSCONFM medicine order.If " medical professional's confirmation (such as, action 345 is), then Virtual Medical assistant can initiate the process submitting medicine order to, such as generates complete medicine order and is submitted to CPOE system.
The medical knowledge that virtual medical science assistant also can obtain based on the one or more Medical Information Resources that may have access to (such as, via one or more information retrieval resource) from Virtual Medical assistant infers one or more parameter.Such as, medical professional can say " as required JohnDoe start daily compazine be used for the treatment of for 2-3 time nauseating ".Although it should be oral that medical professional does not clearly state medicine, Virtual Medical assistant is to infer oral administration for the brand name of the oral form of medicine prochlorperazine by true compazine.When responding medical professional (such as, in confirmatory response or such as about the inquiry of dosage), Virtual Medical assistant can be supplied to medical professional medicine order its describe in provide this infer (such as, to the medicine order of patient JohnDoe.Every day 2-3 times is nauseating to treat with the oral compazine of pill form as required.Should the prochlorperazine of what dosage be taken?)
As another example, free form instruction can mention " IV " (namely, intravenous injection medicinal approaches), and this medicine of Virtual Medical assistant deducibility should administration in liquid form (it can be for the parameter needed for medicine), make in some embodiment as herein described, liquid form can be comprised, because it is implied at the order for medicine.As another example, if free form instruction indicates this medicine to answer " immediately " administration, then this medicine of Virtual Medical assistant deducibility needs administration immediately, and it can make Virtual Medical assistant can fill for the start time field in the order form of medicine.
Virtual medicine assistant also can carry out inferential information based on it to the knowledge of medical professional and/or the practical operation of medical professional.Such as, medical professional can say " JaneDoe needs the CT scan of chest and neck, with compound ".Virtual Medical assistant can receive this free form instruction, processes this free form instruction to determine that medical professional wants to order diagnostic test.Although medical professional does not specify will perform the radiation position of diagnostic test, Virtual Medical assistant can based on the main contact of medical professional and mechanism, the previous instruction of radiating the position tested or the available out of Memory compared to another place suggestion the three unities of Virtual Medical assistant will be performed infer and radiate position.Virtual Medical assistant or can present its deduction in order to have obtained and to have distributed in the response for any out of Memory needed for the order of diagnostic test to medical professional in confirmatory response.
Method 300 above described in composition graphs 3 illustrates some deduction ability of the Virtual Medical assistance system according to some embodiment, it allows Virtual Medical assistant to perform medical task, by inferring about at least some information of the one or more medical task that will perform, imperfect, the indefinite or representative or help medical professional to implement action in addition when causing problem in addition of medical professional's instruction wherein.As illustrational in above example, for inferential information technology can individually or with the technology for interacting with medical professional by talking to combined use (such as, the response relevant with the free form instruction received is provided to medical professional) to provide a kind of system, this system allows medical professional to perform his/her practical operation more efficiently, easily and/or safely, although realize the requirement that this type of benefit is not technology described herein or any embodiment.
As discussed above, according to some embodiment, Virtual Medical assistant can be configured to perform one or more tasks that can help the medical practice of medical professional.Example tasks includes but not limited to send message (text, Email, voice etc.), arranges meeting, seizure and/or process medical treatment oral account, medical information in access EMR and/or position the information from EHR system and present, prepare and submit order (such as, medicine order, laboratory order, disposal order, diagnostic test order, order of holding a consultation, order etc. of changing the place of examination) to, to be searched for by medical treatment and alarm provides medical decision making support etc.Should be appreciated that Virtual Medical assistant can realize one or any combination in above-mentioned example tasks, or other task do not described clearly in this article, and there is not the requirement that Virtual Medical assistant performs any particular task.
According to some embodiment, the interface that Virtual Medical assistant can serve as EHR system performs with the patient information obtaining medical professional and ask and/or help the medical task that medical professional asks to access EMR.Virtual Medical assistant can keep patient's context across the multiple instructions from medical professional, to promote present to the significant of medical professional and allow Virtual Medical assistant to infer the information relevant with medical professional's instruction.
In this respect, Virtual Medical assistant can serve as EMR door to retrieve patient information for medical professional's examination and/or help to perform one or more medical task, includes but not limited to obtain and presents current patents's list, selection patient for observing, search for the patient of mating with specified rule in more detail and obtaining about any one in the information of selected patient or combine.For selected patient, more detailed information can be obtained via Virtual Medical assistant.Such as, Virtual Medical assistant can present patient's recording chart (or its part) or carry out other patient data of auto correlation EMR, such as current problem or exception list, current medical list, allergy list, current order, patient history notes, such as medical notes, consulting notes, can operationral report, operation, pathology, radiological report, progress record, treat summary, summary of leaving hospital, diagnostic test result, imaging results etc.In this respect, Virtual Medical assistant can be configured to navigate to obtain to given EHR system and independent EMR the patient information that medical professional asks.
As discussed above, some embodiment comprise be configured to help medical professional electronically to order can the Virtual Medical assistant of order items.Such as, Virtual Medical assistant can receive from medical professional the free form instruction comprising the instruction placed an order, and can process this free form instruction with prepare, complete and/or distribute order, its can comprise carry out about order or can order items one or more deduction and/or interact to obtain more information in this respect with medical professional.Virtual Medical assistant can be configured to order fulfillment system interface so that order distributes order once completing.
According to some embodiment, Virtual Medical assistant can be configured to understand that be used for can the order of multiple types of any one or combination in order items, comprise for medical institutions (such as, hospital) the inpatient order of medicine and out-patient's medicine order (such as, prescription), for laboratory work or other test medical response order (such as, MRI, CT scan or various other dispose in any one), to other medical professional (such as, other physician or expert, physiotherapy) order of changing the place of examination, communication order (such as, for for any one order such as stopped in many themes of smoking or dietary advice and so on, sincere advice, the order instructing or train) etc.
As discussed above, according to some embodiment as herein described, Virtual Medical assistant uses medical treatment to understand resource to process the free form instruction received from medical professional, and the NLU/CLU parts that resource comprises being identified at the order of specifying in free form instruction are understood in this medical treatment.NLU/CLU parts can identify the one or more parameters in order, or can identify the information on basis that can be used as determining or obtain the parameter in order.The understanding that resource (such as, the dialogue parts that resource uses are understood in medical treatment) can have the parameter needing the order be designated to generate application type is understood in medical treatment.Such as, medical treatment is understood parts (or other parts of Virtual Medical assistant) and this Virtual Medical assistant can be kept to be configured to the expression of each Order Type carrying out assisting, and it comprises the field for the requirement relevant with sending corresponding order and/or optional each parameter.
If free form instruction is specified completely, be used for can all parameters of order of order items, according to some embodiment, then can be used from the information of prior instructions by Virtual Medical assistant or infer missing parameter from the information of the resource that can be used for Virtual Medical assistant, and/or by obtaining with the dialogue of medical professional.Exemplary parameter for ordering medicine can comprise the title of medicine (such as, commercial medicine or medicine name or generic name), dosage, approach, frequency, duration and instruction (such as, specifying instruction to answer the symptom, health status, disease etc. of ingestion of drugs).Exemplary parameter for disposing can comprise the mark of disposing type and for the position of this disposal and date.To dispose for laboratory or the exemplary parameter of test can comprise and disposing or the mark of type of test, date, frequency (if will repeat) and dispose about laboratory or any special instruction of test.Exemplary parameter for order instruction, sincere advice, guidance, training etc. will by word of mouth or can provide via some reference material (such as, write loose page and maybe will be supplied to other material of patient) and change according to the character of communication order and its.Parameter for subsequent access can comprise the information (such as, it is the access, general physical checkup etc. that will solve the specific purposes of some thing especially) of identification access list type, date and any special instruction.
When order completes, Virtual Medical assistant can generate order and distribute order and fulfil for electronics.As discussed above, based on process free form instruction to have obtained the parameter needed for order, Virtual Medical assistant can test for prescription, laboratory automatically to send with CPOE or other order fulfillment system interface, radiology examination, operation or other medical treatment and/or other plan the order for the treatment of action items.According to some embodiment, Virtual Medical assistant can adopt one or more coded system to promote and place an order with its appropriate format.This type systematic can be used for making term to standardize and/or provide specific indent fulfillment to need for can one or more codes of order items.Such as, the medicine with title " X " can be able to be ordered only by the different title of use or code " Z " in specific indent fulfillment.Coded system can use one or more coding standard (such as, for the R × Norm of medicine, the LOINC etc. for laboratory and diagnosis order), and Virtual Medical assistant can be configured to utilize this type systematic to place an order with correct form before distributing order to suitable order fulfillment system.
As discussed above, according to some embodiment, Virtual Medical assistant can to the free form instruction execution analysis received from medical professional to detect and to be provided for the alarm of the potential conflict relevant with order.This can perform in any suitable manner, discussed above is its some example.Such as, when can order items be medicine time, can check that dosage is to determine it whether between minimum and maximum magnitude and/or can check its form and approach for consistance by Virtual Medical assistant.As another example, can check that nearest laboratory result for patient is to guarantee medicine compatible with it (such as, the cholesterol level of patient).As another example, can check that drug interaction is to guarantee the compatible pharmaceutical (drug-drug interactions) in the current medical list of medicine and the patient ordered.As another example, any allergy compatible (medicine-allergy interacts) in the case history of itself and patient can be guaranteed to medicine inspection.As another example, can check that drug interaction is to evaluate certain drug whether safety (medicine-health status interacts) for the use relevant with medical conditions.
When can order items be dispose time, Virtual Medical assistant can check that whether any compatible pharmaceutical (disposal-drug interaction) that whether this disposal absorb with patient, this disposal are safe (dispose-health interact) for having the patient of given health status, or can detect and dispose any other relevant with given patient and conflict or problem with specifying.Should be appreciated that the conflict about compatibility and/or adaptability can by with any one in the intelligible Order Type of Virtual Medical assistant or combine relevant Virtual Medical assistant and determine, because each side is unrestricted in this.Virtual Medical assistant can perform this type of in any appropriate manner and determine, comprise and use one or more CDS system, it comprises the information about compatibility, medicine and the specific hypersensitive compatibility etc. between the adaptability of dosage and compatibility, medicament forms and method of administration, dissimilar medicine.
Described below is according to the medical professional of some embodiment and many exemplary mutual to illustrate each conception of species relevant with Virtual Medical assistant and technology via mobile device between Virtual Medical assistant.Wire frame in composition graphs 4A-4H describes each example, and it schematically illustrates the Virtual Medical assistant application be arranged on mobile device 401.Fig. 4 A-4H show be applied in mobile device 401 by Virtual Medical assistant display on present to medical professional with the exemplary GUI410 allowing medical professional to utilize medical assistant's function, below in conjunction with Fig. 4 A-4H, its some example is described.
Fig. 4 A illustrates the GUI410 presented on the mobile apparatus by Virtual Medical assistant according to some embodiment.General GUI function reproduces the talk of knocking and speaking in allowing the chat type on mobile device 401 to present.Especially, show from Virtual Medical assistant and the dialogue from medical professional in the dialogue icon on the display of mobile device 401.Also present the loudspeaker icon 413 that medical professional can knock when medical professional wants to say instruction over the display, medical professional can say this instruction with free form.The free form instruction mobile device of saying catches and is received by the Virtual Medical assistant application resided on mobile device.Then can by Virtual Medical assistant by such as providing the free form instruction received to process the free form instruction received via wireless communication unit 406 to one or more Internet resources.
Fig. 4 A illustrates such as can present when medical professional activates Virtual Medical assistant (such as, by starting Virtual Medical assistant application on the mobile apparatus) exemplary introductory and presents.In this example, Virtual Medical assistant applies display dialogue (and can audibly reproduce this dialogue), and its instruction Virtual Medical assistant is ready to by inviting medical professional knock loudspeaker icon and inform that what this medical professional of Virtual Medical assistant feels like doing and help medical professional and provide guidance to it.At first, medical professional may be unfamiliar with the function provided by Virtual Medical assistant, and Virtual Medical assistant application can present the menu that Virtual Medical assistant can help medical professional or represent the example tasks that medical professional performs.For this reason, medical professional can say " what you can do for me? " and responsively, Virtual Medical assistant application can be suitable for the typical free form instruction of process that order Virtual Medical assistant performs associated task or start to perform this generic task and presents many example tasks that Virtual Medical assistant can perform by providing.Should be appreciated that medical professional is not limited to say the same word presented in this example, because Virtual Medical assistant can be configured to have the ability to deal with free form instruction.The menu of example is intended to medical professional and provides the characteristic (flavor) how interacted with Virtual Medical assistant.
The example tasks of presenting to medical professional illustrates in figure 4b, and comprise and making a phone call to the someone in the telephone directory of medical professional, to appointment, recipient sends message (such as, text or Email), request Virtual Medical assistant show the schedule of medical professional, Patient list or for particular patient recording chart, order medicine, obtain oral account (such as, to record the result that patient meets) etc.Given Virtual Medical assistant can select to present Virtual Medical assistant can help to do any one group may task, or this type of " help " function may be at all unrealized, because feature is used for illustrating the possible function for Virtual Medical assistant for this reason.
Fig. 4 C illustrates the result that medical professional asks Virtual Medical assistant " to show my Patient list ".Especially, in response to the free form instruction of medical professional, Virtual Medical assistant presents the list of the patient of medical professional, and it or can keep other position of this information to obtain from EHR system.As discussed above, the alternate manner that Virtual Medical assistant can also have except speech receives instruction from medical professional.Fig. 4 D illustrates Virtual Medical assistant to medical professional such as via the result that the touch ability of display selects patient to respond from Patient list.Especially, medical professional's touch display in the entry for particular patient can be interpreted as the instruction being used for the recording chart of this patient in order to retrieval by Virtual Medical assistant application, and Virtual Medical assistant obtains this recording chart by access EHR system.Should be appreciated that medical professional can use other input mechanism to provide this instruction, such as, by providing free form instruction by saying " for my display [patient's name's] recording chart " or keying in this type of instruction via keyboard.
Medical professional usually has busy schedule, and may arrange the prompting wanting help and/or may need to perform some task in agreement.Intransit medical professional may remember having needed of task, such as further action is taked to patient or the medical worker that is associated with patient, but may have no time to carry out follow-up at given time, or do like this in preset time may be logically not justified.Medical professional can utilize Virtual Medical assistant to help its busy schedule by helping to arrange agreement or patient's access, setting alarm and/or prompting, conflict etc. on management calendar.
Fig. 4 E illustrates the Virtual Medical assistant helping medical professional to set prompting.Especially, in the example shown in Fig. 4 E, medical professional says free form instruction and " reminded me to take further action to John April 12 ", and this free form instruction is received for process by Virtual Medical assistant.Medical professional does not specify the time, but Virtual Medical assistant reasonably can infer that the time is the current year, and sets about setting the prompting on April 12nd, 2013.Virtual Medical assistant can present prompting to medical professional, and confirming by presenting tangible icon or other manual actuation, processing another free form voice commands or both ask medical professional to confirm.Alternatively, Virtual Medical assistant can set the prompting and report details of having finished the work when not requiring the confirmation from medical professional.
Fig. 4 F illustrates medical professional and utilizes dictation capabilities to catch relevant free form of meeting with patient to describe.Such as, medical professional can say " please obtain the oral account for JaneDoe ", and this instruction can be interpreted as medical professional by Virtual Medical assistant meets desirable to provide about with JaneDoe patient, describing of such as patient's access.Virtual Medical assistant can order medical professional to knock loudspeaker and start to say and describe.This free form describes and can be caught by equipment, is received and process the content to identify oral account by Virtual Medical assistant.Reuse family can be provided by identified oral account over the display via Virtual Medical assistant application.According to some embodiment, Virtual Medical assistant can only audio reception by this audio transmission to another system, such as, audio frequency oral account filed so that by the person of transcribing or by the off-line automatic recognition system system of transcribing in batches.According to some embodiment, the oral account (such as, being identified by ASR parts 130) identified is sent to EHR system to be included in the electronic medical record of patient.According to some embodiment, by identify that oral account is supplied to NLU parts and adds this fact to EHR system to extract medical facts with the structure according to database.According to some embodiment, Virtual Medical assistant deducibility is about the information of oral account, and provide this information to fill field in EHR system (such as, Virtual Medical assistant can infer the date from statement " access about Tu. ", and can " please obtain the oral account for JaneDoe " fill patient's name's information by means of reception instruction).
Fig. 4 G and 4H illustrates the exemplary dialogue between Virtual Medical assistant, and wherein, described medical professional utilizes Virtual Medical assistant to order the medicine for patient.As shown in figure 4g, medical professional says free form instruction and " orders the medicine being used for JoePetro ", and it is applied reception via the audio input capabilities of mobile device by Virtual Medical assistant.Then the medical treatment that this free form instruction is supplied to system can be understood resource for process to identify the speech of medical professional and to understand this speech content by the Virtual Medical assistant application on mobile device.In this example, Virtual Medical assistant understands medical professional and wants to order medicine recognizing and need additional information to complete the medical task submitting medicine order to.
In order to start the process obtaining more information, medical Virtual Medical assistant illustrates response: " this is your the medicine order for JoePetro.What medicine? " and present this response to medical professional.In this example, Virtual Medical assistant inquires more information to medical professional and presents to medical professional with by the medicine order of Virtual Medical assistant from the information solicitation of free form instruction acquisition in it is to the response of free form instruction, and it is first primarily of the name of patient and date of birth (Virtual Medical system may be obtained by access EHR system or other medical record system of can be used for Virtual Medical assistant) composition.Medicine order is presented to medical professional allow medical professional to confirm rapidly Virtual Medical assistant understands this instruction identified correct patient, make the process that medical professional feels comfortable.
In the example shown in Fig. 4 G and 4H, in response to the inquiry about medicine, medical professional by saying " medicine name Laxix, dosage is 40mg, and approach is IV, today 3pm start.PLSCONFM." respond.Virtual Medical assistant receives this free form voice commands and processes this speech to have extracted the information needed for medicine order.In this example, Virtual Medical assistant extracts medicine name, dosage, method of administration and time, and this information presented about medicine order is examined for medical professional.Should be appreciated that the vision display that any response provided by Virtual Medical assistant can be reproduced as individually audio frequency or supplement response.Virtual Medical assistant application also presents confirmation icon to medical professional, and medical professional can be confirmed, and medicine order is correct.While medical professional asks to confirm clearly, Virtual Medical assistant automatically etc. can be ready to use in the confirmation of any medical task being wherein confirmed to be suitable and/or be required, therefore promotes perform medical task with less mistake and avoid medical malpractice.Virtual Medical assistant can be configured to ask all the time to confirm, or save the confirmation for certain task, unless medical professional asks to confirm, because each side is unrestricted in this.
If medical professional confirm medicine order be correct (such as, by knocking " confirmation " icon, Virtual Medical assistant can generate to be formatted into and meet target order system (such as, expect CPOE system) medicine order and submit this order to so that by the process of CPOE system to complete medicine order, in example in Fig. 4 G and 4H, medical professional provides information needed in single response.But, if Virtual Medical assistant requires more information from medical professional, then can continue, till having received the information needed for order with the talk of medical professional.In addition, can exchange via the suitable dialogue between medical professional and Virtual Medical assistant and calculate with medical professional other obstacle any identified by Virtual Medical assistant, any problem that the problem of the incompatible aspect of such as drug interaction, dosage or approach or the Virtual Medical assistant relevant with medicine order have.
As discussed above, Virtual Medical assistant can be configured to talk with medical professional by visually or audibly reproducing response (such as, prompting, request, inquiry, alarm, warning etc.).Relative to audibly reproducing response, Virtual Medical assistant is by network or use local resource employing speech synthetic technology to generate the acoustic frequency response that such as can use one or more loudspeaker of the equipment being coupled to trustship Virtual Medical assistant or use independent interface unit to reproduce.Can individually or with eye response combined use acoustic frequency response be provided, or can according to circumstances, environment or medical professional's preference and use one or the other.
Table 1 below illustrates and performs to allow such as when not asking medical professional visually to concentrate on equipment and/or to be used for by medical professional and equipment that Virtual Medical assistant interacts does not comprise the exemplary talk between medical professional and Virtual Medical assistant carrying out when display function or Virtual Medical assistant can not access the display function of equipment exchanging wherein with audio frequency in essence.Especially, this free form instruction can use speech to provide by medical professional, and can use speech synthesis technique and/or pre-recorded speech and reproduce the response from Virtual Medical assistant via audio frequency.This type of audio mode may be preferred in some cases, such as when medical professional visual focus aim at other places time (such as, driving, perform dispose or be also noted that patient etc. while), when the display of the equipment of trustship Virtual Medical assistant make eye response difficulty or have in addition problem or eye response can not time (such as, the interface that medical professional uses does not comprise display capabilities, such as phone incoming call environment).Exemplary talk for ordering medicine can be carried out as follows.
Table 1
Should be appreciated that and also can use eye response (any visual display technologies shown in Fig. 4 A-4H, or any other suitable display technique or form) realize above-mentioned talk and/or any mode that can also have except speech to receive medical professional's input (such as, via keyboard, touch icon etc.), because the example in table 1 only illustrate in some cases may suitably (or favourable) perform one of dialogue with medical professional may mode, and can to use in other cases and/or preferably vision display.
Exemplary talk shown in table 1 illustrates in order to talk understanding with medical professional and to help through the dialogue of medical task and the use of inference technologies that send medicine order.Especially, in many cases, Virtual Medical assistant to medical professional provide response with obtain about medicine order more information (such as, ask the drain message of such as medicament forms and so on, inquiry etc. about special instruction) and/or the alarm medical professional conflict (such as, medicine-allergy alarm, min/max dosage alarm) relevant with medicine order.
In addition, in the exemplary talk in Table 1, Virtual Medical assistant obtains information by the deduction carried out according to previously received instruction and/or the information that obtains due to previously received instruction.Such as, the second medicine order (such as, Levofloxacin) of medical professional does not comprise the name of patient, but Virtual Medical assistant infers identical with for previous order of this patient.
Virtual Medical assistant may be configured with safety practice; any one or combination in such as password protection, speech verification/certification, signature verification/certification etc., to verify and/or to confirm to provide the user of free form instruction to be authorized to perform the one or more medical task of specifying in the free form instruction received from user.Any suitable safety technique can be utilized, because each side is unrestricted in this.
Figure 5 illustrates the illustrated embodiment that can be used to the computer system 500 realizing one or more Virtual Medical assistant technology as herein described.Computer system 500 can comprise one or more processor 510 and one or more non-provisional computer-readable recording medium (such as, storer 520 and one or more non-volatile memory medium 530).Processor 510 can control write to from storer 520 and non-volatile memory device 530 and read data in any suitable manner, because each aspect of the present invention as herein described is unrestricted in this.Processor 510 can be such as the processor on mobile device.
In order to perform function as herein described and/or technology, processor 510 can perform and be stored in one or more computer-readable recording medium (such as, storer 520, storage medium etc.) in one or more instructions, its can serve as store instruction so that the non-provisional computer-readable recording medium performed by processor 510.Computer system 500 also can comprise route data, performs calculating, perform required other processor any, controller or the control module such as I/O function.Such as, the input function that computer system 500 can comprise any number and type to provide data, and can comprise the control device performing I/O function with the output function receiving data and/or can comprise any data and type.
Be identified at (one or more) task of specifying in free form instruction and combine, can by being configured to receive free form instruction, one or more programs of processing this instruction or performing function described herein are in addition stored on one or more computer-readable recording mediums of computer system 500.Especially, certain of Virtual Medical assistant partly or entirely can be embodied as the instruction be stored on one or more computer-readable recording medium.Processor 510 can perform and can be used for any one of this class method of processor by being stored in the local in computer system 500 or by network access or combining.Other software any as herein described, program or instruction also can be stored by computer system 500 and perform.Computer system 500 can represent that Virtual Medical assistant applies the computer system on mounted main process equipment in the above and/or can represent any one that can realize in the above in Internet resources or the computer system combined (such as, form any one in the parts of Virtual Medical assistant or combine or other Internet resources).Computer system 500 can be embodied as a part for stand-alone computer, server, distributed computing system, and connectable to network and can resource in accesses network and/or with other compunications one or more (such as, computing machine way system 500 can be a part for the addressable Internet resources of Virtual Medical assistant) being connected to network.
Term " program " or " software " in this article be used to refer in general sense generation can be used for programming computing machine or other processor realizing embodiment as discussed above various in the computer code of any type or sets of processor-executable instructions.In addition, should be appreciated that according to an aspect, the one or more computer programs performing method disclosed in providing in this article when being performed do not need to reside on single computing machine or processor, but can be distributed in modular fashion in different computing machines or processor to realize disclosed various aspect provided herein.
Processor executable can take many forms, the program module such as performed by one or more computing machine or miscellaneous equipment.Usually, program module comprises the routine, program, object, parts, data structure etc. that perform particular task or realize particular abstract data type.Usually, in various embodiments, can combine or the function of distribution program module according to expecting.
Further, data structure can be stored in one or more non-provisional computer-readable recording medium with other form any.In order to illustrated simple for the purpose of, data structure can be shown for having multiple fields relevant by position in data structure.This type of relation can similarly be realized by the field distribution reservoir for having the position of passing on the relation between field in non-transitory computer readable medium.But, any mechanism suitably can be used to the relation between the information in the field setting up data structure, comprise by use pointer, label or between Data Elements opening relationships other mechanism.
Further, various inventive concept can be presented as one or more process, provide its multiple example.Can sort to the action that the part as each process performs in any appropriate manner.Therefore, can construct wherein according to the embodiment performed an action from shown different order, it can comprise and side by side performs some action, even if show in an illustrative embodiment for continuous action.
The all definition such as defining in this article and use should be understood as its ordinary meaning of the term of control dictionary definition and/or definition.
Should by the phrase " at least one " such as used in the description and in detail in the claims in this article but at least one key element selected in any one or the multiple key element that are understood as when the list with reference to one or more key element in the key element meant from key element is enumerated may not be included in key element list in each key element specifically enumerated at least one, and do not get rid of any combination of the key element in key element list.This definition also allows there is the key element except except the key element of mark concrete in the key element list of phrase " at least one " reference alternatively, no matter is relevant with those key elements specifically identified or irrelevant.Therefore, at least one is as non-limiting example, at least one " in A and B at least one " (or equivalently " in A or B at least one " or equivalently " in A and/or B at least one "), in one embodiment, can be referred at least one, comprise and not existing (and the key element comprised alternatively except B) more than A, a B alternatively; In another embodiment, at least one refers at least one, comprises and not existing (and the key element comprised alternatively except A) more than B, an A alternatively; In another embodiment, at least one refer at least one, alternatively comprise more than an A and at least one, comprise more than a B (and comprising other key element alternatively) etc. alternatively.
Should by as in this article in the present description and claims the phrase "and/or" that uses be understood as mean " any one or both " in the key element that links, namely link ground in some cases and exist and the key element existed dividually in other cases.The multiple key elements listed by "and/or" should be understood in an identical manner, " one or more " in the key element namely linked like this.No matter except the key element identified particularly by "and/or" clause, can there is other key elements alternatively, be relevant to those key elements identified particularly or irrelevant.Therefore, as non-limiting example, when using in combination with the open language such as " to comprise " and so on, can refer in one embodiment only A (comprising the key element except B alternatively) the reference of " A and/or B "; In another embodiment, refer to only B (comprising the key element except A alternatively); In another embodiment, A and B (comprising other key element alternatively) etc. is referred to.
The use itself of the ordinal term such as such as " first ", " second ", " the 3rd " of modifying claim elements in the claims does not comprise any right of priority, preferably or the time sequencing of the action of order or manner of execution of a claim elements compared to another.This type of term is only used as a claim elements with certain title to differentiate (if not having the use of ordinal term) with another key element with same names.
Phrase used herein and term are for purposes of illustration and should not be considered as is restrictive." comprise ", " having ", " comprising ", " relating to " and variant thereof use intention contain the project and addition item listed thereafter.
Describe in detail multiple embodiments of technology described herein, those skilled in the art will be easy to expect various amendment and improvement.This type of amendment and improvement intention are in spirit and scope of the present disclosure.Therefore, aforementioned description is only in an illustrative manner, and is not intended as restriction.Only define this technology by following claim and equivalent thereof.

Claims (63)

1. use Virtual Medical assistant to help a medical professional's method, described Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, and described method comprises:
Free form instruction is received from medical professional;
There is provided described free form instruction for process to help to identify at least one medical task that will perform from described free form instruction;
Described in the forward direction of execution at least one medical task described, medical professional provides at least one first response about described free form instruction; And
The first information is received from described medical professional in response at least one first response described.
2. method as claimed in claim 1, wherein, described free form instruction by the process of natural language understanding parts to be identified at the information being used to indicate the intention by performing at least one medical task described expressed in described free form instruction.
3. method as claimed in claim 2, also comprises the mark obtained at least one obstacle performing at least one medical task described, and wherein, provides at least one first response described to promote to overcome at least one obstacle described to described medical professional.
4. method as claimed in claim 3, wherein, at least one obstacle identified comprises the one or more obstacles being selected from the group be made up of the following:
Perform the mark of the information of omitting from described free form instruction of at least one medical required by task described, relevant with performing at least one medical task described at least one is ambiguous, can not identify at least one medical task described with sufficient determinacy and relevant with at least one medical task described in execution one or morely conflict.
5. method as claimed in claim 4, wherein, comprising from least one medical task described in described free form command identification can the request of order items in order to order.
6. method as claimed in claim 5, wherein, institute's identification request of order items can comprise the order being selected from the group be made up of the following in order to order: medicine order, dispose order, laboratory order, diagnostic test order, arrange order, change the place of examination order and consultation of doctors order.
7. method as claimed in claim 6, wherein, at least one obstacle identified comprises one or more conflict, described one or more conflict is included in and can at least one between order items and the information identified in described free form instruction and/or the patient information that obtains from the electronic medical record be associated with patient conflicts, and wherein, providing at least one first response described to comprise provides about at least one alarm conflicted described to medical professional.
8. method as claimed in claim 7, wherein, what identified the request of order items can comprise medicine order for medicine in order to order, and wherein said one or more institutes identification collision comprises at least one conflict being selected from the group be made up of the following: the drug-drug interactions about medicine, the medicine about medicine-allergy interaction, the dosage conflict about medicine, the administration frequency conflict about medicine and the method for administration conflict about medicine.
9. method as claimed in claim 5, also comprises and to submit in response to receiving the described first information from medical professional for can the order of order items.
10. method as claimed in claim 1, wherein, receive described free form instruction to comprise and receive free form voice commands from medical professional, and wherein provide described free form instruction to comprise, by least one network, described free form voice commands is sent to automatic identification component to identify free form voice commands at least partially for process, and wherein identified free form voice commands be provided to natural language understanding parts with help to identify to perform described at least one medical task.
11. methods as claimed in claim 1, also comprise help perform identify in described free form instruction described at least one medical task.
12. at least one computer-readable mediums, described computer-readable medium stores instruction, described instruction performs the method using Virtual Medical assistant to help medical professional when executed by least one processor, described Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, and described method comprises:
Free form instruction is received from medical professional;
There is provided described free form instruction for process to help to identify at least one medical task that will perform from described free form instruction;
Described in the forward direction of execution at least one medical task described, medical professional provides at least one first response about described free form instruction; And
The first information is received from described medical professional in response at least one first response described.
13. as at least one computer-readable medium of claim 12, wherein, described free form instruction will be performed the information of the intention of at least one medical task described by the process of natural language understanding parts to be identified at being used to indicate of expressing in described free form instruction.
14. as at least one computer-readable medium of claim 13, also comprise the mark obtained at least one obstacle performing at least one medical task described, and wherein, provide at least one first response described to promote to overcome at least one obstacle described to described medical professional.
15. as at least one computer-readable medium of claim 14, and wherein, at least one obstacle identified comprises the one or more obstacles being selected from the group be made up of the following:
Perform the mark of the information of omitting from described free form instruction of at least one medical required by task described, relevant with performing at least one medical task described at least one is ambiguous, can not identify at least one medical task described with sufficient determinacy and relevant with at least one medical task described in execution one or morely conflict.
16. as at least one computer-readable medium of claim 15, and wherein, comprising from least one medical task described in described free form command identification can the request of order items in order to order.
17. as at least one computer-readable recording medium of claim 16, wherein, institute's identification request of order items can comprise the order being selected from the group be made up of the following in order to order: medicine order, dispose order, laboratory order, diagnostic test order, arrange order, change the place of examination order and consultation of doctors order.
18. as at least one computer-readable recording medium of claim 17, wherein, at least one obstacle identified comprises one or more conflict, described one or more conflict is included in and can at least one between order items and the information identified in described free form instruction and/or the patient information that obtains from the electronic medical record be associated with patient conflicts, and wherein, providing at least one first response described to comprise provides about at least one alarm conflicted described to medical professional.
19. as at least one computer-readable recording medium of claim 18, wherein, what identified the request of order items can comprise medicine order for medicine in order to order, and wherein said one or more institutes identification collision comprises at least one conflict being selected from the group be made up of the following: the drug-drug interactions about medicine, the medicine about medicine-allergy interaction, the dosage conflict about medicine, the administration frequency conflict about medicine and the method for administration conflict about medicine.
20. as at least one computer-readable medium of claim 16, also comprises and to submit in response to receiving the described first information from medical professional for can the order of order items.
21. as at least one computer-readable recording medium of claim 12, wherein, receive described free form instruction to comprise and receive free form voice commands from medical professional, and wherein provide described free form instruction to comprise for process: by least one network, described free form voice commands to be sent to automatic identification component to identify free form voice commands at least partially, and wherein identified free form voice commands be provided to natural language understanding parts with help mark to perform described at least one medical task.
22. as at least one computer-readable medium of claim 12, also comprise help to perform identify in described free form instruction described at least one medical task.
23. 1 kinds of main process equipments can accessing at least one network, described main process equipment comprises:
At least one processor, realize the virtual clinical assistant for helping medical professional at least in part, at least one processor described is configured to:
Free form instruction is received from medical professional;
There is provided described free form instruction for process to help to identify at least one medical task that will perform from described free form instruction;
Described in the forward direction of execution at least one medical task described, medical professional provides at least one first response about described free form instruction; And
The first information is received from described medical professional in response at least one first response described.
24. as the main process equipment of claim 23, wherein, described free form instruction by the process of natural language understanding parts to be identified at the information being used to indicate the intention by performing at least one medical task described expressed in described free form instruction.
25. as the main process equipment of claim 24, wherein, at least one processor described is configured to obtain the mark at least one obstacle performing at least one medical task described, and wherein, provide at least one first response described to promote to overcome at least one obstacle described to described medical professional.
26. as the main process equipment of claim 25, and wherein, at least one obstacle identified comprises the one or more obstacles being selected from the group be made up of the following:
Perform the mark of the information of omitting from described free form instruction of at least one medical required by task described, relevant with performing at least one medical task described at least one is ambiguous, can not identify at least one medical task described with sufficient determinacy and relevant with at least one medical task described in execution one or morely conflict.
27. as the main process equipment of claim 26, and wherein, comprising from least one medical task described in described free form command identification can the request of order items in order to order.
28. as the main process equipment of claim 27, wherein, institute's identification request of order items can comprise the order being selected from the group be made up of the following in order to order: medicine order, dispose order, laboratory order, diagnostic test order, arrange order, change the place of examination order and consultation of doctors order.
29. as the main process equipment of claim 28, wherein, at least one obstacle identified comprises one or more conflict, described one or more conflict is included in and can at least one between order items and the information identified in described free form instruction and/or the patient information that obtains from the electronic medical record be associated with patient conflicts, and wherein, at least one processor described is configured to provide about at least one alarm conflicted described to medical professional.
30. as the main process equipment of claim 29, wherein, what identified the request of order items can comprise medicine order for medicine in order to order, and wherein said one or more institutes identification collision comprises at least one conflict being selected from the group be made up of the following: the drug-drug interactions about medicine, the medicine about medicine-allergy interaction, the dosage conflict about medicine, the administration frequency conflict about medicine and the method for administration conflict about medicine.
31. as described in claim 27 main process equipment, wherein, at least one processor described is configured to submit in response to receiving the described first information from medical professional for can the order of order items.
32. as the main process equipment of claim 23, and wherein, at least one processor described is configured to:
Free form voice commands is received from medical professional; And
By at least one network, described free form voice commands is sent to automatic identification component to identify described free form voice commands at least partially, and the free form voice commands wherein, identified be provided to natural language understanding parts with help mark to perform described at least one medical task.
33. as the main process equipment of claim 23, wherein, at least one processor described be configured to help to perform identify in described free form instruction described at least one medical task.
34. 1 kinds of methods using Virtual Medical assistant to help medical professional, described Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, and described method comprises:
Free form instruction is received from medical professional;
There is provided described free form instruction for process to help to identify at least one medical task that will perform from described free form instruction;
Obtain the mark at least one obstacle performing at least one medical task described; And
Infer and overcome described at least some information needed at least one obstacle.
35. as the method for claim 34, wherein, described free form instruction by the process of natural language understanding parts to be identified at the information being used to indicate the intention by performing at least one medical task described expressed in described free form instruction.
36. as the method for claim 35, wherein, described at least some information at least in part according to previously received free form instruction, in response to previously received free form instruction the information obtained, the electronic medical record be associated with patient and/or infer by the medical information resource that at least one network described is accessed.
37. as the method for claim 36, and wherein, at least one obstacle identified comprises the one or more obstacles being selected from the group be made up of the following:
Perform the mark of the information of omitting from described free form instruction of at least one medical required by task described, relevant with performing at least one medical task described at least one is ambiguous, can not identify at least one medical task described with sufficient determinacy and relevant with at least one medical task described in execution one or morely conflict.
38. as the method for claim 37,
Wherein, comprising from least one medical task described in free form instruction identification can the request of order items in order to order, and the request of order items can comprise the order being selected from the group be made up of the following in order to order: medicine order, dispose order, laboratory order, diagnostic test order, arrange order, change the place of examination order and consultation of doctors order.
39. as the method for claim 38, wherein, infers that at least some information comprises that has inferred can at least some information needed for the order of order items, and described method also comprises submission for can the electronic order of order items.
40. as the method for claim 38, wherein, what identified the request of order items can comprise request for ordering medicine in order to order, and wherein, infers that described at least some information comprises at least one that infer in drug dose, the administration frequency of medicine and the method for administration of medicine.
41. as the method for claim 36, wherein, previously received free form instruction comprises the request of the patient information of the observation patient from medical professional, and wherein, infer that at least some information comprises according to the patient information received in response to order and/or infers at least some information according to the electronic medical record be associated with the patient identified in order.
42. as the method for claim 34, wherein, receive described free form instruction to comprise and receive free form voice commands from medical professional, and wherein, there is provided described free form instruction to comprise for process, by least one network, described free form voice commands is sent to automatic voice identification component to identify described free form voice commands at least partially, and the free form voice commands wherein, identified be provided to natural language understanding parts with help mark to perform described at least one medical task.
43. as the method for claim 34, also comprise help to perform identify in described free form instruction described at least one medical task.
44. at least one computer-readable mediums, described computer-readable medium stores instruction, described instruction performs the method using Virtual Medical assistant to help medical professional when executed by least one processor, described Virtual Medical assistant is realized by least one processor of the main process equipment that can be connected at least one network at least in part, and described method comprises:
Free form instruction is received from medical professional;
There is provided described free form instruction for process to help to identify at least one medical task that will perform from described free form instruction;
Obtain the mark at least one obstacle performing at least one medical task described; And
Infer and overcome described at least some information needed at least one obstacle.
45. as at least one computer-readable recording medium of claim 44, wherein, described free form instruction will be performed the information of the intention of at least one medical task described by the process of natural language understanding parts to be identified at being used to indicate of expressing in described free form instruction.
46. as at least one computer-readable recording medium of claim 45, wherein, described at least some information at least in part according to previously received free form instruction, in response to previously received free form instruction the information obtained, the electronic medical record be associated with patient and/or infer by the medical information resource that at least one network described is accessed.
47. as at least one computer-readable medium of claim 46, and wherein, at least one obstacle identified comprises the one or more obstacles being selected from the group be made up of the following:
Perform the mark of the information of omitting from described free form instruction of at least one medical required by task described, relevant with performing at least one medical task described at least one is ambiguous, can not identify at least one medical task described with sufficient determinacy and relevant with at least one medical task described in execution one or morely conflict.
48. as at least one computer-readable recording medium of claim 47, wherein, comprising from least one medical task described in described free form command identification can the request of order items in order to order, and describedly the request of order items can comprise the order being selected from the group be made up of the following in order to order: medicine order, dispose order, laboratory order, diagnostic test order, arrange order, change the place of examination order and consultation of doctors order.
49. as at least one computer-readable recording medium of claim 48, wherein, infer at least some information comprise has inferred described can at least some information needed for the order of order items, described method also comprises submission for can the electronic order of order items.
50. as at least one computer-readable recording medium of claim 48, wherein, what identified the request of order items can comprise request for ordering medicine in order to order, and wherein, infer that described at least some information comprises at least one that infer in drug dose, the administration frequency of medicine and the method for administration of medicine.
51. as at least one computer-readable recording medium of claim 46, wherein, previously received free form instruction comprises the request of the patient information of the observation patient from medical professional, and wherein, infer that at least some information comprises according to the patient information received in response to order and/or infers at least some information according to the electronic medical record be associated with the patient identified in order.
52. as at least one computer-readable recording medium of claim 44, wherein, receive described free form instruction to comprise and receive free form voice commands from medical professional, and wherein, there is provided described free form instruction to comprise for process, by least one network, described free form voice commands is sent to automatic voice identification component to identify described free form voice commands at least partially, and wherein, the free form voice commands identified be provided to natural language understanding parts with help mark to perform described at least one medical task.
53. as at least one computer-readable medium of claim 44, also comprise help to perform identify in described free form instruction described at least one medical task.
54. 1 kinds of main process equipments that can be connected at least one network, described main process equipment comprises:
At least one processor, realize the Virtual Medical assistant for helping medical professional at least in part, at least one processor described is configured to:
Free form instruction is received from medical professional;
There is provided described free form instruction for process to help to identify at least one medical task that will perform from described free form instruction;
Obtain the mark at least one obstacle performing at least one medical task described; And
Infer and overcome described at least some information needed at least one obstacle.
55. as the main process equipment of claim 54, wherein, described free form instruction by the process of natural language understanding parts to be identified at the information being used to indicate the intention by performing at least one medical task described expressed in described free form instruction.
56. as the main process equipment of claim 55, wherein, described at least some information at least in part according to previously received free form instruction, in response to previously received free form instruction the information obtained, the electronic medical record be associated with patient and/or infer by the medical information resource that at least one network described is accessed.
57. as the main process equipment of claim 56, and wherein, at least one obstacle identified comprises the one or more obstacles being selected from the group be made up of the following:
Perform the mark of the information of omitting from described free form instruction of at least one medical required by task described, relevant with performing at least one medical task described at least one is ambiguous, can not identify at least one medical task described with sufficient determinacy and relevant with at least one medical task described in execution one or morely conflict.
58. as the main process equipment of claim 57, wherein, comprising from least one medical task described in described free form command identification can the request of order items in order to order, and describedly the request of order items can comprise the order being selected from the group be made up of the following in order to order: medicine order, dispose order, laboratory order, diagnostic test order, arrange order, change the place of examination order and consultation of doctors order.
59. as the main process equipment of claim 58, and wherein, at least one processor described is configured to: inferred described can at least some information needed for the order of order items; And submit that be used for can the electronic order of order items to.
60. as the main process equipment of claim 58, wherein, what identified the request of order items can comprise request for ordering medicine in order to order, and wherein, at least one processor described is configured to infer at least one in drug dose, the administration frequency of medicine and the method for administration of medicine.
61. as the main process equipment of claim 56, wherein, previously received free form instruction comprises the request of the patient information of the observation patient from medical professional, and wherein, at least one processor described is configured to according to the patient information received in response to order and/or infers at least some information according to the electronic medical record be associated with the patient identified in order.
62. as the main process equipment of claim 54, and wherein, at least one processor described is configured to:
Free form voice commands is received from medical professional; And
By at least one network, described free form voice commands is sent to automatic voice identification component to identify described free form voice commands at least partially, and the free form voice commands wherein, identified be provided to natural language understanding parts with help mark to perform described at least one medical task.
63. as the main process equipment of claim 54, wherein, at least one processor described be configured to help to perform identify in free form instruction described at least one medical task.
CN201480011385.XA 2013-03-01 2014-02-26 virtual medical assistant method and device Active CN105144171B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/782,362 2013-03-01
US13/782,362 US20140249830A1 (en) 2013-03-01 2013-03-01 Virtual medical assistant methods and apparatus
PCT/US2014/018478 WO2014134089A1 (en) 2013-03-01 2014-02-26 Virtual medical assistant methods and apparatus

Publications (2)

Publication Number Publication Date
CN105144171A true CN105144171A (en) 2015-12-09
CN105144171B CN105144171B (en) 2019-01-18

Family

ID=50240094

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480011385.XA Active CN105144171B (en) 2013-03-01 2014-02-26 virtual medical assistant method and device

Country Status (4)

Country Link
US (1) US20140249830A1 (en)
EP (1) EP2946320A1 (en)
CN (1) CN105144171B (en)
WO (1) WO2014134089A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106372432A (en) * 2016-08-31 2017-02-01 杭州逸曜信息技术有限公司 Medicine combination information processing method
CN108245777A (en) * 2017-12-28 2018-07-06 小悠科技(深圳)有限公司 A kind of intelligent Physical Therapeutic Device and its control method
CN109154900A (en) * 2016-03-17 2019-01-04 纽昂斯通讯公司 Dialog processing interaction between two or more virtual assistants
CN109690688A (en) * 2016-09-06 2019-04-26 威里利生命科学有限责任公司 System and method for preventing operation mistake
CN109871440A (en) * 2019-02-25 2019-06-11 京东方科技集团股份有限公司 Intelligent prompt method, device and equipment based on semantic analysis
CN112204669A (en) * 2018-06-26 2021-01-08 国际商业机器公司 Cognitive analysis and disambiguation of electronic medical records for presenting information related to medical plans

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10504622B2 (en) 2013-03-01 2019-12-10 Nuance Communications, Inc. Virtual medical assistant methods and apparatus
US10055681B2 (en) * 2013-10-31 2018-08-21 Verint Americas Inc. Mapping actions and objects to tasks
US20150169285A1 (en) * 2013-12-18 2015-06-18 Microsoft Corporation Intent-based user experience
US20150261920A1 (en) 2014-03-12 2015-09-17 Kenneth BLICK Apparatus, method, and system for cumulative reporting of medical information
US10037492B2 (en) * 2014-04-02 2018-07-31 Lutron Electronics Co., Inc. Selecting a window treatment fabric
KR20160076264A (en) * 2014-12-22 2016-06-30 엘지전자 주식회사 Mobile terminal and contor method thereof
KR101918544B1 (en) * 2015-05-20 2018-11-15 삼성에스디에스 주식회사 Method and apparatus for providing electronic-chart using ontology
USD777784S1 (en) * 2015-08-26 2017-01-31 Google Inc. Display screen with icon
US10867699B2 (en) * 2015-10-05 2020-12-15 Cerner Innovation, Inc. Medication list generator
EP3607478A4 (en) 2017-05-11 2020-11-11 Microsoft Technology Licensing, LLC Assisting psychological cure in automated chatting
US10854335B2 (en) * 2017-06-16 2020-12-01 Htc Corporation Computer aided medical method and medical system for medical prediction
US20190018694A1 (en) * 2017-07-12 2019-01-17 HelixAI, Inc. Virtual laboratory assistant platform
US11316865B2 (en) 2017-08-10 2022-04-26 Nuance Communications, Inc. Ambient cooperative intelligence system and method
US10957427B2 (en) * 2017-08-10 2021-03-23 Nuance Communications, Inc. Automated clinical documentation system and method
EP3704689A4 (en) * 2017-11-05 2021-08-11 Walkme Ltd. Chat-based application interface for automation
WO2019173353A1 (en) 2018-03-05 2019-09-12 Nuance Communications, Inc. System and method for review of automated clinical documentation
US11250382B2 (en) 2018-03-05 2022-02-15 Nuance Communications, Inc. Automated clinical documentation system and method
US11515020B2 (en) 2018-03-05 2022-11-29 Nuance Communications, Inc. Automated clinical documentation system and method
USD877770S1 (en) * 2018-05-04 2020-03-10 Google Llc Display screen with transitional graphical user interface
US11170881B2 (en) 2018-05-18 2021-11-09 General Electric Company Devices and method for a healthcare collaboration space
US11373761B2 (en) 2018-05-18 2022-06-28 General Electric Company Device and methods for machine learning-driven diagnostic testing
US11075007B2 (en) * 2018-07-18 2021-07-27 International Business Machines Corporation Dynamic selection of virtual agents in a mutli-domain expert system
US11270082B2 (en) * 2018-08-20 2022-03-08 Verint Americas Inc. Hybrid natural language understanding
US11031139B2 (en) * 2019-02-08 2021-06-08 General Electric Company Systems and methods for conversational flexible data presentation
US11322263B2 (en) 2019-04-15 2022-05-03 GE Precision Healthcare LLC Systems and methods for collaborative notifications
US11600397B2 (en) * 2019-02-08 2023-03-07 General Electric Company Systems and methods for conversational flexible data presentation
US20200303064A1 (en) * 2019-03-23 2020-09-24 Joseph Alan Epstein System and Method for In-Person Encounters and Assistance for Remote or Noncorporeal Medical Diagnosis and Treatment
US11100933B2 (en) 2019-04-17 2021-08-24 Tempus Labs, Inc. Collaborative artificial intelligence method and system
US11227679B2 (en) 2019-06-14 2022-01-18 Nuance Communications, Inc. Ambient clinical intelligence system and method
US11043207B2 (en) 2019-06-14 2021-06-22 Nuance Communications, Inc. System and method for array data simulation and customized acoustic modeling for ambient ASR
US11216480B2 (en) 2019-06-14 2022-01-04 Nuance Communications, Inc. System and method for querying data points from graph data structures
US11531807B2 (en) 2019-06-28 2022-12-20 Nuance Communications, Inc. System and method for customized text macros
US11670408B2 (en) 2019-09-30 2023-06-06 Nuance Communications, Inc. System and method for review of automated clinical documentation
WO2021209525A1 (en) * 2020-04-16 2021-10-21 Koninklijke Philips N.V. Determining a medical professional having experience relevant to a medical procedure
US11222103B1 (en) 2020-10-29 2022-01-11 Nuance Communications, Inc. Ambient cooperative intelligence system and method
US20230033607A1 (en) * 2021-07-28 2023-02-02 Kevin Carr Handsfree Communication System and Method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007050541A2 (en) * 2005-10-24 2007-05-03 Siemens Medical Solutions Usa, Inc. A system and user interface enabling user order item selection for medical and other fields
US20090187407A1 (en) * 2008-01-18 2009-07-23 Jeffrey Soble System and methods for reporting
US20090192800A1 (en) * 2008-01-24 2009-07-30 Siemens Medical Solutions Usa, Inc. Medical Ontology Based Data & Voice Command Processing System
CN101677770A (en) * 2007-06-20 2010-03-24 高通股份有限公司 Personal virtual assistant
CN102510426A (en) * 2011-11-29 2012-06-20 安徽科大讯飞信息科技股份有限公司 Personal assistant application access method and system
US20120323572A1 (en) * 2011-06-19 2012-12-20 Detlef Koll Document Extension in Dictation-Based Document Generation Workflow

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020040282A1 (en) * 2000-03-22 2002-04-04 Bailey Thomas C. Drug monitoring and alerting system
US20060020465A1 (en) * 2004-07-26 2006-01-26 Cousineau Leo E Ontology based system for data capture and knowledge representation
US20080202978A1 (en) * 2007-02-26 2008-08-28 Doron Salomon Method and Device for a First Aid Container
US20100049756A1 (en) * 2007-11-01 2010-02-25 Siemens Medical Solutions Usa. Inc. Medical Intelligence Framework
US20120173281A1 (en) * 2011-01-05 2012-07-05 Dilella James M Automated data entry and transcription system, especially for generation of medical reports by an attending physician
US9904768B2 (en) * 2011-02-18 2018-02-27 Nuance Communications, Inc. Methods and apparatus for presenting alternative hypotheses for medical facts
WO2013049854A1 (en) * 2011-09-29 2013-04-04 Eclinicalworks, Llc Systems and methods for generating and updating electronic medical records
US9251809B2 (en) * 2012-05-21 2016-02-02 Bruce Reiner Method and apparatus of speech analysis for real-time measurement of stress, fatigue, and uncertainty
WO2014028529A2 (en) * 2012-08-13 2014-02-20 Mmodal Ip Llc Maintaining a discrete data representation that corresponds to information contained in free-form text

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007050541A2 (en) * 2005-10-24 2007-05-03 Siemens Medical Solutions Usa, Inc. A system and user interface enabling user order item selection for medical and other fields
CN101677770A (en) * 2007-06-20 2010-03-24 高通股份有限公司 Personal virtual assistant
US20090187407A1 (en) * 2008-01-18 2009-07-23 Jeffrey Soble System and methods for reporting
US20090192800A1 (en) * 2008-01-24 2009-07-30 Siemens Medical Solutions Usa, Inc. Medical Ontology Based Data & Voice Command Processing System
US20120323572A1 (en) * 2011-06-19 2012-12-20 Detlef Koll Document Extension in Dictation-Based Document Generation Workflow
CN102510426A (en) * 2011-11-29 2012-06-20 安徽科大讯飞信息科技股份有限公司 Personal assistant application access method and system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109154900A (en) * 2016-03-17 2019-01-04 纽昂斯通讯公司 Dialog processing interaction between two or more virtual assistants
CN106372432A (en) * 2016-08-31 2017-02-01 杭州逸曜信息技术有限公司 Medicine combination information processing method
CN109690688A (en) * 2016-09-06 2019-04-26 威里利生命科学有限责任公司 System and method for preventing operation mistake
CN108245777A (en) * 2017-12-28 2018-07-06 小悠科技(深圳)有限公司 A kind of intelligent Physical Therapeutic Device and its control method
CN112204669A (en) * 2018-06-26 2021-01-08 国际商业机器公司 Cognitive analysis and disambiguation of electronic medical records for presenting information related to medical plans
CN109871440A (en) * 2019-02-25 2019-06-11 京东方科技集团股份有限公司 Intelligent prompt method, device and equipment based on semantic analysis
CN109871440B (en) * 2019-02-25 2022-11-11 京东方科技集团股份有限公司 Intelligent prompting method, device and equipment based on semantic analysis

Also Published As

Publication number Publication date
WO2014134089A1 (en) 2014-09-04
EP2946320A1 (en) 2015-11-25
US20140249830A1 (en) 2014-09-04
CN105144171B (en) 2019-01-18

Similar Documents

Publication Publication Date Title
CN105144171A (en) Virtual medical assistant methods and apparatus
US11881302B2 (en) Virtual medical assistant methods and apparatus
US11594222B2 (en) Collaborative artificial intelligence method and system
CN110675951A (en) Intelligent disease diagnosis method and device, computer equipment and readable medium
US20130339030A1 (en) Interactive spoken dialogue interface for collection of structured data
US20090089100A1 (en) Clinical information system
US11531935B2 (en) System and method for implementing a diagnostic software tool
CN111133521B (en) System and method for automatic retrieval and analysis of medical records
Bulla et al. A review of AI based medical assistant chatbot
US20190228850A1 (en) Interactive pill dispensing apparatus and ecosystem for medication management
US20190066822A1 (en) System and method for clinical trial management
WO2021247792A1 (en) Systems and methods for mental health care delivery via artificial intelligence
KR102007036B1 (en) Method to transform clinician order entry
US20240062863A1 (en) System and method for automated voice-based healthcare planning using a supplemental clinician user interface
Ayimdji Tekemetieu et al. From speech acts to assistance acts for cognitive assistance in ambient assisted living: how to nudge cognitively impaired people to act independently
WO2023015287A1 (en) Systems and methods for automated medical data capture and caregiver guidance
US20220344038A1 (en) Virtual medical assistant methods and apparatus
US10600505B2 (en) Intelligent prompting of protocols
Jesse Analysis of voice assistants in eHealth
US20240177846A1 (en) Resource Utilization Based on Patients' Medical Condition Trajectories
US20230044000A1 (en) System and method using ai medication assistant and remote patient monitoring (rpm) devices
Vryoni Chatbots in Healthcare: Towards AI-enabled general diagnosis and medical support
WO2022212743A1 (en) Resource utilization based on patients' medical condition trajectories
Han et al. AscleAI: A LLM-based Clinical Note Management System for Enhancing Clinician Productivity
CN116825305A (en) Multifunctional navigation service method and system for intelligent hospital

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20231023

Address after: Washington State

Patentee after: MICROSOFT TECHNOLOGY LICENSING, LLC

Address before: Massachusetts

Patentee before: Nuance Communications, Inc.

TR01 Transfer of patent right