JP6345502B2 - Medical diagnostic imaging equipment - Google Patents

Description

  Embodiments described herein relate generally to a medical image diagnostic apparatus.

  In recent years, with the advancement of technology, a technology called NUI (Natural User Interface) that accepts input to a device or the like from a user's voice or gesture is being studied in a machine or device.

  The NUI is, for example, a document displayed on the information processing apparatus by a user's hand holding operation, or a document displayed on the information processing apparatus by a mouth opening / closing operation indicating an intention display. This is a technology related to the interface such as turning pages.

  By applying such technology to, for example, remote operation of a medical device using a portable information terminal and combining it with the medical device, various operations can be realized without being influenced by the screen size. Benefits can be considered.

  On the other hand, when the NUI is applied to a medical device, the influence of malfunctioning differs depending on the usage scene (normal examination, intraoperative examination, etc.), and thus malfunction prevention is an important factor from the viewpoint of safety.

  Here, a surgical operation system control apparatus using voice recognition, which is based on control state information from a controlled apparatus, and which analyzes the voice information for controlling the controlled apparatus and controls the controlled apparatus The control apparatus regarding is disclosed (refer patent document 1).

JP 2008-216803 A

  By the way, in a device operation using NUI, as a general method for preventing a malfunction, a malfunction is provided by setting a threshold for the degree of coincidence (hereinafter also referred to as reliability) with a reference pattern such as voice or gesture. Prevention is realized.

  However, since the effects of malfunctions in medical care differ depending on the usage scene (normal inspection, intraoperative inspection, etc.), setting a unique reliability threshold value leads to risk to the patient if the impact on safety is high. Sometimes.

  Also, by setting the reliability threshold strictly, preventing malfunctions in scenes that have a high impact on safety will reduce the probability that operations will be performed by NUI, resulting in a significant decrease in operability. There is a concern about letting it happen.

  Therefore, when using the NUI in medical care, there has been a demand for a medical image diagnostic apparatus capable of ensuring operability while realizing an appropriate malfunction prevention function according to the use scene.

The medical image diagnostic apparatus according to the present embodiment includes a detection unit that detects an operation of the operator as input information, and a target that indicates details of an operation performed by the operator on the apparatus based on the detected input information. A reliability determination unit that determines an operation and its reliability , and converted into a risk index indicating a risk to the subject according to at least one of the determined target operation, the reliability, and the operator , and converted A confirmation stage determination unit for determining a confirmation stage for stepwise switching a confirmation method for the operator when performing the target operation based on the risk index, and the operation based on the determined confirmation stage An additional operation determination unit that determines whether or not there is an additional operation to be requested to the operator, and when there is the additional operation based on a result of the determination, the operator selects the additional operation. While displaying the additional operation in order, when the additional operation is not, and an additional operation execution unit for executing the target operation.

1 is a schematic configuration diagram illustrating an example of a schematic configuration of a medical image diagnostic apparatus according to an embodiment. The hardware block diagram which shows the structure of the medical image diagnostic apparatus which concerns on this embodiment. The flowchart which showed the malfunction prevention operation process which acquires the input information from a medical worker using NUI, and displays the additional operation for preventing malfunctioning in the medical image diagnostic apparatus which concerns on this embodiment. Explanatory drawing which showed an example of the table with which the output value of the sensor which comprises a detection part, and target operation which the detection part which concerns on this embodiment stored, and target operation were linked | related. Explanatory drawing which showed an example of the concept which the reliability determination part of the medical image diagnostic apparatus which concerns on this embodiment determines the reliability of object operation. Setting information for explaining an outline in which the confirmation stage determination unit of the medical image diagnostic apparatus according to the present embodiment determines an operation level based on at least one of a use scene, medical worker information, target operation, and reliability FIG. Explanatory drawing when the operation level determination part of the medical image diagnostic apparatus which concerns on this embodiment uses the setting information converted into the risk index about the medical worker applicable to an operator. Explanatory drawing when the operation level determination part of the medical image diagnostic apparatus which concerns on this embodiment uses the setting information converted into the risk index about the use scene. Explanatory drawing when the operation level determination part of the medical image diagnostic apparatus which concerns on this embodiment uses the setting information converted into the risk parameter | index about object operation. Explanatory drawing when the operation level determination part of the medical image diagnostic apparatus which concerns on this embodiment uses the setting information converted into the risk index about reliability. An operation level assignment table in which a confirmation stage determination unit of the medical image diagnostic apparatus according to the present embodiment determines an operation level based on a total of indices converted into risk indices. Explanatory drawing which showed the setting information of the operation level allocation table in which the operation level is set to 1. Explanatory drawing which showed the setting information of the operation level allocation table used as operation level 2. Explanatory drawing which showed the setting information of the operation level allocation table whose operation level is 3. FIG. Explanatory drawing which showed the setting content of the operation level allocation table in which the operation level is set to 4. Explanatory drawing which switches whether the additional operation execution part of the medical image diagnostic apparatus which concerns on this embodiment determined whether target operation was able to be recognized based on the operation level, and waits for selection of additional operation. Explanatory drawing which showed the example of a display which the additional operation execution part of the medical image diagnostic apparatus which concerns on this embodiment displays on a display part. Explanatory drawing which showed the example of a display which the additional operation execution part of the medical image diagnostic apparatus which concerns on this embodiment displays on a display part. Explanatory drawing which illustrated selection of the candidate of the operation level 3 on the display part by the additional operation execution part of the medical image diagnostic apparatus which concerns on this embodiment Explanatory drawing explaining the content of each mode when the operation level determination part of the medical image diagnostic apparatus which concerns on 2nd Embodiment is provided with the several determination mode.

(First embodiment)
Hereinafter, the medical image diagnostic apparatus 100 according to the first embodiment will be described with reference to the accompanying drawings.

  FIG. 1 is a schematic configuration diagram illustrating an example of a schematic configuration of a medical image diagnostic apparatus 100 according to the present embodiment.

  As shown in FIG. 1, the medical image diagnostic apparatus 100 according to the present embodiment includes a detection unit 110, an input information acquisition unit 115, a reliability determination unit 120, a detection unit-operation storage unit 125, an operation level determination unit (confirmation stage). A determination unit) 130, an operation level setting storage unit 135, a scene acquisition unit 140, an operator information acquisition unit 145, an additional operation determination unit 150, an additional operation execution unit 155, and the like.

  The detection unit 110 detects an operator's operation as input information. For example, the detection unit 110 detects voice, movement, touch gesture, line of sight, position, biological signal, and the like as input information as the types of movements of medical personnel (operators) such as doctors and nurses. Yes.

  The input information acquisition unit 115 acquires the detected input information. For example, the voice or operation detected by the detection unit 110 is acquired as input information.

  Based on the acquired input information, the reliability determination unit 120 determines a target operation indicating the content of an operation performed by the medical staff on the device and the reliability thereof.

  The detection unit-operation storage unit 125 stores a table in which output values detected by the detection unit 110 are associated with target operations. The reliability determination unit 120 searches the table stored in the detection unit-operation storage unit 125, and determines the target operation and its reliability based on the output value of the detection unit 110 and the target operation described in the table. It comes to decide.

  Based on at least one of the target operation, the reliability, and the medical worker determined by the reliability determining unit 120, the operation level determination unit 130 performs a step-by-step confirmation method for the medical worker when performing the target operation. The operation level (confirmation stage) for switching is determined.

  Here, the operation level means a confirmation stage for stepwise switching the confirmation method to the medical staff when the subject apparatus executes the target operation. For example, an element that requires strictness in the confirmation method may be included in the operation level, and the risk level of the subject regarding the target operation may be included in the element.

  The operation level setting storage unit 135 stores information for the operation level determination unit 130 to determine the operation level. The operation level determination unit 130 can determine the operation level based on at least one of the target operation, the reliability, and the medical staff by referring to the information stored in the operation level setting storage unit 135.

  The scene acquisition unit 140 acquires information for determining a scene in which a medical worker uses the device for medical practice (hereinafter also referred to as a use scene), and displays the scene in use. It is specified (determined). In this case, when the scene acquisition unit 140 determines the scene being used, the operation level determination unit 130 causes the determined scene to be used, the operation target and the reliability determined by the reliability determination unit 120. The operating level can be determined based on at least one of the medical personnel.

  The operator information acquisition unit 145 acquires medical worker information (operator information) indicating a role in a medical practice related to a medical worker. The operation level determination unit 130 determines the operation level based on at least one of the medical worker based on the medical worker information acquired by the operator information acquisition unit 145, the target operation determined by the reliability determination unit 120, and the reliability. Can also be determined.

  Further, the operation level determination unit 130 refers to the information stored in the operation level setting storage unit 135, and determines the scene, operation target, operator, and reliability determined by the scene acquisition unit 140 as the operation level. The operation level may be determined on the basis of at least one of the converted risk indices, each of which is converted into a risk index indicating the risk to the subject in the contents.

  Based on the determined operation level (confirmation stage), the additional operation determination unit 150 determines whether or not there is an additional operation to be requested from the medical staff.

  Based on the result of the determination, the additional operation execution unit 155 displays the additional operation to cause the medical worker to select the additional operation when there is an additional operation, and when there is no additional operation, the target operation Is supposed to run. Based on the determination result, the additional operation execution unit 155 determines that there is an additional operation. When the selection of the additional operation to be executed is received from the displayed additional operations, the additional operation execution unit 155 executes the received additional operation. can do.

  FIG. 2 is a hardware block diagram illustrating a configuration of the medical image diagnostic apparatus 100 according to the present embodiment.

  As shown in FIG. 2, the medical image diagnostic apparatus 100 according to the present embodiment includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a network interface unit 104, an operation unit. 105, a display unit 106, a storage unit 107, an internal bus 108, and the like.

  The CPU 101 can realize the functions of various programs by loading various programs stored in the ROM 102 into the RAM 103 and expanding the programs. The RAM 103 is used as a work area (working memory). The ROM 102 stores various programs. Various programs stored in the ROM 102 include programs for realizing functions such as the detection unit 110 to the additional operation execution unit 155 shown in FIG.

  The network interface unit 104 is an interface unit for communicating with an external device via a network (not shown).

  The operation unit 105 is an input device for inputting information on a medical worker such as a doctor or an examination engineer or inputting a usage scene in the medical image diagnostic apparatus 100. Specifically, the operation unit 105 includes a keyboard and a mouse.

  The display unit 106 is configured as a display unit that displays the content input by the operation unit 105 or displays information registered in the medical image diagnostic apparatus 100. The display unit 106 includes a liquid crystal display, a monitor, and the like.

  The storage unit 107 is a storage unit that constitutes a storage memory, and includes a RAM, a hard disk, and the like. In the present embodiment, the storage unit 107 constitutes, for example, a detection unit-operation storage unit 125 and an operation level setting storage unit 135.

  As described above, in the present embodiment, the medical image diagnostic apparatus 100 can realize the functions of the medical image diagnostic apparatus 100 illustrated in FIG. 2 by executing the program stored in the ROM 102. ing.

(Malfunction prevention processing)
Next, the operation of the malfunction prevention process in the medical image diagnostic apparatus 100 according to the present embodiment will be described with reference to FIGS.

  FIG. 3 is a flowchart illustrating a malfunction prevention operation process for acquiring input information from a medical staff using the NUI and displaying an additional operation for preventing malfunction in the medical image diagnostic apparatus 100 according to the present embodiment. It is. In FIG. 3, reference numerals with numerals added to S indicate steps in the flowchart.

  First, the medical image diagnostic apparatus 100 according to the present embodiment acquires various types of information for determining an operation level (confirmation stage) regarding an operation for a target operation (step ST001).

  For example, the scene acquisition unit 140 uses the detection unit 110 and the operation unit 105 to determine a scene in which a medical worker is using his / her device for a medical practice (that is, a usage scene). Information is acquired, and the scene in use is specified (determined).

  Specifically, the scene acquisition unit 140 uses a microphone as the detection unit 110 to identify a use scene from the content of the most recent conversation, or uses a camera as the detection unit 110 to analyze the use scene by motion analysis. Identify. As described above, the medical image diagnostic apparatus 100 acquires a use scene by using the scene acquisition unit 140.

  Further, the operator information acquisition unit 145 uses the detection unit 110 and the operation unit 105 to acquire medical worker information (operator information) indicating a role in a medical practice related to a medical worker.

  Specifically, the operator information acquisition unit 145 recognizes a speaker by a voice pattern using a microphone as the detection unit 110 or identifies an individual by face authentication using a camera as the detection unit 110. To obtain operator information. Further, the operator information acquisition unit 145 may acquire the name of the doctor or the name of the laboratory technician directly by the operation unit 105.

  As described above, the medical image diagnostic apparatus 100 acquires, as various information, information for specifying a scene (use scene) in which the medical worker uses the apparatus for medical practice in the scene acquisition unit 140. Then, the use scene in use is specified. In addition, medical image diagnostic apparatus 100 acquires medical worker information indicating a role in a medical practice related to a medical worker in operator information acquisition unit 145 (step ST001).

  Next, the detection unit 110 of the medical image diagnostic apparatus 100 detects the operation of the medical staff as input information (ST003). For example, the detection unit 110 detects voice, movement, touch gesture, line of sight, position, biological signal, and the like as input information as movements of medical staff such as doctors and nurses.

  For example, the voice can be acquired by a microphone, and not only a voice of a medical worker but also a purposely generated sound such as a sound of hitting a bed can be acquired. Further, not only the case where the content of the sound is specified but also the case where the presence / absence of the sound and the volume are determined are included. The motion can be acquired by a camera or a sensor used for operation, and the motion of the entire body, the motion of the arm, the motion of the fingertip, and the like can be acquired. As the type of sensor, a gyro sensor or an acceleration sensor can be used.

  The touch gesture can acquire handwritten character input by a sensor provided on the touch panel. The line of sight can be obtained by recording the movement of the human eyeball called an eye tracker or by examining the movement of the eye. The position can be acquired by a camera, a sensor used for operation, or a GPS (Global Positioning System). In addition, the biosignal can be obtained as a myoelectric signal, an electroencephalogram, or the like by a biosensor provided to a medical worker.

  In the following, since any input information is processed in the same manner, a case where voice and operation are acquired as input information will be mainly described.

  The input information acquisition unit 115 of the medical image diagnostic apparatus 100 acquires the input information detected by the detection unit 110 (step ST005). For example, the voice or operation detected by the detection unit 110 is acquired as input information.

  The reliability determination unit 120 of the medical image diagnostic apparatus 100 is a target indicating the content of an operation performed by the medical worker on the medical image diagnostic apparatus 100 (self apparatus) based on the input information acquired by the input information acquisition unit 115. The operation and its reliability are determined (step ST007).

  In this case, for example, the reliability determination unit 120 searches the detection unit-operation storage unit 125 and determines the target operation and its reliability from the table in which the output value detected by the detection unit 110 and the target operation are associated with each other. Can be determined.

  FIG. 4 is an explanatory diagram illustrating an example of a table stored in the detection unit-operation storage unit 125 according to the present embodiment and associated with the output values of the sensors constituting the detection unit 110 and the target operation.

  As illustrated in FIG. 4, the detection unit-operation storage unit 125 stores a table in which the output value detected by the detection unit 110 and the target operation are associated with each other.

  In the example of FIG. 4A, the reliability determination unit 120 searches the table of the detection unit-operation storage unit 125 and, for example, obtains a voice output “B mode” from a medical worker, the target operation Then, the function of the medical image diagnostic apparatus 100 is determined to be “switch to B mode”. In addition, when the voice determination “Gain Up” is acquired from the medical staff, the reliability determination unit 120 determines “Gain is incremented by one” as the target operation.

  In the example of FIG. 4B, the reliability determination unit 120 searches the table of the detection unit-operation storage unit 125, and, for example, from the operation of the medical worker, the arm is determined by the operation (gesture) indicating the trajectory of the skeleton point. When the sensor detects an action of jumping up, the action (gesture) is used to determine that “Gain is raised by one scale”.

  In the example of FIG. 4C, the operation of the hand by the medical worker is shown, and the reliability determination unit 120 searches the table of the detection unit-operation storage unit 125, for example, the medical worker on the touch panel The touch gesture to be performed is image-analyzed, and the target operation is determined to be “Gain up one scale” based on the hand movement of the medical staff.

  As described above, the reliability determination unit 120 of the medical image diagnostic apparatus 100 according to the present embodiment searches the table stored in the detection unit-operation storage unit 125 to obtain the output value of the detection unit 110 and the target operation. Based on this, the target operation can be determined.

  FIG. 5 is an explanatory diagram illustrating an example of a concept in which the reliability determination unit 120 of the medical image diagnostic apparatus 100 according to the present embodiment determines the reliability of the target operation.

  As illustrated in FIG. 5, when the reliability determination unit 120 determines the reliability of the target operation, the likelihood when determining the target operation can be set as the reliability. In addition, the reliability in this embodiment means the general term of the value showing the likelihood of the determined target operation at the same time as determining the target operation.

  For example, when the detection unit 110 acquires the voice of a medical worker, the sound volume threshold value is determined based on the sound volume data based on the sound volume of the sound data, and the reliability can be calculated from the difference from the threshold value. Moreover, when the voice of a medical worker is acquired, it is converted into character data by voice recognition, and the reliability of voice recognition can be used as the reliability of the target operation. Furthermore, when the position coordinate of the skeleton point of the medical worker is acquired in the detection unit 110, the target operation is determined by pattern matching using the position locus (movement locus) of the skeleton point, and the skeleton point extraction is performed. The reliability can be set as the reliability of the target operation. In the present embodiment, the calculation method for calculating the reliability is not limited at all.

  In this embodiment, when there are a plurality of candidates for the target operation, the operation with the highest reliability is automatically extracted. However, the target operation with the second or higher reliability is also considered. May be.

  Next, the operation level determination unit 130 of the medical image diagnostic apparatus 100 according to the present embodiment uses the use scene determined by the scene acquisition unit 140, the operation target and reliability determined by the reliability determination unit 120, and the medical staff Based on at least one of the information regarding the operator level, the operator level (confirmation stage) is determined (step ST009).

  The operation level determination unit 130 is based on at least one of the medical worker based on the medical worker information acquired by the operator information acquisition unit 145, the target operation determined by the reliability determination unit 120, and the reliability. The operation level may be determined.

  FIG. 6 shows an outline in which the operation level determination unit 130 of the medical image diagnostic apparatus 100 according to the present embodiment determines the operation level based on at least one of a use scene, medical worker information, target operation, and reliability. It is explanatory drawing of the setting information demonstrated.

  As shown in FIG. 6, this setting information explanatory diagram includes columns for items and contents. In the item column, there are items of an operator, a use scene, an operation target, and a reliability, and the corresponding contents are described.

  For example, in the explanatory diagram shown in FIG. 6, it is described that the operator is a main examiner among medical workers. It is described that the usage scene is an intraoperative examination (puncture positioning scan). It is described that the operation target is the B mode. It is described that the reliability is 70%.

  For the B mode (operation target) performed by the medical worker (main examiner), for example, the operation level determination unit 130 determines the operation level as 5 based on the setting information illustrated in FIG. Thus, in this setting information, for example, an operation level can be assigned in advance for each combination that may be selected.

  In addition, the operation level determination unit 130 searches the information stored in the operation level setting storage unit 135, and uses scenes, operation targets, operators, and reliability determined by the scene acquisition unit 140, for example, the contents of the operation May be converted into risk indicators each indicating a risk to the subject, and the operation level may be determined based on at least one of the converted risk indicators.

  FIG. 7 is an explanatory diagram when the operation level determination unit 130 of the medical image diagnostic apparatus 100 according to the present embodiment uses setting information converted into a risk index for a medical worker corresponding to the operator.

  As shown in FIG. 7, the medical staff corresponding to the operator has been converted into a risk index, and the operation level determination unit 130 uses the converted risk index when determining the operation level. Yes. In FIG. 7, for example, the operator is classified into a doctor, a laboratory technician, and other three, and the risk index is shown.

  FIG. 8 is an explanatory diagram when the operation level determination unit 130 of the medical image diagnostic apparatus 100 according to the present embodiment uses setting information converted into a risk index for a use scene.

  As shown in FIG. 8, the operation in the usage scene is converted into a risk index, and the operation level determination unit 130 uses the converted risk index when determining the operation level. In FIG. 8, for example, the usage index is divided into three types: a normal examination, an intraoperative examination (puncture positioning scan), and an intraoperative examination (echo-guided puncture), and the risk index is shown. In addition, as a use scene, you may make it provide classification | category, such as during an operation and a general examination.

  FIG. 9 is an explanatory diagram when the operation level determination unit 130 of the medical image diagnostic apparatus 100 according to the present embodiment uses setting information converted into a risk index for a target operation.

  As shown in FIG. 9, the target operation is converted into a risk index, and the operation level determination unit 130 uses the converted risk index when determining the operation level. In FIG. 9, for example, the risk index is shown by classifying the operation target into three parts: image turning or display content switching, parameter adjustment, angio arm operation, bed operation, or exposure operation.

  FIG. 10 is an explanatory diagram when the operation level determination unit 130 of the medical image diagnostic apparatus 100 according to the present embodiment uses setting information converted into a risk index for reliability.

  As shown in FIG. 10, the reliability is converted into a risk index, and the operation level determination unit 130 uses the converted risk index when determining the operation level. In FIG. 10, for example, the risk index is shown by classifying the reliability into three categories of 80 to 100 (%), 50 to 80 (less than) (%), and 0 to 50 (less than) (%). .

  FIG. 11 is an operation level assignment table in which the operation level determination unit 130 of the medical image diagnostic apparatus 100 according to the present embodiment determines the operation level based on the total of the indices converted into risk indices.

  As shown in FIG. 11, in the operation level assignment table of FIG. 11, the operation level is determined by comprehensively judging from the respective risk indicators corresponding to the use scene, the operation target, the operator, and the reliability. It has become.

  For example, in the operation level assignment table shown in FIG. 11, the operation level is assigned to 1 when the sum of the risk indices is 4 or 5. Further, when the sum of the risk indices is 6 or 7, the operation level is assigned to 2. When the sum of the risk indices is 8, the operation level is assigned to 3. When the sum of the risk indices is 9 or 10, the operation level is assigned to 4. When the sum of the risk indices is 11 or 12, the operation level is assigned to 5.

  As a result, the operation level determination unit 130 can determine the operation level by comprehensively judging from the risk index corresponding to the use scene, the operation target, the operator, and the reliability.

  FIG. 12 is an explanatory diagram showing setting information of the operation level assignment table in which the operation level is 1.

  As shown in FIG. 12, when the operator is a doctor, the risk index is 1. When the usage scene is a normal inspection, the risk index is 1. When the operation content is the B mode, the risk index is 2. When the reliability is 80%, the risk index is 1. In this case, the total risk index is 5, and the overall operation level is 1.

  FIG. 13 is an explanatory diagram showing setting information of an operation level assignment table with an operation level of 2.

  As shown in FIG. 13, when the operator is a doctor, the risk index is 1. When the usage scene is an intraoperative examination (puncture positioning scan), the risk index is 2. When the operation content is the B mode, the risk index is 2. When the reliability is 80%, the risk index is 1. In this case, the total risk index is 6, and the overall operation level is 2.

  FIG. 14 is an explanatory diagram showing setting information of an operation level assignment table with an operation level of 3.

  As shown in FIG. 14, when the operator is a doctor, the risk index is 1. If the usage scene is an intraoperative examination (puncture under echo guide), the risk index is 3. When the operation content is a contrast mode as an example of parameter adjustment, the risk index is 2. When the reliability is 50%, the risk index is 2. In this case, the total risk index is 8, and the total operation level is 3.

  FIG. 15 is an explanatory diagram showing setting information of an operation level assignment table with an operation level of 4.

  As shown in FIG. 15, when the operator is a laboratory technician, the risk index is 2. If the usage scene is an intraoperative examination (puncture under echo guide), the risk index is 3. When the operation content is a gain adjustment screen as an example of switching display content, the risk index is 1. When the reliability is 30%, the risk index is 3. In this case, the total risk index is 9, and the overall operation level is 4.

  Next, the additional operation determination unit 150 of the medical image diagnostic apparatus 100 according to the present embodiment determines whether or not the target operation has been recognized based on the determined operation level (step ST011 in FIG. 3).

  FIG. 16 shows display contents for the additional operation execution unit 155 of the medical image diagnostic apparatus 100 according to the present embodiment to determine whether the target operation has been recognized based on the operation level and to wait for selection of the additional operation. It is explanatory drawing which switches.

  As shown in FIG. 16, this explanatory diagram has columns for operation level, content of additional operation, switching of display content, and execution of target operation.

  For example, when the operation level is 5, this corresponds to the case where the input information by NUI is not recognizable or the risk index determined by the operation level determination unit 130 is high, and the additional operation execution unit 155 adds This indicates that nothing is executed for the operation and the target operation. In this case, since the display content is not switched, the display content switching field also states that nothing is executed.

  Further, when the operation level is 4, for example, it is described that the transition is made so that the candidate selection screen is displayed in the column of the content of the additional operation. The display content switching field describes that a candidate screen transition button is displayed. In addition, the execution column of the target operation describes that the target operation is not executed.

  In addition, when the operation level is 3, for example, it is described that a candidate selection message is displayed in the column of the content of the additional operation. The display content switching field describes that a candidate selection screen is displayed. In addition, the execution column of the target operation describes that the target operation is not executed.

  Further, when the operation level is 2, for example, it is described that a confirmation for executing the target operation (confirmation of operation execution) is displayed in the column of the content of the additional operation. The display content switching field describes that a confirmation screen is displayed. In addition, the execution column of the target operation describes that the target operation is not executed.

  Further, when the operation level is 1, for example, in the column of the content of the additional operation, it is described that the additional operation is not executed. The display content switching field describes that a display screen when the target operation is executed (display screen when the operation is executed) is displayed. Further, the execution of the target operation is described in the execution column of the target operation. In this case, the process for confirming the additional operation of the medical staff is unnecessary, and the target operation is directly executed.

  For example, in step ST003 of FIG. 3, when the medical worker pronounces “bee mode”, the additional operation determination unit 150 determines whether or not the “bee mode” based on the voice of the medical worker can be recognized as the target operation. Is determined (step ST011).

  Based on the determination result of the additional operation determination unit 150, when the “bee mode” by voice cannot be recognized as the target operation (NO in step ST011), it corresponds to the operation level “5”. The execution unit 155 can notify that the recognition has failed (step ST013), and can prompt the health care professional to pronounce the operation content again (“bee mode”).

  Specifically, the additional operation execution unit 155 displays on the display unit 106 that “the voice could not be recognized” or displays on the display unit 106 that “please pronounce again”. be able to.

  On the other hand, if the “bee mode” by voice can be recognized as the target operation based on the determination result (YES in step ST011), whether or not there is an additional operation corresponding to the operation level for the medical staff. Is determined (step ST015).

  When it is determined that the additional operation corresponding to the operation level is not necessary (NO in step ST017), the additional operation execution unit 155 corresponds to the operation level “1” (FIG. 16), and directly executes the target operation. (Step ST019), the malfunction prevention operation process is terminated. For example, when the “BEE mode” is recognized with high accuracy at the operation level, the “B mode” can be directly executed without requiring an additional operation.

  On the other hand, when it is determined that an additional operation corresponding to the operation level is necessary (YES in step ST017), the operation level corresponds to “2” to “4” (FIG. 16), and the additional operation execution unit 155 In order to cause the medical staff to select an additional operation to be requested, the additional operation is displayed on the display unit 106 and the selection of the additional operation is awaited (step ST021).

  The additional operation execution unit 155 receives selection of an additional operation to be executed from the displayed additional operations (YES in step ST023), and executes the received additional operation (step ST025).

  17 and 18 are explanatory diagrams illustrating display examples displayed on the display unit 106 by the additional operation execution unit 155 of the medical image diagnostic apparatus according to the present embodiment.

  FIG. 17A shows a case where the operation level is “5”, and nothing is executed for the addition operation and the target operation, so that the display content is not switched. Therefore, the display unit 106 of the medical image diagnostic apparatus 100 has no change in the display content. Note that the notification of unrecognizable in step ST013 may be displayed.

  FIG. 17B shows a case where the operation level is “4”, and the transition to the candidate selection screen is shown as the content of the additional operation. For this reason, in FIG. 17B, a candidate screen transition button is displayed.

  FIG. 17C shows a case where the operation level is “3”, and indicates that a candidate for the target operation is selected as the content of the additional operation. For this reason, in FIG. 17C, a candidate selection screen is displayed.

  FIG. 18D illustrates a case where the operation level is “2”, and indicates that confirmation for executing the target operation is performed as the content of the additional operation. For this reason, in FIG. 18D, a screen for confirming the execution of the operation is displayed.

  FIG. 18E shows a case where the operation level is “1”, and shows that the target operation is executed as the content of the additional operation. Therefore, in FIG. 18E, a screen indicating execution of the target operation is displayed.

  Note that the display examples illustrated in FIGS. 17 and 18 are merely examples, and for example, the number of additional operations may be appropriately assigned according to the number of candidates.

  In step ST023 of FIG. 3, for example, the selection of the additional operation corresponding to the operation level “2” to “4” illustrated in FIGS. 17 and 18 is received, and the additional operation execution unit 155 executes the additional operation. At the same time (step ST025), the target operation (for example, B mode) is executed (step ST019), and the malfunction prevention operation process is terminated.

  FIG. 19 is an explanatory diagram illustrating selection of operation level 3 candidates on the display unit 106 by the additional operation execution unit 155 of the medical image diagnostic apparatus according to the present embodiment.

  As shown in FIG. 19, in FIG. 19A, when the “M mode” is sensed by the sensor constituting the detection unit 110 of the medical image diagnostic apparatus 100, the additional operation execution unit 155 displays the additional operation execution unit 155 in FIG. ), A selection of candidates for operation level 3 is displayed, and a selection of an additional operation from the medical staff is awaited (step ST021).

  For example, the additional operation execution unit 155 may receive “No. 2” indicating “M mode” using the operation unit 105 by an operation of a medical worker, or use the detection unit 110 to perform “2”. ”Or“ No. 2 ”may be recognized, and“ M mode ”may be selected as shown in FIG. Further, “2” indicating “M mode” can also be selected by a sensor constituting the detection unit 110 using gestures or image analysis.

  As described above, the medical image diagnostic apparatus 100 according to the present embodiment acquires a medical worker's operation as input information, and performs a target operation (for example, the medical image diagnostic apparatus 100 performs based on the acquired input information). , B mode or M mode) and its reliability. Further, the medical image diagnostic apparatus 100 is an operation level for stepwise switching the confirmation method to the medical staff when executing the target operation based on at least one of the determined target operation, reliability, and operator. (Confirmation stage) is determined, and it is determined whether or not there is an additional operation to be requested to the medical staff.

  Thereby, when there is an additional operation based on the determination result, the medical image diagnostic apparatus 100 according to the present embodiment displays the additional operation to cause the medical staff to select the additional operation. If there is no, the target operation can be executed directly.

  As described above, in the medical image diagnostic apparatus 100 according to the present embodiment, the operability is improved by adding a few additional operations to the operations of the medical staff while executing an appropriate malfunction prevention function. Can be secured.

(Second Embodiment)
In the first embodiment, the operation level determination unit 130 of the medical image diagnostic apparatus 100 executes the target operation based on the target operation determined by the reliability determination unit 120 and at least one of the reliability and the medical staff. The operation level for switching the confirmation method to the health care worker step by step was decided.

  In the second embodiment, the operation level determination unit 130 is provided with a determination mode according to the situation when the target operation is executed. The second embodiment can be realized with the same configuration as the first embodiment, and the function of the operation level determination unit 130 of the first embodiment includes an emergency mode (early execution mode) and a safety mode. At least one determination mode such as (careful execution mode) is provided.

  In the second embodiment, for example, when there is a need to execute an operation target early, an emergency mode for determining an operation level so that the number of additional operations is reduced at the operation level (confirmation stage), and an operation When it is necessary to execute the object carefully, at least one mode of the safety mode is provided to determine the operation level so that the number of additional operations is increased at the operation level.

  The operation level determination unit 130 according to the second embodiment presets each parameter (for example, operator, use scene, operation target, and reliability) for determining the operation level, and sets the mode using the NUI. The mode can be easily switched by operating or operating the operation unit 105. In addition, each piece of information regarding the determination mode can be stored in the operation level setting storage unit 135.

  For example, a medical worker can apply the determination mode to the operation level determination unit 130 using the detection unit 110 or the operator information acquisition unit 145, and flexibly change the operation level determined by the operation level determination unit 130. can do.

  Specifically, the medical staff can easily change the determination of the operation level by setting or changing the determination mode by voice, such as “emergency mode” or “safety mode”. In addition, the medical staff can change the determination of the operation level by using the operation unit 105 to set or change the determination mode of “emergency mode” or “safety mode”.

  FIG. 20 is an explanatory diagram illustrating the contents of each mode when the operation level determination unit 130 of the medical image diagnostic apparatus according to the second embodiment includes a plurality of determination modes.

  As illustrated in FIG. 20, the operation level determination unit 130 according to the second embodiment includes, for example, three modes of an emergency mode, a safety mode, and a doctor A mode as determination modes. .

  In the emergency mode illustrated in FIG. 20, the operation level determination unit 130 of the first embodiment indicates that the risk index and the operation level are lowered. In this case, it is possible to set the number of additional operations for the medical staff to be reduced by lowering the risk index and the operation level. Thereby, the operation level determination unit 130 according to the second embodiment is effective when the target operation needs to be executed immediately.

  Moreover, in the safety mode shown in FIG. 20, it has shown that the operation level determination part 130 of 1st Embodiment raises a risk parameter | index and an operation level. In this case, by increasing the risk index and the operation level, it is possible to set so that the number of additional operations for the medical staff increases. Thereby, the operation level determination part 130 which concerns on 2nd Embodiment is effective when it is necessary to perform a test | inspection and a treatment more carefully.

  Further, the doctor A mode shown in FIG. 20 indicates that the doctor (for example, doctor A) sets the risk index and the operation level described in the first embodiment to favorite values in advance. In this case, a favorite value of the doctor A is assigned according to the examination and treatment, and an additional operation can be selected in accordance with the doctor A's intention.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

  Further, in the embodiment of the present invention, each step of the flowchart shows an example of processing that is performed in time series in the order described. The process to be executed is also included.

100 medical image diagnostic apparatus 101 CPU
102 ROM
103 RAM
104 network interface unit 105 operation unit 106 display unit 107 storage unit 108 internal bus 110 detection unit 115 input information acquisition unit 120 reliability determination unit 125 detection unit-operation storage unit 130 operation level determination unit (confirmation stage determination unit)
135 Operation level setting storage unit 140 Scene acquisition unit 145 Operator information acquisition unit 150 Additional operation determination unit 155 Additional operation execution unit

Claims (8)

A detection unit for detecting an operation of the operator as input information;
Based on the detected input information, a reliability determination unit that determines the target operation indicating the content of the operation performed on the device by the operator and the reliability thereof;
When the target operation, the reliability, and the operator are each converted into a risk index indicating a risk to the subject according to the determined target operation, and the target operation is executed based on the converted risk index A confirmation stage determination unit for determining a confirmation stage for switching the confirmation method to the operator in stages;
Based on the determined confirmation step, an additional operation determination unit that determines whether there is an additional operation to be requested to the operator;
Based on the result of the determination, when there is the additional operation, the additional operation is displayed to allow the operator to select the additional operation, and when there is no additional operation, the target operation is executed. An additional operation execution unit to perform,
A medical image diagnostic apparatus comprising: The additional operation execution unit includes:
The received additional operation is executed when it is determined that there is the additional operation based on the result of the determination and a selection of an additional operation to be executed is received from the displayed additional operations. The medical image diagnostic apparatus described in 1. Further comprising a scene acquisition unit for acquiring information for determining a scene in which the operator is using his / her device for medical practice, and determining the scene in use;
The confirmation stage determination unit
The confirmation step is determined based on at least one of the scene being used determined by the scene acquisition unit, the target operation and the reliability determined by the reliability determination unit, and the operator. Item 3. The medical image diagnostic apparatus according to Item 1 or 2. An operator information acquisition unit that acquires operator information indicating a role in the medical practice related to the operator;
The confirmation stage determination unit
The confirmation step is determined based on at least one of the operator based on the operator information acquired by the operator information acquisition unit, the target operation determined by the reliability determination unit, and the reliability. Item 4. The medical image diagnostic apparatus according to any one of Items 1 to 3. A detection unit that stores a table in which an output value of the detection unit and the target operation are associated with each other; an operation storage unit;
The reliability determination unit includes:
The table stored in the detection unit-operation storage unit is searched, and the target operation and its reliability are determined based on the output value of the detection unit described in the table and the target operation. The medical image diagnostic apparatus according to any one of 1 to 4. A confirmation stage setting storage unit for storing information for determining the confirmation stage;
The confirmation stage determination unit
The information stored in the confirmation stage setting storage unit is searched, and the confirmation stage is determined based on at least one of the target operation, the reliability, and the operator. The medical image diagnostic apparatus described in 1. A confirmation stage setting storage unit for storing information for determining the confirmation stage;
The confirmation stage determination unit
The information stored in the confirmation stage setting storage unit is searched, and the scene used, the target operation , the operator, and the reliability determined by the scene acquisition unit are detected in the contents of the operation. The medical image diagnostic apparatus according to claim 3, wherein the medical image diagnosis apparatus converts each of the risk indices into a risk index indicating a risk to the specimen, and determines the confirmation step based on at least one of the converted risk indices. An early execution mode for determining the confirmation stage so that the number of the additional operations is reduced in the confirmation stage, and a careful execution mode for determining the confirmation stage so that the number of the additional operations is increased in the confirmation stage. Prepared,
The confirmation stage determination unit
If there is a need to execute the target operation at an early stage, the confirmation step is determined so that the number of additional operations is reduced in the confirmation step,
The medical check according to any one of claims 1 to 7, wherein when it is necessary to carefully perform the target operation , the confirmation step is determined so that the number of the additional operations is increased in the confirmation step. Diagnostic imaging device.

Images