JPH11197142A - Medical diagnostic system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a medical diagnostic system suitable for improving operability, safety and reliability by displaying the operation contents of respective parts of the system corresponding to a word discriminated by a voice recognizing device on a monitor for observing a diagnostic image by recognizing the word for displaying the operation contents of the respective parts of the system through the voice recognizing device. SOLUTION: The equipment to be operated and the word corresponding to the operation setting of the equipment are previously registered in the voice of an operator 41 to operate the equipment and stored in a voice recognizing device 6 and when the operator 41 inputs any word to a voice input device 5 at the time of operating the equipment, the word is recognized by the voice recognizing device 6 and transmitted to a voice input operation control part 7. Then, that word is decoded and transmitted to an operating command transmitter 8, the operation setting of every equipment is performed, and operation is executed by inputting signals to a controller 9 for every equipment and a controller 9a for an image processor. Then, the word or operation setting contents are displayed on monitors 31 and 52 for observing X-ray images so as not to perform erroneous operation even when the word registered in the voice recognizing device 6 is forgotten or the wrong word is erroneously inputted.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention
The present invention relates to a medical diagnostic apparatus that enables voice operation without touching operation means of a medical diagnostic apparatus such as an X-ray CT apparatus, a magnetic resonance imaging apparatus, and an ultrasonic diagnostic apparatus. The present invention relates to a medical diagnostic device suitable for improving the performance.

[0002]

2. Description of the Related Art In recent years, a therapeutic method using a catheter called interventional radiology (hereinafter referred to as IVR) has been actively performed. this is,
For example, when treating an infarction in a coronary artery, a catheter is inserted from a femoral vein or the like, the catheter is advanced to a target blood vessel under fluoroscopy, and a balloon catheter or atherectomy is performed at a target site. The stenosis is dilated using a catheter.

In such an IVR procedure, a target blood vessel is found under X-ray fluoroscopy using a conventional circulatory organ X-ray inspection apparatus or a general fluoroscopy apparatus, and a catheter is quickly moved to the target blood vessel. Although it is necessary to insert it, it is necessary to move an imaging system, a support mechanism, a patient table, and the like under X-ray fluoroscopy. Such an operation, which was a conventional contrast examination, became more necessary due to the IVR procedure.

However, in the IVR, a target treatment site is determined from an X-ray image obtained at the time of diagnosis, and the IV region is actually determined.
When performing treatment by R, X-ray fluoroscopy becomes even more important as a guide for moving the catheter within the blood vessel and reaching the catheter to the target site. Therefore, the catheter is brought close to the region of interest, and a desired operation is brought to the center of the field of view of the cine camera, or a small operation is performed by slightly shifting the operation. However, due to the IVR procedure, the operator's hand must be kept clean, and therefore, the operator cannot operate the device by touching operation means such as a switch lever and a switch button of the apparatus with his / her own hand. Therefore, request a third party who does not directly touch the subject to perform the switch operation, or cover the switch lever, switch button, etc. with a hygiene maintenance cover, and always keep the operator clean. To keep his hands clean.

However, in the former method in which a third party performs the switch operation on behalf of the operator, the procedure becomes complicated, and it is difficult to achieve the position state as expected by the operator himself, and it takes time for positioning and the like. Further, in the latter method of covering the cover for keeping the hygiene, it takes a lot of trouble and time to mount and replace the cover. In particular, in the IVR procedure, an operation of frequently switching between a large number of switches is required, and the above problem is more remarkable.

In order to solve this problem, Japanese Patent Laid-Open No.
A method of operating by voice disclosed in Japanese Patent No. 229028 has been proposed by the present inventors.

In this method, words corresponding to the device to be operated and the operation content, ie, operation commands, are determined in advance,
This is registered as one's own voice, and the voice is stored in the specific speaker-compatible voice recognition device. When the device is activated and a voice input operation is enabled, the operator inputs an operation command toward the microphone of the voice input device. The voice recognition device recognizes the input operation command, decodes the command with the control device, sets the operation of the device such as the support device, the patient table, and the monitor, sends the control command to each device, and sends the control command to each device. Is to operate. In this way, the surgeon can operate the device without using his hands.

[0008]

In the above-described IVR procedure performed in the prior art, the operation of a table on which a subject is mounted, an arm supporting an image system around the table, or a monitor displaying a photographed image is performed. Is performed by voice input on the condition that the surgeon previously remembers words for operating these. In such a case, the operator had to remember all the words for operating these devices, and there was no provision for suggesting the words if they were forgotten. For this reason, it may take time to grasp the operation state of the apparatus, or an erroneous speech may be erroneously input, which may cause a malfunction.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a medical diagnostic apparatus suitable for improving operability, safety and reliability by solving the above-mentioned problems when performing an operation by voice input.

[0010]

SUMMARY OF THE INVENTION The object of the present invention is to provide a control means for operating each part of the apparatus in response to various commands from an operation means, a sound input apparatus for converting a sound into an electric signal and outputting the signal, and a predetermined object. A voice storage device in which the control means control words are registered, and an output signal of the voice input device and voice data stored in the voice storage device are compared. A voice recognition device for determining which of the above is applicable, and a command conversion transmission device for converting the words determined by the voice recognition device into corresponding control commands, setting the operation of each section of the device, and inputting this to the control means In a medical diagnostic apparatus which operates each section of the apparatus by an output signal of the command conversion transmission device, a word indicating the operation content of each section of the apparatus is registered in the voice storage device, and this word is recognized by speech recognition. Recognized by location it is achieved by displaying the operation contents of the various units of the monitor to observe the diagnostic images corresponding to the word is determined by the speech recognition apparatus of the medical diagnostic apparatus. As described above, according to the present invention, a word for displaying the operation content of each unit of the device is registered in the voice storage device, and the voice is recognized by the voice recognition device, and the voice is displayed on the monitor for observing the diagnostic image of the medical diagnostic device. The operation content of each unit of the device corresponding to the word determined by the recognition device, that is, the “operating device”, “operating state of operating device”, and “operation setting of device that can be input at the current time” Do "now displays information such as words. Thereby, even if the operator forgets the operation words stored in the voice storage device, the operator can grasp the operation contents of each unit displayed on the monitor for observing the diagnostic image of the medical diagnostic device and immediately proceed to the next operation. Words to operate (operation commands)
The operator can continue the operation by inputting the information, and can use only the image observation monitor to see the diagnostic image information and the operation state information of the apparatus, so that the operator does not need to move his / her gaze from the monitor, and the operation becomes easier. Thus, operability, safety, and reliability can be improved.

In addition, the present invention displays the operation contents of each unit of the apparatus on a monitor for observing a diagnostic image of the medical diagnostic apparatus when the speech recognition apparatus recognizes a word indicating the operation contents of each unit of the apparatus. And a display switching means for displaying a diagnostic image on a monitor for observing a diagnostic image of the medical diagnostic apparatus when a word indicating the operation content of each section of the apparatus is not recognized. By providing such display switching means, the operation contents of each unit of the apparatus are displayed on the monitor for observing the diagnostic image of the medical diagnostic apparatus only when necessary, so that the diagnostic image and the operation contents are simultaneously displayed. This makes it possible to display more information on the diagnostic image and the operation contents than in the above, which greatly contributes to the improvement of the image diagnosis and the operation of the apparatus.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 3 shows an overall configuration diagram when the present invention is used in a circulatory organ X-ray inspection apparatus. In the figure, 1
Is a subject (patient), 2 is a table on which the subject is mounted, 3
1 is a monitor for observing an X-ray image as shown in FIG. 2A, and 21 is an image intensifier (hereinafter referred to as I.I.).
I. 2) and a support mechanism for supporting the X-ray tube 23, 2
4 is I. I. 25 and a support mechanism for supporting the X-ray tube 26, 3
Reference numeral 3 denotes an operation device in which switches for operating the above-described support mechanism, table, and the like are arranged, and these are installed in an inspection room. Further, an image processing apparatus 51 for displaying an image on a monitor 52 for observing an X-ray image and storing a captured image.
The remote operation console 3 having a function of operating the support mechanism, the table, and the like is installed in an X-ray shielded operation room at a location different from the inspection room. The operation of each mechanism in this device will be described. This apparatus is mainly used for a contrast examination of a heart, a head, and an abdomen.

[0013] The contrast test is, for example, inserting a catheter into a subject having a heart disease through a femoral vein or the like,
It is advanced while confirming the progress thereof by X-ray fluoroscopy on the television monitor 31 for observing the X-ray image. In particular, in the heart and head, it is difficult to understand a complicated state of blood vessel traveling only by one-way fluoroscopy in order to selectively advance a blood vessel through which a catheter is advanced.

Therefore, by changing the perspective direction and observing from another angle, the traveling of the blood vessel is confirmed. Further, in the case of this apparatus, not only an imaging system using the support unit 21 but also an I.D. I. 25 and X-ray tube 26
Can be obtained.

Further, the support 24 is structured so as to be rotatable in a direction parallel to the body axis of the subject, so that a perspective image at an angle which cannot be obtained by the photographing system of the support 21 is provided. Can be obtained. On the other hand, the table 2 is movable in the body axis direction of the subject and can change the height direction. In this manner, the imaging system can be positioned from multiple directions, and a target blood vessel can be selected from complicated blood vessels. In addition, four switches are used as switches for providing perspective.

This device comprises a voice input device 5, a voice recognition device 6, a voice input operation control device 7, an operation command transmitting device 8, a controller 9 for each device, and a controller 9a for an image processing device. Each device can be operated. The device to be operated and words (operation commands) corresponding to the operation settings of the device are registered in advance by the voice of the operator 41 who operates the device, and the voice recognition device 6 stores the registered device. 41 is the voice input device 5
The speech recognition device 6 recognizes the word and transmits it to the voice input operation control device 7. The voice input operation control device 7 having received the recognized word decodes the word, transmits the word to the operation command transmitting device 8 to set the operation of each device, and transmits this signal to the controller 9 of each device, the image processing device, and the like. An operation is performed by inputting the information to the controller 9a of the apparatus.

By repeatedly performing this method, the operation of the apparatus can be set without using a hand. In this configuration, the present invention is designed to prevent the user from forgetting a word (operation command) registered in the voice recognition device 6 or performing an incorrect operation even if an incorrect word is input. Monitors 31 and 52 for observing the X-ray image
The above-mentioned words and the contents of the operation settings are displayed on the screen, and by referring to these, the above-mentioned problems are addressed.

FIG. 1 shows the contents to be processed by the voice input operation control device 7 and the controller 9a of the image processing device 51 according to the present invention. In FIG. 1, when defining words to be voice-inputted in advance, the screen of the monitor 31 is changed from an “X-ray image display screen” as shown on the left of FIG. 2 to an “operation state display screen” as shown on the right of FIG. Is determined and registered in the voice recognition device 6.

The "operation state setting screen" is a screen that displays the name of the device that is performing the voice input operation, the operation state of the device, and operation setting commands that can be input when the above-mentioned words are input. It is. Here, for example, the word “display the operation state display screen” is “display”.

It is assumed that the surgeon 41 is operating the apparatus by the above-described voice input method, and has forgotten a word to be input during the operation while operating the apparatus. At this time, it is assumed that the screens of the monitors 31 and 52 are “X-ray image display screens”. In this case, processing is performed in the following steps.

(1) The surgeon 41 voice-inputs "display" which is a word "display an operation state display screen" to the voice input device 5 (step 101). (2) The input words are subjected to voice recognition processing by the voice recognition device 6 (step 102). (3) The result is transmitted to the voice input operation control device 7, and the voice input operation control device 7 determines whether or not the recognition result is a word "display an operation state display screen" (step 103). . (4) If the word is “display the operation state display screen”, a signal for switching the image display is transmitted to the operation command transmitting device 8. At this time, the voice input operation control device 7 outputs the information 120 for forming the operation status screen, that is, the “operating device” and the “operating status of the operating device” at the present time.
And information such as “words at which the operation of the apparatus can be input at the present time” is transmitted to the controller 9a of the image processing apparatus 51. At this time, the voice input operation control device 7 holds information indicating that the “operation state display screen” is displayed on the monitor 31 (step 104). (5) If the judgment in step 103 is a word for setting an operation, the word is analyzed, an operation command is sent to the operation command transmitting device 8 (step 114), and the device is operated (step 115). . (6) If it is determined in step 103 that the word is "display the operation state screen", the processing in step 104 is performed, and the operation command transmitting device 8 transmits the information to the controller 9a of the image processing device 51 ( Step 10
5). (7) Based on the information received from the voice input operation control device 7 in (Step 104), the controller 9a of the image processing device 51 determines “operating device”, “operating state of operating device”, and A screen for displaying “setting commands that can be input”, that is, an “operation state display screen” as shown in FIG. 2B is formed, and the monitors 52 and 31 on the remote control console are displayed as “X-ray image display”. From the “screen” to the created “operation state display screen” (step 10
6). (8) The screens of the monitor 52 and the monitor 31 are switched to the “operation state display screen” (step 107). (9) The surgeon 41 looks at the “operation state display screen” displayed on the monitor 31, and at a glance the operation state of the device being operated and words for setting the operation of the device that can be input at that time. You can check. Here, the surgeon 41 inputs the inputtable words displayed on the screen to the voice input device 5 (step 108). (10) The input words are subjected to voice recognition processing by the voice recognition device 6 (step 109). (11) The result is transmitted to the voice input operation control device 7. The voice input operation control device 7 includes a monitor 52 and a monitor 31.
Since the information indicating that the “operation state display screen” is displayed on the two monitors is held after receiving the recognition result, the “operation state display screen” (FIG. The state before switching the screen from b)), that is, “X-ray image display screen” ((a) in FIG. 2)
To the operation command transmitting device 8 (step 110). (12) Then, in the voice input operation control device 7,
The recognition result transmitted from the voice recognition device 6 is analyzed, the operation of the device is set, and the operation is transmitted to the operation command transmitting device 8 (step 114), transmitted to the controller 9 of each device, and the device is operated (step 115). ). (13) In parallel with the process of (12), the operation command transmitting device 8 transmits the command to the controller 9a of the image processing device 51.
(Step 111). (14) The controller 9a of the image processing device 51 receives the signal, and switches the monitor 52 and the monitor 31 from the “operation state display screen” (FIG. 2B) to the “X-ray image display screen”.
Switching to ((a) of FIG. 2) (step 112). (15) The monitor 52 and the monitor 31 are switched from the “operation state display screen” to a screen displaying an X-ray image (step 113).

With the above-described operation, it is possible to switch the monitor screen with a predetermined "word".

Next, a second embodiment will be described. FIG. 4 shows an overall configuration diagram of a circulatory organ X-ray inspection apparatus incorporating the present invention. An image processing device 5 is added to the configuration of the first embodiment shown in FIG.
A monitor screen switching unit 10 is added between the first controller 9a and the remote console 3.

That is, in the second embodiment of the present invention, switching between the "operation state display screen" and the "X-ray image display screen" is performed by a switching signal from the monitor screen switching unit 10 in FIG.

The operation status by voice input is the same as in the first embodiment, and the surgeon 41 is operating the device by the above-described voice input method. Suppose you have forgotten the words to enter. At this time, assuming that the screens of the monitors 31 and 52 are “X-ray image display screens”, in the second embodiment, the processing is performed in the steps shown in FIG. In this case, (Step 10
Steps 1) to (Step 103) are performed in the same manner as in the first embodiment.

(1) If the recognition result is a word for switching to the “operation state display screen”, the voice input operation control device 7 determines “the operating device”, “the operating state of the operating device”, and “ An “operation state display screen” is formed based on information 120 such as “words for setting operation of the apparatus that can be input at the present time”, and a signal for switching the screen is transmitted to the operation command transmission device 8. At this time, the voice input operation control device 7 holds information that the “operation state display screen” is displayed on the monitors 31 and 52 (step 20).
4). (2) When a signal for switching the screen is transmitted to the operation command transmitting device 8, the signal is transmitted to the image processing controller 9a, and the “operation state display screen” signal generated in (Step 204) is converted to the monitor screen switching unit. 10 and the monitor screen switching unit 10 causes the monitor 31 and the monitor 52
Is switched from the "X-ray image display screen" to the "operation state display screen" (step 206). (3) From (Step 107) to (Step 11)
Up to 3), the same processing as in the first embodiment is performed. (4) On the other hand, if the word is for setting an operation, the word is analyzed, an operation command is sent to the operation command transmitting device 8 (step 114), and the device is operated (step 11).
5).

In the first and second embodiments described above, the "X-ray image display screen" and the "operation state display screen" are displayed on the image observation monitor 52 in the remote control room and the image observation monitor 31 in the examination room. Is switched and displayed. However, the present invention is not limited to this, and may be displayed simultaneously on the “X-ray image display screen” and the “operation state display screen” as shown in FIG. In this case, although the image information and the operation state display information to be displayed are limited due to the restriction on the size of the monitor screen, the object of the present invention is achieved. In the above-described embodiment, the case where the present invention is applied to a circulatory organ X-ray inspection apparatus has been described. However, the present invention is not limited to this, and other X-ray diagnostic apparatuses, X-ray CT apparatuses, magnetic resonance imaging apparatuses, It goes without saying that it can be widely used for medical diagnostic devices such as ultrasonic diagnostic devices.

[0028]

As described above, according to the present invention,
When performing an operation by voice input, if the operator cannot recall the words for operating the device or if he or she cannot understand the operation state of the device, a certain word is input by voice and the monitor that displays a diagnostic image displays `` operation By displaying the "status", the status of the device and words to be input at the present time can be confirmed at a glance.

Therefore, the operation time due to the voice input can be shortened, and the operation of the device can be prevented from being erroneously operated.
Reliability can be improved. In addition, since the image information and the operation state information of the apparatus can be viewed using only the image display monitor, the operator does not need to move his / her gaze from the monitor, so that the operation is facilitated.

[Brief description of the drawings]

FIG. 1 is a diagram showing a processing flow according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a display example on an image monitor according to the first and second embodiments of the present invention.

FIG. 3 is an overall configuration diagram when the first embodiment of the present invention is used in a circulatory organ X-ray inspection apparatus.

FIG. 4 is an overall configuration diagram when a second embodiment of the present invention is used in a circulatory organ X-ray inspection apparatus.

FIG. 5 is a diagram showing a processing flow according to a second embodiment of the present invention.

FIG. 6 is a diagram showing a display example on an image monitor according to another embodiment of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 subject 2 table 3 remote console 5 voice input device 6 voice recognition device 7 voice input operation control device 8 operation command transmission device 9 controller of each device 9a controller of image processing device 10 monitor screen switching unit 31 X-ray image Observation monitor 41 Surgeon 51 Image processing device 52 Image observation monitor provided on remote console

Claims (2)

[Claims] A control means for operating each part of the apparatus in response to various commands from an operation means; a voice input device for converting a voice into an electric signal and outputting the signal; and a predetermined word for controlling the control means. A voice storage device to be registered is compared with an output signal of the voice input device and voice data stored in the voice storage device to determine which of the words for controlling the control means corresponds to. A speech recognition device, a command conversion transmission device that converts words determined by the speech recognition device into corresponding control commands, sets the operation of each section of the device, and inputs the operation settings to the control means; In a medical diagnostic apparatus that operates each section of the apparatus with an output signal, words for displaying the operation contents of each section of the apparatus are registered in the voice storage device, and the words are recognized by a voice recognition device, and the medical diagnostic apparatus is recognized. A medical diagnostic apparatus characterized by displaying operation contents of each section of the apparatus corresponding to a word determined by the voice recognition apparatus on a monitor for observing a diagnostic image of the apparatus. 2. When the speech recognition device recognizes a word indicating the operation content of each unit of the device, the operation content of each unit of the device is displayed on a monitor for observing a diagnostic image of the medical diagnostic device. 2. The medical diagnostic apparatus according to claim 1, further comprising display switching means for displaying a diagnostic image on a monitor for observing a diagnostic image of the medical diagnostic apparatus when a word indicating the operation content is not recognized.