JP2015093120A - Ultrasonic diagnostic apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an ultrasonic diagnostic apparatus enabling an operator to easily issue operator guidance while confirming displayed ultrasonic images.SOLUTION: The ultrasonic diagnostic apparatus includes: a display part, an operation part, a detection part and a notification part. The display part displays ultrasonic images generated by sending/receiving ultrasonic waves to/from a subject by an ultrasonic probe. The operation part receives operator guidance from an operator. The detection part detects a preliminary stage of the operator guidance to the operation part during displaying the ultrasonic images. The notification part notifies guidance information for guiding the operator guidance to the operator when the preliminary stage of the operator guidance is detected.

Description

  Embodiments described herein relate generally to an ultrasonic diagnostic apparatus and a program.

  2. Description of the Related Art Conventionally, there is known an ultrasonic diagnostic apparatus that generates an ultrasonic image from a reflected wave signal obtained by scanning a subject with an ultrasonic probe and displays the generated ultrasonic image on a monitor in real time. Setting information (hereinafter referred to as image parameters) related to the operation mode for displaying the ultrasonic image and the generation of the ultrasonic image (hereinafter referred to as an image parameter) is received by receiving an operation instruction from an operator through a console provided with operation keys and a touch panel It can be changed freely on the operator side. For example, the operation modes set / changed by operating instructions of the console include a live display mode in which ultrasonic images are sequentially generated and displayed, and a freeze display mode in which the generated ultrasonic images are freeze-displayed (still display). is there. Similarly, image parameters are related to ultrasonic transmission / reception conditions and image processing conditions, and include the gain of reflected wave signals, the number of rasters, and the number of frames for inter-frame smoothing.

  As described above, when setting / changing the operation mode and the image parameter according to the console operation instruction while confirming the generated ultrasonic image in real time, the operator uses both the monitor on which the ultrasonic image is displayed and the console. Therefore, it was necessary to move the line of sight, and operation instructions could not be performed easily. Even when an operation instruction is given without moving the line of sight to the console, it is necessary to store the operation key arrangement on the console and the touch position of the touch panel, and it is difficult to make an easy operation instruction.

JP 2009-112595 A JP 2011-72746 A

  The problem to be solved by the present invention is to provide an ultrasonic diagnostic apparatus and a program capable of easily giving an operation instruction while confirming a displayed ultrasonic image.

  The ultrasonic diagnostic apparatus according to the embodiment includes a display unit, an operation unit, a detection unit, and a notification unit. The display unit displays an ultrasonic image generated by transmitting / receiving ultrasonic waves to / from the subject with the ultrasonic probe. The operation unit receives an operation instruction from the operator. The detection unit detects a previous stage of an operation instruction to the operation unit during display of the ultrasonic image. The notification unit notifies the operator of guidance information for guiding the operation instruction when the previous stage of the operation instruction is detected.

FIG. 1 is a block diagram showing the configuration of the ultrasonic diagnostic apparatus according to the first embodiment. FIG. 2 is an external view of the ultrasonic diagnostic apparatus according to the first embodiment. FIG. 3 is a diagram illustrating the operation unit. FIG. 4 is a flowchart illustrating an example of the operation of the ultrasonic diagnostic apparatus according to the first embodiment. FIG. 5 is an explanatory diagram for explaining a display screen. FIG. 6 is an explanatory diagram illustrating a display example of the display screen. FIG. 7 is an explanatory diagram illustrating a display example of the display screen. FIG. 8 is an explanatory diagram illustrating a display example of the display screen. FIG. 9 is an explanatory diagram for explaining the operation of the ultrasonic diagnostic apparatus. FIG. 10 is a block diagram illustrating a configuration of an ultrasonic diagnostic apparatus according to the second embodiment. FIG. 11 is an external view of an ultrasonic diagnostic apparatus according to the second embodiment. FIG. 12 is a flowchart illustrating an example of the operation of the ultrasonic diagnostic apparatus according to the second embodiment. FIG. 13 is a flowchart illustrating an example of an operation guide display operation of the ultrasonic diagnostic apparatus according to the third embodiment. FIG. 14 is a block diagram illustrating a configuration of an ultrasonic diagnostic apparatus according to the fourth embodiment.

  Hereinafter, an ultrasonic diagnostic apparatus and a program according to embodiments will be described in detail with reference to the accompanying drawings. In the following description, common constituent elements are given common reference numerals, and redundant description is omitted.

(First embodiment)
FIG. 1 is a block diagram showing a configuration of an ultrasonic diagnostic apparatus 1 according to the first embodiment. As shown in FIG. 1, the ultrasound diagnostic apparatus 1 includes an ultrasound probe 10, an electronic scanning analog unit 20, a display processing unit 30, a control unit 40, an operation unit 50, and a storage unit 60.

  The ultrasonic probe 10 has a plurality of piezoelectric vibrators. The plurality of piezoelectric vibrators generate an ultrasonic pulse based on the drive signal supplied from the pulser 22 of the electronic scanning analog unit 20, receives a reflected wave from the subject, and converts it into an electrical signal. In addition, the ultrasonic probe 10 includes a matching layer provided on the piezoelectric vibrator, a packing material that prevents propagation of ultrasonic waves from the piezoelectric vibrator to the rear, and the like. The ultrasonic probe 10 may be a 1D probe in which a plurality of piezoelectric vibrators are arranged in a row, a 2D probe in which a plurality of piezoelectric vibrators are two-dimensionally arranged, or the like. In addition, the form of the ultrasonic probe 10 includes sector correspondence, linear correspondence, or convex correspondence, and an arbitrary ultrasonic probe 10 may be selected from a plurality of forms.

  The electronic scanning analog unit 20 performs ultrasonic scanning, and includes a preamplifier 21, a pulser 22, a reference signal generator 23, a delay line 24, an adder 25, and a detector 26. The reference signal generator 23, the delay line 24, and the pulsar 22 are configured in a transmission system that transmits ultrasonic pulses to the subject. The preamplifier 21, the delay line 24, the adder 25, and the detector 26 have a receiving system configuration that receives an ultrasonic echo (reflected wave) via the ultrasonic probe 10.

  The reference signal generator 23 generates a reference clock. The generated reference clock signal is output to the delay line 24. The delay line 24 receives a rate pulse at a preset pulse repetition frequency (RPF) and a reference clock, and performs a delay drive signal (trigger pulse) after performing a delay to determine the directivity of the ultrasonic wave. Is generated. The generated delay drive signal is output to the pulser 22. The pulser 22 outputs a drive signal for exciting the piezoelectric vibrator of the ultrasonic probe 10 to the ultrasonic probe 10 in synchronization with the delay drive signal.

  The piezoelectric vibrator of the ultrasonic probe 10 receives the drive signal output from the pulser 22 and vibrates. Thereby, an ultrasonic pulse having a reference clock as a center frequency is periodically generated at a pulse repetition frequency (RPF) and transmitted to the subject.

  The ultrasonic wave transmitted from the ultrasonic probe 10 propagates in the subject and is reflected one after another by a discontinuous surface of acoustic impedance in the middle thereof. The reflected wave due to this reflection is received by the piezoelectric vibrator of the ultrasonic probe 10 and output to the electronic scanning analog unit 20 as an electric signal.

  The electrical signal output from the ultrasonic probe 10 by receiving the reflected wave is input to the reception system of the electronic scanning analog unit 20. The preamplifier 21 amplifies the electrical signal output from the ultrasonic probe 10 and outputs it to the delay line 24. In the delay line 24, the electric signal amplified by the preamplifier 21 is delayed and output to the adder 25. The adder 25 adds the delayed electrical signals to generate one echo signal having reception directivity. The generated echo signal is output to the detector 26. The detector 26 detects the echo signal, extracts the reflection component, logarithmically amplifies the reflection component, and detects the envelope, thereby generating a B-mode image signal representing the tissue in the cross section of the subject.

  The display processing unit 30 performs display processing for displaying an ultrasonic image or the like based on the B-mode image signal, and includes a DSC 31 (digital scan converter), a signal processing unit 32, a D / A converter 33, and a display. 34.

  The B-mode image signal obtained by the ultrasonic scanning by the electronic scanning analog unit 20 is converted into a standard TV scanning image signal by the DSC 31, and is controlled by the control unit 40 via the signal processing unit 32 such as a multiplexer (MPX). After being synthesized with the GUI (Graphical User Interface) image generated below, it is output to the D / A converter 33. The D / A converter 33 converts the image signal output from the D / A converter 33 into an analog signal and outputs it to the display 34. The display device 34 is a monitor such as a liquid crystal display, for example, and displays an image based on the image signal output from the display device 34 on a display screen.

  FIG. 2 is an external view of the ultrasonic diagnostic apparatus 1 according to the first embodiment. As shown in FIG. 2, the display 34 is installed on the upper part of the housing of the ultrasonic diagnostic apparatus 1. The operator can check an ultrasonic image, a GUI image, and the like based on the B-mode image signal displayed on the display 34. An operation unit 50 that receives various operation instructions from the operator is provided below the display unit 34. The operator moves the line of sight immediately below the display screen of the display unit 34 to thereby operate the operation unit 50. The arrangement of operation devices (operation switches, etc.) can be confirmed.

  The control unit 40 controls the entire processing in the ultrasonic diagnostic apparatus 1. Specifically, the control unit 40 indicates an operation mode for displaying an ultrasonic image input from an operator via the operation unit 50, an instruction for setting information (image parameter) related to generation of an ultrasonic image, a storage unit Based on a program (not shown), display data 61, and setting data 62 stored in 60, the operation of each unit during generation and display of an ultrasonic image is controlled.

  The operation unit 50 is a console having an operation device such as an operation switch or a TCS (Touch Command Screen), receives an operation instruction from the operator from the operation device, and outputs the operation instruction to the control unit 40.

  FIG. 3 is a diagram illustrating the operation unit 50, and more specifically, is a diagram illustrating a state in which the operation unit 50 in FIG. As shown in FIG. 3, operation devices such as a TCS 51 and an operation switch 52 are arranged in the operation unit 50. The operation device may include a trackball, a changeover switch, a button switch, a toggle switch, and the like. For example, the operator operates the operation switch 52, touches the operation UI 53 (User Interface) displayed on the TCS 51, and operates the operation switch 52 to which a function linked to the operation UI 53 is assigned. As a result, the operation mode, image parameters, etc. are set. Note that functions are assigned to the operation UI 53 and the operation switch 52 by an operator, a serviceman, or the like.

  The operation instruction from the operator in the operation unit 50 is accepted when a predetermined operation is performed on an operation device such as the TCS 51 and the operation switch 52.

  The control unit 40 receives an operation instruction corresponding to the operation when a predetermined operation is performed on the operation device such as the TCS 51 and the operation switch 52. For example, the controller 40 detects the operator's pressing step by step based on the detection value of the pressure sensor provided in the TCS 51, the operation switch 52, etc., and the controller 40 does not start until the operator presses it with a predetermined pressing force after contact. An operation instruction in the TCS 51 and the operation switch 52 is accepted. Then, the control unit 40 detects operations (contact, pressing operation, etc.) performed for each of the TCS 51 and the operation switch 52 until the operation instruction is received as a stage before the operation instruction.

  More specifically, the control unit 40 detects a touch operation of the TCS 51 before the operation UI 53 of the TCS 51 is pressed as a stage before receiving an operation instruction for the operation UI 53. Thereafter, when an operation of pressing the operation UI 53 with a predetermined pressing force is performed, the control unit 40 receives an operation instruction corresponding to the operation UI 53. Similarly, the control unit 40 detects an operation before pressing the operation switch 52 with a predetermined pressing force as a stage before receiving an operation instruction for the operation switch 52. Thereafter, when an operation of pressing the operation switch 52 with a predetermined pressing force is performed, the control unit 40 receives an operation instruction corresponding to the operation switch 52. In the following description of the present embodiment, the stage before receiving an operation instruction from when the operator touches the TCS 51 and the operation switch 52 until the operator presses down with a predetermined pressing force is before pressing with the predetermined pressing force. Including the pressing operation, the contact with the TCS 51 and the operation switch 52 is assumed.

  The storage unit 60 is an HDD (Hard Disk Drive) or the like, and stores a program executed by the control unit 40, display data 61, setting data 62, and the like. The display data 61 is a GUI image or the like for performing GUI display. The control unit 40 reads the GUI image stored in the display data 61 and performs various GUI displays on the display 34. The setting data 62 stores various settings for each operation device in the operation unit 50 (for example, setting of presence / absence of operation guide display described later). The stored contents of the setting data 62 are set in advance by an operator, a service person, or the like.

  Next, in the first embodiment, the operation of the ultrasonic diagnostic apparatus 1 performed under the control of the control unit 40 and details of the operation when displaying an ultrasonic image on the display 34 will be described. . FIG. 4 is a flowchart illustrating an example of the operation of the ultrasonic diagnostic apparatus 1 according to the first embodiment.

  After starting the display of the ultrasonic image on the display 34, the control unit 40 determines whether or not the operator's contact with the operation device (TCS 51, operation switch 52) in the operation unit 50 is detected (S11). ). When the contact of the operator with the operation device is not detected (S11: NO), the control unit 40 advances the process to S16.

  When the contact of the operator with the operation device is detected (S11: YES), the control unit 40 refers to the stored content of the setting data 62 and the operation device that the operation device touched by the operator displays the operation guide. It is determined whether or not there is (S12). When the operation device that the operator has touched is not the operation device that performs the operation guide display (S12: NO), the control unit 40 advances the process to S16.

  The operation device indicates the operation mode such as the live display mode that sequentially generates and displays the ultrasound image, the freeze display mode that freezes the generated ultrasound image (still display), and the reflected wave signal Some commands specify image parameters such as gain, the number of rasters, and the number of frames for inter-frame smoothing. The operator sets in advance whether or not to display the operation guide for the operation device corresponding to the desired operation mode and image parameter from among these operation devices by operating the operation unit 50 or the like. The contents are stored in the setting data 62. Thereby, for example, a frequently used operation device (in particular, an operation device that is frequently operated while viewing an ultrasonic image) such as freeze display and gain adjustment can be set to display an operation guide.

  When the operation device touched by the operator is an operation device that performs the operation guide display (S12: YES), the control unit 40 reads the GUI image corresponding to the touched operation device from the display data 61 and sends it to the display processing unit 30. An operation guide display is performed to output and display the operation guide of the touched operation device on the display unit 34 as a GUI image (S13). As a result, the operator is notified of the operation guide for the touched operation device.

  FIG. 5 is an explanatory diagram for explaining the display screen G. FIG. As shown in FIG. 5, the display screen G of the display 34 includes an ultrasonic image display area G1 for displaying an ultrasonic image based on a B-mode image signal obtained by ultrasonic scanning, and a parameter display area G2 for displaying various parameters. And an operation guide display area G3 for displaying the operation guide. The GUI image is synthesized so that the operation guide display in S13 is performed in the operation guide display area G3.

  The operator can check the operation guide displayed in the operation guide display area G3 together with the ultrasonic image in the ultrasonic image display area G1 and various parameters in the parameter display area G2 by placing a line of sight on the display 34. Therefore, the operator confirms the operation instruction without moving the line of sight from the display unit 34 to the operation unit 50 by the operation guide displayed in the operation guide display area G3 in the previous stage of the operation instruction on the operation device that has been touched. it can. Therefore, the operator can easily give an operation instruction while confirming the ultrasonic image displayed in the ultrasonic image display area G1.

  6 to 8 are explanatory diagrams for explaining display examples of the display screen G. FIG. As shown in FIG. 6, on the display screen G, an ultrasound image G11 is displayed in the ultrasound image display area G1, and a parameter G21 is displayed in the parameter display area G2. At this time, when an operator touches the gain adjustment key in the operation switch 52, the control unit 40 reads a GUI image for performing an operation guide for the gain adjustment key from the display data 61, and synthesizes it in the operation guide display area G3. An operation guide G31 for the gain adjustment key is displayed in the operation guide display area G3.

  The operation guide G31 may be a name, a function, an operation method, and the like for the operation device. At least one piece of information in the name, function, and operation method is set in advance as a GUI image, and the setting is performed. A GUI image may be read and presented. For example, as shown in FIG. 6, when the operator touches the gain adjustment key of the operation switch 52, the name such as “gain adjustment key”, the function such as “adjusting the gain of the received signal”, and the gain When increasing, an operation method for decreasing the gain may be displayed as the operation guide G31 in the operation guide display area G3. As a result, the operator can confirm the name, function, and operation method of the operation device in the previous stage of the operation instruction on the operated operation device.

  Moreover, about this operation guide G31, based on the operation device which detected the contact of the operator, you may show the position of the operation device. Specifically, an operation guide G31 in which an icon image is added to the position of the operation device touched by the operator is displayed in the operation guide display area G3 on the GUI image schematically showing the arrangement relationship of the operation devices in the operation unit 50. You can do it. For example, as shown in FIG. 7, an operation device image G32 obtained by looking down the operation unit 50 from above, a contact position icon G33 and a finger icon G34 corresponding to the position of a gain adjustment key that is an operation device that has detected the contact of the operator. Is displayed in the operation guide display area G3. Further, as shown in FIG. 8, with respect to the operation device image obtained by looking down the operation unit 50 from above, an operation device image obtained by trimming and enlarging a region corresponding to a gain adjustment key that is an operation device that has detected the contact of the operator. G32a may be used. The operator can easily confirm the position of the operation device with the operation device images G32 and G32a in the previous stage of the operation instruction on the operated operation device.

  FIG. 9 is an explanatory diagram for explaining the operation of the ultrasonic diagnostic apparatus 1. As shown in FIG. 9, in the live display mode, the operator H1 applies the ultrasonic probe 10 to the subject H2, and an ultrasonic image of the subject H2 is displayed on the display 34 in real time. In this live display mode, the operator H1 moves his gaze as much as possible from the ultrasonic image displayed in real time, such as when switching to the freeze display mode in which the ultrasonic image is freeze-displayed (still display) at a desired timing. There are situations where it is not good. In such a situation, when the guide display is not performed, it is necessary to move the line of sight to the operation unit 50 in order to search for an operation device that performs an operation instruction for freeze display. Is detected and the guide display is performed, the operator can find a desired operation device without moving the line of sight to the operation unit 50.

  Returning to FIG. 4, after S13, the control unit 40 determines whether or not an input operation of an operation instruction for pressing the operation device touched by the operator with a predetermined pressing force has been performed (S14). Here, when the input operation of the operation instruction to be pressed with a predetermined pressing force is not performed (S14: NO), the control unit 40 advances the process to S16. When an input operation of an operation instruction to be pressed with a predetermined pressing force is performed (S14: YES), the control unit 40 receives an operation instruction on the operation device (S15), and advances the process to S16.

  Note that the operation instruction received by the control unit 40 in S15 may be different for each stage of the pressing force. For example, two threshold values (threshold value 1 <threshold value 2) are set in advance to determine the pressing force step in two steps, and a pressing force in a range larger than threshold value 1 and smaller than threshold value 2 is applied. It is assumed that an operation instruction for an operation (function) assigned to each operation device is received. When a pressing force larger than the threshold value 2 is applied, it is assumed that an operation instruction for a uniformly set operation (for example, a freeze operation) is accepted for any operation device. Note that the operation that is uniformly set for any operation device may be set for each operation mode. For example, the operation may be a freeze operation in the live display mode and a switching operation to the live display mode in the freeze display mode.

  In S16, the control unit 40 determines whether or not to end the process of displaying the ultrasonic image on the display 34 based on the operation instruction from the operation unit 50, and continues the process (S16: NO). Returns the process to S11.

  In the first embodiment described above, in the operation devices such as the TCS 51 and the operation switch 52, the configuration in which an operation instruction is received when a predetermined pressing force is applied after the operator has contacted is described. The reception of the instruction is not limited to pressing with a predetermined pressing force. For example, in the TCS 51 or the like, an operation instruction corresponding to the operation UI 53 may be received when the operator touches the operation UI 53 continuously for a predetermined time. In this case, the control unit 40 may detect the time until the operator touches the operation UI 53 continuously for a predetermined time as a previous stage of the operation instruction, and performs an operation guide display corresponding to the operation UI 53.

  In particular, in the TCS 51, since the operator touches the plane, it is not possible to obtain a tactile sensation specific to the device on the operation switch 52 or the like, so that the operation UI 53 displayed on the operation switch 52 is directly touched and operated. Can be difficult. However, in the ultrasonic diagnostic apparatus 1, the operability in the TCS 51 is detected by detecting the previous stage of an operation instruction such as an operator touching the operation UI 53 continuously for a predetermined time and displaying the operation guide of the operation UI 53. Can be improved. Therefore, when there are many operation instructions via the TCS 51 in the operation unit 50, it is more effective in terms of improving operability to display the operation guide of the operation UI 53 displayed on the TCS 51.

(Second Embodiment)
In the first embodiment described above, the configuration in which the control unit 40 detects the contact of the operation unit 50 with the operation device (TCS 51, operation switch 52, etc.) is illustrated as a step before the operation instruction in the operation unit 50. In 2nd Embodiment, the structure which detects the case where an operator's finger | toe approaches the operation part 50 vicinity as an operation | movement stage in the operation part 50 is illustrated.

  FIG. 10 is a block diagram showing a configuration of an ultrasonic diagnostic apparatus 1a according to the second embodiment. As illustrated in FIG. 10, the ultrasonic diagnostic apparatus 1 a includes a camera 70 in addition to the configuration exemplified in the ultrasonic diagnostic apparatus 1 a. The camera 70 is a digital camera that captures images at a predetermined frame rate (for example, 15 fps), and outputs the captured images to the control unit 40.

  FIG. 11 is an external view of an ultrasonic diagnostic apparatus 1a according to the second embodiment. As illustrated in FIG. 11, the camera 70 is provided on an upper part of the display 34 and the like, and images the operation unit 50 from above. Therefore, the image captured by the camera 70 is an image obtained by looking down on the operation unit 50 from the top as illustrated in FIG. Therefore, when the operator inputs an operation instruction to the operation unit 50, the operator's finger heading from the outside of the frame to the operation device is imaged by the camera 70 prior to the operation instruction.

  Therefore, the control unit 40 detects a stage before the operator inputs an operation instruction to the operation unit 50 by analyzing the frame (camera image) captured by the camera 70 and detecting the operator's finger. Can do. Specifically, the control unit 40 detects the operator's finger from the shape and color by using a more known image recognition technique for the camera image. For example, when a contour line is detected from a camera image and the color of the image in the contour line is in the skin color range, it is estimated that the region in the contour line is an image of the operator's hand. When the shape of the finger of the hand (thumb, forefinger, middle finger, ring finger, little finger) is confirmed from the contour line of the image recognized as the hand image, it is detected as the operator's finger.

  Next, in the second embodiment, details of the operation of the ultrasonic diagnostic apparatus 1a performed under the control of the control unit 40 and displaying an ultrasonic image on the display 34 will be described. . FIG. 12 is a flowchart illustrating an example of the operation of the ultrasonic diagnostic apparatus 1a according to the second embodiment.

  After starting the display of the ultrasonic image on the display 34, the control unit 40 acquires and analyzes the camera image captured by the camera 70, and detects the operator's finger from the camera image (S21). If the operator's finger is not detected from the camera image (S22: NO), the control unit 40 advances the process to S28.

  When the operator's finger is detected from the camera image (S22: YES), the control unit 40 acquires the position of the operator's finger in the camera image (S23). Specifically, the control unit 40 detects, from the camera image, the position (coordinates) of the index finger that mainly operates the operation device from the operator's fingers detected by the above-described image recognition technology. More specifically, the tip coordinate of the index finger is detected. And the control part 40 makes the operation device nearest to the position of an operator's finger | toe the candidate of the operation device which an operator inputs an operation instruction.

  Next, the control unit 40 refers to the stored content of the setting data 62 to determine whether or not the operation device that is a candidate for the operator to input an operation instruction is an operation device that performs operation guide display (S24). ). When the operation device that is a candidate for the operator to input an operation instruction is not an operation device that performs operation guide display (S24: NO), the control unit 40 advances the process to S28.

  When the operation device that is a candidate for the operator to input an operation instruction is an operation device that performs operation guide display (S24: YES), the control unit 40 displays a GUI image corresponding to the candidate operation device. The data 61 is read out and output to the display processing unit 30, and an operation guide display for displaying the operation guide of the operation device that is a candidate for the operator to input an operation instruction on the display 34 as a GUI image is performed (S 25). Thereby, the operator is notified of the operation guide of the operation device that is a candidate for the operator to input the operation instruction.

  Following S25, the control unit 40 determines whether or not an input operation has been performed in which the operator inputs an operation instruction to the operation device (S26). Here, when the input operation of the operation instruction is not performed (S26: NO), the control unit 40 advances the process to S28. When the input operation of the operation instruction is performed (S26: YES), the control unit 40 receives the operation instruction on the operation device (S27), and advances the process to S28.

  In S28, the control unit 40 determines whether or not to end the process of displaying the ultrasonic image on the display 34 based on the operation instruction from the operation unit 50, and continues the process (S28: NO). Returns the process to S21.

  As in the second embodiment, the detection of the previous stage of the operation instruction in the operation unit 50 is performed by analyzing the camera image of the camera 70 that images the operation unit 50, so that the operator's finger is placed near the operation unit 50. You may detect the case where approaches. As another example of detecting the case where the operator's finger approaches the vicinity of the operation unit 50, the operator's finger immediately above the operation unit 50 may be detected using ultrasonic waves, infrared rays, or the like. Further, the control unit 40 may display a camera image (live image) captured by the camera 70 instead of the operation device images G32 and 32b. In this case, the operator can confirm the finger position of the operator based on the live image of the operation unit 50 captured by the camera 70.

(Third embodiment)
In 3rd Embodiment, the case where an operation guide display is performed based on the detection time after the previous step of the operation instruction in the operation part 50 is detected is illustrated. Specifically, it is an embodiment applicable to the operation guide display of S13 in the first embodiment, the operation guide display of S25 in the second embodiment, and the other configurations are the ultrasonic diagnostic apparatuses 1 and 1a. The same.

  FIG. 13 is a flowchart illustrating an example of an operation guide display operation of the ultrasonic diagnostic apparatus according to the third embodiment. As shown in FIG. 13, after the operation guide display in S13 and S25 is started, the control unit 40 determines whether or not the operation guide display has elapsed for a predetermined time or more (S31).

  When the predetermined time or more has not elapsed (S31: NO), the control unit 40 reads the GUI image of the first operation guide from the display data 61 and displays the operation device for which the previous stage of the operation instruction has been detected. The first operation guide is displayed so that the operation guide of the operation device is displayed on the display unit 34 as a GUI image (S32).

  When the predetermined time or more has elapsed (S31: YES), the control unit 40 reads the GUI image of the second operation guide from the display data 61 for the operation device for which the previous stage of the operation instruction has been detected, and sends it to the display processing unit 30. The second operation guide display is performed to display the operation guide of the operation device on the display unit 34 as a GUI image (S33).

  The first operation guide and the second operation guide may be any information as long as the information is different from each other. For example, any one of the name, function, operation method, and position of the operation device may be used. One operation guide may be used, and the other may be the second operation guide. In addition, the configuration may be such that only the second operation guide is performed without the first operation guide. In this case, the operation guide can be notified when the previous stage of the operation instruction in the operation unit 50 has passed to some extent.

  In this way, the operation guide is notified step by step based on the detection time after the previous stage of the operation instruction in the operation unit 50 is detected, so that the information is provided to the operator more easily. it can. For example, since the operator is in the stage of searching for the operation device within a predetermined time, the operation device images G32 and G32a are displayed to notify the positional relationship of the operation device, and the operation device is displayed when the predetermined time has elapsed. The name, function, operation method, etc. may be notified.

  In the case of detecting the contact of the operator in the operation unit 50, it is determined in S31 whether or not the contact is not less than a predetermined pressing operation below the pressing force for receiving the operation instruction, and the first operation guide. And the structure which switches a 2nd operation guide may be sufficient. In this case, in the weak contact stage where the operator is looking for the operation device, the operation device images G32, G32a, etc. are displayed to notify the positional relationship of the operation device, and the name, function, You may notify the operation method etc.

(Fourth embodiment)
In the first to third embodiments described above, the configuration in which the display is displayed on the display 34 and the operator is notified is illustrated. In the fourth embodiment, a configuration for notifying the operator by voice is exemplified.

  FIG. 14 is a block diagram showing a configuration of an ultrasonic diagnostic apparatus 1b according to the fourth embodiment. As illustrated in FIG. 14, the ultrasonic diagnostic apparatus 1 b includes an audio output unit 80 in addition to the configuration exemplified in the ultrasonic diagnostic apparatus 1 a. The storage unit 60 also stores audio data 63 for performing audio guidance for each operation device. In the illustrated example, the configuration in which the audio output unit 80 is added to the ultrasonic diagnostic apparatus 1a according to the second embodiment is illustrated, but the audio output unit 80 is added to the ultrasonic diagnostic apparatus 1 according to the first embodiment. The structure to add may be sufficient.

  The voice output unit 80 notifies the operator by voice under the control of the control unit 40, and includes a voice synthesizer 81, an amplifier 82, and a speaker 83. The voice synthesizer 81 synthesizes voice based on the voice data 63 under the control of the control unit 40. The amplifier 82 amplifies the voice synthesized by the voice synthesizer 81. The speaker 83 outputs the sound amplified by the amplifier 82.

  Specifically, the control unit 40 reads out the audio data 63 for performing audio guidance of the operation device that has detected the previous stage of the operation instruction during the operation guide display processing steps (S13, S25), and outputs the audio data 63. Output to the output unit 80. In the audio output unit 80, the audio guide stored in the audio data 63 is converted into audio and output from the speaker 83. Thereby, the operator can confirm the operation instruction without moving the line of sight from the display unit 34 to the operation unit 50 by the operation guide output in the sound in the stage before the operation instruction in the operation device.

  In addition, although the 1st-4th embodiment mentioned above may each be implemented separately, you may implement in combination. For example, by combining the first, third, and fourth embodiments, the first operation guide display is performed when the operator touches the operation unit 50, and the first operation guide is displayed when the contact with the operation unit 50 continues for a predetermined time. Two operation guides may be output by voice. In addition, by combining the first and second embodiments, the operator's contact with the TCS 51 is detected, the previous stage of the operation instruction to the operation UI 53 displayed on the TCS 51 is detected, and the camera image captured by the camera 70 Thus, the previous stage of the operation instruction to the operation switch 52 may be detected.

  Further, the layout of the ultrasonic image display area G1, the parameter display area G2, and the operation guide display area G3 illustrated in FIG. 5 is not limited to the illustrated example. In particular, the operation guide display area G3 may be any position that can be easily viewed while confirming the ultrasonic image G11 displayed in the ultrasonic image display area G1. For example, the operation guide display area G3 may be disposed so as to overlap the ultrasonic image display area G1. As described above, when the ultrasonic image display area G1 and the operation guide display area G3 are arranged in an overlapping manner, the operation guide G31 and the operation device images G32 and G32a in the operation guide display area G3 are made semitransparent and superimposed. Also good. In addition, the operation device in the operation unit 50 may be configured to have either one of the TCS 51 and the operation switch 52 or any one of them.

  According to at least one embodiment described above, an operation instruction can be easily performed while confirming the displayed ultrasonic image.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 1, 1a, 1b ... Ultrasonic diagnostic apparatus, 10 ... Ultrasonic probe, 20 ... Electronic scanning analog part, 30 ... Display processing part, 40 ... Control part, 50 ... Operation part, 51 ... TCS, 52 ... Operation switch, 53 ... Operation UI 60 ... Storage unit 61 ... Display data 62 ... Setting data 63 ... Audio data 70 ... Camera 80 ... Audio output unit G ... Display screen G1 ... Ultrasonic image display area G2 ... Parameter Display area, G3 ... operation guide display area, G11 ... ultrasonic image, G21 ... parameter, G31 ... operation guide, G32, G32a ... operation device image, G33 ... contact position icon, G34 ... finger icon, H1 ... operator, H2 ... Subject

Claims (11)

A display unit for displaying an ultrasonic image generated by transmitting / receiving ultrasonic waves to / from a subject with an ultrasonic probe;
An operation unit for receiving an operation instruction from the operator;
A detection unit for detecting a previous stage of an operation instruction to the operation unit during display of the ultrasonic image;
A notification unit for notifying the operator of guidance information for guiding the operation instruction when a previous stage of the operation instruction is detected;
An ultrasonic diagnostic apparatus comprising: For each operation device included in the operation unit, detect a previous stage of an operation instruction to the operation device,
The notification unit notifies the operator of guidance information corresponding to the operation device when a previous stage of an operation instruction to any of the operation devices is detected;
The ultrasonic diagnostic apparatus according to claim 1. The notification unit notifies the operator of guidance information corresponding to the operation device when a previous stage of an operation instruction to the operation device set in advance is detected in the operation device.
The ultrasonic diagnostic apparatus according to claim 2. The notification unit notifies the operator of at least one information among the name, function, operation method, and position of the operation device in which the previous stage of the operation instruction is detected.
The ultrasonic diagnostic apparatus according to claim 2 or 3. The detection unit detects the operator's contact with the operation unit before receiving the operation instruction as a previous stage of the operation instruction.
The ultrasonic diagnostic apparatus as described in any one of Claims 1 thru | or 4. An imaging unit for imaging the operation unit;
The detection unit detects a previous stage of the operation instruction based on detection of the operator's finger included in the image captured by the imaging unit;
The ultrasonic diagnostic apparatus as described in any one of Claims 1 thru | or 4. The notification unit notifies the operator of the guidance information based on a detection time after the previous stage of the operation instruction is detected.
The ultrasonic diagnostic apparatus as described in any one of Claims 1 thru | or 6. The notification unit notifies the operator of first guidance information when a previous stage of the operation instruction is detected, and when the detection time becomes longer than a preset time, Notifying the operator of guidance information,
The ultrasonic diagnostic apparatus according to claim 7. The notification unit displays the guidance information on the display unit to notify the operator;
The ultrasonic diagnostic apparatus as described in any one of Claims 1 thru | or 8. A voice output unit for outputting voice to the operator;
The notification unit is configured to notify the operator by outputting the guidance information to the voice output unit.
The ultrasonic diagnostic apparatus as described in any one of Claims 1 thru | or 8. To a computer of an ultrasonic diagnostic apparatus comprising a display unit that displays an ultrasonic image generated by transmitting and receiving ultrasonic waves to and from a subject with an ultrasonic probe, and an operation unit that receives an operation instruction from an operator,
A detection step of detecting a previous stage of an operation instruction to the operation unit during display of the ultrasonic image;
A notification step of notifying the operator of guidance information for guiding the operation instruction when a previous stage of the operation instruction is detected;
A program that executes