JP5225648B2 - Ultrasonic image display system - Google Patents

Description

  The present invention relates to an ultrasonic image display system, and more particularly to an ultrasonic image display system configured so that both an examiner and a subject can observe the same ultrasonic image.

  In the case of ultrasonic diagnosis in medical care, an examiner (doctor, laboratory technician) often gives various explanations while showing an ultrasonic image to a subject (patient or the like). In that case, it is generally difficult for the subject lying on the bed to observe the main display of the ultrasonic diagnostic apparatus. If the main display is directed toward the subject, this makes it difficult for the examiner to observe the ultrasound image. If the same display is shared, this problem inevitably occurs. In particular, the examiner or the subject sometimes wants to explain or ask questions while pointing to the position on the ultrasonic image. In such a case, the conventional system configuration is inconvenient. Patent Document 1 discloses an ultrasonic diagnostic system including a display for an examiner and a display for a subject. Patent Document 2 discloses that two displays are supported above a bed by one arm.

JP 2007-68816 A JP-A-8-66354

  In the system described in Patent Document 1 above, each of the examiner and the subject can observe the ultrasonic image at a close distance, but the portion indicated by the subject on the ultrasonic diagnostic image is accurately transmitted to the examiner. There is no mechanism to do this. This may be sufficient if the subject is in a position to receive explanations from the examiner. However, the subject may ask questions or give opinions to the examiner regarding the ultrasonic diagnosis results. Then, a mechanism for accurately transmitting the examinee's intention (for example, a region of interest) to the examiner is required. Alternatively, it is desired to construct an operation environment that can positively reflect the needs and intentions of the subject in the ultrasonic diagnosis or the image display operation within the allowable range.

  An object of the present invention is to provide an ultrasonic image display system in which a subject himself can input in relation to an ultrasonic image.

  Another object of the present invention is to provide an ultrasonic image display system capable of facilitating communication (dialogue) between a subject and an examiner.

  The present invention relates to a transducer for transmitting / receiving ultrasound to / from a subject on a bed, and an ultrasound image forming unit for forming an ultrasound image based on a reception signal obtained by transmitting / receiving the ultrasound. And a display image for the examiner including the ultrasonic image and a display image for the subject that is the same image as the display image for the examiner or a partially different display image and includes the ultrasonic image. A display image processing unit; an inspector display for displaying the inspector display image; a subject display for displaying the subject display image; and the subject display image on the bed. A subject user interface unit provided with a subject input device for inputting information by the subject, wherein the display image processing unit is input from the subject input device. The subject input information is displayed on the inspector display image and the subject table. Executing the subject input information reflecting process for reflecting the image, an ultrasound image display system, characterized in that.

  According to the above configuration, the subject on the bed can observe the ultrasound image close-up via the display for the subject in the user interface (UI) unit for the subject, and the UI for the subject. It becomes possible to input information (subject input information) regarding the ultrasonic image using the input device for the subject in the unit. The subject input information includes position information that designates a position on the ultrasonic image. In this case, the subject can point to a specific part on the ultrasonic image and accurately transmit it to the examiner. Therefore, dialogue or communication between the two can be promoted. According to the said structure, a test subject can be made to participate actively in an ultrasonic diagnosis, and an understanding of the person can be improved. Therefore, it is possible to obtain an advantage that mutual trust between the examiner and the subject can be enhanced. In addition to specifying coordinates, frame input during image playback, adjustment of playback speed, adjustment to adapt brightness or contrast to your own preferences, and 3D image formation Such as changing the viewpoint, mainly for the convenience of image observation.

  The inspector display image and the subject display image may be completely the same or may be partially different. For example, attribute information may be included in the former display image, and such attribute information may be deleted from the latter image. Basically, the same ultrasound image is included in each display image, but an ultrasound image having exceptionally different contents may be included as long as the diagnosis target part is the same. The ultrasonic image may be a two-dimensional tomographic image or a three-dimensional image.

  Preferably, an inspector input device for an inspector to input inspector input information regarding the display image for the inspector is included, and the display image processing unit is inspector input information input from the inspector input device. Is applied to the inspector display image and the inspected person display image. According to this configuration, it is possible to share a display image in which mutual inputs are reflected.

  Preferably, the inspected person input information and the inspector input information are position information for specifying a position on the ultrasonic image. It is desirable that the coordinate information is input by touching the image with a finger.

  Preferably, the display image processing unit displays the subject marker representing the positional information input as the subject input information in the subject input information reflection processing, the display image for the examiner and the subject. In the inspector input information reflection process, the inspector marker representing the position information input as the inspector input information is combined with the inspector display image and the inspector display image. . According to this configuration, it is possible to grasp the part indicated by the other party as the marker position or movement locus on the ultrasonic image.

  Preferably, the display image processing unit changes the display mode of the subject marker and the examiner marker. According to this configuration, confusion between markers can be prevented.

  Preferably, the inspector input device and the inspector display constitute an inspector user interface unit, and the inspector user interface unit and the inspector user interface unit are arranged on the bed. A positioning mechanism for holding the examiner above is provided. Preferably, the two UI parts are held back to back. According to this configuration, the conversation can be performed in a format close to meeting.

  The inspector display may be a main display mounted on the apparatus main body. In this case, the inspector input device may be an operation panel. Preferably, the inspector display and the subject display are flat panel displays, and the inspector input and the subject input are joined or embedded on the screen of the flat panel display. A transparent touch sensor (touch sensor panel). According to this configuration, it is easy to specify a specific part on the ultrasonic image. Here, the ultrasonic image is a moving image or a still image, and may be a reproduced image.

  As described above, according to the present invention, the intention of the subject can be respected as a party in ultrasonic diagnosis. Alternatively, according to the present invention, communication between the examinee and the examiner can be promoted.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described with reference to the drawings.

  FIG. 1 shows a preferred embodiment of an ultrasonic image display system according to the present invention, and FIG. 1 is a block diagram showing the overall configuration thereof.

  The probe 10 is an ultrasonic probe that is used in contact with the surface of a living body or is inserted into a body cavity. In the present embodiment, the probe 10 has a 1D array transducer in which a plurality of vibration elements are arranged one-dimensionally. An ultrasonic beam is formed by the array transducer, and the ultrasonic beam is electronically scanned. As the electronic scanning method, electronic linear scanning, electronic sector scanning, and the like are known. A 2D array transducer may be provided for the probe 10 so that an ultrasonic beam is scanned two-dimensionally to form a three-dimensional echo data capturing space.

  The transmission / reception unit 12 functions as a transmission beamformer and a reception beamformer. That is, at the time of transmission, a plurality of transmission signals are supplied from the transmission / reception unit 12 to the array transducer. As a result, a transmission beam is formed. The reflected wave reflected in the living body is received by the array transducer, and a plurality of reception signals are output from the array transducer to the transmission / reception unit 12. In the transmission / reception unit 12, a phasing addition process is performed on a plurality of reception signals. The received signal (beam data) after the phasing addition is output to the signal processing unit 14.

  The signal processing unit 14 applies various types of signal processing such as logarithmic compression processing and detection processing to the beam data, and outputs the processed beam data as a result to the image forming unit 16. In this embodiment, the image forming unit 16 is configured by a digital scan converter (DSC). That is, it has a function of forming a two-dimensional tomographic image (B-mode image) from a plurality of beam data.

  The image memory 17 is configured as a cine memory in this embodiment, and images of a plurality of frames are stored on the image memory 17 in chronological order. An image before coordinate conversion may be stored, or an image after coordinate conversion may be stored. In the image reproduction mode, the image of each frame stored on the image memory 17 is read out sequentially. In the real-time mode, the image memory 17 always stores images for a plurality of frames going back a certain time from the present. The image memory 17 generally has a ring buffer structure.

  The display processing unit 18 executes a process of adding attribute information to the image data or adding a graphic image. In the present embodiment, the first marker for specifying the coordinates input by the examiner with respect to the ultrasonic image and the second marker for expressing the coordinates input by the examinee are combined. A display image is formed by the composition processing. The image data is output to the main display 34.

  The main display 34 is configured by a CRT or a flat panel display in the present embodiment. On the main display 34, the display image formed by the display processing unit 18 is displayed. In the present embodiment, the sub display 36 is constituted by a liquid crystal display, and an operation menu image or the like is displayed on the sub display 36.

  In the present embodiment, display image data output from the display processing unit 18 is also output to the first UI unit 19 and the second UI unit 20. Here, the first UI unit 19 is a user interface unit for an examiner, and the second UI unit 20 is a user interface unit for a subject. In the present embodiment, the first UI unit 19 includes a flat panel display 24 provided on the back side and a touch sensor 22 attached to the front side. Similarly, the second UI unit 20 includes a flat panel display 28 and a touch sensor 26. Although the same display image is displayed on the flat panel displays 24 and 28, the displayed images may be different from each other. In the present embodiment, since the touch sensors 22 and 26 are provided on the flat panel displays 24 and 28, the examiner and the examinee touch the specific part with a finger on the displayed image. The coordinate information representing the touched part can be input to the control unit 30.

  The control unit 30 controls the operation of each component shown in FIG. The operation panel 32 is an input device including a keyboard and a trackball. In the present embodiment, the control unit 30 has a function of synthesizing and displaying the marker representing the coordinates input as described above on the display image. Data representing the designated coordinates and the coordinates designated by the subject are output. Based on this, the display processing unit 18 forms a first marker representing coordinates designated by the examiner and a second marker representing coordinates designated by the examinee as graphics on the ultrasound image in forming the display image. The process to synthesize is executed. Since the examiner and the examinee observe such an image, it is possible to accurately and appropriately transmit the coordinates input by both parties to the other party via the image. Incidentally, when displaying two markers, it is desirable to display them so that each marker can be visually distinguished, for example, it is desirable to change colors and forms.

  As a modification, the main display 34 and the operation panel 32 can be regarded as a user interface unit for an inspector, and in this case, the first UI unit 19 is not necessary. However, as will be described later, in the present embodiment, the first UI unit 19 and the second UI unit 20 are positioned back to back in the upper space of the subject. According to such a configuration, the examiner and the subject are positioned. There is an advantage that the dialogue can be performed in a state where the examiner is substantially facing the examiner.

  FIG. 2 is a flowchart showing the operation of the system shown in FIG. This flowchart particularly represents processing for reflecting information input by the examiner and the subject on the display image. In S101, it is determined whether or not the interactive mode is selected. If it is selected, S102 is executed. If it is not selected, the process proceeds to S103. In S102, a process of reflecting information (coordinate information in the present embodiment) input by the subject on the display image is executed. That is, a process of synthesizing the second marker representing the coordinates designated by the subject with the ultrasound image as a graphic is executed.

  On the other hand, in S103, processing for reflecting the information input by the examiner on the display image is executed. That is, a process of combining the first marker that specifies the coordinates input by the examiner on the ultrasonic image as a graphic is executed. When both S102 and S103 are executed, the first marker and the second marker are combined and displayed on the same ultrasonic image. Of course, when neither the examiner nor the subject touches the touch sensor, the marker is not displayed.

  In S104 and S105, the display image configured as described above is displayed on each flat panel display (FPD) included in the first UI unit and the second UI unit. That is, the examiner can recognize the coordinates indicated by the subject via the FPD, and similarly, the subject can recognize the coordinates indicated by the examiner via the other FPD. It becomes possible. Accordingly, it is possible to promote dialogue between the two, and in particular, it becomes easy for the subject to ask the examiner about the specific part or to express his / her opinion. In S106, it is determined whether or not to continue this routine, and in the case of continuing, each step after S101 is executed. Incidentally, although not shown in FIG. 2, when the bi-directional display mode is canceled by the examiner, the provision of images to the examinee is terminated, and the acceptance of input from the examinee is also terminated.

  For example, the examiner first confirms the display of an appropriate ultrasonic image using the first UI unit, and then causes the subject to observe the image, and in such an image sharing state, the mutual intention is obtained via the image. May be communicated to facilitate dialogue. Then, the provision of an image to the subject may be terminated at the stage where such a dialogue is terminated.

  In the above embodiment, coordinate information is given as information that can be input by the subject, but in addition to this, for example, selection of an image frame, selection of an image reproduction speed, and a viewpoint for constructing a three-dimensional image. A condition relating to image display such as setting may be input to the subject.

  FIG. 3 shows an example of the display image. In this example, the same display image is provided to both the examiner and the subject. A display image 52 is included in the display screen 50. In this example, the ultrasonic image 52 is a two-dimensional tomographic image. Of course, a three-dimensional image or other images may be displayed. On the ultrasound image 52, a first marker 54 and a second marker 55 are included as graphics. When the inspector changes the position of the touch on the screen, the first marker 54 moves accordingly. Similarly, if the subject moves the contact position on the touch screen, the second marker 55 moves on the ultrasonic image 52 accordingly. Of course, each marker can be deleted from the screen by operating a predetermined button. In the illustrated example, the first marker 54 and the second marker 55 are displayed in different forms, and different colors are assigned to each other. In any case, it is desirable that each marker is expressed so that it can be distinguished.

  Incidentally, reference numeral 56 represents a group of operation buttons during image reproduction. Reference numeral 60 represents a button for turning one frame to the past side in time series order, and reference numeral 62 represents a button for moving forward one frame in time series order. Each may be a button representing playback in the forward direction and the reverse direction instead of the frame advance button. Reference numeral 58 represents a stop button. Such a button group 56 may be displayed on the screen so that the subject can select a predetermined frame during loop reproduction from the cine memory. According to such a method, the subject can be actively involved in the observation of the ultrasonic image, and the subject, that is, the patient who has been in the position to be followed up to now is limited to the main. It becomes possible to raise it to the position. In addition, the coordinates of the viewpoint necessary for forming the three-dimensional image may be arbitrarily set by the subject. According to this, for example, it becomes possible to see a three-dimensional image of a fetus from a direction that a pregnant woman wants to observe.

  An afterimage process may be applied when moving each marker. For example, as shown in FIG. 4, when displaying the first marker, the first marker may be displayed so that the luminance gradually decreases from the present to the past. Reference numeral 54a represents the first marker in the latest frame, and reference numerals 54b to 54f represent the first marker in each time phase retroactive to the past. According to such a display mode, there is an advantage that the movement trajectory can be easily recognized when the finger is traced on the screen, and since the movement trajectory does not always remain, the feeling of agitation can be eliminated.

  5 and 6 are schematic views of the first UI unit 19 and the second UI unit 20 shown in FIG. In FIG. 5, a patient 66 who is a patient lies on the bed, and an examiner 64 is present on the side. Reference numeral 34 represents a main display, and reference numeral 36 represents a sub-display. Reference numeral 100 denotes a display mechanism including two UI units 19 and 20. As shown in FIG. 5, when the examiner 64 touches the screen with a finger on the first UI unit 19, the first marker 54 representing the coordinates touched by the examiner on the second UI unit 20 as shown in FIG. 6. Is displayed. That is, the subject 66 can observe the ultrasound image at a close distance, and can clearly recognize the part indicated by the examiner as the position of the first marker. Incidentally, reference numeral 70 represents an arm that supports the two UI parts 19 and 20. This arm is connected to the apparatus main body.

FIG. 7 shows a main configuration of the display mechanism 100. A first base 73 is connected to the tip of the arm 70 via a joint 72 that can rotate about a first axis. The second base 74 is connected to the first base 73 via a joint 75 that rotates about the second axis as a rotation axis. That is, the two UI parts 19 and 20 can be rotated around two orthogonal axes. Further, the second base 74 is provided with two shafts 76 and 78, and the first UI unit 19 and the second UI unit 20 can swing or open and close each other via the shafts 76 and 78, respectively. This I line adjustment of the orientation of the 1UI portion 19 and the 2UI portion 20, the first 1UI portion 19 toward the examiner who is in bedside directs the subject lying the first 2UI portion 20 on the bed Can do. Incidentally, reference numerals 19A and 20A represent states in which the UI units 19 and 20 have moved.

As described above , two display units for observation are provided on the bed, specifically above the chest or abdomen of the subject, and the examiner and the subject are substantially facing each other through the display unit. Since mutual communication can be achieved, there is an advantage that the efficiency of ultrasonic diagnosis can be improved, and mutual mutual trust can be improved by improving mutual communication.

Next, other configuration examples are shown in FIGS. In this configuration example, the first UI unit 19 shown in FIG. 1 is omitted, and the main display 34 and the operation panel are used instead. Of course, a touch sensor may be provided on the screen of the main display 34. As shown in FIG. 8, the second UI unit 20 is positioned above the chest of the subject 66 so as to face the subject lying on the bed , and the second UI unit 20 is positioned by the arm 70. Is retained. When the examiner 64 points to a specific part on the main display 34 or performs coordinate input to the pointing device instead, the second UI unit 20 for the subject 66 is displayed on the second UI unit 20 as shown in FIG. The coordinates input by the inspector are displayed as the first marker 54. On the other hand, as shown in FIG. 10, when the examinee 66 points to a specific part on the second UI unit 20, the second marker appears on the main display 34, and the examiner 64 It is possible to directly recognize the position pointed by the subject from the position where the two markers are displayed.

1 is a block diagram showing an overall configuration of an ultrasonic image display system according to the present invention. It is a flowchart which shows operation | movement of the system shown in FIG. It is a figure which shows an example of a display image. It is a figure for demonstrating afterimage processing. It is a general-view figure which shows the positioning state of a 1st UI part and a 2nd UI part. It is a general-view figure which shows a mode seen from the subject side. It is a figure for demonstrating the operation structure of two UI parts. It is a figure for demonstrating arrangement | positioning of UI part which concerns on other embodiment. It is a figure which shows the general view seen from the patient in the structure shown in FIG. It is a general-view figure which shows the contact state of the fingertip on an image in a subject.

Explanation of symbols

  16 image forming unit, 18 display processing unit, 19 first UI unit, 20 second UI unit, 22, 26 touch sensor, 24, 28 flat panel display, 34 main display, 54 first marker, 55 second marker.

Claims (8)

A transducer for transmitting and receiving ultrasonic waves to a subject lying on a bed;
An ultrasonic image forming unit that forms an ultrasonic image based on a reception signal obtained by transmitting and receiving the ultrasonic wave;
An inspector display image including the ultrasound image and a display image for the subject that is the same image as the inspector display image or a partially different display image and includes the ultrasound image are generated. A display image processing unit;
An inspector display for displaying the inspector display image;
A display for a subject for displaying the display image for the subject, and a subject for inputting information with the finger of the subject lying on the bed regarding the display image for the subject A user interface unit for a subject provided with an input device;
Including
The display image processing unit executes a subject input information reflecting process for reflecting the subject input information input from the subject input device in the inspector display image and the subject display image. An ultrasonic image display system characterized by that. The system of claim 1, wherein
An inspector input device for the inspector to input inspector input information regarding the display image for the inspector;
The display image processing unit executes an inspector input information reflecting process for reflecting the inspector input information input from the inspector input device in the inspector display image and the inspector display image. A featured ultrasonic image display system. The system of claim 2, wherein
2. The ultrasonic image display system according to claim 1, wherein the subject input information and the examiner input information are position information for specifying a position on the ultrasonic image. The system of claim 3, wherein
In the subject input information reflecting process, the display image processing unit displays the subject marker representing the position information input as the subject input information, the examiner display image and the subject display image. And in the inspector input information reflecting process, combining the inspector marker representing the position information input as the inspector input information with the inspector display image and the inspector display image. A featured ultrasonic image display system. The system of claim 4, wherein
The ultrasonic image display system, wherein the display image processing unit changes a display mode of the subject marker and the examiner marker. The system according to any one of claims 2 to 5,
The inspector input device and the inspector display constitute an inspector user interface unit,
The positioning mechanism is provided for holding the subject for a user interface portion facing towards the subject for a user interface portion and the inspector pointing towards the subject above the subject on the bed The
An ultrasonic image display system characterized by that. The system of claim 6, wherein
The subject user interface portion and the subject user interface portion are held by the positioning mechanism in a back-to-back state,
An ultrasonic image display system characterized by that. The system of claim 1, wherein
A positioning mechanism for holding the user interface part for the subject toward the subject on the bed is provided,
An ultrasonic image display system characterized by that.