JP6907291B2 - Ultrasonic image display device - Google Patents

Description

The present invention relates to an ultrasonic image display device including a display for displaying an ultrasonic image of a subject and a user interface.

The ultrasonic image display device is a device that creates an ultrasonic image based on an echo signal obtained by transmitting ultrasonic waves to a subject and displays it on a display. In this ultrasonic image display device, the user interface receives the input of the operator, and various processes including the creation and display of the ultrasonic image are performed. When such input and processing are performed in the ultrasonic image display device, log data relating to the usage status of the ultrasonic image display device is generated and stored. (See, for example, Patent Document 1).

Patent No. 3725522

For example, even if the operator inputs an input, the ultrasonic image display device may have a problem such that the response of the device is slow or there is no response at all. In this case, the log data may be analyzed to try to identify the cause of the problem. However, it is difficult to identify the cause of the defect of the ultrasonic image display device based only on the log data because the cause of all the defects is not recorded in the log data. It may take some time.

The inventors of the present application can quickly and easily determine the cause of a defect by utilizing information that is not recorded in the log data, such as the operation and behavior of the operator that was performed immediately before the defect is recognized, together with the log data. Focusing on the point that can be specified in, the invention of the present application was reached. That is, the invention made to solve the above problems includes a user interface that accepts input from an operator, a display that displays an ultrasonic image of a subject, and a camera that captures moving images of the user interface and the screen of the display. An ultrasonic image display device including at least one memory and at least one processor, wherein the processor generates log data relating to a usage status of the ultrasonic image display device and stores the log data in the memory. When the occurrence of a defect in the ultrasonic image display device is detected and the occurrence of the defect is detected, the moving image data taken by the camera is the required period based on the time when the occurrence of the defect is detected. It is an ultrasonic image display device configured to store moving image data in the memory, and also generate log data indicating the occurrence of the defect as the log data and store it in the memory.

The invention from the above viewpoint relates to the usage status of the ultrasonic image display device, which stores the moving image data for a required period in the memory based on the time when the occurrence of the defect is detected, and also includes the log data indicating the occurrence of the defect. Log data is also stored in memory. By providing such video data and log data, a person who identifies the cause of a defect can check the video and log data and quickly and easily identify the cause. Therefore, according to the invention from the above viewpoint, it is possible to provide data that makes it possible to quickly and easily identify the cause of a defect that has occurred in the ultrasonic image display device.

It is a block diagram which shows the structure of 1st Embodiment of the ultrasonic diagnostic apparatus of this invention. It is a perspective view which shows the appearance of an example of embodiment of the ultrasonic diagnostic apparatus of this invention. It is a flowchart which shows an example of the processing of the ultrasonic diagnostic apparatus of embodiment. It is explanatory drawing of an example of the 1st moving image data and the 2nd moving image data. It is explanatory drawing of another example of the 1st moving image data and the 2nd moving image data. It is a diagram explaining the identification of the cause of the defect, (A) is an explanatory diagram when the cause of the defect is a defective hard key, and (B) is a diagram when the cause of the defect is a defect of the program that performs freeze processing. It is explanatory drawing. It is a block diagram which shows the structure of the 1st modification of the ultrasonic diagnostic apparatus of 1st Embodiment. It is a block diagram which shows the structure of the 2nd modification of the ultrasonic diagnostic apparatus of 1st Embodiment. It is a figure which shows the screen of the display which displayed the image which shows the time when the trouble occurred. It is a block diagram which shows the structure of the 2nd Embodiment of the ultrasonic diagnostic apparatus of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following embodiment, as an example of the ultrasonic image display device according to the present invention, an ultrasonic diagnostic device that displays an ultrasonic image of a subject for the purpose of diagnosis or the like will be described.
(First Embodiment)
First, the first embodiment will be described. The ultrasonic diagnostic apparatus 1 shown in FIGS. 1 and 2 includes an ultrasonic probe 2 (not shown in FIG. 2), a transmission / reception beam former 3, a transmitter 4, a receiver 5, a reception beam former 6, and a first processor 7. It has a display 8, a first memory 9, and a user interface 10. The ultrasonic probe 2 is connected to the device main body 100 constituting the ultrasonic diagnostic device 1 via a probe cable (not shown). The apparatus main body 100 has a transmission / reception beam former 3, a transmitter 4, a receiver 5, a reception beam former 6, a first processor 7, a display 8, a first memory 9, and a user interface 10.

The ultrasonic probe 2 transmits and receives ultrasonic waves to a subject in a three-dimensional space. More specifically, the transmitting beam former 3 and the transmitter 4 drive a plurality of vibrating elements 2a arranged in the ultrasonic probe 2 to radiate a pulsed ultrasonic signal to a subject (not shown). It is configured. The pulsed ultrasonic signal generates an echo that is reflected in the subject and returned to the vibrating element 2a. The echo is converted into an electric signal by the vibrating element 2a, and the electric signal is received by the receiver 5. An electric signal representing the received echo, that is, an echo signal is input to the reception beamformer 6, and the reception beamforming is performed in the reception beamformer 6. The reception beamformer 6 may output the echo signal after the reception beamforming to the first processor 7.

The receiving beam former 6 may be a hardware beam former or a software beam former. When the receive beam former 6 is a software beam former, the receive beam former 6 performs a graphics processing unit (GPU), a microprocessor, a central processing unit (CPU), a digital signal processor (DSP), or a logical operation. Can include one or more processors, including any one or more of the other types of processors capable of. The processor constituting the reception beam former 6 may be configured by a processor different from the first processor 7, or may be configured by the first processor 7.

The ultrasonic probe 2 may include an electrical circuit for performing all or part of transmit beamforming and / or receive beamforming. For example, all or part of the transmitting beam former 3, the transmitter 4, the receiver 5, and the receiving beam former 6 may be provided in the ultrasonic probe 2.

The first processor 7 controls the transmitting beam former 3, the transmitter 4, the receiver 5, and the receiving beam former 6. The first processor 7 is in electronic communication with the ultrasonic probe 2. The first processor 7 can control the ultrasonic probe 2 to acquire an echo signal. The first processor 7 controls which of the vibrating elements 2a is active and the shape of the ultrasonic beam transmitted from the ultrasonic probe 2. The first processor 7 also electronically communicates with the display 8, and the first processor 7 can process the echo signal into an ultrasonic image for display on the display 8. The term "electronic communication" can be defined to include both wired and wireless communication.

The first processor 7 may include a central processing unit (CPU) according to one embodiment. According to other embodiments, the first processor 7 may perform processing functions such as a digital signal processor, a field programmable gate array (FPGA), a graphics processing unit (GPU), or another type of processor. It can include other electronic components that can. According to another embodiment, the first processor 7 may include a plurality of electronic components capable of performing processing functions. For example, the first processor 7 can include two or more electronic components selected from a list of electronic components including a central processing unit, a digital signal processor, a field programmable gate array, and a graphics processing unit.

The first processor 7 can also include a composite demodulator (not shown) that demodulates RF data. In another embodiment, demodulation can be performed early in the processing chain.

The first processor 7 is configured to perform one or more processing operations on the data according to a plurality of selectable ultrasonic modalities. When the echo signal is received, the data can be processed in real time during the scanning session. For this disclosure, the term "real time" is defined to include procedures that are performed without any intentional delay.

In addition, the data can be temporarily stored in a buffer (not shown) during ultrasonic scanning and processed in live or offline operations rather than in real time. In this disclosure, the term "data" can be used herein to refer to one or more datasets obtained using an ultrasonic device.

The raw data obtained by processing by the receiving beam former 6 is obtained by the first processor 7 in other or different mode-related modules (eg, B mode, color doppler, M mode, color M mode, spectrum doppler, etc.). It can be processed by elastography, TVI, distortion, strain rate, etc.) to create ultrasonic image data. For example, one or more modules generate ultrasound images such as B-mode, color doppler, M-mode, color M-mode, spectral doppler, elastography, TVI, distortion, strain rate, and combinations thereof. Can be done. Image beams and / or image frames are stored and can record timing information indicating when the data was acquired in memory. The module may include, for example, a scan transformation module that performs a scan transform operation to transform an image frame from coordinate beam space to display space coordinates. A video processor module may be provided that reads an image frame from memory while the subject is being treated and displays the image frame in real time. The image processor module can store the image frame in the image memory, and the ultrasonic image is read from the image memory and displayed on the display 8.

When the first processor 7 includes a plurality of processors, the plurality of processors may be in charge of the above-mentioned processing tasks in charge of the first processor 7. For example, one first processor 7 can be used to demodulate and thin out RF signals, and another first processor 7 can be used to further process the data before displaying the image. ..

Further, for example, when the receiving beam former 6 is a software beam former, the processing function may be executed by a single first processor 7 or may be executed by a plurality of first processors 7.

Further, the first processor 7 generates log data indicating the usage status of the ultrasonic diagnostic apparatus 1 and stores it in the first memory 9. The log data indicating the usage status of the ultrasonic diagnostic apparatus 1 also includes log data indicating the occurrence of a problem described later.

The display 8 displays an ultrasonic image or the like of the subject. The display 8 is, for example, an LED (Light Emitting Diode) display, an LCD (Liquid Crystal Display), an organic EL (Electro-Lumisensence) display, or the like.

The first memory 9 is an arbitrary known data storage medium, and includes a non-transient storage medium and a transient storage medium (the same applies to the second memory 13 described later). The non-transient storage medium is, for example, a non-volatile storage medium such as an HDD (Hard Disk Drive) or a ROM (Read Only Memory). The non-transient storage medium may include a portable storage medium such as a CD (Compact Disk) or a DVD (Digital Versatile Disc). The program executed by the first processor 7 is stored in a non-transient storage medium.

The transient storage medium is a volatile storage medium such as RAM (Random Access Memory).

The user interface 10 can accept the input of the operator. For example, the user interface 10 is provided on the operation panel 101 constituting the device main body 100, and receives instructions and information input from the user. The user interface 10 includes a keyboard (keyboard) 10A, a hard key (hard key) 10B, a trackball (trackball) 10C, a rotary control (rotary control) 10D, and a touch screen 10E for displaying soft keys (not shown). It is configured.

The user interface 10 is configured to accept an input notifying the occurrence of a defect as one of the inputs by the operator. For example, the user interface 10 has a hard key 10B or a soft key that accepts an input by an operator notifying the occurrence of a problem.

The ultrasonic diagnostic apparatus 1 further includes a camera 11, a second processor 12, and a camera module 14 having a second memory 13. The camera module 14 includes a U-shaped mounting member 15 (not shown in FIG. 1) configured so that the operation panel 101 can be sandwiched. The camera module 14 is detachably attached to the apparatus main body 100 by the attachment member 15 sandwiching the operation panel 101.

The camera 11 is controlled by a second processor 12 composed of a CPU or the like to shoot a moving image. The camera module 14 is attached at a position where the camera 11 can shoot a moving image of the screens of the user interface 10 and the display 8. Therefore, the camera 11 captures the operation and behavior of the operator and the screen of the display 8 as a moving image.

The camera module 14 is connected to the device main body 100 via a cable 16 (not shown in FIG. 1), and the signal of the user interface 10 is input via the cable 16. Further, the camera module 14 may be supplied with power via the cable 16 or may have a battery (not shown).

Next, the operation of this example will be described based on the flowchart of FIG. First, in step S1, the camera 11 starts shooting the first moving image data DT1. For example, when the power of the ultrasonic diagnostic apparatus 1 is turned on, the first processor 7 outputs a signal to the second processor 12. Then, the second processor 12 to which this signal is input controls the camera 11 to start shooting.

The first moving image data DT1 includes images of the user interface 10 and the display 8. Further, the second processor 12 adds time information to the first moving image data DT1.

The first moving image data DT1 is stored in the second memory 13. However, the first moving image data DT1 having a required period T1 is stored in the second memory 13 retroactively from the present time. Therefore, with the passage of time, the past moving image data that exceeds the required period T1 retroactively from the present time is deleted.

In step S1, the first processor 7 and the second processor 12 may perform a process of matching the time information with each other.

Next, in step S2, the acquisition of the ultrasonic image is started. Specifically, the ultrasonic probe 2 transmits and receives ultrasonic waves to the subject, and an ultrasonic image based on the obtained echo signal is displayed on the display 8. During the acquisition of the ultrasonic image, the first processor 7 generates log data regarding the usage status of the ultrasonic diagnostic apparatus 1 and stores it in the first memory 9. The log data also includes time information of the first processor 7.

Next, in step S3, the second processor 12 determines whether or not a problem has occurred in the ultrasonic diagnostic apparatus 1. Specifically, when the operator first thinks that a problem has occurred in the ultrasonic diagnostic apparatus 1, he presses the hard key 10B or the soft key for notifying the occurrence of the problem in the user interface 10.

When the user interface 10 receives an input by an operator notifying the occurrence of a defect, the user interface 10 outputs a signal S indicating that the input has been made to the second processor 12 via the first processor 7. The first processor 7 and the second processor 12 to which the signal S is input determine that a problem has occurred in the ultrasonic diagnostic apparatus 1 (“YES” in step S3). That is, the first processor 7 and the second processor 12 detect the occurrence of a defect by inputting the signal S.

On the other hand, if the signal S is not input in step S3, the first processor 7 and the second processor 12 determine that no problem has occurred in the ultrasonic diagnostic apparatus 1 (“NO” in step S3). The determination as to whether or not the signal S is input is continued.

If it is determined in step S3 that a problem has occurred in the ultrasonic diagnostic apparatus 1, the process proceeds to step S4. In step S4, the second processor 12 stores a part of the first moving image data DT1 captured by the camera 11 in the second memory 13 as the second moving image data DT2. The second moving image data DT2 is data obtained by copying a part of the first moving image data DT1 and is stored in the second memory 13 separately from the first moving image data DT1. The second moving image data DT2 also includes time information.

More specifically, the second moving image data DT2 is the data of the required period T2 (T2 <T1) with reference to the time when the occurrence of the defect is detected. For example, the second processor 12 has a required period T2 from the time tb when the required time elapses from the time ta when the occurrence of the defect is detected in the first moving image data DT1 captured by the camera as shown in FIG. The second moving image data DT2 up to the time point tk may be stored in the second memory 13. The required period T2 includes the time point ta.

Further, as shown in FIG. 5, the second processor 12 is the first of the first moving image data DT1 captured by the camera, from the time ta when the occurrence of a defect is detected to the time tk retroactive by the required period T2. The moving image data DT2 of 2 may be stored in the second memory 13.

The required period T is set to a sufficient length by experience or the like so as to include the time when the operator's action related to the occurrence of the trouble described later and the processing in the ultrasonic diagnostic apparatus 1 are performed.

When the occurrence of a defect is detected, it is determined that the occurrence of the defect has occurred in the user interface 10 when the input for notifying the occurrence of the defect is performed by the operator and in the first processor 7 and the second processor 12. Including the time.

Further, in step S4, the first processor 7 generates log data indicating the occurrence of a defect and stores it in the first memory 9. When the signal S is input from the user interface 10, the first processor 7 may generate and store log data indicating the occurrence of a defect. Note that this log data also includes time information.

Next, in step S5, it is determined whether to end the process. For example, the first processor 7 determines whether or not to end the process. In one example, the first processor 7 determines that the process ends when a signal indicating that it has received the input of the operator who ends the acquisition of the ultrasonic image is input from the user interface 10 (in step S5). "YES"). The first processor 7 may output a signal indicating that the processing is completed to the second processor 12. When a signal indicating that the process is terminated is input from the first processor 7, the second processor 12 ends the shooting by the camera 11.

If it is determined in step S5 that the process is not completed (“NO” in step S5), the process returns to step S3, and the processes of steps S3 to S5 are repeated.

According to this example, it occurs in the ultrasonic diagnostic apparatus 1 by reproducing the second moving image data DT2 stored in the second memory 13 and analyzing the log data stored in the first memory 9. The cause of the problem can be easily identified. A person who identifies the cause of the defect (hereinafter referred to as "specific person") reproduces the second moving image data DT2 on the display 8 of the ultrasonic diagnostic apparatus 1, and analyzes the log data on the ultrasonic diagnostic apparatus 1. By doing so, the cause of the defect may be identified.

In addition, the specific person reproduces the second moving image data DT2 transmitted from the second memory 13 on a device capable of playing a moving image (not shown), and indicates the occurrence of a defect transmitted from the first memory 13. The cause of the defect may be identified by analyzing the log data with a device other than the ultrasonic diagnostic device 1 (not shown). In this case, the device for reproducing the second moving image data DT2 and the device for analyzing the log data may be located in a place different from the facility where the ultrasonic diagnostic device 1 is installed.

The identification of the cause of the defect will be specifically described with reference to FIG. Here, a problem that occurs when the real-time ultrasonic image displayed on the display 8 is frozen will be described. The causes of the problems will be described with reference to a defect of the hard key 10B (freeze button) that receives the input of the operator instructing the freeze process and a defect of the program that performs the freeze process.

FIG. 6A shows a case where the cause of the defect is a defect of the hard key 10B. At time t1 in FIG. 6A, the hard key 10B is pressed as an input instructing the operator to perform the freeze process (freeze Button is pressed). The vertical arrow A1 indicates that the hard key 10B for freeze processing is pressed. The hard key 10B is pressed three times after the time point t1. After the third hard key 10B is pressed at the time point t2, at the time point t3, the first processor 7 generates log data indicating that the hard key 10B for freeze processing is pressed. It is stored in the first memory 9 (Freeze Button recognition). The vertical arrow A2 indicates the generation and storage of log data indicating that the hard key 10B for freeze processing has been pressed.

Next, at the time point t4, the first processor 7 starts a program that performs the freeze process and starts the freeze process. This freeze process may include processing such as storage of ultrasonic image data and transfer of DICOM images. Then, when the freeze process is completed at the time point t5, the ultrasonic image displayed on the display 8 freezes. The horizontal arrow A3 between time points t4 and time point t5 indicates the period of freeze processing. The first processor 7 may generate log data indicating that the freeze process has been completed and store it in the first memory 9 (not shown in FIG. 6).

The horizontal arrow A4 indicates the period from the time t1 when the operator first presses the hard key 10B to the time t5 when the ultrasonic image freezes. The operator feels that the response of the ultrasonic diagnostic apparatus 1 is slow even if the hard key 10B is pressed because A4 is long during this period, and at the time point t6, an input is input to notify the occurrence of a defect in the user interface 10. The vertical arrow A5 indicates an input for notifying the occurrence of a defect. At this point, the input at t6 causes the first processor 7 to generate and store log data indicating the occurrence of a defect in step S4. The time point t6 is a time point when the occurrence of a defect is detected. Further, the second processor 12 stores the second moving image data DT2 for the required period T2. The required period T2 is set to a sufficient length to include the time point t1.

The identification of the cause of the defect in the above cases will be described. The specific person identifies the cause of the defect based on the log data stored in the first memory 9 and the second moving image data DT2 stored in the second memory 13. Specifically, the specific person analyzes what kind of operation or processing is performed in the ultrasonic image display device 1 based on the log data. At this time, the specific person can shorten the time required for the analysis by identifying the log data indicating the occurrence of the defect and analyzing the log data that is close in time to the time when the log data is generated. ..

The specific person identifies that the hard key 10B was pressed at the time point t3 based on the log data generated at the time point t3. However, the fact that the operator pressed the hard key 10B before the time point t3 is not stored as log data, and the fact that the pressing of the hard key 10B is not recognized by the ultrasonic diagnostic apparatus 1 is recorded as log data. It has not been. Therefore, the specific person can grasp that the hard key 10B is pressed three times from the time point t1 to the time point t2 by checking the image to be reproduced based on the second moving image data DT2.

Since the second moving image data DT2 includes the time information, the time is displayed in the image reproduced based on the second moving image data DT2. Therefore, the specific person can specify the time points t1 and t2 according to the displayed time. Further, the specific person can specify the time point t3 by the time information of the log data. Therefore, the specific person can confirm that the log data indicating that the hard key 10B has been pressed is generated after the hard key 10B is pressed three times. Thereby, the specific person can identify that the pressing of the hard key 10B at the time point t1 is not recognized by the ultrasonic diagnostic apparatus 1 and the hard key 10B is defective.

Next, based on FIG. 6B, a case where the cause of the defect is a defect of the program that performs the freeze process will be described. At the time point t11 in FIG. 6 (B), the hard key 10B for the freeze process is pressed by the operator as in the time point t1 in FIG. 6 (A) (vertical arrow A1). In FIG. 6B, the hard key 10B for the freeze process is pressed only once.

At time point t12 after time point t11, the first processor 7 generates log data indicating that the hard key 10B for freeze processing has been pressed, as in time point t3 in FIG. 6 (A). It is stored in the memory 9 of 1 (vertical arrow A2).

Next, at the time point t13, the first processor 7 starts the program that performs the freeze process and starts the freeze process, as in the time point t4 in FIG. 6 (A). Then, when the freeze process is completed at the time point t14, the ultrasonic image displayed on the display 8 freezes. The horizontal arrow A3 indicating the period of freeze processing is located between the time points t13 and the time point t14. The first processor 7 may generate log data indicating that the freeze process has been completed and store it in the first memory 9 (not shown in FIG. 6).

In FIG. 6B, the horizontal arrow A4 indicating the period from when the operator presses the hard key 10B until the ultrasonic image freezes is between the time point t11 and the time point t14. As in the case of FIG. 6A, the operator feels that this period A4 is long and the response of the ultrasonic diagnostic apparatus 1 is slow even if the hard key 10B is pressed, and at the time point t15, the user interface 10 has a problem. Input to notify the occurrence of (vertical arrow A5). At this point, the input at t15 causes the first processor 7 to generate and store log data indicating the occurrence of a defect in step S4. Further, the second processor 12 stores the second moving image data DT2 for the required period T2. The required period T2 is set to a sufficient length to include the time point t11.

The identification of the cause of the defect in the above cases will be described. The specific person analyzes the log data stored in the first memory 9 in the same manner as in the case of FIG. 6A. Then, the specific person identifies that the hard key 10B has been pressed at the time point t12 based on the log data generated at the time point t12. Further, the specific person confirms that the hard key 10B is pressed at the time point t11 in the image to be reproduced based on the second moving image data DT2.

The specific person confirms the time displayed in the image to be reproduced based on the second moving image data DT2 and the time of the log data indicating that the hard key 10B has been pressed (time point t12). As soon as the hard key 10B is pressed, it can be recognized that log data indicating that is generated. Therefore, it can be specified that the hard key 10B has no problem. On the other hand, the specific person determines the first processor 7 from the time of the log data indicating that the hard key 10B is pressed (time point t12) and the time of the log data indicating that the freeze process is completed (t14). It is possible to identify that the program is defective because the freeze process is taking a long time.

As described above, according to the ultrasonic diagnostic apparatus 1 of this example, it is possible to provide the second moving image data DT2 and the log data including the log data indicating that a defect has occurred, and the ultrasonic diagnostic apparatus can be provided. It is possible to provide data that makes it possible to quickly and easily identify the cause of the trouble that occurred in.

Next, a modified example of the first embodiment will be described. First, a first modification will be described. As shown in FIG. 7, the ultrasonic probe 2 may be provided with a magnetic sensor 17 composed of, for example, a Hall element. The magnetic sensor 17 detects the magnetism generated from, for example, the magnetic generator 18 installed in the three-dimensional space, and detects the position of the ultrasonic probe 2 in the three-dimensional space. The magnetic generating unit 18 is composed of, for example, a magnetic generating coil. The detection signal in the magnetic sensor 17 is input to the first processor 7. The first processor 7 detects the position of the ultrasonic probe 2 based on the detection signal of the magnetic sensor 17, and further calculates the speed and acceleration when the ultrasonic probe 2 moves.

In this first modification, it can be detected that the operator accidentally drops the ultrasonic probe 2 as a defect of the ultrasonic diagnostic apparatus 1. Specifically, when the speed or acceleration calculated based on the detection signal of the magnetic sensor 17 exceeds the threshold value in step S3 of the flowchart of FIG. 3, the first processor 7 has a problem in the ultrasonic diagnostic apparatus 1. Judge that it has occurred.

In the first modification, the first processor 7 may determine that a defect has occurred in the ultrasonic diagnostic apparatus 1 in the above step S3 even when the above signal S is input. Further, the first processor 7 has a problem in step S3 described above because the generation of the log data that is periodically generated among the log data other than the log data indicating the occurrence of the problem is hindered. May be determined.

In this first modification, the magnetic sensor 17 for detecting the drop of the ultrasonic probe 2 is only one example. For example, instead of the magnetic sensor 17, an acceleration sensor may be provided on the ultrasonic probe 2 to detect a drop of the ultrasonic probe 2.

Next, a second modification will be described. In the above-described embodiment, the camera module 14 is separate from the device main body 100 and is configured to be detachably attached to the device main body 100, but the present invention is not limited thereto. As shown in FIG. 8, the camera module 14 may be built in the apparatus main body 100. However, even in this case, the camera 11 is provided at a position where the screens of the user interface 10 and the display 8 can be imaged.

Next, a third modification will be described. When the signal S is input in step S3, the first processor 7 may display an image I1 indicating the time when a defect has occurred on the screen of the display 8 as shown in FIG. For example, the first processor 7 displays the image I1 in the area of the screen of the display 8 where the ultrasonic image I2 such as the B-mode image created based on the echo signal is not displayed. The image I1 may be a color image composed of a required figure having a required color. In FIG. 10, image I1 is a circular color image. However, the image I1 may be an image configured so that it can be recognized by a moving image taken by the camera 11.

When the moving image based on the second moving image data DT2 is played back, the specific person confirms the image I1 displayed on the screen of the display 8 and presses the hard key 10B to notify the occurrence of the defect at what point. It can be confirmed more easily whether it has been done.

(Second Embodiment)
Next, the second embodiment will be described. FIG. 10 is a block diagram showing the configuration of the ultrasonic diagnostic apparatus 20 of the second embodiment. In FIG. 10, the same configuration as that of the ultrasonic diagnostic apparatus 1 of the first embodiment is designated by the same reference numerals and the description thereof will be omitted.

The ultrasonic diagnostic apparatus 20 includes an ultrasonic probe 2, a transmission / reception beam former 3, a transmitter 4, a receiver 5, a reception beam former 6, a display 8, and a user interface 10, as well as a processor 21, a memory 22, and a camera 23.

The description of the processor 21 is incorporated by reference to the description of the first processor 7 and the second processor 12 in the first embodiment. Therefore, the processor 21 is configured to perform the same controls and processes as the first processor 7 and the second processor 12.

Further, the description of the memory 22 also incorporates the description of the first memory 9 and the second memory 13 in the first embodiment. Therefore, the memory 22 stores the same data as the data stored in the first memory 9 and the second memory 13.

The camera 23 is controlled by the processor 21 to shoot moving images of the user interface 10 and the display 8. Similar to the first embodiment, the camera 23 is configured as a separate body from the device main body 100 and is detachably attached to the device main body 100. However, although not particularly shown, the camera 23 may be built in the device main body 100.

Also in the ultrasonic diagnostic apparatus 20 of this example, the processing according to the flowchart of FIG. 3 is performed. However, the ultrasonic diagnostic apparatus 20 of this example has a processor 21 instead of the first processor 7 and the second processor 12 in the first embodiment. Further, the ultrasonic diagnostic apparatus 20 of this example has a memory 22 instead of the first memory 9 and the second memory 13 in the first embodiment. Hereinafter, among the processes of the ultrasonic diagnostic apparatus 20 of this example performed according to the flowchart of FIG. 3, the processes different from those of the ultrasonic diagnostic apparatus 1 of the first embodiment due to the difference in the above configuration. explain.

In step S1, the processor 21 starts shooting the first moving image data DT1 by the camera 23. The first moving image data DT1 is stored in the memory 22. The processor 21 adds time information to the first moving image data DT1. As will be described later, since the log data is generated by the processor 21, it is not necessary to perform the time information matching process performed by the first processor 7 and the second processor 12 in the first embodiment.

In step S2, during the acquisition of the ultrasonic image, the processor 21 generates log data regarding the usage status of the ultrasonic diagnostic apparatus 1 and stores it in the memory 22. The log data is stored in a storage area different from that of the first moving image data DT1. The log data also includes time information of the processor 21.

In step S3, when the user interface 10 receives an input by the operator notifying the occurrence of a defect, the user interface 10 outputs a signal S indicating that the input has been made to the processor 21. When the signal S is input, the processor 21 determines that a problem has occurred in the ultrasonic diagnostic apparatus 20. On the other hand, when the signal S is not input, the processor 21 determines that the ultrasonic diagnostic apparatus 20 has not caused a problem.

In step S4, the processor 21 stores the second moving image data DT2 in the memory 22. The second moving image data DT2 is stored in a storage area different from that of the first moving image data DT1 and the log data. Further, in step S4, the processor 21 generates log data indicating the occurrence of a defect and stores it in the memory 22.

In step S5, the processor 21 determines the end. When the processor 21 determines that the process is finished, the processor 21 finishes the shooting by the camera 23.

In this example, the specific person identifies the cause of the defect based on the second moving image data DT2 and the log data stored in the memory 22. The ultrasonic diagnostic apparatus 20 of this example can also obtain the same effect as the ultrasonic diagnostic apparatus 1 of the first embodiment.

The ultrasonic diagnostic apparatus 20 of the second embodiment also detects the occurrence of a defect by detecting the fall of the ultrasonic probe 2 as in the first modification of the first embodiment. May be good. Further, the ultrasonic diagnostic apparatus 20 of the second embodiment may also display an image showing the time when a defect occurs, as in the case of the third modification of the first embodiment.

Although the present invention has been described above by the above-described embodiment, it goes without saying that the present invention can be modified in various ways without changing the gist thereof. For example, the flowchart described in each of the above embodiments is an example, and can be modified as long as the gist of the present invention is not impaired. For example, the present invention is not limited to the case where a real-time ultrasonic image is displayed, and can be similarly applied to a case where an ultrasonic image stored in a first memory 9 or the like is displayed. can.

Further, the configurations shown in the block diagrams of FIGS. 1, 7, 8 and 10 are also examples, and can be modified as long as the gist of the present invention is not impaired. For example, beamforming may not be performed.

Further, the method for determining whether or not a defect has occurred in each of the above embodiments is merely an example. For example, it may be determined that a problem has occurred when an abnormality occurs in the log data or the device.

Further, the mounting position of the camera module 14 shown in FIG. 2 is an example, and the screens of the user interface 10 and the display 8 may be mounted at a position where the camera 11 can shoot a moving image. Further, the number of cameras that capture moving images of the screens of the user interface 10 and the display 8 is not limited to one. For example, a total of two cameras may be provided, one for photographing the user interface 10 as a moving image and the other for photographing the screen of the display 8.

In addition, the above embodiment
A user interface that accepts operator input and
A display that displays an ultrasonic image of the subject,
A camera that captures moving images of the user interface and the screen of the display,
With at least one memory
With at least one processor
A method in which the processor controls an ultrasonic image display device comprising the above.
The processor
Log data relating to the usage status of the ultrasonic image display device is generated and stored in the memory.
Detecting the occurrence of a defect in the ultrasonic image display device,
When the occurrence of the defect is detected, the moving image data taken by the camera and the required period of time based on the time when the occurrence of the defect is detected is stored in the memory and is used as the log data. , The control method of the ultrasonic image display device, which generates log data indicating the occurrence of the defect and stores it in the memory, may be used.

1, 20 Ultrasonic diagnostic device 2 Ultrasonic probe 7 1st processor 8 Display 9 1st memory 10 User interface 11 Camera 12 2nd processor 13 2nd memory 14 Camera module 21 Processor 22 Memory 23 Camera 100 Device body

Claims (12)

A user interface that accepts operator input and
A display that displays an ultrasonic image of the subject,
A camera that captures moving images of the user interface and the screen of the display,
With at least one memory
With at least one processor
It is an ultrasonic image display device equipped with
The processor
Log data relating to the usage status of the ultrasonic image display device is generated and stored in the memory.
Based on the input signal or the log data, the occurrence of a defect in the ultrasonic image display device is detected, and the occurrence of a defect is detected.
When the occurrence of the defect is detected, the moving image data taken by the camera and the required period of time based on the time when the occurrence of the defect is detected is stored in the memory and is used as the log data. An ultrasonic image display device configured to generate log data indicating the occurrence of the defect and store it in the memory. In the memory, the first moving image data captured by the camera and the second moving image data of a required period based on a part of the first moving image data and the time when the occurrence of the defect is detected are stored in the memory. The ultrasonic image display device according to claim 1, which is stored. The memory is composed of a first memory and a second memory.
The ultrasonic image display device according to claim 1 or 2, wherein the processor stores the log data in the first memory and stores the moving image data in the second memory. The ultrasonic image display device according to claim 1 or 2, wherein the processor stores the log data and the moving image data in different storage areas in one memory. The user interface is an interface that accepts an input by the operator notifying the occurrence of a defect, and when receiving an input notifying the occurrence of the defect, outputs a signal indicating that the input has occurred to the processor.
The ultrasonic image display device according to any one of claims 1 to 4, wherein the processor detects the occurrence of the defect by inputting the signal. Any of claims 1 to 4, wherein the processor detects the occurrence of the defect by hindering the generation of the log data that is periodically generated among the log data other than the log data indicating the occurrence of the defect. The ultrasonic image display device according to claim 1. In addition, it is equipped with an ultrasonic probe that transmits and receives ultrasonic waves.
The ultrasonic probe has a sensor that detects the movement of the ultrasonic probe.
The processor is configured to detect a drop of the ultrasonic probe based on a signal input from the sensor, and detects the occurrence of the defect by detecting the drop of the ultrasonic probe. The ultrasonic image display device according to any one of 1 to 4. The ultrasonic image display device according to any one of claims 1 to 7, wherein the processor stores moving image data for a required period retroactively from the time when the occurrence of the defect is detected in the memory. The processor stores in the memory the moving image data of the required period that is a required period that goes back from the time point after the time when the occurrence of the defect is detected and includes the time point when the occurrence of the defect is detected. The ultrasonic image display device according to any one of claims 1 to 7. The ultrasonic image display device according to any one of claims 1 to 9, wherein the processor displays an image indicating the time when the defect occurs on the screen of the display. A device body having at least the user interface and the display.
The ultrasonic image display device according to any one of claims 1 to 10, wherein the camera is configured to be detachably attached to the device main body. The ultrasonic image display device according to claim 11, further comprising the camera, the memory, and a camera module having the processor, the camera module being configured to be detachably attached to the device body.

Images