JP2024026718A - Ultrasonic systems and methods of controlling them - Google Patents

Abstract

[Problem] To provide an ultrasound system and an ultrasound system control method that can obtain appropriate ultrasound images and improve the accuracy of ultrasound diagnosis even when ultrasound images are taken in a remote location. provide. [Solution] An ultrasound system (1C) includes an ultrasound probe (2C), a mobile information terminal (3C), and an external device (4C), and the mobile information terminal (3C) includes a camera unit (4C) that acquires a visual field image. 33), a first input device into which the first information is input, a first information transmission unit, and a terminal-side wireless communication unit (31) that wirelessly transmits the visual field image, the ultrasound image, and the first information. The external device (4C) includes an external monitor (45), a second input device into which the second information is input, a second information transmission unit, and an external monitor that transmits the ultrasound image and the visual field image. (45), and an external wireless communication unit (46C) that wirelessly transmits second information, and bidirectional communication between the mobile information terminal (3C) and the external device (4C). Communicate information. [Selection diagram] Figure 9

Description

The present invention relates to an ultrasound system and a method of controlling the ultrasound system, and particularly relates to an ultrasound system that displays ultrasound images on a mobile information terminal and a method of controlling the ultrasound system.

BACKGROUND ART Ultrasonic diagnostic apparatuses that utilize ultrasound images have been put into practical use in the medical field. Generally, this type of ultrasound diagnostic equipment has an ultrasound probe with a built-in transducer array and a device body connected to the ultrasound probe, and the ultrasound probe emits ultrasound waves toward the subject. An ultrasonic image is generated by transmitting an ultrasonic wave, receiving an ultrasonic echo from the subject with an ultrasonic probe, and electrically processing the received signal in the main body of the apparatus.

In recent years, for example, as disclosed in Patent Document 1, an ultrasound image acquired using an ultrasound probe is displayed on an external monitor placed at a position distant from the user, and Ultrasonic diagnostic apparatuses have been developed that attempt to improve the convenience of ultrasonic diagnosis by including a portable information terminal for performing input operations.

JP2017-86360A

Generally, in ultrasound diagnosis using an ultrasound diagnostic apparatus such as that disclosed in Patent Document 1, by checking the ultrasound image, it is possible to accurately grasp the region inside the subject depicted in the ultrasound image. It is known that a certain level of skill is required in order to do so. Further, it is known that the image quality of the generated ultrasound image is greatly influenced by the operator's technique.

For example, when ultrasound images are taken in a remote location outside of a hospital, such as during home nursing, an operator who operates an ultrasound probe to take the ultrasound images and an operator who takes the ultrasound images, Observers such as doctors who observe and make diagnoses may be different.
At this time, the operator usually needs to operate the ultrasound probe while checking the obtained ultrasound image himself/herself to capture an ultrasound image of the target area within the subject. Particularly when the operator's skill level is low, it may be difficult for the operator to judge whether or not the target part of the subject is being observed accurately. Furthermore, an operator with low skill level may not be able to operate the ultrasound probe using appropriate techniques, resulting in obtaining ultrasound images with low image quality. In addition, the observer must check the ultrasound images taken by the operator of the ultrasound diagnostic equipment to make a diagnosis, but since the observer cannot see how the operator takes the ultrasound images, it is necessary to When an ultrasound image is taken by an operator with low skill, it may be difficult to accurately determine whether the ultrasound image was taken using an appropriate technique.

The present invention has been made to solve these conventional problems, and even when ultrasound images are taken at a remote location, it is possible to obtain appropriate ultrasound images and perform ultrasound diagnosis. An object of the present invention is to provide an ultrasonic system and a method of controlling the ultrasonic system that can improve the accuracy of the ultrasonic system.

In order to achieve the above object, a first ultrasound system according to the present invention is an ultrasound system that includes an ultrasound probe, a mobile information terminal, and an external device, and the ultrasound probe includes a transducer array, A transmitter/receiver circuit that transmits ultrasound from the transducer array and generates a sound ray signal based on the received signal acquired by the transducer array, and generates an ultrasound image based on the sound ray signal generated by the transmitter/receiver circuit. It includes an ultrasound image generation unit and a probe-side wireless communication unit that wirelessly transmits the ultrasound image only to the mobile information terminal, and the mobile information terminal acquires a visual field image of the scanned location of the ultrasound probe in the subject. A camera section, a first input device into which first information is input by an operator of the mobile information terminal, a first information transmission section, and an external device that performs bidirectional wireless communication; a terminal-side wireless communication unit that wirelessly transmits the acquired visual field image, the ultrasound image received from the ultrasound probe, and first information input to the first input device to an external device; a monitor, a second input device into which second information is input by an observer of the external monitor, a second information transmission section, and a display control section that displays the ultrasound image and the visual field image together on the external monitor. and an external wireless communication unit that performs bidirectional wireless communication with the mobile information terminal and wirelessly transmits second information input to the second input device to the mobile information terminal, The first information transmission unit transmits the second information input to the second input device of the external device to the operator, and the second information transmission unit of the external device inputs the second information to the first input device of the mobile information terminal. The present invention is characterized in that two-way information transmission is performed between the portable information terminal and the external device by transmitting the first information obtained to the observer to the observer.

The portable information terminal includes a terminal monitor, and the ultrasound image and the field of view image can be displayed on the terminal monitor.
The mobile information terminal can include a second image synchronization unit that synchronizes the ultrasound image and the visual field image with each other.
Further, the external device includes an input device, and the external wireless communication unit wirelessly transmits external input information input via the input device to the terminal side wireless communication unit, so that the external input information can be displayed on the terminal monitor.
The portable information terminal may be attachable to the head of an operator who operates the ultrasound probe and the portable information terminal.

A first method for controlling an ultrasound system according to the present invention is a method for controlling an ultrasound system including an ultrasound probe, a personal digital assistant, and an external device, the ultrasound probe including a transducer array of the ultrasound probe. transmits ultrasound waves from the transducer array, generates a sound ray signal based on the received signal acquired by the transducer array, generates an ultrasound image based on the generated sound ray signal, and sends the ultrasound image to a mobile information terminal. The mobile information terminal transmits the field of view image of the scanned location of the ultrasound probe on the subject by radio, receives the input of the first information from the operator of the mobile information terminal, and then transmits the field of view image and ultrasound image to the mobile information terminal. The ultrasound image wirelessly transmitted from the sonic probe and the first information whose input has been accepted are wirelessly transmitted to an external device, and the external device displays the ultrasound image and the field of view image together on an external monitor. the mobile information terminal transmits the second information input on the external device to the operator, and the external device observes the first information input on the mobile information terminal. The feature is that two-way information transmission is performed between the portable information terminal and the external device by transmitting the information to the user.

A second ultrasound system according to the present invention is an ultrasound system that includes an ultrasound probe, a mobile information terminal, and an external device, and the ultrasound probe includes a transducer array and transmits ultrasound waves from the transducer array. and a transmitter/receiver circuit that generates a sound ray signal based on the received signal acquired by the transducer array, and a receiver that generates received data before imaging by performing signal processing on the sound ray signal generated by the transmitter/receiver circuit. The mobile information terminal includes a data generation unit and a probe-side wireless communication unit that wirelessly transmits received data only to the mobile information terminal, and the mobile information terminal includes a camera unit that acquires a visual field image of the scanned location of the ultrasound probe in the subject. , a first input device into which first information is input by an operator of the mobile information terminal, a first information transmission unit, and an external device, and performs bidirectional wireless communication with the external device, and at least information that is acquired by the camera unit. a terminal-side wireless communication unit that wirelessly transmits the field-of-view image and the first information input to the first input device to an external device, and the external device includes an external monitor and a second information input by an observer of the external monitor. A second input device into which information is input, a second information transmission unit, and a display control unit that displays an ultrasound image and a visual field image generated based on the received data on an external monitor, The first information transmitting section of the mobile information terminal transmits the second information input to the second input device of the external device to the operator, and the second information transmitting section of the external device transmits the second information inputted to the second input device of the external device. The present invention is characterized in that bidirectional information transmission is performed between the portable information terminal and the external device by transmitting the first information input to the input device to the observer.

The external device can include an image processing unit that generates an ultrasound image based on received data wirelessly transmitted from the probe-side wireless communication unit.
Alternatively, the probe-side wireless communication unit wirelessly transmits the received data to the mobile information terminal,
The mobile information terminal includes an image processing unit that generates an ultrasound image based on received data wirelessly transmitted from the probe side wireless communication unit, and the terminal side wireless communication unit generates an ultrasound image and the ultrasound image generated by the image processing unit. It is also possible to wirelessly transmit the visual field image acquired by the camera unit to an external device.
At this time, the portable information terminal includes a terminal monitor, and the ultrasound image and the visual field image can be displayed on the terminal monitor.

The external device includes an input device, and the external wireless communication unit wirelessly transmits external input information input via the input device to the terminal side wireless communication unit, so that the external input information can be displayed on the terminal monitor.
The portable information terminal may be attachable to the head of an operator who operates the ultrasound probe and the portable information terminal.

A second method for controlling an ultrasound system according to the present invention is a method for controlling an ultrasound system including an ultrasound probe, a personal digital assistant, and an external device, the ultrasound probe including a transducer array of the ultrasound probe. transmits ultrasonic waves from the transducer array, generates a sound ray signal based on the received signal acquired by the transducer array, performs signal processing on the generated sound ray signal to generate received data before imaging, and receives wirelessly transmitting the data to a mobile information terminal, acquiring a field of view image of the scanned location of the ultrasound probe on the subject in the mobile information terminal, receiving input of first information by an operator of the mobile information terminal, and at least The acquired visual field image and the first information whose input has been accepted are wirelessly transmitted to an external device, and the external device displays the ultrasound image and the visual field image generated based on the received data together on an external monitor. , the mobile information terminal receives the input of second information by the observer of the external monitor, the mobile information terminal transmits the second information input on the external device to the operator, and the external device transmits the first information input on the mobile information terminal. It is characterized by bidirectional information transmission between the portable information terminal and the external device by transmitting information to the observer.

According to the present invention, an ultrasonic probe includes a transducer array, a transmitting/receiving circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a received signal acquired by the transducer array, and a transmitting/receiving circuit. and a probe-side wireless communication unit that wirelessly transmits the ultrasound image only to the mobile information terminal. a camera unit that acquires a field-of-view image of a location scanned by an ultrasound probe in a specimen; a first input device into which first information is input by an operator of a mobile information terminal; and a first information transmission unit; It performs bidirectional wireless communication with an external device, and wirelessly transmits the visual field image acquired by the camera unit, the ultrasound image received from the ultrasound probe, and the first information input to the first input device to the external device. the external device includes an external monitor, a second input device into which second information is input by an observer of the external monitor, a second information transmission section, and an ultrasonic wave transmitting terminal side wireless communication section. A display control unit that displays the image and the visual field image together on an external monitor, and a display control unit that performs bidirectional wireless communication with the mobile information terminal, and transmits second information input to the second input device to the mobile information terminal. an external wireless communication unit that transmits wirelessly, the first information transmission unit of the portable information terminal transmits the second information input to the second input device of the external device to the operator, and the second information transmission unit of the external device transmits the second information input to the second input device of the external device The information transmission unit transmits the first information input to the first input device of the mobile information terminal to the observer, thereby performing two-way information transmission between the mobile information terminal and the external device, Even when an ultrasound image is taken at a remote location, an appropriate ultrasound image can be obtained and the accuracy of ultrasound diagnosis can be improved.

1 is a block diagram showing the configuration of an ultrasound system according to Embodiment 1 of the present invention. FIG. FIG. 2 is a block diagram showing the internal configuration of a transmitting and receiving circuit in Embodiment 1 of the present invention. 1 is a diagram schematically showing an example of a portable information terminal in Embodiment 1 of the present invention. FIG. FIG. 3 is a diagram schematically showing an example of an external device in Embodiment 1 of the present invention. FIG. 7 is a diagram schematically showing an example of a cursor placed on a visual field image in a modification of the first embodiment of the present invention. FIG. 3 is a block diagram showing the configuration of a portable information terminal in another modification of the first embodiment of the present invention. FIG. 3 is a block diagram showing the configuration of an external device in another modification of Embodiment 1 of the present invention. FIG. 2 is a block diagram showing the configuration of an ultrasound system according to Embodiment 2 of the present invention. FIG. 3 is a block diagram showing the configuration of an ultrasound system according to Embodiment 3 of the present invention. FIG. 3 is a block diagram showing the configuration of an ultrasound system according to Embodiment 4 of the present invention. It is a block diagram showing the composition of the ultrasonic system concerning Embodiment 5 of the present invention. It is a figure which shows typically the example of the ultrasound image and visual field image displayed on the external device in Embodiment 5 of this invention. It is a block diagram showing the composition of the ultrasonic system concerning Embodiment 6 of the present invention.

Embodiments of the present invention will be described below based on the accompanying drawings.
Although the description of the constituent elements described below is based on typical embodiments of the present invention, the present invention is not limited to such embodiments.
Note that in this specification, a numerical range expressed using "~" means a range that includes the numerical values written before and after "~" as the lower limit and upper limit.
In this specification, "same" and "same" include error ranges generally accepted in the technical field.

Embodiment 1
FIG. 1 shows the configuration of an ultrasound system 1 according to Embodiment 1 of the present invention. The ultrasound system 1 includes an ultrasound probe 2, a mobile information terminal 3, and an external device 4. A portable information terminal 3 and an external device 4 are connected to the ultrasound probe 2 by wireless communication, and the portable information terminal 3 and the external device 4 are connected to each other by wireless communication.

The ultrasound probe 2 includes a transducer array 21, to which a transmitting/receiving circuit 22, a signal processing section 23, and a probe-side wireless communication section 24 are sequentially connected. The probe-side wireless communication unit 24 is connected to the mobile information terminal 3 and the external device 4 by wireless communication. Although not shown, the signal processing section 23 constitutes a received data generation section.
Further, a probe control section 26 is connected to the transmitting/receiving circuit 22, the signal processing section 23, and the probe side wireless communication section 24. Further, the signal processing section 23, the probe side wireless communication section 24, and the probe control section 26 constitute a probe side processor 27.

The mobile information terminal 3 includes a terminal-side wireless communication section 31 that is connected to the ultrasound probe 2 and the external device 4 by wireless communication, and an image processing section 32 is connected to the terminal-side wireless communication section 31. Furthermore, the mobile information terminal 3 includes a camera section 33, and the camera section 33 is connected to the terminal-side wireless communication section 31. Further, an image synchronization section 34 is connected to the image processing section 32 and the camera section 33.
Further, a display control section 35 and a terminal monitor 36 are connected to the image synchronization section 34 in sequence. Further, a terminal control section 37 is connected to the terminal side wireless communication section 31, image processing section 32, camera section 33, image synchronization section 34, and display control section 35. Further, an input device 38 is connected to the terminal control section 37 . Further, the terminal side processor 39 is composed of the terminal side wireless communication section 31, the image processing section 32, the image synchronization section 34, the display control section 35, and the terminal control section 37.

The external device 4 includes an external wireless communication section 41 that is connected to the ultrasound probe 2 and the mobile information terminal 3 by wireless communication, and an image processing section 42 and an image synchronization section 43 are connected to the external wireless communication section 41. ing. Further, the image processing section 42 is connected to an image synchronization section 43. Further, a display control section 44 and an external monitor 45 are connected to the image synchronization section 43 in sequence.
Further, an external control section 46 is connected to the external wireless communication section 41, the image processing section 42, the image synchronization section 43, and the display control section 44. Furthermore, an input device 47 is connected to the external control section 46 . Further, the external wireless communication section 41, the image processing section 42, the image synchronization section 43, the display control section 44, and the external control section 46 constitute an external device side processor 48.

The transducer array 21 of the ultrasound probe 2 has a plurality of transducers arranged one-dimensionally or two-dimensionally. These transducers transmit ultrasonic waves according to drive signals supplied from the transmitting/receiving circuit 22, receive ultrasonic echoes from the subject, and output reception signals based on the ultrasonic echoes. Each vibrator is made of, for example, a piezoelectric ceramic represented by PZT (Lead Zirconate Titanate), a polymer piezoelectric element represented by PVDF (Poly Vinylidene Di Fluoride), and a PMN-PT ( It is constructed by forming electrodes at both ends of a piezoelectric material made of a piezoelectric single crystal such as Lead Magnesium Niobate-Lead Titanate (lead magnesium niobate-lead titanate solid solution).

The transmitting/receiving circuit 22 transmits ultrasonic waves from the transducer array 21 under the control of the probe controller 26 and generates a sound beam signal based on the received signal acquired by the transducer array 21. As shown in FIG. 2, the transmitting/receiving circuit 22 includes a pulser 51 connected to the transducer array 21, an amplifying section 52, an AD (Analog Digital) converting section 53, and a beam former connected in series from the transducer array 21. It has 54.

The pulser 51 includes, for example, a plurality of pulse generators, and transmits pulses from the plurality of transducers of the transducer array 21 based on a transmission delay pattern selected according to a control signal from the probe control unit 26. Each drive signal is supplied to the plurality of transducers with the amount of delay adjusted so that the ultrasonic waves form an ultrasonic beam. In this way, when a pulsed or continuous wave voltage is applied to the electrodes of the transducers of the transducer array 21, the piezoelectric material expands and contracts, and pulsed or continuous wave ultrasound is generated from each transducer. , an ultrasonic beam is formed from the composite wave of those ultrasonic waves.

The transmitted ultrasound beam is reflected by a target such as a part of the subject, and propagates toward the transducer array 21 of the ultrasound probe 2 . The ultrasonic echoes propagating toward the transducer array 21 in this way are expanded and contracted by each transducer configuring the transducer array 21 by receiving the propagating ultrasonic echoes. and outputs these received signals to the amplifying section 52.

The amplifying section 52 amplifies the signals input from the respective vibrators constituting the vibrator array 21 and transmits the amplified signals to the AD converting section 53. The AD conversion section 53 converts the signal transmitted from the amplification section 52 into digital reception data, and transmits this reception data to the beamformer 54. The beamformer 54 performs the following on each received data converted by the AD converter 53 according to the sound speed or the sound speed distribution set based on the reception delay pattern selected according to the control signal from the probe controller 26. So-called reception focus processing is performed by adding the signals with a delay of . Through this reception focus processing, each reception data converted by the AD converter 53 is phased and added, and a sound ray signal in which the ultrasonic echo is focused is acquired.

The signal processing unit 23 performs signal processing on the sound ray signal generated by the beamformer 54 of the transmitting/receiving circuit 22 to generate received data before being imaged. More specifically, the signal processing unit 23 corrects the attenuation caused by the propagation distance on the sound ray signal generated by the beamformer 54 of the transmitting/receiving circuit 22 according to the depth of the position where the ultrasonic wave is reflected. After that, envelope detection processing is performed to generate a signal representing tomographic image information regarding the tissue inside the subject as received data before imaging.

The probe-side wireless communication unit 24 includes an antenna for transmitting and receiving radio waves, and modulates a carrier based on the received data before imaging generated by the signal processing unit 23, thereby transmitting and receiving radio waves. Generate a transmission signal representing the received data. The probe-side wireless communication unit 24 supplies the transmission signal generated in this manner to the antenna and transmits radio waves from the antenna, thereby transmitting the received data before image formation to the terminal-side wireless communication unit 31 of the mobile information terminal 3. Then, the data is sequentially transmitted wirelessly to the external wireless communication unit 41 of the external device 4. Carrier modulation methods include ASK (Amplitude Shift Keying), PSK (Phase Shift Keying), QPSK (Quadrature Phase Shift Keying), and 16QAM (16 Quadrature Amplitude Keying). Modulation: 16 quadrature phase amplitude modulation) etc. are used.

Further, wireless communication between the probe-side wireless communication unit 24 of the ultrasound probe 2, the terminal-side wireless communication unit 31 of the mobile information terminal 3, and the external wireless communication unit 41 of the external device 4 is performed using 5G (5th Generation). Communication standards related to mobile communications such as mobile communication systems), 4G (4th Generation), WiFi (registered trademark), Bluetooth (registered trademark), UWB (Ultra Wide Band), etc. This can be done in accordance with communication standards regarding short-range wireless communication.

Since the ultrasound probe 2 and the mobile information terminal 3 are assumed to be located close to each other, the wireless communication between the ultrasound probe 2 and the mobile information terminal 3 is based on mobile communication and short-range wireless communication. Any wireless communication method can be adopted.
Furthermore, since it is assumed that the external device 4 is located in a remote location with respect to the ultrasound probe 2 and the mobile information terminal 3, wireless communication between the external device 4 and the ultrasound probe 2 and the connection between the external device 4 and the It is preferable that the wireless communication with the portable information terminal 3 be carried out by mobile communication. In particular, from the viewpoint of reducing the time lag in data transmission between the external device 4 and the ultrasound probe 2 and the mobile information terminal 3, wireless communication between the external device 4 and the ultrasound probe 2 and the wireless communication between the external device 4 and the mobile information terminal 3 are important. As the wireless communication with the information terminal 3, it is preferable that mobile communication according to 5G is performed.

The probe control unit 26 controls each part of the ultrasound probe 2 based on a control program stored in advance.
Further, although not shown, a probe side storage section is connected to the probe control section 26. The probe-side storage unit stores a control program for the ultrasound probe 2 and the like. Further, as the probe side storage unit, for example, a flash memory, RAM (Random Access Memory), SD card (Secure Digital card), SSD (Solid State Drive), etc. are used. be able to.
Although not shown, the ultrasonic probe 2 has a built-in battery, and power is supplied from the battery to each circuit of the ultrasonic probe 2.

The probe-side processor 27, which includes the signal processing section 23, the probe-side wireless communication section 24, and the probe control section 26, includes a CPU (Central Processing Unit) and a control unit for causing the CPU to perform various processes. It consists of programs such as FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), and GPU (Graphics Processing Unit). : graphics processing unit), other ICs (Integrated Circuits), or a combination of these.

Further, the signal processing section 23, the probe side wireless communication section 24, and the probe control section 26 of the probe side processor 27 can be partially or entirely integrated into one CPU or the like.

The terminal-side wireless communication unit 31 of the mobile information terminal 3 includes an antenna for transmitting and receiving radio waves, and is controlled by the probe-side wireless communication unit 24 of the ultrasound probe 2 under the control of the terminal control unit 37. A transmission signal representing the transmitted received data before being imaged is received via an antenna, and the received transmission signal is demodulated to output the received data before being imaged. Furthermore, the terminal-side wireless communication section 31 sends the received data before being imaged to the image processing section 32.

The image processing unit 32 raster-converts the received data sent from the terminal-side wireless communication unit 31 before image formation into an image signal according to the scanning method of a normal television signal, and transmits the converted image signal to the terminal. B mode (Brightness mode: Brightness mode) Generates an image signal. The B-mode image signal generated in this manner is simply referred to as an ultrasound image U. The image processing unit 32 also sends the generated ultrasound image U to the image synchronization unit 34.

The camera unit 33 acquires a visual field image C that captures the scanned location of the ultrasound probe 2 on the subject. Although not shown, the camera unit 33 includes a photographic lens, an image sensor that photographs the scanning location of the ultrasound probe 2 through the photographic lens and obtains a visual field image signal that is an analog signal, and a visual field image acquired by the image sensor. An analog signal processing circuit that amplifies a signal and converts it into a digital signal, and a digital signal processing circuit that performs various corrections such as gain on the converted digital signal to generate a visual field image C are built in. The analog signal processing circuit and the digital signal processing circuit can also be built into the terminal side processor 39. The camera section 33 sends the generated visual field image C to the terminal side wireless communication section 31 and the image synchronization section 34. Further, the visual field image C sent to the terminal-side wireless communication unit 31 is wirelessly transmitted to the external device 4 by the terminal-side wireless communication unit 31.

The image synchronization unit 34 synchronizes the ultrasound image U generated by the image processing unit 32 and the visual field image C generated by the camera unit 33, and converts the ultrasound image U and visual field image C into mutually synchronized ultrasound images U and visual field images C. A composite image M is generated based on the image. Here, to synchronize the ultrasound image U and the visual field image C with each other means to associate the ultrasound image U and the visual field image C that are photographed at the same timing with each other. For example, the image processing unit 32 adds a timestamp to the ultrasound image U indicating the time when the ultrasound image U was generated, and the camera unit 33 adds a timestamp indicating the time when the visual field image C was generated. When added to the visual field image C, the image synchronization unit 34 regards the time stamp of the ultrasound image U as representing the time when the ultrasound image U was taken, and assigns the time stamp of the visual field image C to the visual field image. The ultrasound image U and the visual field image C, which were captured at the same timing, are synchronized with each other by assuming that C represents the time when the image was captured and by referring to the time stamps of the ultrasound image U and the visual field image C. be able to.

Furthermore, when associating the ultrasound image U and the visual field image C, the image synchronization unit 34 refers to, for example, the time stamp of the ultrasound image U and the time stamp of the visual field image C, and the ultrasound image U is photographed. If the difference between the time when the visual field image C was taken and the time when the visual field image C was taken is within a certain range, for example within 0.1 seconds, it is assumed that the ultrasound image U and the visual field image C were taken at the same timing. You can make an association by Further, the image synchronization unit 34 refers to the time stamp of the ultrasound image U and the time stamp of the visual field image C, for example, and captures the ultrasound image U at the time closest to the time when the ultrasound image U to be associated is captured. It is also possible to select the selected visual field image C and associate the selected visual field image C with the ultrasound image U. Further, the image synchronization unit 34 selects, for example, an ultrasound image U taken at the closest time to the time when the visual field image C to be associated is taken, and combines the selected ultrasound image U with the ultrasound image U. It is also possible to associate it with the visual field image C.
The image synchronization unit 34 sends the ultrasound image U and visual field image C synchronized in this manner to the display control unit 35.

The display control unit 35 performs predetermined processing on the composite image M sent from the image synchronization unit 34 under the control of the terminal control unit 37, and displays the image on the terminal monitor 36 of the mobile information terminal 3 as shown in FIG. , the synchronized ultrasound image U and visual field image C are displayed together.
The terminal monitor 36 displays an ultrasound image U, a visual field image C, etc. under the control of the display control unit 35, and is, for example, an LCD (Liquid Crystal Display), an organic EL display (Organic Electroluminescence Display), etc. including display devices such as

The input device 38 of the mobile information terminal 3 is used by the operator to perform input operations, and includes a touch sensor placed over the terminal monitor 36. For example, probe control information for controlling the ultrasound probe 2 can be input by the operator via the input device 38 . The probe control information input in this way is sent to the terminal side wireless communication section 31 via the terminal control section 37, and is wirelessly transmitted from the terminal side wireless communication section 31 to the ultrasound probe 2.

The terminal control section 37 controls each section of the mobile information terminal 3 based on a control program stored in advance.
Further, although not shown, a terminal side storage section is connected to the terminal control section 37. The terminal side storage unit stores a control program for the mobile information terminal 3 and the like. Further, as the terminal side storage unit, for example, a flash memory, RAM, SD card, SSD, etc. can be used.
Although not shown, the mobile information terminal 3 has a built-in battery, and power is supplied from the battery to each circuit of the mobile information terminal 3.

Note that the terminal side processor 39, which includes the terminal side wireless communication section 31, the image processing section 32, the image synchronization section 34, the display control section 35, and the terminal control section 37, includes a CPU and a processor for causing the CPU to perform various processes. Although it is constructed from a control program, it may also be constructed using an FPGA, DSP, ASIC, GPU, or other IC, or a combination of these.
Further, the terminal side wireless communication section 31, image processing section 32, image synchronization section 34, display control section 35, and terminal control section 37 of the terminal side processor 39 may be partially or entirely integrated into one CPU, etc. It can also be configured.

The external wireless communication section 41 of the external device 4 includes an antenna for transmitting and receiving radio waves, and under the control of the external control section 46, radio waves are transmitted by the probe side wireless communication section 24 of the ultrasound probe 2. A transmission signal representing the received data before image formation and a transmission signal representing the visual field image C transmitted by the terminal-side wireless communication unit 31 of the mobile information terminal 3 are received via the antenna, and the received transmission signal is demodulated. As a result, the received data and visual field image C before being imaged are output. Furthermore, the external wireless communication unit 41 sends the received data before being imaged to the image processing unit 42 and sends the visual field image C to the image synchronization unit 43.

The image processing unit 42 raster-converts the received data sent from the external wireless communication unit 41 before being converted into an image into an image signal according to a normal television signal scanning method, and displays the converted image signal on an external monitor. The ultrasound image U is generated by performing various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction according to the display format for 45. . The image processing unit 42 sends the generated ultrasound image U to the image synchronization unit 43.

The image synchronization unit 43 of the external device 4 synchronizes the ultrasound image U sent from the image processing unit 42 and the visual field image C sent from the external wireless communication unit 41, and generates a mutually synchronized ultrasound image U. A composite image M is generated based on the visual field image C. For example, the image processing unit 42 of the external device 4 adds a time stamp indicating the time when the ultrasound image U was generated to the ultrasound image U, and the camera unit 33 of the mobile information terminal 3 generates the visual field image C. When a time stamp representing the time at which the ultrasound image U was taken is added to the visual field image C, the image synchronization unit 43 regards the time stamp of the ultrasound image U as representing the time at which the ultrasound image U was taken, and By regarding the time stamp of image C as representing the time when visual field image C was taken, and referring to the time stamps of ultrasound image U and visual field image C, it is possible to compare ultrasound image U taken at the same timing. The visual field images C can be synchronized with each other.

The display control unit 44 performs predetermined processing on the composite image M sent out from the image synchronization unit 43 under the control of the external control unit 46, and displays the image on the external monitor 45 of the external device 4 as shown in FIG. The synchronized ultrasound image U and visual field image C are displayed together.
The external monitor 45 displays the ultrasound image U, visual field image C, etc. under the control of the display control unit 44, and includes a display device such as an LCD or an organic EL display.
The input device 47 of the external device 4 is used by the operator to perform input operations, and includes a touch sensor placed over the external monitor 45 .

The external control section 46 controls each section of the external device 4 based on a control program stored in advance.
Further, although not shown, an external device side storage section is connected to the external device 4. The external device side storage section stores a control program for the external device 4, and the like. Further, as the external device side storage section, for example, a flash memory, RAM, SD card, SSD, etc. can be used.
Although not shown, the external device 4 has a built-in battery, and power is supplied to each circuit of the external device 4 from this battery.

Note that an external device side processor 48 having an external wireless communication section 41, an image processing section 42, an image synchronization section 43, a display control section 44, and an external control section 46 includes a CPU and a processor for causing the CPU to perform various processes. Although it is constructed from a control program, it may also be constructed using an FPGA, DSP, ASIC, GPU, or other IC, or a combination of these.
Further, the external wireless communication section 41, image processing section 42, image synchronization section 43, display control section 44, and external control section 46 of the external device side processor 48 may be partially or entirely integrated into one CPU or the like. It can also be configured.

Next, the operation of the ultrasound system 1 according to the first embodiment of the present invention will be explained.
First, an operator brings the ultrasound probe 2 into contact with the body surface of the subject, and under the control of the probe control unit 26, a plurality of transducer arrays 21 are An ultrasound beam is transmitted from the transducer into the subject. Ultrasonic echoes based on the transmitted ultrasound beams are received by each transducer, and the reception signal, which is an analog signal, is output to the amplification section 52 and amplified, and AD converted by the AD conversion section 53 to obtain reception data. be done. The beamformer 54 performs reception focus processing on this reception data, thereby generating a sound ray signal.

The generated sound ray signal is converted by the signal processing unit 23 into received data before imaging, which is a signal representing tomographic image information regarding the tissue within the subject. At this time, the signal processing unit 23 performs envelope detection processing on the sound ray signal after correcting attenuation due to the propagation distance according to the depth of the position where the ultrasonic wave is reflected.
The probe-side wireless communication unit 24 wirelessly transmits the generated sound ray signal to the mobile information terminal 3 and the external device 4.

The terminal-side wireless communication unit 31 of the mobile information terminal 3 receives the received data before being imaged wirelessly transmitted from the ultrasound probe 2, and sends the received received data before being imaged to the image processing unit 32. . The image processing unit 32 raster-converts the received data sent from the terminal-side wireless communication unit 31 before image formation into an image signal according to the scanning method of a normal television signal, and transmits the converted image signal to the terminal. An ultrasound image U is generated by performing various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction according to the display format for the monitor 36. do. The ultrasound image U generated in this manner is sent to the image synchronization unit 34.

Furthermore, under the control of the terminal control unit 37, the camera unit 33 of the mobile information terminal 3 acquires a visual field image C that captures the scanned location of the ultrasound probe 2 on the subject. Although not shown, at this time, for example, the operator photographs a field of view image C via the input device 38 of the mobile information terminal 3 while directing the photographing lens of the camera unit 33 to the scanning location of the ultrasound probe 2 on the subject. It is possible to input control information indicating that the In this case, for example, the control information input by the operator is input to the terminal control unit 37, so that the terminal control unit 37 controls the camera unit 33 to capture the visual field image C according to the control information. I can do it. The visual field image C acquired in this manner is sent to the terminal side wireless communication section 31 and the image synchronization section 34.

When the image synchronization unit 34 receives the ultrasound image U from the image processing unit 32 and the visual field image C from the camera unit 33, the image synchronization unit 34 synchronizes the received ultrasound image U and the visual field image C with each other so that they are synchronized with each other. A composite image M in which the ultrasound image U and the visual field image C are combined into one is generated. For example, the image processing unit 32 adds a timestamp to the ultrasound image U indicating the time when the ultrasound image U was generated, and the camera unit 33 adds a timestamp indicating the time when the visual field image C was generated. When added to the visual field image C, the image synchronization unit 34 regards the time stamp of the ultrasound image U as representing the time when the ultrasound image U was taken, and assigns the time stamp of the visual field image C to the visual field image. The ultrasound image U and the visual field image C that were captured at the same timing are correlated with each other by regarding the time stamp of the ultrasound image U and the visual field image C as C representing the time when the image was captured. I can do it.

The ultrasound image U and visual field image C synchronized with each other by the image synchronization unit 34 are sent to the display control unit 35 as a composite image M. After performing predetermined processing on the composite image M, the display control unit 35 sends the composite image M to the terminal monitor 36, and as shown in FIG. Display C together with C. In the example shown in FIG. 3, a visual field image C and an ultrasound image U are displayed above and below the terminal monitor 36, respectively. Furthermore, in this example, the visual field image C depicts the ultrasound probe 2 in contact with the abdomen of the subject, and the ultrasound image U depicts the internal tissue of the abdomen of the subject. Therefore, by checking the terminal monitor 36 of the mobile information terminal 3, the operator can simultaneously view the visual field image C representing the scanning location of the ultrasound probe 2 on the subject and the ultrasound image U corresponding to the visual field image C. By confirming this, it is possible to easily associate and understand the scanning location of the ultrasound probe 2 in the subject and the tissue within the subject observed thereby.

Further, the visual field image C acquired by the camera unit 33 is wirelessly transmitted from the terminal side wireless communication unit 31 to the external device 4.
The external wireless communication unit 41 of the external device 4 receives the pre-imaging reception data wirelessly transmitted from the ultrasound probe 2 and the visual field image C wirelessly transmitted from the mobile information terminal 3, and receives the received pre-imaging data. The received data is sent to the image processing section 42, and the received visual field image C is sent to the image synchronization section 43.

The image processing unit 42 raster-converts the received data sent from the external wireless communication unit 41 before being converted into an image into an image signal according to a normal television signal scanning method, and displays the converted image signal on an external monitor. The ultrasound image U is generated by performing various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction according to the display format for 45. . The image processing unit 42 sends the generated ultrasound image U to the image synchronization unit 43.

The image synchronization unit 43 synchronizes the ultrasound image U sent from the image processing unit 42 and the visual field image C sent from the external wireless communication unit 41, and generates the ultrasound image U and visual field image C that are synchronized with each other. A composite image M is generated in which the images are combined into one. For example, the image processing unit 42 of the external device 4 adds a time stamp to the ultrasound image U indicating the time when the ultrasound image U was generated, and the camera unit 33 of the mobile information terminal 3 adds the visual field image C to the ultrasound image U. When a timestamp representing the generated time is given to the visual field image C, the image synchronization unit 43 regards the timestamp of the ultrasound image U as representing the time when the ultrasound image U was taken, By regarding the time stamp of the visual field image C as representing the time when the visual field image C was taken and referring to the time stamps of the ultrasound image U and the visual field image C, the ultrasound image U taken at the same timing can be obtained. and visual field image C can be synchronized with each other. At this time, the time on the portable information terminal 3 and the time on the external device 4 can be shared with each other.

Note that the time on the mobile information terminal 3 and the time on the external device 4 can be shared with each other, but specifically, for example, the time can be shared based on either the mobile information terminal 3 or the external device 4. can be done. For example, if either the mobile information terminal 3 or the external device 4 is connected to the Internet, the internal A clock time may be set.

The ultrasound image U and visual field image C synchronized with each other by the image synchronization unit 43 are sent to the display control unit 44 as a composite image M. After performing predetermined processing on the composite image M, the display control unit 44 sends the composite image M to an external monitor 45, and as shown in FIG. Display C together with C. In the example of FIG. 4, it is shown that the external device 4 is a portable terminal similar to the mobile information terminal 3, and a visual field image C and an ultrasound image U are displayed above and below the terminal monitor 36 of the external device 4, respectively. is displayed. Further, in this example, similarly to the ultrasound image U and the visual field image C displayed on the terminal monitor 36 of the mobile information terminal 3, the ultrasound probe 2 is in contact with the abdomen of the subject in the visual field image C. The situation is depicted, and the internal tissue of the subject's abdomen is depicted in the ultrasound image U.

Here, the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4 display the visual field image C and the ultrasound image U, which are synchronized with each other, respectively. , the same visual field image C and the same ultrasound image U are displayed almost simultaneously. Therefore, for example, even if the external device 4 is located at a remote location relative to the mobile information terminal 3, the observer observing the external monitor 45 can monitor the site of the examination where the subject and operator are located. It is possible to observe the visual field image C and the ultrasound image U taken in almost real time.

By the way, it is generally known that a certain level of proficiency is required in order to accurately understand the internal parts of a subject depicted in an ultrasound image by checking the ultrasound image. There is. Furthermore, it is known that the image quality of ultrasound images generated by an ultrasound diagnostic apparatus is largely influenced by the operator's technique.

For example, when ultrasound images are taken in a remote location outside of a hospital, such as in home nursing care, there is an operator who operates an ultrasound probe to take ultrasound images, and a person who observes the ultrasound images. Observers such as doctors who perform the diagnosis may be different from each other. At this time, the operator usually needs to operate the ultrasound probe while checking the obtained ultrasound image himself/herself to capture an ultrasound image of the target area within the subject. Particularly when the operator's skill level is low, it may be difficult for the operator to judge whether or not the target part of the subject is being observed accurately. Furthermore, an operator with low skill level may not be able to operate the ultrasound probe using appropriate techniques, resulting in obtaining ultrasound images with low image quality.

In addition, an observer located remotely from the subject and the operator will make a diagnosis by checking the ultrasound images taken by the operator of the ultrasound diagnostic equipment; In particular, when an ultrasound image is taken by an unskilled operator, it is difficult to accurately determine whether or not the ultrasound image was taken using an appropriate technique. It was sometimes difficult to judge.

According to the ultrasound system 1 according to the first embodiment of the present invention, since the same visual field image C and ultrasound image U are displayed on the terminal monitor 36 and the external monitor 45 almost simultaneously, for example, the external device 4 Even if C is located at a remote location relative to the mobile information terminal 3, the observer observing the external monitor 45 can view the visual field image C taken at the examination site where the subject and the operator are located. and the ultrasound image U can be observed almost in real time. This allows, for example, a highly skilled observer to give advice to the operator in real time, even if the operator is located remotely from the observer and is less skilled. An appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

Further, according to the ultrasound system 1 according to the first embodiment of the present invention, for example, a visual field image C representing a highly skilled operator operating the ultrasound probe 2, and a visual field image C corresponding to the visual field image C. An appropriate ultrasound image U can also be confirmed by an observer who is located remotely from the operator and who is less skilled. In this way, the ultrasound system 1 according to Embodiment 1 of the present invention is also very useful from the viewpoint of education.

Although it has been explained that the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4 each add a time stamp to the generated ultrasound image U, the mobile information Instead of the image processing unit 32 of the terminal 3 and the image processing unit 42 of the external device 4 adding a time stamp to the ultrasound image U, the signal processing unit 23 of the ultrasound probe 2 performs envelope detection processing. A timestamp can also be added to the signal. In this case, for example, the time on the ultrasound probe 2 and the time on the mobile information terminal 3 are shared with each other, so that the image processing unit 32 of the mobile information terminal 3 generates a signal based on a time stamped signal. The ultrasonic image U generated by the image processing unit 42 of the external device 4 and the visual field image C generated by the camera unit 33 are synchronized with each other, and the ultrasonic image U generated by the image processing unit 42 of the external device 4 and the visual field image C generated by the camera unit 33 are synchronized with each other. C can be synchronized with each other.

Here, the time on the ultrasound probe 2 and the time on the mobile information terminal 3 can be shared, for example, using either the ultrasound probe 2 or the mobile information terminal 3 as a reference. Further, for example, if either the ultrasound probe 2 or the mobile information terminal 3 is connected to the Internet, the time of the built-in clock may be set using a communication protocol such as NTP or NITZ.

Further, the method of synchronizing the ultrasound image U and the visual field image C with each other is not limited to the method using the time stamp described above. For example, as disclosed in Japanese Unexamined Patent Application Publication No. 2011-183056, the timing of capturing the ultrasound image U by the ultrasound probe 2 and the timing of capturing the visual field image C by the camera unit 33 of the mobile information terminal 3 are synchronized, Furthermore, when the time difference between the time when the ultrasound image U is taken and the time when the visual field image C is taken is within a certain range, for example, within 0.1 seconds, the image synchronization unit 34 of the mobile information terminal 3 and The image synchronization unit 43 of the external device 4 considers that the ultrasound image U and the visual field image C are taken at the same timing, and can synchronize the ultrasound image U and the visual field image C with each other.

Further, the image synchronization unit 34 of the mobile information terminal 3 generates a composite image M in which the ultrasound image U and visual field image C that are synchronized with each other are combined into one, and displays the generated composite image M to the display control unit 35. However, instead of generating the composite image M, the ultrasonic image U and visual field image C, which are synchronized with each other, can be sent to the display control unit 35, respectively. In this case, the display control unit 35 performs predetermined processing on the ultrasound image U and visual field image C sent from the image synchronization unit 34, and synchronizes them with each other on the terminal monitor 36, as shown in FIG. The obtained ultrasound image U and visual field image C are displayed together. Therefore, the operator can simultaneously confirm the position of the ultrasound probe 2 and the corresponding state of the tissue within the subject.

Similarly, the image synchronization unit 43 of the external device 4 can send the ultrasound image U and visual field image C that are synchronized with each other to the display control unit 44 instead of generating the composite image M. In this case as well, since the ultrasonic image U and visual field image C, which are synchronized with each other, are displayed simultaneously on the external monitor 45, the observer looking at the external monitor 45 can see where the subject and the operator are located. The visual field image C and the ultrasound image U taken at the inspection site can be observed almost in real time.

Further, although the ultrasound probe 2 and the portable information terminal 3 are connected to each other by wireless communication, for example, instead of being connected by wireless communication, they may be connected to each other by wired communication.
Further, in FIG. 4, the external device 4 is illustrated to be a portable thin computer called a so-called smartphone or a tablet, like the mobile information terminal 3, but the external device 4 is not limited to this. For example, a so-called notebook personal computer, a stationary personal computer, or the like may be used as the external device 4.

Although not shown, a second external device having a monitor is installed near the site where the subject is being examined by the operator, and the second external device is connected to the ultrasound probe 2 and the mobile information terminal 3. It is also possible to connect the ultrasonic image U and the visual field image C to the monitor of a second external device. In particular, when the second external device has a large monitor, the operator can more clearly check the ultrasound image U and visual field image C, so that the operator can see the scanning location of the ultrasound probe 2 on the subject. With this, it is possible to more clearly associate and understand the observed tissues within the subject.

Further, in FIG. 3, the portable information terminal 3 is illustrated as a portable thin computer called a so-called smartphone or a tablet, but the present invention is not limited to this as long as it is a portable information terminal. For example, as the portable information terminal 3, a terminal device that can be worn on the operator's head can also be used. In such a terminal device, for example, a terminal monitor 36 is arranged so as to face the operator's eyes when the terminal device is worn on the head, and a visual field image C representing the front field of view of the operator is captured by the camera unit 33. be done. The operator can indirectly check the front field of view by checking the field of view image C displayed on the terminal monitor 36 instead of directly checking the front field of view. In this way, when the mobile information terminal 3 is attached to the operator's head, the operator does not need to hold the mobile information terminal 3 in his hand. It is possible to perform a variety of examinations, such as inserting a so-called puncture needle into a subject using the other hand while operating the ultrasound probe 2 using the ultrasound probe.

Further, as shown in FIG. 2, the transmitting/receiving circuit 22 has a beamformer 54 together with the amplifying section 52 and the AD converting section 53, but the beamformer 54 is not installed inside the transmitting/receiving circuit 22, but inside the transmitting/receiving circuit 22. and the signal processing section 23. In this case, the beam former 54 can also be configured by the probe side processor 27.

For example, as shown in FIG. 5, external input information such as a cursor A that can be moved by an input operation by an observer via the input device 47 of the external device 4 is transmitted to the external monitor 45 of the external device 4 and the mobile information terminal. 3 terminal monitors 36 at the same time. In this case, for example, when the cursor A displayed on the external monitor 45 of the external device 4 is moved by an input operation by the observer via the input device 47 of the external device 4, the cursor A displayed on the external monitor 45 of the external device 4 is displayed on the terminal monitor 36 of the mobile information terminal 3. The displayed cursor A is also moved in the same way. Thereby, for example, more detailed information can be shared between the operator of the ultrasound probe 2 and the portable information terminal 3A and the observer located near the external device 4A. For example, a highly skilled observer who is observing the ultrasound image U and the visual field image C on the external monitor 45 of the external device 4A may respond to a less skilled operator of the ultrasound probe 2 and the mobile information terminal 3A. The inspection performed by the operator can be easily supported by using the cursor A to indicate the position where the ultrasound probe 2 should be scanned.

Furthermore, for example, the cursor A, which can be moved by an input operation by the operator via the input device 38 of the mobile information terminal 3, may be displayed simultaneously on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4. can. In this case, for example, a highly skilled operator can more easily and in detail educate a less skilled observer located near the external device 4A about ultrasound diagnosis. .
Note that the shape of the cursor A is not limited to the arrow shape, but can have any shape such as a circular shape or a polygonal shape.

Furthermore, for example, audio data can be wirelessly communicated bidirectionally between the portable information terminal 3 and the external device 4. FIG. 6 shows the configuration of a mobile information terminal 3A in a modification of the first embodiment of the present invention. The mobile information terminal 3A is the same as the mobile information terminal 3 shown in FIG. 39A is provided. In the mobile information terminal 3A, a microphone 61 and a speaker 62 are connected to the terminal side wireless communication section 31.

Further, FIG. 7 shows the configuration of an external device 4A in a modification of the first embodiment of the present invention. The external device 4A is the same as the external device 4 shown in FIG. It is equipped with 48A. In the external device 4A, a microphone 63 and a speaker 64 are connected to the external wireless communication section 41.

In a modification of the first embodiment of the present invention, audio data is transmitted and received bidirectionally between the mobile information terminal 3A and the external device 4A. For example, when the ultrasound probe 2 and the operator of the mobile information terminal 3A emit voice toward the mobile information terminal 3A, the emitted voice is input to the microphone 61 of the mobile information terminal 3A, and the microphone 61 converts the voice data into generated. The generated audio data is wirelessly transmitted from the terminal side wireless communication unit 31 to the external device 4A. External wireless communication section 41 of external device 4A receives audio data wirelessly transmitted from mobile information terminal 3A, and sends the received audio data to speaker 64. The speaker 64 reproduces the sounds emitted by the operators of the ultrasound probe 2 and the portable information terminal 3A based on the audio data received from the external wireless communication unit 41.

Further, for example, when an observer who is observing the ultrasound image U and visual field image C on the external monitor 45 of the external device 4A emits a sound toward the external device 4A, the emitted sound is transmitted to the external device 4A. The audio data is input to the microphone 63, and the microphone 63 generates audio data. The generated audio data is wirelessly transmitted from the external wireless communication unit 41 to the mobile information terminal 3A. The terminal-side wireless communication unit 31 of the mobile information terminal 3A receives audio data wirelessly transmitted from the external device 4A, and sends the received audio data to the speaker 62. The speaker 62 reproduces the sound emitted by the observer located near the external device 4 based on the sound data received from the terminal-side wireless communication section 31 .

In this way, by bidirectionally transmitting and receiving audio data between the mobile information terminal 3A and the external device 4A, an observer located near the operator of the ultrasound probe 2 and the mobile information terminal 3A and the external device 4A can You can share more detailed information with other people. For example, a highly skilled observer who is observing the ultrasound image U and the visual field image C on the external monitor 45 of the external device 4A may respond to a less skilled operator of the ultrasound probe 2 and the mobile information terminal 3A. It becomes possible to provide advice more easily and in detail. Furthermore, for example, it is also possible for a highly skilled operator to more easily and in detail educate a less skilled observer located near the external device 4A about ultrasonic diagnosis.

Further, the operator's voice input into the microphone 61 of the mobile information terminal 3A can also be used as the operator's input operation. For example, the terminal control unit 37A acquires instruction information by analyzing audio data generated by the microphone 61 based on the operator's voice, and the camera unit 33 captures the visual field image C according to the acquired instruction information. It is possible to control each part of the mobile information terminal 3A, such as starting and stopping photography. Furthermore, the ultrasound probe 2 can also be controlled based on the audio data analyzed by the terminal control unit 37A. In this case, for example, audio data analyzed by the terminal control unit 37A is wirelessly transmitted from the terminal side wireless communication unit 31 to the ultrasound probe 2 as input information from the operator, and is transmitted via the probe side wireless communication unit 24. and is input to the probe side control section 26. The probe control unit 26 controls each part of the ultrasound probe 2 based on the input information, such as starting and stopping the transmission of ultrasound by the transducer array 21, starting and stopping the imaging of the visual field image C by the camera unit 33, etc. can do.

Furthermore, the observer's voice input into the microphone 63 of the external device 4A can also be used as the observer's input operation. For example, the external control unit 46A acquires instruction information by analyzing voice data generated by the microphone 63 based on the observer's voice, and according to the acquired instruction information, the camera unit 33 of the mobile information terminal 3A Controls each part of the portable information terminal 3A, such as starting and stopping imaging of the visual field image C, and controlling each part of the ultrasound probe 2, such as starting and stopping transmission of ultrasound by the transducer array 21 of the ultrasound probe 2. You can also do this.

Embodiment 2
In the first embodiment, the ultrasonic probe 2 generates pre-imaging reception data in which the sound ray signal is subjected to envelope detection processing, and the generated pre-imaging reception data is transmitted to the mobile information terminal 3 and Although the ultrasound image U is wirelessly transmitted to the external device 4 , the ultrasound image U can also be generated by the ultrasound probe 2 and wirelessly transmitted to the mobile information terminal 3 and the external device 4 .

FIG. 8 shows the configuration of an ultrasound system 1B according to Embodiment 2 of the present invention. The ultrasonic system 1 is the same as the ultrasonic system 1 of the first embodiment shown in FIG. , an external device 4B is provided instead of the external device 4.

The ultrasonic probe 2B is the same as the ultrasonic probe 2 in the first embodiment except that an image processing section 71 is added, a probe control section 26B is provided in place of the probe control section 26, and a probe side processor is provided in place of the probe side processor 27. 27B is provided. In the ultrasound probe 2B, an image processing section 71 is connected to the signal processing section 23. Further, the image processing section 71 is connected to the probe side wireless communication section 24 and the probe control section 26B. Although not shown, the signal processing section 23 and the image processing section 71 constitute an ultrasound image generation section.

In the mobile information terminal 3B, the image processing unit 32 is removed from the mobile information terminal 3 in the first embodiment, a terminal control unit 37B is provided in place of the terminal control unit 37, and a terminal side processor is provided in place of the terminal side processor 39. 39B is provided. In the mobile information terminal 3B, an image synchronization section 34 and a camera section 33 are connected to the terminal side wireless communication section 31.
In the external device 4B, the image processing section 42 is removed from the external device 4 in the first embodiment, an external control section 46B is provided in place of the external control section 46, and an external device side processor is provided in place of the external device side processor 48. 48B is provided.

The image processing unit 71 of the ultrasound probe 2B raster-converts the signal subjected to envelope detection processing by the signal processing unit 23 into an image signal according to the scanning method of a normal television signal, and performs raster conversion on the converted image signal. By performing various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, the display for the terminal monitor 36 of the mobile information terminal 3B is An ultrasound image U according to the format and an ultrasound image U according to the format for the external monitor 45 of the external device 4B are generated. Furthermore, the image processing unit 71 wirelessly transmits the ultrasound image U according to the display format for the terminal monitor 36 of the mobile information terminal 3B from the probe side wireless communication unit 24 to the mobile information terminal 3B, and The ultrasound image U according to the format is wirelessly transmitted from the probe side wireless communication unit 24 to the external device 4B.

The terminal-side wireless communication unit 31 of the mobile information terminal 3B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B, and sends the received ultrasound image U to the image synchronization unit 34.
The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal-side wireless communication unit 31 and the visual field image C generated by the camera unit 33, so that the ultrasound image U and the visual field image C are synchronized with each other. A composite image M is generated based on. For example, the image processing unit 71 of the ultrasound probe 2B adds a time stamp to the ultrasound image U indicating the time when the ultrasound image U was generated, and the camera unit 33 of the mobile information terminal 3B adds the visual field image C to the ultrasound image U. When a timestamp indicating the time at which the visual field image C was generated is assigned to the visual field image C, the image synchronization unit 34 generates the ultrasound image U based on the timestamp assigned to the ultrasound image U and the visual field image C. and visual field image C can be synchronized with each other.

After performing predetermined processing on the composite image M generated by the image synchronization unit 34, the display control unit 35 sends the composite image M to the terminal monitor 36, and as shown in FIG. , the ultrasound image U and the visual field image C, which are synchronized with each other, are displayed together.

The external wireless communication unit 41 of the external device 4B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B and the visual field image C wirelessly transmitted from the mobile information terminal 3B, and transmits the received ultrasound image U and visual field image. C is sent to the image synchronization section 43.
The image synchronization unit 43 synchronizes the ultrasound image U and visual field image C sent from the external wireless communication unit 41, and generates a composite image M based on the ultrasound image U and visual field image C that are synchronized with each other. do.
After performing predetermined processing on the composite image M generated by the image synchronization unit 43, the display control unit 44 sends the composite image M to the external monitor 45, and as shown in FIG. , the ultrasound image U and the visual field image C, which are synchronized with each other, are displayed together.

As described above, according to the ultrasound system 1B according to the second embodiment of the present invention, even if the ultrasound probe 2B is equipped with the image processing section 71, the mobile information terminal 3 is equipped with the image processing section 32. Similar to the ultrasound system 1 of the first embodiment, in which the external device 4 includes the image processing section 42, the same visual field image C and ultrasound image U are displayed on the terminal monitor 36 and the external monitor 45 almost simultaneously. . Therefore, for example, an observer who observes the visual field image C and the ultrasound image U using the external device 4B located at a remote location can give advice to the operator of the ultrasound probe 2B and the mobile information terminal 3B. Therefore, an appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

Furthermore, in the ultrasound system 1 of the first embodiment shown in FIG. In the ultrasound system 1B, since the ultrasound probe 2B is equipped with the image processing unit 71, it is not necessary for the mobile information terminal 3B and the external device 4B to have the image processing units 32 and 42, respectively. The internal configuration of external device 4B is simplified compared to the internal configurations of portable information terminal 3 and external device 4 in ultrasound system 1 of the first embodiment. Therefore, according to the ultrasound system 1B according to the second embodiment, it is possible to reduce the power consumption, calculation load, etc. of the mobile information terminal 3B and the external device 4B, compared to the ultrasound system 1 of the first embodiment. It is.

Embodiment 3
In the first embodiment, the ultrasound image U and the visual field image C are synchronized in the mobile information terminal 3 and the external device 4, respectively. However, for example, the ultrasound image U and the visual field image C are synchronized only in the mobile information terminal 3. It can also be synchronized.

FIG. 9 shows the configuration of an ultrasound system 1C according to Embodiment 3 of the present invention. The ultrasonic system 1 includes an ultrasonic probe 2C having the same internal configuration as the ultrasonic probe 2 in the ultrasonic system 1 of the first embodiment shown in FIG. 3C is provided, and an external device 4C is provided instead of the external device 4. The ultrasonic probe 2C is connected only to the mobile information terminal 3C by wireless communication, and the external device 4C is connected only to the mobile information terminal 3C by wireless communication.

The mobile information terminal 3C is the same as the mobile information terminal 3 in the first embodiment, except that the terminal control unit 37 is replaced by a terminal control unit 37C, and the terminal processor 39 is replaced by a terminal processor 39C. . In the mobile information terminal 3C, an image synchronization unit 34 is connected to the terminal side wireless communication unit 31. Further, the camera section 33 is connected to an image synchronization section 34.

In the external device 4C, the image processing section 42 and the image synchronization section 43 are removed from the external device 4 in the first embodiment, an external control section 46C is provided in place of the external control section 46, and the external device side processor 48 is replaced with the external device 4C. is equipped with an external device side processor 48C. In the external device 4C, a display control section 44 is connected to the external wireless communication section 41.

The probe-side wireless communication unit 24 of the ultrasound probe 2C wirelessly transmits the received data, which has been subjected to envelope detection processing by the signal processing unit 23 and has not yet been imaged, to only the mobile information terminal 3C.
The terminal-side wireless communication unit 31 of the mobile information terminal 3C receives the received data before imaging wirelessly transmitted from the ultrasound probe 2C, and sends the received data before imaging to the image processing unit 32.

The image processing unit 32 raster-converts the received data sent from the terminal-side wireless communication unit 31 before image formation into an image signal according to the scanning method of a normal television signal, and adjusts the brightness of the converted image signal. By performing various necessary image processing such as image size correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, the display format for the terminal monitor 36 of the mobile information terminal 3B is followed. The ultrasound image U is generated in accordance with the format for the ultrasound image U and the external monitor 45 of the external device 4B. Furthermore, the image processing section 32 sends the ultrasound image U according to the display format for the terminal monitor 36 of the mobile information terminal 3B and the ultrasound image U according to the format for the external monitor 45 of the external device 4B to the image synchronization section 34.

The camera unit 33 acquires a visual field image C that captures the scanned location of the ultrasound probe 2C on the subject, and sends the acquired visual field image C to the image synchronization unit 34.
The image synchronization unit 34 synchronizes the ultrasound image U sent out from the image processing unit 32 and the visual field image C sent out from the camera unit 33. More specifically, the image synchronization unit 34 generates a composite image M by synchronizing the ultrasound image U and the visual field image C according to the display format for the terminal monitor 36 of the mobile information terminal 3B, and further generates a composite image M A composite image M is generated by synchronizing the ultrasound image U and visual field image C according to the display format for the external monitor 45 of 4C.

Further, the image synchronization unit 34 sends to the display control unit 35 a composite image M generated based on the ultrasound image U and visual field image C that follow the display format for the terminal monitor 36 of the mobile information terminal 3B that are synchronized with each other. do. After performing predetermined processing on the composite image M sent from the image synchronization unit 34, the display control unit 35 sends the composite image M to the terminal monitor 36, and as shown in FIG. , the ultrasound image U and the visual field image C, which are synchronized with each other, are displayed together. Further, the image synchronization unit 34 sends to the terminal-side wireless communication unit 31 a composite image M generated based on the ultrasound image U and visual field image C in accordance with the display format for the external monitor 45 of the external device 4C.

The terminal-side wireless communication unit 31 wirelessly transmits the composite image M sent out from the image synchronization unit 34 to the external device 4C.
The external wireless communication unit 41 of the external device 4C receives the composite image M wirelessly transmitted from the mobile information terminal 3C, and sends the received composite image M to the display control unit 44. The display control unit 44 performs predetermined processing on the composite image M sent from the external wireless communication unit 41, and then sends the composite image M to the external monitor 45, as shown in FIG. , the ultrasonic image U and visual field image C, which are synchronized with each other, are displayed together.

From the above, according to the ultrasound system 1C according to the third embodiment of the present invention, even if the image processing section 32 and the image synchronization section 34 are provided only in the portable information terminal 3C, the portable information terminal Similar to the ultrasound system 1 of the first embodiment in which the external device 4 includes the image processing unit 32 and the external device 4 includes the image processing unit 42, the same visual field image C and the same ultrasound image are displayed on the terminal monitor 36 and the external monitor 45 almost simultaneously. U will be displayed. Therefore, for example, an observer who observes the visual field image C and the ultrasound image U using the external device 4C located at a remote location can give advice to the operator of the ultrasound probe 2C and the mobile information terminal 3C. Therefore, an appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

Furthermore, in the ultrasound system 1 according to the first embodiment shown in FIG. Since the composite image M generated based on the ultrasound image U and visual field image C is wirelessly transmitted from the information terminal 3C to the external device 4C, there is no need for the external device 4C to have the image processing section 42 and the image synchronization section 43. , the internal configuration of the external device 4C is simpler than the internal configuration of the external device 4 in the first embodiment. Therefore, according to the ultrasound system 1C according to the third embodiment, it is possible to reduce the power consumption, calculation load, etc. of the external device 4C.

Embodiment 4
In Embodiment 3, the reception data before imaging that has been subjected to envelope detection processing by the signal processing unit 23 of the ultrasound probe 2 is wirelessly transmitted to the mobile information terminal 3 and the external device 4. An ultrasound image U can also be generated at .

FIG. 10 shows the configuration of an ultrasound system 1D according to Embodiment 4 of the present invention. The ultrasonic system 1D is the same as the ultrasonic system 1C of the third embodiment shown in FIG. 9, except that an ultrasonic probe 2D is provided in place of the ultrasonic probe 2C, and a portable information terminal 3D is provided in place of the portable information terminal 3C. , an external device 4D is provided instead of the external device 4C. The ultrasonic probe 2D is connected only to the mobile information terminal 3D by wireless communication, and the external device 4D is connected only to the mobile information terminal 3D by wireless communication.

The ultrasonic probe 2D is the same as the ultrasonic probe 2C in the third embodiment except that an image processing section 81 is added, a probe control section 26D is provided instead of the probe control section 26, and a probe side processor is provided instead of the probe side processor 27. 27D is equipped. In the ultrasound probe 2D, an image processing section 81 is connected to the signal processing section 23, and a probe side wireless communication section 24 and a probe control section 26D are connected to the image processing section 81. Although not shown, the signal processing section 23 and the image processing section 81 constitute an ultrasound image generation section.

In the mobile information terminal 3D, the image processing unit 32 is removed from the mobile information terminal 3C in the third embodiment, a terminal control unit 37D is provided in place of the terminal control unit 37C, and a terminal side processor is provided in place of the terminal side processor 39C. 39D is equipped. In the mobile information terminal 3D, an image synchronization unit 34 is connected to the terminal side wireless communication unit 31. Further, the camera section 33 is connected to an image synchronization section 34.

The external device 4D is the same as the external device 4C in the third embodiment except that an external control section 46D is provided in place of the external control section 46C, and an external device-side processor 48D is provided in place of the external device-side processor 48C. .

The image processing unit 81 of the ultrasound probe 2D raster-converts the signal subjected to envelope detection processing by the signal processing unit 23 into an image signal according to the scanning method of a normal television signal, and performs raster conversion on the converted image signal. By performing various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, the display for the terminal monitor 36 of the mobile information terminal 3D is improved. An ultrasound image U according to the format and an ultrasound image U according to the format for the external monitor 45 of the external device 4D are generated. The image processing unit 81 also sends these generated ultrasound images U to the probe-side wireless communication unit 24.

The probe-side wireless communication unit 31 wirelessly transmits the ultrasound image U sent from the image processing unit 81 to the mobile information terminal 3D.
The terminal-side wireless communication unit 31 receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2D, and sends the received ultrasound image U to the image synchronization unit 34.
The camera unit 33 acquires a visual field image C that captures the scanning location of the ultrasound probe 2D in the subject, and sends the acquired visual field image C to the image synchronization unit 34.

The image synchronization unit 34 synchronizes the ultrasound image U transmitted from the terminal-side wireless communication unit 31 and the visual field image C transmitted from the camera unit 33, and synchronizes the ultrasound image U and visual field image C that are synchronized with each other. A composite image M is generated based on the image. Specifically, the image synchronization unit 34 mutually synchronizes the ultrasound image U and the visual field image C according to the format for the terminal monitor 36 of the mobile information terminal 3D, and further synchronizes the ultrasound image U and the visual field image C according to the format for the external monitor 45 of the external device 4D. The ultrasound image U and the visual field image C are synchronized with each other.

The image synchronization unit 34 sends to the display control unit 35 a composite image M generated based on the ultrasound image U and visual field image C that are synchronized with each other in a format for the terminal monitor 36 .
After performing predetermined processing on the composite image M sent from the image synchronization unit 34, the display control unit 35 sends the composite image M to the terminal monitor 36, and as shown in FIG. , the ultrasound image U and the visual field image C, which are synchronized with each other, are displayed together.

Further, the image synchronization unit 34 sends to the terminal side wireless communication unit 31 a composite image M generated based on the ultrasonic image U and the visual field image C in accordance with the format for the external monitor 45 that are synchronized with each other.
The terminal-side wireless communication unit 31 wirelessly transmits the composite image M sent out from the image synchronization unit 34 to the external device 4D.

The external wireless communication unit 41 of the external device 4D receives the composite image M wirelessly transmitted from the mobile information terminal 3D, and sends the received composite image M to the display control unit 44.
The display control unit 44 performs predetermined processing on the composite image M sent from the external wireless communication unit 41, and then sends the composite image M to the external monitor 45, as shown in FIG. , an ultrasound image U and a visual field image C that are synchronized with each other are displayed together.

From the above, according to the ultrasound system 1D according to the fourth embodiment, the image processing section 81 is provided only in the ultrasound probe 2D, and the image synchronization section 34 is provided only in the mobile information terminal 3D. Similarly to the ultrasound system 1C of the third embodiment in which the mobile information terminal 3C includes the image processing unit 32 and the external device 4 includes the image processing unit 42, the terminal monitor 36 and the external monitor 45 are provided with the same field of view almost simultaneously. Image C and ultrasound image U are displayed. Therefore, for example, an observer who observes the visual field image C and the ultrasound image U using the external device 4D located at a remote location can give advice to the operator of the ultrasound probe 2D and the mobile information terminal 3D. Therefore, an appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

Embodiment 5
In the third embodiment, the external device 4C receives the composite image M from the mobile information terminal 3C and displays the received composite image M on the external monitor 45. Therefore, the ultrasound image U displayed on the external monitor 45 However, according to the ultrasonic diagnostic apparatus 1E of the fifth embodiment shown in FIG. The arrangement and size of the ultrasound image U and visual field image C can be arbitrarily changed on the external device 4E side.

FIG. 11 shows the configuration of an ultrasound system 1E according to Embodiment 5 of the present invention. The ultrasonic system 1E is equipped with an ultrasonic probe 2E having the same internal configuration as the ultrasonic probe 2C in the ultrasonic system 1C of Embodiment 3, and is equipped with a mobile information terminal 3E instead of the mobile information terminal 3C. , an external device 4E is provided instead of the external device 4C. The ultrasonic probe 2E is connected only to the mobile information terminal 3E by wireless communication, and the external device 4E is connected only to the mobile information terminal 3E by wireless communication.

The portable information terminal 3E is the same as the portable information terminal 3C in the third embodiment, except that the terminal controller 37 is replaced by a terminal controller 37E, and the terminal processor 39 is replaced by a terminal processor 39E. . In the mobile information terminal 3E, an image synchronization section 34 is connected to the camera section 33, and the image synchronization section 34 is connected to the terminal side wireless communication section 31.

The external device 4E is the same as the external device 4C in the third embodiment, except that an external control section 46E is provided in place of the external control section 46, and an external device-side processor 48E is provided in place of the external device-side processor 48. .

The probe-side wireless communication unit 24 of the ultrasound probe 2E wirelessly transmits the received data, which has been subjected to envelope detection processing by the signal processing unit 23 and has not yet been imaged, to the mobile information terminal 3E.
The terminal-side wireless communication unit 31 of the mobile information terminal 3E receives the received data before imaging that is wirelessly transmitted from the ultrasound probe 2E, and sends the received data before imaging to the image processing unit 32.

The image processing unit 32 generates an ultrasonic image U according to the format for the terminal monitor 36 of the mobile information terminal 3E and the external monitor 45 of the external device 4E based on the received data sent from the terminal side wireless communication unit 31 before image formation. An ultrasound image U is generated according to the display format for. The image processing unit 32 also sends these ultrasound images U to the image synchronization unit 34.
The camera unit 33 acquires a visual field image C that captures the scanned location of the ultrasound probe 2E in the subject, and sends the acquired visual field image C to the image synchronization unit 34.

The image synchronization unit 34 synchronizes the ultrasound image U transmitted from the terminal-side wireless communication unit 31 and the visual field image C transmitted from the camera unit 33 with each other. Specifically, the image synchronization unit 34 mutually synchronizes the ultrasound image U and the visual field image C according to the format for the terminal monitor 36 of the mobile information terminal 3E, and further synchronizes the ultrasound image U and the visual field image C according to the format for the external monitor 45 of the external device 4E. The ultrasound image U and the visual field image C are synchronized with each other.

The image synchronization unit 34 generates the ultrasound image U and the visual field image C, respectively, without generating one composite image M based on the ultrasound image U and the visual field image C that follow the format for the terminal monitor 36 that are synchronized with each other. , is sent to the display control section 35.
The display control unit 35 performs predetermined processing on the ultrasound image U and visual field image C sent from the image synchronization unit 34, and displays ultrasound images synchronized with each other on the terminal monitor 36, as shown in FIG. Image U and visual field image C are displayed together.

Furthermore, the image synchronization unit 34 generates the ultrasound image U and the visual field image C without generating one composite image M based on the ultrasound image U and the visual field image C that follow the format for the external monitor 45 that are synchronized with each other. , respectively, to the terminal side wireless communication section 31.
The terminal-side wireless communication unit 31 wirelessly transmits the ultrasound image U and visual field image C sent from the image synchronization unit 34 to the external device 4E.
The external wireless communication unit 41 of the external device 4E receives the ultrasound image U and visual field image C wirelessly transmitted from the mobile information terminal 3E, and sends the received ultrasound image U and visual field image C to the display control unit 44, respectively. do.

The display control unit 44 performs predetermined processing on the ultrasound image U and visual field image C sent from the external wireless communication unit 41, and displays the ultrasound image U and visual field image C that are synchronized with each other on the external monitor 45. Display together.
Here, the display position and size of the ultrasound image U and visual field image C displayed on the external monitor 45 can be adjusted by an input operation by the observer via the input device 47. can. For example, when an observer inputs instruction information to adjust the arrangement and size of the ultrasound image U and visual field image C on the external monitor 45 via the input device 47, the input instruction information is transmitted to the external control unit 46E. The information is input to the display control unit 44 via. Based on the input instruction information, the display control unit 44 displays an ultrasound image U and a visual field image C that are synchronized with each other, for example, in the arrangement and size as shown in FIG. 12. In the example shown in FIG. 12, the external device 4E, ultrasound image U, and visual field image C are rotated by 90 degrees compared to the example shown in FIG. An ultrasound image U and a visual field image C are displayed on the external monitor 45 as shown in FIG.

From the above, according to the ultrasound system 1E according to the fifth embodiment of the present invention, the arrangement and size of the ultrasound image U and visual field image C displayed on the external monitor 45 of the external device 4E can be adjusted. An observer who observes the ultrasound image U and visual field image C displayed on the monitor 45 can check the ultrasound image U and visual field image C more clearly according to his or her preference.

Embodiment 6
In Embodiment 5, the reception data before imaging that has been subjected to envelope detection processing by the signal processing unit 23 is wirelessly transmitted to the mobile information terminal 3E by the probe side wireless communication unit 24. An ultrasound image U can also be generated at .

FIG. 13 shows the configuration of an ultrasound system 1F according to Embodiment 6 of the present invention. The ultrasonic system 1F is the ultrasonic system 1E according to the fifth embodiment shown in FIG. 11, except that an ultrasonic probe 2F is provided instead of the ultrasonic probe 2E, and a portable information terminal 3F is provided instead of the portable information terminal 3E. In this case, an external device 4F is provided in place of the external device 4E. The ultrasonic probe 2F is connected only to the mobile information terminal 3F by wireless communication, and the external device 4F is connected only to the mobile information terminal 3F by wireless communication.

The ultrasonic probe 2F is the same as the ultrasonic probe 2E in the fifth embodiment except that an image processing section 91 is added, a probe control section 26E is provided instead of the probe control section 26, and a probe side processor is provided instead of the probe side processor 27. 27E is equipped. In the ultrasound probe 2F, an image processing section 91 is connected to the signal processing section 23, and a probe side wireless communication section 24 and a probe control section 26F are connected to the image processing section 91. Although not shown, the signal processing section 23 and the image processing section 91 constitute an ultrasound image generation section.

The mobile information terminal 3F is the same as the mobile information terminal 3E in the fifth embodiment, except that the image processing unit 32 is removed, a terminal control unit 37F is provided in place of the terminal control unit 37E, and a terminal side processor is provided in place of the terminal side processor 39E. It is equipped with 39F. In the mobile information terminal 3F, an image synchronization unit 34 is connected to the terminal side wireless communication unit 31. Further, the camera section 33 is connected to an image synchronization section 34.

The external device 4F is the same as the external device 4E in the fifth embodiment except that an external control section 46F is provided in place of the external control section 46E, and an external device-side processor 48F is provided in place of the external device-side processor 48E. .

The image processing unit 91 of the ultrasound probe 2F raster-converts the signal subjected to envelope detection processing by the signal processing unit 23 into an image signal according to the scanning method of a normal television signal, and performs raster conversion on the converted image signal. By performing various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, the display for the terminal monitor 36 of the mobile information terminal 3F is An ultrasound image U according to the format and an ultrasound image U according to the format for the external monitor 45 of the external device 4F are generated. Further, the image processing unit 91 sends these generated ultrasound images U to the probe-side wireless communication unit 24.

The terminal-side wireless communication unit 31 receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2F, and sends the received ultrasound image U to the image synchronization unit 34.
The camera unit 33 acquires a visual field image C that captures the scanning location of the ultrasound probe 2F in the subject, and sends the acquired visual field image C to the image synchronization unit 34.

The image synchronization unit 34 synchronizes the ultrasound image U transmitted from the terminal-side wireless communication unit 31 and the visual field image C transmitted from the camera unit 33 with each other. Specifically, the image synchronization unit 34 mutually synchronizes the ultrasound image U and the visual field image C according to the format for the terminal monitor 36 of the mobile information terminal 3F, and further synchronizes the ultrasound image U and the visual field image C according to the format for the external monitor 45 of the external device 4F. The ultrasound image U and the visual field image C are synchronized with each other.

The image synchronization unit 34 generates the ultrasound image U and the visual field image C, respectively, without generating one composite image M based on the ultrasound image U and the visual field image C that follow the format for the terminal monitor 36 that are synchronized with each other. , is sent to the display control section 35.
The display control unit 35 performs predetermined processing on the ultrasound image U and visual field image C sent from the image synchronization unit 34, and displays the ultrasound image U and visual field image C that are synchronized with each other on the terminal monitor 36. Display together.

Furthermore, the image synchronization unit 34 generates the ultrasound image U and the visual field image C without generating one composite image M based on the ultrasound image U and the visual field image C that follow the format for the external monitor 45 that are synchronized with each other. , respectively, to the terminal side wireless communication section 31.
The terminal-side wireless communication unit 31 wirelessly transmits the ultrasound image U and visual field image C sent from the image synchronization unit 34 to the external device 4F.

The external wireless communication unit 41 of the external device 4F receives the ultrasound image U and visual field image C wirelessly transmitted from the mobile information terminal 3F, and sends the received ultrasound image U and visual field image C to the display control unit 44, respectively. do.
The display control unit 44 performs predetermined processing on the ultrasound image U and visual field image C sent from the external wireless communication unit 41, and displays the ultrasound image U and visual field image C synchronized with each other on the external monitor 45. displayed together.

At this time, the display control unit 44 can adjust the arrangement and size of the ultrasound image U and visual field image C displayed on the external monitor 45 in accordance with input operations by the observer via the input device 47. As a result, for example, as shown in FIG. 12, the ultrasound image U and visual field image C that are synchronized with each other are displayed together on the external monitor 45.

From the above, according to the ultrasound system 1F according to the sixth embodiment of the present invention, even if the ultrasound probe 2F is equipped with the image processing unit 91, the image displayed on the external monitor 45 of the external device 4F is Since the placement and size of the ultrasonic image U and visual field image C can be adjusted, the observer who observes the ultrasonic image U and visual field image C displayed on the external monitor 45 can adjust the ultrasonic image more clearly according to his/her preference. The acoustic wave image U and the visual field image C can be confirmed.

1, 1B, 1C, 1D, 1E, 1F Ultrasonic system, 2, 2B, 2C, 2D, 2E, 2F Ultrasonic probe, 3, 3A, 3B, 3C, 3D, 3E, 3F Mobile information terminal, 4, 4A , 4B, 4C, 4D, 4E, 4F External device, 21 Transducer array, 22 Transmission/reception circuit, 23 Signal processing section, 24 Probe side wireless communication section, 26, 26B, 26D, 26F Probe control section, 27, 27B, 27D , 27F probe side processor, 31 terminal side wireless communication section, 32, 42, 71, 81, 91 image processing section, 33 camera section, 34, 43 image synchronization section, 35, 44 display control section, 36 terminal monitor, 37, 37A, 37B, 37C, 37D, 37E, 37F Terminal control unit, 38, 47 Input device, 39, 39A, 39B, 39C, 39D, 39E, 39F Terminal side processor, 41 External wireless communication unit, 45 External monitor, 46, 46A, 46B, 46C, 46D, 4E6, 46F External control section, 48, 48A, 48B, 48C, 48D, 48E, 48F External device side processor, 51 Pulser, 52 Amplification section, 53 AD conversion section, 54 Beam former, 61 , 63 microphone, 62, 64 speaker, A cursor, C visual field image, U ultrasound image.

Claims (14)

An ultrasound system comprising an ultrasound probe, a mobile information terminal, and an external device,
The ultrasound probe includes:
a transducer array,
a transmitting/receiving circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a received signal acquired by the transducer array;
an ultrasound image generation unit that generates an ultrasound image based on the sound ray signal generated by the transmission/reception circuit;
a probe-side wireless communication unit that wirelessly transmits the ultrasound image only to the mobile information terminal;
The mobile information terminal is
a camera unit that acquires a field-of-view image of a scanned location of the ultrasound probe in the subject;
a first input device into which first information is input by an operator of the mobile information terminal;
a first information transmission section;
Bidirectional wireless communication is performed with the external device, and the visual field image acquired by the camera unit, the ultrasound image received from the ultrasound probe, and the first input device are input to the first input device. a terminal-side wireless communication unit that wirelessly transmits the information to the external device;
The external device is
external monitor and
a second input device into which second information is input by an observer of the external monitor;
a second information transmission section;
a display control unit that displays the ultrasound image and the visual field image together on the external monitor;
an external wireless communication unit that performs bidirectional wireless communication with the mobile information terminal and wirelessly transmits the second information input to the second input device to the mobile information terminal,
The first information transmitting unit of the mobile information terminal transmits the second information input to the second input device of the external device to the operator, and transmits the second information of the external device. The unit transmits the first information input to the first input device of the mobile information terminal to the observer, thereby performing bidirectional information transmission between the mobile information terminal and the external device. Perform ultrasound system. The mobile information terminal includes a terminal monitor,
The ultrasound system according to claim 1, wherein the ultrasound image and the field of view image are displayed on the terminal monitor. The ultrasound system according to claim 2, wherein the portable information terminal includes a second image synchronization unit that synchronizes the ultrasound image and the visual field image with each other. The external device includes an input device,
The external wireless communication unit wirelessly transmits external input information input via the input device to the terminal side wireless communication unit,
The ultrasound system according to claim 2 or 3, wherein the external input information is displayed on the terminal monitor. The ultrasound system according to any one of claims 1 to 4, wherein the mobile information terminal is attachable to the head of an operator who operates the ultrasound probe and the mobile information terminal. A method for controlling an ultrasound system comprising an ultrasound probe, a mobile information terminal, and an external device, the method comprising:
In the ultrasound probe,
transmitting ultrasound from a transducer array of the ultrasound probe and generating a sound ray signal based on a received signal acquired by the transducer array;
Generating an ultrasound image based on the generated sound ray signal,
wirelessly transmitting the ultrasound image to the mobile information terminal;
In the mobile information terminal,
Obtaining a field of view image of the scanned location of the ultrasound probe in the subject;
accepting input of first information by an operator of the mobile information terminal;
wirelessly transmitting the acquired visual field image, the ultrasound image wirelessly transmitted from the ultrasound probe, and the first information whose input is accepted to the external device;
In the external device,
displaying the ultrasound image and the visual field image together on an external monitor;
accepting input of second information by an observer of the external monitor;
The mobile information terminal transmits the second information input on the external device to the operator, and the external device transmits the first information input on the mobile information terminal to the observer. A method for controlling an ultrasound system, wherein information is transmitted bidirectionally between the portable information terminal and the external device. An ultrasound system comprising an ultrasound probe, a mobile information terminal, and an external device,
The ultrasound probe includes:
a transducer array,
a transmitting/receiving circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a received signal acquired by the transducer array;
a received data generation unit that generates received data before imaging by performing signal processing on the sound ray signal generated by the transmitting and receiving circuit;
a probe-side wireless communication unit that wirelessly transmits the received data only to the mobile information terminal;
The mobile information terminal is
a camera unit that acquires a field-of-view image of a scanned location of the ultrasound probe in the subject;
a first input device into which first information is input by an operator of the mobile information terminal;
a first information transmission section;
A terminal that performs bidirectional wireless communication with the external device and wirelessly transmits at least the visual field image acquired by the camera unit and the first information input to the first input device to the external device. including a side wireless communication section and
The external device is
external monitor and
a second input device into which second information is input by an observer of the external monitor;
a second information transmission section;
a display control unit that displays the ultrasound image generated based on the received data and the visual field image together on the external monitor;
The first information transmitting unit of the mobile information terminal transmits the second information input to the second input device of the external device to the operator, and transmits the second information of the external device. The unit transmits the first information input to the first input device of the mobile information terminal to the observer, thereby performing bidirectional information transmission between the mobile information terminal and the external device. Perform ultrasound system. The ultrasound system according to claim 7, wherein the external device includes an image processing unit that generates an ultrasound image based on the received data wirelessly transmitted from the probe-side wireless communication unit. The probe-side wireless communication unit wirelessly transmits the received data to the mobile information terminal,
The mobile information terminal includes an image processing unit that generates an ultrasound image based on the received data wirelessly transmitted from the probe-side wireless communication unit,
The ultrasound system according to claim 7, wherein the terminal-side wireless communication unit wirelessly transmits the ultrasound image generated by the image processing unit and the visual field image acquired by the camera unit to the external device. The mobile information terminal includes a terminal monitor,
The ultrasound system according to claim 9, wherein the ultrasound image and the field of view image are displayed on the terminal monitor. The ultrasound system according to claim 10, wherein the mobile information terminal includes a second image synchronization unit that synchronizes the ultrasound image and the visual field image with each other. The external device includes an input device,
The external wireless communication unit wirelessly transmits external input information input via the input device to the terminal side wireless communication unit,
The ultrasound system according to claim 10 or 11, wherein the external input information is displayed on the terminal monitor. The ultrasound system according to any one of claims 7 to 12, wherein the mobile information terminal is attachable to the head of an operator who operates the ultrasound probe and the mobile information terminal. A method for controlling an ultrasound system comprising an ultrasound probe, a mobile information terminal, and an external device, the method comprising:
In the ultrasound probe,
transmitting ultrasound from a transducer array of the ultrasound probe and generating a sound ray signal based on a received signal acquired by the transducer array;
generating received data before imaging by performing signal processing on the generated sound ray signal;
wirelessly transmitting the received data to the mobile information terminal;
In the mobile information terminal,
Obtaining a field of view image of the scanned location of the ultrasound probe in the subject;
accepting input of first information by an operator of the mobile information terminal;
wirelessly transmitting at least the acquired visual field image and the first information whose input has been accepted to the external device;
In the external device,
displaying the ultrasound image generated based on the received data and the visual field image together on an external monitor;
accepting input of second information by an observer of the external monitor;
The mobile information terminal transmits the second information input on the external device to the operator, and the external device transmits the first information input on the mobile information terminal to the observer. A method for controlling an ultrasound system, wherein information is transmitted bidirectionally between the portable information terminal and the external device.