KR20240006406A - Ultrasound remote diagnosis system and method thereof - Google Patents

Abstract

An ultrasonic remote diagnosis system according to an embodiment of the present invention includes a main body including a main panel, a touch panel, and a control panel, and a remote device that communicates with the main body, wherein the remote device provides real-time image information of the main panel. Among display data, first control data that is real-time image information of the touch panel, and second control data that is a virtual control panel corresponding to the control panel, at least each information corresponding to the display data and the first control data. It is received independently from the main body, and the display unit, first control unit, and second control unit corresponding to the display data, the first control data, and the second control data, respectively, are displayed so as not to overlap, and the control panel and the second control data are displayed. The operation information by one of the control units is characterized in that the operation information is transmitted between the main body and the remote device so that it can be displayed on the other control unit.

Description

Ultrasound remote diagnosis system and diagnosis method {ULTRASOUND REMOTE DIAGNOSIS SYSTEM AND METHOD THEREOF}

The present invention relates to an ultrasound remote diagnosis system and an ultrasound remote diagnosis method, and specifically to an ultrasound diagnosis system and a diagnosis method capable of remotely diagnosing ultrasound.

Ultrasound imaging refers to sending high-frequency sound waves from the surface of the human body into the inside of the body and then imaging the sound waves reflected from the inside. Ultrasound examination provides ultrasound images in real time. From the conventional analog method to the digital method, there is a change from a 2-dimensional ultrasound diagnostic device to a 3-dimensional and 4-dimensional ultrasound diagnostic device that includes the passage of time. Recently, 4-dimensional ultrasound examination that even expresses the movement of 3-dimensional images is also used. It is becoming.

An ultrasound diagnostic device is a device that irradiates an ultrasound signal generated from a transducer of a probe to an object and receives information on the echo signal reflected from the object to obtain an image of the area inside the object. Diagnostic devices have the advantage of being more stable than diagnostic devices using X-rays and being able to display images in real time, so they are widely used along with other imaging diagnostic devices. In particular, ultrasound diagnostic devices are widely used in various diagnostic processes because they are safer than other diagnostic devices because they have higher accuracy and there is no risk of radiation exposure to the human body.

With the development of ultrasonic remote diagnosis technology, bedside diagnosis and treatment have become possible even in remote locations, and recently, ultrasonic remote diagnosis technology has been utilized in training courses for ultrasonic devices.

The purpose of the present invention is to provide an ultrasonic remote diagnosis system and method that facilitates remote diagnosis by improving operational inconvenience in the ultrasonic remote diagnosis process and improves the accuracy of diagnosis.

The ultrasonic remote diagnosis system according to the present invention includes a remote device that communicates with a main body including a main panel, a touch panel, and a control panel, and the remote device includes display data that is real-time image information of the main panel and the touch panel. Among first control data, which is real-time image information, and second control data, which is a virtual control panel corresponding to the control panel, each information corresponding to at least the display data and the first control data is independently received from the main body, , the display unit, first control unit, and second control unit corresponding to the display data, the first control data, and the second control data, respectively, are displayed so as not to overlap, and are operated by any one of the control panel and the second control unit. The information is characterized in that the operation information is transmitted between the main body and the remote device so that it can be displayed on the other.

The ultrasonic remote diagnosis system according to the present invention includes a main body that communicates with a remote device, the main body includes a main panel, a touch panel, and a control panel, and the remote device includes display data that is real-time image information of the main panel, So that the display unit, first control unit, and second control unit corresponding to the first control data, which is real-time image information of the touch panel, and the second control data, which is a virtual control panel corresponding to the control panel, are displayed without overlapping, The main body independently transmits each information corresponding to at least the display data and the first control data among the display data, the first control data, and the second control data to the remote device, and the control panel, the The manipulation information by one of the second control units is characterized in that the manipulation information is transmitted between the main body and the remote device so that it can be displayed on the other one.

The ultrasonic remote diagnosis system according to the present invention includes a main body including a main panel, a touch panel, and a control panel, and a remote device that communicates with the main body, and the remote device includes display data that is real-time image information of the main panel. , among first control data, which is real-time image information of the touch panel, and second control data, which is a virtual control panel corresponding to the control panel, at least each information corresponding to the display data and the first control data is received from the main body. receives the display data, the first control data, and the second control data independently, displays the display unit, first control unit, and second control unit corresponding to the display data, the first control data, and the second control data, respectively, so that they do not overlap, and displays the display data, the first control data, and the second control data so as not to overlap each other, and any one of the control panel and the second control unit The manipulation information by one is characterized in that the manipulation information is transmitted between the main body and the remote device so that it can be displayed on the other device.

Specifically, operation information by the control panel may be displayed on the second control unit in real time, and operation information by the second control unit may be displayed on the control panel in real time.

Specifically, operation information by the control panel displayed on the second control unit may be displayed as a GUI.

Specifically, there may be one or more remote devices capable of remote connection to the main body.

Specifically, the operation information of the plurality of second control units may be displayed on each of the plurality of second control units.

Specifically, the plurality of operation information displayed on the second control unit may be displayed in a differentiated form.

Specifically, operation information of the plurality of second control units may be displayed on the control panel, respectively.

Specifically, a plurality of operation information displayed on the control panel may be displayed in a differentiated form.

Specifically, the operation information displayed on the control panel may be displayed in a blinking manner on the control panel operation unit.

Specifically, operation information by the control panel and operation information by the second control unit displayed on the control panel may be displayed in distinct forms.

Specifically, the touch panel and the first control unit, and the control panel and the second control unit can each independently transmit and receive in both directions.

The ultrasonic remote diagnosis method according to the present invention is an ultrasonic remote diagnosis method of an ultrasonic remote diagnosis system including a main body including a main panel, a touch panel, and a control panel, and a remote device communicating with the main body, wherein the remote device At least the display data and the first control data among display data that is real-time image information of the main panel, first control data that is real-time image information of the touch panel, and second control data that is a virtual control panel corresponding to the control panel. independently receiving each piece of information corresponding to Displaying the operation information so as not to overlap, and transmitting the operation information between the main body and the remote device so that the operation information by one of the control panel and the second control unit can be displayed on the other one. It is characterized by

Specifically, it may include displaying operation information by the control panel on the second control unit in real time.

Specifically, it may include displaying operation information by the second control unit on the control panel in real time.

Specifically, operation information by the control panel displayed on the second control unit may be displayed as a GUI.

Specifically, there may be one or more remote devices capable of remote connection to the main body.

Specifically, the operation information of the plurality of second control units may be displayed on each of the plurality of second control units.

Specifically, the plurality of operation information displayed on the second control unit may be displayed in a differentiated form.

Specifically, operation information of the plurality of second control units may be displayed on the control panel, respectively.

Specifically, a plurality of operation information displayed on the control panel may be displayed in a differentiated form.

Specifically, the operation information displayed on the control panel may be displayed in a blinking manner on the control panel operation unit.

Specifically, operation information by the control panel and operation information by the second control unit displayed on the control panel may be displayed in distinct forms.

Specifically, the touch panel and the first control unit, and the control panel and the second control unit can each independently transmit and receive in both directions.

The ultrasonic remote diagnosis system and diagnostic method according to the present invention can improve the usability of remote control by allowing a remote device to check the operation process of the main ultrasound equipment during the ultrasonic remote diagnosis process.

The effects of the present invention are not limited to the effects described above, and effects not mentioned can be clearly understood by those skilled in the art from this specification and the attached drawings.

Figure 1 is a block diagram showing the configuration of an ultrasound diagnosis device 100 according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the configuration of an ultrasound diagnosis device 100 according to an embodiment of the present invention.
FIG. 3 is a block diagram showing the configuration of an ultrasound diagnosis device 100 according to an embodiment of the present invention.
Figures 4 (a) to (c) are perspective views of an ultrasound diagnosis device 200 according to at least one embodiment of the present invention.
Figures 5 (a) to (c) are perspective views of an ultrasound diagnosis device 500 according to at least one embodiment of the present invention.
Figure 6a is a diagram for explaining a conventional ultrasound remote diagnosis system.
Figure 6b is a diagram for explaining a conventional ultrasound remote diagnosis system.
FIG. 7A is a diagram for explaining an ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 7B is a diagram for explaining an ultrasound remote diagnosis system 700 according to another embodiment of the present invention.
Figure 8 is a diagram for explaining the measurement mode of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 9A is a diagram illustrating a process for executing the measurement mode of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 9B is a diagram illustrating a process for executing the measurement mode of the ultrasound remote diagnosis system 700 according to another embodiment of the present invention.
FIG. 10 is a diagram illustrating a telemetry process in the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 11 is a diagram illustrating various embodiments of the measurement markers 742 and 744 and the second pointer 740 in the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 12A is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 12B is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to another embodiment of the present invention.
FIG. 13 is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 14 is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 15 is a diagram illustrating a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 16 is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 17 is a diagram illustrating a method of controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 18 is a diagram illustrating a method of controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the present invention.
Figure 19 is a diagram for explaining another embodiment of the remote trackball 727 control method of the ultrasound remote diagnosis system 700 according to the present invention.
FIG. 20A is a diagram for explaining size adjustment of the second control unit 726 in the remote trackball 727 control method of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 20B is a diagram for explaining size adjustment of the second control unit 726 in the remote trackball 727 control method of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 21A is a diagram for explaining the second control unit 726 in the method for controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 21B is a diagram for explaining the second control unit 726 in the method for controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.
FIG. 22 is a diagram for explaining the second control unit 726 in the method for controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.

This specification clarifies the scope of rights of the present invention, explains the principles of the present invention, and discloses embodiments so that those skilled in the art can practice the present invention. The disclosed embodiments may be implemented in various forms.

Throughout this specification, when a part is said to be “connected” to another part, this includes not only direct connection but also indirect connection, and indirect connection refers to connection through a wireless communication network. Includes.

Additionally, the terms used herein are used to describe embodiments and are not intended to limit and/or limit the disclosed invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “comprise” or “have” are intended to indicate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. The existence or addition of numbers, steps, operations, components, parts, or combinations thereof is not excluded in advance.

In addition, terms including ordinal numbers such as “first”, “second”, etc. used in this specification may be used to describe various components, but the components are not limited by the terms, and the terms It is used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention.

Additionally, terms such as "~unit", "~unit", "~block", "~member", and "~module" may refer to a unit that processes at least one function or operation. For example, the terms may refer to at least one hardware such as a field-programmable gate array (FPGA) / application specific integrated circuit (ASIC), at least one software stored in memory, or at least one process processed by a processor. there is.

The codes attached to each step are used to identify each step, and these codes do not indicate the order of each step. Each step is performed differently from the specified order unless a specific order is clearly stated in the context. It can be.

Additionally, images herein may include medical images acquired by medical imaging devices such as magnetic resonance imaging (MRI) devices, computed tomography (CT) devices, ultrasonic imaging devices, or X-ray imaging devices, and include ultrasound images. In addition to ultrasound, medical images of other modalities may be provided or controlled.

Additionally, in this specification, an 'object' is something that is subject to photography and may include a person, an animal, or a part thereof. For example, the object may include a part of the body (organ, etc.) or a phantom.

Throughout the specification, “ultrasonic image” refers to an image of an object that is transmitted to the object and processed based on ultrasonic signals reflected from the object.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a block diagram showing the configuration of an ultrasound diagnosis device 100 according to an embodiment of the present invention.

The ultrasound diagnosis device 100 according to one embodiment includes a probe 20, an ultrasound transceiver 110, a control unit 120, an image processor 130, a display unit 140, a storage unit 150, and a communication unit 160. ), and may include an input unit 170.

The ultrasound diagnosis device 100 can be implemented not only in a cart type but also in a portable form. Examples of portable ultrasound diagnostic devices include, but are not limited to, smart phones, laptop computers, PDAs, and tablet PCs that include probes and applications.

Probe 20 may include a plurality of transducers. A plurality of transducers may transmit ultrasonic signals to the object 10 according to a transmission signal applied from the transmitter 113. A plurality of transducers may receive ultrasonic signals reflected from the object 10 to form a received signal. Additionally, the probe 20 may be implemented integrally with the ultrasound diagnosis device 100, or may be implemented as a separate type connected to the ultrasound diagnosis device 100 by wire or wirelessly. Additionally, the ultrasound diagnosis device 100 may include one or more probes 20 depending on the implementation type.

The control unit 120 controls the transmission unit 113 to form a transmission signal to be applied to each of the plurality of transducers in consideration of the positions and focal points of the plurality of transducers included in the probe 20.

The control unit 120 converts the received signal received from the probe 20 into analog-to-digital, considers the positions and focus points of the plurality of transducers, and sums the digitally converted received signals to generate ultrasonic data. ) is controlled.

The image processor 130 uses ultrasound data generated by the ultrasound receiver 115 to generate an ultrasound image.

Meanwhile, ultrasound images are not only gray-scale ultrasound images that scan the object according to A-mode (amplitude mode), B-mode (brightness mode), and M-mode (motion mode), but also Doppler images of the movement of the object. It can be expressed.

A-mode is the most basic form of ultrasound image display method and displays the intensity of reflected sound as amplitude on the time (distance) axis. If the reflected sound is strong, the amplitude is high, and if the reflected sound is weak, the amplitude is low, so it is advantageous for distance measurement. This mode is currently rarely used because the image changes even if the direction of the probe is slightly different.

M-mode is a variation of A-mode and is a mode that displays the distance of a moving reflector as a temporal change. A region of interest (ROI) in a 2D image is designated as an M line to display changes over time in that area. It is mainly used to observe heart valves, and can also record fetal heart sounds, but recently. It is being largely replaced by the Doppler method.

B-mode is a method of displaying reflected sounds as the brightness of dots and is currently used in most ultrasound diagnostic equipment. The brightness of each dot is proportional to the amplitude of the reflected signal, and recently provides a brightness level of 256 or more. , It is also a mode that displays organ movements in real time. The mode called 2D mode, which stands for B (brightness) mode, displays the cross-sectional image of the object in black and white shades on the screen in real time, and is the most frequently used mode.

In addition, Doppler mode is a mode that measures blood flow by generally detecting the flow of red blood cells in blood vessels. It uses the principle that the wavelength becomes shorter when red blood cells approach the probe and becomes longer when they move away, and is used as a method of displaying blood flow. Accordingly, there are color Doppler, pulse wave Doppler (PW), continuous wave Doppler (CW), etc. Doppler images may include blood flow Doppler images (also called color Doppler images) showing blood flow, tissue Doppler images showing tissue movement, and spectral Doppler images showing the moving speed of the object as a waveform. there is.

In addition, as a complex mode, there is a mode that displays other modes based on 2D by applying two or three modes to one image at the same time, and a 3D mode that displays a three-dimensional image.

In the B-mode processing process, B-mode components are extracted and processed from ultrasound data, and in the image generation process, an ultrasound image in which the signal intensity is expressed as brightness is generated based on the B-mode components extracted in the B-mode processing process. can do. In the Doppler processing process, Doppler components are extracted from ultrasound data, and in the image generation process, a Doppler image expressing the movement of the object 10 in color or waveform can be generated based on the extracted Doppler components.

In the image generation process, a two-dimensional ultrasound image or a three-dimensional image of the object can be generated, and an elastic image that images the degree of deformation of the object according to pressure can also be generated. Furthermore, various additional information can be expressed as text or graphics on the ultrasound image. Meanwhile, the generated ultrasound image can be stored in memory.

In the process of measuring an object in an ultrasound image, a measurement tool for measuring the object may be determined, and one of a plurality of measurement tools may be selected based on user input.

For example, a measurement tool selection menu may be provided to select one of a plurality of measurement tools, and the measurement tool selection menu may be displayed along with the ultrasound image on one screen. Additionally, the measurement tool selection menu may be displayed on a separate screen from the touch screen on which the ultrasound image is displayed.

Additionally, one of the plurality of measurement tools may be determined based on a user input for selecting one of the plurality of measurement items to be measured. Measurement items may include, but are not limited to, length, area, or angle.

Upon receiving a user input for selecting one of the measurement items, a predetermined measurement tool may be determined in response to the selected measurement item.

The display unit 140 may display the generated ultrasound image and various information processed by the ultrasound diagnosis device 100. The ultrasound diagnosis device 100 may include one or more display units 140 depending on the implementation type. Additionally, the display unit 140 can be implemented as a touch screen by combining with a touch panel.

The control unit 120 may control the overall operation of the ultrasound diagnosis device 100 and signal flow between internal components of the ultrasound diagnosis device 100. The control unit 120 may include a memory that stores programs or data for performing the functions of the ultrasound diagnosis device 100, and a processor that processes the programs or data. Additionally, the control unit 120 may control the operation of the ultrasound diagnosis device 100 by receiving a control signal from the input unit 170 or an external device.

The ultrasound diagnosis device 100 includes a communication unit 160 and can be connected to an external device (e.g., server, medical device, portable device (smart phone, tablet PC, wearable device, etc.)) through the communication unit 160. there is.

The communication unit 160 may include one or more components that enable communication with an external device, and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.

The communication unit 160 transmits and receives control signals and data from an external device, and transmits the received control signal to the control unit 120, allowing the control unit 120 to control the ultrasound diagnosis device 100 according to the received control signal. It is also possible.

Alternatively, it is possible for the control unit 120 to transmit a control signal to an external device through the communication unit 160, thereby controlling the external device according to the control signal from the control unit.

For example, the external device may process data from the external device according to a control signal from the control unit received through the communication unit.

A program (artificial intelligence, etc.) capable of controlling the ultrasound diagnosis device 100 may be installed in the external device, and this program may include commands that perform part or all of the operations of the control unit 120.

The program may be pre-installed on the external device, or the user of the external device may download and install the program from a server that provides the application. A server that provides an application may include a recording medium on which the program is stored.

Additionally, in a system comprised of a server and a client device, the program may include the storage medium of the server or the storage medium of the client device. Alternatively, if there is a third device (smart phone, tablet PC, wearable device, etc.) in communication connection with the server or client device, the program product may include the storage medium of the third device. Alternatively, the program may include the S/W program itself transmitted from the server to the client device or a third device, or from the third device to the client device.

In this case, one of the server, the client device, and the third device may execute the program and perform the method according to the disclosed embodiments. Alternatively, two or more of a server, a client device, and a third device may execute the program and perform the methods according to the disclosed embodiments in a distributed manner.

For example, a server (eg, a cloud server or an artificial intelligence server, etc.) may execute a program stored in the server and control a client device connected to the server to perform the method according to the disclosed embodiments.

The storage unit 150 may store various data or programs for driving and controlling the ultrasound diagnosis device 100, input/output ultrasound data, acquired ultrasound images, etc.

The input unit 170 may receive a user's input for controlling the ultrasound diagnosis device 100. For example, the user's input includes manipulating buttons, keypad, mouse, trackball, jog switch, and knob, input by touching the touch pad or touch screen, voice input, motion input, and biometric information input ( For example, iris recognition, fingerprint recognition, etc.), but is not limited thereto.

FIG. 2 is a block diagram showing the configuration of an ultrasound diagnosis device 100 according to an embodiment of the present invention.

Referring to FIG. 2 , the ultrasound diagnosis device 100 may include a wireless probe 20 and an ultrasound system 40.

The wireless probe 20 may include a transmitter 113, a transducer 117, a receiver 115, a control unit 118, and a communication unit 119. In FIG. 2, the wireless probe 20 is shown as including both the transmitting unit 113 and the receiving unit 115. However, depending on the implementation form, the wireless probe 20 includes only a portion of the transmitting unit 113 and the receiving unit 115. may include, and some of the components of the transmitter 113 and the receiver 115 may be included in the ultrasound system 40. Alternatively, the wireless probe 20 may further include an image processing unit 130.

The transducer 117 may include a plurality of transducers. A plurality of transducers may transmit ultrasonic signals to the object 10 according to a transmission signal applied from the transmitter 113. A plurality of transducers may receive ultrasonic signals reflected from the object 10 to form a received signal.

The control unit 118 controls the transmission unit 113 to form a transmission signal to be applied to each of the plurality of transducers, considering the positions and focal points of the plurality of transducers.

The control unit 118 converts the received signal received from the transducer 117 into analog-to-digital, considers the positions and focus points of the plurality of transducers, adds the digitally converted received signals, and generates ultrasonic data. 115) is controlled. Alternatively, when the wireless probe 20 includes the image processor 130, an ultrasound image can be generated using the generated ultrasound data.

The communication unit 119 may wirelessly transmit the generated ultrasound data or ultrasound image to the ultrasound system 40 through a wireless network. Alternatively, the communication unit 119 may receive control signals and data from the ultrasound system 40.

Additionally, the ultrasound diagnosis device 100 may include one or more wireless probes 20 depending on the implementation type.

The ultrasound system 40 may receive ultrasound data or ultrasound images from the wireless probe 20 . The ultrasound system 40 may include a control unit 120, an image processing unit 130, a display unit 140, a storage unit 150, a communication unit 160, and an input unit 170.

The image processing unit 130 uses ultrasound data received from the wireless probe 20 to generate an ultrasound image.

The display unit 140 may display an ultrasound image received from the wireless probe 20, an ultrasound image generated by the ultrasound system 40, and various information processed by the ultrasound diagnosis device 100. The ultrasound diagnosis device 100 may include one or more display units 140 depending on the implementation type. Additionally, the display unit 140 can be implemented as a touch screen by combining with a touch panel.

The control unit 120 may control the overall operation of the ultrasound diagnosis device 100 and signal flow between internal components of the ultrasound diagnosis device 100. The control unit 120 may include a memory that stores programs or data for performing the functions of the ultrasound diagnosis device 100, and a processor that processes the programs or data. Additionally, the control unit 120 may control the operation of the ultrasound diagnosis device 100 by receiving a control signal from the input unit 170 or an external device.

The ultrasound system 40 includes a communication unit 160 and can be connected to an external device (e.g., server, medical device, portable device (smart phone, tablet PC, wearable device, etc.)) through the communication unit 160. .

The communication unit 160 may include one or more components that enable communication with an external device, and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.

The communication unit 160 transmits and receives control signals and data from an external device, and transmits the received control signal to the control unit 120, allowing the control unit 120 to control the ultrasound diagnosis device 100 according to the received control signal. It is also possible.

Alternatively, it is possible for the control unit 120 to transmit a control signal to an external device through the communication unit 160, thereby controlling the external device according to the control signal from the control unit.

For example, the external device may process data from the external device according to a control signal from the control unit received through the communication unit.

A program (artificial intelligence, etc.) capable of controlling the ultrasound diagnosis device 100 may be installed in the external device, and this program may include commands that perform part or all of the operations of the control unit 120.

The program may be pre-installed on the external device, or the user of the external device may download and install the program from a server that provides the application. A server that provides an application may include a recording medium on which the program is stored.

Additionally, in a system comprised of a server and a client device, the program may include the storage medium of the server or the storage medium of the client device. Alternatively, if there is a third device (smart phone, tablet PC, wearable device, etc.) in communication connection with the server or client device, the program product may include the storage medium of the third device. Alternatively, the program may include the S/W program itself transmitted from the server to the client device or a third device, or from the third device to the client device.

In this case, one of the server, the client device, and the third device may execute the program and perform the method according to the disclosed embodiments. Alternatively, the client device may perform the method according to the disclosed embodiments via the server.

Alternatively, two or more of a server, a client device, and a third device may execute the program and perform the methods according to the disclosed embodiments in a distributed manner.

For example, a server (eg, a cloud server or an artificial intelligence server, etc.) may execute a program stored in the server and control a client device connected to the server to perform the method according to the disclosed embodiments.

The storage unit 150 may store various data or programs for driving and controlling the ultrasound diagnosis device 100, input/output ultrasound data, ultrasound images, etc.

The input unit 170 receives a user's input for controlling the ultrasound diagnosis device 100. For example, the user's input includes manipulating buttons, keypad, mouse, trackball, jog switch, and knob, input by touching the touch pad or touch screen, voice input, motion input, and biometric information input ( For example, iris recognition, fingerprint recognition, etc.) may include, but are not limited to this.

FIG. 3 is a block diagram showing the configuration of an ultrasound diagnosis device 100 according to an embodiment of the present invention.

Referring to FIG. 3, the ultrasound diagnosis device 100 includes a probe 20, an ultrasound transceiver 110, a control unit 120, an image processor 130, a display unit 140, an input unit 170, and a storage unit. It may include (150) and a communication unit (160).

The probe 20 according to one embodiment may include a plurality of transducers. A plurality of transducers may be arranged in two dimensions to form a two-dimensional transducer array.

For example, the two-dimensional transducer array may include a plurality of sub-arrays including a plurality of transducers arranged in a first direction in a second direction different from the first direction.

Additionally, the ultrasonic transceiver 110 may include an analog beamformer 116a and a digital beamformer 116b. In FIG. 3, the ultrasonic transceiver 110 and the probe 20 are shown as separate components. However, the probe 20 according to one embodiment includes part or all of the ultrasonic transceiver 110, depending on the implementation type. It can be included. for example,

The probe 20 may include one or both of an analog beamformer 116a and a digital beamformer 116b.

The control unit 120 may calculate a time delay value for digital beamforming for each sub-array for each of the plurality of sub-arrays included in the two-dimensional transducer array. Additionally, the control unit 120 may calculate a time delay value for analog beamforming for each transducer included in one of the plurality of sub-arrays.

The control unit 120 operates the analog beamformer 116a and the digital beamformer ( 116b) can be controlled.

Additionally, the controller 120 may control the analog beamformer 116a to sum up the signals received from a plurality of transducers for each sub-array according to the time delay value for analog beamforming. Additionally, the control unit 120 may control the ultrasonic transceiver unit 110 to convert the summed signal for each sub-array to analog to digital. Additionally, the control unit 120 may control the digital beamformer 116b to generate ultrasound data by summing the digitally converted signals according to a time delay value for digital beamforming.

The image processing unit 130 generates an ultrasound image using the generated ultrasound data.

The display unit 140 may display the generated ultrasound image and various information processed by the ultrasound diagnosis device 100. The ultrasound diagnosis device 100 may include one or more display units 140 depending on the implementation type. Additionally, the display unit 140 can be implemented as a touch screen by combining with a touch panel.

The control unit 120 may control the overall operation of the ultrasound diagnosis device 100 and signal flow between internal components of the ultrasound diagnosis device 100. The control unit 120 may include a memory that stores programs or data for performing the functions of the ultrasound diagnosis device 100, and a processor that processes the programs or data. Additionally, the control unit 120 may control the operation of the ultrasound diagnosis device 100 by receiving a control signal from the input unit 170 or an external device.

The ultrasound diagnosis device 100 includes a communication unit 160 and can be connected to an external device (e.g., server, medical device, portable device (smart phone, tablet PC, wearable device, etc.)) through the communication unit 160. there is.

The communication unit 160 may include one or more components that enable communication with an external device, and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.

The communication unit 160 transmits and receives control signals and data from an external device, and transmits the received control signal to the control unit 120, allowing the control unit 120 to control the ultrasound diagnosis device 100 according to the received control signal. It is also possible.

Alternatively, it is possible for the control unit 120 to transmit a control signal to an external device through the communication unit 160, thereby controlling the external device according to the control signal from the control unit.

For example, the external device may process data from the external device according to a control signal from the control unit received through the communication unit.

A program (artificial intelligence, etc.) capable of controlling the ultrasound diagnosis device 100 may be installed in the external device, and this program may include commands that perform part or all of the operations of the control unit 120.

The program may be pre-installed on the external device, or the user of the external device may download and install the program from a server that provides the application. A server that provides an application may include a recording medium on which the program is stored.

Additionally, in a system comprised of a server and a client device, the program may include the storage medium of the server or the storage medium of the client device. Alternatively, if there is a third device (smart phone, tablet PC, wearable device, etc.) in communication connection with the server or client device, the program product may include the storage medium of the third device. Alternatively, the program may include the S/W program itself transmitted from the server to the client device or a third device, or from the third device to the client device.

In this case, one of the server, the client device, and the third device may execute the program and perform the method according to the disclosed embodiments. Alternatively, two or more of a server, a client device, and a third device may execute the program and perform the methods according to the disclosed embodiments in a distributed manner.

For example, a server (eg, a cloud server or an artificial intelligence server, etc.) may execute a program stored in the server and control a client device connected to the server to perform the method according to the disclosed embodiments.

The storage unit 150 may store various data or programs for driving and controlling the ultrasound diagnosis device 100, input/output ultrasound data, ultrasound images, etc.

The input unit 170 may receive a user's input for controlling the ultrasound diagnosis device 100. For example, the user's input includes manipulating buttons, keypad, mouse, trackball, jog switch, and knob, input by touching the touch pad or touch screen, voice input, motion input, and biometric information input ( For example, iris recognition, fingerprint recognition, etc.), but is not limited thereto.

Figures 4 (a) to (c) are perspective views of an ultrasound diagnosis device 200 according to at least one embodiment of the present invention.

Referring to FIGS. 4A and 4B , the ultrasound diagnosis devices 200a and 200b may include a main display unit 221 and a sub-display unit 222. One of the main display unit 221 and the sub display unit 222 may be implemented as a touch screen. The main display unit 221 and the sub display unit 222 may display ultrasound images or various information processed by the ultrasound diagnosis devices 200a and 200b. In addition, the main display unit 221 and the sub-display unit 222 are implemented as touch screens and provide a GUI, so that data for controlling the ultrasound diagnosis devices 200a and 200b can be input from the user. For example, the main display unit 221 may display an ultrasound image, and the sub-display unit 222 may display a control panel for controlling the display of the ultrasound image in a GUI form. The sub-display unit 222 can receive data for controlling the display of images through a control panel displayed in GUI form. The ultrasound diagnosis devices 200a and 200b can control the display of ultrasound images displayed on the main display unit 221 using input control data.

Referring to (b) of FIG. 4 , the ultrasound diagnosis device 200b may further include a control panel 265 in addition to the main display unit 221 and the sub-display unit 222. The control panel 265 may include buttons, trackballs, jog switches, knobs, etc., and may receive data input for controlling the ultrasound diagnosis device 200b from the user. For example, the control panel 265 may include a Time Gain Compensation (TGC) button 271, a Freeze button 272, etc. The TGC button 271 is a button for setting the TGC value for each depth of the ultrasound image. Additionally, when the ultrasound diagnosis device 200b detects the Freeze button 272 input while scanning an ultrasound image, the frame image at that point in time can be displayed.

Meanwhile, buttons, trackballs, jog switches, knobs, etc. included in the control panel 265 may be provided as a GUI on the main display unit 221 or the sub display unit 222.

Referring to (c) of FIG. 4, the ultrasound diagnosis device 200c can also be implemented as a portable device. Examples of the portable ultrasound diagnosis device 200c may include, but are not limited to, a smart phone, laptop computer, PDA, tablet PC, etc. including a probe and an application.

The ultrasound diagnosis device 200c includes a probe 20 and a main body 240, and the probe 20 may be connected to one side of the main body 240 by wire or wirelessly. The main body 240 may include a touch screen 245. The touch screen 245 can display ultrasound images, various information processed by the ultrasound diagnosis device, and a GUI.

Figures 5 (a) to (c) are perspective views of an ultrasound diagnosis device 500 according to at least one embodiment of the present invention.

Referring to (a) of FIG. 5, an ultrasonic diagnostic device used indoors or an indoor ultrasonic diagnostic device 500 generally refers to a non-portable ultrasound diagnostic device used for ultrasound diagnosis, and this ultrasonic diagnostic device 500 ) is also called cart base equipment. The ultrasonic diagnosis device 500 does not necessarily have to be used only indoors, but for convenience, it will be referred to as an indoor ultrasound diagnosis device 500.

The indoor ultrasound diagnosis device 500 may have a portable docking unit 580 connected to the portable ultrasound diagnosis device 400, and the portable docking unit 580 of the indoor ultrasound diagnosis device 500 used in the present invention. All components except are commonly used, so detailed descriptions thereof will be omitted.

Unlike the portable ultrasound diagnosis device 400, the indoor ultrasound diagnosis device 500 has fewer constraints in terms of size, weight, and power consumption, so it can be developed with diverse diagnostic items and high performance. If the portable ultrasound diagnosis device 400 is mounted on the indoor ultrasound diagnosis device 500, the portable ultrasound diagnosis device 400 can be used with high performance. However, the position where the portable ultrasound diagnosis device 400 is mounted on the indoor ultrasound diagnosis device 500 can be any location that is convenient for the user to use the portable ultrasound diagnosis device 400 and the indoor ultrasound diagnosis device 500 at the same time. There are no restrictions anywhere and it is not limited by (a) in Figure 5. Furthermore, the portable ultrasound diagnosis device 400 may be connected to the indoor ultrasound diagnosis device 500 through a wire or integrated connection.

Referring to Figures 5 (a) and (b), the portable ultrasound diagnosis device 400 of Figure 5 (a) may correspond to the portable ultrasound diagnosis device 201 of Figure 5 (b).

It can be formed integrally with a probe (not shown) including a plurality of transducer elements. Specifically, the portable ultrasound diagnosis device 400 is connected to the indoor ultrasound diagnosis device 500 using a wireless or wired communication method (including USB (Universal Serial Bus)) and provides ultrasound images to the user using received ultrasound image data. refers to the device provided. As an example, the portable ultrasound diagnosis device 400 may be a smart device that downloads and installs an application on a smartphone, etc.

Specifically, the portable ultrasound diagnosis device 400 may be a device that is connected to the indoor ultrasound diagnosis device 500 through wired or wireless communication and provides ultrasound images to the user using received ultrasound image data.

As an example, the wireless communication method may include at least one short-range data communication method including a 60 GHz (mmWave) wireless local area network (WLAN). Wireless local area network (Wi-Fi), Bluetooth, ZigBee, Wi-Fi Direct (WFD), Infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), wireless broadband Internet (Wibro), microwave access (WiMAX) ), the Worldwide Interoperability Shared Radio Access Protocol (SWAP), the Wireless Gigabit Alliance (WiGig), and radio frequency (RF) communications.

Figure 5(b) illustrates an ultrasound diagnosis system in which a portable ultrasound diagnosis device 201 is connected to a cart-based ultrasound diagnosis device 500.

The cart-based ultrasound diagnosis device 500 can be connected to the portable ultrasound diagnosis device 201 using the wireless communication method described above. Specifically, the portable ultrasound diagnosis device 201 may be equipped with at least one wireless communication module (not shown) for performing at least one of the wireless communication methods described above. Furthermore, the portable docking unit 580 of the cart-based ultrasound diagnosis device 500 may include at least one wireless communication module (not shown) for performing wireless communication with the portable ultrasound diagnosis device 201.

At this time, the wireless communication module in the cart-based ultrasound diagnosis device 500 may be a module for performing communication according to at least one of the wireless communication methods described above.

Figure 5(c) illustrates an ultrasound diagnosis system in which a portable ultrasound diagnosis device 202 is connected to a cart-based ultrasound diagnosis device 500.

The portable ultrasound diagnosis device 202 may be coupled to the probe 301 through a probe port. The portable ultrasound diagnosis device 202 may generate an ultrasound image using an ultrasound image corresponding to the ultrasound signal received by the probe 301 and display it on the display unit.

The cart-based ultrasound diagnosis device 500 can be connected to the portable ultrasound diagnosis device 202 using the wireless communication method described above. The connection through wireless communication between the cart-based ultrasound diagnosis device 500 and the portable ultrasound diagnosis device 202 corresponds to the connection between the cart-based ultrasound diagnosis device 500 and the portable ultrasound diagnosis device 201, and a detailed description thereof. will be omitted.

Hereinafter, an embodiment of an ultrasonic remote diagnosis system that can be applied to at least one of the ultrasonic diagnostic devices mentioned in FIGS. 1 to 3 and the like mentioned above will be described.

Figure 6a is a diagram for explaining a conventional ultrasound remote diagnosis system.

The conventional ultrasound remote diagnosis system shown in FIG. 6A transmits only the portion corresponding to the main panel of the ultrasound device body to a remote monitor, so only the main panel on which the ultrasound image is displayed can be displayed on the remote monitor. In this case, the parts corresponding to the touch panel and control panel, which are components of the ultrasonic device main body, are not displayed on the remote monitor.

Figure 6b is a diagram for explaining a conventional ultrasound remote diagnosis system.

The conventional ultrasonic remote diagnosis system shown in Figure 6b is a system in which all parts corresponding to the main panel, touch panel, and control panel of the ultrasound device are displayed on a remote monitor, and the main panel, touch panel, and control panel are connected to a single signal. This is a mirroring technology that transmits data to the monitor of a remote device.

This method displays the main panel, touch panel, and control panel corresponding to the ultrasound image on the monitor of the ultrasound device, and transmits the entire image displayed on the monitor at once. In the conventional system of Figure 6b, all three screens of the main panel, touch panel, and control panel are displayed on the monitor of the remote device, but with the screen corresponding to the main panel displayed on the entire remote monitor, the touch panel and control panel are displayed. The screen corresponding to the panel is displayed in an overlapping format.

This is a technology in which three pieces of information are transmitted as a single signal, and can only be displayed in an overlapping form on the remote device's monitor, causing inconvenience in diagnosis as the user cannot see the entire screen corresponding to the main panel. . In order to check the ultrasound image, diagnosis must be made by moving the ultrasound image to a position that does not overlap with the screen corresponding to the touch panel and control panel.

The ultrasound remote diagnosis system 700 and diagnosis method according to the present invention will be described below as an attempt to improve the above-mentioned inconvenience.

FIG. 7A is a diagram for explaining an ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

As shown in FIG. 7A, the ultrasound remote diagnosis system 700 according to an embodiment of the present invention includes a main body 710 including a main panel 712, a touch panel 714, and a control panel 716. , and a remote device 720 that communicates with the main body 710.

The remote device 720 includes display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and second control data that is a virtual control panel corresponding to the control panel 716. A display unit 722 that independently receives information corresponding to at least display data and first control data among the control data from the main body 710, and corresponding to the display data, first control data, and second control data, respectively; The first control unit 724 and the second control unit 726 are displayed so as not to overlap, and the main body 710 is operated remotely in a measurement mode in which the object is measured based on a marker set in the ultrasound image displayed on the main panel 712. Characterized by receiving the marker information for measurement input to at least one of the display unit 722, the first control unit 724, and the second control unit 726 of the device 720 and displaying it on the main panel 712. do.

According to another embodiment of the present invention, the ultrasonic remote diagnosis system 700 includes a remote device 720 that communicates with the main body 710 including a main panel 712, a touch panel 714, and a control panel 716. ) includes.

The remote device 720 includes display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and second control data that is a virtual control panel corresponding to the control panel 716. A display unit 722 independently receives information corresponding to at least display data and the first control data among the control data from the main body 710, and corresponds to the display data, first control data, and second control data, respectively. In a measurement mode in which the first control unit 724 and the second control unit 726 are displayed so as not to overlap, and the object is measured based on a marker set in the ultrasound image displayed on the main panel 712, the display unit 722, the second control unit 726, Marker information for measurement input to at least one of the first control unit 724 and the second control unit 726 is transmitted to the main body 710 so that it can be displayed on the main panel 712.

According to another embodiment of the present invention, the ultrasound remote diagnosis system 700 includes a main body 710 that communicates with a remote device 720.

The remote device 720 displays display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and second control that is a virtual control panel corresponding to the control panel 716. So that the display unit 722, first control unit 724, and second control unit 726 corresponding to the data can be displayed without overlapping, the main body 710 is configured to select one of the display data, first control data, and second control data. In a measurement mode in which each information corresponding to at least the display data and the first control data is independently transmitted to the remote device 720 and the object is measured based on a marker set in the ultrasound image displayed on the main panel 712, Marker information for measurement input to at least one of the display unit 722, the first control unit 724, and the second control unit 726 is received by the main body 710 and displayed on the main panel 712. .

In FIGS. 6A and 6B described above, information corresponding to the main panel, touch panel, and control panel of the existing main body was transmitted to a remote device in the form of a single signal. However, unlike this, the ultrasonic remote diagnosis system according to the present invention ( 700) is characterized in that information corresponding to the main panel 712, the touch panel 714, and the control panel 716 of the main body 710 are transmitted as separate signals to the remote device 720. Therefore, in the remote device 720 of the present invention, the display unit 722, the first control unit 724, and the second control unit 726 can each be displayed without overlapping and can be adjusted independently.

In the present invention, the information corresponding to the main panel 712, the touch panel 714, and the control panel 716 of the main body 710 are transmitted as separate signals to the remote device 720. The display unit 722, the first control unit 724, and the second control unit 726 are characterized in that each can be adjusted independently. According to another embodiment, after being transmitted to overlap, each is independently controlled. You can also adjust the size so that they do not overlap.

The remote device 720 may include a monitor and, depending on the embodiment, may include a virtual monitor such as AR/VR/MR.

The display unit 722 displays an ultrasound scan screen in real time, and the first control unit 724 corresponding to the real-time image of the touch panel 714 may be displayed as a video.

For reference, in the case of conventional technology where the control panel itself is a touch panel, the main panel is vertical. In this case, as explained above, the transmission method from the main unit to the remote device in the prior art is to transmit the entire main screen as a single signal, so the entire screen displayed on the main unit has no choice but to be integrated and moved, so the main panel and controls The panels are transmitted as they are arranged vertically. The monitor of the remote device is generally horizontal, and in this case, it is difficult to display the vertical display placed on the main body as is, and even if it is displayed, there is a problem that the screen becomes small or cut off.

The present invention is a technology characterized by transmitting independent signals to the main panel 712, touch panel 714, and control panel 716 of the main body 710 to a remote device 720 as separate signals, There is an advantage that the main body 710 and the remote device 720 can easily display a complete screen regardless of whether it is horizontal or vertical.

The second control unit 726 in the present invention is a virtual control panel corresponding to the control panel 716 of the main body 710, and may have the same shape as the actual control panel 716 of the main body 710. Specifically, the screen displayed on the second control unit 726 matches the control panel 716, which is the actual hardware of the main body 710, and matches the buttons provided on the control panel 716, functions by buttons, etc. A virtual control panel with shape and function may be displayed.

That is, the second control unit 726 may display the same shape as the control panel 716 based on the second control data, which is information about the model of the control panel 716.

In the remote device 720 of the present invention, the screens of the display unit 722, the first control unit 724, and the second control unit 726 are displayed separately, making it convenient to manipulate images or view detailed screens.

In the present invention, the user can operate the first control unit 724 and the second control unit 726 displayed on the remote device 720 using the remote mouse 750.

The first control unit 724 can be clicked with the remote mouse 750, and at this time, the input value through the remote mouse 750 is changed into relative position information on the screen and transmitted to the main body 710, thereby completing the task. It can be done.

Additionally, the second control unit 726 can be operated by clicking or dragging, and can also be operated using a mouse wheel.

For example, in the case where the operation configuration of the control panel 716 of the main body 710 is a rotation operation method in the + and - directions, the operation method of the second control unit 726 displayed on the remote device 720 You can manipulate the parts marked with + and - by clicking them with the remote mouse 750. Alternatively, the configuration rotated on the actual control panel 716 can be rotated by dragging using the remote mouse 750 on the remote device 720, and + and - can be manipulated depending on the direction in which the wheel is rolled. there is.

The user's frequently used operation buttons and operation contents can be assigned in advance to specific keys on the remote keyboard 760 and used as shortcut keys.

The measurement mode refers to measuring an object included in an ultrasound image. In the measurement mode, the object to be measured can be measured based on a marker displayed on the ultrasound image. Regarding the marker, it will be explained in Figures 10 and 11 below.

There may be more than one remote device 720 capable of remote connection with the main body 710. The following description is made for the case where there is only one remote device 720. However, if there are multiple remote devices 720, the same method is used. This can be.

FIG. 7B is a diagram for explaining an ultrasound remote diagnosis system 700 according to another embodiment of the present invention.

Figure 7b shows a case where the monitor of the remote device 720 is a dual monitor consisting of a first monitor and a second monitor. In this case, the display unit 722 is on the first monitor, the first control unit 724, and the second monitor. The control unit 726 may be displayed on the second monitor.

The monitor of the remote device 720 of the present invention may be horizontal, as shown in FIGS. 7A and 7B, but may also be vertical, with a long width compared to the height.

In the case of a vertical monitor, the display unit 722 may be displayed at the top of the monitor of the remote device 720, and the first control unit 724 and the second control unit 726 may be displayed at the bottom of the monitor of the remote device 720, Conversely, the display unit 722 may be displayed at the bottom, and the first control unit 724 and the second control unit 726 may be displayed at the top.

The position of each screen displayed on the monitor of the remote device 720 is not limited to the positions described above, and may include all cases where the screen is displayed without overlapping parts.

Figure 8 is a diagram for explaining the measurement mode of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

As shown in FIG. 8, in the ultrasound remote diagnosis system 700 according to an embodiment of the present invention, in the measurement mode, information input to the display unit 722 is transmitted to the main body 710 and displayed on the main panel 712. ) can be displayed.

In the present invention, the touch panel 714 and the first control unit 724, and the control panel 716 and the second control unit 726 can transmit and receive independently in both directions. However, when not in the measurement mode, between the main panel 712 of the main body 710 and the display unit 722 of the remote device 720, the main panel 712 of the main body 710 displays the Only one-way information transmission is possible to the display unit 722.

On the other hand, in the measurement mode, as shown in FIG. 8, the main panel 712 of the main body 710 and the display unit 722 of the remote device 720 can transmit and receive information in two directions.

The present inventor's ultrasonic remote diagnosis system 700 can execute a measurement mode by adjusting the main panel 712 of the main body 710 or touching the touch panel 714, as well as controlling the remote device 720. ) is also possible to execute measurement mode. Execution of the measurement mode through the remote device 720 will be described in FIGS. 9A and 9B below.

In the measurement mode, the measurement process that progresses through the main body 710 and the remote device 720 can be displayed identically on both the main panel 712 of the main body 710 and the display unit 722 of the remote device 720. .

When the ultrasound remote diagnosis system 700 of the present invention is in the measurement mode, a first pointer (not shown) corresponding to the mouse cursor of the main body 710 may be displayed on the display unit 722, and the remote device 720 A second pointer 740 corresponding to the mouse cursor may be displayed, and both the first pointer (not shown) and the second pointer 740 may be displayed.

When there are a plurality of remote devices 720, each remote device 720 can independently execute a measurement mode.

At this time, the measurement process can be displayed not only on the remote device 720 performing the measurement, but also on other remote devices 720. When measurements are performed simultaneously on a plurality of remote devices 720, the display method and display order are not limited in this specification.

FIG. 9A is a diagram illustrating a process for executing the measurement mode of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

In the ultrasonic remote diagnosis system 700 of the present invention, in order to execute the measurement mode, the measurement mode must first be started, and starting the measurement mode may be the same as the method of starting the measurement mode in a conventional ultrasonic device. there is.

In the present invention, before executing the measurement mode, the user must enter the measurement mode, and while in the measurement mode, measurement can be performed through the operations as described in FIGS. 9A and 9B below.

The ultrasonic remote diagnosis system 700 according to an embodiment of the present invention can measure the distance, line trace, perimeter, thickness, area, volume, etc. to be measured of an object through the measurement modes for the various modes described above. there is.

The types of measurement modes are not limited to those listed above and may include all of the various measurement modes used in ultrasonic devices.

Execution of the measurement mode in the present invention can be done through adjustment of the second control unit 726. In one embodiment, as shown in FIG. 9A, 'measurement' located in the second control unit 726. You can run it by pressing the button.

As another embodiment, the measurement mode can be executed only by moving the second pointer 740, which will be explained with reference to FIG. 9B.

FIG. 9B is a diagram illustrating a process for executing the measurement mode of the ultrasound remote diagnosis system 700 according to another embodiment of the present invention.

(i) in FIG. 9B shows the second pointer 740 located in the second control unit 726 area, and (ii) in FIG. 9B shows the second pointer 740 moving to the display unit 722. .

As shown in (ii) of FIG. 9B, the measurement mode can be executed by moving the second pointer 740 inside the display unit 722 area, that is, inside the image area 730 where the image is displayed.

In the measurement mode, the main panel 712 of the main body 710 and the display unit 722 of the remote device 720 can transmit and receive information in both directions, and measurement in the measurement mode is performed using a first pointer (not shown). ), at least one of the second pointer 740 can be used.

The measurement method using the first pointer (not shown) corresponding to the mouse cursor of the main body 710 is similar to the measurement method in a general ultrasonic device. Hereinafter, the second pointer 740 corresponding to the mouse cursor of the remote device 720 will be used. ) to explain the measurement method using .

FIG. 10 is a diagram illustrating a telemetry process in the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.

First, as shown in FIG. 10, when the second pointer 740 corresponding to the mouse cursor of the remote device 720 is located within the area of the display unit 722, the second pointer 740 displays the measurement marker 742. , 744).

A first measurement marker 742 is displayed at the point where the second pointer 740 is located. Click on the first measurement marker 742 to specify the first point 743, and when the second pointer 740 moves, A second measurement marker 744 is displayed at the moved position, and the second point 745 can be specified by clicking the second measurement marker 744.

In the present invention, the second pointer 740 can be moved by manipulating the remote mouse 750, and in addition, the remote trackball 727 of the second control unit 726, which is a virtual control panel, can be moved by manipulating the remote mouse 750. It can also be easily operated.

Looking at the measurement process through FIG. 10, FIG. 10(a) shows the second pointer 740 being moved to the starting position for measuring the object in order to measure the object located within the display unit 722. The second pointer ( The first measurement marker 742 is displayed at the point where 740) is located. As the position of the second pointer 740 moves, the first measurement marker 742 moves to match the second pointer 740.

FIG. 10(b) shows clicking with the second pointer 740 positioned at a specific location of the object to be measured, that is, the starting position for measurement, and the point indicated by the first measurement marker 742 accordingly. , the starting position for measurement may be specified as the first point 743.

Figure 10(c) shows that the second pointer 740 is moved to the end position for measuring the object after specifying the first point 743, and the second measurement marker 744 is attached to the moved second pointer 740. ) is displayed. While the second pointer 740 is moved by the user, the second measurement marker 744 may continue to be displayed on the second pointer 740.

In the present invention, in the process of measuring an object through the remote device 720, the user specifies the first point 743 and the second point 745 while watching the positions of each measurement marker 742 and 744 move. There is an advantage to being able to do it.

Figure 10(d) shows the second pointer 740 clicking with the second pointer 740 positioned at the end position for measurement, and the point pointed to by the second measurement marker 744 is the second point. It can be specified as (745).

According to one embodiment, a connection line connecting the first point 743 and the second point 745 may be displayed, and the connection line is displayed on the screen, which has the effect of enabling accurate measurement.

In the measurement mode of the present invention, the user can see the first measurement marker 742 and the second measurement marker 744, which are displayed while moving together with the movement of the second pointer 740, and can determine the location to be measured by looking at them. Its characteristic is that it can be specified while making a judgment, making measurement easier than before.

In addition, in the present invention, when the second pointer 740 is positioned in the image area 730 of the display unit 722, measurement markers 742 and 744 appear, and when specifying a measurement point, a separate button is pressed. It is easier than existing measurement methods in that the point to be measured is specified by simply placing the second pointer 740 at the point to be specified and clicking, without the need to move the second pointer 740 again.

That is, in the present invention, in order to specify a point, the second pointer 740 is positioned at the first point 743 and the second point 745, and then the remote mouse 750 is clicked to control the main body 710. It can be processed in the same way as clicking the SET/EXIT button located on the second control unit 726 of the remote device 720 corresponding to the panel 716.

In contrast, in the existing measurement method, even when the mouse cursor is placed in the image area, the measurement marker does not appear on the mouse cursor immediately, but a separate action of clicking the mouse cursor is required for the measurement marker to appear on the mouse cursor.

In particular, in the process of moving the mouse cursor to the object, it was possible to move the pointer by dragging the mouse only within the trackball area on the virtual control panel displayed on the remote monitor. Therefore, if the object to be measured is larger than the trackball diameter, the mouse must be moved in several ways. There was the inconvenience of having to move the measurement marker by dragging it once. In addition, after positioning the measurement marker on the object by moving the mouse pointer within the trackball according to the above description, SET displayed on the remote monitor screen corresponding to the control panel of the main body to specify the first point and the second point. Each button had to be clicked, and the existing method was an indirect measurement method rather than measuring directly on the object image, which was inconvenient.

FIG. 11 is a diagram illustrating various embodiments of the measurement markers 742 and 744 and the second pointer 740 in the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

As shown in (i) to (ix) of FIG. 11, the size of the second pointer 740, the measurement markers 742 and 744, and the connection line between the first point 743 and the second point 745. , shape, etc. can vary.

According to an embodiment of the present invention, an ultrasonic remote diagnosis method includes a main body 710 including a main panel 712, a touch panel 714, and a control panel 716, and a remote device communicating with the main body 710. This is an ultrasonic remote diagnosis method of the ultrasonic remote diagnosis system 700 including 720.

The remote device 720 provides display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and second control that is a virtual control panel corresponding to the control panel 716. Independently receiving information corresponding to at least display data and first control data among the data from the main body 710, wherein the remote device 720 corresponds to the display data, first control data, and second control data, respectively. Displaying the display unit 722, the first control unit 724, and the second control unit 726 so that they do not overlap, and measuring the object based on a marker set in the ultrasound image displayed on the main panel 712. , the main body 710 includes receiving marker information for measurement input to at least one of the display unit 722, the first control unit 724, and the second control unit 726 and displaying it on the main panel 712. It is characterized by:

A step of moving the second pointer 740 within the area of the display unit 722 or executing the measurement mode through adjustment of the second control unit 726 may be further included.

In the measurement mode, at least one of a first pointer (not shown) corresponding to the mouse cursor of the main body 710 and a second pointer 740 corresponding to the mouse cursor of the remote device 720 is displayed on the display unit 722. This may include displaying measurement markers 742 and 744 on the second pointer 740 when the second pointer 740 is located within the object area.

In the measurement mode, specifying the first point 743 by clicking on the first measurement marker 742 displayed at the point where the second pointer 740 is located, and displayed at the position to which the second pointer 740 moved It may include specifying the second point 745 by clicking on the second measurement marker 744.

Depending on the embodiment, this may include displaying a connection line between the first point 743 and the second point 745.

Depending on the embodiment, the ultrasound diagnostic device according to the present invention may be used for diagnosis in conjunction with not only an ultrasound device but also a medical imaging device such as a magnetic resonance imaging (MRI) device, a computed tomography (CT) device, or an X-ray imaging device. It can also be applied to areas.

Since details related to each step have been sufficiently described in relation to the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention, detailed description will be omitted.

In the above, a remote measurement method of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention has been described, and below, a remote display method of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention has been described. Let me explain.

In the case of existing ultrasonic remote diagnosis, when operating the control panel on the main unit, the operation process of what operation is being performed is not displayed on the monitor of the remote device, and only the results of the operation are shown. Accordingly, the control panel operation process taking place in the main body cannot be known from a remote location, so the diagnosis process had to be guessed only through the image of the operation result during the ultrasound diagnosis process. In this regard, there were some difficulties in learning how to operate the ultrasound diagnostic system remotely.

The present invention is intended to improve the difficulties of the existing ultrasonic remote diagnosis method as described above, and is characterized by displaying the operation process of the control panel 716 of the main body 710 on the remote device 720.

At the same time, in the present invention, the operation process of the second control unit 726 of the remote device 720 can be displayed on the control panel 716 of the main body 710, in the case where there are multiple second control units 726. It is significant that the operation process in each second control unit 726 can be confirmed from the main body 710.

FIG. 12A is a diagram illustrating a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention, and FIG. 12B is a diagram illustrating a display method of the ultrasound remote diagnosis system 700 according to another embodiment of the present invention. This is a drawing to explain.

As shown in FIGS. 12A and 12B, the ultrasound remote diagnosis system 700 according to an embodiment of the present invention has a main body (712), a touch panel 714, and a control panel 716. 710) and a remote device 720 that communicates with the main body 710, where the remote device 720 displays display data that is real-time image information of the main panel 712 and real-time image information of the touch panel 714. 1 Among the control data and the second control data, which is a virtual control panel corresponding to the control panel 716, at least display data and each information corresponding to the first control data are independently received from the main body 710, and the display data , the display unit 722, first control unit 724, and second control unit 726 corresponding to the first control data and the second control data, respectively, are displayed so as not to overlap, and the control panel 716 and the second control unit The operation information by any one of (726) is characterized in that the operation information is transmitted between the main body 710 and the remote device 720 so that it can be displayed on the other one.

According to another embodiment of the present invention, the ultrasonic remote diagnosis system 700 includes a remote device 720 that communicates with the main body 710 including a main panel 712, a touch panel 714, and a control panel 716. ), and the remote device 720 includes display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and a virtual device corresponding to the control panel 716. Among the second control data that is the control panel, information corresponding to at least display data and first control data is independently received from the main body 710, and information corresponding to the display data, first control data, and second control data is respectively received. The display unit 722, the first control unit 724, and the second control unit 726 are displayed so as not to overlap, and operation information by one of the control panel 716 and the second control unit 726 is displayed on the other one. In order to do so, the operation information is transmitted between the main body 710 and the remote device 720.

According to another embodiment of the present invention, the ultrasonic remote diagnosis system 700 includes a main body 710 that communicates with a remote device 720, and the main body 710 includes a main panel 712, a touch panel ( 714), a control panel 716, and the remote device 720 displays display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and a control panel (714). The main body 710 displays the display unit 722, the first control unit 724, and the second control unit 726, respectively, corresponding to the second control data, which is the virtual control panel corresponding to 716), without overlapping. Each information corresponding to at least the display data and the first control data among the data, first control data, and second control data is independently transmitted to the remote device 720, and the control panel 716 and the second control unit 726 Manipulation information by one of them is characterized in that the manipulation information is transmitted between the main body 710 and the remote device 720 so that it can be displayed on the other one.

In the present invention, operation information by the control panel 716 can be displayed in real time on the second control unit 726, and operation information by the second control unit 726 can be displayed in real time on the control panel 716. there is.

As shown in FIG. 12A, there may be only one remote device 720 capable of remote connection with the main body 710, and as shown in FIG. 12B, there may be one remote device 720 capable of remote connection with the main body 710. There may be more than one.

The case where there are multiple remote devices 720 will be described in detail in FIGS. 14 and 16 below.

FIG. 13 is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

As shown in FIG. 13, operation information by the control panel 716 displayed on the second control unit 726 may be displayed in a GUI.

The second control unit 726 is a virtual control panel corresponding to the control panel 716 of the main body 710, and may have the same shape as the actual control panel 716 of the main body 710.

In the present invention, as the control panel 716 of the main body 710 is operated, the operation process can be displayed in real time on the second control unit 726 to match the configuration of the control panel 716 being operated.

Specifically, as shown in FIG. 13, around the second control unit 726 component corresponding to the component operated on the control panel 716, the movement of the corresponding component due to the user's manipulation may be displayed in a GUI. As an example, what is displayed in the GUI may be arrows indicating left and right rotation, up and down movement, pressing, etc.

FIG. 14 is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

FIG. 14 is a diagram illustrating a case where there are a plurality of remote devices 720 capable of remote connection to the main body 710, and each of the plurality of second control units 726 of the plurality of remote devices 720 is connected to the second control unit 726a. , 726b, 726c).

An example of operation through the second control units 726a and 726b and the control panel 716 is shown. In the second control units 726a and 726b, operations are performed as indicated in A and C, respectively, and in the control panel 716, operations are performed as indicated in B. The above operation process is performed in the second control unit 726c. This is what it looks like in the GUI.

As shown in FIG. 14, the second control unit 726a performed an operation (A) to rotate a component at the top counterclockwise, and the second control unit 726b performed an operation (A) to press the SCAN button. C) was performed, and in the control panel 716, it can be seen that the angle adjustment (ANGLE) configuration was rotated clockwise (B).

The manipulation information from the second control units 726a and 726b is transmitted to the control panel 716 of the main body 710, and an image reflecting a plurality of manipulation information is displayed on the main body 710, and a real-time image reflecting the manipulation information is displayed. is displayed in the same way on each remote device 720.

The manipulation information displayed on the second control unit 726c may include not only manipulation information through the control panel 716 but also manipulation information through other second control units 726a and 726b.

The operation information of the plurality of second control units 726 can be displayed between the plurality of second control units 726. In FIG. 14, only the screen of the second control unit 726c is shown enlarged, but the second control unit 726c is shown in an enlarged form. In the same way, operation information of a plurality of second control units 726 and operation information by the control panel 716 may be displayed in (726a, 726b).

In this case, a plurality of manipulation information displayed on the second control unit 726 may be displayed in a differentiated form.

For example, the display format, such as the color, shape, type of line, and thickness of the line displayed in the GUI, may be changed. Because it is displayed in a mutually distinguishable form, the user using the remote device 720 can determine whether the operation currently in progress is performed on the main body 710 and, if there are multiple remote devices 720, which remote device 720 is used. ), you can check whether the operation is being performed.

When an operation is performed in a plurality of second control units 726, the plurality of operation information may be displayed sequentially, starting with the first operation, and after all of the first operation operations are completed, the other second control units 726 operation information can be displayed.

Alternatively, even before the previously performed operation task is completed, operation information from another second control unit 726 may also be displayed. In this case, in order to distinguish the operation information performed in each second control unit 726 and to distinguish the order in which the operations are performed, the display is numbered according to a predetermined standard, or the displayed color is made increasingly darker. Multiple pieces of operation information can be displayed so that they can be distinguished.

FIG. 15 is a diagram illustrating a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

FIG. 15 is a diagram showing that a plurality of operation information is displayed on the second control unit 726. As an example of the operation information, the first operation by D1 and D2, the second operation by E1 and E2, and the operation information by F1 are shown. It can be confirmed that the third operation by and the fourth operation by G1 were performed.

Each operation information is processed in the second control unit 726 and the control panel 716, and each operation information is displayed on the second control unit 726 in a different display format, so that the user can select any remote location or control panel. You can check whether any manipulation has been performed.

FIG. 16 is a diagram for explaining a display method of the ultrasound remote diagnosis system 700 according to an embodiment of the present invention.

According to one embodiment of the present invention, operation information by the second control unit 726 can be displayed in real time on the control panel 716, and Figure 16 shows information operated by each of the second control units 726a and 726b. This shows an example of displaying on the control panel 716.

As shown in FIG. 16, the operation information of the plurality of second control units 726 may be displayed on the control panel 716, and the operation information of the plurality of second control units 726 displayed on the control panel 716 may be displayed. Operation information may be displayed in a form that is distinct from each other.

According to one embodiment, the operation information displayed on the control panel 716 may be displayed in a blinking manner of the control panel operation unit 718.

The control panel operation unit 718 refers to components operated on the control panel 716. In FIG. 16, the components operated by the second control units 726a and 726b are indicated as the control panel operation unit 718; In addition to the configuration indicated as the control panel operating portion 718, the operating configuration on the control panel 716 may be the control panel operating portion 718.

In the control panel 716, LEDs that can be lit are disposed on the buttons themselves, switches, or their periphery, and whether or not they are operated can be indicated by lighting the corresponding LEDs.

When operated by a plurality of second control units 726, each LED lighting color may be different to distinguish them from each other. Additionally, the operation information displayed on the control panel 716 and the operation information displayed on the second control unit 726 may be displayed in a differentiated form.

According to an embodiment of the present invention, an ultrasonic remote diagnosis method includes a main body 710 including a main panel 712, a touch panel 714, and a control panel 716, and a remote device communicating with the main body 710. This is an ultrasonic remote diagnosis method of the ultrasonic remote diagnosis system 700 including 720.

The remote device 720 provides display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and second control that is a virtual control panel corresponding to the control panel 716. Independently receiving information corresponding to at least display data and first control data among the data from the main body 710, wherein the remote device 720 corresponds to the display data, first control data, and second control data, respectively. Displaying the display unit 722, the first control unit 724, and the second control unit 726 so that they do not overlap, and the operation information by any one of the control panel 716 and the second control unit 726 is, It is characterized by including a step of transmitting operation information between the main body 710 and the remote device 720 so that it can be displayed on the other.

According to the embodiment, it may include displaying operation information by the control panel 716 on the second control unit 726 in real time, and displaying operation information by the second control unit 726 on the control panel 716. It may include a display step in real time.

Since details related to each step have been sufficiently described in relation to the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention, detailed description will be omitted.

Hereinafter, a method for controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention will be described.

FIG. 17 is a diagram illustrating a method of controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.

As shown in FIG. 17, the ultrasound remote diagnosis system 700 according to an embodiment of the present invention includes a main body 710 including a main panel 712, a touch panel 714, and a control panel 716. , and a remote device 720 that communicates with the main body 710.

The remote device 720 includes display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and second control data that is a virtual control panel corresponding to the control panel 716. A display unit 722 that independently receives information corresponding to at least display data and first control data among the control data from the main body 710, and corresponding to the display data, first control data, and second control data, respectively; The first control unit 724 and the second control unit 726 are displayed so that they do not overlap, and the remote trackball is controlled by at least a portion of the second control unit 726 including the remote trackball 727 image or the surrounding area of the remote trackball 727 image. It is characterized in that the operation information of (727) is input.

According to another embodiment of the present invention, the ultrasonic remote diagnosis system 700 includes a remote device 720 that communicates with the main body 710 including a main panel 712, a touch panel 714, and a control panel 716. ), and the remote device 720 includes display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and a virtual device corresponding to the control panel 716. Among the second control data that is the control panel, information corresponding to at least display data and first control data is independently received from the main body 710, and information corresponding to the display data, first control data, and second control data is respectively received. The display unit 722, the first control unit 724, and the second control unit 726 are displayed so as not to overlap, and the second control unit 726 includes an image of a remote trackball 727 corresponding to the trackball of the control panel 726. And, the manipulation information of the remote trackball 727 is input by at least a part of the second control unit 726 including the remote trackball 727 image or the surrounding area of the remote trackball 727 image.

According to another embodiment of the present invention, the ultrasonic remote diagnosis system 700 includes a main body 710 that communicates with a remote device 720, and the main body 710 includes a main panel 712, a touch panel ( 714), a control panel 716, and the remote device 720 displays display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and a control panel (714). The main body 710 displays the display unit 722, the first control unit 724, and the second control unit 726, respectively, corresponding to the second control data, which is the virtual control panel corresponding to 716), without overlapping. Each information corresponding to at least the display data and the first control data among the data, first control data, and second control data is independently transmitted to the remote device 720, and the main body 710 is configured to use the control panel 716. Receiving manipulation information of the remote trackball 727 input by at least a portion of the second control unit 726 including the remote trackball 727 image corresponding to the trackball or the remote trackball 727 image of the second control unit 726. It is characterized by:

It includes a main body 710 that communicates with a remote device 720, and the main body 710 includes a main panel 712, a touch panel 714, and a control panel 716, and a remote trackball in the second control unit 726. It may include a remote mouse 750 that controls 727.

The first control unit 724 can be controlled through a remote mouse 750, and the second control unit 726 can be controlled through at least one of the remote mouse 750 and the remote keyboard 760.

In the ultrasonic remote diagnosis system 700 of the present invention, the touch panel 714, the first control unit 724, the control panel 716, and the second control unit 726 are each independently capable of two-way transmission and reception, at this time, The information transmitted from the first control unit 724 to the touch panel 714 includes control information by the remote mouse 750 of the first control unit 724, and is transmitted from the second control unit 726 to the control panel 716. The transmitted information may include control information by the remote mouse 750 and remote keyboard 760 of the second control unit 726.

FIG. 18 is a diagram for explaining a method of controlling the remote trackball 727 of the second control unit 726 in the method of controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the present invention.

First, in Figure 18, the drawing shown on the left relates to a conventional ultrasonic remote device. This is a diagram showing the configuration of a remote location corresponding to the control panel of a conventional main body. As shown, in order to control the trackball in the control panel, the mouse of the remote location could only be moved within the area (A) corresponding to the trackball. . That is, in the prior art, when operating a trackball, the area that can be moved with a remote mouse is narrow, causing inconvenience.

The figure shown on the right side of FIG. 18 is a diagram showing the second control unit 726 of the ultrasonic remote diagnosis system 700 of the present invention. As shown, in the present invention, a second control unit 726 is used to control the remote trackball 727. 2 The remote mouse 750 can be moved within the entire area (B) of the control unit 726.

That is, in the present invention, the movement area of the remote mouse 750 on the remote device 720 is within the area of the second control unit 726, and the range in which the remote mouse 750 can move is expanded compared to the prior art, so that the user's remote trackball ( 727) It has the effect of facilitating control.

In addition, in order for the user to recognize that the remote mouse 750 can be moved beyond the remote trackball 727 area (A) to the second control unit 726, the second control unit 726 of the present invention is used. As shown in FIG. 18, the movable area range of the remote mouse 750 may be displayed in an arrow shape.

Depending on the embodiment, the main body 710 may display that the remote mouse 750 is being selected or operated at a remote location.

Figure 19 is a diagram for explaining another embodiment of the remote trackball 727 control method of the ultrasound remote diagnosis system 700 according to the present invention.

As shown in FIG. 19, the second control unit 726 in the present invention may be a movable area of the remote mouse 750 for controlling the remote trackball 727. Accordingly, in FIG. 19, the second control unit 726 Various embodiments are shown to indicate that the entire area is movable.

In the process of controlling the remote trackball 727, other buttons on the second control unit 726 cannot be used, and to make the user aware of this, the area of the second control unit 726 is shaded when the remote trackball 727 is operated. It can be processed. In order to indicate that this is an area where the remote mouse 750 can move along with shading, arrows can be displayed up, down, left, and right throughout the second control unit 726, and the size of the arrows can be increased or the arrows can be made to point toward both end corners. The direction can be changed and the available area can be indicated using text.

The method of indicating a movable area is not limited to the methods listed above or those shown in the drawing, and utilizes the color, transparency, text content, position, size, color, type of border line, color, etc. indicated by the second control unit 726. So it can be displayed in various ways.

FIG. 20A is a diagram for explaining size adjustment of the second control unit 726 in the remote trackball 727 control method of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention, and FIG. 20B is a diagram illustrating the size of the second control unit 726 according to the present invention. This diagram is for explaining size adjustment of the second control unit 726 in the remote trackball 727 control method of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.

The ultrasonic remote diagnosis system 700 according to the present invention uses information corresponding to the main panel 712, the touch panel 714, and the control panel 716 of the main body 710 as separate signals to transmit information to the remote device 720. ) is characterized in that the display unit 722, the first control unit 724, and the second control unit 726 are displayed on the remote device 720 so as not to overlap each other, and each can be independently adjusted in size. there is.

Figure 20a shows the display unit 722 in the left area of the remote device 720, the first control unit 724 at the top of the right area, and the second control unit 726 at the bottom. The size ratio of both sides and the top and bottom are displayed. This is a drawing showing the size ratios being equally divided.

In contrast, in Figure 20b, the size of the display unit 722 in the left area is reduced to enlarge the right area, and the area of the first control unit 724 at the top is reduced in order to display the second control unit 726 at the bottom in a larger size. This is a diagram showing the remote device 720 displayed as follows.

In the conventional ultrasonic remote device, the information in the main body is integrated and transmitted as a single signal, so it is not possible to independently adjust each piece at a remote location. However, in the present invention, each size can be adjusted independently, and the display unit 722, The first control unit 724 and the second control unit 726 may close only some windows or minimize their size.

FIG. 21A is a diagram for explaining the second control unit 726 in the remote trackball 727 control method of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention, and FIG. 21B is an embodiment of the present invention. This diagram is for explaining the second control unit 726 in the remote trackball 727 control method of the ultrasonic remote diagnosis system 700 according to an example.

The second control unit 726 in the present invention is a virtual control panel corresponding to the control panel 716 of the main body 710, and may have the same shape as the actual control panel 716 of the main body 710.

The second control unit 726 shown in FIGS. 21A and 21B, which is shown as an example of the second control unit 726, has different buttons and functions, and the buttons around the remote trackball 727 are different. The shape, etc. is also slightly different.

In this way, the second control unit 726 displayed on the remote device 720 corresponds to the model of the control panel 716 of the main body 710, and the model information and second control data of the control panel 716 are It can be stored in advance in the ultrasound remote diagnosis system 700.

FIG. 22 is a diagram for explaining the second control unit 726 in the method for controlling the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention.

In the method of controlling the second control unit 726, the user can set shortcut keys to control the second control unit 726 on the remote keyboard 760.

Specifically, in the second control unit 726, the user's frequently used operation buttons and operation contents can be assigned in advance to specific keys on the remote keyboard 760 and used as shortcut keys. There is an advantage that the user's control becomes more convenient in that the operation is performed simply by pressing a key button on the remote keyboard 760 without the need to move the remote mouse 750.

Figure 22 shows an example of a shortcut key. In the case of configuration (a) of the second control unit 726, it is designated as the number 1 of the remote keyboard 760, and the - and + buttons are designated as the number 1 of the remote keyboard 760. They were designated as F1 and F2.

In the case of configuration (b), it was designated as number 2 on the remote keyboard 760, and in configuration (c), it was designated as number 3 on the remote keyboard 760.

For configuration (d), the alphabet R of the remote keyboard 760 was designated. For configuration (e), the alphabet T was designated as the remote keyboard 760. For configuration (f), the remote keyboard (760) was designated as T. 760) was designated as the alphabet Y.

In addition, configuration (g) is designated by the alphabet I of the remote keyboard 760, and configuration (h) is the 'ENTER' key of the remote keyboard 760. In the case of configuration (i), the remote keyboard 760 It was designated with the 'DELETE' key.

Figure 22 shows an example of shortcut keys. In addition to those shown, various shortcut keys corresponding to the remote keyboard 760 can be set in the configuration of the second control unit 726 that the user frequently uses.

The configuration shown in FIG. 22 shows an example of shortcut keys. In addition to those shown, various shortcut keys corresponding to the remote keyboard 760 can be set in the configuration of the second control unit 726 that the user frequently uses.

The remote keyboard 760 of the present invention and the main keyboard can be mapped one-to-one.

However, if a shortcut key is set on the remote keyboard 760 as set above, the shortcut key set on the remote keyboard 760 may be applied preferentially on the remote keyboard 760. In this case, the shortcut key can only be used on the remote site. It may be valid.

According to an embodiment of the present invention, an ultrasonic remote diagnosis method includes a main body 710 including a main panel 712, a touch panel 714, and a control panel 716, and a remote device communicating with the main body 710. This is an ultrasonic remote diagnosis method of the ultrasonic remote diagnosis system 700 including 720.

The remote device 720 provides display data that is real-time image information of the main panel 712, first control data that is real-time image information of the touch panel 714, and second control that is a virtual control panel corresponding to the control panel 716. Independently receiving information corresponding to at least display data and first control data among the data from the main body 710, wherein the remote device 720 corresponds to the display data, first control data, and second control data, respectively. displaying the display unit 722, the first control unit 724, and the second control unit 726 so that they do not overlap, and the second control unit 726 uses a remote trackball 727 corresponding to the trackball of the control panel 716. A step of inputting manipulation information of the remote trackball 727 by at least a portion of the second control unit 726, which includes an image, and includes the remote trackball 727 image or the periphery of the remote trackball 727 image. It is characterized by

Since details related to each step have been sufficiently described in relation to the ultrasonic remote diagnosis system 700 according to an embodiment of the present invention, detailed description will be omitted.

As described above, the disclosed embodiments have been described with reference to the attached drawings. A person skilled in the art to which the present invention pertains will understand that the present invention can be practiced in forms different from the disclosed embodiments without changing the technical idea or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

700: Ultrasound remote diagnosis system
710: body
712: Main panel
714: Touch panel
716: Control panel
718: Control panel operation unit
720: Remote device
722: Display unit
724: first control unit
726: second control unit
727: Remote trackball
730: Image area
740: second pointer
742: first measurement marker
743: First point
744: second measurement marker
745: Second point
750: Remote mouse
760: Remote keyboard

Claims (25)

It includes a remote device that communicates with a main body including a main panel, a touch panel, and a control panel,
The remote device is,
At least the display data and the first control data among display data that is real-time image information of the main panel, first control data that is real-time image information of the touch panel, and second control data that is a virtual control panel corresponding to the control panel. independently receives information corresponding to the main body, and displays the display unit, first control unit, and second control unit corresponding to the display data, the first control data, and the second control data, respectively, so that they do not overlap,
An ultrasound remote diagnosis system, characterized in that the operation information by one of the control panel and the second control unit is transmitted between the main body and the remote device so that the operation information can be displayed on the other one.
Includes a main body that communicates with a remote device,
The main body includes a main panel, a touch panel, and a control panel,
In the remote device, a display unit corresponding to display data that is real-time image information of the main panel, first control data that is real-time image information of the touch panel, and second control data that is a virtual control panel corresponding to the control panel, To enable the first control unit and the second control unit to be displayed without overlapping, the main body provides information corresponding to at least the display data and the first control data among the display data, the first control data, and the second control data. transmits independently to the remote device,
An ultrasound remote diagnosis system, characterized in that the operation information by one of the control panel and the second control unit is transmitted between the main body and the remote device so that the operation information can be displayed on the other one.
A main body including a main panel, a touch panel, and a control panel; and
Including a remote device that communicates with the main body,
The remote device is,
At least the display data and the first control data among display data that is real-time image information of the main panel, first control data that is real-time image information of the touch panel, and second control data that is a virtual control panel corresponding to the control panel. independently receives information corresponding to the main body, and displays the display unit, first control unit, and second control unit corresponding to the display data, the first control data, and the second control data, respectively, so that they do not overlap,
An ultrasound remote diagnosis system, characterized in that the operation information by one of the control panel and the second control unit is transmitted between the main body and the remote device so that the operation information can be displayed on the other one.
According to any one of claims 1 to 3,
An ultrasound remote diagnosis system, characterized in that operation information by the control panel is displayed in real time on the second control unit, and operation information by the second control unit is displayed in real time on the control panel.
According to any one of claims 1 to 3,
An ultrasound remote diagnosis system, characterized in that the operation information by the control panel displayed on the second control unit is displayed in a GUI.
According to any one of claims 1 to 3,
An ultrasound remote diagnosis system, characterized in that the remote device capable of remote connection with the main body is one or more.
According to clause 6,
An ultrasound remote diagnosis system, wherein the operation information of the plurality of second control units is displayed on each of the plurality of second control units.
In clause 7,
An ultrasound remote diagnosis system, wherein the plurality of operation information displayed on the second control unit are displayed in a differentiated form.
According to clause 6,
An ultrasound remote diagnosis system, wherein the operation information of the plurality of second control units is displayed on the control panel, respectively.
According to clause 9,
An ultrasound remote diagnosis system, characterized in that the plurality of operation information displayed on the control panel are displayed in a differentiated form.
According to any one of claims 1 to 3,
An ultrasound remote diagnosis system, characterized in that the operation information displayed on the control panel is displayed in a blinking manner on the control panel operation unit.
According to any one of claims 1 to 3,
An ultrasound remote diagnosis system, characterized in that the operation information by the control panel and the operation information by the second control unit displayed on the control panel are displayed in distinct forms.
According to any one of claims 1 to 3,
An ultrasound remote diagnosis system, characterized in that the touch panel and the first control unit, and the control panel and the second control unit independently transmit and receive in both directions.
In the ultrasonic remote diagnosis method of an ultrasonic remote diagnosis system including a main body including a main panel, a touch panel, and a control panel, and a remote device communicating with the main body,
The remote device transmits at least the display data and the Independently receiving each piece of information corresponding to first control data from the main body;
displaying, by the remote device, a display unit, a first control unit, and a second control unit corresponding to the display data, the first control data, and the second control data, respectively, so that they do not overlap; and
Ultrasound remote diagnosis, characterized in that the operation information by one of the control panel and the second control unit includes the step of transmitting the operation information between the main body and the remote device so that it can be displayed on the other one. method.
According to clause 14,
An ultrasonic remote diagnosis method, characterized in that it includes the step of displaying operation information by the control panel in real time on the second control unit.
According to clause 14,
An ultrasonic remote diagnosis method, characterized in that it includes the step of displaying operation information by the second control unit on the control panel in real time.
According to clause 14,
An ultrasound remote diagnosis method, characterized in that the operation information by the control panel displayed on the second control unit is displayed in a GUI.
According to clause 14,
An ultrasound remote diagnosis method, characterized in that the remote device capable of remote connection with the main body is at least one.
According to clause 18,
An ultrasound remote diagnosis method, wherein the operation information of the plurality of second control units is displayed on each of the plurality of second control units.
According to clause 19,
An ultrasonic remote diagnosis method, wherein the plurality of manipulation information displayed on the second control unit are displayed in a differentiated form.
According to clause 18,
An ultrasonic remote diagnosis method, characterized in that the operation information of the plurality of second control units is displayed on the control panel, respectively.
According to clause 21,
An ultrasonic remote diagnosis method, characterized in that the plurality of operation information displayed on the control panel are displayed in a differentiated form.
According to clause 14,
An ultrasonic remote diagnosis method, characterized in that the operation information displayed on the control panel is displayed in a blinking manner on the control panel operation unit.
According to clause 14,
An ultrasonic remote diagnosis method, wherein the operation information by the control panel and the operation information by the second control unit displayed on the control panel are displayed in distinct forms.
According to clause 14,
An ultrasonic remote diagnosis method, characterized in that the touch panel and the first control unit, and the control panel and the second control unit independently transmit and receive in both directions.