CN117357150A

CN117357150A - Ultrasonic remote diagnosis system and ultrasonic remote diagnosis method

Info

Publication number: CN117357150A
Application number: CN202310330572.5A
Authority: CN
Inventors: 李承周; 吕效奏; 崔嘉元; 罗斗英; 金大焕; 徐智慧; 李锺立; 赵赫来
Original assignee: Samsung Medison Co Ltd
Current assignee: Samsung Medison Co Ltd
Priority date: 2022-07-06
Filing date: 2023-03-30
Publication date: 2024-01-09

Abstract

The present disclosure provides an ultrasonic remote diagnosis system and an ultrasonic remote diagnosis method. An ultrasonic remote diagnostic system according to an embodiment of the present disclosure includes a main body including a main panel, a touch panel, and a control panel, and a remote device in communication with the main body, wherein the remote device is configured to: independently receiving, from the main body, at least each item of information corresponding to the display data, which is real-time image information of the main panel, first control data, which is real-time image information of the touch panel, and second control data, which is a virtual control panel corresponding to the control panel; and the main body is configured to receive and display on the main panel marking information for measurement, the marking information being input to at least one of a display portion, a first controller, and a second controller of the remote device.

Description

Ultrasonic remote diagnosis system and ultrasonic remote diagnosis method

The present application claims priority from korean patent application No. 10-2022-0083415 filed on the korean intellectual property office on the 7 th month 6 of 2022 and korean patent application No. 10-2022-01231198 filed on the 9 th month 23 of 2022, the entire disclosures of which are incorporated herein by reference.

Technical Field

The present disclosure relates to an ultrasonic remote diagnosis system and an ultrasonic remote diagnosis method, and more particularly, to an ultrasonic diagnosis system and a diagnosis method capable of remotely diagnosing ultrasound.

Background

Ultrasonic imaging refers to imaging of sound waves reflected from the inside of a human body after transmitting high-frequency sound waves from the surface of the human body to the inside of the human body, and ultrasonic examination provides an ultrasonic image in real time. In general, an ultrasonic diagnostic apparatus is changing from an analog type to a digital type, and from a 2D ultrasonic diagnostic apparatus to a 3D ultrasonic diagnostic apparatus and then to a 4D ultrasonic diagnostic apparatus including a lapse of time, and recently, a 4D ultrasonic inspection showing movement of a 3D image is also being applied.

An ultrasonic diagnostic apparatus is an apparatus that irradiates an ultrasonic signal generated from a transducer of a probe to a subject and receives information of an echo signal reflected from the subject to acquire an image of the inside of the subject, and such an ultrasonic diagnostic apparatus exhibits higher stability than a diagnostic apparatus using X-rays while enabling real-time image display, thereby being widely used together with other imaging diagnostic apparatuses. In particular, ultrasonic diagnostic apparatuses are widely used in various diagnostic processes, are more accurate than other diagnostic apparatuses, and are safe since there is no risk of exposing radiation to the human body.

With the development of ultrasonic remote diagnosis technology, it has become possible to perform clinical diagnosis or treatment at a remote location, and recently, ultrasonic remote diagnosis technology has been used in the training process of ultrasonic equipment.

Disclosure of Invention

Embodiments provide an ultrasonic remote diagnosis system and a diagnosis method that facilitate remote diagnosis and improve the accuracy of diagnosis by improving operational inconvenience in an ultrasonic remote diagnosis process.

According to one aspect of the present disclosure, there is provided an ultrasonic remote diagnostic system comprising a remote device in communication with a main body, the main body comprising a main panel, a touch panel, and a control panel, wherein the remote device is configured to: independently receiving, from the main body, at least each item of information corresponding to the display data, which is real-time image information of the main panel, first control data, which is real-time image information of the touch panel, and second control data, which is a virtual control panel corresponding to the control panel; and displaying a display portion, a first controller, and a second controller corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping, and wherein, in a measurement mode in which an object is measured based on a mark set in an ultrasound image displayed on the main panel, mark information for measurement input to at least one of the display portion, the first controller, and the second controller is transmitted to the main body to be displayed on the main panel.

According to another aspect of the present disclosure, there is provided an ultrasonic remote diagnosis system including a main body that communicates with a remote apparatus, wherein the main body includes a main panel, a touch panel, and a control panel, and in order for the remote apparatus to display, as non-overlapping, display portions, a first controller, and a second controller, which correspond to display data, which is real-time image information of the main panel, first control data, and second control data, which is real-time image information of the touch panel, respectively, and virtual control panel corresponding to the control panel, the main body is configured to independently transmit, to the remote apparatus, each item of information corresponding to at least the display data and the first control data, and wherein marker information for measurement, which is input to at least one of the display portions, the first controller, and the second controller, is input to a measurement mode in which an object is measured based on a marker set in an ultrasonic image displayed on the main panel, is received by the main body to be displayed on the main panel.

According to another aspect of the present disclosure, there is provided an ultrasonic remote diagnostic system comprising a main body and a remote device in communication with the main body, the main body comprising a main panel, a touch panel, and a control panel, wherein the remote device is configured to: independently receiving, from the main body, at least each item of information corresponding to the display data, which is real-time image information of the main panel, first control data, which is real-time image information of the touch panel, and second control data, which is a virtual control panel corresponding to the control panel; and displaying a display portion, a first controller, and a second controller corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping, and the main body is configured to: in a measurement mode in which an object is measured based on a mark set in an ultrasonic image displayed on the main panel, mark information for measurement input to at least one of the display portion of the remote device, the first controller, and the second controller is received and displayed on the main panel.

Specifically, in the measurement mode, measurement processing performed by the main body and the remote device may be displayed on the main panel and the display portion in the same manner.

Specifically, in the measurement mode, at least one of a first pointer corresponding to a mouse cursor of the main body and a second pointer corresponding to a mouse cursor of the remote device may be displayed on the display portion.

Specifically, the measurement mode may be performed by moving the second pointer within the area of the display portion or by control of the second controller.

Specifically, the measurement mode may be performed by control of the main panel or the touch panel.

In particular, the measurement in the measurement mode may use at least one of the first pointer and the second pointer.

Specifically, when the second pointer is located within the area of the display portion, the second pointer may be displayed in the form of a measurement mark.

Specifically, a first measurement mark may be displayed at a point where the second pointer is located, a first point may be designated by clicking the first measurement mark, and when the second pointer is moved, a second measurement mark may be displayed at a moved position, and a second point may be designated by clicking the second measurement mark.

In particular, a connection line connecting the first point and the second point may be displayed.

Specifically, the touch panel and the first controller may independently perform bidirectional transmission and reception, and the control panel and the second controller may independently perform bidirectional transmission and reception.

In particular, the number of remote devices that can remotely access the subject may be at least one.

According to another aspect of the present disclosure, there is provided an ultrasonic remote diagnosis method of an ultrasonic remote diagnosis system including a main body including a main panel, a touch panel, and a control panel, and a remote device in communication with the main body, the method comprising: independently receiving, by the remote device, from the main body, at least each item of information corresponding to the display data, which is real-time image information of the main panel, first control data, which is real-time image information of the touch panel, and second control data, which is a virtual control panel corresponding to the control panel; displaying, by the remote device, a display portion, a first controller, and a second controller corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping; and receiving, by the main body, mark information for measurement input to at least one of the display portion, the first controller, and the second controller to be displayed on the main panel in a measurement mode in which an object is measured based on a mark set in an ultrasonic image displayed on the main panel.

Specifically, the method may further comprise: in the measurement mode, measurement processing performed by the main body and the remote device is displayed in the same manner on the main panel and the display portion.

Specifically, the method may further comprise: the measurement mode is performed by moving the second pointer within the area of the display section or by control of the second controller.

Specifically, the method may further comprise: the measurement mode is performed by control of the main panel or the touch panel.

Specifically, the method may further comprise: the second pointer is displayed in the form of a measurement mark when the second pointer is located within the area of the display section.

Specifically, the method may further comprise: designating a first point by clicking on a first measurement mark displayed at a point where the second pointer is located; and designating a second point by clicking on a second measurement mark displayed at a position where the second pointer is moved.

Specifically, the method may further comprise: and displaying a connecting line connecting the first point and the second point.

The ultrasonic remote diagnosis system and diagnosis method according to the present disclosure may facilitate remote diagnosis by improving accuracy of measurement results of a subject during an ultrasonic remote diagnosis process and improving operational inconvenience of remote control.

Effects of the present disclosure are not limited to the above-described effects, and effects not mentioned can be clearly understood by those skilled in the art to which the present disclosure pertains from the present specification and drawings.

Drawings

Example embodiments will now be described more fully hereinafter with reference to the accompanying drawings; they may, however, be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the example embodiments to those skilled in the art.

In the drawings, the size may be exaggerated for clarity of illustration. It will be understood that when an element is referred to as being "between" two elements, it can be the only element between the two elements or one or more intervening elements may also be present. Like reference numerals refer to like elements throughout.

Fig. 1 is a block diagram showing a configuration of an ultrasonic diagnostic apparatus 100 according to one embodiment of the present disclosure.

Fig. 2 is a block diagram showing a configuration of the ultrasonic diagnostic apparatus 100 according to one embodiment of the present disclosure.

Fig. 3 is a block diagram showing a configuration of the ultrasonic diagnostic apparatus 100 according to one embodiment of the present disclosure.

Fig. 4A to 4C are perspective views of an ultrasonic diagnostic apparatus 200 according to at least one embodiment of the present disclosure.

Fig. 5A to 5C are perspective views of an ultrasonic diagnostic apparatus 500 according to at least one embodiment of the present disclosure.

Fig. 6A is a diagram for explaining a conventional ultrasonic remote diagnosis system.

Fig. 6B is a diagram for explaining a conventional ultrasonic remote diagnosis system.

Fig. 7A is a diagram for explaining an ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure.

Fig. 7B is a diagram for illustrating an ultrasonic remote diagnostic system 700 according to another embodiment of the present disclosure.

Fig. 8 is a diagram for explaining a measurement mode of an ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure.

Fig. 9A is a diagram for explaining a process of performing a measurement mode of the ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure.

Fig. 9B to 9C are diagrams for explaining a process of performing a measurement mode of the ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure.

Fig. 10A to 10D are diagrams for explaining a remote measurement process in the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 11A-11I are diagrams illustrating various embodiments of measurement markers 742, 744 and a second pointer 740 in an ultrasonic remote diagnostic system 700 according to embodiments of the present disclosure.

Fig. 12A is a diagram for explaining a display method of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 12B is a diagram for explaining a display method of the ultrasonic remote diagnosis system 700 according to another embodiment of the present disclosure.

Fig. 13 is a diagram for explaining a display method of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 14 is a diagram for explaining a display method of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 15 is a diagram for explaining a display method of an ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure.

Fig. 16 is a diagram for explaining a display method of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 17 is a diagram for explaining a control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 18 is a diagram for explaining a method of controlling the remote trackball 727 in a control method of the remote trackball 727 of the ultrasonic remote diagnostic system 700 according to the present disclosure.

Fig. 19 is a diagram for explaining another embodiment of a control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the present disclosure.

Fig. 20A is a diagram for explaining the size control of the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 20B is a diagram for explaining the size control of the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 21A is a diagram for explaining the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 21B is a diagram for explaining the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Fig. 22 is a diagram for explaining the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

Detailed Description

The present specification sets forth the scope of the present disclosure and, in order to enable one of ordinary skill in the art to which the present disclosure pertains, the principles of the present disclosure and the embodiments are disclosed. The disclosed embodiments may be implemented in various forms.

Throughout the specification, when one part is "connected" to another part, it includes not only the case of direct connection but also the case of indirect connection, and indirect connection includes connection through a wireless communication network.

Furthermore, the terminology used herein is for the purpose of describing embodiments and is not intended to be limiting and/or limiting of the disclosed invention. Unless the context clearly indicates otherwise, singular expressions include plural expressions. In this specification, terms such as "comprises" or "comprising" specify the presence of stated features, integers, steps, operations, elements, components, or groups thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or groups thereof.

Further, although various components are described using terms including ordinal numbers such as "first," "second," etc., the components are not limited to such terms, and these terms are used only to distinguish one component from another. For example, within the scope of the present disclosure, a first component may be referred to as a second component, or similarly, a second component may be referred to as a first component.

In addition, terms such as "unit," "group," "block," "member" and "module" may refer to a unit that processes at least one function or operation. For example, these terms may refer to at least one process processed by at least one hardware, such as a Field Programmable Gate Array (FPGA)/Application Specific Integrated Circuit (ASIC), at least one software stored in a memory, or a processor.

The labels assigned to the steps are used to identify the steps, the labels do not indicate the order among the steps, and the steps may be performed in an order different from the order set forth unless the context clearly indicates a particular order.

In addition, the images herein may include medical images acquired by a medical imaging device such as a Magnetic Resonance Imaging (MRI) device, a Computed Tomography (CT) device, an ultrasound imaging device, or an X-ray imaging device, and may provide or control ultrasound images and medical images of modalities other than ultrasound images.

Further, the term "subject" as used herein refers to a subject to be photographed, and may include a person, an animal, or a part thereof. For example, the object may comprise a part of a body (such as an organ) or a phantom.

Throughout the specification, the term "ultrasound image" as used herein refers to an image of an object that is transmitted to the object and processed based on ultrasound signals reflected from the object.

Hereinafter, embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings.

The ultrasonic diagnostic apparatus 100 according to an embodiment of the present disclosure may include a probe 20, an ultrasonic transceiver 110, a controller 120, an image processor 130, a display unit 140, a memory 150, a communication unit 160, and an input unit 170.

The ultrasonic diagnostic apparatus 100 may be provided not only as a cart type but also as a portable type. Examples of the portable ultrasonic diagnostic apparatus may include, but are not limited to, a smart phone, a laptop computer, a PDA, and a tablet PC including a probe and an application program.

The probe 20 may include a plurality of transducers. The plurality of transducers may transmit ultrasonic signals to the subject 10 according to the transmission signals applied from the transmitter 113. The plurality of transducers may be configured to receive ultrasonic signals reflected from the object 10 to generate a received signal. In addition, the probe 20 may be integrated with the ultrasonic diagnostic apparatus 100, or may be provided as a separate type to be connected to the ultrasonic diagnostic apparatus 100 by a wired or wireless manner. Further, depending on the implementation, the ultrasonic diagnostic device 100 may include one or more probes 20.

The controller 120 is configured to control the transmitter 113 in consideration of the positions and focal points of the plurality of transducers included in the probe 20 to generate a transmission signal to be applied to each of the plurality of transducers.

The controller 120 is configured to analog-to-digital convert the received signals received from the probe 20 and to add the digitally converted received signals to control the receiver 115 to generate ultrasound data, taking into account the positions and focal points of the plurality of transducers.

The image processor 130 is configured to generate an ultrasound image by using the ultrasound data generated by the receiver 115.

Further, the ultrasound image may represent the motion of the object as a doppler image obtained by scanning the object according to an a mode (amplitude mode), a B mode (brightness mode), and an M mode (motion mode), as well as a grayscale ultrasound image.

The a-mode is the most basic form of an ultrasonic image display method, which is a method of displaying the intensity of reflected sound as an amplitude magnitude on the time (distance) axis, and if the reflected sound is strong, the amplitude is high, and if the reflected sound is weak, the amplitude is low, which is advantageous for distance measurement, but since the image changes even if the direction of the probe slightly changes, the mode is rarely used at present.

The M-mode is a mode in which the distance of the moving reflector is displayed as a time change in the form of a change in the a-mode. By designating a region of interest (ROI) in a 2D image as an M-line and displaying the time-dependent change in the region, it is mainly used for observing heart valves, and fetal heart sounds can also be recorded, but have been recently replaced by a doppler method.

The B mode is a method of displaying reflected sound as brightness of points, each of which is proportional to the amplitude of a reflected signal and recently provides a brightness level of 256 or more, which is currently used in most ultrasonic diagnostic apparatuses, and is also a mode of visualizing and displaying long-term motion in real time. A mode called a 2D mode (which means a B (brightness) mode) displays a cross-sectional image of an object on a screen in real time in black and white shadows, and is the most commonly used mode.

Further, the doppler mode is generally a mode in which blood flow is measured by detecting the flow of erythrocytes in a blood vessel, which uses the principle that the wavelength is shortened when erythrocytes approach a probe and the wavelength is lengthened when they are away, and according to a method of displaying blood flow, there is color doppler, pulse wave doppler (PW), continuous wave doppler (CW), or the like. The Doppler images may include a blood flow Doppler image (also referred to as a color Doppler image) showing blood flow, a tissue Doppler image showing tissue movement, and a spectral Doppler image showing the movement speed of the subject in a waveform.

In addition, as the composite mode, there are a mode in which two or three modes are simultaneously applied to one image to display other modes based on 2D and a 3D mode in which a 3D stereoscopic image is displayed.

In the B-mode processing, a B-mode component is extracted and processed from the ultrasound data, and in the image generation, an ultrasound image in which signal intensity is expressed as brightness may be generated based on the B-mode component extracted in the B-mode processing. During the doppler processing, doppler components are extracted from the ultrasound data, and during the image generation, a doppler image representing the motion of the object 10 in color or waveform may be generated based on the extracted doppler components.

In the image generation process, a 2D ultrasound image or a 3D image of the object may be generated, and an elastic image obtained by imaging the degree of deformation of the object according to pressure may also be generated. Further, various types of additional information may be represented as text or graphics on the ultrasound image. Further, the generated ultrasound image may be stored in a memory.

In measuring an object in an ultrasound image, a measurement tool for measuring the object may be determined, and one of a plurality of measurement tools may be selected based on user input.

For example, a measuring tool selection menu for selecting one of a plurality of measuring tools may be provided, and the measuring tool selection menu may be displayed on one screen together with the ultrasound image. In addition, the measurement tool selection menu may be displayed on a separate screen from the touch screen on which the ultrasound image is displayed.

In addition, one of the plurality of measurement tools may be determined based on a user input for selecting one of the plurality of measurement items to be measured. The measurement items may include, but are not limited to, length, width, or angle.

When a user input for selecting one of the measurement items is received, a predetermined measurement tool corresponding to the selected measurement item may be determined.

The display unit 140 may be configured to display the generated ultrasonic image and various information processed in the ultrasonic diagnostic apparatus 100. According to an implementation form, the ultrasonic diagnostic apparatus 100 may include one or more display units 140. In addition, the display unit 140 may be provided as a touch screen combined with a touch panel.

The controller 120 may control the overall operation of the ultrasonic diagnostic apparatus 100 and the signal flow between the internal components of the ultrasonic diagnostic apparatus 100. The controller 120 may include a memory configured to store programs or data for performing the functions of the ultrasonic diagnostic apparatus 100 and a processor configured to process the programs or data. In addition, the controller 120 may be configured to receive a control signal from the input unit 170 or an external device to control the operation of the ultrasonic diagnostic apparatus 100.

The ultrasonic diagnostic apparatus 100 may include a communication unit 160, and be connected with an external device (e.g., a server, a medical device, a portable device (smart phone, tablet PC, wearable device, etc.)) through the communication unit 160.

The communication unit 160 may include one or more components (including, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module) capable of enabling communication with an external device.

The communication unit 160 may also receive control signals and data from an external device and transmit the received control signals to the controller 120, so that the controller 120 controls the ultrasonic diagnostic apparatus 100 according to the received control signals.

Alternatively, the controller 120 may also transmit a control signal to the external device through the communication unit 160 to control the external device according to the control signal of the controller.

For example, the external device may be configured to process data of the external device according to a control signal of the controller received through the communication unit.

A program capable of controlling the ultrasonic diagnostic apparatus 100, such as an artificial intelligence program, may be installed in the external device such that the program may include instructions for performing some or all of the operations of the controller 120.

The program may be installed in the external device in advance, or may be installed by downloading the program from a server providing the application by a user of the external device. The server providing the application may include a recording medium storing the corresponding program.

In addition, the program product may include a storage medium of a server or a storage medium of a client device in a system composed of the server and the client device. Alternatively, if there is a third device (smart phone, tablet PC, wearable device, etc.) communicatively connected to the server or client device, the program product may include a storage medium for the third device. Alternatively, the program product may comprise the software (S/W) program itself sent from the server to the client device or the third device or from the third device to the client device.

In this case, one of the server, the client device, and the third device may execute a program to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the client device, and the third device may execute a program for executing the method according to the disclosed embodiments by distributing the method.

For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) may execute a program stored in the server to control a client device communicatively connected to the server to perform a method according to the disclosed embodiments.

The memory 150 may be configured to store various data or programs for driving and controlling the ultrasonic diagnostic apparatus 100, input/output ultrasonic data, and acquired ultrasonic images.

The input unit 170 may be configured to receive a user input for controlling the ultrasonic diagnostic apparatus 100. For example, the user input may include input for manipulating buttons, a keypad, a mouse, a trackball, a scroll wheel switch, a knob, etc., input for touching a touch panel or a touch screen, voice input, motion input, and input of biometric information (e.g., iris recognition, fingerprint recognition, etc.), but is not limited thereto.

Referring to fig. 2, the ultrasonic diagnostic apparatus 100 may include a wireless probe 20 and an ultrasonic system 40.

The wireless probe 20 may include a transmitter 113, a transducer 117, a receiver 115, a controller 118, and a communication unit 119. In fig. 2, the wireless probe 20 is shown to include both the transmitter 113 and the receiver 115, but depending on the implementation, the wireless probe 20 may include only a portion of the configuration of the transmitter 113 and the receiver 115, and a portion of the configuration of the transmitter 113 and the receiver 115 may be included in the ultrasound system 40. Optionally, the wireless probe 20 may also include an image processor 130.

The transducer 117 may comprise a plurality of transducers. The plurality of transducers may be configured to transmit ultrasonic signals to the subject 10 according to the transmission signals transmitted from the transmitter 113. The plurality of transducers may be configured to receive ultrasonic signals reflected from the object 10 to generate a received signal.

The controller 118 is configured to control the transmitter 113 to generate a transmission signal to be transmitted to each of the plurality of transducers in consideration of the positions and focal points of the plurality of transducers.

The controller 118 is configured to analog-to-digital convert the received signals received from the transducers 117 and, taking into account the positions and focal points of the plurality of transducers, sum the digitally converted received signals to control the receiver 115 to generate ultrasound data. Alternatively, when the wireless probe 20 includes the image processor 130, the generated ultrasound data may be used to generate an ultrasound image.

The communication unit 119 may be configured to wirelessly transmit the generated ultrasound data or ultrasound image to the ultrasound system 40 via a wireless network. Alternatively, the communication unit 119 may be configured to receive control signals and data from the ultrasound system 40.

In addition, depending on the implementation, the ultrasonic diagnostic device 100 may include one or more wireless probes 20.

The ultrasound system 40 may be configured to receive ultrasound data or ultrasound images from the wireless probe 20. Ultrasound system 40 may include a controller 120, an image processor 130, a display unit 140, a memory 150, a communication unit 160, and an input unit 170.

The image processor 130 may be configured to generate an ultrasound image by using ultrasound data received from the wireless probe 20.

The display unit 140 may be configured to display the ultrasound image received from the wireless probe 20, the ultrasound image generated in the ultrasound system 40, and various information processed in the ultrasound diagnostic apparatus 100. According to an implementation form, the ultrasonic diagnostic apparatus 100 may include one or more display units 140. In addition, the display unit 140 may be provided as a touch screen combined with a touch panel.

The controller 120 may be configured to control the overall operation of the ultrasonic diagnostic apparatus 100 and the signal flow between the internal components of the ultrasonic diagnostic apparatus 100. The controller 120 may include a memory configured to store programs or data for performing the functions of the ultrasonic diagnostic apparatus 100 and a processor configured to process the programs or data. Further, the controller 120 may be configured to receive a control signal from the input unit 170 or an external device to control the operation of the ultrasonic diagnostic apparatus 100.

The ultrasound system 40 may include a communication unit 160 and be connected with external devices (e.g., servers, medical devices, portable devices (smartphones, tablet PCs, wearable devices, etc.)) through the communication unit 160.

The communication unit 160 may include one or more components capable of enabling communication with external devices, (including, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module).

In addition, the program product may include a storage medium of a server or a storage medium of a client device in a system composed of the server and the client device. Alternatively, if there is a third device (smart phone, tablet PC, wearable device, etc.) communicatively connected to the server or client device, the program product may include a storage medium for the third device. Alternatively, the program product may comprise the S/W program itself sent from the server to the client device or the third device or from the third device to the client device.

In this case, one of the server, the client device, and the third device may execute a program to perform the method according to the disclosed embodiments. Alternatively, the client device may perform the method according to the disclosed embodiments via a server.

Alternatively, two or more of the server, the client device, and the third device may execute a program for executing the method according to the disclosed embodiments by distributing the method.

For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) may be configured to execute a program stored in the server to control a client device communicatively connected to the server to perform a method in accordance with the disclosed embodiments.

The memory 150 may be configured to store various data or programs for driving and controlling the ultrasonic diagnostic apparatus 100, input/output ultrasonic data, and ultrasonic images.

Referring to fig. 3, the ultrasonic diagnostic apparatus 100 may include a probe 20, an ultrasonic transceiver 110, a controller 120, an image processor 130, a display unit 140, an input unit 170, a memory 150, and a communication unit 160.

The probe 20 according to embodiments of the present disclosure may include a plurality of transducers. The plurality of transducers may be arranged two-dimensionally to form a 2D transducer array.

For example, a 2D transducer array may have a form comprising a plurality of sub-arrays including a plurality of transducers arranged in a first direction and in a second direction different from the first direction.

Further, the ultrasound transceiver 110 may include an analog beamformer 116a and a digital beamformer 116b. Although the ultrasonic transceiver 110 and the probe 20 are shown in fig. 3 as having separate configurations, the probe 20 according to embodiments of the present disclosure may include some or all of the configurations of the ultrasonic transceiver 110, depending on the implementation. For example, the probe 20 may include one or both of an analog beamformer 116a and a digital beamformer 116b.

The controller 120 may be configured to: for each of a plurality of sub-arrays included in the 2D transducer array, a time delay value for digital beamforming for each sub-array is calculated. Further, the controller 120 may be configured to: for each transducer included in any one of the plurality of sub-arrays, a time delay value for analog beamforming is calculated.

The controller 120 may be configured to: the analog beamformer 116a and the digital beamformer 116b are controlled according to the time delay value for analog beamforming and the time delay value for digital beamforming to generate a transmit signal to be transmitted to each of the plurality of transducers.

Further, the controller 120 may be configured to: the analog beamformer 116a is controlled to sum the signals received from the plurality of transducers of each sub-array according to the time delay values for analog beamforming. In addition, the controller 120 may be configured to control the ultrasonic transceiver 110 to analog-to-digital convert the signal summed for each sub-array. In addition, the controller 120 may be configured to: the digital beamformer 116b is controlled to generate ultrasound data by summing the digitally converted signals according to the time delay values of the digital beamforming.

The image processor 130 is configured to generate an ultrasound image using the generated ultrasound data.

The controller 120 may be configured to control the overall operation of the ultrasonic diagnostic apparatus 100 and the signal flow between the internal components in the ultrasonic diagnostic apparatus 100. The controller 120 may include a memory configured to store programs or data for performing the functions of the ultrasonic diagnostic apparatus 100 and a processor configured to process the programs or data. Further, the controller 120 may be configured to receive a control signal from the input unit 170 or an external device to control the operation of the ultrasonic diagnostic apparatus 100.

The communication unit 160 may receive control signals and data from an external device and transmit the received control signals to the controller 120, so that the controller 120 controls the ultrasonic diagnostic apparatus 100 according to the received control signals.

Referring to fig. 4A and 4B, the ultrasonic diagnostic apparatuses 200a and 200B may include a main display unit 221 and a sub display unit 222. One of the main display unit 221 and the sub display unit 222 may be provided as a touch screen. The main display unit 221 and the sub display unit 222 may be configured to display ultrasound images or various information processed in the ultrasound diagnostic apparatuses 200a and 200 b. In addition, the main display unit 221 and the sub display unit 222 may be provided as touch screens, and by providing a GUI, data for controlling the ultrasonic diagnostic apparatuses 200a and 200b may be received from the user. For example, the main display unit 221 may be configured to display an ultrasound image, and the sub display unit 222 may be configured to display a control panel for controlling the display of the ultrasound image in the form of a GUI. The data for controlling the display of the image may be input to the sub display unit 222 through a control panel displayed in the form of a GUI. The ultrasonic diagnostic apparatuses 200a and 200b may be configured to control the display of the ultrasonic image displayed on the main display unit 221 by using the received control data.

Referring to fig. 4B, the ultrasonic diagnostic apparatus 200B may further include a control panel 265 in addition to the main display unit 221 and the sub display unit 222. The control panel 265 may include buttons, a trackball, a scroll wheel switch, and a knob, and may input data for controlling the ultrasonic diagnostic apparatus 200b from a user. For example, the control panel 265 may include a Time Gain Compensation (TGC) button 271 and a freeze (freeze) button 272. The TGC button 271 is a button for setting a TGC value for each depth of an ultrasound image. Further, when an input of the freeze button 272 is sensed while scanning an ultrasonic image, the ultrasonic diagnostic apparatus 200b may maintain a state in which a frame image at a corresponding timing is displayed.

In addition, buttons, trackballs, wheel switches, and knobs included in the control panel 265 may be provided as GUIs to the main display unit 221 or the sub display unit 222.

Referring to fig. 4C, the ultrasonic diagnostic apparatus 200C may be implemented as a portable type. Examples of the portable ultrasonic diagnostic apparatus 200c may include, but are not limited to, a smart phone, a laptop computer, a PDA, and a tablet PC including a probe and an application.

The ultrasonic diagnostic apparatus 200c may include a probe 20 and a main body 240, and the probe 20 may be connected to one side of the main body 240 by wire or wirelessly. The body 240 may include a touch screen 245. The touch screen 245 may be configured to display an ultrasound image, various information processed in the ultrasound diagnostic apparatus, and a GUI.

Referring to fig. 5A, an indoor ultrasonic diagnostic apparatus or an indoor ultrasonic diagnostic apparatus 500 used in the room generally refers to a non-portable ultrasonic diagnostic apparatus for ultrasonic diagnosis, and such an ultrasonic diagnostic apparatus 500 is also referred to as a cart-based apparatus. Although the ultrasonic diagnostic apparatus 500 is not necessarily used only indoors, it will be referred to as an indoor ultrasonic diagnostic apparatus 500 for convenience.

The in-room ultrasonic diagnostic apparatus 500 may have a portable docking (docking) unit 580 connected to the portable ultrasonic diagnostic apparatus 400, and since all components of the in-room ultrasonic diagnostic apparatus 500 used in the embodiments of the present disclosure except the portable docking unit 580 are commonly used, a detailed description thereof will be omitted.

Unlike the portable ultrasonic diagnostic apparatus 400, the in-room ultrasonic diagnostic apparatus 500 has less restrictions in terms of size, weight, power consumption, and the like, so that diagnosable areas are diversified and can be developed to have high performance. When the portable ultrasonic diagnostic apparatus 400 is mounted on the indoor ultrasonic diagnostic apparatus 500, the portable ultrasonic diagnostic apparatus 400 having high performance may be used. However, the position where the portable ultrasonic diagnostic apparatus 400 is mounted on the in-room ultrasonic diagnostic apparatus 500 may be any position where it is convenient for the user to use the portable ultrasonic diagnostic apparatus 400 and the in-room ultrasonic diagnostic apparatus 500 at the same time without limitation, and is not limited by fig. 5A. Further, the portable ultrasonic diagnostic apparatus 400 may be connected to the indoor ultrasonic diagnostic apparatus 500 by a wire or integrally.

Referring to fig. 5A and 5B, the portable ultrasonic diagnostic apparatus 400 in fig. 5A may correspond to the portable ultrasonic diagnostic apparatus 201 in fig. 5B.

Which may be integrated with a probe (not shown) comprising a plurality of transducer elements. Specifically, the portable ultrasonic diagnostic apparatus 400 refers to an apparatus that is connected to the indoor ultrasonic diagnostic apparatus 500 using a wireless communication method or a wired communication method including a Universal Serial Bus (USB) to provide an ultrasonic image to a user using received ultrasonic image data. For example, the portable ultrasonic diagnostic apparatus 400 may be a smart device in which an application is downloaded and installed in a smart phone.

In particular, the portable ultrasonic diagnostic apparatus 400 may be an apparatus connected to the indoor ultrasonic diagnostic apparatus 500 by a wired communication method or a wireless communication method to provide an ultrasonic image to a user using received ultrasonic image data.

For example, the wireless communication methods may include at least one of short-range data communication methods, including 60GHz (mmWave) Wireless Local Area Network (WLAN). It may be local area network (Wi-Fi), bluetooth, zigBee, wi-Fi direct (WFD), infrared data association (IrDA), bluetooth Low Energy (BLE), near Field Communication (NFC), wireless broadband internet (Wibro), worldwide interoperability for microwave access (SWAP) (WiMAX), wireless gigabit alliance (WiGig), and Radio Frequency (RF).

Fig. 5B shows an ultrasonic diagnostic system in which a portable ultrasonic diagnostic apparatus 201 is connected to a cart-based ultrasonic diagnostic apparatus 500.

The cart-based ultrasonic diagnostic apparatus 500 may be connected to the portable ultrasonic diagnostic apparatus 201 using the aforementioned wireless communication method. Specifically, the portable ultrasonic diagnostic apparatus 201 may include at least one wireless communication module (not shown) for performing at least one of the above-described wireless communication methods. Further, the portable docking unit 580 in the cart-based ultrasonic diagnostic device 500 may include at least one wireless communication module (not shown) for performing wireless communication with the portable ultrasonic diagnostic device 201.

In this case, the wireless communication module in the cart-based ultrasonic diagnostic apparatus 500 may be a module for performing communication according to at least one of the above-described wireless communication methods.

Fig. 5C shows an ultrasonic diagnostic system in which a portable ultrasonic diagnostic apparatus 202 is connected to a cart-based ultrasonic diagnostic apparatus 500.

The portable ultrasonic diagnostic apparatus 202 may be connected to the probe 301 through a probe port. The portable ultrasonic diagnostic apparatus 202 may be configured to generate an ultrasonic image by using an ultrasonic image corresponding to an ultrasonic signal received by the probe 301 to display the ultrasonic image on the display unit.

The cart-based ultrasonic diagnostic device 500 may be connected to the portable ultrasonic diagnostic device 202 using the wireless communication method described above. The connection between the cart-based ultrasonic diagnostic apparatus 500 and the portable ultrasonic diagnostic apparatus 202 through wireless communication corresponds to the connection between the cart-based ultrasonic diagnostic apparatus 500 and the portable ultrasonic diagnostic apparatus 201, and thus a detailed description thereof will be omitted.

Hereinafter, an embodiment of an ultrasonic remote diagnosis system suitable for at least one of the ultrasonic diagnosis apparatuses described with reference to fig. 1 to 3 will be described.

The conventional ultrasonic remote diagnosis system shown in fig. 6A may be configured to transmit only a portion corresponding to a main panel of an ultrasonic device main body to a monitor at a remote location, so that only the main panel on which an ultrasonic image is displayed may be displayed on the monitor at the remote location. In this case, a portion corresponding to the touch panel and the control panel, which are one component of the ultrasonic device main body, is not displayed on the remote monitor.

The conventional ultrasonic remote diagnosis system shown in fig. 6B is a system in which portions corresponding to a main panel, a touch panel, and a control panel of an ultrasonic apparatus are displayed on a remote monitor, which is a mirroring technique that transmits the main panel, the touch panel, and the control panel as one signal to the monitor of a remote device.

Which is a method as follows: the entire image displayed on the main body monitor is transmitted immediately while the main panel, the touch panel, and the control panel corresponding to the ultrasonic image are displayed on the monitor of the ultrasonic device main body. In the conventional system of fig. 6B, when all three screens of the main panel, the touch panel, and the control panel are displayed on the monitor of the remote device, the screens corresponding to the touch panel and the control panel are displayed in an overlapping form in a state in which the screens corresponding to the main panel are displayed on the entire remote monitor.

This is a technique of transmitting three pieces of information as one signal, and since the screen may be displayed on the monitor of the remote apparatus only in the form of an overlapping screen, the user cannot see the entire screen corresponding to the main panel, which is inconvenient for diagnosis. This is because, in order to confirm an ultrasound image, diagnosis must be performed while the ultrasound image is moved to a position that does not overlap with screens corresponding to the touch panel and the control panel.

The ultrasonic remote diagnosis system 700 and the diagnosis method according to the present disclosure aim to improve the above inconvenience, and will be described below.

As shown in fig. 7A, an ultrasonic remote diagnostic system 700 according to an embodiment of the present disclosure includes a main body 710 having a main panel 712, a touch panel 714, and a control panel 716, and a remote device 720 in communication with the main body 710.

The remote device 720 is configured to independently receive each item of information corresponding to at least the display data and the first control data, of the display data (which is real-time image information of the main panel 712), the first control data (which is real-time image information of the touch panel 714), and the second control data (which is a virtual control panel corresponding to the control panel 716) from the main body 710, and display the display portion 722, the first controller 724, and the second controller 726 corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping, and the main body 710 is configured to: in a measurement mode for measuring an object based on a mark set in an ultrasound image displayed on the main panel 712, mark information for measurement input to at least one of the display portion 722, the first controller 724, and the second controller 726 of the remote device 720 is received and displayed on the main panel 712.

According to another embodiment of the present disclosure, the ultrasonic remote diagnostic system 700 includes a remote device 720 in communication with a main body 710 (including a main panel 712, a touch panel 714, and a control panel 716).

The remote device 720 receives each item of information of display data (which is real-time image information of the main panel 712), first control data (which is real-time image information of the touch panel 714), and second control data (which is a virtual control panel corresponding to the control panel 716) corresponding to at least the display data and the first control data independently from the main body 710, and displays a display portion 722, a first controller 724, and a second controller 726 corresponding to the display data, the first control data, and the second control data, respectively, so as not to overlap, and in a measurement mode for measuring an object based on a mark set in an ultrasound image displayed on the main panel 712, mark information for measurement input to at least one of the display portion 722, the first controller 724, and the second controller 726 is transmitted to the main body 710 to be displayed on the main panel 712.

According to another embodiment of the present disclosure, an ultrasonic remote diagnostic system 700 includes a body 710 in communication with a remote device 720.

In order for the remote device 720 to display the display portion 722, the first controller 724, and the second controller 726 corresponding to the display data (which is real-time image information of the main panel 712), the first control data (which is real-time image information of the touch panel 714), and the second control data (which is a virtual control panel corresponding to the control panel 716), respectively, so as not to overlap, the main body 710 transmits each item of information of the display data, the first control data, and the second control data corresponding to at least the display data and the first control data to the remote device 720, and in a measurement mode for measuring an object based on a mark set in an ultrasound image displayed on the main panel 712, mark information for measurement input to at least one of the display portion 722, the first controller 724, and the second controller 726 is received by the main body 710 to be displayed on the main panel 712.

In the above-described fig. 6A and 6B, although information corresponding to the main panel, the touch panel, and the control panel of the conventional main body is transmitted to the remote device in the form of a single signal, unlike this, in the ultrasonic remote diagnosis system 700 according to the present disclosure, information corresponding to the main panel 712, the touch panel 714, and the control panel 716 of the main body 710 is transmitted to the remote device 720 as separate signals, and thus, each of the display portion 722, the first controller 724, and the second controller 726 may be displayed on the remote device 720 without overlapping and may be independently controlled.

In the present disclosure, information corresponding to the main panel 712, the touch panel 714, and the control panel 716 of the main body 710 is transmitted to the remote device 720 as separate signals to independently control each of the display portion 722, the first controller 724, and the second controller 726 in the remote device 720, and according to another embodiment, after being transmitted to overlap, they may be independently resized and displayed to be non-overlapping.

The remote device 720 may include a monitor and, according to an embodiment, may include a virtual monitor type (such as AR, VR, or MR).

The ultrasonic scan screen may be displayed on the display portion 722 in real time, and the first controller 724 corresponding to the real-time image of the touch panel 714 may be displayed as a moving image.

For reference, in the case of the related art in which the control panel itself is a touch panel, the main panel corresponds to a vertical type. In this case, as described above, the transmission method from the main body to the remote device in the related art is to transmit the entire screen of the main body as one signal, and the entire screen displayed on the main body is not selected but is integrated and moved, so the main panel and the control panel are transmitted when they are vertically arranged. The monitor of the remote apparatus is generally horizontal, and in this case, it is difficult to display the vertical type arranged on the main body as it is, and even if it is displayed, there is a problem in that the screen is small or cut off.

The present disclosure is a technique having the following features: the main panel 712, the touch panel 714, and the control panel 716 of the main body 710 are each independently transmitted to the remote device 720 as separate signals, and there is an advantage in that a complete screen can be easily displayed regardless of whether the main body 710 and the remote device 720 are of a horizontal type or a vertical type.

The second controller 726 in the present disclosure is a virtual control panel corresponding to the control panel 716 of the main body 710, and may have the same shape as the actual control panel 716 of the main body 710. Specifically, the screen displayed on the second controller 726 matches the control panel 716, which is hardware of the actual main body 710, and a virtual control panel having a shape and a function matching those of buttons and buttons provided in the control panel 716 may be displayed.

In other words, based on the second control data, which is information about the model of the control panel 716, the same shape as that of the control panel 716 may be displayed on the second controller 726.

In the remote device 720 of the present disclosure, each screen of the display portion 722, the first controller 724, and the second controller 726 is displayed separately, which facilitates image manipulation or viewing of detailed screens.

In the present disclosure, a user may manipulate the first and second controllers 724 and 726 displayed on the remote device 720 by using the remote mouse 750.

The first controller 724 may be clicked with the remote mouse 750, at which time an input value through the remote mouse 750 is changed to relative position information on the screen and transmitted to the main body 710, so that an operation may be performed.

In addition, the second controller 726 may be manipulated by clicking or dragging, or may be manipulated using a mouse wheel.

For example, in the case where the manipulation configuration of the control panel 716 of the main body 710 is the configuration of the manipulation method of rotating in the +direction and the-direction, as the manipulation method of the second controller 726 displayed on the remote device 720, the portion marked with +and-may be clicked and manipulated with the remote mouse 750. Alternatively, the configuration actually rotated in the control panel 716 may be rotated by a dragging method using the remote mouse 750 in the remote device 720, and +and-may be manipulated according to the direction in which the wheel is rolled.

The manipulation buttons and the manipulation contents frequently used by the user may be designated to specific keys on the remote keypad 760 in advance and may be used as shortcut keys.

The measurement mode means to measure an object included in an ultrasound image, and in the measurement mode, the object to be measured may be measured based on a mark displayed on the ultrasound image. The marks will be described below with reference to fig. 10A to 10D and fig. 11A to 11I.

One or more remote devices 720 capable of remotely accessing the body 710 may be provided, and hereinafter, a case where one remote device 720 exists has been described, but when there are a plurality of remote devices 720, the same method may be used.

Fig. 7B shows a case where the monitor of the remote device 720 is a dual monitor composed of a first monitor and a second monitor, and in this case, the display portion 722 may be displayed on the first monitor, and the first controller 724 and the second controller 726 may be displayed on the second monitor.

The monitor of the remote device 720 according to the present disclosure may be a horizontal type having a longer horizontal length than a vertical length as shown in fig. 7A and 7B, but may also be a vertical type having a long vertical length.

In the case of a vertical monitor, the display portion 722 may be displayed on an upper side of the monitor of the remote device 720, and the first and second controllers 724 and 726 may be displayed on a lower side of the monitor of the remote device 720, and conversely, the display portion 722 may be disposed on the lower side, and the first and second controllers 724 and 726 may be disposed on the upper side to perform display.

The position of each screen displayed on the monitor of the remote device 720 is not limited to the above-described position, and may include all cases where the screen is displayed without an overlapping portion on the screen.

As shown in fig. 8, in an ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure, in a measurement mode, information input to a display portion 722 may be transmitted to a main body 710 and may be displayed on a main panel 712.

In the present disclosure, the touch panel 714 and the first controller 724 may perform bidirectional transmission and reception independently, and the control panel 716 and the second controller 726 may perform bidirectional transmission and reception independently. However, in the case of the non-measurement mode, only one-way information transmission is possible from the main panel 712 of the main body 710 to the display portion 722 of the remote device 720 between the main panel 712 of the main body 710 and the display portion 722 of the remote device 720.

On the other hand, in the measurement mode, as shown in fig. 8, the main panel 712 of the main body 710 and the display portion 722 of the remote device 720 can bidirectionally transmit and receive information.

The ultrasonic remote diagnosis system 700 according to the present disclosure may perform the measurement mode by controlling the main panel 712 of the main body 710 or by touching the touch panel 714, and in addition, may perform the measurement mode by the remote device 720. The execution of the measurement mode by the remote device 720 will be described below with reference to fig. 9A to 9C.

In the measurement mode, the measurement process performed by the main body 710 and the remote device 720 may be equally displayed on the main panel 712 of the main body 710 and the display portion 722 of the remote device 720.

When the ultrasonic remote diagnosis system 700 of the present disclosure enters the measurement mode, a first pointer (not shown) corresponding to the mouse cursor of the main body 710 may be displayed on the display portion 722, a second pointer 740 corresponding to the mouse cursor of the remote device 720 may be displayed, or both the first pointer (not shown) and the second pointer 740 may be displayed.

When there are multiple remote devices 720, each remote device 720 may independently perform a measurement mode.

In this case, the measurement process may be displayed not only on the remote device 720 performing the measurement but also on other remote devices 720. When measurements are performed simultaneously in a plurality of remote devices 720, the display method and the display order are not limited herein.

In the ultrasonic remote diagnosis system 700 of the present disclosure, in order to perform the measurement mode, the measurement mode must be started first, and the start of the measurement mode may be the same as the method of starting the measurement mode in the existing ultrasonic apparatus.

In the present disclosure, before the user performs the measurement mode, the user must enter the measurement mode, and thus in a state of entering the measurement mode, measurement can be performed by the same operation as in the following description of fig. 9A to 9C.

In the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure, the distance to be measured, the trace, the circumference, the thickness, the area, the volume, and the like of the object to be measured may be measured by the measurement modes of the various modes described above.

The types of measurement modes are not limited to the measurement modes listed above, and may include all of the various measurement modes used in the ultrasound apparatus.

Execution of the measurement mode in the present disclosure may be performed by control of the second controller 726, and as an example, may be performed by pressing a "measurement" button located on the second controller 726, as shown in fig. 9A.

As another embodiment, the measurement mode may be performed by moving only the second pointer 740, which will be described with reference to fig. 9B and 9C.

Fig. 9B and 9C are diagrams for explaining a process of performing a measurement mode of the ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure.

Fig. 9B shows a state in which the second pointer 740 is located in the area of the second controller 726, and fig. 9C shows a state in which the second pointer 740 is moved to the display portion 722.

As shown in fig. 9C, the measurement mode may be performed by moving the second pointer 740 within the area of the display portion 722 (i.e., within the image area 730 where the image is displayed).

In the measurement mode, since the main panel 712 of the main body 710 and the display portion 722 of the remote device 720 can bidirectionally transmit and receive information, measurement in the measurement mode can use at least one of the first pointer (not shown) and the second pointer 740.

Since a measurement method using a first pointer (not shown) corresponding to the mouse cursor of the main body 710 is similar to that in a general ultrasonic apparatus, hereinafter, a measurement method using a second pointer 740 corresponding to the mouse cursor of the remote device 720 will be described.

First, as shown in fig. 10A to 10D, when the second pointer 740 corresponding to the mouse cursor of the remote device 720 is located within the area of the display portion 722, the second pointer 740 may be represented in the form of measurement marks 742 and 744.

A first measurement mark 742 is displayed at a point where the second pointer 740 is located, a first point 743 is designated by clicking on the first measurement mark 742, and when the second pointer 740 is moved, a second measurement mark 744 is displayed at the moved position, and a second point 745 can be designated by clicking on the second measurement mark 744.

In the present disclosure, the second pointer 740 may be moved by manipulating the remote mouse 750, and the remote trackball 727 of the second controller 726, which is a virtual control panel, may be easily manipulated by manipulating the remote mouse 750.

Looking at the measurement process through fig. 10A to 10D, fig. 10A is a view in which the second pointer 740 is moved to the start position for measuring the object in order to measure the object located in the display portion 722, which is a state in which the first measurement mark 742 is displayed at the point where the second pointer 740 is located. As the position of the second pointer 740 moves, the first measurement mark 742 moves to coincide with the second pointer 740.

Fig. 10B shows a view in which the second pointer 740 is located at a specific position of the object to be measured (i.e., a start position of measurement) and is clicked, and thus, a point indicated by the first measurement mark 742 and the start position of measurement can be designated as a first point 743.

Fig. 10C shows that the second pointer 740 is moved to the end position for the measurement object after the first point 743 is designated, which is a view in which the second measurement mark 744 is displayed on the moved second pointer 740. The second measurement marks 744 may be continuously displayed together on the second pointer 740 as the user moves the second pointer 740.

In the present disclosure, in measuring an object by the remote device 720, there is an advantage in that a user can designate the first point 743 and the second point 745 while observing the positional movement of each of the measurement marks 742 and 744.

Fig. 10D shows a state in which the second pointer 740 is clicked when the second pointer 740 is located at the end position for measurement, and a point indicated by the second measurement mark 744 may be designated as a second point 745.

According to an embodiment, a connection line connecting the first point 743 and the second point 745 may be displayed, and the connection line is displayed on a screen, thereby having an effect of accurate measurement.

In the measurement mode according to the present disclosure, when the second pointer 740 moves, the user can see the first measurement mark 742 and the second measurement mark 744 displayed while moving together, and since designation can be made while seeing and determining the position to be measured, measurement is easy compared with the existing measurement mode.

In addition, in the present disclosure, when the second pointer 740 is positioned on the image area 730 of the display portion 722, the measurement marks 742 and 744 appear, and when a measurement point is designated, it is not necessary to move the second pointer 740 again to press a separate button, and a point to be measured is designated only by placing the second pointer 740 on the point to be designated and clicking, thus being easier than the existing measurement method.

In other words, in the present disclosure, in order to specify the point, after the second pointer 740 is positioned at the first point 743 and the second point 745, when the remote mouse 750 is clicked as it is, the process may be the same as clicking a SET/EXIT (SET/EXIT) button located in the second controller 726 of the remote device 720 corresponding to the control panel 716 of the main body 710.

In contrast, in the existing measurement method, even when the mouse cursor is placed on the image area, the measurement mark does not immediately appear on the mouse cursor, but only when there is a separate action of clicking the mouse cursor, the measurement mark appears on the mouse cursor.

In particular, in moving a mouse cursor to an object, since a pointer can be moved by a mouse drag only in a trackball area on a virtual control panel displayed on a remote monitor, it is inconvenient to move a measurement mark by dragging the mouse a plurality of times when an object to be measured is larger than the diameter of the trackball. In addition, according to the above description, by moving the mouse pointer in the trackball area, after positioning the measurement mark on the object, in order to designate the first point and the second point, the SET button displayed on the remote monitor screen corresponding to the control panel of the main body should be clicked, respectively, so that the existing method is an indirect measurement method, not a direct measurement of the object image, which may cause inconvenience.

As shown in fig. 11A to 11I, the size, shape, etc. of the second pointer 740, the measurement marks 742 and 744, and the connection line connecting the first point 743 and the second point 745 may be changed.

An ultrasonic remote diagnosis method according to an embodiment of the present disclosure is an ultrasonic remote diagnosis method of an ultrasonic remote diagnosis system including: a main body 710 including a main panel 712, a touch panel 714, and a control panel 716; and a remote device 720 in communication with the body 710.

The method comprises the following steps: each item of information corresponding to at least the display data and the first control data, among the display data (which is real-time image information of the main panel 712), the first control data (which is real-time image information of the touch panel 714), and the second control data (which is a virtual control panel corresponding to the control panel) is independently received by the remote device 720 from the main panel 710, the display portion 722, the first controller 724, and the second controller 726 corresponding to the display data, the first control data, and the second control data, respectively, are displayed by the remote device 720 to be non-overlapping, and in a measurement mode for measuring an object based on a mark set in an ultrasound image displayed on the main panel 712, mark information for measurement input to at least one of the display portion 722, the first controller 724, and the second controller 726 is received by the main panel 710 to be displayed on the main panel 712.

May further comprise: the measurement mode is performed by moving the second pointer 740 within the area of the display portion 722 or by controlling the second controller 726.

In the measurement mode, at least one of a first pointer (not shown) corresponding to a mouse cursor of the main body 710 and a second pointer 740 corresponding to a mouse cursor of the remote device 720 may be displayed on the display portion 722, and may include: measurement marks 742 and 744 are displayed on the second pointer 740 when the second pointer 740 is located within the object region.

May include: in the measurement mode, a first point 743 is designated by clicking on a first measurement mark 742 displayed at the point where the second pointer 740 is located; and designating a second point 745 by clicking on a second measurement mark 744 displayed at a position where the second pointer 740 moves.

According to an embodiment, a connection line connecting the first point 743 and the second point 745 may be included.

According to an embodiment, the ultrasonic diagnostic apparatus according to the present disclosure is applicable not only to an ultrasonic apparatus but also to a diagnostic field performed with a medical imaging device such as a Magnetic Resonance Imaging (MRI) device, a Computed Tomography (CT) device, or an X-ray imaging device.

Since detailed information related to each step has been fully described for the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure, a detailed description thereof will be omitted.

The remote measurement method of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure has been described above, and hereinafter, the remote display method of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure will be described.

In the case of conventional ultrasonic remote diagnosis, when a control panel of a main body is manipulated, a manipulation process in which manipulation is being performed is not displayed on a monitor of a remote device, but only a result of the manipulation is shown. Therefore, the control panel manipulation process in the subject cannot be known at a remote location, and thus the diagnostic process has to be guessed not only by manipulating the image of the result during the ultrasonic diagnostic process. In this regard, there are some difficulties in the process of remote learning to manipulate an ultrasonic diagnostic system.

The present disclosure aims to reduce the difficulty of the existing ultrasonic remote diagnosis method as described above, and has the following features: manipulation of the control panel 716 of the body 710 is displayed on the remote device 720.

Meanwhile, in the present disclosure, the manipulation process of the second controller 726 of the remote device 720 may be displayed on the control panel 716 of the main body 710 in that it is important to: when there are a plurality of second controllers 726, the manipulation process of each second controller 726 may be checked from the body 710.

Fig. 12A is a diagram for explaining a display method of an ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure, and fig. 12B is a diagram for explaining a display method of an ultrasonic remote diagnosis system 700 according to another embodiment of the present disclosure.

As shown in fig. 12A and 12B, the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure includes a main body 710 and a remote device 720 in communication with the main body 710, the main body including a main panel 712, a touch panel 714, and a control panel 716, wherein the remote device 720 is configured to independently receive each item of information of at least the display data and the first control data, which is real-time image information of the main panel 712, first control data (real-time image information of the touch panel 714), and second control data (virtual control panel corresponding to the control panel 716), from the main body 710, display portions 722, first controllers 724, and second controllers 726 corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping, and to cause manipulation information of any one of the control panel 716 and the second controllers 726 to be displayed on the other, the manipulation information being mutually transferred between the main body 710 and the remote device 720.

According to another embodiment of the present disclosure, the ultrasonic remote diagnosis system 700 includes a remote device 720 in communication with a main body 710 including a main panel 712, a touch panel 714, and a control panel 716, wherein the remote device 720 is configured to independently receive each item of information of display data (which is real-time image information of the main panel 712), first control data (which is real-time image information of the touch panel 714), and second control data (which is virtual control panel corresponding to the control panel 716) corresponding to at least the display data and the first control data from the main body 710, display a display portion 722, a first controller 724, and a second controller 726 corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping, and to cause manipulation information of any one of the control panel 716 and the second controller 726 to be displayed on the other, the manipulation information is mutually transmitted between the main body 710 and the remote device 720.

According to another embodiment of the present disclosure, the ultrasonic remote diagnosis system 700 includes a remote device 720 and a main body 710 in communication with the remote device 720, wherein the main body 710 includes a main panel 712, a touch panel 714 and a control panel 716 and the remote device 720, the main body 710 transmits each of the display data, the first control data and the second control data corresponding to at least the display data and the first control data to the remote device 720 independently in order for the remote device 720 to display manipulation information of any one of the control panel 716 and the second control panel 726 on the other, respectively, without overlapping the display portion 722, the first controller 724 and the second controller 726 corresponding to the display data, the first control data and the second control data of the virtual control panel corresponding to the control panel 716, and to mutually transmit the manipulation information between the main body 710 and the remote device 720.

In the present disclosure, manipulation information of the control panel 716 may be displayed on the second controller 726 in real time, and manipulation information of the second controller 726 may be displayed on the control panel 716 in real time.

As shown in fig. 12A, there may be one remote device 720 that is remotely accessible to the subject 710, and as shown in fig. 12B, the remote device 720 that is remotely accessible to the subject 710 may be one or more.

The case where there are a plurality of remote devices 720 will be described in detail with reference to fig. 14 and 16.

As shown in fig. 13, manipulation information of the control panel 716 displayed on the second controller 726 may be displayed as a GUI.

The second controller 726 is a virtual control panel corresponding to the control panel 716 of the main body 710, and may have the same shape as the actual control panel 716 of the main body 710.

In the present disclosure, as the control panel 716 of the body 710 is manipulated, a manipulation process may be displayed on the second controller 726 in real time to match the configuration of the control panel 716 to be manipulated.

Specifically, as shown in fig. 13, around the configuration of the second controller 726 corresponding to the configuration manipulated on the control panel 716, movement of the corresponding configuration due to the manipulation by the user can be displayed in the GUI. As an example, the content displayed in the GUI may be an arrow indicating a left-right rotation, a vertical movement, a pressing form, or the like.

Fig. 14 is a diagram showing a case where there are a plurality of remote devices 720 capable of remotely accessing the main body 710, which is a diagram showing a plurality of second controllers 726 of the plurality of remote devices 720 as second controllers 726a, 726b, and 726c, respectively.

An example of manipulation by the second controllers 726a and 726b and the control panel 716 is shown. The second controllers 726a and 726B are manipulated as indicated by a and C, respectively, and the control panel 716 is manipulated as indicated by B, and the above-described manipulation process is displayed as a GUI on the second controller 726C.

As can be seen from what is shown in fig. 14, in the second controller 726a, a manipulation a of rotating one component on the upper side in the counterclockwise direction is performed, the second controller 726B performs a manipulation C of pressing a SCAN (SCAN) button, and a manipulation B of rotating an ANGLE (ANGLE) component in the control panel 716 clockwise is performed.

The manipulation information from the second controllers 726a and 726b is transmitted to the control panel 716 of the main body 710, and an image reflecting a plurality of pieces of manipulation information is displayed on the main body 710, and a real-time image reflecting manipulation information is equally displayed on each remote device 720.

The manipulation information displayed on the second controller 726c may include not only manipulation information of the control panel 716 but also manipulation information via the other second controllers 726a and 726 b.

The manipulation information of the plurality of second controllers 726 may be displayed on the plurality of second controllers 726, respectively, and although only the screen of the second controller 726c is shown enlarged in fig. 14, the manipulation information of the plurality of second controllers 726 and the manipulation information of the control panel 716 may be displayed on the second controllers 726a and 726 b.

In this case, pieces of manipulation information displayed on the second controller 726 may be displayed in a manner distinguished from each other.

For example, it may be displayed in different display formats (such as color, shape, line type, and line thickness displayed in the GUI). Since it is displayed in a mutually differentiated form, a user using the remote device 720 can check whether the current manipulation is performed on the main body 710 or, if there are a plurality of remote devices 720, on which remote device 720 the manipulation is performed.

When the manipulation is performed by the plurality of second controllers 726, among the plurality of pieces of manipulation information, the manipulation may be sequentially displayed from the first-performed manipulation, and after all of the previously-performed manipulation tasks are completed, the manipulation information from the other second controllers 726 may be displayed.

Alternatively, the manipulation information of another second controller 726 may be displayed together even before the previously performed manipulation task is completed. In this case, in order to distinguish the manipulation information performed by each of the second controllers 726 and distinguish the order in which the manipulations are performed, pieces of manipulation information may be displayed so as to be distinguishable, such as numbering the display according to a predetermined standard, or gradually darkening the color of the display, or the like.

Fig. 15 is a diagram showing that a plurality of pieces of manipulation information are displayed on the second controller 726, and as an example of the manipulation information, it may be confirmed that the first manipulation of D1 and D2, the second manipulation of E1 and E2, the third manipulation of F1, and the fourth manipulation of G1 have been performed.

Each item of manipulation information is performed by the second controller 726 and the control panel 716, and since each item of manipulation information is displayed on the second controller 726 in a different display format, the user can confirm which manipulation is performed at a remote location or control panel.

According to an embodiment of the present disclosure, manipulation information of the second controller 726 may be displayed on the control panel 716 in real time, and fig. 16 illustrates an example in which information manipulated by each of the second controllers 726a and 726b is displayed on the control panel 716.

As shown in fig. 16, manipulation information of the plurality of second controllers 726 may be displayed on the control panel 716, respectively, and manipulation information of the plurality of second controllers 726 displayed on the control panel 716 may be displayed in a form distinguished from each other.

According to an embodiment, the manipulation information displayed on the control panel 716 may be displayed in a blinking manner of the control panel manipulator 718.

The control panel manipulator 718 refers to a configuration that is manipulated on the control panel 716, and although the configuration that is manipulated by the second controllers 726a and 726b is shown as the control panel manipulator 718 in fig. 16, a manipulation configuration on the control panel 716 other than the configuration that is indicated as the control panel manipulator 718 in fig. 16 may also be the control panel manipulator 718.

In the control panel 716, the illuminable LEDs are provided on the button itself, the switch, or the periphery thereof on the control panel 716, so that whether or not they have been manipulated can be displayed by turning on the corresponding LEDs.

When the plurality of second controllers 726 are manipulated, the illumination colors of the respective LEDs may be different to be distinguished from each other. In addition, manipulation information of the control panel 716 and manipulation information of the second controller 726 displayed on the control panel 716 may be displayed in a form distinguished from each other.

An ultrasonic remote diagnosis method according to an embodiment of the present disclosure is an ultrasonic remote diagnosis method of an ultrasonic remote diagnosis system including: a main body 710 including a main panel 712, a touch panel 714, and a control panel 716; and a remote device in communication with the body 710.

The method comprises the following steps: each item of information corresponding to at least the display data and the first control data, among the display data (which is real-time image information of the main panel 712), the first control data (which is real-time image information of the touch panel 714), and the second control data (which is a virtual control panel corresponding to the control panel) is independently received from the main body 710 through the remote device 720, and the display portion 722, the first controller 724, and the second controller 726 corresponding to the display data, the first control data, and the second control data, respectively, are displayed to be non-overlapping through the remote device 720. And comprises: in order to cause manipulation information of any one of the control panel 716 and the second controller 726 to be displayed on the other, the manipulation information is transmitted between the main body 710 and the remote device 720 to each other.

According to an embodiment, the manipulation information of the control panel 716 may be displayed on the second controller 726 in real time, and the manipulation information of the second controller 726 may be displayed on the control panel 716 in real time.

Hereinafter, a control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure will be described.

As shown in fig. 17, an ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure includes: a main body 710 including a main panel 712, a touch panel 714, and a control panel 716; and a remote device 720 in communication with the body 710.

The remote device 720 is configured to: each item of information corresponding to at least the display data and the first control data, which is real-time image information of the main panel 712, the first control data, which is real-time image information of the touch panel 714, and the second control data, which is a virtual control panel corresponding to the control panel 716, is independently received from the main body 710, the display portion 722, the first controller 724, and the second controller 726 corresponding to the display data, the first control data, and the second control data, respectively, are displayed to be non-overlapping, and manipulation information of the remote trackball 727 is input through at least a portion of the second controller 726 (including an image of the remote trackball 727 or a periphery of an image of the remote trackball 727).

According to another embodiment of the present disclosure, the ultrasonic remote diagnosis system 700 includes a remote device 720 in communication with a main body 710, the main body 710 including a main panel 712, a touch panel 714, and a control panel 716, wherein the remote device 720 is configured to independently receive display data (which is real-time image information of the main panel 712), first control data (which is real-time image information of the touch panel 714), and second control data (which is each item of information corresponding to at least the display data and the first control data in a virtual control panel corresponding to the control panel 716), display portions 722, first controllers 724, and second controllers 726 corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping, wherein the second controllers 726 include images of the remote trackball 727 corresponding to the trackballs of the control panel 716, and manipulation information of the remote trackball 727 is input through at least a portion of the second controllers 726 (including the images of the remote trackball 727 or the periphery of the images of the remote trackball 727).

According to another embodiment of the present disclosure, the ultrasonic remote diagnosis system 700 includes a remote device 720 and a main body 710 in communication with the remote device 720, wherein the main body 710 includes a main panel 712, a touch panel 714, and a control panel 716, and the main body 710 is configured to receive manipulation information of a remote trackball 727 input through at least a portion of the second controller 726 (including an image of the remote trackball 727 corresponding to a trackball of the control panel 716 or an image of the remote trackball 727 of the second controller 726) in order for the remote device 720 to display data corresponding to display data of real-time image information as the main panel 712, first control data as real-time image information of the touch panel 714, and second control data as a virtual control panel corresponding to the control panel 716, respectively, as non-overlapping.

A body 710 may be included in communication with the remote device 720, and the body 710 may include a main panel 712, a touch panel 714, and a control panel 716, and may include a remote mouse 750 configured to control a remote trackball 727 of a second controller 726.

The first controller 724 may be controlled by a remote mouse 750, and the second controller 726 may be controlled by at least one of a remote mouse 750 and a remote keyboard 760.

In the ultrasonic remote diagnosis system 700 of the present disclosure, the touch panel 714 and the first controller 724 may independently perform bidirectional transmission and reception, the control panel 716 and the second controller 726 may independently perform bidirectional transmission and reception, and at this time, information transmitted from the first controller 724 to the touch panel 714 may include control information of the remote mouse 750 through the first controller 724, and information transmitted from the second controller 726 to the control panel 716 may include control information of the remote mouse 750 and the remote keyboard 760 through the second controller 726.

First, in fig. 18, the diagram shown on the left side relates to a conventional ultrasonic remote device. As a diagram showing a configuration of a remote location corresponding to a control panel of a conventional body, as shown in the drawing, in order to control a trackball on the control panel, a remote mouse may be moved only within an area (a) corresponding to the trackball. In other words, in the related art, when the trackball is operated, an area movable by the mouse at a remote location is narrow, which is inconvenient.

The diagram shown on the right side in fig. 18 is a diagram showing a second controller 726 of an ultrasonic remote diagnostic system 700 according to the present disclosure, and as shown, in the present disclosure, a remote mouse 750 is movable within the entire area (B) of the second controller 726 to control a remote trackball 727.

In other words, in the present disclosure, since the moving area of the remote mouse 750 on the remote device 720 is within the area of the second controller 726, the movable range of the remote mouse 750 is widened as compared to the related art, thereby having an effect of facilitating the user's control of the remote trackball 727.

In addition, in order for the user to recognize that the remote mouse 750 may be moved to the second controller 726 beyond the area a of the remote trackball 727, the second controller 726 of the present disclosure may indicate the movable area range of the remote mouse 750 in the shape of an arrow as shown in fig. 18.

According to an embodiment, may be displayed on the body 710: a remote mouse 750 at a remote location is selected or operated.

Fig. 19 is a diagram for explaining another embodiment in a control method of a remote trackball 727 of an ultrasonic remote diagnosis system 700 according to the present disclosure.

As shown in fig. 19, the second controller 726 in the present disclosure may be a movable area of a remote mouse 750 for controlling a remote trackball 727, and thus fig. 19 illustrates various embodiments for indicating that the entire second controller 726 is a movable area.

Other buttons on the second control 726 may not be used during control of the remote trackball 727 and the area of the second control 726 may be shaded when the remote trackball 727 is operated in order to inform the user of this. To indicate that it is a movable area of the remote mouse 750 with a shadow, an arrow upward, downward, leftward, and rightward may be displayed on the second controller 726, the size of the arrow may be increased, or the direction of the arrow may be changed to point to both ends, and an Available area (Available area) may be indicated using text.

The method of indicating that it is a movable region is not limited to the method listed above or the method shown in the drawings, and may be displayed in various ways by using the color, transparency, text content, position, size, type, etc. of the boundary line indicated by the second controller 726.

Fig. 20A is a diagram for explaining the size control of the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure, and fig. 20B is a diagram for explaining the size control of the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to an embodiment of the present disclosure.

The ultrasonic remote diagnosis system 700 according to the present disclosure transmits information corresponding to the main panel 712, the touch panel 714, and the control panel 716 of the main body 710 as separate signals to the remote device 720, and on the remote device 720, the display portion 722, the first controller 724, and the second controller 726 are displayed so as not to overlap each other and their sizes can be independently controlled.

Fig. 20A shows a display portion 722 of the remote device 720 located in the left side region, a first controller 724 located in the upper side of the right side region, and a second controller 726 located in the lower side of the right side region, which show a state in which the size ratio of both sides and the size ratios of the upper side and the lower side are equally divided.

In contrast, fig. 20B is a diagram showing the remote device 720, the remote device 720 being displayed by reducing the area of the first controller 724 located on the upper side to enlarge the right side area by reducing the size of the display portion 722 in the left side area and further enlarging and displaying the second controller 726 located on the lower side.

Although in conventional ultrasound remote devices, it is not possible to independently control each size at a remote location because the information in the body is integrated and sent as a single signal, in the present disclosure, each size may be independently controlled and only some of the windows in the display portion 722, the first controller 724, and the second controller 726 may be closed or the size may be minimized.

Fig. 21A is a diagram for explaining the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure, and fig. 21B is a diagram for explaining the second controller 726 in the control method of the remote trackball 727 of the ultrasonic remote diagnosis system 700 according to the embodiment of the present disclosure.

The second controller 726 in the present disclosure is a virtual control panel corresponding to the control panel 716 of the main body 710, and may have the same shape as the actual control panel 716 of the main body 710.

The second controller 726 shown in fig. 21A and 21B, which is shown as an example of the second controller 726, has different buttons provided on each, different button functions, and slightly different buttons in shape around the remote trackball 727.

Accordingly, the second controller 726 displayed on the remote device 720 corresponds to a model of the control panel 716 of the main body 710, and model information and second control data of the control panel 716 may be stored in the ultrasonic remote diagnosis system 700 in advance.

In the control method of the second controller 726, a user may set a shortcut key for controlling the second controller 726 on the remote keypad 760.

Specifically, the manipulation buttons and the manipulation contents frequently used by the user in the second controller 726 may be pre-assigned to specific keys on the remote keypad 760 and may be used as shortcut keys. This has the advantage that the user's control is facilitated because it is performed by pressing only the keys of the remote keyboard 760 without the need to move the remote mouse 750.

Fig. 22 shows an example of a shortcut key, and in the case of configuration (a) of the second controller 726, the number 1 of the remote keyboard 760 is designated, and-buttons and +buttons are designated as F1 and F2 of the remote keyboard 760.

In the case of configuration (b), number 2 of remote keyboard 760 is specified, and in configuration (c), number 3 of remote keyboard 760 is specified.

In the case of configuration (d), the letter R of the remote keyboard 760 is specified, in the case of configuration (e), the letter T of the remote keyboard 760 is specified, and in configuration (f), the letter Y of the remote keyboard 760 is specified.

In addition, in configuration (g), the letter I of remote keyboard 760 is specified, in configuration (h), the "ENTER" key of remote keyboard 760 is specified, and in the case of configuration (I), the "DELETE" key of remote keyboard 760 is specified.

Fig. 22 shows an example of a shortcut key, and in addition to the illustrated content, various shortcut keys corresponding to the remote keyboard 760 may be set in the configuration of the second controller 726 frequently used by the user.

The configuration shown in fig. 22 shows an example of a shortcut key, and various shortcut keys corresponding to the remote keyboard 760 may be set in the configuration of the second controller 726 frequently used by the user, in addition to what is shown.

The remote keypad 760 and the body keypad of the present disclosure may be mapped one-to-one.

However, if the shortcut key is set in the remote keypad 760 as described above, the shortcut key set in the remote keypad 760 may be preferentially applied in the remote keypad 760, and in this case, the corresponding shortcut key may be valid only at a remote location.

An ultrasonic remote diagnosis method according to an embodiment of the present disclosure is an ultrasonic remote diagnosis method of an ultrasonic remote diagnosis system including a main body 710 and a remote device in communication with the main body 710, the main body 710 including a main panel 712, a touch panel 714, and a control panel 716.

The method comprises the following steps: each item of information corresponding to at least the display data and the first control data, among the display data (which is real-time image information of the main panel 712), the first control data (which is real-time image information of the touch panel 714), and the second control data (which is a virtual control panel corresponding to the control panel) is independently received from the main body 710 through the remote device 720, the display portion 722, the first controller 724, and the second controller 726 corresponding to the display data, the first control data, and the second control data, respectively, are displayed to be non-overlapping through the remote device 720, and manipulation information of the remote trackball 727 is input through at least a portion of the second controller 726 (including an image of the remote trackball 727 or a periphery of an image of the remote trackball 727) when the second controller 726 includes an image of the remote trackball 727 corresponding to a trackball of the control panel 716.

The disclosed embodiments have been described with reference to the accompanying drawings as described above. Those skilled in the art to which the present disclosure pertains will appreciate that the present disclosure may be practiced in other than the disclosed embodiments without alteration of the technical spirit or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. An ultrasonic remote diagnostic system includes a body in communication with a remote device,

wherein the main body includes a main panel, a touch panel, and a control panel, and

in order for the remote device to display a display portion, a first controller, and a second controller corresponding to display data as real-time image information of the main panel, first control data as real-time image information of the touch panel, and second control data as virtual control panel corresponding to the control panel, respectively, as non-overlapping, the main body is configured to independently transmit each item of information corresponding to at least the display data and the first control data, of the first control data, and the second control data to the remote device, and

Wherein, in a measurement mode in which an object is measured based on a mark set in an ultrasonic image displayed on the main panel, mark information for measurement input to at least one of the display section, the first controller, and the second controller is received by the main body to be displayed on the main panel.

2. An ultrasonic remote diagnostic system comprising:

a main body including a main panel, a touch panel, and a control panel; and

a remote device, in communication with the body,

wherein the remote device is configured to:

independently receiving, from the main body, at least each item of information corresponding to the display data, which is real-time image information of the main panel, first control data, which is real-time image information of the touch panel, and second control data, which is a virtual control panel corresponding to the control panel; and displaying the display portion, the first controller, and the second controller corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping, and

The body is configured to:

in a measurement mode in which an object is measured based on a mark set in an ultrasonic image displayed on the main panel, mark information for measurement input to at least one of the display portion of the remote device, the first controller, and the second controller is received and displayed on the main panel.

3. The ultrasonic remote diagnostic system according to claim 2, wherein in the measurement mode, measurement processing performed by the main body and the remote device is displayed on the main panel and the display portion in the same manner.

4. The ultrasonic remote diagnosis system according to claim 2, wherein in the measurement mode, at least one of a first pointer corresponding to a mouse cursor of the main body and a second pointer corresponding to a mouse cursor of the remote device is displayed on the display portion.

5. An ultrasonic remote diagnosis method of an ultrasonic remote diagnosis system including a main body including a main panel, a touch panel, and a control panel, and a remote device in communication with the main body,

The ultrasonic remote diagnosis method comprises the following steps:

independently receiving, by the remote device, from the main body, at least each item of information corresponding to the display data, which is real-time image information of the main panel, first control data, which is real-time image information of the touch panel, and second control data, which is a virtual control panel corresponding to the control panel;

displaying, by the remote device, a display portion, a first controller, and a second controller corresponding to the display data, the first control data, and the second control data, respectively, as non-overlapping; and

in a measurement mode in which an object is measured based on a mark set in an ultrasonic image displayed on the main panel, mark information for measurement input to at least one of the display portion, the first controller, and the second controller is received by the main body to be displayed on the main panel.

6. The ultrasonic remote diagnostic method of claim 5, further comprising:

In the measurement mode, measurement processing performed by the main body and the remote device is displayed in the same manner on the main panel and the display portion.

7. The ultrasonic remote diagnosis method according to claim 5, wherein in the measurement mode, at least one of a first pointer corresponding to a mouse cursor of the main body and a second pointer corresponding to a mouse cursor of the remote device is displayed on the display portion.

8. The ultrasonic remote diagnostic method of claim 7, further comprising:

the measurement mode is performed by moving the second pointer within the area of the display section or by control of the second controller.

9. The ultrasonic remote diagnostic method of claim 5, further comprising:

the measurement mode is performed by control of the main panel or the touch panel.

10. The ultrasonic remote diagnostic method of claim 7, wherein the measurement in the measurement mode uses at least one of the first pointer and the second pointer.

11. The ultrasonic remote diagnostic method of claim 7, further comprising:

The second pointer is displayed in the form of a measurement mark when the second pointer is located within the area of the display section.

12. The ultrasonic remote diagnostic method of claim 11, further comprising:

designating a first point by clicking on a first measurement mark displayed at a point where the second pointer is located; and

a second point is designated by clicking on a second measurement indicia displayed at the location of the second pointer movement.

13. The ultrasonic remote diagnostic method of claim 12, further comprising:

and displaying a connecting line connecting the first point and the second point.

14. The ultrasonic remote diagnosis method according to claim 5, wherein the touch panel performs bidirectional transmission and reception independently of the first controller, and the control panel performs bidirectional transmission and reception independently of the second controller.

15. The ultrasonic remote diagnostic method of claim 5, wherein the number of remote devices that can remotely access the subject is at least one.