WO2017209395A1

WO2017209395A1 - Method and device for controlling wireless ultrasonic image on basis of user input using hardware and graphic interface

Info

Publication number: WO2017209395A1
Application number: PCT/KR2017/004173
Authority: WO
Inventors: 장원석; 유선국; 오경택
Original assignee: 연세대학교 산학협력단
Priority date: 2016-05-30
Filing date: 2017-04-19
Publication date: 2017-12-07
Also published as: WO2017209395A9; KR20170135197A

Abstract

An ultrasonic diagnosis device comprises: a wireless ultrasonic probe which is connected to the ultrasonic diagnosis device through a network and generates ultrasonic data for a point at which the probe is contacted with a part of the body of a person to be diagnosed; a communication unit for receiving ultrasonic data from the wireless ultrasonic probe; a display for displaying an ultrasonic image on the basis of received ultrasonic data; an interface for receiving a control signal that controls an ultrasonic image through a graphic interface image; and a control unit for controlling an ultrasonic image on the basis of a received control signal, wherein the control unit can differently perform a control operation in response to a button input signal of the wireless ultrasonic probe on the basis of analysis information relating to the control signal when the button input signal is received.

Description

Method and apparatus for controlling wireless ultrasound image based on user input using hardware and graphic interface

The present invention relates to a method and apparatus for controlling a wireless ultrasound image based on user input using a hardware and a graphic interface.

In general, the ultrasound diagnostic apparatus includes a control panel for a user to operate the ultrasound diagnostic apparatus. The control panel may include a trackball for displaying an ultrasound image on the screen, providing a search for the displayed image, a keyboard for inputting text, and providing a shortcut key according to a measurement mode. It can be mounted to an ultrasound diagnostic system so that it can be moved left and right. However, such a control panel is limited to move only within a predetermined range, and the user needs to operate the control panel with the other hand while holding the probe in one hand, so that the user diagnoses the patient with an uncomfortable posture, thereby causing inconvenience to the user. There is a problem with providing.

In addition, in a place such as a complicated intensive care unit or an operating room, the diagnosis of the large sized machine at an operable distance may cause confusion with various machines and cause the user to lose concentration. It may be adversely affected.

Accordingly, a probe that can be wirelessly measured is connected to a portable ultrasound diagnosis apparatus, an ultrasound diagnosis apparatus, and a wireless network so that a user can diagnose a patient without being limited in space.

Background art of the present application is disclosed in Korea Patent Publication No. 2010-0057341.

An object of the present invention is to provide an ultrasound diagnostic apparatus and method for controlling an ultrasound image based on a control signal received from an ultrasound diagnostic apparatus and a wireless ultrasound probe.

It is an object of the present invention to provide an apparatus and method for controlling a control operation by a button input signal compared to a control signal received by an ultrasound diagnostic apparatus when a button input of a wireless ultrasonic probe is received.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, an embodiment of the present invention, in the ultrasonic diagnostic apparatus, wirelessly connected to the network and the ultrasonic diagnostic apparatus, generating ultrasonic data for a point of contact with a part of the subject's body An ultrasonic probe, a communication unit for receiving ultrasonic data from a wireless ultrasonic probe, a display for displaying an ultrasonic image based on the received ultrasonic data, an interface for receiving a control signal for controlling the ultrasonic image through a graphic interface image, and a received control signal. And a control unit configured to control an ultrasound image based on the control unit, and when the button input signal of the wireless ultrasound probe is received, the control unit changes a control operation by the button input signal based on analysis information about the control signal. A device can be provided.

In addition, according to an embodiment of the present disclosure, when receiving a button input of the wireless ultrasonic probe, the control unit may be different from the control operation by the button input signal compared to at least one of the button input signal and the control signal received from the interface. have.

In addition, according to an embodiment of the present disclosure, when receiving a button input of the wireless ultrasonic probe, the controller may change the control operation by the button input based on the time information on the control signal.

In addition, according to an exemplary embodiment of the present disclosure, when receiving a button input of the wireless ultrasonic probe, the controller may control the operation of the wireless ultrasonic probe by comparing with at least one of a button input signal and a control signal received from the interface.

In addition, according to an embodiment of the present disclosure, the graphical interface image may include at least one menu image related to the control of the ultrasound image, and the menu image may further include at least one submenu.

In addition, according to an embodiment of the present disclosure, the wireless ultrasound probe is a freeze button for acquiring an image of an ultrasound image of a point of contact with a part of the subject's body, and focus on at least one menu image. A wheel for moving the wheel, a select button for moving to a lower menu for the focused menu image, and a back button for moving to an upper menu for the focused menu image.

In addition, according to one embodiment of the present application, the wireless ultrasonic probe may further include a hold button for controlling other buttons other than the freeze button does not operate.

According to an embodiment of the present disclosure, when the focused menu image is the lowest menu from the wireless ultrasound pro, the controller may control the ultrasound image based on the received control signal when the button input for the selection button is received. .

In addition, according to an exemplary embodiment of the present disclosure, the focused menu may have at least one state of color, emphasis, contrast, activation, or deactivation which are distinguished from a menu which is not focused.

In addition, according to an embodiment of the present disclosure, the display may activate or deactivate the graphical interface image based on the distance between the ultrasound diagnostic apparatus and the wireless ultrasound probe.

In addition, according to an embodiment of the present disclosure, the display may activate or deactivate at least one menu image based on the distance between the ultrasound diagnosis apparatus and the wireless ultrasound probe.

Further, according to an embodiment of the present invention, in the method for controlling the ultrasonic diagnostic apparatus, generating ultrasonic data for a point of contact with a part of the subject's body by a wireless ultrasonic probe, ultrasonic data from the wireless ultrasonic probe Receiving, displaying an ultrasound image based on the received ultrasound data, receiving a control signal for controlling the ultrasound image through the graphical interface image, and controlling the ultrasound image based on the received control signal And, the step of controlling, when receiving the button input signal of the wireless ultrasonic probe, it is possible to provide a control method that is different from the control operation by the button input signal based on the analysis information on the control signal.

The above-mentioned means for solving the problems are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the aforementioned problem solving means of the present application, it is possible to provide an ultrasound diagnostic apparatus and method for controlling an ultrasound image based on a control signal received from an ultrasound diagnostic apparatus and a wireless ultrasound probe.

When the button input of the wireless ultrasound probe is received, an apparatus and a method capable of different control operations by the button input signal compared to the control signal received by the ultrasound diagnostic apparatus may be provided.

It is not restricted by space and the large machine is not placed within the operable distance, which prevents confusion with various machines, thereby providing an environment where the user can concentrate on the patient, thereby preventing adverse effects on the patient. can do.

1 is a block diagram of an ultrasound diagnostic apparatus according to an embodiment of the present invention.

2 is a block diagram of the ultrasound diagnostic apparatus according to an embodiment of the present invention.

3 is a view showing a wireless ultrasonic probe according to an embodiment of the present invention.

4A-4B illustrate graphical interface images in accordance with one embodiment of the present invention.

5 is a diagram illustrating a graphic interface image according to an embodiment of the present invention.

6 is a diagram illustrating a flow of button input received from a wireless ultrasonic probe according to an embodiment of the present invention.

7 is a flowchart illustrating a control method of an ultrasound diagnostic apparatus according to an exemplary embodiment.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present disclosure. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted for simplicity of explanation, and like reference numerals designate like parts throughout the specification.

Throughout this specification, when a portion is "connected" to another portion, this includes not only "directly connected" but also "electrically connected" with another element in between. do.

Throughout this specification, when a member is said to be located on another member "on", "upper", "top", "bottom", "bottom", "bottom", this means that any member This includes not only the contact but also the presence of another member between the two members.

Throughout this specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding the other components unless specifically stated otherwise.

1 is a block diagram of an ultrasound diagnostic apparatus 10 according to an embodiment of the present invention. Referring to FIG. 1, the ultrasound diagnosis apparatus 10 may further include a wireless ultrasound probe 101 connected to the ultrasound diagnosis apparatus 10 through a wireless network. In FIG. 1, the ultrasonic diagnostic apparatus 10 and the wireless ultrasonic probe 101 according to an embodiment of the present invention are shown to be connected through a wireless network, but this is only illustrative of the ultrasonic diagnostic apparatus 10. And those skilled in the art to which this embodiment belongs will be applicable to various modifications and modifications to the components included in the ultrasonic diagnostic apparatus 10 in a range not departing from the essential characteristics of this embodiment. For example, the ultrasound diagnosis apparatus 10 and the wireless ultrasound probe 101 may be connected by wire through a wired connector or a module such as a universal serial bus (USB), a micro-USB, and a serial port.

According to various embodiments of the present disclosure, the ultrasound diagnosis apparatus 10 may be a device such as a mobile device having a touch interface. For example, smartphones, tablet personal computers, mobile phones, video phones, e-book readers, desktop PCs, laptop PCs ), Netbook computer, workstation, server, personal digital assistant, portable multimedia player, MP3 player, mobile medical device, camera, or wearable device (e.g., At least one of smart glasses, headmounted-device (HMD), electronic clothing, electronic bracelet, electronic necklace, electronic accessory, electronic tattoo, smart mirror, or smart watch It may include.

The wireless ultrasound probe 101 may radiate an ultrasound signal to an object (object), receive an ultrasound echo reflected from a subject, and transmit the ultrasound signal to the ultrasound diagnosis apparatus 10. The ultrasound diagnosis apparatus 10 may receive ultrasound data from the wireless ultrasound probe 101, display an ultrasound image, and control the ultrasound image displayed through the graphic interface image.

Hereinafter, operations of the wireless ultrasound probe 101 and the ultrasound diagnostic apparatus 10 will be described in detail with reference to FIG. 2.

2 is a block diagram of the ultrasound diagnostic apparatus 10 according to an embodiment of the present invention. Referring to FIG. 2, the ultrasound diagnostic apparatus 10 may include a wireless ultrasound probe 101, a communication unit 102, a display 103, an interface 104, and a controller 105. However, the configuration of the ultrasound diagnostic apparatus 10 is not limited to the configurations shown in FIG. For example, the ultrasound diagnosis apparatus may further include a storage unit for storing the ultrasound image displayed on the ultrasound diagnosis apparatus 10 and various information related to the ultrasound image.

The wireless ultrasound probe 101 may be connected to the ultrasound diagnosis apparatus 10 through a network, and generate ultrasound data about a point of contact with a part of the subject's body. For example, the wireless ultrasonic probe 101 may generate ultrasonic data by radiating an ultrasonic signal to a part of the subject's body and receiving ultrasonic echo reflected from a part of the body.

In relation to the method of radiating an ultrasonic signal, the wireless ultrasonic probe 101 may be arranged by a predetermined distance from the inspection organ site, depending on the arrangement of the transducers included in the wireless ultrasonic probe 101 or the method of irradiating ultrasonic waves. Linear method for parallel movement, Sector method that can show the inside of organs through narrow intervals, Convex that can be expressed in the same way as the linear method, and can be expressed widely through narrow areas ) May be used, and in addition to this, an arc method, a radial method, and the like may be used.

The communicator 102 may receive ultrasonic data from the wireless ultrasonic probe 101. For example, the communication unit 102 may include a wireless ultrasonic probe 101, a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, a World Interoperability for Microwave Access (WIMAX) network, the Internet, and a LAN ( Local Area Network, Wireless Local Area Network (WLAN), Wide Area Network (WAN), Personal Area Network (PAN), Bluetooth (Bluetooth) Network, Near Field Communication (NFC) Network, Satellite Broadcast Network, Analog Broadcast Network, It may be connected through a DMB (Digital Multimedia Broadcasting) network, but is not limited thereto, and may be connected by wire through a connection module such as a cable connector. The communication unit 102 may receive ultrasound data obtained by photographing a part of the body of the subject from the wireless ultrasound probe 101.

The display 103 may display an ultrasound image based on the received ultrasound data. For example, the received ultrasound data may be ultrasound echoes emitted from the object by emitting ultrasound waves to the human body, and the display 103 may configure and display an image necessary for diagnosis based on the state of the ultrasound echoes. In another example, the received ultrasound data may be data configured as an image through the wireless ultrasound probe 101, and the display 103 may display the received ultrasound image.

The interface 104 may receive a control signal for controlling the ultrasound image through the graphic interface image. The interface may be a touch interface input through a touch. In this case, the graphic interface image may include at least one menu image related to the control of the ultrasound image, and the menu image may further include at least one submenu. The lower menu may refer to a part of a collection of relevant operations in relation to the control operation. The menu image may be focused on at least one menu image based on a control signal, and the focused menu may display at least one state of color, highlight, contrast, activation, or deactivation, which is distinguished from the focused menu. Can have In this case, the focus may mean that the menu image is in an active state.

For example, FIGS. 4A-4B for a graphical interface image through FIGS. 4A-4B are diagrams illustrating a graphical interface image in accordance with one embodiment of the present invention.

Referring to FIG. 4A, the display 103 may display a graphic interface image such as a menu image related to control of an ultrasound image in one region of the display 103. 401 indicates that one of the menus is focused based on a control signal related to the control of the ultrasound image through the interface 104. Mode, which is the currently focused menu, has a bright contrast compared to an unfocused menu, and may indicate that one of the submenus included in the mode is selected.

Referring to FIG. 4B, a configuration of a menu image related to control of an ultrasound image, according to an exemplary embodiment, is shown. The first menu image 402 may correspond to Patient information, Review, Annotate and Test actions, and the second menu image 403 may be optimized, configured. (Compound), Tissue harmonic imaging (THI), and auto gain operations. In addition, the third menu image 404 may correspond to Zoom, Brightness mode, Orientation, and Dual mode operation, and the fourth menu image 405 is Freeze. It may correspond to an operation.

The fifth menu image 406 may correspond to an operation for storing as a video or an image, and the sixth menu image 407 is a 2D, color, Doppler associated with the shooting mode of the wireless ultrasonic probe 101. And M-mode operation. However, the configuration of the menu image related to the control of the graphic interface image or the ultrasound image described with reference to FIGS. 4A to 4B is not limited to those described above. For example, as shown in FIG. 5, there may be a graphical interface image different from FIGS. 4A-4B. Referring to FIG. 5, the focused menu image 501 may have a bright contrast compared to other menus.

The controller 105 may control the ultrasound image based on the received control signal. For example, the controller 105 may enlarge or reduce the ultrasound image displayed on the display 103 based on the control signal for zooming the ultrasound image, and presently based on the control signal for changing the shooting mode to the Doppler mode. You can also change the ultrasound mode to Doppler mode.

When the controller 105 receives the button input signal of the wireless ultrasonic probe 101, the controller 105 may change a control operation by the button input signal based on analysis information about the control signal. When the controller 105 receives the button input signal of the wireless ultrasonic probe, the controller 105 may perform a control operation by the button input signal in comparison with at least one of the received button input signal and the control signal received from the interface 104. .

For example, when receiving the button input signal related to the movement of the menu from the wireless ultrasound probe 101, the controller 105 may move the focus based on the currently focused menu image. In more detail, when the focus is located in the zoom of the third menu image 404 of the graphic interface image, when the button input signal related to the movement of the menu is received from the wireless ultrasound probe 101, the zoom, brightness adjustment, Focus can be shifted sequentially arranged on the graphical interface image in the order of policy and dual mode. Subsequently, when the controller 105 receives a button input signal related to selection from the wireless ultrasound probe 101, the controller 105 may control the image of the ultrasound based on a Jaar operation corresponding to the currently focused menu image. In another example, when focus is placed on the sixth image 407 of the graphical interface image, upon receiving a button input signal relating to the movement of the menu from the wireless ultrasound probe 101, the menu images of 402 to 407 are sequentially processed. You can move the focus.

Meanwhile, the controller 105 may receive a button input signal of the wireless ultrasonic probe 101 and change a control operation by button input based on time information of the control signal. For example, when a predetermined time elapses after focus is placed on a current predetermined menu image, the focus may be released, and when a button input signal related to movement of a menu of the wireless ultrasound probe 101 is received, the position of the previous focus may be changed. Regardless of the focus, the focus may be moved around the set initial position.

When the controller 105 receives the button input signal of the wireless ultrasonic probe 101, the controller 105 may control the operation of the wireless ultrasonic probe 101 by comparing with at least one of a button input signal and a control signal received from the interface. For example, the menu image of 407 may be related to the shooting mode of the wireless ultrasound probe 101, and when the controller 105 receives a control signal related to the shooting mode among the graphic interface images through the interface 104, Based on this, the imaging mode of the wireless ultrasound probe 101 may be changed. The controller 105 may change the photographing mode of the wireless ultrasound probe 101 based on the button input signal received from the wireless ultrasound probe 101.

3, the button input signal of the wireless ultrasound probe 101 and the operation of the controller 105 will be described in more detail. 3 is a diagram illustrating a wireless ultrasonic probe 101 according to an exemplary embodiment of the present invention. Referring to FIG. 3, the wireless ultrasound probe 101 may include at least one button, and the buttons may include, for example, a freeze button 1011, a wheel 1012, and a select button. 1013 and a back button 1014 may be included. However, the configuration of the wireless ultrasonic probe 101 is not limited thereto. For example, the wireless ultrasonic probe 101 may further include a hold button 1015 and a transducer for irradiating an ultrasonic signal in addition to the button. The apparatus may further include a communication module for communicating with the ultrasound diagnosis apparatus.

The freeze button 1011 may generate a button input signal for obtaining an image of an ultrasound image of a point of contact with a part of the body of the subject. As an example, when an abnormality is found while diagnosing based on an ultrasound image acquired using the wireless ultrasound probe 101, the user may input a freeze button 1011 of the wireless ultrasound probe 101. The controller 105 may stop the displayed ultrasound image based on this. Through this, an image of a time point at which an abnormality is found in the displayed ultrasound image may be acquired.

The wheel 1012 may generate a button input signal for shifting the focus on at least one menu image, and the select button 1013 moves to a submenu of the focused menu image. The signal may be generated, and the back button 1014 may generate a move button input signal to a higher menu for the focused menu image. The wheel 1012 and the select button 1013 or a combination of two or more buttons may quickly execute various functions. As a result, the same function may be operated with fewer operations as compared with the case of operating through the wheel 1012 and the selection button 1013.

When the menu image focused from the wireless ultrasound probe 101 is the lowest menu, the controller 105 may control the ultrasound image based on the received control signal when the button input signal for the selection button is received. Through S301 to S302, for example, in S301, the unfreeze menu image includes submenu images of New, Depth, Save, Gain, and Color, and currently Indicates that the save menu image is in focus. After moving the focus to the gain menu image through the wheel 1012 of the wireless ultrasonic probe 101 in S302, and inputting a button input signal for the selection button 1103, the controller 105 based on the gain menu image is input. The ultrasound image may be controlled through a control operation corresponding to the control.

The wireless ultrasonic probe 101 may further include a hold button 1105 for controlling other buttons 1012 to 1014 not to operate in addition to the freeze button 1011.

Meanwhile, the display 102 may activate or deactivate the graphic interface image based on the distance between the ultrasound diagnosis apparatus 10 and the wireless ultrasound probe 101, and between the ultrasound diagnosis apparatus 10 and the wireless ultrasound probe 101. Based on the distance, the at least one menu image may be activated or deactivated. For example, when the distance between the ultrasonic diagnostic apparatus 10 and the wireless ultrasonic probe 101 is close, the display 02 may activate and display a graphic interface image, and the ultrasonic diagnostic apparatus 10 and the wireless ultrasonic probe ( If the distance between 101) is greater than or equal to the predetermined distance, the graphic interface image may be deactivated and not displayed. The display 103 may activate or display at least one menu image based on the distance between the ultrasound diagnosis apparatus 10 and the wireless ultrasound probe 101.

6 is a diagram illustrating a flow of button input received from the wireless ultrasonic probe 10 according to an embodiment of the present invention. Referring to FIG. 6, the freeze button 1011 may generate a button input signal corresponding to a freeze operation regardless of the operation of the hold button 1015 (S605). The wheel 1012, the select button 1013, and the back button 1014 perform the hold check S601 based on the presence or absence of the hold button 1015. When the hold button 1015 is operated, the wheel 1012, the select button 1013, and the back button 1014 may not operate. When the hold button 1015 is not operated, the select button 1013 may generate a button input signal corresponding to the focus check (S603), and the back button 1014 generates the button input signal corresponding to the back. (S604). Meanwhile, the wheel 1012 may generate a button input signal corresponding to the focus movement (S602), and confirm the focus (S603), and generate a button input signal to move the focus corresponding to the checked focus (S602). It may be.

7 is a flowchart illustrating a control method of an ultrasound diagnostic apparatus according to an exemplary embodiment. The control method illustrated in FIG. 7 is performed by the wireless ultrasonic probe 101 and the ultrasonic diagnostic apparatus 10 described above with reference to FIGS. 1 to 6. Therefore, although omitted below, the descriptions of the wireless ultrasound probe 101 and the ultrasound diagnosis apparatus 10 through FIGS. 1 to 6 also apply to FIG. 7.

In operation S701, ultrasound data regarding a point of contact with a part of the subject's body may be generated by the wireless ultrasound probe 101, and in operation S702, the ultrasound diagnosis apparatus 10 may generate ultrasound data generated from the wireless ultrasound probe 101. Data can be received. The ultrasound image may be displayed based on the ultrasound data received in step S703. In step S704, a control signal for controlling the ultrasound image is received through the graphic interface image, and the ultrasound image is received based on the control signal received in step S705. Can be controlled.

The above description of the present application is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present application is indicated by the following claims rather than the above description, and it should be construed that all changes or modifications derived from the meaning and scope of the claims and their equivalents are included in the scope of the present application.

Claims

In the ultrasound diagnostic device,

A wireless ultrasonic probe connected to a network with the ultrasonic diagnostic apparatus and generating ultrasonic data about a point of contact with a part of a subject's body;

A communication unit configured to receive the ultrasonic data from the wireless ultrasonic probe;

A display for displaying an ultrasound image based on the received ultrasound data;

An interface for receiving a control signal for controlling the ultrasound image through a graphic interface image; And

And a controller configured to control the ultrasound image based on the received control signal.

The control unit, when receiving the button input signal of the wireless ultrasound probe, different from the control operation by the button input signal based on the analysis information on the control signal, the ultrasound diagnostic apparatus.
The method of claim 1,

When the control unit receives a button input signal of the wireless ultrasound probe, the control unit compares at least one of the button input signal and the control signal received from the interface to change a control operation by the button input signal. Diagnostic device.
The method of claim 1,

The control unit, when receiving the button input signal of the wireless ultrasonic probe, different from the control operation by the button input based on the time information on the control signal, the ultrasound diagnostic apparatus.
The method of claim 1,

When the controller receives a button input signal of the wireless ultrasound probe, the controller compares at least one of the button input signal and a control signal received from the interface to control the operation of the wireless ultrasound probe.
The method of claim 1,

The graphic interface image includes at least one menu image associated with the control of the ultrasound image,

And the menu image further includes at least one submenu image.
In the method of controlling the ultrasonic diagnostic apparatus,

Generating ultrasound data for a point of contact with a portion of the subject's body by a wireless ultrasonic probe;

Receiving the ultrasound data from the wireless ultrasound probe;

Displaying an ultrasound image based on the received ultrasound data;

Receiving a control signal for controlling the ultrasound image through a graphic interface image; And

Controlling the ultrasound image based on the received control signal,

The controlling may include controlling a control operation by the button input signal based on analysis information regarding the control signal when receiving a button input signal of the wireless ultrasonic probe.