KR102017285B1 - The method and apparatus for changing user interface based on user motion information - Google Patents

Abstract

Disclosed is a method for changing and providing a user interface (UI) used for examination of an object through a medical device based on motion information of a user. According to an embodiment of the present invention, a method of acquiring motion information of a user, changing a UI using the obtained motion information of the user, and displaying the changed UI is disclosed.

Description

Method and apparatus for changing the user interface based on the motion information of the user {THE METHOD AND APPARATUS FOR CHANGING USER INTERFACE BASED ON USER MOTION INFORMATION}

The present invention relates to a method and apparatus for changing and providing a user interface based on motion information of a user.

The ultrasound diagnostic apparatus irradiates an ultrasound signal generated from a transducer of a probe to an object, receives information of an echo signal reflected from the object, and detects an area (eg, soft tissue or the like) or blood flow inside the object. Etc.) can be obtained. In particular, the ultrasound diagnostic apparatus may be used for medical purposes such as observation inside an object, foreign matter detection, and injury measurement.

Such an ultrasound diagnostic apparatus has an advantage in that information about an object can be displayed in real time. In addition, the ultrasonic diagnostic apparatus has the advantage of high stability because there is no exposure to X-rays, and other imaging diagnosis such as an X-ray diagnostic apparatus, a computerized tomography (CT) scanner, a magnetic resonance image (MRI) apparatus, and a nuclear medical diagnostic apparatus. It is widely used with the device.

The present invention relates to a method and an apparatus for changing and providing a user interface (UI) used for examination of an object through a medical device based on user motion information.

According to an embodiment of the present invention, a method for changing and providing a user interface (UI) used for examination of an object through a medical device based on user motion information may include obtaining motion information of the user. The method may include changing the UI using the obtained motion information of the user and displaying the changed UI.

Motion information of a user according to an embodiment of the present invention may be obtained based on location information of a current probe.

The position information of the current probe according to an embodiment of the present invention may include at least one of a current direction of the probe, an inclination angle with respect to a predetermined reference point, and a height value.

The user motion information according to an embodiment of the present invention may be obtained based on biometric information including at least one of fingerprint information of the user, iris information of the user, and facial information of the user.

The UI according to an embodiment of the present invention may include at least one of a shortcut button, a switch, a keyboard, and a trackball indicating a function to be used when the object is examined.

Changing the UI by using the acquired motion information of the user according to an embodiment of the present invention may include changing at least one of a shape, a size, and a position of the UI according to the obtained motion information of the user. have.

According to an embodiment of the present invention, at least one of a shape, a size, and a position may be differently provided according to a frequency of a function used when examining an object.

According to an external input signal according to an embodiment of the present invention, the UI may be editable.

The UI according to an embodiment of the present invention may be displayed through at least one of a display unit displaying a captured image of an object and a control panel provided with a display function.

The method may further include adjusting at least one of a height and an angle of the control panel according to the motion information of the user according to an embodiment of the present invention.

The method may further include obtaining identification information of the user according to an embodiment of the present disclosure, and storing the changed UI according to the obtained identification information.

An apparatus for changing and providing a user interface (UI) used for examination of an object through a medical device based on motion information of a user according to an embodiment of the present invention may include: a motion for obtaining motion information of the user; It may include an information acquisition unit, a UI change unit for changing the UI using the obtained motion information of the user, and a display unit capable of displaying the changed UI.

The motion information acquisition unit according to an embodiment of the present invention may further include a sensing unit, and the motion information of the user may be obtained based on location information of the current probe obtained through the sensing unit.

The position information of the current probe according to an embodiment of the present invention may include at least one of a current direction of the probe, an inclination angle with respect to a predetermined reference point, and a height value.

The user motion information according to an embodiment of the present invention may be obtained based on biometric information including at least one of fingerprint information of the user, iris information of the user, and facial information of the user obtained through the sensing unit.

The UI according to an embodiment of the present invention may include at least one of a shortcut button, a switch, a keyboard, and a trackball indicating a function to be used when the object is examined.

According to an embodiment of the present invention, the UI changer may change at least one of a shape, a size, and a position of the UI according to the acquired motion information of the user.

According to an embodiment of the present invention, at least one of a shape, a size, and a position may be differently provided according to a frequency of a function used when examining an object.

The apparatus according to an embodiment of the present invention further includes an external input receiver, and the UI may be edited by the UI changer according to an external input signal received through the external input receiver.

The apparatus according to an embodiment of the present invention further includes a control panel having a display function, and the UI may be displayed through at least one of the display unit and the control panel.

The apparatus according to an embodiment of the present invention further includes a controller, and the controller may adjust at least one of a height and an angle of the control panel according to the motion information of the user.

The apparatus according to an embodiment of the present invention may further include an identification information acquisition unit for obtaining identification information of the user, and a storage unit for storing the changed UI according to the obtained identification information.

Meanwhile, according to an embodiment of the present invention, a computer-readable recording medium having recorded thereon a program for executing the above-described method on a computer can be provided.

According to the method and the device provided as an embodiment of the present invention, by acquiring the user's motion information, and changing the user interface (UI) based on the obtained motion information to increase the convenience of the user's medical device utilization It can be effective. In addition, by automatically controlling the position of the medical device or the like based on the user motion information, there is an effect that it is possible to reduce unnecessary time wasted in the shooting environment setting.

1A illustrates an example of a method for examining a subject using a conventional medical device.
1B is a block diagram illustrating an exemplary configuration of an ultrasound diagnostic apparatus r1000 according to an embodiment of the present invention.
1C is a block diagram illustrating an exemplary configuration of a wireless probe r2000 according to an embodiment of the present invention.
FIG. 2 is a schematic diagram of a method for changing and providing a user interface (UI) used for examination of an object through a medical device based on user motion information according to an embodiment of the present invention.
3 is a flowchart illustrating a method for changing and providing a user interface (UI) based on motion information of a user according to an embodiment of the present invention.
4 illustrates an example of obtaining motion information of a user according to an embodiment of the present invention.
5 illustrates an example of motion information of a user obtained according to another embodiment of the present invention.
6 illustrates an example of a user interface (UI) that can be changed and provided according to an embodiment of the present invention.
FIG. 7 illustrates an aspect in which a user interface (UI) is changed and provided based on motion information of a user according to an embodiment of the present invention.
FIG. 8 illustrates an aspect in which a user interface (UI) is changed and provided based on motion information of a user according to another embodiment of the present invention.
9A illustrates an example of editing a user interface (UI) in accordance with one embodiment of the present invention.
9B illustrates an example of the use of a modified user interface (UI) in accordance with one embodiment of the present invention.
10 illustrates an aspect in which a user interface (UI) is provided according to an embodiment of the present invention.
11 is a flowchart illustrating a method of controlling the operation of a medical device according to another embodiment of the present invention.
12 illustrates an example of medical device operation control according to another embodiment of the present invention.
13 is a flowchart illustrating a method of managing a changed UI according to another embodiment of the present invention.
FIG. 14 illustrates an apparatus for changing and providing a user interface (UI) used for examination of an object through a medical device based on user motion information according to an embodiment of the present invention.
15 illustrates an apparatus further including a sensing unit according to an embodiment of the present invention.
16 illustrates an apparatus further including a sensing unit, an external input receiver, and a control panel according to an embodiment of the present invention.
17 illustrates an apparatus further comprising a sensing unit, an external input receiver, a control panel, and a controller according to an embodiment of the present invention.
FIG. 18 illustrates an apparatus for changing and providing a user interface (UI) based on motion information of a user according to another embodiment of the present invention.

Terms used herein will be briefly described and the present invention will be described in detail.

The terms used in the present invention have been selected as widely used general terms as possible in consideration of the functions in the present invention, but this may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies and the like. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

When any part of the specification is to "include" any component, this means that it may further include other components, except to exclude other components unless otherwise stated. In addition, the terms "... unit", "module", etc. described in the specification mean a unit for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software. .

Throughout the specification, an “ultrasound image” may refer to an image of an object obtained using ultrasound.

In addition, the subject may comprise a human or animal, or part of a human or animal. For example, the subject may include organs such as the liver, heart, uterus, brain, breast, abdomen, or blood vessels. In addition, the object may include a phantom, and the phantom may refer to a material having a volume very close to the density of the organism and the effective atomic number.

In addition, in the entire specification, the "user" may be a doctor, a nurse, a clinical pathologist, a medical imaging expert, or the like, and may be a technician who repairs a medical device, but is not limited thereto.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

1A illustrates an example of a method for examining a subject using a conventional medical device.

As illustrated in FIG. 1A, the user may examine the object 10 using the probe 120 of the ultrasound diagnostic apparatus. In other words, the user may acquire the captured image of the object 10 through the display 110 by manipulating the probe 120 and the control panel 130. In order to accurately diagnose the object 10, a precise captured image of the object 10 must be obtained.

A relatively precise captured image may be acquired with respect to the object 10 according to a user's skill in handling a medical device. However, even an experienced user may have an uncomfortable operation depending on the position of the medical device such as a user's posture, or may be difficult to obtain a precisely captured image even when an experienced user takes a picture of a predetermined part (eg, liver, kidney, etc.) of an object. have. For example, the ease of use of the medical device may be irrelevant to the skill level according to the photographing part of the object, the height at which the object is located, the user's right hand or left hand use preference, the frequency of use of a predetermined button in a predetermined examination item, and the like.

For example, when photographing by moving the probe 120 in a wide range, it may be difficult to operate the control panel 130 according to the physical or behavioral characteristics of the user. In other words, as the probe 120 is operated up, down, left, right, etc., the posture of the user may be changed, and the user may need to correct the posture again to smoothly operate the control panel 130. . In addition, the fixed height, position, and the like of the control panel 130 may cause the user to feel inconvenience of the operation.

In addition, when the user's gaze 140 is changed, such as when the user is forced to look at the display 110 from the side according to the movement of the user, accurate image acquisition or reading of the object may be difficult.

Accordingly, there is a need to increase the convenience of the operation of the medical device by automatically optimizing the photographing environment of the medical device according to the position where the user uses the medical device as compared with the conventional art. In addition, the optimization of the photographing environment of the medical device has the effect of enabling accurate photographing of the object and shortening the photographing time.

Before describing a specific embodiment of the present invention, an exemplary configuration of an ultrasound diagnostic apparatus according to an embodiment of the present invention will be described below with reference to FIGS. 1B and 1C. For convenience of explanation, reference marks r have been added for each component of the apparatus.

1B is a block diagram illustrating a configuration of an ultrasound diagnostic apparatus r1000 according to an exemplary embodiment of the present invention.

The ultrasound diagnosis apparatus r1000 according to an embodiment of the present invention may include a probe r20, an ultrasound transceiver r100, an image processor r200, a communicator r300, a memory r400, an input device r500, and The controller r600 may be included, and the above-described various components may be connected to each other through the bus r700.

The ultrasound diagnosis apparatus r1000 may be implemented in a portable type as well as a cart type. Examples of the portable ultrasound diagnostic apparatus may include, but are not limited to, a PACS viewer, a smart phone, a laptop computer, a PDA, a tablet PC, and the like.

The probe r20 transmits an ultrasound signal to the object r10 according to a driving signal applied from the ultrasound transceiver r100 and receives an echo signal reflected from the object r10. The probe r20 includes a plurality of transducers, and the plurality of transducers vibrate according to the transmitted electrical signal and generate ultrasonic waves which are acoustic energy. In addition, the probe r20 may be connected to the main body of the ultrasound diagnosis apparatus r1000 by wire or wirelessly, and the ultrasound diagnosis apparatus r1000 may include a plurality of probes r20 according to an implementation form.

The transmitter r110 supplies a driving signal to the probe r20 and includes a pulse generator r112, a transmission delay unit r114, and a pulser r116.

The pulse generator r112 generates a pulse for forming a transmission ultrasonic wave according to a predetermined pulse repetition frequency (PRF), and the transmission delay unit r114 determines the transmission directionality. Apply a delay time to the pulse. Each pulse to which the delay time is applied corresponds to a plurality of piezoelectric vibrators included in the probe r20.

The pulser r116 applies a driving signal (or a driving pulse) to the probe r20 at a timing corresponding to each pulse to which a delay time is applied.

The receiver r120 processes the echo signal received from the probe r20 to generate ultrasonic data, an amplifier r122, an ADC (analog digital converter) r124, a reception delay unit r126, and The adder r128 may be included.

The amplifier r122 amplifies the echo signal for each channel, and the ADC r124 converts the amplified echo signal to analog-digital conversion.

The reception delay unit r126 applies a delay time for determining reception directionality to the digitally converted echo signal, and the adding unit r128 adds the echo signals processed by the reception delay unit r166. Generate ultrasound data.

The image processor r200 generates and displays an ultrasound image through a scan conversion process on the ultrasound data generated by the ultrasound transceiver r100.

Meanwhile, the ultrasound image is a gray scale ultrasound image of scanning the object according to the A mode, B mode, and M mode, as well as the Doppler image. Can be represented. The Doppler image may include a blood flow Doppler image (or also called a color Doppler image) representing blood flow, a tissue Doppler image representing a tissue movement, and a spectral Doppler image displaying a moving speed of an object as a waveform. have.

The B mode processing unit r212 extracts and processes the B mode component from the ultrasonic data.

The image generator r220 may generate an ultrasound image in which the intensity of the signal is expressed as brightness based on the B mode component extracted by the B mode processor r212.

Similarly, the Doppler processor r214 may extract the Doppler component from the ultrasound data, and the image generator r220 may generate a Doppler image representing the movement of the object in color or waveform based on the extracted Doppler component.

According to an embodiment, the image generator r220 may generate a 3D ultrasound image through a volume rendering process for volume data, and may also generate an elastic image that images the deformation degree of the object r10 according to pressure. It may be. Furthermore, the image generator r220 may express various additional information in text or graphics on the ultrasound image. The generated ultrasound image may be stored in the memory r400.

The display unit r230 displays and outputs the generated ultrasound image. The display unit r230 may display and output not only an ultrasound image but also various information processed by the ultrasound diagnosis apparatus r1000 on a screen through a graphical user interface (GUI). Meanwhile, the ultrasound diagnosis apparatus r1000 may include two or more display units r230 according to an implementation form.

The communication unit r300 is connected to the network r30 by wire or wirelessly to communicate with an external device or a server. The communication unit r300 may exchange data with a hospital server or another medical device in the hospital connected through a picture archiving and communication system (PACS). In addition, the communication unit r300 may perform data communication according to a digital imaging and communications in medicine (DICOM) standard.

The communication unit r300 may transmit and receive data related to the diagnosis of the object, such as an ultrasound image, ultrasound data, and Doppler data of the object, through a network r30, and may be a medical image taken by another medical device such as CT, MRI, or X-ray. It can also send and receive. In addition, the communication unit r300 may receive information on a diagnosis history, a treatment schedule, and the like of the patient from the server and use the same to diagnose the object. In addition, the communication unit r300 may perform data communication with a portable terminal of a doctor or a patient, as well as a server or a medical device in a hospital.

The communication unit r300 may be connected to the network r30 by wire or wirelessly to exchange data with the server r32, the medical device r34, or the portable terminal r36. The communication unit r300 may include one or more components that enable communication with an external device, and may include, for example, a short range communication module r310, a wired communication module r320, and a mobile communication module r330. Can be.

The short range communication module r310 may mean a module for short range communication within a predetermined distance. Local area communication technology according to an embodiment of the present invention includes a wireless LAN, Wi-Fi, Bluetooth, Zigbee, WFD (Wi-Fi Direct), UWB (ultra wideband), infrared communication ( IrDA (Infrared Data Association), Bluetooth Low Energy (BLE), Near Field Communication (NFC), and the like, but are not limited thereto.

The wired communication module r320 refers to a module for communication using an electrical signal or an optical signal. The wired communication technology according to an embodiment includes a pair cable, a coaxial cable, an optical fiber cable, an Ethernet cable, and the like. This may be included.

The mobile communication module r330 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The memory r400 stores various types of information processed by the ultrasound diagnosis apparatus r1000. For example, the memory r400 may store medical data related to diagnosis of an object, such as input / output ultrasound data and an ultrasound image, or may store an algorithm or a program performed in the ultrasound diagnosis apparatus r1000.

The memory r400 may be implemented with various types of storage media such as a flash memory, a hard disk, and an EEPROM. Also, the ultrasound diagnosis apparatus r1000 may operate a web storage or a cloud server that performs a storage function of the memory r400 on the web.

The input device r500 means a means for receiving data for controlling the ultrasound diagnostic apparatus r1000 from a user. The input device r500 may include, but is not limited to, a hardware configuration such as a keypad, a mouse, a touch panel, a touch screen, a trackball, a jog switch, and an ECG measurement module, a respiration measurement module, a voice recognition sensor, and a gesture recognition sensor. The apparatus may further include various input means such as a fingerprint sensor, an iris sensor, a depth sensor, and a distance sensor.

The controller r600 may control the overall operation of the ultrasound diagnosis apparatus r1000. That is, the controller r600 controls operations between the probe r20, the ultrasonic transceiver r100, the image processor r200, the communicator r300, the memory r400, and the input device r500 illustrated in FIG. 1. can do.

Some or all of the probe r20, the ultrasonic transceiver r100, the image processor r200, the communicator r300, the memory r400, the input device r500 and the controller r600 may be operated by a software module. However, the present invention is not limited thereto, and some of the above-described configurations may be operated by hardware.

In addition, at least some of the ultrasound transceiver r100, the image processor r200, and the communicator r300 may be included in the controller r600, but are not limited thereto.

1C is a block diagram illustrating a configuration of a wireless probe r2000 according to an embodiment of the present invention.

The wireless probe r2000 may include a plurality of transducers as described with reference to FIG. 1B, and may include some or all of the configuration of the ultrasonic transceiver r100 of FIG. 1B according to an implementation form.

The wireless probe r2000 according to the embodiment illustrated in FIG. 1C includes a transmitter r2100, a transducer r2200, and a receiver r2300, and the detailed descriptions thereof are omitted since they have been described in FIG. 1. do. Meanwhile, the wireless probe r2000 may optionally include a reception delay unit r2330 and an adder r2340 according to its implementation.

The wireless probe r2000 may transmit an ultrasound signal to the object r10, receive an echo signal, generate ultrasound data, and wirelessly transmit the ultrasound signal to the ultrasound diagnosis apparatus r1000 of FIG. 1.

FIG. 2 is a schematic diagram of a method for changing and providing a user interface (UI) used for examination of an object through a medical device based on user motion information according to an embodiment of the present invention.

As shown in FIG. 2A, the direction of movement of the probe 1200 connection line may be sensed to determine whether the user uses the probe 1200 with his left hand or the probe 1200 with his right hand. For example, if the user is left-handed, the probe 1200 may be used with the left hand. Similarly, if the user is right handed, the probe 1200 may be used with the right hand.

As such, the user interface (UI), etc. may be differently provided on the control panel according to the user's use of the probe 1200.

For example, as shown in FIG. 2B, when the user is right-handed, it may be convenient for the user to position the object on his right side and manipulate the probe using his right hand. Therefore, when the user is right-handed, it is necessary to provide a button, a trackball, and the like, which are included on the control panel and used for shooting, as the right-hand UI pattern 131.

In addition, when the user is left-handed, it may be convenient for the user to position the object on his left side and manipulate the probe using his left hand. In other words, when the user is left-handed, the left-hand UI pattern 133 may be provided to the user on the control panel.

In addition, the right-hand UI pattern 131 and the left-hand UI pattern 133 on the control panel may be switched based on the user's motion information including the current position, the position change, and the like of the probe 1200.

3 is a flowchart illustrating a method for changing and providing a user interface (UI) based on motion information of a user according to an embodiment of the present invention.

According to an embodiment of the present invention, a method for changing and providing a user interface (UI) used for examination of an object through a medical device based on user motion information may include obtaining motion information of the user. In operation S100, the method may include changing the UI using the obtained motion information of the user (S200) and displaying the changed UI (S300).

According to an embodiment of the present invention, motion information of the user may be obtained (S100).

The user interface (UI) indicating a button, trackball, etc. to be used for photographing may be changed using the obtained motion information (S200). The change of the user interface (UI) or the like may include optimizing the medical device photographing environment so that a user can easily operate the medical device.

As described above, the UI may be changed according to the user's left or right hand preference, or the UI may be arranged or sized according to the frequency of use of the button used for shooting. It can be provided by adjusting.

According to an embodiment of the present invention, the changed UI may be provided to the user through a display unit (S300).

Motion information of the user according to an embodiment of the present invention may be obtained from the position of the probe, the biometric information of the user. This will be described later with reference to FIGS. 4 and 5.

4 illustrates an example of obtaining motion information of a user according to an embodiment of the present invention.

Motion information of the user according to an embodiment of the present invention may be obtained based on the current position information of the probe 1200.

The location information of the current probe 1200 according to an embodiment of the present invention may include at least one of a current indicating direction of the probe 1200, an inclination angle with respect to a predetermined reference point, and a height value.

For example, position information of the current probe 1200 may be obtained according to the direction in which the probe 1200 is directed. For example, through a predetermined sensor 121 or the like included in the probe 1200 (eg, included in the end of the probe for connection with the ultrasonic device) or embedded in the ultrasonic device to which the probe 1200 is to be connected. Current indication direction information of the probe 1200 may be obtained.

The predetermined sensor 121 may be configured to determine the direction in which the probe 1200 is directed according to which direction the connection line of the probe 1200 is directed from the reference line (eg, the center line ML of the sensor 121). have.

For example, the direction of indication of the probe 1200 may be determined through the sensor 121 or the like in the same manner as the toggle switch principle. As shown in FIG. 4A, if the probe 1200 is deflected to the right from the center line ML, the current position information of the probe 1200 may include the display unit 2300 and the control panel 2500. It may be determined that you are pointing to the right. In other words, information that the probe 1200 is located on the right side of the ultrasound apparatus may be obtained.

In addition, as shown in FIG. 4A, if the probe 1200 is deflected to the left from the center line ML, the current position information of the probe 1200 includes an ultrasonic wave including the display unit 2300 and the control panel 2500. It may be determined that the left side of the device is pointing. In other words, information that the probe 1200 is located on the left side of the ultrasound apparatus may be obtained.

In addition, when the probe 1200 according to an embodiment of the present invention is wireless, the predetermined sensor 121 may be configured to sense GPS (Global Positioning System) coordinates of the wireless probe through wireless communication.

In addition, according to an embodiment of the present invention, the position information of the current probe 1200 may include at least one of an inclination angle and a height value with respect to a predetermined reference point.

As shown in FIG. 4B, the probe 1200 may include a sensor 123 or the like for obtaining tilt information or height information. The sensor 123 may include a gyro sensor, a height sensor, or the like.

For example, position information of the current probe 1200 may be obtained as tilt angle information with respect to a predetermined reference point. The predetermined reference point may include the ground on which the medical device is located, the initial position of the patient table or probe 1200 (eg, the position of the state attached to the ultrasound device, etc.).

The current motion of the user may be estimated according to this tilt angle information. For example, it may be estimated that the degree of movement of the probe 1200 gradually increases as the change width of the inclination angle increases, and the movement angle range of the user who is operating the probe 1200 based on the estimated movement of the probe 1200. Motion information for the back may be obtained.

For example, the ground (or patient table) and the probe 1200 may form an angle of up to 90 degrees (eg, when the probe 1200 is positioned perpendicular to the ground). As the photographing proceeds, the user may move the probe 1200 in a predetermined direction and angle. An angle formed between the probe 1200 and the ground may be included within a predetermined range (eg, 0 degrees to 90 degrees). For example, when the user wants to photograph the ultrasound of the liver of the object, the probe 1200 may be parallel to the ground (eg, the probe 1200 and the ground form an angle of 0 degrees) or vertical (eg, the probe) according to a user's manipulation. 1200 and the ground at an angle of 90 degrees).

In other words, when the probe 1200 is moved in a state where the probe 1200 is parallel to the ground and the probe 1200 is perpendicular to the ground, the change width of the inclination angle may be maximum, and the width of the probe 1200 may be increased. The degree of movement may also be estimated to be maximum, and motion information indicating that the degree of movement of the user who is operating the probe 1200 is also maximum based on the estimated movement of the probe 1200.

Similarly, the inclination angle from the position of the initial state where the probe 1200 is attached on the ultrasound device may be obtained as the position information of the current probe 1200.

For example, in the sensor 123 according to an embodiment of the present invention, the direction toward the right or the east side of the sensor 123 is represented by a positive angle, and the direction toward the left or the west side is represented by a negative angle. It may be configured to be represented, but is not necessarily limited thereto.

Accordingly, when the probe 1200 is presently biased to the right from the initial position, a positive inclination angle may be sensed on the sensor 123, and the current probe 1200 may be sensed on the right side of the sensor 123. Information that it exists at the location of the figure may be obtained. In addition, when the probe 1200 is presently biased to the left from the initial position, a negative tilt angle may be sensed on the sensor 123, and the current probe 1200 may be sensed on the left side of the sensor 123. Information may be obtained that exists at the position of.

In addition, position information of the current probe 1200 may be obtained as height value information for a predetermined reference point. The predetermined reference point may include the ground, the patient table or the initial position of the probe 1200 (eg, the position attached to the ultrasound device, etc.). In this case, the predetermined sensor 123 may be a height sensor.

For example, the sensor 123 may sense information that the current probe 1200 is located at a height of about 120 cm from the ground. In addition, the sensor 123 may sense that the probe 1200 is currently positioned about 5 cm lower than the initial state attached to, for example, the ultrasound apparatus. In other words, the height value information for the predetermined reference point may be obtained as position information of the current probe 1200.

Based on the height value information (eg, the degree of change in height, etc.) of the probe 1200 according to an embodiment of the present invention, motion information indicating a degree of change in height of the posture of the user who is operating the probe 1200 may be obtained. have.

5 illustrates an example of motion information of a user obtained according to another embodiment of the present invention.

The user motion information according to an embodiment of the present invention may be obtained based on biometric information including at least one of fingerprint information of the user, iris information of the user, and facial information of the user.

User motion information according to an embodiment of the present invention may be obtained based on fingerprint information of the user.

For example, based on the fingerprint information 11 of the user acquired through the sensor 125 included in the probe 1200, the user may determine whether the user has gripped the probe 1200 with his left or right hand. have.

In other words, motion information about whether the user uses the probe 1200 for the left hand or the right hand may be obtained from the fingerprint information 11 of the user acquired through the sensor 125 included in the probe 1200. have.

For example, if the acquired fingerprint information 11 of the user is the fingerprint of the user's right hand thumb or index finger, it is determined that the user is currently holding the probe 1200 with his right hand, and the user's right hand uses the probe 1200. Motion information can be obtained.

In addition, if the acquired fingerprint information 11 of the user is the fingerprint of the thumb or the index finger of the user, it is determined that the user is holding the probe 1200 with his left hand, and the user may use the probe 1200 with his left hand. Motion information can be obtained.

In addition, according to an embodiment of the present invention, it is possible to identify who is currently using the probe based on the fingerprint information 11 of the user obtained through the sensor 125 included in the probe 1200. . In this case, the fingerprint information 11 of the user can be utilized as user identification information (eg, ID, etc.).

User motion information according to an embodiment of the present invention may be obtained based on at least one of the iris information 13 of the user and the face information 15 of the user.

As illustrated in FIG. 5, at least one of the iris information 13 of the user and the face information 15 of the user may be obtained through the sensor 111 provided on the ultrasound apparatus. The sensor 111 may be located near the display unit 2300 of the ultrasonic device, but is not necessarily limited thereto.

In addition, the sensor 111 may simultaneously perform iris recognition and face recognition, or may be implemented as each individual sensor having an iris recognition and face recognition.

According to an embodiment of the present invention, the iris information 13 of the user may be obtained through the sensor 111. The iris information 13 of the user may include user identification information about who the current user is, information about the current location of the iris of the current user, and the like. For example, by reading the iris of the user through the sensor 111, information about who the current user is can be obtained.

In addition, the current gaze of the user may be determined using current location information of the iris obtained through the sensor 111, and motion information of the user may be obtained based on the current gaze of the user. In other words, information about the current posture of the user may be obtained depending on whether the iris is biased to the left or positioned to the right in the user's eyes, but is not necessarily limited thereto.

For example, when the iris is generally biased to the left in the user's eye, it may be determined that the upper body of the user is directed to the right. In other words, it may be determined that the user is currently operating the probe 1200 with his right hand.

Similarly, when the iris is generally biased to the right in the user's eye, it may be determined that the upper body of the user is directed to the left. It may be determined that the user is operating the probe 1200 with the left hand.

According to an embodiment of the present invention, the face information 15 of the user may be obtained through the sensor 111. The facial information 15 of the user may include user identification information about who the current user is, information about the current facial direction of the user, and the like. For example, by reading the facial feature point, the facial contour, and the like of the user through the sensor 111, information about who the current user is can be obtained.

In addition, the main face of the user may be determined using face direction information of the user acquired through the sensor 111, and motion information of the user may be obtained based on the main face of the user. In other words, the current main face of the user may be determined based on the face area of the user, and information about the current posture of the user may be obtained from the determined main face.

For example, by comparing the area of the right face with the left face of the user, if the area of the left face is larger, it may be determined that the upper body of the user is directed to the right. In other words, it may be determined that the user is currently operating the probe 1200 with his right hand.

Similarly, by comparing the area of the right face with the left face of the user, when the area of the right face is wider, it may be determined that the upper body of the user is facing the left side. In other words, it may be determined that the user is currently operating the probe 1200 with his left hand.

In addition, motion information of the user may be obtained using the iris information 13 of the user and the face information 15 of the user. For example, when the area of the right and left faces of the user is compared, but it is not possible to clearly distinguish which area of the face is larger, the user's motion is further considered in consideration of the user's iris information as described above. Information can also be obtained.

6 illustrates an example of a user interface (UI) that can be changed and provided according to an embodiment of the present invention.

As shown in FIG. 6, a user interface (UI) (eg, 611 to 615) indicating an operation function in a medical device may be displayed and provided according to an embodiment of the present invention.

The UI according to an embodiment of the present invention may include at least one of a shortcut button, a switch, a keyboard, and a trackball indicating a function to be used when the object is examined.

According to an embodiment of the present invention, a user interface (UI) may include a user interface (UI) in the form of a keyboard 611 for inputting letters, numbers, etc., zooming / reducing an image, adjusting a resolution, and a 2D image. It may include a UI in the form of at least one button or switch 613, a UI in the form of a trackball 615, and the like, for example, switching between 3D images.

At least one of the above-described UI in the form of a keyboard 611, the UI in the form of at least one button or switch 613, and the UI in the form of a trackball 615 may be provided as a virtual UI layout.

In other words, the user interface (UI) according to an embodiment of the present invention does not always need to exist in a physically constant form, but in the form of letters, numbers, images, etc. on the display unit 2300 or the control panel 2500. It may exist virtually to represent a predetermined function.

FIG. 7 illustrates an aspect in which a user interface (UI) is changed and provided based on motion information of a user according to an embodiment of the present invention. For convenience of description, the user interface UI is simplified and shown in FIG. 7.

According to an embodiment of the present disclosure, the step of changing the UI by using the acquired motion information of the user (S200) may include changing at least one of a shape, a size, and a position of the UI according to the acquired motion information of the user. It may include.

As shown in FIG. 7A, the shape of the UI may be changed according to the acquired motion information of the user.

For example, when the movement range of the probe 1200 is very wide, that is, when the movement of the user increases, the user's touch to the user interface (UI) 611 to 615 may be inconvenient. In other words, the user's hand may not reach the user interface (UI), or the user may have difficulty operating the UI.

In this case, as in the exemplary embodiment of the present invention, the user's convenience may be increased by changing the shape of the user interface UI. The user interface UI may include a plurality of variable UIs whose shape is changed. For example, the UI 131 in the form of a keyboard 611 of FIG. 6, the UI in the form of a button or switch 613, and the like may be provided 132 by changing the shape of the UI 131 1 to 3 of FIG. 7A. have. For example, if the user uses the button 2 more frequently than the button 1 or the button 3 during the photographing process, the shape of the lower side may be changed to the shape of the longest triangle to increase the access probability of the button 2. In other words, it is possible to change the area of button 2 to be larger than button 1 or button 3. However, the UI may include a UI whose shape does not change. For example, the UI of FIG. 7A, which simplifies the UI in the form of the trackball 615 of FIG. 6, may not change shape.

In addition, the positions of the plurality of variable UIs may be changed. In one embodiment of the present invention, the positions of the buttons 1 to 3 may be changed. For example, the UI may be changed to be arranged in the order of button 3, button 1, and button 2. In this case, the button 1 may be the button with the highest frequency of use, and the button 1 may form a triangle having the longest lower side, but the shape before and after the change of the UI such as the button is not necessarily limited thereto. However, the UI may include a UI whose position does not change. For example, the UI of FIG. 7A, which simplifies the UI in the form of the trackball 615 of FIG. 6, may not change its position.

In addition, as illustrated in FIG. 7B, the UI may include a plurality of variable UIs whose sizes of the UI are changed according to the acquired motion information of the user.

As described above, when the user's movement increases, the size of a button or the like of the UI pattern 131 is increased or decreased in whole or in part, thereby changing the size of the UI so that the user can easily access the UI such as the button (135). )can do.

For example, by increasing the size of the buttons 1 to 3, the accessibility of the user's buttons can be improved. Similarly, by changing the positions of the buttons 1 to 3 close to the user, the accessibility of the user's buttons can be improved. In the embodiment illustrated in FIGS. 7A and 7B, at least one of the shape, size, and position of the UI including the buttons 1 to 3 includes at least one of a user's usage history, frequency of use, and degree of access with respect to the UI. It can be changed based on the usage information. However, the UI may include a UI whose size does not change. For example, the UI of FIG. 7B, which simplifies the UI in the form of the trackball 615 of FIG. 6, may not be changed in size.

In addition, as shown in FIG. 7C, different patterns of UIs may be provided according to physical features of the user.

For example, when the user is right-handed, the right-hand UI pattern 131 may be provided. In addition, when the user is left-handed, the left-hand UI pattern 133 may be provided. The right-hand UI pattern 131 and the left-hand UI pattern 133 may be symmetrical with each other, and may be mutually switched based on user motion information as described above.

FIG. 8 illustrates an aspect in which a user interface (UI) is changed and provided based on motion information of a user according to another embodiment of the present invention.

According to an embodiment of the present invention, at least one of a shape, a size, and a position may be differently provided depending on the frequency of a function used when examining an object.

For example, the UI pattern 131 of FIG. 7 that simplifies the UI in the form of a keyboard 611 of FIG. 6, the UI in the form of a button or switch 613, and the like, is illustrated in FIGS. 8B and 8C. The UI may be provided (137 or 139) by changing at least one of a shape, a size, and a position according to a frequency of a function used. For convenience of description, it is assumed that the UI pattern 131 of FIG. 8A is a basic pattern that can be provided in a medical device.

For example, the track ball is not used in a predetermined examination item, and a function corresponding to button 2 of the button type UI, which is simplified to 1 to 3, may be most used. In this case, as shown in FIG. 8B, the circular UI of the trackball function may be omitted in the basic pattern 131, and the size of the UI of the button 2 may be changed to be the largest.

In the embodiment described with reference to FIG. 8, at least one of a shape, a size, and a position of the UI may be changed based on usage information regarding a function that a user frequently uses when examining an object. In other words, by omitting a UI that is not used or used less frequently by the user, and providing a UI with a high frequency of use, the accessibility and convenience of the user who operates the medical device can be increased.

As another example, if a user mainly uses the trackball in a predetermined examination item and most uses the third button (for example, a zoom function, etc.) of the button type UI, the basic pattern 131 as shown in FIG. 8C. ) Can be provided by changing the size of the button 3 of the circular UI and the button-type UI corresponding to the trackball significantly (139).

In addition, although the UI may be disposed and provided in a radial form as in the pattern 139 of FIG. 8C, similar to the shape of the user's hand, the present invention is not limited thereto.

In addition, since the frequency of the functions used may vary according to the test type, a UI having a different pattern may be provided according to the test type.

For example, the frequency of use of the functions provided by the ultrasound apparatus may vary depending on the types of tests, such as cardiac ultrasound, liver ultrasound, abdominal ultrasound, pelvic ultrasonography, and Doppler ultrasound. For example, in an echocardiography, an image zooming function and a trackball function are frequently used, whereas in liver ultrasound, a resolution adjustment function may be used more than an zooming and trackball function.

In other words, in the echocardiography, a UI that performs an enlargement / reduction function of an image and a UI that performs a trackball function may be relatively larger than other UIs, and may be positioned in the center of the control panel 2500.

On the other hand, in the liver ultrasound examination, the size of the UI of the zooming / reducing function of the image and the UI of the trackball function can be reduced or omitted, and the UI of adjusting the resolution of the center of the control panel 2500 is relatively large. You can change the UI pattern so that it is laid out in size.

9A illustrates an example of editing a user interface (UI) in accordance with one embodiment of the present invention.

According to an external input signal according to an embodiment of the present invention, the UI may be editable.

For example, the UI can be added, deleted, repositioned, and resized according to user input. In addition, the UI may change a language, a font, and a UI display color according to a user input.

For example, the position or size of the button-type UI may change according to a user input.

As shown in FIG. 9, the position or size of the UI may be changed based on a user's predetermined input to the UI. The predetermined input of the user according to an embodiment of the present invention may include at least one of at least one click on the UI and a press for a predetermined time. The predetermined input may also include a case where a plurality of inputs are simultaneously input.

For example, an edit start signal is applied to the button 1 of the button type UI as a user input by pressing about 1 second to 1.5 seconds, and a drag and drop 21 signal to the target position of the button 1 is received. To change the position of button 1.

The drag and drop 21 signal may be a continuous user input signal. In other words, for example, the user input signal of the drag and drop 21 for the button 1 may be a signal that is continuously applied. For example, the drag and drop 21 signal may be applied by one touch, but is not necessarily limited thereto.

Further, for example, after receiving the edit start signal, the first button can be enlarged or reduced by receiving a drag signal in a predetermined direction with respect to the boundary line of the first button.

In addition, for example, after receiving the edit start signal, the UI may be deleted by clicking the UI once again.

In addition, for example, the UI may be added by receiving a UI addition start signal through a press 23 for a few seconds (for example, about 1 second to 2 seconds, etc.) applied by the user to an empty space other than the UI.

Also, for example, an existing UI or a newly added UI may be a UI based on an external input signal including a plurality of clicks or a predetermined pattern (eg, star, triangle, square, etc.) input to the UI. You can reset the function of. In other words, functions (eg, switching between 2D and 3D images, adjusting resolution, etc.) applicable to the corresponding UI per predetermined pattern or click may be displayed on the corresponding UI.

In addition, according to another embodiment of the present invention, functions applicable to an existing UI or a newly added UI may be provided in the form of a preset table or the like.

For example, such a table may be provided in the form of a popup, or may be provided in the form of being displayed in a margin of the control panel 2500 or the like. When applicable functions are provided for the UI, the function for the existing UI or newly added UI may be reset according to the user's matching input (eg, sequential click, drag and drop, etc.), but is not necessarily limited thereto. .

The order of matching between the UI and the function is to first select a function to be applied according to user input, select a UI to which the selected function is applied, or first select a UI to reset the function, and select a function to be applied to the selected UI. You can follow any of the methods.

Similarly, the language, font, color, etc. displayed in the existing UI or the newly added UI may be changed and displayed. In other words, by receiving an external input signal such as a signal for selecting the nationality of the user, letters, numbers, and the like displayed on the UI may be changed to suit the user's language.

In addition, the language displayed on the UI may be automatically changed according to the nationality included in the user profile including the identification information of the user.

In addition, a signal for changing the UI display color to a color selected from among preset color tables that can be provided may be received as an external input signal to change the color displayed on the UI.

9B illustrates an example of the use of a modified user interface (UI) in accordance with one embodiment of the present invention.

When the user interface (UI) is changed based on the motion information according to an embodiment of the present invention, when the user does not fully recognize the change of the UI, the user may be confused or cause a malfunction in using the changed UI. Accordingly, by indicating the UI usage state of the user with respect to the changed UI according to an embodiment of the present invention, it is possible to prevent the user from confusion or malfunction.

The UI use status of the user may be provided in real time. In addition, the UI usage state of the user may be provided as at least one of an image including a letter, a number, and the like and a sound such as a voice.

For example, the UI used by the user to perform a predetermined function may be displayed to the user for a predetermined time through the display unit 2300. Through this display, the user can recognize exactly what UI he wants to use.

As shown in FIG. 9B, if the user presses the second button (eg, 2D to 3D switching function) with respect to the changed UI 139 (91), the function of the second button for a predetermined time is The information 93 may appear on the upper left of the display unit 2300. For example, when the user presses the button 2 (91), the function information 93 of “2D → 3D” may be displayed on the display unit 2300 or the like for about 1 second or 1.5 seconds, but disappears. It is not necessarily limited thereto.

In addition, as shown in FIG. 9B, according to the pressing 91 of the button 2 by the user, the function of the button 2 (for example, a 2D to 3D switching function) is performed to perform a 3D image 115 of the object. Can be obtained.

In addition, the UI use state of the user may be provided in the form of a sound such as a voice. As in the above example, when the user presses the second button, the UI use state of the user may be provided to the user in the form of a voice message, such as "to switch from 2D to 3D".

10 illustrates an aspect in which a user interface (UI) is provided according to an embodiment of the present invention.

The UI according to an embodiment of the present invention may be displayed through at least one of the display unit 2300 on which the photographed image of the object is displayed and the control panel 2500 equipped with the display function.

Due to the necessity of a portable medical device and the miniaturization of the medical device, a screen for displaying an image of an object and a control panel providing screen may coexist on a single touch screen. In other words, as illustrated in FIG. 10A, the image 113 of the object may be provided on the same screen as the UI pattern 131 (eg, the display unit 2300).

However, the use of the integrated display may make it difficult to read a photographed image of an object due to a foreign material such as dust or a fingerprint of a user.

According to an embodiment of the present invention, as shown in FIG. 10B, the UI that can be changed and provided may be provided through a control panel 2500 having a display function other than the display unit of the captured image. For example, the captured image may be provided to the user through the display unit 2300, and the predetermined UI pattern 131 may be provided separately from the captured image to the user through the control panel 2500 having a display function. have.

11 is a flowchart illustrating a method of controlling the operation of a medical device according to another embodiment of the present invention. 12 illustrates an example of medical device operation control according to another embodiment of the present invention.

The method according to an embodiment of the present disclosure may further include adjusting at least one of a height and an angle of the control panel according to the motion information of the user (S400).

In order to maximize the convenience of the user's medical device, the physical position of a predetermined component (eg, the display unit 2300, the control panel 2500, etc.) of the medical device may be adjusted based on motion information reflecting the posture of the user. .

For example, the position of a predetermined component (eg, the display unit 2300, the control panel 2500, etc.) of the medical device may be automatically adjusted according to which hand the user holds the probe before photographing the object.

For example, when the user grips the probe with his right hand, the upper body of the user is very likely to change to the right as the photographing starts. Accordingly, the display unit 2300 and the control panel 2500 may be moved upward, downward, leftward, rightward, horizontal or vertical, at a predetermined angle toward the user according to the motion information obtained from the user's movement. In other words, the display unit 2300, the control panel 2500, and the like may be moved up, down, left, right, horizontally or vertically, at a predetermined angle so as to face the user (or as much as possible in front of the user). .

Also, as described above, the display unit 2300, the control panel 2500, and the like face the user (or as close to the front of the user as possible) based on the motion information that can be obtained by the user who is shooting the object. ) Up, down, left, right, horizontal or vertical, can be moved at a predetermined angle.

As shown in FIG. 12, at least one of the height and angle of the control panel 2500 may be adjusted to correspond to the movement of the probe 1200. In other words, as the position of a predetermined component (eg, the display unit 2300, the control panel 2500, etc.) of the medical device may be moved, the user's convenience of the medical device may be further increased.

13 is a flowchart illustrating a method of managing a changed UI according to another embodiment of the present invention.

The method according to an embodiment of the present invention may further include obtaining identification information of the user (S500) and storing the changed UI according to the obtained identification information (S600), but is not limited thereto. no. For example, acquiring user identification information (S500) may be performed before acquiring motion information of the user (S100).

In addition, the obtaining of the user identification information (S500) may be performed simultaneously with the obtaining of the motion information of the user (S100).

For example, as described above, a user profile including biometric information of the user may be obtained at the same time that fingerprint information, iris information, facial information, etc. of the user are obtained. In other words, the user identification information may be included in the user profile together with the user biometric information, and the user profile may be previously built in the form of a database.

For example, a preferred UI pattern for each user, or a changed UI according to an embodiment of the present invention is stored according to user identification information (eg, ID, etc.), and the user may then correspond to his identification information as needed. You can also load and use saved UI patterns.

In other words, since the physical and behavioral characteristics of the user may be different, a database of appropriate UI patterns or previously changed UI patterns according to the user identification information is stored in a database, and the identification information of the user when the user operates the medical device. By loading the UI pattern corresponding to the setting environment of the medical device, the shooting time can be shortened.

FIG. 14 illustrates an apparatus for changing and providing a user interface (UI) used in the examination of an object through a medical device based on user motion information according to an embodiment of the present invention.

The apparatus 2000 for changing and providing a user interface (UI) used in the examination of an object through a medical device based on the user's motion information according to an embodiment of the present invention may provide the user's motion information. It may include a motion information acquisition unit 2100 to obtain, a UI change unit 2200 for changing the UI using the obtained motion information of the user, and a display unit 2300 capable of displaying the changed UI.

The motion information acquisition unit 2100 may acquire motion information indicating whether the user uses the probe 1200 with his left hand or the probe 1200 with his right hand.

For example, a user who mainly uses his left hand will place an object (eg, a patient) on his left side and proceed with imaging. In addition, a user who mainly uses his right hand will place an object on his right side and proceed with imaging. In other words, the left hand may hold the probe 1200 with his left hand and proceed with image capturing, and the right hand may hold the probe 1200 with his right hand and proceed with image capturing.

A user of a medical device, particularly an ultrasound diagnostic device, acquires an image of an object by manipulating the control panel 2500 as well as the probe 1200. Therefore, in order to increase convenience of use of the medical device user, a user interface (UI) or the like may be provided in a different form on the control panel according to the user's use of the probe 1200.

As described above, when the user is right-handed, it may be convenient for the user to position the object on his right side and manipulate the probe by using the right hand, so that a button UI, a trackball UI, and the like on the control panel are the right-hand UI. If provided as a pattern (131 of FIG. 2B), the user may feel the convenience of utilizing the medical device.

Similarly, when the user is left-handed, it may be convenient for the user to place the object on his left side and manipulate the probe using his left hand, so that the user may be able to use a button UI on the control panel, a trackball UI, etc. Can be provided as a left hand UI pattern (133 of FIG. 2B).

The right-hand UI pattern 131 and the left-hand UI pattern 133 on the control panel may be switched with each other based on the motion information of the user.

For example, when user A and user B exist as a user who uses a medical device, and user A, who is right-handed, wants to use the medical device, the right hand on the control panel 2500 according to an embodiment of the present invention. UI pattern (131 of FIG. 2B) may be provided. In contrast, when a user B who is left-handed wants to use a medical device, the UI pattern for the left hand (FIG. 2) may be provided on the control panel 2500 according to an embodiment of the present disclosure. 133 of 2b may be provided.

In other words, according to one embodiment of the present invention, each user can flexibly use the medical device without being limited to his or her physical or behavioral characteristics, and provides a UI of a suitable pattern according to the user, There is an effect that can increase the user convenience.

Changing the user interface (UI) or the like based on the motion information obtained according to an embodiment of the present invention may be configured to adaptively adjust the photographing environment of the medical device to the user so that the user can conveniently operate the medical device. It may include. As described above, depending on whether the user is a good user or a left-handed user, the layout of the UI such as the control panel 2500 may be different, the layout, size, etc. of the UI may be changed depending on the type of examination, or the frequency of use of the buttons used for shooting. Depending on the layout, the size of the UI can be adjusted and provided.

15 illustrates an apparatus further including a sensing unit according to an embodiment of the present invention.

The motion information acquisition unit 2100 according to an embodiment of the present invention may further include a sensing unit 2110.

Motion information of a user according to an exemplary embodiment of the present invention may be obtained based on location information of a current probe acquired through the sensing unit 2110.

The position information of the current probe according to an embodiment of the present invention may include at least one of a current direction of the probe, an inclination angle with respect to a predetermined reference point, and a height value.

For example, position information of the current probe 1200 may be obtained based on the current direction of indication of the probe 1200. For example, the probe 1200 may be included in the probe 1200 for connection with the ultrasonic device (eg, included at the end of the probe, etc.) or through a predetermined sensor 121 or the like embedded in the ultrasonic device to which the probe 1200 is connected. Current indication direction information) may be obtained.

The predetermined sensor 121 may be configured to determine the direction in which the probe 1200 is directed according to which direction the connection line of the probe 1200 is directed from the reference line (eg, the center line ML of the sensor 121). have. In other words, the predetermined sensor 121 according to an embodiment of the present invention may operate similar to the operating principle of the toggle switch.

Referring back to FIG. 4A of the present application, if the probe 1200 is deflected to the right from the center line ML, it may be determined that the position information of the current probe 1200 indicates the right side of the ultrasound apparatus. For example, information that the probe 1200 is located on the right side of the ultrasound apparatus may be obtained.

Alternatively, if the probe 1200 is biased to the left from the center line ML, it may be determined that the position information of the current probe 1200 indicates the left side of the ultrasound apparatus. In other words, information that the probe 1200 is located on the left side of the ultrasound apparatus may be obtained.

In addition, when the probe 1200 according to an embodiment of the present invention is wireless, the predetermined sensor 121 may be configured to sense GPS (Global Positioning System) coordinates of the wireless probe through wireless communication.

In addition, according to an embodiment of the present invention, the position information of the current probe 1200 may include at least one of an inclination angle and a height value with respect to a predetermined reference point.

As shown in FIG. 4B, the probe 1200 may include a sensor 123 or the like for obtaining tilt information or height information. The sensor 123 may include a gyro sensor, a height sensor, or the like.

For example, position information of the current probe 1200 may be obtained as tilt angle information with respect to a predetermined reference point. The predetermined reference point may include the ground on which the medical device is located, the initial position of the patient table or probe 1200 (eg, the position of the state attached to the ultrasound device, etc.).

The current motion of the user may be estimated according to this tilt angle information. For example, it may be estimated that the degree of movement of the probe 1200 gradually increases as the change width of the inclination angle increases, and the movement angle range of the user who is operating the probe 1200 based on the estimated movement of the probe 1200. Motion information for the back may be obtained.

For example, the ground (or patient table) and the probe 1200 may form an angle of up to 90 degrees (eg, when the probe 1200 is positioned perpendicular to the ground). As the photographing proceeds, the user may move the probe 1200 in a predetermined direction and angle. An angle formed between the probe 1200 and the ground may be included within a predetermined range (eg, 0 degrees to 90 degrees). For example, when the user wants to photograph the ultrasound of the liver of the object, the probe 1200 may be parallel to the ground (eg, the probe 1200 and the ground form an angle of 0 degrees) or vertical (eg, the probe) according to a user's manipulation. 1200 and the ground at an angle of 90 degrees).

In other words, when the probe 1200 is moved in a state where the probe 1200 is parallel to the ground and the probe 1200 is perpendicular to the ground, the change width of the inclination angle may be maximum, and the width of the probe 1200 may be increased. The degree of movement may also be estimated to be maximum, and motion information indicating that the degree of movement of the user who is operating the probe 1200 is also maximum based on the estimated movement of the probe 1200.

Similarly, the inclination angle from the position of the initial state where the probe 1200 is attached on the ultrasound device may be obtained as the position information of the current probe 1200.

For example, in the sensor 123 according to an embodiment of the present invention, the direction toward the right or the east side of the sensor 123 is represented by a positive angle, and the direction toward the left or the west side is represented by a negative angle. It may be configured to be represented, but is not necessarily limited thereto.

Accordingly, when the probe 1200 is presently biased to the right from the initial position, a positive inclination angle may be sensed on the sensor 123, and the current probe 1200 may be sensed on the right side of the sensor 123. Information that it exists at the location of the figure may be obtained. In addition, when the probe 1200 is presently biased to the left from the initial position, a negative tilt angle may be sensed on the sensor 123, and the current probe 1200 may be sensed on the left side of the sensor 123. Information may be obtained that exists at the position of.

In addition, position information of the current probe 1200 may be obtained as height value information for a predetermined reference point. The predetermined reference point may include the ground, the patient table or the initial position of the probe 1200 (eg, the position attached to the ultrasound device, etc.). In this case, the predetermined sensor 123 may be a height sensor.

For example, the sensor 123 may sense information that the current probe 1200 is located at a height of about 120 cm from the ground.

In addition, the sensor 123 may sense that the probe 1200 is currently positioned about 5 cm lower than the initial state attached to, for example, the ultrasound apparatus. In other words, the height value information for the predetermined reference point may be obtained as position information of the current probe 1200.

Based on the height value information (eg, the degree of change in height, etc.) of the probe 1200 according to an embodiment of the present invention, motion information indicating a degree of change in height of the posture of the user who is operating the probe 1200 may be obtained. have.

The user motion information according to an embodiment of the present invention may be obtained based on biometric information including at least one of a fingerprint information of a user, an iris information of a user, and facial information of a user obtained through the sensing unit 2110. have.

Referring back to FIG. 5 of the present application, based on the fingerprint information 11 of the user obtained through the sensor 125 included in the probe 1200, the user may select the probe 1200 with either the left hand or the right hand. It can be determined whether or not gripping.

In other words, motion information about whether the user uses the probe 1200 for the left hand or the right hand may be obtained from the fingerprint information 11 of the user acquired through the sensor 125 included in the probe 1200. have.

For example, if the acquired fingerprint information 11 of the user is the fingerprint of the user's right hand thumb or index finger, it is determined that the user is currently holding the probe 1200 with his right hand, and the user's right hand uses the probe 1200. Motion information can be obtained.

In addition, if the acquired fingerprint information 11 of the user is the fingerprint of the thumb or the index finger of the user, it is determined that the user is holding the probe 1200 with his left hand, and the user may use the probe 1200 with his left hand. Motion information can be obtained.

In addition, according to an embodiment of the present invention, it is possible to identify who is currently using the probe based on the fingerprint information 11 of the user obtained through the sensor 125 included in the probe 1200. . In this case, the fingerprint information 11 of the user can be utilized as user identification information (eg, ID, etc.).

In addition, the user motion information according to an embodiment of the present invention may be obtained based on at least one of the user's iris information 13 and the user's face information 15.

5 again, at least one of the iris information 13 of the user and the face information 15 of the user may be obtained through a sensor 111 provided on the ultrasound apparatus. The sensor 111 may be located near the display unit 2300 of the ultrasonic device, but is not necessarily limited thereto.

In addition, the sensor 111 may simultaneously perform iris recognition and face recognition, or may be implemented as each individual sensor having an iris recognition and face recognition.

According to an embodiment of the present invention, the iris information 13 of the user may be obtained through the sensor 111. The iris information 13 of the user may include user identification information about who the current user is, information about the current location of the iris of the current user, and the like. For example, by reading the iris of the user through the sensor 111, information about who the current user is can be obtained.

In addition, the current gaze of the user may be determined using current location information of the iris obtained through the sensor 111, and motion information of the user may be obtained based on the current gaze of the user. In other words, information about the current posture of the user may be obtained depending on whether the iris is more biased toward the left or the right in the user's eyes, but is not necessarily limited thereto.

For example, when the iris is generally biased to the left in the user's eye, it may be determined that the upper body of the user is directed to the right. In other words, it may be determined that the user is currently operating the probe 1200 with his right hand.

Similarly, when the iris is generally biased to the right in the user's eye, it may be determined that the upper body of the user is directed to the left. It may be determined that the user is operating the probe 1200 with the left hand.

According to an embodiment of the present invention, the face information 15 of the user may be obtained through the sensor 111. The facial information 15 of the user may include user identification information about who the current user is, information about the current facial direction of the user, and the like. For example, by reading the facial feature point, the facial contour, and the like of the user through the sensor 111, information about who the current user is can be obtained.

In addition, the main face of the user may be determined using face direction information of the user acquired through the sensor 111, and motion information of the user may be obtained based on the main face of the user. In other words, the current main face of the user may be determined based on the face area of the user, and information about the current posture of the user may be obtained from the determined main face.

For example, by comparing the area of the right face with the left face of the user, if the area of the left face is larger, it may be determined that the upper body of the user is directed to the right. In other words, it may be determined that the user is currently operating the probe 1200 with his right hand.

Similarly, by comparing the area of the right face with the left face of the user, when the area of the right face is wider, it may be determined that the upper body of the user is facing the left side. In other words, it may be determined that the user is currently operating the probe 1200 with his left hand.

In addition, motion information of the user may be obtained using the iris information 13 of the user and the face information 15 of the user. For example, when the area of the right and left faces of the user is compared, but it is not possible to clearly distinguish which area of the face is larger, the user's motion is further considered in consideration of the user's iris information as described above. Information can also be obtained.

The UI according to an embodiment of the present invention may include at least one of a shortcut button, a switch, a keyboard, and a trackball indicating a function to be used when the object is examined.

Referring back to FIG. 6 of the present application, in accordance with an embodiment of the present invention, a user interface (UI) for displaying operating functions in a medical device includes a keyboard 611, a button or switch 613, a trackball 615, and the like. It may include.

According to an embodiment of the present invention, a user interface (UI) may include a user interface (UI) in the form of a keyboard 611 for inputting letters, numbers, etc., zooming / reducing an image, adjusting resolution, and 2D image. It may include a UI in the form of at least one button or switch 613, a UI in the form of a trackball 615, and the like, for example, switching between 3D images.

At least one of the above-described UI in the form of a keyboard 611, the UI in the form of at least one button or switch 613, and the UI in the form of a trackball 615 may be provided as a virtual UI layout.

In other words, the user interface (UI) according to an embodiment of the present invention does not always need to exist in a physically constant form, but in the form of letters, numbers, images, etc. on the display unit 2300 or the control panel 2500. It may exist virtually to represent a predetermined function.

The UI changer 2200 according to an embodiment of the present invention may change at least one of a shape, a size, and a position of the UI according to the obtained motion information of the user. The UI changer 2200 may be configured as a hardware device including a processor.

Referring back to FIG. 7A of the present invention, the shape of the UI may be changed according to the acquired motion information of the user.

For example, when the movement range of the probe 1200 is very wide, that is, when the movement of the user increases, the user's touch to the user interface (UI) 611 to 615 may be inconvenient. In other words, the user's hand may not reach the user interface (UI), or the user may have difficulty operating the UI.

In this case, as in the exemplary embodiment of the present invention, the user's convenience may be increased by changing the shape of the user interface UI. The user interface UI may include a plurality of variable UIs whose shape is changed. For example, if the user uses the button 2 more frequently than the button 1 or the button 3 during the photographing process, the shape of the lower side may be changed to the shape of the longest triangle to increase the access probability of the button 2. In other words, it is possible to change the area of button 2 to be larger than button 1 or button 3. However, the UI may include a UI whose shape does not change. For example, the UI of FIG. 7A, which simplifies the UI in the form of the trackball 615 of FIG. 6, may not change shape.

In addition, the positions of the plurality of variable UIs may be changed. According to an embodiment of the present invention, the positions of the buttons 1 to 3 may be changed. For example, the UI may be changed to be arranged in the order of button 3, button 1, and button 2. In this case, the button 1 may be the button with the highest frequency of use, and the button 1 may form a triangle having the longest lower side, but the shape before and after the change of the UI such as the button is not necessarily limited thereto. However, the UI may include a UI whose position does not change. For example, the UI of FIG. 7A, which simplifies the UI in the form of the trackball 615 of FIG. 6, may not change its position.

In addition, referring back to FIG. 7B of the present invention, the UI may include a plurality of variable UIs whose sizes are changed according to the obtained motion information of the user.

As described above, when the user's movement increases, the size of a button or the like of the UI pattern 131 is increased or decreased in whole or in part, thereby changing the size of the UI so that the user can easily access the UI such as the button (135). )can do.

For example, by increasing the size of the buttons 1 to 3, the accessibility of the user's buttons can be improved. Similarly, by changing the positions of the buttons 1 to 3 close to the user, the accessibility of the user's buttons can be improved. However, the UI may include a UI whose size does not change. For example, the UI of FIG. 7B, which simplifies the UI in the form of the trackball 615 of FIG. 6, may not be changed in size. Referring to FIGS. 7A and 7B together with FIG. 15, the UI change unit 2200 may determine a shape, size, and position of the UI based on usage information including at least one of a usage history, a frequency of use, and an access level of the UI. You can change at least one.

Referring back to FIG. 7C of the present application, different patterns of UI may be provided based on the physical characteristics of the user.

For the good user, the right-hand UI pattern 131 may be provided. In addition, the left hand UI pattern 133 may be provided to the left user. The right-hand UI pattern 131 and the left-hand UI pattern 133 may be symmetrical with each other, and may be mutually switched based on user motion information as described above.

According to an embodiment of the present invention, at least one of a shape, a size, and a position may be differently provided according to a frequency of a function used when examining an object.

Referring back to FIG. 8 of the present application, the UI pattern 131 is provided with a UI changed in at least one of shape, size, and position according to a frequency of a function used in the examination of an object, as shown in FIGS. 8B and 8C. (137 or 139). For convenience of description, it is assumed that the UI pattern 131 of FIG. 8A is a basic pattern that can be provided in a medical device.

For example, the track ball is not used in a predetermined examination item, and a function corresponding to button 2 of the button type UI, which is simplified to 1 to 3, may be most used. In this case, as shown in FIG. 8B, the circular UI of the trackball function may be omitted in the basic pattern 131, and the size of the UI of the button 2 may be changed to be the largest.

Referring to FIG. 8 along with FIG. 15, the UI changer 2200 may change at least one of a shape, a size, and a position of the UI based on usage information regarding a function frequently used by a user for examining an object. In other words, by omitting a UI that is not used or used less frequently by the user, and providing a UI with a high frequency of use, the accessibility and convenience of the user who operates the medical device can be increased.

As another example, if a user mainly uses the trackball in a predetermined examination item and most uses the third button (for example, a zoom function, etc.) of the button type UI, the basic pattern 131 as shown in FIG. 8C. ) Can be provided by changing the size of the button 3 of the circular UI and the button-type UI corresponding to the trackball significantly (139).

In addition, although the UI may be disposed and provided in a radial form as in the pattern 139 of FIG. 8C, similar to the shape of the user's hand, the present invention is not limited thereto.

In addition, since the frequency of the functions used may vary according to the test type, a UI having a different pattern may be provided according to the test type.

For example, the frequency of use of the functions provided in the ultrasound apparatus may vary depending on the types of examinations such as cardiac ultrasound, liver ultrasound, abdominal ultrasound, gynecological ultrasound, and Doppler ultrasound. For example, in an echocardiography, an image zooming function and a trackball function are frequently used, whereas in liver ultrasound, a resolution adjustment function may be used more than an zooming and trackball function.

In other words, in the echocardiography, a UI that performs an enlargement / reduction function of an image and a UI that performs a trackball function may be relatively larger than other UIs, and may be positioned in the center of the control panel 2500.

On the other hand, in the liver ultrasound examination, the size of the UI of the zooming / reducing function of the image and the UI of the trackball function can be reduced or omitted, and the UI of adjusting the resolution of the center of the control panel 2500 is relatively large. You can change the UI pattern so that it is laid out in size.

16 illustrates an apparatus further including a sensing unit, an external input receiver, and a control panel according to an embodiment of the present invention.

The apparatus 2000 according to an embodiment of the present invention may further include an external input receiver 2400.

The UI according to an embodiment of the present invention may be edited by the UI changer 2200 according to an external input signal received through the external input receiver 2400.

The UI according to an embodiment of the present invention may be added, deleted, positioned, or changed in size according to a user input. In addition, the UI may change a language, a font, and a UI display color according to a user input.

For example, the position or size of the button-type UI may change according to a user input.

Referring back to FIG. 9 of the present application, the position or size of the UI may be changed based on a user's predetermined input to the UI. The predetermined input of the user according to an embodiment of the present invention may include at least one of at least one click on the UI and a press for a predetermined time. The predetermined input may also include a case where a plurality of inputs are simultaneously input.

For example, an edit start signal is applied as a user input to button 1 of the button type UI as a user input, and a drag and drop 21 signal to button 1 is applied to a target position. To change the position of button 1.

The drag and drop 21 signal may be a continuous user input signal. In other words, for example, the user input signal of the drag and drop 21 for the button 1 may be a signal that is continuously applied. For example, the drag and drop 21 signal may be applied by one touch, but is not necessarily limited thereto.

Further, for example, after receiving the edit start signal, the first button can be enlarged or reduced by receiving a drag signal in a predetermined direction with respect to the boundary line of the first button.

In addition, for example, after receiving the edit start signal, the UI may be deleted by clicking the UI once again.

In addition, for example, the UI may be added by receiving a UI addition start signal through a press 23 for a few seconds (for example, about 1 second to 2 seconds, etc.) applied by the user to an empty space other than the UI.

Also, for example, an existing UI or a newly added UI may be a UI based on an external input signal including a plurality of clicks or a predetermined pattern (eg, star, triangle, square, etc.) input to the UI. You can reset the function of. In other words, functions (eg, switching between 2D and 3D images, adjusting resolution, etc.) applicable to the corresponding UI per predetermined pattern or click may be displayed on the corresponding UI.

In addition, according to another embodiment of the present invention, functions applicable to an existing UI or a newly added UI may be provided in the form of a preset table or the like.

For example, such a table may be provided in the form of a popup, or may be provided in the form of being displayed in a margin of the control panel 2500 or the like. When applicable functions are provided for the UI, the function for the existing UI or newly added UI may be reset according to the user's matching input (eg, sequential click, drag and drop, etc.), but is not necessarily limited thereto. . The order of matching between the UI and the function is to first select a function to be applied according to user input, select a UI to which the selected function will be applied, or first select a UI to reset the function, and select a function to be applied to the selected UI. You can follow any of the methods.

Similarly, the language, font, color, etc. displayed in the existing UI or the newly added UI may be changed and displayed. In other words, by receiving an external input signal such as a signal for selecting the nationality of the user, letters, numbers, and the like displayed on the UI may be changed to suit the user's language. In addition, the language displayed on the UI may be automatically changed according to the nationality included in the user profile including the identification information of the user.

In addition, a signal for changing the UI display color to a color selected from among preset color tables that can be provided may be received as an external input signal to change the color displayed on the UI.

The apparatus 2000 according to an embodiment of the present invention may further include a control panel 2500 having a display function.

The UI according to an embodiment of the present invention may be displayed through at least one of the display unit 2300 and the control panel 2500.

The UI according to an embodiment of the present invention may be displayed through at least one of the display unit 2300 on which the photographed image of the object is displayed and the control panel 2500 equipped with the display function.

Due to the necessity of a portable medical device and the miniaturization of the medical device, a screen for displaying an image of an object and a control panel providing screen may coexist on a single touch screen. In other words, referring back to FIG. 10A, the image 113 of the object may be provided on the same screen as the UI pattern 131 (eg, the display unit 2300).

However, the use of the integrated display may make it difficult to read a photographed image of an object due to a foreign material such as dust or a fingerprint of a user.

Referring back to FIG. 10B of the present application, a UI which can be changed and provided according to an embodiment of the present invention may be provided through a control panel 2500 having a display function other than the display unit of the photographed image. For example, the captured image may be provided to the user through the display unit 2300, and the predetermined UI pattern 131 may be provided to the user separately from the captured image through the control panel 2500 equipped with the display function. have.

17 illustrates an apparatus further including a sensing unit, an external input receiver, a control panel, and a controller according to an embodiment of the present invention.

The apparatus 2000 according to an embodiment of the present invention may further include a controller 2600. The controller 2600 according to an exemplary embodiment of the present invention may adjust at least one of the height and the angle of the control panel 2500 according to the motion information of the user.

In order to maximize the convenience of the user's medical device, the physical position of a predetermined component (eg, the display unit 2300, the control panel 2500, etc.) of the medical device may be adjusted based on motion information reflecting the posture of the user. .

For example, the position of a predetermined component (eg, the display unit 2300, the control panel 2500, etc.) of the medical device may be automatically adjusted according to which hand the user holds the probe before photographing the object.

For example, when the user grips the probe with his right hand, the upper body of the user is very likely to change to the right as the photographing starts. Accordingly, the display unit 2300 and the control panel 2500 may be moved upward, downward, leftward, rightward, horizontal or vertical, at a predetermined angle toward the user according to the motion information obtained from the user's movement. In other words, the display unit 2300, the control panel 2500, and the like may be moved up, down, left, right, horizontally or vertically, at a predetermined angle so as to face the user (or as much as possible in front of the user). .

Also, as described above, the display unit 2300, the control panel 2500, and the like face the user (or as close to the front of the user as possible) based on the motion information that can be obtained by the user who is shooting the object. ) Up, down, left, right, horizontal or vertical, can be moved at a predetermined angle. Referring back to FIG. 12 of the present disclosure, at least one of the height and angle of the control panel 2500 may be adjusted to correspond to the movement of the probe 1200. In other words, as the position of a predetermined component (eg, the display unit 2300, the control panel 2500, etc.) of the medical device may be moved, the user's convenience of the medical device may be further increased.

FIG. 18 illustrates an apparatus for changing and providing a user interface (UI) based on motion information of a user according to another embodiment of the present invention.

The apparatus 2000 according to an exemplary embodiment of the present invention may include a motion information acquirer 2100, a UI changer 2200, a display 2300, an external input receiver 2400, a control panel 2500, and a controller ( 2600, and may further include an identification information acquisition unit 2700 for obtaining identification information of the user and a storage unit 2800 for storing the changed UI according to the obtained identification information.

According to an embodiment of the present invention, the identification information acquisition unit 2700 may obtain identification information of the user. The obtained identification information may be stored in the storage unit with the changed UI, but is not necessarily limited thereto.

According to an embodiment of the present invention, the obtaining of the user identification information may be performed prior to obtaining the motion information of the user.

In addition, acquiring user identification information may be performed simultaneously with the motion information of the user. For example, as described above, a user profile including biometric information of the user may be obtained at the same time that fingerprint information, iris information, facial information, etc. of the user are obtained. In other words, the user identification information may be included in the user profile together with the user biometric information, and the user profile may be previously built in the form of a database.

For example, a preferred UI pattern for each user, or a changed UI according to an embodiment of the present invention is stored according to user identification information (eg, ID, etc.), and the user may then correspond to his identification information as needed. You can also load and use saved UI patterns.

In other words, since the physical and behavioral characteristics of the user may be different, a database of appropriate UI patterns or previously changed UI patterns according to the user identification information is stored in a database, and the identification information of the user when the user operates the medical device. By loading the UI pattern corresponding to the setting environment of the medical device, the shooting time can be shortened.

With regard to the apparatus according to an embodiment of the present invention, the above-described method may be applied. Therefore, with respect to the apparatus, the description of the same contents as those of the above-described method is omitted.

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed in a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium.

Such computer-readable recording media include, but are not limited to, magnetic storage media (e.g., ROMs, floppy disks, hard disks, etc.), optical reading media (e.g., CD-ROMs, DVDs, etc.) and carrier waves (e.g., the Internet). Storage medium).

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

Claims (30)

An ultrasound diagnostic apparatus for generating an ultrasound signal for generating an echo signal irradiated to an object and reflected from the object,
A control panel including a touch screen displaying a plurality of UIs; And
A processor for acquiring usage information of the plurality of UIs of a user who operates the ultrasound diagnosis apparatus;
Including,
The plurality of UI,
A trackball UI that does not change the shape, size, and position displayed on the touch screen; And
A plurality of variable UIs in which at least one of a shape, a size, and a position displayed on the touch screen is changed; Including,
The processor changes at least one of shapes, sizes, and positions of the plurality of variable UIs based on usage information of the plurality of UIs,
The plurality of variable UIs are UIs that provide only one predetermined function among a plurality of functions used when examining the object.
Each of the plurality of variable UIs includes a button UI for performing any one of functions of enlarging or reducing the displayed ultrasound image, a keyboard UI for receiving a user input for inputting at least one of letters and numbers, and the ultrasound image. And at least one of a switch UI for performing a function of switching to one of 2D ultrasound images and 3D ultrasound images.
delete delete delete delete delete The method of claim 1,
The ultrasound image of the acquired object is displayed on the touch screen, the ultrasound diagnostic device.
delete delete delete The method of claim 1,
At least one of the shape, size and position of the plurality of variable UI is changed based on the type of examination that the user examines the object.
delete delete delete delete delete delete In the ultrasound diagnostic device,
A probe for transmitting an ultrasound signal to an object and receiving an echo signal reflected from the object;
An ultrasonic transceiver unit configured to receive the echo signal and generate ultrasonic data;
An ultrasound image processor configured to scan-convert the ultrasound data to generate an ultrasound image;
A control panel including a touch screen displaying a UI for controlling the function of the ultrasound diagnosis apparatus to acquire the ultrasound image or to operate the ultrasound image; And
A processor configured to change at least one of a shape, a size, and a position of the UI based on the UI usage information of a user who uses the ultrasound diagnosis apparatus;
Including,
The control panel displays a trackball UI of which the shape, size, and position of the UI does not change in the first area on the touch screen,
Each of the UIs provides only one preset function among a plurality of functions used for the examination of the object, and the UI includes a button UI, a letter, and a number for performing any one function of enlarging or reducing the ultrasound image. Ultrasound comprising at least one of a keyboard UI for receiving a user input for inputting at least one of the, and a switch UI for converting the ultrasound image to any one of the 2D ultrasound image or 3D ultrasound image, Diagnostic device.
The method of claim 18,
A display device for displaying the ultrasound image; To further include, an ultrasound diagnostic device. delete A method of operating an ultrasound diagnostic apparatus for generating an ultrasound signal for generating an echo signal irradiated to an object and reflected from the object,
Acquiring usage information of a plurality of UIs for controlling a function of the ultrasound diagnosis apparatus by a user using the ultrasound diagnosis apparatus; And
Changing the plurality of UIs based on the obtained usage information; Including,
The plurality of UIs include a trackball UI in which the shape, size and position are not changed, and a plurality of variable UIs in which at least one of shape, size and position is changed by changing the UI.
The plurality of UIs are displayed on the control panel of the ultrasound diagnosis apparatus, and control the function of the ultrasound diagnosis apparatus based on an echo signal reflected from the object to obtain an ultrasound image, or based on the reflected echo signal. Is operated by the user to manipulate the ultrasound image of the obtained object,
Each of the plurality of variable UIs provides only one preset function among a plurality of functions used when examining the object,
The plurality of variable UIs may include a button UI for performing any one of functions of enlarging or reducing the obtained ultrasound image, a keyboard UI for receiving a user input for inputting at least one of letters and numbers, and the ultrasound image. And at least one of a switch UI for performing a function of switching to one of 2D ultrasound images and 3D ultrasound images.
delete delete The method of claim 21,
Storing the plurality of UIs changed based on the usage information of the user; It further comprises. The method of claim 21,
Displaying the obtained ultrasound image on a display device; It further comprises.
delete delete delete The method of claim 1,
A sensor unit which acquires motion information of a user who uses the ultrasound diagnostic apparatus through position information of the ultrasound probe included in the ultrasound diagnostic apparatus; More,
The control panel may display a right-hand UI pattern or a left-hand UI pattern that is mutually switched based on the motion information of the user.
delete

Images