WO2024090746A1

WO2024090746A1 - Ultrasound image processing method and device

Info

Publication number: WO2024090746A1
Application number: PCT/KR2023/011445
Authority: WO
Inventors: 김덕석; 최보경
Original assignee: 주식회사 엠티이지
Priority date: 2022-10-28
Filing date: 2023-08-03
Publication date: 2024-05-02
Also published as: KR20240065446A

Abstract

Disclosed are a method for processing ultrasound images, and a device and recording medium for the method, the method comprising the steps of: obtaining an ultrasound image including one or more objects of interest; obtaining, from the ultrasound image, an optimal image for the one or more objects of interest; obtaining an annotation used to access the optimal image; obtaining a timetable representing a monitoring situation for the one or more objects of interest; and providing the annotation and the timetable that operates in conjunction with the annotation.

Description

Ultrasound image processing method and device

The technical field of the present disclosure relates to ultrasonic image processing methods and devices for optimal images, and to the technical field of providing a method of providing useful information to users through image processing of ultrasonic images.

Recently, information has been delivered through video in various fields. Video media can record the scene as is and allow viewers to convey content more effectively through audio-visual effects. Due to the advantages of these video media, information delivery using video is being carried out in various fields. For example, YouTube, a leader in the video market, provides users with the information they want more effectively through a search engine for keywords.

However, specific methods for monitoring objects of interest in ultrasound images are still under development. In particular, in the case of ultrasound images, analysis is required not only on whether the object of interest exists but also on whether it is easy to observe. Therefore, there is a need for a method that allows users to easily utilize ultrasound images.

The problem to be solved in this disclosure concerns an ultrasonic image processing method and device, which can improve user convenience in terms of providing a method for easily utilizing ultrasonic images.

The problems to be solved by this disclosure are not limited to the technical problems described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, a user-optimized ultrasound image processing method according to the first aspect of the present disclosure includes: acquiring an ultrasound image including one or more objects of interest; Obtaining an optimal image for the one or more objects of interest from the ultrasound image; Obtaining an annotation used to access the optimal image; Obtaining a time table representing a monitoring situation for the one or more objects of interest; and providing the annotation and the time table that operates in conjunction with the annotation.

Additionally, the annotation may include information about the start and end points of the optimal image.

Additionally, the time table may include information about when the one or more objects of interest are recognized simultaneously.

Additionally, the step of providing the time table may highlight and display on the time table a point in time when a preset number or more objects of interest among the one or more objects of interest are simultaneously recognized.

Additionally, performing segmentation on the one or more objects of interest included in the ultrasound image; and displaying the one or more objects of interest on which the segmentation has been performed in different ways.

Additionally, the step of displaying the one or more objects of interest in different ways may display the one or more objects of interest in different colors.

Additionally, the step of acquiring the optimal image from the ultrasound image may be performed before the step of performing the segmentation.

Additionally, in the step of acquiring the optimal image from the ultrasound image, the optimal image may be obtained from the ultrasound image based on a positional relationship between the one or more objects of interest.

Additionally, the one or more objects of interest include an artery, a nervous system, and a rib, and the step of acquiring the optimal image from the ultrasound image produces an image in which the one or more objects of interest are arranged in the order of the nervous system, the artery, and the ribs. It can be determined based on the optimal image.

Additionally, the step of providing the time table may display editing graphics for editing the start and end points of the optimal image indicated by the annotation and removal graphics for removing the annotation in an area adjacent to the annotation.

An ultrasound image processing device according to a second aspect of the present disclosure, comprising: a receiver for acquiring an ultrasound image including one or more objects of interest; and obtaining an optimal image for the one or more objects of interest from the ultrasound image, obtaining an annotation used to access the optimal image, and obtaining a time table indicating a monitoring situation for the one or more objects of interest. It may include a processor that provides annotations and the time table that operates in conjunction with the annotations.

Additionally, the processor may further include a display that performs segmentation of the one or more objects of interest included in the ultrasound image and displays the one or more objects of interest on which the segmentation has been performed in different ways.

Additionally, the processor may obtain the optimal image from the ultrasound image before performing the segmentation.

In addition, the display may further include displaying editing graphics for editing the start and end points of the optimal image indicated by the annotation and removal graphics for removing the annotation in an area adjacent to the annotation.

Additionally, the third aspect of the present disclosure may provide a non-transitory computer-readable recording medium on which a program for implementing the method of the first aspect is recorded.

According to an embodiment of the present disclosure, by providing a method for easily utilizing ultrasound images, convenience can be improved in that useful images in ultrasound images can be easily accessed.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned may be clearly understood by those skilled in the art from the description below.

FIG. 1 is a diagram illustrating an example of a device or server implemented on a system according to an embodiment.

Figure 2 is a block diagram schematically showing the configuration of a device according to an embodiment.

Figure 3 is a flowchart showing each step in which a device operates according to an embodiment.

FIG. 4 is a diagram illustrating an example in which a device acquires an optimal image according to an embodiment.

FIG. 5 is a diagram illustrating an example in which a device acquires an annotation according to an embodiment.

FIG. 6 is a diagram illustrating an example in which a device acquires a time table according to an embodiment.

FIG. 7 is a diagram illustrating an example in which a device according to an embodiment provides optimal images, time tables, and annotations in conjunction with each other.

Advantages and features in the present disclosure, and methods for achieving them, will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure is complete and to those skilled in the art. It is provided to provide complete information.

The terms used herein are for describing embodiments and are not intended to limit the disclosure. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements. Like reference numerals refer to like elements throughout the specification, and “and/or” includes each and every combination of one or more of the referenced elements. Although “first”, “second”, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be the second component within the technical spirit of the present disclosure.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

Spatially relative terms such as “below”, “beneath”, “lower”, “above”, “upper”, etc. are used as a single term as shown in the drawing. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms that include different directions of components during use or operation in addition to the directions shown in the drawings. For example, if a component shown in a drawing is flipped over, a component described as "below" or "beneath" another component will be placed "above" the other component. You can. Accordingly, the illustrative term “down” may include both downward and upward directions. Components can also be oriented in other directions, so spatially relative terms can be interpreted according to orientation.

Hereinafter, embodiments will be described in detail with reference to the drawings.

FIG. 1 is a diagram illustrating an example in which a device 100 or a server according to an embodiment is implemented on a system.

As shown in Figure 1, the medical information system includes a device 100, an external server 130, a storage medium 140, a communication device 150, a virtual server 160, a user terminal 170, and a network. It can be included.

However, those skilled in the art can understand that other general-purpose components other than those shown in FIG. 1 may be included in the medical information system. For example, the medical information system may further include a blockchain server (not shown) that operates in conjunction with the network. Alternatively, according to another embodiment, those skilled in the art may understand that some of the components shown in FIG. 1 may be omitted.

The device 100 according to one embodiment may obtain information related to medical procedures such as surgery from various sources. For example, the device 100 may obtain information (e.g., video) related to medical procedures such as surgery from an information acquisition device (not shown). Information acquisition devices (not shown) may include, but are not limited to, imaging devices, recording devices, and biological signal acquisition devices. As another example, the device 100 may obtain information (eg, video) related to medical procedures such as surgery from the network.

Biological signals may include signals obtained from living organisms, such as body temperature signals, pulse signals, respiration signals, blood pressure signals, electromyography signals, and brain wave signals, without limitation. An imaging device, which is an example of an information acquisition device (not shown), includes a first imaging device (e.g., CCTV, etc.) that photographs the entire operating room situation and a second imaging device (e.g., endoscope, etc.) that focuses on photographing the surgical site. It can be done, but is not limited to this.

The device 100 according to one embodiment may acquire images (videos, still images, etc.) related to medical procedures such as surgery from an information acquisition device (not shown) or a network. Video can be understood as a concept that includes both moving images and still images. The device 100 may perform image processing on the acquired image. Image processing according to an embodiment may include naming, encoding, storage, transmission, editing, and metadata creation for each image, but is not limited thereto.

The device 100 according to one embodiment may transmit medical treatment-related information obtained from an information acquisition device (not shown) or a network as is or as updated information to the network. Transmission information transmitted by the device 100 to the network may be transmitted to

external devices

130, 140, 150, 160, and 170 through the network. For example, the device 100 may transmit the updated video to the external server 130, storage medium 140, communication device 150, virtual server 160, user terminal 170, etc. through the network. . Device 100 may receive various information (eg, feedback information, update request, etc.) from

external devices

130, 140, 150, 160, and 170. The communication device 150 may refer to a device used for communication without limitation (eg, a gateway), and the communication device 150 may communicate with a device that is not directly connected to the network, such as the user terminal 180.

The device 100 according to one embodiment may include an input unit, an output processor, memory, etc., and may also include a display device (not shown). For example, through the display device, the user can view communication status, memory usage status, power status (e.g., battery state of charge, external power supply, etc.), thumbnail images for stored videos, currently operating mode, etc. You can check, etc. Meanwhile, display devices include liquid crystal display, thin film transistor-liquid crystal display, organic light-emitting diode, flexible display, and 3D display. display), electrophoretic display, etc. Additionally, the display device may include two or more displays depending on the implementation type. Additionally, when the touchpad of the display has a layered structure and is configured as a touch screen, the display can be used as an input device in addition to an output device.

Additionally, networks may communicate with each other through wired or wireless communication. For example, a network may be implemented as a type of server and may include a Wi-Fi chip, Bluetooth chip, wireless communication chip, NFC chip, etc. Of course, the device 100 can communicate with various external devices using a Wi-Fi chip, Bluetooth chip, wireless communication chip, NFC chip, etc. Wi-Fi chips and Bluetooth chips can communicate using Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi chip or a Bluetooth chip, various connection information such as SSID and session key are first transmitted and received, and various information can be transmitted and received after establishing a communication connection using this. A wireless communication chip can perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution). The NFC chip can operate in the NFC (Near Field Communication) method using the 13.56MHz band among various RF-ID frequency bands such as 135kHz, 13.56MHz, 433MHz, 860~960MHz, 2.45GHz, etc.

The input unit according to one embodiment may refer to a means through which a user inputs data to control the device 100. For example, the input unit includes a key pad, dome switch, and touch pad (contact capacitive type, pressure resistance type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, There may be a piezo effect method, etc.), a jog wheel, a jog switch, etc., but it is not limited thereto.

The output unit according to one embodiment may output an audio signal, a video signal, or a vibration signal, and the output unit may include a display device, a sound output device, and a vibration motor.

The user terminal 170 according to an embodiment may include, but is not limited to, various wired and wireless communication devices such as a smartphone, SmartPad, and tablet PC.

The device 100 according to one embodiment may update medical treatment-related information (eg, video) obtained from an information acquisition device (not shown). For example, the device 100 may perform naming, encoding, storage, transmission, editing, metadata creation, etc. on images acquired from an information acquisition device (not shown). As an example, the device 100 may name an image file using metadata (eg, creation time) of the acquired image. As another example, the device 100 may classify images related to medical procedures obtained from an information acquisition device (not shown). The device 100 can use learned AI to classify images related to medical procedures based on various criteria such as type of surgery, operator, and location of surgery.

Additionally, the device 100 in FIG. 1 may be implemented as a server, and the scope of physical devices in which the device 100 can be implemented is not interpreted as being limited.

In addition, throughout the specification, 'provision' can be interpreted to include not only the transmission of information but also all actions that provide any object such as information or screens, such as the action of displaying a screen, and is limited to special implementation actions. It doesn't work.

A selection input may be obtained as an example of a user input on a screen provided by the device 100 according to an embodiment. Selection input according to one embodiment may be obtained through various methods, such as touch input, click input using a mouse, etc., and typing input using a keyboard.

FIG. 2 is a block diagram schematically showing the configuration of the device 100 according to an embodiment.

As shown in FIG. 2, the device 100 according to one embodiment may include a receiving unit 210, a processor 220, an output unit 230, and a memory 240. However, not all of the components shown in FIG. 2 are essential components of the device 100. The device 100 may be implemented with more components than those shown in FIG. 2 , or the device 100 may be implemented with fewer components than the components shown in FIG. 2 .

For example, the device 100 according to one embodiment may further include a communication unit (not shown) or an input unit (not shown) in addition to the receiver 210, processor 220, output unit 230, and memory 240. It may be possible. Additionally, an example of the output unit 230 may include a display (not shown).

The receiver 210 according to one embodiment may obtain a selection input for a portion of the screen where a plurality of objects are provided in the video. Selective input may be provided in various ways, such as touch input, click input using a mouse, etc., and typing input using a keyboard.

The receiver 210 according to one embodiment may acquire an ultrasound image including one or more objects of interest. The ultrasound image may be acquired from an ultrasound image acquisition device (not shown) used to acquire the ultrasound image. The receiver 210 according to one embodiment may receive an ultrasound image wired or wirelessly using an ultrasound image acquisition device. Alternatively, the receiver 210 may include an ultrasound image acquisition device.

The processor 220 according to one embodiment acquires an optimal image for one or more objects of interest from an ultrasound image. For example, the processor 220 may learn samples for the optimal image and obtain the optimal image from the ultrasound image based on the learning result. As another example, the processor 220 may obtain an optimal image from an ultrasound image based on the positional relationship between one or more objects of interest.

The processor 220 according to one embodiment acquires an annotation used to access the optimal image. An annotation according to an embodiment can provide a method of accessing an optimal image from an ultrasound image. For example, an annotation according to one example may provide a link to easily access a time section of 30 to 35 seconds, which is the time section corresponding to the optimal image in a 1-minute ultrasound image.

The processor 220 according to one embodiment obtains a time table representing a monitoring situation for one or more objects of interest. The time table contains information about when the object of interest is determined to be in the ultrasound image. Accordingly, the time table according to one embodiment may include information about when one or more objects of interest are recognized simultaneously.

The processor 220 according to one embodiment provides annotations and a time table that operates in conjunction with the annotations. According to one embodiment, the annotation, time table, and ultrasound image may operate in conjunction with each other.

FIG. 3 is a flowchart illustrating each step in which the device 100 operates according to an embodiment.

Referring to step S310, the device 100 according to one embodiment acquires an ultrasound image including one or more objects of interest. The ultrasound image may be acquired from an ultrasound image acquisition device (not shown) used to acquire the ultrasound image. The device 100 according to one embodiment may receive an ultrasound image wired or wirelessly from an ultrasound image acquisition device. Alternatively, the device 100 may include an ultrasound image acquisition device.

An ultrasound image according to one embodiment may be provided as a file containing an image that is updated over time. For example, the ultrasound image may include an ultrasound image acquired as the depth is updated for the same viewpoint. As another example, the ultrasound image may include an ultrasound image acquired as the aiming viewpoint is updated.

Referring to step S320, the device 100 according to one embodiment acquires an optimal image for one or more objects of interest from an ultrasound image.

The device 100 according to an embodiment can obtain an optimal image from an ultrasound image in various ways. For example, the device 100 may learn samples for the optimal image and obtain the optimal image from the ultrasound image based on the learning result. As another example, the device 100 may obtain an optimal image from an ultrasound image based on the positional relationship between one or more objects of interest.

A method for the device 100 according to an embodiment to obtain an optimal image from an ultrasound image based on the positional relationship between one or more objects of interest will be described. One or more objects of interest may include arteries, nervous system, ribs, etc. The device 100 may determine some of the ultrasound images among the plurality of ultrasound images as the optimal image based on the positional relationships of the nervous system, arteries, ribs, etc. For example, the device 100 may determine an ultrasound image arranged in the order of the nervous system, arteries, and ribs as the optimal image. Specifically, if the arteries, nervous system, and ribs are listed in that order according to the direction from one side of the ultrasound image to the other side, and the ribs are arranged to support the arteries and nervous system, it can be determined as the optimal image. A more specific example of the optimal image will be described later in Figure 4.

Referring to step S330, the device 100 according to one embodiment acquires an annotation used to access the optimal image.

An annotation according to an embodiment can provide a method of accessing an optimal image from an ultrasound image. For example, an annotation according to one example may provide a link to easily access a time section of 30 to 35 seconds, which is the time section corresponding to the optimal image in a 1-minute ultrasound image. In this case, as a selection input is applied to an annotation according to an example, the device 100 may display an ultrasound image in a time section corresponding to the optimal image.

Therefore, an annotation according to one embodiment may include information about the start and end points of the optimal image. As a selection input is applied to the annotation according to one example, the device 100 may display an ultrasound image corresponding to the start point of the optimal image.

More specific examples of annotations are described later in FIG. 5.

Referring to step S340, the device 100 according to one embodiment acquires a time table indicating a monitoring situation for one or more objects of interest.

The device 100 according to one embodiment may provide a time table containing information about when an object of interest is monitored. The time table contains information about when the object of interest is determined to be in the ultrasound image. Accordingly, the time table according to one embodiment may include information about when one or more objects of interest are recognized simultaneously.

When providing a time table, the device 100 according to one embodiment may highlight and display on the time table a point in time when a preset number of objects of interest or more among one or more objects of interest are recognized simultaneously.

A more specific example of the time table will be described later in FIG. 6.

Referring to step S350, the device 100 according to one embodiment provides an annotation and a time table that operates in conjunction with the annotation.

The device 100 according to one embodiment may provide annotations, time tables, and ultrasound images. Ultrasound images may include optimal images. According to one embodiment, the annotation, time table, and ultrasound image may operate in conjunction with each other. An example in which an annotation, a time table, and an ultrasound image are provided in conjunction with each other according to an embodiment will be described later with reference to FIG. 7 .

FIG. 4 is a diagram illustrating an example in which the device 100 acquires an optimal image according to an embodiment.

The device 100 according to an embodiment can obtain an optimal image in various ways.

The device 100 according to one embodiment may acquire an optimal image by performing learning. The device 100 may determine the optimal image among a plurality of ultrasound images by learning about a sample optimal image used as an example of the optimal image. Various learning algorithms can be used for learning. When performing learning, the location of the object of interest can be used as a main variable.

The device 100 according to one embodiment may acquire an optimal image by performing learning. The device 100 may obtain an optimal image from an ultrasound image based on the positional relationship between one or more objects of interest.

For example, the device 100 may determine an ultrasound image arranged in the order of the nervous system 410, the artery 420, and the ribs 430 as the optimal image. Specifically, according to the direction from one side (e.g., upper side) of the ultrasound image to the other side (e.g., lower side), the nervous system 410, the artery 420, and the ribs 430 are listed in the order, and the ribs are connected to the artery and the nervous system. If it is arranged in a way that supports the , it can be determined as the optimal image.

The device 100 according to one embodiment may perform segmentation on one or more objects of interest included in an ultrasound image. For example, the device 100 may distinguish the nervous system 410, arteries 420, and ribs 430 from each other by performing segmentation.

The device 100 according to one embodiment may display a plurality of objects of interest in different ways. The device 100 may display one or more objects of interest on which segmentation has been performed in different ways. As a result of segmentation, the plurality of objects of interest may be distinguished from each other, and the device 100 may display the plurality of distinct objects of interest in different ways. Referring to FIG. 4 , the device 100 may display the nervous system 410, arteries 420, and ribs 430 in different colors, but is not limited thereto. The device 100 may distinguish and display a plurality of objects of interest in a different manner not shown in FIG. 4 . For example, the device 100 may display the outlines of the nervous system 410, arteries 420, and ribs 430 by overlapping them on the ultrasound image. As another example, the device 100 may exclude the ultrasound image and display an image that provides only the object of interest.

The device 100 according to one embodiment may acquire an optimal image from an ultrasound image before performing segmentation. When the optimal image is first acquired before segmentation is performed, the device 100 can acquire the optimal image with higher accuracy. When segmentation is performed, errors may occur during the segmentation process, and if these errors accumulate, inaccuracy may increase in the process of acquiring the optimal image. Accordingly, the device 100 first acquires the optimal image before performing segmentation, and once the optimal image is acquired, higher accuracy can be secured by performing segmentation on the obtained optimal image. If segmentation is performed first, significant resource consumption occurs in the process of performing segmentation on all ultrasound images. However, if segmentation is performed only on the optimal images once acquired, resource consumption can be reduced.

FIG. 5 is a diagram illustrating an example in which the device 100 acquires an annotation according to an embodiment.

An annotation according to an embodiment can provide a method of accessing an optimal image from an ultrasound image. For example, referring to FIG. 5 , the first annotation 510 may provide a link to easily access a time section of 16 to 17 seconds, which is the time section corresponding to the optimal image in the ultrasound image.

The device 100 according to one embodiment may provide a plurality of annotations. For example, the device 100 may provide a first annotation 510, a second annotation 530, and a third annotation 530.

According to one example, when a selection input is applied to one annotation among a plurality of annotations, the device 100 may display an ultrasound image in a time section corresponding to the annotation to which the selection input was applied. For example, when a selection input is applied to the first annotation 510, the device 100 may display an ultrasound image corresponding to a time point of 16 seconds.

According to one embodiment, the ultrasound image in the time section corresponding to the annotation may be the optimal image. The device 100 may generate and provide an annotation for the time section containing the optimal image for the entire time section of the ultrasound image. For a specific method for the device 100 to obtain an optimal image from an ultrasound image, refer to the details described above with reference to FIG. 4 .

An annotation according to one embodiment may be created based on user input. For example, a new annotation may be created for a time period determined based on user input (for example, 34 to 35 seconds). For example, based on the text entered into the input area 541 and the save request obtained through the save button 542, the device 100 stores a time period determined based on the user input (e.g., 34 to 35 seconds). ) You can obtain a new annotation for.

According to one embodiment, the device 100 annotates the editing graphics 521 for editing the start and end points of the optimal image indicated by the annotation (e.g., the second annotation 520). )) can be displayed in the adjacent area. For example, when a user input is applied to the editing graphic 521, the device 100 provides a screen for editing the starting point and ending point of the second annotation 520, and the information obtained through the provided editing screen is displayed. The start and end points of the second annotation 520 may be updated based on user input.

The device 100 according to one embodiment may display a removal graphic 522 for removing an annotation (e.g., the second annotation 520) in an area adjacent to the annotation (e.g., the second annotation 520). there is. For example, when a user input is applied to the removal graphic 522, the device 100 may delete the second annotation 520.

FIG. 6 is a diagram illustrating an example in which the device 100 obtains a time table according to an embodiment.

The device 100 according to one embodiment may provide a time table 600 including information on when an object of interest is monitored. The time table 600 includes information about the point in time at which the object of interest is determined to be in the ultrasound image. For example, the first row 610 may indicate the point in time at which the first object of interest is determined to be in the ultrasound image, and the second row 620 may indicate the point in time at which the second object of interest is determined to be in the ultrasound image. and the third row 630 may indicate a point in time at which it is determined that the third object of interest is in the ultrasound image.

The time table 600 according to one embodiment may include information about when one or more objects of interest are recognized simultaneously. In providing the time table 600, the device 100 may highlight and display on the time table a point in time when a preset number or more of the objects of interest among one or more objects of interest are simultaneously recognized. For example, for the first time interval 641, the second time interval 642, and the third time interval 643 in which the first object of interest, the second object of interest, and the third object of interest are simultaneously monitored, the device 100 ) can be highlighted and displayed.

FIG. 7 is a diagram illustrating an example in which the device 100 according to an embodiment provides optimal images, time tables, and annotations in conjunction with each other.

Referring to FIG. 7, the device 100 displays an ultrasound image including an optimal image in a first area, displays one or more annotations in a second area 720, and displays a time table 600 in a third area 730. ) can be displayed. The positions of the first area 710, the second area 720, and the third area 730 may be provided in a manner different from that shown in FIG. 7.

According to one embodiment, information provided in the first area 710, the second area 720, and the third area 730 may be interconnected. For example, 34 to 35 seconds, which is the time interval for the new annotation displayed in the second area, may be displayed in the first area 710.

The device 100 according to one embodiment may provide an optimal image, a time table 600, and one or more annotations in conjunction with each other. For example, when a user applies a selection input for an annotation in the second area, the corresponding ultrasound image is displayed in the first area 710, and the corresponding play bar is displayed in the third area 730. It can be.

Various embodiments of the present disclosure are implemented as software including one or more instructions stored in a storage medium (e.g., memory) that can be read by a machine (e.g., a display device or computer). It can be. For example, the processor of the device (eg, processor 220) may call at least one instruction among one or more instructions stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in the present disclosure may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or via an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smartphones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

Although the present invention has been described with reference to the illustrative drawings, it is not limited to the disclosed embodiments and drawings, and those skilled in the art in the technical field related to the present embodiments may make modifications without departing from the essential characteristics of the above-mentioned description. You will be able to understand that it can be implemented in a certain form. Therefore, the disclosed methods should be considered from an explanatory rather than a restrictive perspective. Even if the operational effects according to the configuration of the present invention are not explicitly described and explained in the description of the embodiment, the effects that can be predicted by the configuration may also be recognized. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the equivalent scope should be construed as being included in the present invention.

Claims

In the ultrasonic image processing method,

Acquiring an ultrasound image including one or more objects of interest;

Obtaining an optimal image for the one or more objects of interest from the ultrasound image;

Obtaining an annotation used to access the optimal image;

Obtaining a time table representing a monitoring situation for the one or more objects of interest; and

A method comprising: providing the annotation and the time table that operates in conjunction with the annotation.
According to claim 1,

The annotation includes information about the start point and end point of the optimal image.
According to claim 1,

The time table includes information about when the one or more objects of interest are recognized simultaneously.
According to claim 1,

The step of providing the time table is

A method of highlighting and displaying on the time table a point in time when a preset number or more of the objects of interest among the one or more objects of interest are simultaneously recognized.
According to claim 1,

performing segmentation on the one or more objects of interest included in the ultrasound image; and

The method further comprising: displaying the one or more objects of interest on which the segmentation was performed in different ways.
According to claim 5,

The method of displaying the one or more objects of interest in different ways includes displaying the one or more objects of interest in different colors.
According to claim 5,

The method of obtaining the optimal image from the ultrasound image is performed before performing the segmentation.
According to claim 1,

The step of acquiring the optimal image from the ultrasound image is

A method of obtaining the optimal image from the ultrasound image based on the positional relationship between the one or more objects of interest.
According to claim 8,

The one or more objects of interest include arteries, nervous system, and ribs,

The step of acquiring the optimal image from the ultrasound image is

A method of determining as the optimal image an image in which the one or more objects of interest are arranged in the order of the nervous system, the artery, and the ribs.
According to claim 1,

The step of providing the time table is

A method of displaying editing graphics for editing the start and end points of the optimal image indicated by the annotation and removal graphics for removing the annotation in an area adjacent to the annotation.
In the ultrasonic image processing device,

A receiver that acquires an ultrasound image including one or more objects of interest; and

Obtaining an optimal image for the one or more objects of interest from the ultrasound image,

Obtain an annotation used to access the optimal image,

Obtaining a time table representing a monitoring situation for the one or more objects of interest,

A device comprising: a processor providing the annotation and the time table that operates in conjunction with the annotation.
According to claim 11,

The annotation includes information about the start and end points of the optimal image.
According to claim 11,

The time table includes information about when the one or more objects of interest are recognized simultaneously.
According to claim 11,

The processor is

Perform segmentation on the one or more objects of interest included in the ultrasound image,

A device further comprising a display that displays the one or more objects of interest on which the segmentation has been performed in different ways.
According to clause 14,

The processor is

A device that acquires the optimal image from the ultrasound image before performing the segmentation.
According to claim 11,

The processor is

A device that acquires the optimal image from the ultrasound image based on the positional relationship between the one or more objects of interest.
According to claim 11,

A display that displays editing graphics for editing the start and end points of the optimal image indicated by the annotation and removal graphics for removing the annotation in an area adjacent to the annotation.
A non-transitory computer-readable recording medium on which a program for implementing the method of any one of claims 1 to 10 is recorded.