CN113855072B - Ultrasonic equipment and working method thereof - Google Patents

Ultrasonic equipment and working method thereof Download PDF

Info

Publication number
CN113855072B
CN113855072B CN202111145530.1A CN202111145530A CN113855072B CN 113855072 B CN113855072 B CN 113855072B CN 202111145530 A CN202111145530 A CN 202111145530A CN 113855072 B CN113855072 B CN 113855072B
Authority
CN
China
Prior art keywords
probe
inspection parameters
parameters corresponding
target body
body organ
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111145530.1A
Other languages
Chinese (zh)
Other versions
CN113855072A (en
Inventor
陈哲
王文凯
郭颂
时俊楠
王�琦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Medical Equipment Co Ltd
Original Assignee
Qingdao Hisense Medical Equipment Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Medical Equipment Co Ltd filed Critical Qingdao Hisense Medical Equipment Co Ltd
Priority to CN202111145530.1A priority Critical patent/CN113855072B/en
Publication of CN113855072A publication Critical patent/CN113855072A/en
Application granted granted Critical
Publication of CN113855072B publication Critical patent/CN113855072B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4444—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to the probe
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image

Abstract

The invention relates to an ultrasonic device and an ultrasonic device working method, which relate to the technical field of ultrasonic artificial intelligence, and comprise the following steps: acquiring an image containing a probe, which is shot by a camera, and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe types; acquiring a probe-type scanned image and identifying a target body organ within the probe-type scanned image that an operator wants to detect; adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ; or if the body position of the target body organ is identified to be in the abdomen or the target body organ is the organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the abdomen. The invention can automatically detect the type of the probe and the target body organ which the operator wants to detect, thereby automatically adjusting the parameters and reducing the workload of the operator.

Description

Ultrasonic equipment and working method thereof
Technical Field
The invention relates to the technical field of ultrasonic artificial intelligence, in particular to ultrasonic equipment and an ultrasonic equipment working method.
Background
A large number of whole body examination items are frequently faced every day in an ultrasonic department, such as examining neck blood vessels, mammary glands, thyroid glands, lymph nodes and the like of the neck by using a linear array probe, examining the heart of the chest by using a phased array probe, examining the liver, gall, pancreas, spleen and kidney of the abdomen by using a convex array probe, and examining lower limb blood vessels at the legs, blood vessels at the joints of the feet and the like of a patient by using a linear array probe.
In order to clearly and accurately reflect the real imaging effects of different examination positions and organs of a patient, an operator needs to switch back and forth not only the probes, but also examination modes, such as an abdomen mode, a kidney mode, a urinary system mode and the like, under each probe. Such a large number of inspections every day necessitates a complicated probe switching and site selection operation, which increases the operator's workload.
Disclosure of Invention
The invention provides ultrasonic equipment and an ultrasonic equipment working method, which can automatically detect the type of a probe and a target body organ which an operator wants to detect, so that parameters are automatically adjusted, and the workload of the operator is reduced.
In a first aspect, an embodiment of the present invention provides an ultrasound apparatus, including: the device comprises a camera, a probe interface, a display and a processor;
The camera is used for shooting images of the probe displayed by an operator;
the probe interface is used for accessing various types of probes;
the processor is used for acquiring the image containing the probe and shot by the camera and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe types; acquiring a probe-type scanned image and identifying a target body organ within the probe-type scanned image that an operator wants to detect;
adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the target body organ; or if the body position of the target body organ is in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the abdomen;
the display is used for displaying an image formed by scanning the target body organ through the probe type of the inspection parameter corresponding to the target body organ.
According to the ultrasonic equipment, the probe type of the image can be identified through the image containing the probe and shot by the camera of the ultrasonic equipment, the operation parameters corresponding to the identified probe type are used as the operation parameters of the ultrasonic equipment, then the image scanned by the probe type is acquired, the target body organ which an operator wants to detect in the image is identified, the inspection parameters of the probe type are adjusted to the inspection parameters corresponding to the target body organ, or when the body position of the target body organ is identified to be in the abdomen or the body organ is identified to be the organ in the urinary system, the inspection parameters of the probe type are adjusted to the inspection parameters corresponding to the abdomen.
In one possible implementation, the identified target body organ is determined to be a body organ that the probe type is capable of examining.
According to the ultrasonic equipment, each probe type is provided with the body organ which can be checked, and the judgment shows that the probe type is the body organ which can be checked, so that the accuracy of adjustment of the checking parameters is increased.
In one possible implementation manner, after acquiring the image including the probe captured by the camera, the method further includes:
Identifying a probe type and a model of the probe type in an image containing the probe;
and adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe type and the model of the probe type.
The ultrasonic equipment can identify different probe types and the types of the probe types because different types of different probe types are different in function or used operation parameters, so that the operation parameters of the ultrasonic equipment are adjusted to the identified probe types and the operation parameters corresponding to the types of the probe types, the purpose of automatically adjusting the parameters is achieved, the workload of operators is reduced, and the accuracy of parameter adjustment is improved.
In one possible implementation, the processor is further configured to: after identifying the probe type in the image containing the probe, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained in the image scanned by the probe, highlighting the target body organ identified in the operation interface;
after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe types, filling the operation parameters corresponding to the identified probe types into an operation interface;
After adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ, displaying the inspection parameters corresponding to the target body organ in an operation interface; or after the inspection parameters of the probe type are adjusted to the inspection parameters corresponding to the abdomen, displaying the inspection parameters corresponding to the abdomen in an operation interface.
The ultrasonic equipment can display the identified probe type, the identified target body organ, the adjusted operation parameters and the adjusted inspection parameters, so that an operator can know the current working condition.
In one possible implementation, the processor is specifically configured to:
extracting the characteristics of the image scanned by the probe type by adopting a first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features with a plurality of sampling rates, and fusing the weighted features with a plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features weighted twice;
And extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
According to the ultrasonic equipment, the characteristics of different sampling rates can be convolved, weighted and mixed in the characteristic extraction process, so that the characteristics of the determined target body organ have more information, and the accuracy of the determined target body organ is improved.
In one possible implementation, the processor is specifically configured to:
the first convolution layer and the second convolution layer have the same structure, and the processing procedures comprise:
carrying out convolution processing on the input of the convolution layer to obtain a convolved feature, carrying out convolution pooling processing on the convolved feature to obtain a pooled feature, and carrying out jump connection processing on the pooled feature to obtain the output of the convolution layer;
the first attention mechanism and the second attention mechanism have the same structure, and the processing procedures comprise:
channel attention processing is carried out on the input of the attention mechanism to obtain characteristics after channel processing, spatial attention processing is carried out on the input of the attention mechanism to obtain characteristics after spatial processing, convolution processing is carried out on the input of the attention mechanism to obtain gating characteristics;
Fusing the characteristics after channel processing with the characteristics after space processing to obtain fused characteristics; and carrying out weighted summation on the fused characteristic and the gating characteristic to obtain the output of the attention mechanism.
According to the method, after the convolution layer carries out feature extraction by utilizing convolution, the feature is subjected to convolution downsampling processing, and the downsampled feature is subjected to jump connection processing, so that the depth of feature extraction is increased, training times are reduced, a channel and spatial attention are provided for an attention mechanism, and meanwhile, the input feature is subjected to convolution to obtain a gating feature, and weighted summation is carried out according to the gating feature and the fused feature, so that the accuracy of organ identification is improved.
In a second aspect, an operating method of an ultrasonic device provided by an embodiment of the present invention includes:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a convex array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the convex array probe;
after the convex array probe starts to work, acquiring an image scanned by the convex array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the convex array probe;
If the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the convex array probe of the inspection parameters corresponding to the abdomen; or (b)
If the target body organ is identified as liver, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the liver so that an operator can scan the liver by using the convex array probe of the inspection parameters corresponding to the liver; or if the target body organ is identified as the gall bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the gall bladder so that an operator can scan the gall bladder through the convex array probe using the inspection parameters corresponding to the gall bladder; or if the target body organ is identified as pancreas, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the pancreas so that an operator can scan the pancreas by using the convex array probe of the inspection parameters corresponding to the pancreas; or if the target body organ is identified as the spleen, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the spleen so that an operator can scan the spleen by using the convex array probe of the inspection parameters corresponding to the spleen; or if the target body organ is identified as the kidney, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the kidney so that an operator can scan the kidney by using the convex array probe of the inspection parameters corresponding to the kidney; or if the target body organ is identified as the bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the bladder so that an operator can scan the bladder by using the convex array probe of the inspection parameters corresponding to the bladder; or if the target body organ is identified as the prostate, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the prostate, so that an operator can scan the prostate by using the convex array probe of the inspection parameters corresponding to the prostate.
In a third aspect, an embodiment of the present invention provides a method for operating an ultrasonic device, including:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a linear array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the linear array probe;
after the linear array probe starts to work, acquiring an image scanned by the linear array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the linear array probe;
if the target body organ is recognized as thyroid, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the thyroid, so that an operator can scan the thyroid by using the linear array probe of the inspection parameters corresponding to the thyroid; or if the target body organ is identified as a blood vessel, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the blood vessel so that an operator can scan the blood vessel by using the linear array probe of the inspection parameters corresponding to the blood vessel; or if the target body organ is identified as the mammary gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the mammary gland so that an operator can scan the mammary gland by using the linear array probe of the inspection parameters corresponding to the mammary gland; or if the target body organ is identified as the lymph node, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the lymph node so that an operator can scan the lymph node by using the linear array probe of the inspection parameters corresponding to the lymph node.
In a fourth aspect, an operation method of an ultrasonic device provided by an embodiment of the present invention includes:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a phased array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the phased array probe;
after the phased array probe starts to work, acquiring an image scanned by the phased array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the phased array probe;
and if the target body organ is identified as the heart, adjusting the inspection parameters of the phased array probe to the inspection parameters corresponding to the heart, so that an operator can scan the heart by using the phased array probe of the inspection parameters corresponding to the heart.
In a fifth aspect, an embodiment of the present invention provides a working method of an ultrasonic apparatus, including:
acquiring an image containing the probe through a camera on the ultrasonic equipment, and identifying an intracavity probe in the image containing the probe;
if the identified probe type is an intracavity probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the intracavity probe;
After the intracavity probe begins to work, acquiring an image scanned by the intracavity probe, and identifying a target body organ which an operator wants to detect in the image scanned by the intracavity probe;
if the target body organ is identified as uterus, adjusting the inspection parameters of the intracavity probe to the inspection parameters corresponding to the uterus, so that an operator can scan the uterus by using the intracavity probe of the inspection parameters corresponding to the uterus; or if the target body organ is identified as the ovary, adjusting the inspection parameters of the intracavity probe to the inspection parameters corresponding to the ovary so that an operator can scan the ovary through the intracavity probe using the inspection parameters corresponding to the ovary.
In a sixth aspect, the present application also provides a computer storage medium having stored thereon a computer program which, when executed by a processing unit, implements the steps of the method for operating an ultrasound device according to any one of the second to fifth aspects.
In addition, the technical effects caused by any implementation manner of the second aspect to the sixth aspect may refer to the technical effects caused by different implementation manners of the first aspect, which are not described herein.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention and do not constitute a undue limitation on the invention.
FIG. 1 is a schematic diagram of an ultrasound device provided by an embodiment of the present invention;
FIG. 2 is a schematic diagram of probe type identification provided by an embodiment of the present invention;
FIG. 3 is a schematic illustration of identifying a target body organ provided by an embodiment of the present invention;
FIG. 4 is a schematic diagram of an operation interface according to an embodiment of the present invention;
FIG. 5 is a flow chart of a method of operating an ultrasound device provided by an embodiment of the present invention;
FIG. 6 is a flow chart of another method of operation of an ultrasound device provided by an embodiment of the present invention;
FIG. 7 is a workflow diagram of a network for identifying a target body organ provided by an embodiment of the present invention;
FIG. 8 is a block diagram of a convolutional layer provided by an embodiment of the present invention;
FIG. 9 is a block diagram of an attention mechanism provided by an embodiment of the present invention;
FIG. 10 is a flow chart of a method of operation of an ultrasonic device based on a convex array probe provided by an embodiment of the invention;
FIG. 11 is a flow chart of an ultrasonic device working method based on a linear array probe provided by an embodiment of the invention;
FIG. 12 is a flow chart of a method of operating a phased array probe-based ultrasound device in accordance with an embodiment of the present invention;
fig. 13 is a flowchart of an operation method of an ultrasonic device based on an intracavity probe according to an embodiment of the present invention.
Detailed Description
In order to enable a person skilled in the art to better understand the technical solutions of the present invention, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the embodiments described in the following exemplary examples do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
The application scenario described in the embodiment of the present invention is for more clearly describing the technical solution of the embodiment of the present invention, and does not constitute a limitation on the technical solution provided by the embodiment of the present invention, and as a person of ordinary skill in the art can know that the technical solution provided by the embodiment of the present invention is applicable to similar technical problems as the new application scenario appears.
At present, the ultrasonic equipment is very wide in applicable examination items, such as neck, abdomen, blood vessels and the like, the types and parameters of probes applicable to each part are different, and certain parameters cannot be set uniformly. The operator holds the probe right hand to check, and meanwhile, the left hand also needs to continuously click the button and the adjusting knob, and most of the steps are repeated and redundant operation, so that a great deal of operation time is consumed.
Based on this, the present application provides an ultrasound apparatus.
A hardware configuration block diagram of an ultrasound apparatus 100 according to an exemplary embodiment is illustrated in fig. 1. As shown in fig. 1, the ultrasonic apparatus 100 includes: memory, display, multiple probe interfaces 130, processor, camera 150, power interface, console 170, housing 180, pulley 190, and the like.
The specific functions of the above components are described below:
(1) A memory:
the memory may be used to store software programs and data. The processor performs various functions of the ultrasound device 100 and data processing by running software programs or data stored in the memory. The memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. The memory stores an operating system that enables the ultrasound device 100 to operate. The memory in the application can store an operating system and various application programs, and can also store codes for executing the method in the embodiment of the application.
(2) Probe interface:
a plurality of probe interfaces for accessing a plurality of types of probes; the ultrasonic equipment provided by the application can be connected with various types of probes, so that an operator can use the probes to perform inspection work.
(3) Probe interface:
the camera 150 is used for shooting an image of the probe displayed by the operator and sending the image shot by the camera 150 to the processor.
Specifically, the operator displays the type of probe used by the operator to the imaging range of the camera 150, and after the operator activates the camera 150, the camera 150 captures an image and transmits the image to the processor.
(4) A processor:
the processor is a control center of the ultrasonic apparatus 100, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the ultrasonic apparatus 100 and processes data by running or executing software programs stored in a memory, and calling data stored in the memory. In some embodiments, a processor may include one or more processing units; the processor may also integrate an application processor that primarily handles operating systems, operator interfaces, applications, etc., and a baseband processor that primarily handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor. The processor can run an operating system, an application program, an operator interface display and a touch response, and the processing method disclosed by the embodiment of the application. In addition, the processor is coupled to a display 120.
A processor in the present invention for acquiring an image containing a probe photographed by the camera 150 and identifying a probe type in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe types; acquiring a probe-type scanned image and identifying a target body organ within the probe-type scanned image that an operator wants to detect; the operation parameters of the ultrasonic equipment are parameters which can enable the probe type to normally operate on the ultrasonic equipment, namely, the ultrasonic equipment is inserted with probes of what type, so that the parameters of the probes of the type can be used normally.
Adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the target body organ; or if the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the abdomen;
Parameters, i.e. parameters required for examination of a specific body part, such as frequency, scan range, dynamic range, speckle suppression, noise suppression, spurious color, line density, frame correlation, number of foci, etc.
The probe type comprises a convex array probe, a linear array probe, a phased array probe and an intracavity probe;
if the identified probe type is a convex probe, the target body organ is one of the following organs: liver, gall bladder, pancreas, spleen, kidney, bladder, and prostate;
if the identified probe type is a linear probe, the target body organ is one of the following organs: thyroid, vascular, breast, lymph nodes;
if the identified probe type is a phased array probe, the target body organ is a heart;
if the identified probe type is an intracavity probe, the target body organ is one of the following: uterus, ovary.
The processor and memory are both enclosed by a housing 180.
(5) A display:
the display 120 is used to display an operator interface (graphical user interface, GUI), images of probe type scans, images captured by the camera 150, and so forth. In particular, the display 120 may include a display screen disposed on the front of the ultrasound device 100. The display screen may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display 120 may be used to display various graphical operator interfaces described in the present application.
The display comprises a first display screen 121 and a second display screen 122; the first display screen 121 is used for displaying an operator interface (graphical user interface, GUI), an image of probe type scanning, an image acquired by the camera 150, and the like; the second display 122 is used for displaying data controlled by the console 170, for example, displaying detection parameters, so that an operator adjusts the console through the console 170.
The first display screen 121 is configured to display a recognition result of an image captured by the camera, that is, display a recognized probe type, and, as shown in fig. 2, for example, the recognized probe type is Fype 1.91, and a picture and the recognized type are displayed in the first display screen 121.
The first display screen 121 is further configured to display an image scanned by the probe type, and in conjunction with fig. 3, the current probe type is a convex probe, the detected target body organ is a kidney, and the displayed image is an image of the kidney scanned by the convex probe.
For a processor, the processor is further configured to: after identifying the probe type in the image containing the probe, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained in the image scanned by the probe, highlighting the target body organ identified in the operation interface;
After the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe types, the operation parameters corresponding to the identified probe types are displayed in an operation interface;
and after adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ, displaying the inspection parameters corresponding to the target body organ in an operation interface.
The probe type, target body organ, automatically identified by the ultrasound device, are displayed in a second display screen 122, displaying the adjusted operating parameters and the examination parameters. As shown in fig. 4, an operation interface is displayed in the second display screen 122, the operation interface contains patient information, various types of probes, a convex probe, a linear probe, a phased array probe, an intracavity probe, various preset examination positions, an abdomen, a kidney, a heart, a uterus and the like, after the type of the probe in the image containing the probe is identified as the convex probe, the convex probe identified in the operation interface is highlighted, after the target body organ contained in the image scanned by the probe is identified as the abdomen, the abdomen identified in the operation interface is highlighted, and after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified type of the probe, the operation parameters corresponding to the identified type of the probe are filled in the operation interface; and after the inspection parameters of the probe type are adjusted to the inspection parameters corresponding to the target body organ, specific values such as frequency, scanning range, dynamic range, speckle suppression, noise suppression, false color, linear density, frame correlation, focus number and the like are filled in an operation interface.
(6) An operation table:
an operation table 170 for adjusting the inspection parameters. Specifically, the operator may adjust the inspection parameters via buttons on the console 170. The processor is also used for responding to an adjustment instruction triggered by an operator after filling the inspection parameters corresponding to the target body organ in the operation interface, and determining the adjusted target inspection parameters according to the adjustment values of the adjusted target inspection parameters in the adjustment instruction; and adjusting the current target inspection parameters of the probe type to the adjusted target inspection parameters.
The power interface is used for supplying power for each component after being communicated with an external power supply. After the external power supply passes through the power interface, the external power supply can be logically connected with the processor through the power management system, so that the functions of managing charging, discharging, power consumption and the like are realized through the power management system. The ultrasound device 100 may also be configured with power buttons for powering on and off, and locking the screen, etc. functions of the ultrasound device.
The technical scheme of the invention is specifically described below with reference to the accompanying drawings.
Referring to fig. 5, an embodiment of the present invention provides a working method of an ultrasonic apparatus, which is applied to the above-described ultrasonic apparatus, including:
s500: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
S501: adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe types;
s502: acquiring a probe-type scanned image and identifying a target body organ within the probe-type scanned image that an operator wants to detect;
s503: adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the target body organ; or if the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the abdomen so that the operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the abdomen.
Wherein the step of adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ can be understood as: if the body position of the target body organ is not in the abdomen and the target body organ is not an organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ; if the body position of the target body organ is identified to be in the abdomen or the target body organ is the organ in the urinary system, the inspection parameters of the probe type are adjusted to the inspection parameters corresponding to the target body organ.
For the scheme provided by the invention, the probe type can be automatically identified, so that an operator does not need to select the probe type of the operator, the target body organ which the operator wants to detect is automatically identified, the corresponding inspection parameters are selected according to the target body organ, the inspection parameters are adjusted, the operator does not need to operate the probe and adjust the parameters, and meanwhile, the operation amount of the operator is reduced, and the operation flow of the operator is simplified.
Since each probe type has its own body organ that can be examined, for example, a convex probe can examine the body organ as: liver, gall bladder, pancreas, spleen, kidney, bladder, and prostate;
body organ that linear array probe can examine: thyroid, vascular, breast, lymph nodes;
the body organ that the phased array probe can examine is the heart;
body organ that intracavity probe can examine: uterus, ovary.
Therefore, before adjusting the inspection parameters, the identified target body organ is determined to be the body organ which can be inspected by the probe type, so that the accuracy of the inspection parameter adjustment can be improved.
For the body organ identified as not being of a probe type that can be inspected, the operator is prompted that the identified target body organ is not of a probe type that can be inspected.
Because the working of different types of probes and the working parameters of the running probes are different, in order to improve the setting accuracy of the running parameters, the invention proposes to identify the type of the probe and the type of the probe in the image containing the probe; and adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe type and the model of the probe type.
Whether the probe type is identified independently or the type of the probe type and the type of the probe type are identified, the invention can use a Yolo5s series target detection network, and a multi-scale special fusion method such as FPN, PAN and the like is added into the Yolo5s series target detection network; the network structure is optimized, the number of network layers is properly reduced, and the recognition speed is further improved, so that the effects of accurate recognition and real-time detection are realized.
In a network in which only the probe type is identified, an image including the probe type is used as a sample image, and the probe type is used as an output, so that the network is trained.
When the probe type and the model of the probe type are identified, the network is trained by taking the image containing the probe type as a sample image and taking the probe type and the model of the probe type as output. Thus, the probes of the same type are also identified due to the different shapes of different models.
Of course, when only one type of probe type is applicable, for example, an a type of convex array probe, the invention stores the corresponding relation among the operation parameters, the probe type and the signals of the probe type, and when the a type of convex array probe is identified, the corresponding operation parameters are found by inquiring the corresponding relation among the operation parameters, the probe type and the signals of the probe type according to only one type of convex array probe recorded in the ultrasonic equipment.
For the sample image, the data can be expanded by means of rotation, scaling, enhancement, a mosaics method, a Cutout method and the like to obtain an enhanced data set so as to increase model generalization.
In order to enable an operator to know the working condition of the ultrasonic equipment, the embodiment of the invention further provides another working method of the ultrasonic equipment, which is shown in fig. 6, and includes:
s600: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s601: highlighting the probe type identified in the operation interface;
s602: adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe types;
S603: filling operation parameters corresponding to the identified probe type in an operation interface;
s604: acquiring a probe-type scanned image and identifying a target body organ within the probe-type scanned image that an operator wants to detect;
s605: highlighting the target body organ identified in the operator interface;
s606: adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the target body organ;
s607: and displaying the corresponding examination parameters of the target body organ in the operation interface.
For S606 and S607, the following steps may be substituted: if the target body organ is identified as the body organ and the body organ is located in the abdomen or the body organ is the organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the abdomen; displaying inspection parameters corresponding to the abdomen in an operation interface;
for the inspection parameters, an operator can also adjust the inspection parameters according to own experience, namely after the inspection parameters corresponding to the target body organs are filled in an operation interface, an adjustment instruction triggered by the operator is responded, and the adjusted target inspection parameters are determined according to the adjustment values of the adjusted target inspection parameters in the adjustment instruction; and adjusting the current target inspection parameters of the probe type to the adjusted target inspection parameters.
Specific procedures for identifying a target body organ within the probe-type scanned image that the operator wants to detect include:
extracting the characteristics of the scanned image of the probe type by adopting a first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features with a plurality of sampling rates, and fusing the weighted features with a plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features weighted twice;
and extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
Specifically, the first convolution layer and the second convolution layer are both built on the basis of the reslock, the weighted features are sampled by adopting a plurality of sampling rates, the weighted features with a plurality of sampling rates are obtained, the weighted features with a plurality of sampling rates are fused, and the fusion features are built on the basis of the ASPP Block.
Referring to fig. 7, a multi-organ ultrasound image database is used as a sample set, an image is selected from the multi-organ ultrasound image database and is input into a first block, namely a first convolution layer, and features are extracted; and then adopting a first Attention mechanism (Attention), then adopting an ASPP Block network to sample the weighted features at a plurality of sampling rates to obtain the weighted features at a plurality of sampling rates, fusing the weighted features at a plurality of sampling rates to obtain fused features, adopting a second Attention mechanism to weight the fused features, inputting the weighted fused features into a second Block, namely a second convolution layer, and predicting according to the features after extraction is finished to determine target body organs which an operator wants to detect.
For images in the multi-organ ultrasonic image database, data enhancement can be performed by data expansion modes such as transfer learning, mixUp, elastic Deformation and the like so as to increase the number of images in the database. The multi-organ ultrasonic image database comprises mass data sets of ultrasonic clinical most commonly used measuring organs under different types of probes and different scanning sections, such as liver, gall, pancreas, spleen, kidney of an abdomen system, bladder, prostate and other relevant parts of a urinary system, which are scanned by adopting a convex array probe, thyroid and carotid arteries of a lower superficial and small organ system which are scanned by adopting a linear array probe, and heart which is scanned by adopting a phased array probe.
The first convolution layer and the second convolution layer have the same structure, and the processing procedures comprise:
and carrying out convolution processing on the input of the convolution layer to obtain a feature after convolution, carrying out convolution pooling processing on the feature after convolution to obtain a pooled feature, and carrying out jump connection processing on the pooled feature to obtain the output of the convolution layer.
When the first convolution layer is adopted to extract the characteristics of the image scanned by the probe type, the input of the convolution layer is the image scanned by the probe type; the output of the convolution layer is the extracted feature.
When the fusion characteristics after the secondary weighting are extracted by adopting the second convolution layer, the input of the convolution layer is the fusion characteristics after the secondary weighting; the output of the convolution layer is the extracted twice weighted fusion feature.
The structure of the two convolution layers includes at least one structure as in fig. 8. As shown in fig. 8, the structure includes convolutions Conv, normalized BN, an activation function ReLu, convolutionally pooled convpool, jump-connected Conv and BN, and Conv, BN, reLu, and the specific working process is that convolutions and normalization processing are performed on features after convolutions pooling, convolutions, normalization processing, and activation function processing are performed on features after convolutions pooling, and ADD is fused with the two processing processes to obtain a feature after structure.
In the above process, convolution pooling is used to replace the maximum pooling operation, and since the maximum pooling operation is to find the maximum feature in the feature map of each channel, training is not needed here, and the maximum feature cannot be found better through learning. And the operation of convolution pooling can be used for modifying parameters in the convolution pooling through training to find more features, so that the loss rate of information is reduced.
Wherein, the first attention mechanism and the second attention mechanism have the same structure, and the processing procedure comprises:
channel attention processing is carried out on the input of the attention mechanism to obtain characteristics after channel processing, spatial attention processing is carried out on the input of the attention mechanism to obtain characteristics after spatial processing, convolution processing is carried out on the input of the attention mechanism to obtain gating characteristics;
fusing the characteristics after channel processing with the characteristics after space processing to obtain fused characteristics; and carrying out weighted summation on the fused characteristic and the gating characteristic to obtain the output of the attention mechanism.
The structure of the attention mechanism is shown in fig. 9, and the channel attention model includes global average pooling (global avg pool), global max pooling (global max pool), multi-layer perceptron (MLP), sigmoid function & relu (activation function). The global average pooling (global avg pool) and the global maximum pooling (global max pool) are input into the multi-layer perceptron, the features after the multi-layer perceptron are added, and then the features of the channel attention model are obtained by multiplying the output of the sigmoid function & relu with the input of the attention mechanism.
The spatial attention model comprises global average pooling (global avg pool), global maximum pooling (global max pool), conv (convolution processing) & BN (normalization function), sigmoid function. And adding the global average pooling (global avg pool) and the global maximum pooling (global max pool), and multiplying the output of the sigmoid function with the input of the attention mechanism through conv (convolution processing) and BN (normalization function) to obtain the features of the spatial attention model.
Adding the characteristics of the channel attention model and the characteristics of the space attention model to obtain fused characteristics;
conv (convolution processing) of 1*1 is performed on the input of the attention mechanism, resulting in a gating feature. And carrying out weighted summation on the gating characteristics and the fused characteristics to obtain the output of the attention mechanism.
Because the input of the attention mechanism is multiplied by the characteristics processed by the sigmoid function in each channel attention model, the input of the attention mechanism is multiplied by the characteristics processed by the sigmoid function and the relu are increased, so that the effective channel weight of the characteristics is enhanced, the effective expression on the spatial resolution is increased, and meanwhile, the gating characteristics and the fused characteristics are multiplied to obtain the final output, so that the accuracy of organ identification can be improved.
The process is based on the deep neural network and the data driving, the deep neural network based on jump connection, the cavity convolution space pyramid and the attention mechanism is designed, and the convolution downsampling is used for replacing pooling downsampling, so that the spatial information relationship and semantic relationship among long-distance pixels in an image and the high-dimensional characteristics of target significance are utilized efficiently, the recognition accuracy of recognizing each organ is improved, and the robustness and the rapid recognition of the model are realized.
As described in connection with fig. 10, a specific flow of operation of the ultrasonic device of the convex array probe provided in the embodiment of the present invention includes:
s1000: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s1001: if the identified probe type is a convex array probe, adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the convex array probe;
s1002: after the convex array probe starts to work, acquiring an image scanned by the convex array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the convex array probe;
s1003: if the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the convex array probe of the inspection parameters corresponding to the abdomen;
S1004: if the target body organ is identified as liver, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the liver so that an operator can scan the liver by using the convex array probe of the inspection parameters corresponding to the liver;
s1005: if the target body organ is identified as the gall bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the gall bladder, so that an operator can scan the gall bladder by using the convex array probe of the inspection parameters corresponding to the gall bladder;
s1006: if the target body organ is identified as pancreas, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the pancreas, so that an operator can scan the pancreas by using the convex array probe of the inspection parameters corresponding to the pancreas;
s1007: if the target body organ is identified as the spleen, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the spleen, so that an operator can scan the spleen by using the convex array probe of the inspection parameters corresponding to the spleen;
s1008: if the target body organ is identified as the kidney, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the kidney so that an operator can scan the kidney by using the convex array probe of the inspection parameters corresponding to the kidney;
s1009: if the target body organ is identified as the bladder, adjusting the checking parameters of the convex array probe to the checking parameters corresponding to the bladder, so that an operator can scan the bladder by using the convex array probe of the checking parameters corresponding to the bladder;
S1010: if the target body organ is identified as a prostate, the inspection parameters of the convex array probe are adjusted to the inspection parameters corresponding to the prostate, so that an operator can scan the prostate by using the convex array probe of the inspection parameters corresponding to the prostate.
As described in connection with fig. 11, a specific flow of operation of the ultrasonic device of the linear array probe provided in the embodiment of the present invention includes:
s1100: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s1101: if the identified probe type is a linear array probe, adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the linear array probe;
s1102: after the linear array probe starts to work, acquiring an image scanned by the linear array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the linear array probe;
s1103: if the target body organ is recognized as thyroid, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the thyroid, so that an operator can scan the thyroid by using the linear array probe of the inspection parameters corresponding to the thyroid;
s1104: if the target body organ is identified as a blood vessel, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the blood vessel, so that an operator can scan the blood vessel by using the linear array probe of the inspection parameters corresponding to the blood vessel;
S1105: if the target body organ is identified as the mammary gland, the inspection parameters of the linear array probe are adjusted to the inspection parameters corresponding to the mammary gland, so that an operator can scan the mammary gland by using the linear array probe of the inspection parameters corresponding to the mammary gland;
s1106: if the target body organ is identified as a lymph node, the inspection parameters of the line probe are adjusted to the inspection parameters corresponding to the lymph node so that the operator can scan the lymph node by using the line probe corresponding to the lymph node.
As described in connection with fig. 12, a specific flow of operation of the ultrasonic device of the phased array probe provided in the embodiment of the invention includes:
s1200: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s1201: if the identified probe type is a phased array probe, adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the phased array probe;
s1202: after the phased array probe starts to work, acquiring an image scanned by the phased array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the phased array probe;
s1203: if the target body organ is identified as the heart, the inspection parameters of the phased array probe are adjusted to the inspection parameters corresponding to the heart, so that an operator can scan the heart through the phased array probe using the inspection parameters corresponding to the heart.
As described in connection with fig. 13, a specific flow of operation of the ultrasound device of the intracavity probe provided by the embodiment of the present invention includes:
s1300: acquiring an image containing the probe through a camera on the ultrasonic equipment, and identifying an intracavity probe in the image containing the probe;
s1301: if the identified probe type is an intracavity probe, adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the intracavity probe;
s1302: after the intracavity probe begins to work, acquiring an image scanned by the intracavity probe, and identifying a target body organ which an operator in the image scanned by the intracavity probe wants to detect;
s1303: if the target body organ is identified as uterus, adjusting the inspection parameters of the intracavity probe to the inspection parameters corresponding to the uterus, so that an operator can scan the uterus by using the intracavity probe of the inspection parameters corresponding to the uterus;
s1304: if the target body organ is identified as the ovary, the inspection parameters of the intracavity probe are adjusted to the inspection parameters corresponding to the ovary, so that an operator can scan the ovary by using the intracavity probe of the inspection parameters corresponding to the ovary.
Based on the above-described working method of the ultrasonic device, the embodiment of the invention further provides an ultrasonic device, which includes: the device comprises a camera, a probe interface, a display and a processor;
The camera is used for shooting images of the probe displayed by an operator;
the probe interface is used for accessing various types of probes;
the processor is used for acquiring the image containing the probe and shot by the camera and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe types; acquiring a probe-type scanned image and identifying a target body organ within the probe-type scanned image that an operator wants to detect;
adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the target body organ; or if the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the abdomen;
the display is used for displaying an image formed by scanning the target body organ through the probe type of the inspection parameter corresponding to the target body organ.
Optionally, the processor is further configured to:
the identified target body organ is determined to be the body organ that can be examined by the probe type.
Optionally, after acquiring the image including the probe captured by the camera, the method further includes:
identifying a probe type and a model of the probe type in an image containing the probe;
and adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe type and the model of the probe type.
Optionally, the processor is further configured to: after identifying the probe type in the image containing the probe, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained in the image scanned by the probe, highlighting the target body organ identified in the operation interface;
after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe types, filling the operation parameters corresponding to the identified probe types into an operation interface;
after adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ, displaying the inspection parameters corresponding to the target body organ in an operation interface; or after the inspection parameters of the probe type are adjusted to the inspection parameters corresponding to the abdomen, displaying the inspection parameters corresponding to the abdomen in an operation interface.
Optionally, the processor is further configured to: responding to an adjustment instruction triggered by an operator, and determining an adjusted target inspection parameter according to an adjustment value of the adjusted target inspection parameter in the adjustment instruction;
and adjusting the current target inspection parameters of the probe type to adjusted target inspection parameters.
Optionally, the processor is specifically configured to:
extracting the characteristics of the image scanned by the probe type by adopting a first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features with a plurality of sampling rates, and fusing the weighted features with a plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features weighted twice;
and extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
The processor is specifically configured to:
the first convolution layer and the second convolution layer have the same structure, and the processing procedures comprise:
Carrying out convolution processing on the input of the convolution layer to obtain a convolved feature, carrying out convolution pooling processing on the convolved feature to obtain a pooled feature, and carrying out jump connection processing on the pooled feature to obtain the output of the convolution layer;
the first attention mechanism and the second attention mechanism have the same structure, and the processing procedures comprise:
channel attention processing is carried out on the input of the attention mechanism to obtain characteristics after channel processing, spatial attention processing is carried out on the input of the attention mechanism to obtain characteristics after spatial processing, convolution processing is carried out on the input of the attention mechanism to obtain gating characteristics;
fusing the characteristics after channel processing with the characteristics after space processing to obtain fused characteristics; and carrying out weighted summation on the fused characteristic and the gating characteristic to obtain the output of the attention mechanism.
In an exemplary embodiment, a storage medium is also provided, such as a memory, comprising instructions executable by a processor of an electronic device installed on a train to perform the above-described ultrasonic device operation method. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
The embodiment of the invention also provides a computer program product, when the computer program product runs on the electronic equipment arranged on the train, the electronic equipment arranged on the train is caused to execute the working method for realizing any one of the ultrasonic equipment in the embodiment of the invention.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (10)

1. An ultrasound device, comprising: the device comprises a camera, a probe interface, a display and a processor;
The camera is used for shooting images of the probe displayed by an operator;
the probe interface is used for accessing various types of probes;
the processor is used for acquiring the image containing the probe and shot by the camera and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe types; acquiring a probe-type scanned image and identifying a target body organ within the probe-type scanned image that an operator wants to detect;
adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the target body organ; or if the body position of the target body organ is in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the probe type of the inspection parameters corresponding to the abdomen;
the display is used for displaying an image formed by scanning the target body organ through the probe type of the inspection parameter corresponding to the target body organ.
2. The ultrasonic device of claim 1, wherein the processor is further configured to:
the identified target body organ is determined to be the body organ that can be examined by the probe type.
3. The ultrasonic apparatus according to claim 1, further comprising, after acquiring the image including the probe captured by the camera:
identifying a probe type and a model of the probe type in an image containing the probe;
and adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the identified probe type and the model of the probe type.
4. The ultrasonic device of claim 1, wherein the processor is further configured to: after identifying the probe type in the image containing the probe, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained within the image scanned by the probe type, highlighting the identified target body organ in the operation interface;
after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe types, filling the operation parameters corresponding to the identified probe types into an operation interface;
after adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ, displaying the inspection parameters corresponding to the target body organ in an operation interface; or after the inspection parameters of the probe type are adjusted to the inspection parameters corresponding to the abdomen, displaying the inspection parameters corresponding to the abdomen in an operation interface.
5. The ultrasound device according to any of claims 1 to 4, wherein the processor is specifically configured to:
extracting the characteristics of the image scanned by the probe type by adopting a first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features with a plurality of sampling rates, and fusing the weighted features with a plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features weighted twice;
and extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
6. The ultrasound device of claim 5, wherein the processor is specifically configured to:
the first convolution layer and the second convolution layer have the same structure, and the processing procedures comprise:
carrying out convolution processing on the input of the convolution layer to obtain a convolved feature, carrying out convolution pooling processing on the convolved feature to obtain a pooled feature, and carrying out jump connection processing on the pooled feature to obtain the output of the convolution layer;
The first attention mechanism and the second attention mechanism have the same structure, and the processing procedures comprise:
channel attention processing is carried out on the input of the attention mechanism to obtain characteristics after channel processing, spatial attention processing is carried out on the input of the attention mechanism to obtain characteristics after spatial processing, convolution processing is carried out on the input of the attention mechanism to obtain gating characteristics;
fusing the characteristics after channel processing with the characteristics after space processing to obtain fused characteristics; and carrying out weighted summation on the fused characteristic and the gating characteristic to obtain the output of the attention mechanism.
7. A method of operating an ultrasonic device, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a convex array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the convex array probe;
after the convex array probe starts to work, acquiring an image scanned by the convex array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the convex array probe;
if the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the abdomen so that an operator can scan the target body organ by using the convex array probe of the inspection parameters corresponding to the abdomen; or (b)
If the target body organ is identified as liver, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the liver so that an operator can scan the liver by using the convex array probe of the inspection parameters corresponding to the liver; or if the target body organ is identified as the gall bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the gall bladder so that an operator can scan the gall bladder through the convex array probe using the inspection parameters corresponding to the gall bladder; or if the target body organ is identified as pancreas, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the pancreas so that an operator can scan the pancreas by using the convex array probe of the inspection parameters corresponding to the pancreas; or if the target body organ is identified as the spleen, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the spleen so that an operator can scan the spleen by using the convex array probe of the inspection parameters corresponding to the spleen; or if the target body organ is identified as the kidney, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the kidney so that an operator can scan the kidney by using the convex array probe of the inspection parameters corresponding to the kidney; or if the target body organ is identified as the bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the bladder so that an operator can scan the bladder by using the convex array probe of the inspection parameters corresponding to the bladder; or if the target body organ is identified as the prostate, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the prostate, so that an operator can scan the prostate by using the convex array probe of the inspection parameters corresponding to the prostate.
8. A method of operating an ultrasonic device, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a linear array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the linear array probe;
after the linear array probe starts to work, acquiring an image scanned by the linear array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the linear array probe;
if the target body organ is recognized as thyroid, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the thyroid, so that an operator can scan the thyroid by using the linear array probe of the inspection parameters corresponding to the thyroid; or if the target body organ is identified as a blood vessel, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the blood vessel so that an operator can scan the blood vessel by using the linear array probe of the inspection parameters corresponding to the blood vessel; or if the target body organ is identified as the mammary gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the mammary gland so that an operator can scan the mammary gland by using the linear array probe of the inspection parameters corresponding to the mammary gland; or if the target body organ is identified as the lymph node, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the lymph node so that an operator can scan the lymph node by using the linear array probe of the inspection parameters corresponding to the lymph node.
9. A method of operating an ultrasonic device, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a phased array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the phased array probe;
after the phased array probe starts to work, acquiring an image scanned by the phased array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the phased array probe;
and if the target body organ is identified as the heart, adjusting the inspection parameters of the phased array probe to the inspection parameters corresponding to the heart, so that an operator can scan the heart by using the phased array probe of the inspection parameters corresponding to the heart.
10. A method of operating an ultrasonic device, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is an intracavity probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the intracavity probe;
After the intracavity probe begins to work, acquiring an image scanned by the intracavity probe, and identifying a target body organ which an operator wants to detect in the image scanned by the intracavity probe;
if the target body organ is identified as uterus, adjusting the inspection parameters of the intracavity probe to the inspection parameters corresponding to the uterus, so that an operator can scan the uterus by using the intracavity probe of the inspection parameters corresponding to the uterus; or if the target body organ is identified as the ovary, adjusting the inspection parameters of the intracavity probe to the inspection parameters corresponding to the ovary so that an operator can scan the ovary through the intracavity probe using the inspection parameters corresponding to the ovary.
CN202111145530.1A 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof Active CN113855072B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111145530.1A CN113855072B (en) 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111145530.1A CN113855072B (en) 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof

Publications (2)

Publication Number Publication Date
CN113855072A CN113855072A (en) 2021-12-31
CN113855072B true CN113855072B (en) 2023-09-12

Family

ID=78992097

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111145530.1A Active CN113855072B (en) 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof

Country Status (1)

Country Link
CN (1) CN113855072B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114533119A (en) * 2022-03-03 2022-05-27 意领科技有限公司 Method and system for expanding functions of ultrasonic imaging device
CN116058871B (en) * 2023-03-24 2023-07-14 深圳鲲为科技有限公司 Ultrasonic inspection processing method and ultrasonic inspection equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295483A (en) * 1990-05-11 1994-03-22 Christopher Nowacki Locating target in human body
US5810007A (en) * 1995-07-26 1998-09-22 Associates Of The Joint Center For Radiation Therapy, Inc. Ultrasound localization and image fusion for the treatment of prostate cancer
CN110584712A (en) * 2019-09-17 2019-12-20 青岛海信医疗设备股份有限公司 Fetal face imaging method and device and storage medium
CN111973228A (en) * 2020-06-17 2020-11-24 谈斯聪 B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform
JP2021029675A (en) * 2019-08-26 2021-03-01 キヤノン株式会社 Information processor, inspection system, and information processing method
CN113116377A (en) * 2019-12-31 2021-07-16 无锡祥生医疗科技股份有限公司 Ultrasonic imaging navigation method, ultrasonic device and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150366535A1 (en) * 2011-10-10 2015-12-24 Tractus Corporation Method, apparatus and system for complete examination of tissue with hand-held imaging devices having mounted cameras

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295483A (en) * 1990-05-11 1994-03-22 Christopher Nowacki Locating target in human body
US5810007A (en) * 1995-07-26 1998-09-22 Associates Of The Joint Center For Radiation Therapy, Inc. Ultrasound localization and image fusion for the treatment of prostate cancer
JP2021029675A (en) * 2019-08-26 2021-03-01 キヤノン株式会社 Information processor, inspection system, and information processing method
CN110584712A (en) * 2019-09-17 2019-12-20 青岛海信医疗设备股份有限公司 Fetal face imaging method and device and storage medium
CN113116377A (en) * 2019-12-31 2021-07-16 无锡祥生医疗科技股份有限公司 Ultrasonic imaging navigation method, ultrasonic device and storage medium
CN111973228A (en) * 2020-06-17 2020-11-24 谈斯聪 B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈公白,潘永辉..脑内超声探查——侧射型脑针式超声探头的临床应用.《上海第一医学院学报》.1964,全文. *

Also Published As

Publication number Publication date
CN113855072A (en) 2021-12-31

Similar Documents

Publication Publication Date Title
CN113855072B (en) Ultrasonic equipment and working method thereof
TW201923776A (en) Quality indicators for collection of and automated measurement on ultrasound images
US20100249595A1 (en) System and method for automatic calibration of tracked ultrasound
CN112541928A (en) Network training method and device, image segmentation method and device and electronic equipment
CN108882916B (en) Ultrasonic blood flow parameter display method and ultrasonic imaging system thereof
CN110517757A (en) The medical ultrasound image of tuning
US10695032B2 (en) Medical image display apparatus and method therefor
JP7362354B2 (en) Information processing device, inspection system and information processing method
CN109887077B (en) Method and apparatus for generating three-dimensional model
KR20220020359A (en) Representation of target during ultrasound probe aiming
CA3174788A1 (en) Automated prostate analysis system
CN114554963A (en) System and method for automated ultrasound image tagging and quality grading
CN112115894A (en) Training method and device for hand key point detection model and electronic equipment
CN111836584B (en) Ultrasound contrast imaging method, ultrasound imaging apparatus, and storage medium
JP7321836B2 (en) Information processing device, inspection system and information processing method
CN110418610A (en) Determine guidance signal and for providing the system of guidance for ultrasonic hand-held energy converter
US11191526B2 (en) Ultrasound diagnosis apparatus and method of controlling the same
US20110137165A1 (en) Ultrasound imaging
CN115019980B (en) Method and device for processing inquiry data, user terminal and server
US20230137369A1 (en) Aiding a user to perform a medical ultrasound examination
CN112927275B (en) Image processing method and device, electronic equipment and storage medium
US20060029269A1 (en) Apparatus, program and method for motion analysis in internal body
JP2019118694A (en) Medical image generation apparatus
CN115886877A (en) Guiding method for ultrasonic scanning and ultrasonic imaging system
CN111627002A (en) Coronary artery microvascular resistance index calculation device and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant