CN113855072A - Ultrasonic device and working method thereof - Google Patents

Ultrasonic device and working method thereof Download PDF

Info

Publication number
CN113855072A
CN113855072A CN202111145530.1A CN202111145530A CN113855072A CN 113855072 A CN113855072 A CN 113855072A CN 202111145530 A CN202111145530 A CN 202111145530A CN 113855072 A CN113855072 A CN 113855072A
Authority
CN
China
Prior art keywords
probe
target body
body organ
parameters corresponding
identified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111145530.1A
Other languages
Chinese (zh)
Other versions
CN113855072B (en
Inventor
陈哲
王文凯
郭颂
时俊楠
王�琦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Medical Equipment Co Ltd
Original Assignee
Qingdao Hisense Medical Equipment Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Medical Equipment Co Ltd filed Critical Qingdao Hisense Medical Equipment Co Ltd
Priority to CN202111145530.1A priority Critical patent/CN113855072B/en
Publication of CN113855072A publication Critical patent/CN113855072A/en
Application granted granted Critical
Publication of CN113855072B publication Critical patent/CN113855072B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4444—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to the probe
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

The invention relates to an ultrasonic device and a working method thereof, relating to the technical field of ultrasonic artificial intelligence, wherein the ultrasonic device comprises: acquiring an image which is shot by a camera and contains a probe, and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type; acquiring an image scanned by the probe type, and identifying a target body organ which an operator wants to detect in the image scanned by the probe type; adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ; or if the body position where the target body organ is located is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameter of the probe type to the examination parameter corresponding to the abdomen. The invention can automatically detect the type of the probe and the target body organ which an operator wants to detect, thereby automatically adjusting parameters and reducing the workload of the operator.

Description

Ultrasonic device and working method thereof
Technical Field
The invention relates to the technical field of ultrasonic artificial intelligence, in particular to ultrasonic equipment and an operating method of the ultrasonic equipment.
Background
In an ultrasound department, a large number of general examination items are frequently encountered everyday, for example, a linear array probe is adopted to examine neck blood vessels, mammary glands, thyroid glands, lymph nodes and the like of a neck, a phased array probe is adopted to examine the heart of a chest, a convex array probe is adopted to examine liver, gall, pancreas, spleen and kidney of an abdomen, and then the linear array probe is adopted to examine blood vessels of lower limbs of a leg, blood vessels of joints of feet and the like of a patient.
In order to clearly and accurately reflect the real imaging effect of different examination parts and examination organs of a patient, an operator needs to switch the probes back and forth, and needs to switch examination modes back and forth under each probe, for example, an abdominal mode, a renal mode, a urinary mode and the like are available under a convex array. Such a large number of examinations per day entails cumbersome probe switching, site selection operations, which increases the workload of the operator.
Disclosure of Invention
The invention provides an ultrasonic device and a working method thereof, which can automatically detect the type of a probe and a target body organ which an operator wants to detect, thereby automatically adjusting parameters and reducing the workload of the operator.
In a first aspect, an embodiment of the present invention provides an ultrasound apparatus, including: the device comprises a camera, a probe interface, a display and a processor;
the camera is used for shooting an image of the probe displayed by an operator;
the probe interface is used for accessing various types of probes;
the processor is used for acquiring the image which is shot by the camera and contains the probe, and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type; acquiring an image of probe type scanning, and identifying a target body organ which an operator wants to detect in the image of probe type scanning;
adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ, so that an operator can scan the target body organ by using the probe type of the examination parameters corresponding to the target body organ; or if the body position of the target body organ is in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameter of the probe type to the examination parameter corresponding to the abdomen, so that the operator can scan the target body organ by using the probe type of the examination parameter corresponding to the abdomen;
the display is used for displaying an image formed by scanning the target body organ by using the probe type of the examination parameter corresponding to the target body organ.
The ultrasonic equipment can identify the probe type of the image through the image containing the probe shot by the camera of the ultrasonic equipment, the operation parameter corresponding to the identified probe type is used as the operation parameter of the ultrasonic equipment, then the image scanned by the probe type is obtained, the target body organ which an operator wants to detect in the image is identified, the inspection parameter of the probe type is adjusted to the inspection parameter corresponding to the target body organ, or the inspection parameter of the probe type is adjusted to the inspection parameter corresponding to the abdomen when the body position where the target body organ is located is identified to be the abdomen or the body organ is the organ in the urinary system.
In one possible implementation, the identified target body organ is determined to be a body organ that the probe type can examine.
According to the ultrasonic equipment, each probe type has the body organ which can be inspected, and the body organ which can be inspected by the probe type is judged and identified, so that the accuracy of adjusting the inspection parameters is increased.
In a possible implementation manner, after acquiring the image including the probe shot by the camera, the method further includes:
identifying the type of the probe and the model of the type of the probe in an image containing the probe;
and adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type and the model of the probe type.
Because different types of different probes are different in function or used operation parameters, the ultrasonic equipment can identify different probe types and different types of probes, so that the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe types and the different types of probes, the purpose of automatically adjusting the parameters is achieved, the workload of an operator is reduced, and the accuracy of parameter adjustment is improved.
In one possible implementation, the processor is further configured to: after the probe type in the image containing the probe is identified, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained in the image scanned by the probe, highlighting the identified target body organ in the operation interface;
after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe type, the operation parameters corresponding to the identified probe type are filled in the operation interface;
after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the target body organ, the examination parameters corresponding to the target body organ are displayed in an operation interface; or after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the abdomen, the examination parameters corresponding to the abdomen are displayed in an operation interface.
The ultrasonic equipment can display the recognized probe type, the recognized target body organ, the adjusted running parameter and the adjusted inspection parameter, so that an operator can know the current working condition conveniently.
In one possible implementation, the processor is specifically configured to:
extracting the characteristics of the image scanned by the probe type by adopting a first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features of the plurality of sampling rates, and fusing the weighted features of the plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features after secondary weighting;
and extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
The ultrasonic equipment can adopt multilayer convolution, weighting and mixing of the features with different sampling rates during feature extraction, so that the feature of the determined target body organ has more information, and the accuracy of the determined target body organ is improved.
In one possible implementation, the processor is specifically configured to:
wherein the first convolution layer and the second convolution layer have the same structure, and the processing procedure comprises the following steps:
performing convolution processing on the input of the convolutional layer to obtain a feature after convolution, performing convolution pooling processing on the feature after convolution to obtain a pooled feature, and performing jump connection processing on the pooled feature to obtain the output of the convolutional layer;
the first attention mechanism and the second attention mechanism are identical in structure, and the processing procedures comprise:
performing channel attention processing on the input of the attention mechanism to obtain the characteristics after the channel processing, performing space attention processing on the input of the attention mechanism to obtain the characteristics after the space processing, and performing convolution processing on the input of the attention mechanism to obtain the gating characteristics;
fusing the channel processed features and the space processed features to obtain fused features; and carrying out weighted summation on the fused features and the gating features to obtain the output of the attention mechanism.
According to the method, after the convolution layer performs feature extraction by utilizing convolution, feature is subjected to convolution downsampling processing, and the downsampled feature is subjected to jump connection processing, so that the depth of feature extraction can be increased, the training times are reduced, channel and space attention is provided for an attention mechanism, meanwhile, the input feature is subjected to convolution to obtain a gating feature, and weighted summation is performed according to the gating feature and the fused feature, so that the accuracy of organ identification is increased.
In a second aspect, an embodiment of the present invention provides an ultrasound apparatus operating method, including:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a convex array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the convex array probe;
after the convex array probe starts to work, acquiring an image scanned by the convex array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the convex array probe;
if the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the abdomen, so that an operator can scan the target body organ by using the convex array probe of the examination parameters corresponding to the abdomen; or
If the target body organ is identified to be the liver, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the liver, so that an operator can scan the liver by using the convex array probe of the examination parameters corresponding to the liver; or if the target body organ is identified as the gallbladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the gallbladder, so that an operator can scan the gallbladder by using the convex array probe of the inspection parameters corresponding to the gallbladder; or if the target body organ is identified to be pancreas, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the pancreas, so that the operator can scan the pancreas by using the convex array probe with the inspection parameters corresponding to the pancreas; or if the target body organ is identified as the spleen, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the spleen, so that the operator can scan the spleen by using the convex array probe with the inspection parameters corresponding to the spleen; or if the target body organ is identified as a kidney, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the kidney, so that an operator can scan the kidney by using the convex array probe of the examination parameters corresponding to the kidney; or if the target body organ is identified to be the bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the bladder so that the operator can scan the bladder by using the convex array probe of the inspection parameters corresponding to the bladder; or if the target body organ is identified as the prostate, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the prostate so that the operator can scan the prostate by using the convex array probe with the examination parameters corresponding to the prostate.
In a third aspect, an embodiment of the present invention provides an ultrasound apparatus operating method, including:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a linear array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the linear array probe;
after the linear array probe starts to work, acquiring an image scanned by the linear array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the linear array probe;
if the target body organ is identified to be the thyroid gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the thyroid gland, so that an operator can scan the thyroid gland by using the linear array probe of the inspection parameters corresponding to the thyroid gland; or if the target body organ is identified as a blood vessel, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the blood vessel so that an operator can scan the blood vessel by using the linear array probe with the inspection parameters corresponding to the blood vessel; or if the target body organ is identified to be the mammary gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the mammary gland so that an operator can scan the mammary gland by using the linear array probe with the inspection parameters corresponding to the mammary gland; or if the target body organ is identified as the lymph node, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the lymph node so that the operator can scan the lymph node by using the linear array probe with the inspection parameters corresponding to the lymph node.
In a fourth aspect, an operating method of an ultrasound apparatus provided in an embodiment of the present invention includes:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a phased array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the phased array probe;
after the phased array probe starts to work, acquiring an image scanned by the phased array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the phased array probe;
and if the target body organ is identified as the heart, adjusting the examination parameters of the phased array probe to the examination parameters corresponding to the heart so that the operator can scan the heart by using the phased array probe with the examination parameters corresponding to the heart.
In a fifth aspect, an operating method of an ultrasound apparatus provided in an embodiment of the present invention includes:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the intracavity probe in the image containing the probe;
if the identified probe type is an intracavity probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the intracavity probe;
after the intracavity probe starts to work, acquiring an image scanned by the intracavity probe, and identifying a target body organ which an operator wants to detect in the image scanned by the intracavity probe;
if the target body organ is identified to be the uterus, adjusting the examination parameters of the intracavity probe to the examination parameters corresponding to the uterus, so that an operator can scan the uterus by using the intracavity probe with the examination parameters corresponding to the uterus; or if the target body organ is identified as the ovary, adjusting the inspection parameters of the intracavity probe to the inspection parameters corresponding to the ovary, so that the operator can scan the ovary by using the intracavity probe with the inspection parameters corresponding to the ovary.
In a sixth aspect, the present application further provides a computer storage medium having a computer program stored thereon, which when executed by a processing unit, implements the steps of the method of operating an ultrasound device according to any one of the second to fifth aspects.
In addition, for technical effects brought by any one implementation manner of the second aspect to the sixth aspect, reference may be made to technical effects brought by different implementation manners of the first aspect, and details are not described here.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention and are not to be construed as limiting the invention.
FIG. 1 is a schematic diagram of an ultrasound device provided by an embodiment of the present invention;
FIG. 2 is a schematic diagram of probe type identification provided by an embodiment of the present invention;
FIG. 3 is a schematic diagram of a method for identifying a target body organ according to an embodiment of the invention;
FIG. 4 is a schematic diagram of an operation interface provided in an embodiment of the present invention;
FIG. 5 is a flow chart of a method of operating an ultrasound device provided by an embodiment of the present invention;
FIG. 6 is a flow chart of another method of operating an ultrasound device provided by an embodiment of the present invention;
FIG. 7 is a flow chart of a network for identifying a target body organ provided by an embodiment of the present invention;
FIG. 8 is a block diagram of a convolutional layer provided in an embodiment of the present invention;
FIG. 9 is a block diagram of an attention mechanism provided by an embodiment of the present invention;
fig. 10 is a flowchart of an operating method of an ultrasound apparatus based on a convex array probe according to an embodiment of the present invention;
fig. 11 is a flowchart of an operating method of an ultrasonic apparatus based on a linear array probe according to an embodiment of the present invention;
fig. 12 is a flowchart of a method for operating a phased array probe-based ultrasound device according to an embodiment of the present invention;
fig. 13 is a flowchart of a method for operating an ultrasound apparatus based on an intracavity probe according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
The application scenario described in the embodiment of the present invention is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not form a limitation on the technical solution provided in the embodiment of the present invention, and it can be known by a person skilled in the art that with the occurrence of a new application scenario, the technical solution provided in the embodiment of the present invention is also applicable to similar technical problems.
At present, the ultrasonic equipment is suitable for a wide range of examination items, such as neck, abdomen, blood vessels and the like, and the types and parameters of probes suitable for each part are different, so that certain parameters cannot be set uniformly. This makes the probe of operator's right hand-held do the inspection while, and the button, adjust knob also need be constantly clicked to the left hand, and this step is repeatability, redundant operation mostly, consumes a large amount of operating time.
Based on this, the invention provides an ultrasound device.
A block diagram of a hardware configuration of an ultrasound apparatus 100 according to an exemplary embodiment is exemplarily shown in fig. 1. As shown in fig. 1, the ultrasonic apparatus 100 includes: memory, a display, a plurality of probe interfaces 130, a processor, a camera 150, a power interface, a console 170, a housing 180, a pulley 190, and the like.
The specific functions of the above components are described below:
(1) a memory:
the memory may be used to store software programs and data. The processor performs various functions of the ultrasound device 100 and data processing by executing software programs or data stored in the memory. The memory may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The memory stores an operating system that enables the ultrasound device 100 to function. The memory of the present application may store an operating system and various application programs, and may also store codes for performing the methods described in the embodiments of the present application.
(2) A probe interface:
the probe interfaces are used for accessing various types of probes; the ultrasonic equipment provided by the invention can be connected with various probes, so that an operator can use the probes to perform inspection work.
(3) A probe interface:
and the camera 150 is used for shooting the image of the probe displayed by the operator and sending the image shot by the camera 150 to the processor.
Specifically, the operator displays the type of the probe used by the operator in the imaging range of the camera 150, and when the operator activates the camera 150, the camera 150 captures an image and transmits the image to the processor.
(4) A processor:
the processor is a control center of the ultrasound apparatus 100, connects various parts of the entire terminal with various interfaces and lines, and performs various functions of the ultrasound apparatus 100 and processes data by running or executing software programs stored in the memory and calling up data stored in the memory. In some embodiments, a processor may include one or more processing units; the processor may also integrate an application processor, which primarily handles operating systems, operator interfaces, applications, etc., and a baseband processor, which primarily handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor. The processor can run an operating system, an application program, operator interface display and touch response, and the processing method in the embodiment of the application. In addition, the processor is coupled to a display 120.
The processor is used for acquiring the image containing the probe shot by the camera 150 and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type; acquiring an image scanned by the probe type, and identifying a target body organ which an operator wants to detect in the image scanned by the probe type; the operation parameters of the ultrasonic equipment are parameters which can enable the probe type to normally operate on the ultrasonic equipment, namely, what type of probe the ultrasonic equipment is inserted into can achieve some parameters for normally using the type of probe.
Adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ, so that the operator can scan the target body organ by using the probe type of the examination parameters corresponding to the target body organ; or if the body position where the target body organ is located is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameter of the probe type to the examination parameter corresponding to the abdomen so that the operator can scan the target body organ by using the probe type of the examination parameter corresponding to the abdomen;
examination parameters, i.e. parameters required for the examination of a specific body part, such as frequency, scan range, dynamic range, speckle suppression, noise suppression, false colors, line density, frame correlation, number of foci, etc.
The probe types comprise a convex array probe, a linear array probe, a phased array probe and an intracavity probe;
if the identified probe type is a convex array probe, the target body organ is one of the following organs: liver, gallbladder, pancreas, spleen, kidney, bladder, prostate;
if the identified probe type is a linear array probe, the target body organ is one of the following organs: thyroid, blood vessels, breast, lymph nodes;
if the identified probe type is a phased array probe, the target body organ is a heart;
if the identified probe type is an intracavity probe, the target body organ is one of: uterus, ovary.
The processor and memory are enclosed by a housing 180.
(5) A display:
the display 120 is used to display an operator interface (GUI), images of the probe type scan, images captured by the camera 150, and so forth. In particular, the display 120 may include a display screen disposed on the front face of the ultrasound device 100. The display screen may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display 120 may be used to display various graphical operator interfaces described herein.
The display comprises a first display screen 121 and a second display screen 122; the first display screen 121 is used for displaying an operator interface (GUI), an image scanned by the probe type, an image collected by the camera 150, and the like; a second display screen 122 for displaying data controlled by the console 170, for example, displaying detection parameters, so that the operator can adjust the console through the console 170.
The first display screen 121 is used for displaying the recognition result of the image shot by the camera, that is, displaying the recognized probe type, and in conjunction with fig. 2, for example, the recognized probe type is fpype 10.91, the picture and the recognized type are displayed in the first display screen 121.
The first display screen 121 is further configured to display an image scanned by the probe type, and as shown in fig. 3, the current probe type is a convex array probe, the detected target body organ is a kidney, and the displayed image is an image of the kidney scanned by the convex array probe.
For the processor, the processor is further configured to: after the probe type in the image containing the probe is identified, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained in the image scanned by the probe, highlighting the identified target body organ in the operation interface;
after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe type, the operation parameters corresponding to the identified probe type are displayed in an operation interface;
and after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the target body organ, displaying the examination parameters corresponding to the target body organ in an operation interface.
The type of the probe and the target body organ automatically identified by the ultrasound device are displayed in the second display screen 122, and the adjusted operating parameters and examination parameters are displayed. Referring to fig. 4, an operation interface is displayed on the second display screen 122, where the operation interface includes patient information, multiple types of probes, a convex array probe, a linear array probe, a phased array probe, an intracavity probe, multiple preset examination sites, an abdomen, a kidney, a heart, a uterus, and the like, after the probe type in an image including the probe is identified as the convex array probe, the convex array probe identified in the operation interface is highlighted, after a target body organ included in an image scanned by the probe is identified as the abdomen, the abdomen identified in the operation interface is highlighted, an operation parameter of the ultrasound apparatus is adjusted to an operation parameter corresponding to the identified probe type, and then an operation parameter corresponding to the identified probe type is filled in the operation interface; and after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the target body organ, filling specific values such as frequency, scanning range, dynamic range, speckle suppression, noise suppression, pseudo color, linear density, frame correlation, focus number and the like into an operation interface.
(6) An operation table:
and an operation table 170 for adjusting the inspection parameters. Specifically, the operator may adjust the inspection parameters via buttons on the console 170. The processor is also used for responding to an adjusting instruction triggered by an operator after the examination parameters corresponding to the target body organ are filled in the operation interface, and determining the adjusted target examination parameters according to the adjusting values of the adjusted target examination parameters in the adjusting instruction; and adjusting the current target inspection parameters of the probe type into the adjusted target inspection parameters.
The power interface is used for supplying power to each part after being communicated with an external power supply. After passing through the power interface, the external power supply can be logically connected with the processor through the power management system, so that the functions of managing charging, discharging, power consumption and the like are realized through the power management system. The ultrasound device 100 may also be configured with power buttons for turning the ultrasound device on and off, and for locking the screen.
The technical solution of the present invention is specifically described below with reference to the accompanying drawings.
Referring to fig. 5, an embodiment of the present invention provides an operating method of an ultrasound apparatus, which is applied to the ultrasound apparatus described above, and includes:
s500: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s501: adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type;
s502: acquiring an image scanned by the probe type, and identifying a target body organ which an operator wants to detect in the image scanned by the probe type;
s503: adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ, so that the operator can scan the target body organ by using the probe type of the examination parameters corresponding to the target body organ; or if the body position where the target body organ is located is identified to be the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameter of the probe type to the examination parameter corresponding to the abdomen so that the operator can scan the target body organ by using the probe type of the examination parameter corresponding to the abdomen.
The step of adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ can be understood as follows: if the body position of the target body organ is not in the abdomen and the target body organ is not in the urinary system, adjusting the inspection parameters of the probe type to the inspection parameters corresponding to the target body organ; and if the body position where the target body organ is located is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ.
For the scheme provided by the invention, the probe type can be automatically identified, so that an operator does not need to select the probe type of the operator, the target body organ which the operator wants to detect is automatically identified, the corresponding examination parameter is selected according to the target body organ, and the examination parameter is adjusted, so that the operator does not need to operate the probe and adjust the parameter at the same time.
Since each probe type has its own body organ that can be examined, for example, the body organs that can be examined by a convex array probe are: liver, gallbladder, pancreas, spleen, kidney, bladder, prostate;
body organ that linear array probe can inspect: thyroid, blood vessels, breast, lymph nodes;
the body organ which can be examined by the phased array probe is the heart;
body organs that the intracavity probe can examine: uterus, ovary.
Therefore, before the examination parameters are adjusted, the identified target body organ is determined to be the body organ which can be examined by the probe type, so that the accuracy of the adjustment of the examination parameters can be improved.
And prompting the operator that the identified target body organ is not the body organ which can be checked by the probe type if the identified target body organ is not the body organ which can be checked by the probe type.
Because the different types of probes work and the different parameters of the operation of the probes are different, in order to improve the accuracy of the operation parameter setting, the invention provides the method for identifying the type of the probe and the type of the probe in the image containing the probe; and adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type and the model of the probe type.
No matter whether the probe type is identified independently or the types of the probe type and the probe type are identified, the invention can use a Yolo5s series target detection network, and a multi-scale special fusion method such as FPN, PAN and the like is added in the Yolo5s series target detection network; the network structure is optimized, the number of network layers is properly reduced, and the recognition speed is further improved, so that the effects of accurate recognition and real-time detection are realized.
In the network only recognizing the probe type, an image including the probe type is used as a sample image, the probe type is used as output, and the network is trained.
When the probe type and the model of the probe type are identified, an image containing the probe type is used as a sample image, the probe type and the model of the probe type are used as output, and a network is trained. Thus, probes of the same type can be identified due to different types and shapes.
Of course, when only one type of probe is suitable, for example, a type a convex array probe, the invention stores the corresponding relationship between the operating parameters, the probe type and the signals of the probe type, and the operating parameters corresponding to the type a convex array probe, so that when the convex array probe is identified, the type a convex array probe needs to inquire the corresponding relationship between the operating parameters, the probe type and the signals of the probe type according to only one type a convex array probe recorded in the ultrasonic equipment to find the corresponding operating parameters.
For a sample image, an augmented data set can be obtained by performing data expansion in the modes of rotation, scaling, enhancement, a Mosaic method, Cutout and the like, so as to increase the generalization of the model.
In order to enable an operator to know the working condition of the ultrasonic equipment, another working method of the ultrasonic equipment is further provided in an embodiment of the present invention, which is shown in fig. 6 and includes:
s600: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s601: highlighting the probe type identified in the operation interface;
s602: adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type;
s603: filling operation parameters corresponding to the identified probe type into the operation interface;
s604: acquiring an image scanned by the probe type, and identifying a target body organ which an operator wants to detect in the image scanned by the probe type;
s605: highlighting the target body organ identified in the operation interface;
s606: adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ, so that the operator can scan the target body organ by using the probe type of the examination parameters corresponding to the target body organ;
s607: and displaying the examination parameters corresponding to the target body organ in the operation interface.
For S606 and S607, the following steps may be substituted: if the target body organ is identified to be the body organ, and the body position of the body organ is in the abdomen or the body organ is the organ in the urinary system, adjusting the examination parameter of the probe type to the examination parameter corresponding to the abdomen, so that the operator can scan the target body organ by using the probe type of the examination parameter corresponding to the abdomen; displaying examination parameters corresponding to the abdomen in an operation interface;
for the examination parameters, the operator can also adjust the examination parameters by himself according to own experience, namely after the examination parameters corresponding to the target body organ are filled in the operation interface, the operator responds to the adjustment instruction triggered by the operator, and the adjusted target examination parameters are determined according to the adjustment value of the adjusted target examination parameters in the adjustment instruction; and adjusting the current target inspection parameters of the probe type into the adjusted target inspection parameters.
The specific procedure for identifying a target body organ within an image of a probe type scan that an operator wants to detect includes:
extracting the characteristics of the image scanned by the probe type by adopting the first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features of the plurality of sampling rates, and fusing the weighted features of the plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features after secondary weighting;
and extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
Specifically, the first convolutional layer and the second convolutional layer are both established on the basis of resblock, the weighted features are sampled by adopting multiple sampling rates to obtain the weighted features of the multiple sampling rates, the weighted features of the multiple sampling rates are fused to obtain the fusion features, and the fusion features are established on the basis of ASPP Block.
With reference to fig. 7, a multi-organ ultrasound image database is used as a sample set, and an image is selected from the multi-organ ultrasound image database and input to a first reblock, that is, a first convolution layer, to extract features; then, a first Attention mechanism (Attention) is adopted for weighting, then, an ASPP Block network is adopted for carrying out multiple sampling rates to sample the weighted features to obtain the weighted features of the multiple sampling rates, the weighted features of the multiple sampling rates are fused to obtain fused features, a second Attention mechanism is adopted for carrying out weighting processing on the fused features, the weighted fused features are input into a second reblock, namely a second convolution layer, prediction is carried out according to the features after extraction is finished, and the target body organ which the operator wants to detect is determined.
For the images in the multi-organ ultrasonic image database, data enhancement can be performed through data expansion modes such as transfer learning, MixUp, Elastic Deformation and the like, so as to increase the number of the images in the database. The multi-organ ultrasound image database comprises a sea volume data set of the most commonly used organs for ultrasound clinical measurement under different types of probes and different scanning sections, such as liver, gall, pancreas, spleen and kidney of abdominal system, bladder and prostate of urinary system, and other relevant parts scanned by a convex array probe, thyroid and carotid arteries of lower superficial and small organ systems scanned by a linear array probe, and heart scanned by a phased array probe.
Wherein, the first convolution layer is the same with the structure of second convolution layer, and the processing procedure all includes:
and performing convolution processing on the input of the convolutional layer to obtain the convolved features, performing convolution pooling processing on the convolved features to obtain pooled features, and performing jump connection processing on the pooled features to obtain the output of the convolutional layer.
When the first convolution layer is adopted to extract the characteristics of the image scanned by the probe type, the input of the convolution layer is the image scanned by the probe type; the output of the convolutional layer is the extracted feature.
When the second convolution layer is adopted to extract the fusion characteristics after the secondary weighting, the input of the convolution layer is the fusion characteristics after the secondary weighting; the output of the convolutional layer is the fusion feature after the second weighting after extraction.
The structure of the two convolutional layers includes at least one structure as in fig. 8. As shown in fig. 8, the structure includes convolution Conv, normalized BN, excitation function ReLu, convolution pooling convpool, jump-connected as Conv and BN, and Conv, BN, ReLu, and the specific working process is that the feature after convolution pooling is performed with convolution and normalization processing, the feature after convolution pooling is performed with convolution, normalization, and excitation function processing, and the two processing processes are fused to ADD to obtain a feature after structure.
In the above process, the convolution pooling is replaced by the maximum pooling, and since the maximum pooling is to find the largest feature in the feature map of each channel, training is not required here, and the largest feature cannot be found better through learning. And the operation of the convolution pooling can be used for finding more characteristics by training and modifying parameters in the convolution pooling, so that the loss rate of information is reduced.
The first attention mechanism and the second attention mechanism have the same structure, and the processing process comprises the following steps:
performing channel attention processing on the input of the attention mechanism to obtain the characteristics after the channel processing, performing space attention processing on the input of the attention mechanism to obtain the characteristics after the space processing, and performing convolution processing on the input of the attention mechanism to obtain the gating characteristics;
fusing the channel processed features and the space processed features to obtain fused features; and carrying out weighted summation on the fused features and the gating features to obtain the output of the attention mechanism.
The structure of the attention mechanism is shown in fig. 9, and the channel attention model includes global average pooling (global avg pool), global maximum pooling (global max pool), multi-layer perceptron (MLP), sigmoid function & relu (activation function). Inputting the features after global average pooling (global avg pool) and global maximum pooling (global max pool) into the multilayer perceptron, adding the features after the multilayer perceptron, and multiplying the output of the sigmoid function & relu with the input of the attention mechanism to obtain the features of the channel attention model.
The spatial attention model includes global average pooling (global avg pool), global maximum pooling (global max pool), conv (convolution processing) & BN (normalization function), sigmoid function. Adding features after global average pooling (global avg pool) and global maximum pooling (global max pool), and multiplying the output of the sigmoid function by the input of the attention mechanism through conv (convolution processing) & BN (normalization function) to obtain the features of the spatial attention model.
Adding the characteristics of the channel attention model and the characteristics of the space attention model to obtain fused characteristics;
the input to the attention mechanism was subjected to conv (convolution processing) by 1 x 1, resulting in a gating feature. And carrying out weighted summation on the gating characteristic and the fused characteristic to obtain the output of the attention mechanism.
Because the input of the attention mechanism is added in each channel attention model to be multiplied by the features processed by the sigmoid function, the input of the attention mechanism is added to be multiplied by the features processed by the sigmoid function & relu so as to enhance the effective channel weight of the features and increase the effective expression on the spatial resolution, and meanwhile, the gating features and the fused features are multiplied to obtain the final output, the accuracy of organ identification can be improved.
In the process, based on the deep neural network and data driving, the deep neural network based on jump connection, a hollow convolution space pyramid and an attention mechanism is designed, and convolution down-sampling is used for replacing pooling down-sampling, so that the spatial information relation and semantic relation among remote pixels in the image and high-dimensional characteristics of target significance are efficiently utilized, the identification accuracy of identifying each organ is improved, and the robust and rapid identification of the model is realized.
As described with reference to fig. 10, a specific process of the operation of the ultrasonic apparatus of the convex array probe according to the embodiment of the present invention includes:
s1000: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s1001: if the identified probe type is a convex array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the convex array probe;
s1002: after the convex array probe starts to work, acquiring an image scanned by the convex array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the convex array probe;
s1003: if the body position where the target body organ is located is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the abdomen, so that an operator can scan the target body organ by using the convex array probe of the examination parameters corresponding to the abdomen;
s1004: if the target body organ is identified to be the liver, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the liver, so that an operator can scan the liver by using the convex array probe of the examination parameters corresponding to the liver;
s1005: if the target body organ is identified as the gallbladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the gallbladder so that an operator can scan the gallbladder by using the convex array probe of the inspection parameters corresponding to the gallbladder;
s1006: if the target body organ is identified to be pancreas, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the pancreas, so that an operator can scan the pancreas by using the convex array probe of the inspection parameters corresponding to the pancreas;
s1007: if the target body organ is identified as the spleen, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the spleen, so that the operator can scan the spleen by using the convex array probe with the inspection parameters corresponding to the spleen;
s1008: if the target body organ is identified as the kidney, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the kidney, so that the operator can scan the kidney by using the convex array probe of the examination parameters corresponding to the kidney;
s1009: if the target body organ is identified to be the bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the bladder so that the operator can scan the bladder by using the convex array probe of the inspection parameters corresponding to the bladder;
s1010: if the target body organ is identified as the prostate, the examination parameters of the convex probe are adjusted to the examination parameters corresponding to the prostate so that the operator can scan the prostate by using the convex probe of the examination parameters corresponding to the prostate.
As described with reference to fig. 11, a specific process of the ultrasonic device of the linear array probe according to the embodiment of the present invention includes:
s1100: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s1101: if the identified probe type is a linear array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the linear array probe;
s1102: after the linear array probe starts to work, acquiring an image scanned by the linear array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the linear array probe;
s1103: if the target body organ is identified to be the thyroid gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the thyroid gland so that an operator can scan the thyroid gland by using the linear array probe of the inspection parameters corresponding to the thyroid gland;
s1104: if the target body organ is identified as a blood vessel, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the blood vessel so that an operator can scan the blood vessel by using the linear array probe with the inspection parameters corresponding to the blood vessel;
s1105: if the target body organ is identified to be the mammary gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the mammary gland so that an operator can scan the mammary gland by using the linear array probe with the inspection parameters corresponding to the mammary gland;
s1106: if the target body organ is identified as a lymph node, the inspection parameters of the linear array probe are adjusted to the inspection parameters corresponding to the lymph node, so that the operator can scan the lymph node by using the linear array probe with the inspection parameters corresponding to the lymph node.
As described with reference to fig. 12, a specific process of the operation of the ultrasonic apparatus of the phased array probe according to the embodiment of the present invention includes:
s1200: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
s1201: if the identified probe type is a phased array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the phased array probe;
s1202: after the phased array probe starts to work, acquiring an image scanned by the phased array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the phased array probe;
s1203: if the target body organ is identified as a heart, the examination parameters of the phased array probe are adjusted to the examination parameters corresponding to the heart, so that the operator can scan the heart by using the phased array probe of the examination parameters corresponding to the heart.
As described with reference to fig. 13, a specific process of the operation of the ultrasound device of the intracavity probe according to the embodiment of the present invention includes:
s1300: acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the intracavity probe in the image containing the probe;
s1301: if the identified probe type is an intracavity probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the intracavity probe;
s1302: after the intracavity probe starts to work, acquiring an image scanned by the intracavity probe, and identifying a target body organ which an operator wants to detect in the image scanned by the intracavity probe;
s1303: if the target body organ is identified to be the uterus, adjusting the examination parameters of the intracavity probe to the examination parameters corresponding to the uterus, so that an operator can scan the uterus by using the intracavity probe with the examination parameters corresponding to the uterus;
s1304: if the target body organ is identified as the ovary, the inspection parameters of the intracavity probe are adjusted to the inspection parameters corresponding to the ovary, so that the operator can scan the ovary by using the intracavity probe with the inspection parameters corresponding to the ovary.
Based on the above introduced working method of the ultrasonic device, an embodiment of the present invention further provides an ultrasonic device, including: the device comprises a camera, a probe interface, a display and a processor;
the camera is used for shooting an image of the probe displayed by an operator;
the probe interface is used for accessing various types of probes;
the processor is used for acquiring the image which is shot by the camera and contains the probe, and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type; acquiring an image of probe type scanning, and identifying a target body organ which an operator wants to detect in the image of probe type scanning;
adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ, so that an operator can scan the target body organ by using the probe type of the examination parameters corresponding to the target body organ; or if the body position where the target body organ is located is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameter of the probe type to the examination parameter corresponding to the abdomen, so that the operator can scan the target body organ by using the probe type of the examination parameter corresponding to the abdomen;
the display is used for displaying an image formed by scanning the target body organ by using the probe type of the examination parameter corresponding to the target body organ.
Optionally, the processor is further configured to:
and determining the identified target body organ as the body organ which can be checked by the probe type.
Optionally, after acquiring the image including the probe shot by the camera, the method further includes:
identifying the type of the probe and the model of the type of the probe in an image containing the probe;
and adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type and the model of the probe type.
Optionally, the processor is further configured to: after the probe type in the image containing the probe is identified, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained in the image scanned by the probe, highlighting the identified target body organ in the operation interface;
after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe type, the operation parameters corresponding to the identified probe type are filled in the operation interface;
after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the target body organ, the examination parameters corresponding to the target body organ are displayed in an operation interface; or after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the abdomen, the examination parameters corresponding to the abdomen are displayed in an operation interface.
Optionally, the processor is further configured to: responding to an adjusting instruction triggered by an operator, and determining an adjusted target inspection parameter according to an adjusting value of the adjusted target inspection parameter in the adjusting instruction;
and adjusting the current target inspection parameters of the probe type into the adjusted target inspection parameters.
Optionally, the processor is specifically configured to:
extracting the characteristics of the image scanned by the probe type by adopting a first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features of the plurality of sampling rates, and fusing the weighted features of the plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features after secondary weighting;
and extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
The processor is specifically configured to:
wherein the first convolution layer and the second convolution layer have the same structure, and the processing procedure comprises the following steps:
performing convolution processing on the input of the convolutional layer to obtain a feature after convolution, performing convolution pooling processing on the feature after convolution to obtain a pooled feature, and performing jump connection processing on the pooled feature to obtain the output of the convolutional layer;
the first attention mechanism and the second attention mechanism are identical in structure, and the processing procedures comprise:
performing channel attention processing on the input of the attention mechanism to obtain the characteristics after the channel processing, performing space attention processing on the input of the attention mechanism to obtain the characteristics after the space processing, and performing convolution processing on the input of the attention mechanism to obtain the gating characteristics;
fusing the channel processed features and the space processed features to obtain fused features; and carrying out weighted summation on the fused features and the gating features to obtain the output of the attention mechanism.
In an exemplary embodiment, a storage medium comprising instructions, such as a memory comprising instructions, executable by a processor of an electronic device mounted on a train to perform the above-described ultrasound device operating method is also provided. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
The embodiment of the present invention further provides a computer program product, which, when running on an electronic device installed on a train, enables the electronic device installed on the train to execute a working method for implementing any one of the above ultrasonic devices according to the embodiments of the present invention.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (10)

1. An ultrasound device, comprising: the device comprises a camera, a probe interface, a display and a processor;
the camera is used for shooting an image of the probe displayed by an operator;
the probe interface is used for accessing various types of probes;
the processor is used for acquiring the image which is shot by the camera and contains the probe, and identifying the type of the probe in the image containing the probe; adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type; acquiring an image of probe type scanning, and identifying a target body organ which an operator wants to detect in the image of probe type scanning;
adjusting the examination parameters of the probe type to the examination parameters corresponding to the target body organ, so that an operator can scan the target body organ by using the probe type of the examination parameters corresponding to the target body organ; or if the body position of the target body organ is in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameter of the probe type to the examination parameter corresponding to the abdomen, so that the operator can scan the target body organ by using the probe type of the examination parameter corresponding to the abdomen;
the display is used for displaying an image formed by scanning the target body organ by using the probe type of the examination parameter corresponding to the target body organ.
2. The ultrasound device of claim 1, wherein the processor is further configured to:
and determining the identified target body organ as the body organ which can be checked by the probe type.
3. The ultrasound device of claim 1, wherein after acquiring the image containing the probe taken by the camera, the method further comprises:
identifying the type of the probe and the model of the type of the probe in an image containing the probe;
and adjusting the operation parameters of the ultrasonic equipment into the operation parameters corresponding to the identified probe type and the model of the probe type.
4. The ultrasound device of claim 1, wherein the processor is further configured to: after the probe type in the image containing the probe is identified, highlighting the identified probe type in the operation interface;
after identifying a target body organ contained in the image scanned by the probe, highlighting the identified target body organ in the operation interface;
after the operation parameters of the ultrasonic equipment are adjusted to the operation parameters corresponding to the identified probe type, the operation parameters corresponding to the identified probe type are filled in the operation interface;
after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the target body organ, the examination parameters corresponding to the target body organ are displayed in an operation interface; or after the examination parameters of the probe type are adjusted to the examination parameters corresponding to the abdomen, the examination parameters corresponding to the abdomen are displayed in an operation interface.
5. The ultrasound device according to any of claims 1 to 4, wherein the processor is specifically configured to:
extracting the characteristics of the image scanned by the probe type by adopting a first convolution layer, and weighting the extracted characteristics by adopting a first attention mechanism to obtain weighted characteristics;
sampling the weighted features by adopting a plurality of sampling rates to obtain weighted features of the plurality of sampling rates, and fusing the weighted features of the plurality of sampling rates to obtain fused features;
weighting the fusion features by adopting a second attention mechanism to obtain fusion features after secondary weighting;
and extracting the fusion characteristics after the secondary weighting by adopting the second convolution layer, and determining the target body organ which the operator wants to detect according to the extracted fusion characteristics after the secondary weighting.
6. The ultrasound device of claim 5, wherein the processor is specifically configured to:
wherein the first convolution layer and the second convolution layer have the same structure, and the processing procedure comprises the following steps:
performing convolution processing on the input of the convolutional layer to obtain a feature after convolution, performing convolution pooling processing on the feature after convolution to obtain a pooled feature, and performing jump connection processing on the pooled feature to obtain the output of the convolutional layer;
the first attention mechanism and the second attention mechanism are identical in structure, and the processing procedures comprise:
performing channel attention processing on the input of the attention mechanism to obtain the characteristics after the channel processing, performing space attention processing on the input of the attention mechanism to obtain the characteristics after the space processing, and performing convolution processing on the input of the attention mechanism to obtain the gating characteristics;
fusing the channel processed features and the space processed features to obtain fused features; and carrying out weighted summation on the fused features and the gating features to obtain the output of the attention mechanism.
7. An ultrasonic device operating method, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a convex array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the convex array probe;
after the convex array probe starts to work, acquiring an image scanned by the convex array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the convex array probe;
if the body position of the target body organ is identified to be in the abdomen or the target body organ is an organ in the urinary system, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the abdomen, so that an operator can scan the target body organ by using the convex array probe of the examination parameters corresponding to the abdomen; or
If the target body organ is identified to be the liver, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the liver, so that an operator can scan the liver by using the convex array probe of the examination parameters corresponding to the liver; or if the target body organ is identified as the gallbladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the gallbladder, so that an operator can scan the gallbladder by using the convex array probe of the inspection parameters corresponding to the gallbladder; or if the target body organ is identified to be pancreas, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the pancreas, so that the operator can scan the pancreas by using the convex array probe with the inspection parameters corresponding to the pancreas; or if the target body organ is identified as the spleen, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the spleen, so that the operator can scan the spleen by using the convex array probe with the inspection parameters corresponding to the spleen; or if the target body organ is identified as a kidney, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the kidney, so that an operator can scan the kidney by using the convex array probe of the examination parameters corresponding to the kidney; or if the target body organ is identified to be the bladder, adjusting the inspection parameters of the convex array probe to the inspection parameters corresponding to the bladder so that the operator can scan the bladder by using the convex array probe of the inspection parameters corresponding to the bladder; or if the target body organ is identified as the prostate, adjusting the examination parameters of the convex array probe to the examination parameters corresponding to the prostate so that the operator can scan the prostate by using the convex array probe with the examination parameters corresponding to the prostate.
8. An ultrasonic device operating method, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a linear array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the linear array probe;
after the linear array probe starts to work, acquiring an image scanned by the linear array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the linear array probe;
if the target body organ is identified to be the thyroid gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the thyroid gland, so that an operator can scan the thyroid gland by using the linear array probe of the inspection parameters corresponding to the thyroid gland; or if the target body organ is identified as a blood vessel, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the blood vessel so that an operator can scan the blood vessel by using the linear array probe with the inspection parameters corresponding to the blood vessel; or if the target body organ is identified to be the mammary gland, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the mammary gland so that an operator can scan the mammary gland by using the linear array probe with the inspection parameters corresponding to the mammary gland; or if the target body organ is identified as the lymph node, adjusting the inspection parameters of the linear array probe to the inspection parameters corresponding to the lymph node so that the operator can scan the lymph node by using the linear array probe with the inspection parameters corresponding to the lymph node.
9. An ultrasonic device operating method, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the type of the probe in the image containing the probe;
if the identified probe type is a phased array probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the phased array probe;
after the phased array probe starts to work, acquiring an image scanned by the phased array probe, and identifying a target body organ which an operator wants to detect in the image scanned by the phased array probe;
and if the target body organ is identified as the heart, adjusting the examination parameters of the phased array probe to the examination parameters corresponding to the heart so that the operator can scan the heart by using the phased array probe with the examination parameters corresponding to the heart.
10. An ultrasonic device operating method, comprising:
acquiring an image containing a probe through a camera on ultrasonic equipment, and identifying the intracavity probe in the image containing the probe;
if the identified probe type is an intracavity probe, adjusting the operation parameters of the ultrasonic equipment to the operation parameters corresponding to the intracavity probe;
after the intracavity probe starts to work, acquiring an image scanned by the intracavity probe, and identifying a target body organ which an operator wants to detect in the image scanned by the intracavity probe;
if the target body organ is identified to be the uterus, adjusting the examination parameters of the intracavity probe to the examination parameters corresponding to the uterus, so that an operator can scan the uterus by using the intracavity probe with the examination parameters corresponding to the uterus; or if the target body organ is identified as the ovary, adjusting the inspection parameters of the intracavity probe to the inspection parameters corresponding to the ovary, so that the operator can scan the ovary by using the intracavity probe with the inspection parameters corresponding to the ovary.
CN202111145530.1A 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof Active CN113855072B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111145530.1A CN113855072B (en) 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111145530.1A CN113855072B (en) 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof

Publications (2)

Publication Number Publication Date
CN113855072A true CN113855072A (en) 2021-12-31
CN113855072B CN113855072B (en) 2023-09-12

Family

ID=78992097

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111145530.1A Active CN113855072B (en) 2021-09-28 2021-09-28 Ultrasonic equipment and working method thereof

Country Status (1)

Country Link
CN (1) CN113855072B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114533119A (en) * 2022-03-03 2022-05-27 意领科技有限公司 Method and system for expanding functions of ultrasonic imaging device
CN116058871A (en) * 2023-03-24 2023-05-05 深圳鲲为科技有限公司 Ultrasonic inspection processing method and ultrasonic inspection equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295483A (en) * 1990-05-11 1994-03-22 Christopher Nowacki Locating target in human body
US5810007A (en) * 1995-07-26 1998-09-22 Associates Of The Joint Center For Radiation Therapy, Inc. Ultrasound localization and image fusion for the treatment of prostate cancer
US20150366535A1 (en) * 2011-10-10 2015-12-24 Tractus Corporation Method, apparatus and system for complete examination of tissue with hand-held imaging devices having mounted cameras
CN110584712A (en) * 2019-09-17 2019-12-20 青岛海信医疗设备股份有限公司 Fetal face imaging method and device and storage medium
CN111973228A (en) * 2020-06-17 2020-11-24 谈斯聪 B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform
JP2021029675A (en) * 2019-08-26 2021-03-01 キヤノン株式会社 Information processor, inspection system, and information processing method
CN113116377A (en) * 2019-12-31 2021-07-16 无锡祥生医疗科技股份有限公司 Ultrasonic imaging navigation method, ultrasonic device and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5295483A (en) * 1990-05-11 1994-03-22 Christopher Nowacki Locating target in human body
US5810007A (en) * 1995-07-26 1998-09-22 Associates Of The Joint Center For Radiation Therapy, Inc. Ultrasound localization and image fusion for the treatment of prostate cancer
US20150366535A1 (en) * 2011-10-10 2015-12-24 Tractus Corporation Method, apparatus and system for complete examination of tissue with hand-held imaging devices having mounted cameras
JP2021029675A (en) * 2019-08-26 2021-03-01 キヤノン株式会社 Information processor, inspection system, and information processing method
CN110584712A (en) * 2019-09-17 2019-12-20 青岛海信医疗设备股份有限公司 Fetal face imaging method and device and storage medium
CN113116377A (en) * 2019-12-31 2021-07-16 无锡祥生医疗科技股份有限公司 Ultrasonic imaging navigation method, ultrasonic device and storage medium
CN111973228A (en) * 2020-06-17 2020-11-24 谈斯聪 B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LI, XM 等: "Design of Control System for Monitoring Camera Cleaning Robot", 《APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY》 *
陈公白, 潘永辉.: "脑内超声探查——侧射型脑针式超声探头的临床应用", 《上海第一医学院学报》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114533119A (en) * 2022-03-03 2022-05-27 意领科技有限公司 Method and system for expanding functions of ultrasonic imaging device
WO2023165119A1 (en) * 2022-03-03 2023-09-07 意领科技有限公司 Method and system for expanding function of ultrasonic imaging device
CN116058871A (en) * 2023-03-24 2023-05-05 深圳鲲为科技有限公司 Ultrasonic inspection processing method and ultrasonic inspection equipment

Also Published As

Publication number Publication date
CN113855072B (en) 2023-09-12

Similar Documents

Publication Publication Date Title
CN112215843B (en) Ultrasonic intelligent imaging navigation method and device, ultrasonic equipment and storage medium
CN108882916B (en) Ultrasonic blood flow parameter display method and ultrasonic imaging system thereof
KR102693899B1 (en) Representation of the target during ultrasonic probe aiming
US10893850B2 (en) Methods and apparatuses for guiding collection of ultrasound data using motion and/or orientation data
CN113855072B (en) Ultrasonic equipment and working method thereof
TW201923776A (en) Quality indicators for collection of and automated measurement on ultrasound images
JP7362354B2 (en) Information processing device, inspection system and information processing method
US20100249595A1 (en) System and method for automatic calibration of tracked ultrasound
US20200046322A1 (en) Methods and apparatuses for determining and displaying locations on images of body portions based on ultrasound data
CN112541928A (en) Network training method and device, image segmentation method and device and electronic equipment
CN111971688A (en) Ultrasound system with artificial neural network for retrieving imaging parameter settings of relapsing patients
WO2020146244A1 (en) Methods and apparatuses for ultrasound data collection
CN106580366A (en) Wireless probe, ultrasonic imaging apparatus, and method for controlling the same
WO2018195946A1 (en) Method and device for displaying ultrasonic image, and storage medium
JP2021506470A (en) Echo window artifact classification and visual indicators for ultrasound systems
CN107198542A (en) Alarm for checking mode ultrasonic imaging is aided in
EP4061230B1 (en) Systems and methods for obtaining medical ultrasound images
JP2021029676A (en) Information processor, inspection system, and information processing method
JP2023549093A (en) Robust segmentation with high-level image understanding
CN110418610A (en) Determine guidance signal and for providing the system of guidance for ultrasonic hand-held energy converter
EP3520704B1 (en) Ultrasound diagnosis apparatus and method of controlling the same
US11744545B2 (en) Ultrasonic diagnosis system configured to generate probe operation support information, and operation support method
CN115666400A (en) Assisting a user in performing a medical ultrasound examination
CN112652390B (en) Ultrasonic image adjustment self-defining method, storage medium and ultrasonic diagnostic equipment
CN115886877A (en) Guiding method for ultrasonic scanning and ultrasonic imaging system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant